Ostatnimi czasy Google Analytics nie wycina z ruchu organicznego, który widzimy w panelu całego ruchu botów.
Możemy temu zaradzić, dodając do pliku .htaccess w naszym głównym folderze listę IP botów, które nie powinny gościć na naszym serwerze:
deny from 78.139.5.228 deny from amazonaws.com grapeshot.co.uk lipperhey.com #012 Smile Communications LTD: deny from 87.68.240.0/20 #1&1 Internet AG: deny from 74.208.0.0/16 88.208.192.0/18 104.254.244.0/22 212.227.0.0/16 #23Media GmbH: deny from 212.83.32.0/19 #2DAY Telecom LLP: deny from 46.34.192.0/22 #334,Udyog Vihar: deny from 116.203.73.0/24 #365 Online technology joint stock company: deny from 103.199.16.0/22 #AT&T Services, Inc: deny from 107.192.0.0/12 #Abovenet Communications, Inc: deny from 50.7.176.0/22 208.184.0.0/15 #ACENET, INC: deny from 68.171.208.0/20 #ACTIVE-SERVERS Dennis Rainer Warnholz trading as active-servers.com,DE: deny from 31.214.240.0/21 #Adform ApS: deny from 37.157.4.0/23 37.157.6.0/23 #Administracion Nacional de Telecomunicaciones: deny from 167.58.0.0/20 #ADVANCEDHOSTERS LIMITED: deny from 46.229.160.0/20 #Akamai Technologies, Inc: deny from 104.96.32.0/20 104.103.80.0/20 #Aktsiaselts WaveCom: deny from 46.22.208.0/20 #Alexander Mulgin Serginovic: deny from 185.86.76.0/22 #ALISTAR SECURITY SRL: deny from 176.126.252.0/22 #ALOG SOLUCOES DE TECNOLOGIA EM INFORMATICA S.A: deny from 177.126.160.0/20 #Alpha Net Telecom Ltd: deny from 217.117.250.0/23 #Amazon.com, Inc: deny from 52.4.0.0/14 52.20.0.0/14 52.70.0.0/15 54.64.0.0/15 54.72.0.0/16 54.84.0.0/15 54.152.0.0/16 54.172.0.0/15 54.208.0.0/15 #Apple Inc: deny from 17.142.0.0/15 #Applied Technologies Internet SAS: deny from 62.161.94.0/24 #Argon Data Communication: deny from 103.31.250.0/24 #Arrival Communication, Inc: deny from 69.84.192.0/20 #Aruba S.p.A: deny from 93.186.248.0/21 #AS INFONET: deny from 84.52.0.0/18 #AS Number for CHINANET jiangsu province backbone: deny from 58.221.58.0/24 #AS-REGRU "Domain names registrar REG.RU", Ltd,RU: deny from 188.93.212.0/24 #Asre Enteghal Dadeha: deny from 188.34.0.0/17 #Associação Rede Nacional de Ensino e Pesquisa: deny from 200.133.0.0/18 #ATM S.A: deny from 212.7.220.0/24 #Automattic, Inc: deny from 192.0.83.0/24 192.0.86.0/24 192.0.99.0/24 192.0.100.0/24 #Axtel, S.A.B. de C.V: deny from 187.176.117.0/24 189.208.190.0/24 #B2 Net Solutions Inc: deny from 107.152.128.0/17 172.245.0.0/22 192.241.64.0/18 #Baidu (Hong Kong) Limited: deny from 185.10.107.0/24 #Bangalore Broadband Network Pvt Ltd: deny from 43.247.156.0/24 #Banglalion Communications Ltd: deny from 180.149.19.0/24 #BEGET-AS Beget Ltd,RU: deny from 5.101.156.0/24 #Beijing Baidu Netcom Science and Technology Co., Ltd: deny from 104.193.88.0/24 131.161.8.0/24 131.161.10.0/24 185.10.104.0/24 180.76.15.0/24 202.46.48.0/24 202.46.49.0/24 202.46.50.0/24 202.46.51.0/24 202.46.52.0/24 202.46.53.0/24 202.46.54.0/24 202.46.55.0/24 202.46.56.0/24 202.46.57.0/24 202.46.58.0/24 #Beijing Dian-Xin-Tong Network Technologies Co., Ltd: deny from 124.192.96.0/19 124.200.224.0/19 #Beijing Shidaihongyuan Network Communication Co.,Ltd: deny from 118.193.12.0/24 #Beyond The Network America, Inc: deny from 8.36.40.0/21 63.216.156.0/24 #Bezeq International-Ltd: deny from 79.176.96.0/19 85.130.136.0/21 #bilby.builtwith.com: deny from 142.4.192.0/19 #Binariang Berhad: deny from 14.192.192.0/18 #BitDefender SRL: deny from 81.161.59.0/24 #Biznes-Host.pl sp. z o.o: deny from 91.228.196.0/22 #Boston University: deny from 204.8.152.0/21 #Brasil Telecom S/A - Filial Distrito Federal: deny from 189.75.0.0/18 #Bredband2 AB: deny from 83.233.0.0/16 #Broadnet AS: deny from 193.90.0.0/16 #BruNet - Telekom Brunei Berhad: deny from 61.6.236.0/22 #Brutele SC: deny from 109.88.80.0/20 #BT Public Internet Service: deny from 81.128.0.0/11 #Bytemark Limited: deny from 5.28.56.0/21 #CachedNet LLC: deny from 104.160.5.0/24 104.160.6.0/24 104.160.7.0/24 104.160.8.0/24 104.160.29.0/24 #California Education and Research Federation Network: deny from 206.16.128.0/20 #CAMTEL: deny from 154.72.168.0/23 #CANTV Servicios, Venezuela: deny from 186.90.224.0/19 186.91.224.0/19 186.95.32.0/19 190.77.192.0/19 190.198.192.0/19 190.206.96.0/19 201.243.32.0/19 #Carpathia Hosting, Inc: deny from 173.245.112.0/22 #Celcom Internet Service Provider: deny from 183.171.26.0/24 #Centrilogic, Inc: deny from 192.198.80.0/20 #Changsha: deny from 117.78.0.0/20 #China Mobile communications corporation: deny from 39.187.192.0/19 42.62.64.0/18 120.198.0.0/16 223.73.0.0/16 223.74.190.0/24 #China Networks Inter-Exchange: deny from 59.151.96.0/19 106.120.224.0/19 124.207.128.0/17 124.254.32.0/19 219.143.0.0/16 #China Unicom IP network China169 Guangdong province: deny from 58.248.0.0/13 220.243.0.0/17 #China Unicom Shanghai network: deny from 140.207.198.0/24 #China Telecom: deny from 101.226.0.0/16 116.228.0.0/16 180.153.0.0/16 #China TieTong Telecommunications Corporation: deny from 61.234.248.0/21 122.70.128.0/18 222.45.0.0/16 #CHINANET SiChuan Telecom Internet Data Center: deny from 118.123.8.0/21 #Choopa, LLC: deny from 45.32.192.0/20 104.156.228.0/22 104.207.148.0/22 104.238.140.0/23 104.243.40.0/22 185.92.220.0/23 216.155.128.0/19 #Cirrus Tech Ltd: deny from 192.185.128.0/18 199.103.60.0/22 #Cisco Systems Ironport Division: deny from 208.90.56.0/23 #CIZGI TELEKOMUNIKASYON ANONIM SIRKETI: deny from 94.73.156.0/24 #ClaraNET LTD: deny from 176.61.144.0/21 #Closed Joint Stock Company TransTeleCom: deny from 62.33.0.0/16 80.237.0.0/17 #CloudFlare, Inc: deny from 103.21.244.0/22 103.22.200.0/22 103.31.4.0/22 104.16.0.0/12 104.24.144.0/20 108.162.192.0/18 141.101.64.0/18 162.158.0.0/15 172.64.0.0/13 173.245.48.0/20 188.114.96.0/20 190.93.240.0/20 197.234.240.0/22 198.41.128.0/17 199.27.128.0/21 2400:cb00::/32 2405:8100::/32 2405:b500::/32 2606:4700::/32 2803:f800::/32 #CNCGROUP China: deny from 27.8.0.0/13 27.192.0.0/11 36.248.0.0/14 60.13.128.0/17 61.134.192.0/18 61.135.192.0/18 61.156.0.0/16 101.16.0.0/12 101.64.0.0/13 110.52.0.0/15 111.160.0.0/13 111.206.0.0/18 112.111.0.0/16 112.224.0.0/11 118.186.216.0/21 118.244.224.0/19 122.96.0.0/15 123.125.64.0/18 123.138.0.0/15 182.112.0.0/12 183.184.0.0/13 210.75.96.0/20 219.156.0.0/15 221.204.0.0/15 #Codero: deny from 64.150.176.0/20 68.168.96.0/20 #Cogent Communications: deny from 38.18.64.0/19 38.99.82.0/24 130.117.119.0/24 149.12.0.0/15 162.244.8.0/21 192.240.104.0/22 #Cogswell Enterprises Inc: deny from 209.188.80.0/20 #Colo4, LLC: deny from 74.50.48.0/20 #Colocall Ltd: deny from 62.149.0.0/19 #ColoCrossing: deny from 5.226.171.0/24 23.94.16.0/20 23.94.76.0/24 23.94.112.0/20 23.94.160.0/19 23.94.224.0/20 23.95.0.0/20 23.249.171.0/24 75.127.1.0/24 75.127.5.0/24 104.168.24.0/22 104.168.84.0/22 107.173.0.0/16 107.175.0.0/17 172.245.64.0/19 172.245.216.0/22 192.3.128.0/21 192.3.136.0/21 192.210.166.0/24 192.210.176.0/22 192.210.196.0/22 198.12.96.0/20 198.46.128.0/24 199.21.115.0/24 206.217.131.0/24 #ColoUp: deny from 162.245.83.0/24 #Comcast Cable Communications, Inc: deny from 75.144.0.0/13 #COMMCORP COMUNICACOES LTDA: deny from 186.211.208.0/21 #Comodo CA Ltd: deny from 91.209.196.0/24 #Computer Network Information Center: deny from 159.226.43.0/24 159.226.94.0/23 #Confluence Networks Inc: deny from 208.73.210.0/24 208.73.211.0/24 #Conformal Systems, LLC: deny from 204.124.83.0/24 #Contabo GmbH: deny from 5.189.176.0/20 5.189.128.0/20 37.139.52.0/24 213.136.74.0/23 #CONTENT DELIVERY NETWORK LTD: deny from 37.57.231.0/24 109.87.68.0/23 109.86.80.0/21 178.150.15.0/24 178.150.49.0/24 #Contina deny from 45.45.157.0/24 #Continuum Data Centers, LLC: deny from 199.244.88.0/22 #Core NAP, L.P: deny from 208.123.64.0/19 #CORPORACION NACIONAL DE TELECOMUNICACIONES - CNT EP: deny from 181.211.144.0/22 #Cote d'Ivoire Telecom: deny from 41.66.28.0/24 #Cox Communications Inc: deny from 72.215.192.0/20 #Cyber Cast International, S.A: deny from 200.74.246.0/24 #Cyberdyne S.A: deny from 46.246.32.0/19 #CyrusOne LLC: deny from 192.185.64.0/18 #DataClub S.A: deny from 46.183.216.0/21 #Data Communication Business Group: deny from 1.34.0.0/16 1.160.0.0/16 1.161.0.0/16 1.162.0.0/16 1.165.0.0/16 1.169.0.0/16 36.224.0.0/16 36.225.0.0/16 36.227.0.0/16 36.229.0.0/16 36.230.0.0/16 36.233.0.0/16 36.234.0.0/16 36.235.0.0/16 36.239.0.0/16 59.115.0.0/16 59.124.0.0/16 61.223.0.0/16 111.241.0.0/16 111.248.0.0/16 111.251.0.0/16 114.37.0.0/16 118.160.0.0/16 118.161.0.0/16 118.168.0.0/16 203.69.0.0/16 211.21.0.0/16 220.136.0.0/16 #DataShack, LC: deny from 74.91.16.0/20 107.150.32.0/19 142.54.160.0/19 192.187.96.0/19 198.204.224.0/19 #DataWeb Global Group B.V: deny from 46.229.160.0/20 192.243.48.0/20 #Daum Communication Co.,LTD: deny from 203.133.168.0/24 203.133.169.0/24 203.133.170.0/24 203.133.171.0/24 #DC74 LLC: deny from 198.37.112.0/21 #DediPower Managed Hosting Limited: deny from 46.236.0.0/19 #Deninet KFT: deny from 84.21.7.0/24 178.238.208.0/21 #DEVHD, INC: deny from 8.29.198.0/24 #Digicube sas: deny from 95.130.8.0/21 #Digital Network Associates Pvt Ltd: deny from 150.107.23.0/24 #Digital Ocean, Inc: deny from 45.55.64.0/19 45.55.128.0/18 45.55.192.0/18 95.85.0.0/18 104.131.0.0/16 104.131.192.0/19 104.236.0.0/16 104.236.0.0/18 104.236.192.0/18 146.185.128.0/19 162.243.0.0/17 178.62.64.0/18 178.62.192.0/18 188.166.0.0/16 #Digiweb ltd: deny from 89.234.64.0/18 #Disk Group Ltd: deny from 185.36.100.0/24 #DoclerWeb Kft: deny from 185.51.64.0/22 #Ecatel Network: deny from 80.82.65.0/24 89.248.170.0/23 93.174.88.0/21 94.102.48.0/20 #EdgeCast Networks, Inc: deny from 108.161.241.0/24 #Eircom Limited: deny from 86.40.0.0/13 95.44.0.0/15 #eNET Inc: deny from 64.79.64.0/19 207.182.128.0/19 209.190.0.0/17 #Enzu Inc: deny from 23.88.0.0/18 23.244.0.0/15 198.56.128.0/18 198.98.120.0/22 #Esecurity S.A: deny from 31.220.0.0/22 #First Colo GmbH: deny from 212.224.64.0/18 #Foilhat LLC: deny from 178.73.218.0/23 #FOP Molodnyak Ruslan Petrovich: deny from 46.174.64.0/22 #FOP Tokarchuk Oleksandr Stepanovich: deny from 91.210.144.0/22 #Foreningen for digitala fri- och rattigheter: deny from 171.25.193.0/24 #FORTUNIX NETWORKS L.P: deny from 5.149.250.0/23 #Free Mobile SAS: deny from 37.160.0.0/12 #GARM Technologies Ltd: deny from 195.28.26.0/24 #Gazon Communications India Limited: deny from 103.211.60.0/24 #GEOCITY NETWORK SOLUTIONS PVT LTD: deny from 45.248.28.0/22 #GIGAS HOSTING S.L: deny from 5.56.60.0/22 #Gigatrans LTD: deny from 185.46.148.0/22 #gigavenue.com.us: deny from 208.66.96.0/21 208.78.80.0/21 #GHOSTnet GmbH: deny from 94.103.160.0/20 #Globacom Limited: deny from 197.211.52.0/23 #Global Village Telecom: deny from 177.40.192.0/19 177.206.84.0/22 189.115.192.0/20 #Globalwave Telecom: deny from 189.90.48.0/22 #Globe Telecom Inc: deny from 180.191.76.0/22 #GMO Internet,Inc: deny from 133.130.64.0/18 #GoDaddy.com, LLC: deny from 50.62.160.0/22 173.201.140.0/22 184.168.192.0/22 184.168.200.0/22 184.168.221.0/24 #Golden Telecom LLC: deny from 212.109.32.0/19 #Google Inc: deny from 104.154.0.0/15 104.196.0.0/14 #GorillaServers, Inc: deny from 192.154.110.0/23 #Greysom Limited: deny from 159.253.176.0/22 #Guangdong Mobile Communication Co.Ltd: deny from 111.13.0.0/17 112.5.0.0/16 117.169.0.0/17 117.169.0.0/17 117.177.240.0/24 119.147.144.0/20 120.203.0.0/16 183.218.0.0/16 183.222.0.0/16 211.141.80.0/20 211.141.128.0/19 218.204.128.0/19 221.181.0.0/18 #Gtd Internet S.A: deny from 201.148.105.0/24 #Gyron Internet Ltd: deny from 89.145.64.0/18 #Haldex ltd: deny from 46.229.160.0/20 88.208.0.0/18 #Hanaro Telecom Inc: deny from 1.232.0.0/13 1.240.0.0/13 116.127.0.0/16 211.59.0.0/19 #Hangzhou Alibaba Advertising Co.,Ltd: deny from 42.120.0.0/16 #HARRISONVILLE TELEPHONE: deny from 65.87.48.0/20 #Hathway IP Over Cable Internet: deny from 27.5.160.0/19 #HEAnet Limited: deny from 193.1.0.0/16 #Henan Mobile Communications Co.,Ltd: deny from 120.194.0.0/16 #Henderson Data Centre Limited deny from 203.88.160.0/20 #Hetzner Online AG: deny from 5.9.0.0/16 46.4.0.0/16 78.46.0.0/15 85.10.192.0/18 88.198.0.0/16 91.220.49.0/24 91.233.8.0/22 136.243.0.0/16 138.201.0.0/16 144.76.0.0/16 144.76.136.0/24 144.76.141.0/24 148.251.0.0/16 148.251.36.0/24 176.9.0.0/16 176.9.192.0/24 176.9.195.0/24 176.102.168.0/21 178.63.0.0/16 185.12.64.0/22 185.50.120.0/23 185.107.52.0/22 185.126.28.0/22 185.136.140.0/23 185.141.200.0/24 188.40.0.0/16 193.25.170.0/23 193.110.6.0/23 193.223.77.0/24 194.42.180.0/22 194.42.184.0/22 194.145.226.0/24 195.60.226.0/24 195.248.224.0/24 197.242.84.0/22 213.133.96.0/19 213.169.144.0/22 213.239.192.0/18 2a01:4f8::/29 2a06:be80::/29 #HitMe.pl Marek Bajerski: deny from 188.116.52.0/24 #HK Broadband Network Ltd: deny from 14.136.236.0/24 #Hoshin Multimedia Center Inc: deny from 203.204.205.0/24 #Host Europe GmbH: deny from 5.35.224.0/19 79.170.40.0/21 91.109.8.0/21 #Hosting Internet Hizmetleri Sanayi ve Ticaret Anonim Sirke: deny from 212.68.51.0/24 #Hosting Solutions International, Inc: deny from 209.126.96.0/19 #Host NIT Inc: deny from 172.86.64.0/19 #HostPalace Network Services: deny from 185.63.252.0/22 #Hostpro Ltd: deny from 195.191.25.0/24 #Hostway Deutschland GmbH: deny from 83.246.64.0/18 #Hostwinds LLC: deny from 104.168.128.0/17 #Hurricane Electric, Inc: deny from 23.92.24.0/22 45.79.64.0/18 65.19.128.0/18 72.52.64.0/18 107.178.40.0/21 173.255.240.0/20 184.104.0.0/15 216.218.128.0/17 #HT: deny from 104.243.128.0/20 #IBM Deutschland GmbH: deny from 206.253.226.0/24 #IDC, China Telecommunications Corporation: deny from 211.157.128.0/18 220.181.32.0/19 220.181.96.0/19 #IDC ShanXi China Mobile communications corporation: deny from 183.203.0.0/19 #IFWE INC: deny from 67.221.174.0/24 #ilika.net LLC: deny from 162.211.120.0/21 #iParadigms, LLC: deny from 38.111.147.0/24 #Incero LLC: deny from 23.29.122.0/24 23.227.190.0/24 #Info Data Center Ltd: deny from 195.88.75.0/24 #Infolink: deny from 5.158.236.0/23 #Inetmar internet Hizmetleri San. Tic. Ltd. Sti: deny from 85.95.229.0/24 #InMotion Hosting, Inc: deny from 70.39.250.0/23 192.145.238.0/24 #Input Output Flood LLC: deny from 23.226.72.0/21 107.167.64.0/19 148.163.93.0/24 162.218.115.0/24 184.164.64.0/19 192.110.163.0/24 192.110.164.0/24 199.167.132.0/23 #Integral Ad Science, Inc: deny from 198.148.15.0/24 #Intek-M LLC: deny from 31.135.64.0/20 #Intelig Telecomunicações Ltda: deny from 201.70.0.0/17 #Inter Connects Inc: deny from 5.157.38.0/24 151.237.177.0/24 #intergenia AG: deny from 85.25.185.0/24 #Internap Network Services Corporation deny from 64.74.208.0/20 72.5.64.0/20 74.217.144.0/20 #Internet Unie Services B.V: deny from 185.68.180.0/22 #INTERRA telecommunications group, Ltd: deny from 94.190.0.0/18 #Intervip Networks Ltda: deny from 187.73.224.0/21 187.73.232.0/21 #INULOGIC SARL: deny from 185.81.156.0/22 #IPTelligent LLC: deny from 96.44.128.0/18 #Iskratelecom CJSC: deny from 79.172.64.0/18 #ISP "Fregat" Ltd: deny from 212.115.224.0/19 #IT Systems LLC: deny from 213.133.160.0/19 #ITL Company: deny from 46.28.64.0/21 195.28.182.0/23 195.245.112.0/23 217.12.192.0/19 #Jay.net a/s: deny from 81.7.128.0/18 86.58.128.0/17 #JSC "ISPsystem": deny from 185.63.188.0/22 #JSC Mediasoft ekspert: deny from 194.87.144.0/22 #JSC "Ukrtelecom": deny from 92.113.0.0/18 93.170.186.0/24 95.47.137.0/24 #JSC "Zap-Sib TransTeleCom", Novosibirsk: deny from 94.251.0.0/17 #Kaia Global Networks Ltd: deny from 79.141.160.0/24 #kbro CO. Ltd: deny from 123.192.160.0/21 123.192.168.0/22 #"Kyivstar" PJSC: deny from 5.248.0.0/16 37.115.0.0/16 37.229.0.0/16 46.118.0.0/15 46.185.0.0/17 46.211.0.0/16 81.23.16.0/20 94.153.0.0/16 109.162.0.0/17 134.249.0.0/16 176.8.0.0/16 178.137.0.0/16 188.163.0.0/17 193.41.60.0/22 2a02:2378::/32 #Korea Telecom: deny from 43.241.44.0/24 121.144.0.0/13 211.192.0.0/13 #KPN B.V: deny from 84.39.0.0/19 #Krek Ltd: deny from 93.170.128.0/22 176.8.0.0/16 178.137.0.0/16 188.163.64.0/18 193.41.60.0/22 #Kyivski Telekomunikatsiyni Merezhi LLC: deny from 77.120.128.0/18 93.76.192.0/18 93.77.128.0/19 #LeaseWeb: deny from 5.79.64.0/18 37.48.64.0/18 62.212.64.0/19 85.17.0.0/16 95.211.0.0/16 103.41.176.0/23 104.200.78.0/24 178.162.192.0/19 199.115.112.0/21 207.244.64.0/18 209.58.128.0/20 #LG DACOM Corporation: deny from 60.196.0.0/15 210.97.192.0/22 #Level 3 Communications, Inc: deny from 208.50.0.0/17 #LES.NET: deny from 199.87.152.0/21 #Lightstream Transmission and Telecom Inc: deny from 107.189.60.0/24 #Limestone Networks, Inc: deny from 63.143.32.0/19 #Limited liability company Mail.Ru: deny from 188.93.56.0/21 217.69.128.0/20 #Link3 Technologies Ltd: deny from 27.147.224.0/21 #Linode, LLC: deny from 198.58.96.0/19 #LLC Management Company "Svyaz": deny from 83.166.240.0/20 #LLC "Multiscan": deny from 87.228.64.0/18 89.169.0.0/17 #Locaweb Serviços de Internet S/A: deny from 186.202.160.0/19 186.202.0.0/19 #Login, Inc: deny from 204.17.32.0/19 #Long Distance & Mobile Business Group: deny from 111.81.0.0/16 #LS FIBERNET PRIVATE LIMITED: deny from 43.227.130.0/24 #M247 Ltd: deny from 77.243.176.0/20 83.143.240.0/22 #Majordomo llc: deny from 185.84.108.0/22 #Massachusetts Institute of Technology: deny from 18.181.0.0/20 #Master Internet s.r.o: deny from 77.93.192.0/19 #McAfee, Inc: deny from 161.69.160.0/22 #Media Ltd: deny from 77.50.0.0/17 #Media Temple, Inc: deny from 64.13.192.0/18 70.32.68.0/22 70.32.80.0/20 #Mediasift Limited: deny from 185.20.4.0/22 #MEO - SERVICOS DE COMUNICACOES E MULTIMEDIA S.A: deny from 85.240.0.0/13 #Microplex PTY LTD: deny from 122.105.144.0/20 #Microscan Computers Private Limited: deny from 111.125.219.0/24 #Microsoft Corporation: deny from 13.64.0.0/11 13.96.0.0/13 13.104.0.0/14 23.96.0.0/13 40.64.0.0/10 42.159.0.0/16 51.4.0.0/15 51.8.0.0/16 51.51.0.0/16 51.140.0.0/14 52.112.0.0/14 52.145.0.0/16 52.146.0.0/15 52.148.0.0/14 52.152.0.0/13 52.160.0.0/11 52.224.0.0/11 64.4.0.0/18 65.52.0.0/14 66.119.144.0/20 70.37.0.0/17 70.37.128.0/18 91.190.216.0/21 94.245.64.0/18 103.9.8.0/22 103.36.96.0/22 103.255.140.0/22 104.40.0.0/13 104.146.0.0/15 104.208.0.0/13 111.221.16.0/20 111.221.64.0/18 131.253.1.0/24 131.253.3.0/24 131.253.5.0/24 131.253.6.0/24 131.253.8.0/24 131.253.12.0/22 131.253.16.0/23 131.253.18.0/24 131.253.21.0/24 131.253.22.0/23 131.253.24.0/21 131.253.32.0/20 131.253.61.0/24 131.253.62.0/23 131.253.64.0/18 131.253.128.0/17 132.245.0.0/16 134.170.0.0/16 134.177.0.0/16 137.116.0.0/15 137.135.0.0/16 138.91.0.0/16 138.196.0.0/16 139.217.0.0/16 139.219.0.0/16 146.147.0.0/16 150.171.0.0/16 157.54.0.0/15 157.55.0.0/16 157.56.0.0/14 157.60.0.0/16 167.220.0.0/16 168.61.0.0/16 168.62.0.0/15 191.232.0.0/13 192.32.0.0/16 192.48.225.0/24 192.84.159.0/24 192.84.160.0/23 192.197.157.0/24 193.149.64.0/19 193.221.113.0/24 194.110.197.0/24 198.49.8.0/24 198.105.232.0/22 198.200.130.0/24 198.206.164.0/24 199.103.90.0/23 199.103.122.0/24 199.242.32.0/20 199.242.48.0/21 199.60.28.0/24 199.74.210.0/24 202.89.224.0/20 204.13.120.0/21 204.14.180.0/22 204.152.18.0/23 204.152.140.0/23 204.79.135.0/24 204.79.179.0/24 204.79.180.0/23 204.79.188.0/24 204.79.195.0/24 204.79.196.0/23 204.79.252.0/24 204.231.192.0/24 204.231.194.0/23 204.231.196.0/22 204.231.200.0/21 204.231.208.0/20 204.231.236.0/24 205.174.224.0/20 206.191.224.0/19 207.46.0.0/16 207.46.0.0/19 207.68.128.0/18 208.68.136.0/21 208.76.44.0/22 208.84.0.0/21 209.240.192.0/19 213.199.128.0/18 216.32.180.0/22 2001:489a:2000::/35 2001:67c:1020::/48 2001:df0:7::/48 2001:df0:d7::/48 2001:df0:d8::/48 2001:df0:d9::/48 2603:1000::/24 2620:0:30::/45 2620:10c:5000::/44 2620:1ec::/36 2801:80:1d0::/48 #Ministerio del Interior y de Seguridad Publica - Gobierno de Chile: deny from 163.247.0.0/16 #Mir Telematiki Ltd: deny from 91.237.249.0/24 158.255.0.0/24 #MNR Broadband Services Pvt. Ltd: deny from 103.50.148.0/24 #MO Internet,Inc: deny from 210.172.160.0/19 #MTS OJSC: deny from 80.247.96.0/20 #myLoc managed IT AG: deny from 5.199.128.0/20 31.184.224.0/24 85.14.240.0/20 93.186.192.0/20 #National Information Technology Authority Uganda: deny from 154.72.192.0/19 #National Internet Backbone: deny from 59.98.48.0/20 #National Sun Yat-sen University: deny from 140.117.0.0/16 #Navrang Internet Services Pvt Ltd: deny from 45.126.254.0/24 #Navy Network Information Center (NNIC): deny from 132.250.0.0/16 #Neohost.net: deny from 93.179.68.0/23 #NephoScale Inc: deny from 69.50.224.0/19 #Net Access Corporation: deny from 67.196.0.0/16 69.164.218.0/24 162.216.19.0/24 #Net By Net Holding LLC deny from 176.194.0.0/15 #NET Serviços de Comunicação S.A: deny from 177.182.0.0/16 #Netia SA: deny from 78.8.0.0/14 #netirons: deny from 158.222.0.0/20 #NetRiver INT LLC: deny from 69.46.32.0/20 #Netseer INC: deny from 75.98.9.0/24 #New Dream Network, LLC: deny from 66.33.196.0/22 66.33.206.0/24 69.163.160.0/19 173.236.128.0/17 #NForce Entertainment B.V: deny from 46.166.184.0/21 77.247.176.0/21 109.201.128.0/19 #NHN: deny from 125.209.232.0/22 #Nikultsev Aleksandr Nikolaevich: deny from 91.212.124.0/24 #NKN Core Network: deny from 14.139.128.0/19 #No.31,Jin-rong Street: deny from 27.152.0.0/13 36.99.0.0/16 58.59.128.0/17 59.60.0.0/15 61.51.128.0/18 61.130.0.0/17 110.80.0.0/13 112.224.0.0/11 113.64.0.0/11 116.16.0.0/12 117.40.0.0/14 117.64.0.0/13 119.120.0.0/13 121.204.0.0/14 122.224.0.0/12 124.226.0.0/15 125.64.0.0/13 171.13.0.0/16 180.96.0.0/11 182.32.0.0/12 183.0.0.0/10 218.14.0.0/15 222.76.0.0/14 222.84.0.0/16 222.88.0.0/15 222.208.0.0/13 #Nobis Technology Group, LLC: deny from 23.19.64.0/20 23.80.0.0/16 23.81.216.0/21 23.81.224.0/19 23.106.64.0/19 23.106.160.0/19 23.106.192.0/19 23.106.192.0/19 23.108.0.0/19 23.108.96.0/19 64.120.56.0/21 172.241.16.0/21 172.255.92.0/22 #Nodes Direct: deny from 184.175.192.0/18 #Novotelecom Ltd: deny from 178.49.154.0/24 #NTT PC Communications,Inc: deny from 11.89.0.0/16 #NTT SmartConnect Corporation: deny from 211.1.224.0/20 #Obenetwork AB: deny from 46.227.64.0/21 #"OBIT" Ltd: deny from 79.134.216.0/22 #Office National des Postes et Telecommunications ONPT (Maroc Telecom) / IAM: deny from 41.250.16.0/21 #OJSC Rostelecom: deny from 31.181.0.0/16 95.179.0.0/19 95.179.32.0/19 95.179.64.0/19 95.179.96.0/19 178.234.192.0/18 195.34.240.0/21 #OJSC "Vimpelcom": deny from 2.92.0.0/14 2.94.184.0/24 46.42.160.0/20 128.74.176.0/21 128.74.224.0/20 #Omonia d.o.o. za usluge i trgovinu: deny from 213.186.0.0/19 #ONLINE S.A.S: deny from 62.210.0.0/16 94.23.0.0/16 163.172.0.0/16 178.32.0.0/15 195.154.0.0/16 212.47.224.0/19 #Openface Inc: deny from 207.115.96.0/20 #Opus Interactive: deny from 216.151.0.0/19 #Osnova-Internet LLC: deny from 46.149.80.0/20 #OOO "Network of data-centers "Selectel": deny from 95.213.128.0/17 #OVH SAS: deny from 5.39.0.0/17 5.135.0.0/16 5.196.0.0/16 8.7.244.0/24 8.18.128.0/24 8.18.136.0/21 8.18.172.0/24 8.20.110.0/24 8.21.41.0/24 8.24.8.0/21 8.26.94.0/24 8.29.224.0/24 8.30.208.0/21 8.33.96.0/21 8.33.128.0/21 8.33.136.0/24 8.33.137.0/24 37.59.0.0/16 37.60.48.0/21 37.60.56.0/21 37.187.0.0/16 46.105.0.0/16 46.105.192.0/20 46.105.192.0/23 46.105.194.0/23 46.105.196.0/23 46.105.198.0/24 46.105.205.0/24 51.254.0.0/15 62.245.0.0/19 87.98.128.0/17 91.90.88.0/21 91.121.0.0/16 91.134.0.0/16 92.222.0.0/16 94.23.0.0/16 103.5.12.0/22 137.74.0.0/17 142.4.192.0/19 149.56.0.0/16 149.202.0.0/16 151.80.0.0/16 158.69.0.0/16 164.132.0.0/16 167.114.0.0/16 176.31.0.0/16 176.31.176.0/22 176.31.184.0/22 176.31.188.0/22 178.32.0.0/15 178.32.133.0/24 178.32.134.0/24 178.32.135.0/24 185.12.32.0/23 188.165.0.0/16 192.95.0.0/18 192.95.18.0/24 192.99.0.0/16 193.104.19.0/24 193.109.63.0/24 195.110.30.0/23 195.246.232.0/23 198.27.64.0/18 198.50.128.0/17 198.50.175.0/24 198.100.144.0/20 198.245.48.0/20 213.186.32.0/19 213.251.128.0/18 2001:41d0::/32 2402:1f00::/32 2607:5300::/32 #PALO ALTO NETWORKS: deny from 64.74.215.0/24 #PCCW Limited: deny from 219.77.160.0/19 219.78.32.0/19 219.78.192.0/19 #PE Gritcun Oleksandr Viktorovich: deny from 213.110.128.0/19 #PE Tetyana Mysyk: deny from 193.201.224.0/22 #Peer 1 Network (USA) Inc: deny from 64.34.156.0/22 64.69.64.0/19 216.157.0.0/18 #PEG TECH INC: deny from 142.4.96.0/19 #Penkiu kontinentu komunikaciju centras, Ltd: deny from 213.159.32.0/19 #Perspectiva Ltd: deny from 5.16.0.0/14 #Petersburg Internet Network ltd: deny from 5.101.65.0/24 31.184.238.0/24 46.161.9.0/24 146.185.251.0/24 188.143.232.0/24 #Philippine Long Distance Telephone Company: deny from 49.144.160.0/19 112.207.96.0/19 112.208.32.0/19 #PJSC MegaFon: deny from 83.149.44.0/23 #PJSC Rostelecom: deny from 5.141.200.0/22 5.143.224.0/19 95.32.128.0/18 95.32.192.0/18 109.173.0.0/17 #PlusServer AG: deny from 62.75.128.0/17 62.138.0.0/19 80.86.80.0/20 85.25.0.0/16 85.93.88.0/22 188.138.0.0/17 #PP SKS-LUGAN: deny from 91.200.12.0/22 #PP Trusov Ilya Igorevych: deny from 46.161.62.0/24 #poneytelecom.eu: deny from 212.83.160.0/19 #prgmr.com, Inc: deny from 71.19.157.0/24 #Prometeus di Daniela Agro: deny from 37.247.48.0/21 #Proximus NV: deny from 81.240.0.0/14 #Psychz Networks: deny from 104.149.0.0/16 #PulsePoint B.V: deny from 74.214.194.0/24 #QuadraNet, Inc: deny from 69.12.64.0/19 104.223.0.0/17 107.161.80.0/20 155.94.208.0/20 173.254.192.0/18 173.254.200.0/22 204.44.64.0/18 #Quality Technology Services, LLC: deny from 64.88.160.0/20 #QuickPacket, LLC: deny from 107.161.112.0/20 #QWANT SAS: deny from 194.187.168.0/24 #Rackspace Hosting: deny from 104.130.128.0/19 104.130.192.0/19 162.209.80.0/20 162.209.96.0/19 184.106.0.0/16 204.232.224.0/19 #RCN: deny from 65.78.0.0/17 #Redstation Limited: deny from 37.157.240.0/21 77.245.64.0/20 #Reliance Jio Infocomm Limited: deny from 47.29.0.0/17 49.32.72.0/24 #Republican Unitary Telecommunication Enterprise Beltelecom: deny from 37.212.0.0/14 #Roya Hosting LLC: deny from 104.143.16.0/20 #root SA: deny from 94.242.192.0/18 212.117.160.0/19 #SAKURA Internet Inc: deny from 182.48.0.0/18 #Salay Telekomunikasyon Ticaret Limited Sirketi: deny from 185.9.159.0/24 #Sat-Trakt D.O.O: deny from 81.24.240.0/22 #SatTel Corporation, Ltd: deny from 213.21.32.0/21 #Saudi Telecom Company JSC: deny from 84.235.48.0/21 #Savvis: deny from 64.14.0.0/16 64.37.192.0/18 66.119.32.0/20 #SEACOM Limited: deny from 105.16.0.0/12 #SECURED SERVERS LLC: deny from 23.251.55.0/24 104.161.16.0/20 #Server Central Network: deny from 50.31.128.0/18 66.225.192.0/18 103.238.131.0/24 #ServerAstra Kft: deny from 91.219.236.0/22 #ServerClub Inc: deny from 188.42.240.0/24 #Serverius Holding B.V: deny from 37.49.225.0/24 #ServerStack, Inc: deny from 198.199.64.0/20 #Seznam.cz, a.s: deny from 77.75.78.0/23 #Shandong Mobile Communication Company Limited: deny from 223.99.192.0/23 #Shenzhen Tencent Computer Systems Company Limited: deny from 115.159.4.0/23 #SIA Digitalas Ekonomikas Attistibas Centrs: deny from 193.108.185.0/24 #Sibirskie Seti Ltd: deny from 89.189.176.0/20 #SICOM Systems, Inc: deny from 24.104.42.0/24 #SimpleLink LLC: deny from 104.194.196.0/22 #Simply Transit Ltd: deny from 31.193.128.0/20 #SingleHop: deny from 198.20.64.0/18 #Sky UK Limited: deny from 90.192.0.0/11 #Smallworld Media Communications Ltd: deny from 80.255.192.0/19 #SoftLayer Technologies Inc: deny from 5.10.64.0/19 5.153.0.0/18 23.91.120.0/21 45.33.0.0/19 50.97.32.0/19 50.97.128.0/18 67.228.0.0/18 75.126.16.0/20 75.126.144.0/20 108.168.224.0/20 158.85.0.0/18 159.8.192.0/18 159.253.128.0/19 169.53.0.0/18 169.54.192.0/18 169.57.0.0/17 174.120.0.0/14 184.173.128.0/18 208.101.0.0/18 #SpaceNET AG: deny from 195.30.0.0/16 #SPD Verdi Andrei Sergeevich: deny from 176.97.116.0/22 #"SPRINT" S.A: deny from 155.133.82.0/24 #State Enterprise Infostruktura: deny from 195.182.64.0/19 #STARNET S.R.L: deny from 95.65.0.0/17 #Sting Communications: deny from 216.220.86.0/24 #Stofa A/S: deny from 46.32.32.0/19 #Strato AG: deny from 85.214.0.0/15 #Sun Network (Hong Kong) Limited: deny from 210.56.50.0/24 #SunGard Availability Services LP: deny from 69.164.110.0/23 #SunnyVision Limited: deny from 103.27.127.0/24 #SWIFT NETWORKS LIMITED: deny from 41.58.64.0/20 #Syscon Infoway Pvt. Ltd: deny from 111.119.224.0/21 #SystemsFox prestação de serviços LTDA: deny from 187.109.10.0/24 #T-2, d.o.o: deny from 89.212.128.0/18 #t-ipconnect.de: deny from 84.129.182.160 84.129.185.105 #Taiwan Fixed Network, Telco and Network Service Provider: deny from 180.177.0.0/16 #TalkTalk Communications Limited: deny from 62.24.128.0/17 #Take 2 Hosting, Inc: deny from 173.252.192.0/19 #Tata Teleservices Maharashtra Ltd: deny from 123.252.131.0/24 #TDC A/S: deny from 80.160.0.0/13 #Techcrea Solutions SARL: deny from 185.13.36.0/22 #Techie Hosting, Inc: deny from 208.90.152.0/22 #Tele2 SWIPnet: deny from 90.128.0.0/12 #Telecom Algeria: deny from 41.105.0.0/17 105.106.96.0/19 #Telecom Argentina S.A: deny from 181.14.192.0/21 181.88.176.0/20 #Telecom Italia S.p.a: deny from 194.243.0.0/16 #Télécommunications de Haití: deny from 190.115.128.0/18 #TELEFÔNICA BRASIL S.A: deny from 177.94.0.0/16 #Telemar Norte Leste S.A: deny from 189.70.160.0/19 #Telentia: deny from 104.128.16.0/20 #TELLAS Telecommunication Services S.A: deny from 79.107.160.0/19 #TELLCOM ILETISIM HIZMETLERI A.S: deny from 212.253.112.0/24 #TeNeT Scientific Production Enterprise LLC: deny from 62.16.0.0/19 #TETANEUTRAL.NET,FR: deny from 89.234.156.0/23 #The Corporation for Financing & Promoting Technology: deny from 118.69.200.0/24 #The University of Adelaide: deny from 129.127.0.0/16 #ThePlanet.com Internet Services, Inc: deny from 74.52.0.0/14 #Tikona Digital Networks Pvt Ltd: deny from 113.193.82.0/24 #Tiggee LLC: deny from 96.45.82.0/24 #Tiscali Italia S.P.A.: deny from 217.73.208.0/20 #Tiscali UK Limited: deny from 79.64.0.0/12 212.159.128.0/18 #TM Net, Internet Service Provider: deny from 60.50.0.0/18 #Todayhost Limited: deny from 91.192.116.0/24 #Topsy Labs, Inc: deny from 74.112.130.0/23 #TOT Public Company Limited: deny from 101.51.224.0/20 118.173.192.0/19 118.174.0.0/19 118.175.255.0/24 180.180.96.0/19 182.53.0.0/19 #TOV "ITT": deny from 195.238.108.0/22 #Transip B.V: deny from 149.210.128.0/17 #TransTelecom: deny from 62.33.0.0/16 #TREND MICRO INCORPORATED: deny from 150.70.96.0/20 150.70.160.0/20 #triolan.net.ua: deny from 37.57.231.0/24 159.224.160.0/24 #Trusov Ilya Igorevych: deny from 185.101.71.0/24 #Trustwave Holdings, Inc: deny from 204.13.200.0/24 #Turk Telekomunikasyon Anonim Sirketi: deny from 78.164.128.0/18 78.185.128.0/17 85.107.128.0/17 88.248.0.0/17 95.8.0.0/17 #TurkNet Iletisim Hizmetleri A.S: deny from 31.223.98.0/23 #tw telecom holdings, inc: deny from 74.202.182.0/23 #UAB "Baltnetos komunikacijos": deny from 79.98.28.0/22 #UAB HOSTEX: deny from 31.193.192.0/21 #Ucom LLC: deny from 5.77.128.0/17 #UKfastnet Ltd: deny from 81.201.128.0/20 #Unified Layer: deny from 198.1.64.0/18 198.57.128.0/17 #United Networks of Ukraine, Ltd: deny from 176.111.61.0/24 #University of Pennsylvania: deny from 128.91.0.0/16 #XO Communications: deny from 66.236.0.0/14 #Vautron Rechenzentrum AG: deny from 83.243.56.0/21 #Verdina Ltd: deny from 5.104.175.0/24 #VeriSign Infrastructure & Operations: deny from 69.58.176.0/20 #Versaweb, LLC: deny from 104.238.192.0/18 #VF-GROUP-DC1 Vodafone Group Services GmbH,DE: deny from 195.232.147.0/24 #Viacom Informatics Ltd: deny from 193.23.139.0/24 #ViaWest: deny from 216.46.160.0/19 #Viettel Corporation: deny from 116.104.240.0/20 117.6.112.0/20 171.255.128.0/20 203.113.152.0/22 210.211.120.0/22 #Virgin Media Limited: deny from 81.108.0.0/15 #VNPT Corp: deny from 14.162.64.0/19 14.163.160.0/19 123.30.176.0/24 203.162.0.0/24 #VODAFONE ONO, S.A: deny from 62.43.0.0/16 62.57.0.0/16 #VolumeDrive: deny from 199.180.112.0/21 #Voxel Dot Net, Inc: deny from 216.223.24.0/22 #Voxility S.R.L: deny from 37.221.170.0/23 93.115.92.0/22 109.163.234.0/23 109.163.234.0/23 193.105.21.0/24 #VpsQuan L.L.C: deny from 69.165.64.0/24 #Wamika Broadband Pvt Ltd: deny from 103.228.72.0/24 #Wana Corporate: deny from 41.137.64.0/18 #Wananchi Group (Kenya) Limited: deny from 197.237.242.0/24 #web382.kinghost.net: deny from 189.38.80.0/22 #Webair Internet Development Company Inc: deny from 67.55.64.0/19 #Webfactor SRL: deny from 93.114.64.0/23 #Webfusion Internet Solutions: deny from 81.21.64.0/20 212.48.64.0/19 217.199.160.0/20 #Webzilla B.V: deny from 109.234.38.0/24 #Westelcom Internet, Inc: deny from 64.19.78.0/24 #WestHost, Inc: deny from 206.190.128.0/19 209.95.32.0/19 #WLA Interservice Ltd: deny from 84.21.28.0/24 #WholeSale Internet, Inc: deny from 69.30.192.0/18 69.197.128.0/18 173.208.128.0/17 #WorldLink Communications Pvt Ltd: deny from 27.34.0.0/18 #WorldStream: deny from 93.190.136.0/22 109.236.80.0/20 217.23.0.0/20 #Wowrack.com: deny from 216.244.84.0/22 #WZ Communications Inc: deny from 74.117.176.0/21 208.88.224.0/22 #XFERA Moviles S.A: deny from 46.222.0.0/16 #Yahoo!: deny from 68.142.232.0/22 #YISP B.V. deny from 46.182.106.0/24 #ZAO "National Telecommunications": deny from 109.120.128.0/18 #ZAT "Industrial Media Network": deny from 82.193.96.0/19 #ZiD Internet: deny from 207.253.227.0/24 #Ziggo B.V: deny from 94.208.0.0/14
Dodatkowo możemy wykluczyć też boty SEO, kradnące treści na naszych WordPressach:
# hotlink # RewriteCond %{HTTP_USER_AGENT} (facebookexternalhit) [NC,OR] RewriteCond %{HTTP_REFERER} !^http(s)?://(www\.)?domain.tld/.* [NC] RewriteCond %{REQUEST_URI} !.*403.gif$ RewriteRule \.(png|gif|jpe?g)$ http://domain.tld/images/403.gif [NC,R,L] # deny robots.txt access except # RewriteCond %{HTTP_USER_AGENT} !(msnbot|msn|bing|Baiduspider|Google|googleboot) [NC] RewriteRule ^robots\.txt - [F] # deny request based on request method # RewriteCond %{THE_REQUEST} !^(POST|GET)\ /.*\ HTTP/1\.(0|1)$ RewriteRule .* - [F,L] # deny bad agents # RewriteCond %{REMOTE_ADDR} !(google|googlebot|^google\-proxy) [NC] RewriteCond %{HTTP_USER_AGENT} (^$|^\w{,12}$|360Spider|^bot[_+:,.;/\-\)]|[{}"]|\/bin\/bash) [NC,OR] RewriteCond %{HTTP_USER_AGENT} (Abelssoft|Abonti|Add\sCatalog|AddSugarSpiderBot|ADmantX|AdMedia|Alexa|America|Apache-HttpClient|^Aport$|Applebot|Application|Arachnida|archive|^aria2|Auto\sShell\sSpider) [NC,OR] RewriteCond %{HTTP_USER_AGENT} (Babya\sDiscoverer|base64_decode|BitActive|BLABLUBB|BLEXBot|bluefish|BrowseX|BuzzSumo) [NC,OR] RewriteCond %{HTTP_USER_AGENT} (ca-crawler|CCBot|^CIA$|Cliqzbot|^com\.apple|ContextAd|CRAZYWEBCRAWLER|CrowdStrike|curl) [NC,OR] RewriteCond %{HTTP_USER_AGENT} (datagnionbot|Daum|Dealio\sToolbar|DeuSu|Diagnostics|DigExt|Dillo|Dispatch|Docoloc|Dyak\sCrawler) [NC,OR] RewriteCond %{HTTP_USER_AGENT} (echo|EsriBot|Exabot|ExactSearch) [NC,OR] RewriteCond %{HTTP_USER_AGENT} (facebookexternalhit|Firefox\/0\.|Firefox\/1\.|Firefox\/3\.|Firefox\/40\.1|FirePHP|forensiqDomain\sRe-Animator\sBot|FunWebProducts) [NC,OR] RewriteCond %{HTTP_USER_AGENT} (Genieo|GetIntent\sCrawler|GetintentCrawler|Gigablast|glutenfreepleasure|Go-http-client|Google-HTTP-Java-Client|Google-HTTP-Java-Client|GrapeshotCrawler|GreenBrowser|^gvfs) [NC,OR] RewriteCond %{HTTP_USER_AGENT} (heritrix|Hotbar|HRCrawler|HTTP_Request|^HTTPie|HTTrack|HubSpot|HyperCrawl) [NC,OR] RewriteCond %{HTTP_USER_AGENT} (ia_archiver|ICAP-IOD|^Ipad\sIphone\sSafari$|InfoPath|ips-agent) [NC,OR] RewriteCond %{HTTP_USER_AGENT} (^Java|JDatabaseDriverMysql|JetBrains|Jooblebot|JSimplepieFactory) [NC,OR] RewriteCond %{HTTP_USER_AGENT} (^libwww-perl|LightspeedSystems|link\schecker|LinksCrawler|LinqiaScrapeBot|Lipperhey|Enigma\sBrowser|LivelapBot|LoadImpactRload|LSSRocket|ltx71|Lunascape|Lynx) [NC,OR] RewriteCond %{HTTP_USER_AGENT} (KomodiaBot|Kraken\/Nutch|kscan1\.4\.3) [NC,OR] RewriteCond %{HTTP_USER_AGENT} (^M$|Mail\.RU|MaxPointCrawler|meanpathbot|Mediatoolkitbot|MegaIndex|memoryBot|metagenerator|MetaURI|mfibot|MicroMessenger|Microsoft\sData\sAccess|mifetcher|MixrankBot|MJ12bot|^Mozilla$|^Mozilla\/0\.|Mozilla\/1\.|^Mozilla\/2\.|Mozilla\/3\.|^Mozilla\/4\.|^Mozilla\/5\.0$|^Mozilla\/5\.0\s\(en\)$|^Mozilla\/5\.0\sFirefox\/35\.0$|^Mozilla\/6\.|MSIE\s2\.|MSIE\s4\.|MSIE\s5\.|MSIE\s6|MSIE\s7\.0|MSIE\s9\.11|MSIE\s999\.1|mutant) [NC,OR] RewriteCond %{HTTP_USER_AGENT} (nbot\/2\.0|Netcraft|NETCOMplete|NetSeer|NetSurf|NeumobBot|Niki-Bot|nutch) [NC,OR] RewriteCond %{HTTP_USER_AGENT} (oBot\/2\.3\.1|OffByOne|office|okhttp\/2\.5\.0) [NC,OR] RewriteCond %{HTTP_USER_AGENT} (package|PagesInventory|PeoplePal|PhantomJS|Photon|php-requests|^Podcast|portalmmm|Powermarks|PrivacyAwareBot|^Proxy|proximic|publiclibraryarchive|Pulsepoint|^Python|^Python-urllib) [NC,OR] RewriteCond %{HTTP_USER_AGENT} (Quix\sFetch|Qwantify) [NC,OR] RewriteCond %{HTTP_USER_AGENT} (Rhapsody|RIM-Q10|Ruby) [NC,OR] RewriteCond %{HTTP_USER_AGENT} (SafeDNSBot|Scrapy|Screaming\sFrog|Scope|seebot|SEOlyticsCrawler|seoscanners|SemrushBot|SeznamBot|ShellShock|ShopperReports|SISTRIX|SiteExplorer|Sitemaps\sGenerator|SiteTruth|SkypeUriPreview|Sleipnir|SMTBot|socialayer|SoftMaker|spbot|SputnikFaviconBot|StumbleUpon|sukibot|SurdotlyBot|SurveyBot|Sylera|Synapse) [NC,OR] RewriteCond %{HTTP_USER_AGENT} (tcpiputils\.com|Test\sCertificate\sInfo|TestCrawler|text\/html|Tiscali\sCommunicator|Toweyabot|Typhoeus|TurnitinBot|TweetmemeBot) [NC,OR] RewriteCond %{HTTP_USER_AGENT} (uname|Uptimebot|User-Agent|Uzbl) [NC,OR] RewriteCond %{HTTP_USER_AGENT} (Validator|voltron) [NC,OR] RewriteCond %{HTTP_USER_AGENT} (W3C-checklink|W3CLineMode|W3C_Validator|W3Y3\sSearc|WbSrchh|WebCapture|WBSearchBot|WebThumbnail|WeSEE|WFilter|WhatWeb|Wget|Who\.is\sBot|Win98|Windows\s98|Windows\sNT\s9\.0|WindowsBaiduYunGuanJia|WindowsConnectedSearch|WinHTTP|woobot|WordChampBot|WordPress|worldwebheritage|Wotbox|^www.ru$|wwwtype) [NC,OR] RewriteCond %{HTTP_USER_AGENT} (Xenu\sLink\sSleuth|XoviBot) [NC,OR] RewriteCond %{HTTP_USER_AGENT} (YaBrowser|yacybot|YahooSeeker-Testing|Yandex|YandexWebmaster|Yeti|YisouSpider|Yodao\sDesktop\sDict) [NC,OR] RewriteCond %{QUERY_STRING} ^.*(;|<|>|’|”|\)|%0A|%0D|%22|%27|%3C|%3E|%00).*(/\*|union|select|insert|cast|set|declare|drop|update|md5|benchmark|localhost).* [NC,OR] RewriteCond %{QUERY_STRING} ^.*(stories|option=|task=|sa=U|plugin=|file=|ei=|ved=|method=|usg=|cid=).* [NC,OR] RewriteCond %{QUERY_STRING} ^.*(\.\./|\/\/).* [OR] RewriteCond %{QUERY_STRING} ^.*(null|InterYield|getSnoozing).* [NC] RewriteRule .* - [F,L] RewriteCond %{HTTP_REFERER} (\.5mp\.eu|baixar-musicas-gratis\.com|brokenlinklookup\.com|buttons-for-website\.com|derik82\.hu|edokumentumok\.|For\sYou\sWe\sCode\sAldaor\.|krasivoe-hd\.com|pizza-tycoon\.com|semalt\.com|sur\.ly|\.top|\.gq|wiki\.krebsz\.hu|\.vdc\.vn|\.xyz) [NC,OR] RewriteCond %{REMOTE_HOST} (derik82\.hu) [NC] RewriteRule .* - [F,L] RewriteCond %{REQUEST_URI} ^.*(^admin|administrator|elfinder|manager|\/phpmyadmin&|webroot|wp-content|wp-admin|wp-login|wp-signup|admin-ajax|editor|adform|user|typo3|xmlrpc).* [NC] RewriteRule .* - [F,L]
I tak dla bonusowego uzupełnienia górna konstrukcja .htaccess wyglądać dla świętego spokoju (choć nie do końca) powinna tak (pamiętajcie o zmianie domain.tld na swoją domenę):
RewriteEngine On RewriteBase / IndexIgnore * ServerSignature Off SetEnv TZ Europe/Warsaw AddDefaultCharset UTF-8 # SEO # <IfModule mod_gzip.c> mod_gzip_on Yes mod_gzip_dechunk Yes mod_gzip_item_include file \.(html?|txt|css|js|php|inc)$ mod_gzip_item_include handler ^cgi-script$ mod_gzip_item_include mime ^text/.* mod_gzip_item_include mime ^application/x-javascript.* mod_gzip_item_exclude mime ^image/.* mod_gzip_item_exclude rspheader ^Content-Encoding:.*gzip.* </IfModule> <IfModule mod_headers.c> Header set Connection keep-alive <FilesMatch "\.(ico|gif|jpe?g|png|pdf)$"> Header set Cache-Control "max-age=604800" Header set imagetoolbar "no" </FilesMatch> <FilesMatch "\.(js|css)$"> Header set Cache-Control "max-age=604800" Header append Vary Accept-Encoding </FilesMatch> <FilesMatch "\.(html|htm|txt|xml)$"> Header set Cache-Control "max-age=3600" Header append Vary Accept-Encoding Header set imagetoolbar "no" </FilesMatch> <FilesMatch "\.(inc|php)$"> Header unset Cache-Control </FilesMatch> <FilesMatch "\.(?i:pdf)$"> ForceType application/octet-stream Header set Content-Disposition attachment </FilesMatch> </IfModule> <IfModule mod_deflate.c> <FilesMatch "\.(js|css)$"> SetOutputFilter DEFLATE </FilesMatch> </IfModule> # remove php extension # RewriteRule ^([\w]+)/?$ $1.php # redirect to non www # RewriteCond %{HTTP_HOST} ^www\.domain\.tld [NC] RewriteCond %{HTTP_HOST} !^domain\.tld [NC] RewriteCond %{HTTP_HOST} !^$ RewriteRule ^(.*)$ http://domain.tld/$1 [L,R=301] RewriteRule ^index.php$ http://domain.tld/$1 [L,R=301,NC]