apache - How do I block a bot from a specific directory -
i getting insane amount of requests web crawling bots files in /cachecp/ directory on website (the directory doesn't exist on server, assume hacker bots looking vulnerabilities.) ip's different can't block ip's.
i requests such as: mydomain.com/cachecp/helps/wholesale-plus-size-clothing.html neither folder nor html file exist (or ever have). html file seems totally random , has nothing offerings.
can use htaccess give 403 error bot trying access folder and/or ban ip multiple attempts?
use in robots.txt file
user-agent: * disallow: /cachecp/
bear in mind robots.txt 'gentleman's agreement' , less scrupulous bots ignore rules entirely.
Comments
Post a Comment