擋百度robot的作法
直接修改.htaccess
SetEnvIfNoCase User-Agent "^Baidu" bad_bot
SetEnvIfNoCase User-Agent "^sogou" bad_bot
SetEnvIfNoCase User-Agent "^Bloghoo" bad_bot
SetEnvIfNoCase User-Agent "^Scooter" bad_bot
Deny from env=bad_bot
增加 /robot.txt
User-agent: baiduspider
Disallow: /
User-agent: *
Disallow: /php
....
Powered by ScribeFire.
留言