Quantcast
Channel: BulletProof Security Forum » All Posts
Viewing all articles
Browse latest Browse all 12486

Reply To: Block Bots – Scrapers, XENU Link Sleuth

$
0
0

Only good/legitimate bots/User Agents (Google bot, etc) follow the rules in a robots.txt file.  Bad bots ignore robots.txt file rules.  To add the xenu bot to the BPS Query String Exploits User Agent nuisance filter and save your custom code permanently to BPS Custom Code do these steps:

1.  Go to the htaccess File Editor tab page > click on “Your Current Root htaccess File” tab > Copy the entire BPS Query String Exploits block of code from # BEGIN BPSQSE BPS QUERY STRING EXPLOITS to # END BPSQSE BPS QUERY STRING EXPLOITS to this BPS Root Custom Code text box:  CUSTOM CODE BPSQSE BPS QUERY STRING EXPLOITS
2. After copying the BPS Query String Exploits block of code to Custom Code you can edit the code to customize it and add any bad bots that you would like to block to the BPS Query String Exploits User Agent nuisance filter.
3. Click the Save Root Custom Code button, go to the Security Modes page, click the Create secure.htaccess File AutoMagic button, select the Activate Root Folder BulletProof Mode Radio button and click the Activate|Deactivate button.


Viewing all articles
Browse latest Browse all 12486

Trending Articles