Quantcast
Channel: BulletProof Security Forum » All Posts
Viewing all articles
Browse latest Browse all 12489

Reply To: Problems with Googlebot fetching my robots.txt file

$
0
0

There is not any standard/default BPS .htaccess code that affects the Googlebot, retrieving a robots.txt file, crawling and indexing a website.  If you added additional custom .htaccess code to BPS Custom Code then it is possible that that additional custom .htaccess code could be affecting the Googlebot or other things.

BPS Troubleshooting Steps:  http://forum.ait-pro.com/forums/topic/read-me-first-free/#bps-free-general-troubleshooting

  • This reply was modified 4 hours, 1 minute ago by  AITpro Admin.

Viewing all articles
Browse latest Browse all 12489

Trending Articles