mercredi 15 avril 2015

Is the following robots.txt file fine to block only specific pages


Vote count:

0




I want to disable indexing for only specific pages on the website, and i have the following robots.txt, please let me knew if it's fine as my index dropdown too much pages.



User-agent: *
Disallow: /cgi-bin/
Disallow: /privacy
Disallow: /about


asked 30 secs ago

Devy

353






Is the following robots.txt file fine to block only specific pages

Aucun commentaire:

Enregistrer un commentaire