Currently web searches return results like this:
http://www.centos.org/modules/newbb/makepdf.php?type=post&pageid=0&scale=0.66&post_id=160061
Which is really annoying, as some searches only return the pdf of a single post and the topic search result will be pages down.
Can someone review the robots.txt and add add in appropriate "Disallow: xxx" lines?
Thanks,
Michael
update robots.txt to disallow makepdf.php?
-
- Posts: 37
- Joined: 2012/05/04 19:31:50
- Location: Austin, Tx, Usa
- Contact: