According to my server logs, I've got over a hundred unsuccessful requests for robots.txt. It doesn't affect the user at front end and I don't care for search engine rankings because it's a personal site, nothing spectacular.

But is it a good practice to have the file anyway? I see twelvestone doesn't have one.

More info:www.robotstxt.org Example:www.google.ca/robots.txt

Same with the favicon.ico, Mozilla browsers look for that file automatically. Again, it doesn't really affect the user, but in my server logs, I get a page of unsuccessful requests for the file.

Your thoughts?

you technically don't need either. the favicon.ico relaly only works consistently in mozilla. ie will display it, but only on the page you bookmark. if you want to know how to make one with windows go here. it's really not that hard to make one. at some point i need to make one for my site just for the hell of it.

as for the robats.txt file, make a blank file with nothing in it if you want to drop the 404 requests for it. it's really more used to limit the searching of the site. i'll be adding one largely to elminate spiders crawling my image galleries. then they hit, they bog down my machine.

Thanks mosquito!

6 years in between advice and thank you. A new 12s record, methinks.

this train never runs on time.

*taps foot impatiently