Robots.txt file: all you need to know - SupportHost
Check out new work on my @Behance profile: "ROBOTS.TXT GENERATOR" http://be.net/gallery/121438705/ROBOTSTXT-GENERATOR | Web design, Generator, Free seo tools
Free Robot TxT Generator
Custom robots.txt Generator (Create a Google Robots txt File)