I got a video about how Google handles the robots.txt file. You can watch it if you want:
Above video answers some questions such as:
1) I blocked URL it in robots.txt, but my URL showing up in google search engine? Why? Whats the reason?
2) How to block URL from google?
I hope the video helps if you have questions.
Source : mattcutts.com



Posted in