The difference between a Robots meta tag and a Robots.txt file

Robots.txt