Critical Mistakes in Your Robots.txt Will Break Your Rankings and You Won’t Even Know It

by Razvan Gavrilas
The use of a robots.txt file has long been debated among webmasters as it can prove to be a strong tool when it is well written or one can shoot oneself in the foot with it. Unlike other SEO concepts that could be considered more abstract and for which we don’t have clear guidelines, the robots.txt file is completely documented by Google and other search engines.Read the full article