Seo: Blocking Spiders

  • Should You Gate Content? The SEO Implications

    … may consider this approach "cloaking" and may penalize your site for it. Nonetheless, this approach clearly makes sense in certain situations to help both the search robots and the user have the most streamlined experiences on the site. First, what do I mean by "cloaking"? Google defines cloaking as "the practice of presenting different content…

    Janet Driscoll Miller/ Search Engine Landin SEO Content- 14 readers -
  • Google Orders Terminator Robots Not To Kill Founders Brin & Page

    How do you stop the unstoppable killer Terminators if you're not Sarah Connor? Google does it with a simple text file. People have noted today that Google has a special "robot.txt" file that pokes fun at stopping the Terminators. Robots.txt files are actually used to stop robots of the less threatening kind - it's like Google that crawls the web looking for content. Use robots.

    Barry Schwartz/ Search Engine Land- 25 readers -
Get the top posts daily into your mailbox!