Seo: Crawling And Robots

  • Fun with robots.txt

    … used on vinna.cc to embed an entire game into the file. Head over to https://vinna.cc/robots.txt and play Robots Robots Revolution! Some opinions expressed in this article may be those of a guest author and not necessarily Search Engine Land. Staff authors are listed here. About The Author Patrick Stox is an SEO Specialist for IBM and an organizer for the Raleigh SEO Meetup, the most successful SEO Meetup in the US. …

    Search Engine Landin SEO- 17 readers -
  • It’s scary how many ways SEO can go wrong

    … character that’s located at the start of a file (and it’s essentially meaningless from an SEO perspective). Some programs will add the BOM to a text file, which … can remain invisible to the person creating the text file. And the BOM can cause serious problems when Google tries to read the file. … [W]hen your robots.txt file contains the UTF-8 BOM…

    Search Engine Landin SEO How To's- 15 readers -
  • Exploring a newly-granted Google patent around social signals

    … fits that bill perfectly. We’re heard repeatedly from Google that social interactions are not a search ranking signal. In fact, you can read a Tweet from Google’s Gary Illyes in response to the statement, “Some controversy over whether Google takes social into account for SEO….” His reply: So the answer is “No,” right? Maybe, and here’s where…

    Dave Davies/ Search Engine Landin SEO Google- 12 readers -
  • How to check which URLs have been indexed by Google using Python

    … There are three main components to organic search: crawling, indexing and ranking. When a search engine like Google arrives at your website, it crawls all of the links it finds. Information about what it finds is then entered into the search engine’s index, where different factors are used to determine which pages to fetch, and in what order…

    Search Engine Landin SEO Google How To's- 12 readers -
  • The myth of the duplicate content penalty

    … Many people are more afraid of duplicate content than they are of spammy links. There are so many myths around duplicate content that people actually think it causes a penalty and that their pages will compete against each other and hurt their website. I see forum posts, Reddit threads, technical audits, tools, and even SEO news websites…

    Search Engine Landin SEO Content Google- 9 readers -
  • Case study: JavaScript blocking Google’s view of hreflang

    … The hreflang attribute has been an important part of the SEO toolkit for webmasters and digital marketers for a good many years. In order for Google to best understand your multilingual or multinational website, it is integral that your hreflang implementation is correct and that Google fully understands it. If you’re new to the hreflang…

    Search Engine Landin SEO Google- 15 readers -
  • 9 tools to help you succeed with Google SERP features

    … to get a little help from some friends — and by friends, I mean tools that help you leverage SERP features. Here are a few such tools that can sharpen your SEO sword: 1. Yotpo’s Search Enhancements Do you work in e-commerce? If so, you’ll definitely want to look into Yotpo, which focuses on integrating reviews into your website for greater SERP…

    Jordan Kasteler/ Search Engine Landin SEO Google- 17 readers -
  • 5 ways ads are killing your site (& SEO)

    … a focus on website design and implementation, accessibility standards and all aspects of website visibility involving SEO, social media and strategic planning. She additionally specializes in site health auditing, site forensics, technical SEO and site recovery planning especially when involving Google algorithms such as Penguin and Panda. Her…

    Kristine Schachinger/ Search Engine Landin SEO- 16 readers -
  • SEO requirements for a new website platform

    … and relevant to the page it represents. While it is true that auto-generating title tags based on category, subcategory, filters and the brand name may allow you to pass this “requirement,” it is common sense that, for advanced SEO, you should expect your platform of choice to allow you to customize each page’s title tag. 13. Meta description tags…

    Search Engine Landin SEO- 21 readers -
  • Is your HTTPS setup causing SEO issues?

    … be that the HTTP 301 redirects to the HTTPS. Here is a list of the best practices for a correct HTTPS setup to avoid SEO issues: Ensure your HTTPS site version is added in Google Search Console and Bing Webmaster Tools. In Google Search Console, add both the www and non-www versions. Set your preferred domain under the HTTPS versions. 301 redirect HTTP URL…

    Search Engine Landin SEO- 18 readers -
  • 10 factors that may be impacting your organic traffic

    … Whether you’re a seasoned SEO or someone who runs your own business, you know there are fluctuations in your organic traffic, but you may struggle to pinpoint the root cause. Organic search, unlike its paid counterpart, comes with a unique set of challenges in diagnosing a decline in traffic and conversions. There are some obvious places you…

    Search Engine Landin SEO- 21 readers -
  • Help! I just launched a new website and my search rankings tanked!

    … to launch. Suddenly, you realize you forgot to plan for one crucial element: the SEO best practices that you had so carefully incorporated into your old website. Unfortunately, this is not just a nightmare that can be forgotten once you’ve had your morning coffee, but something I’ve seen happen to countless small businesses over my 10 years…

    Will Scott/ Search Engine Landin SEO- 16 readers -
  • The role of technical SEO is “makeup?” Really?

    … is when it comes to technical SEO, there are no big wins; there’s only recovery from or prevention of big losses. Other than fixing what’s broken, technical SEO is not something that can get you increased search traffic. And isn’t that the true purpose of SEO? When I start working with new clients, the first things I want to look at are crawling…

    Search Engine Landin SEO- 17 readers -
  • How to quickly find and export all subdomains indexed by Google

    … An SEO audit is rarely limited to the www (or non-www) version of a website. When looking for potential duplicate content, it’s often important to know how many subdomains exist and, more importantly, how many of them are indexed by Google. The good old search operators An easy way to find indexed subdomains is to use search operators. Start…

    Search Engine Landin SEO Google How To's- 18 readers -
Get the top posts daily into your mailbox!