Seo: Crawling And Robots

    • How to check which URLs have been indexed by Google using Python

      There are three main components to organic search: crawling, indexing and ranking. When a search engine like Google arrives at your website, it crawls all of the links it finds. Information about what it finds is then entered into the search engine’s index, where different factors are used to determine which pages to fetch, and in what order, for a particular search query.

      Search Engine Landin SEO Google How To's- 12 readers -
    • Why crawl budget and URL scheduling might impact rankings in website migrations

      Earlier this year, Google’s Gary Illyes stated that 30x redirects (301, 302, etc.) do not result in a loss or dilution of PageRank. As you can imagine, many SEOs have greeted this claim with skepticism. In a recent Webmaster Central Office Hours Hangout, I asked Google’s John Mueller whether perhaps the skepticism was because when SEOs experience loss of visibility during mi ...

      Search Engine Landin SEO Google- 8 readers -
    • The myth of the duplicate content penalty

      Many people are more afraid of duplicate content than they are of spammy links. There are so many myths around duplicate content that people actually think it causes a penalty and that their pages will compete against each other and hurt their website. I see forum posts, Reddit threads, technical audits, tools, and even SEO news websites publishing articles that show people ...

      Search Engine Landin SEO Content Google- 8 readers -
  • Exploring a newly-granted Google patent around social signals

    … fits that bill perfectly. We’re heard repeatedly from Google that social interactions are not a search ranking signal. In fact, you can read a Tweet from Google’s Gary Illyes in response to the statement, “Some controversy over whether Google takes social into account for SEO….” His reply: So the answer is “No,” right? Maybe, and here’s where…

    Dave Davies/ Search Engine Landin SEO Google- 11 readers -
  • Case study: JavaScript blocking Google’s view of hreflang

    … The hreflang attribute has been an important part of the SEO toolkit for webmasters and digital marketers for a good many years. In order for Google to best understand your multilingual or multinational website, it is integral that your hreflang implementation is correct and that Google fully understands it. If you’re new to the hreflang…

    Search Engine Landin SEO Google- 13 readers -
  • 9 tools to help you succeed with Google SERP features

    It’s no secret that Google is in a constant state of change. The “ten blue links” that used to comprise a search engine results page (SERP) are diminishing in importance, and new features are becoming more essential with every passing month. From image results and local packs to site links and knowledge panels, Google is reshaping search marketing.

    Jordan Kasteler/ Search Engine Land- 15 readers -
  • 5 ways ads are killing your site (& SEO)

    … In this example in a test from, we can see that this site has 509 resource calls, of which approximately 50% are ad related. This means that as the page downloads, the browser must retrieve over 500 external items. Every call means a trip to and from a server. This can greatly exacerbate page speed issues, no matter how well the load is stacked…

    Kristine Schachinger/ Search Engine Landin SEO- 10 readers -
  • SEO requirements for a new website platform

    … it follow Google’s advice on pagination? Why is this important? Because canonicals allow you to eliminate duplicate and/or low-quality content that many platforms inevitably produce and, from an SEO point of view, it allows a site owner to direct the SEO “power” of those pages. 5. Supports ad hoc 301 redirect mapping The devil is in the details…

    Search Engine Landin SEO- 19 readers -
  • Is your HTTPS setup causing SEO issues?

    … Google has been making the push for sites to move to HTTPS, and many folks have already started to include this in their SEO strategy. Recently at SMX Advanced, Gary Illyes from Google said that 34 percent of the Google search results are HTTPS. That’s more than I personally expected, but it’s a good sign, as more sites are becoming secured…

    Search Engine Landin SEO- 16 readers -
  • 10 factors that may be impacting your organic traffic

    … Whether you’re a seasoned SEO or someone who runs your own business, you know there are fluctuations in your organic traffic, but you may struggle to pinpoint the root cause. Organic search, unlike its paid counterpart, comes with a unique set of challenges in diagnosing a decline in traffic and conversions. There are some obvious places you…

    Search Engine Landin SEO- 18 readers -
  • Help! I just launched a new website and my search rankings tanked!

    … to launch. Suddenly, you realize you forgot to plan for one crucial element: the SEO best practices that you had so carefully incorporated into your old website. Unfortunately, this is not just a nightmare that can be forgotten once you’ve had your morning coffee, but something I’ve seen happen to countless small businesses over my 10 years…

    Will Scott/ Search Engine Landin SEO- 12 readers -
  • The role of technical SEO is “makeup?” Really?

    … is when it comes to technical SEO, there are no big wins; there’s only recovery from or prevention of big losses. Other than fixing what’s broken, technical SEO is not something that can get you increased search traffic. And isn’t that the true purpose of SEO? When I start working with new clients, the first things I want to look at are crawling…

    Search Engine Landin SEO- 16 readers -
  • How to quickly find and export all subdomains indexed by Google

    … is too long (too many -inurl operators), you will get a 400 error page from Google. Once you’re done, you still need some editing to create a nice list of subdomains to work with. The solution: a simple Chrome extension, by Google This extension, Personal Blocklist (by Google), will make your life easier. It allows you to “block” domains from appearing…

    Search Engine Landin SEO Google How To's- 16 readers -
  • The definitive SEO audit part 1 of 3: Technical

    … Disclaimer: Every situation is unique. This outline of the elements of a technical SEO audit discusses the common first points I look at with unpenalized sites hoping to increase their traffic. If you have a penalty or serious technical issues, this list is not exhaustive and will not cover all the areas you will need to research or methods…

    Dave Davies/ Search Engine Landin SEO- 11 readers -
  • Searchmetrics now shows where your app appears in App Packs

    … SEO and content marketing analytics service Searchmetrics has announced several new features, including the ability to see where your mobile apps — or those of competitors — appear in the Google App Packs or where your paid app ads show up a mobile search results page. The San Mateo, California-based company said this kind of analysis in its…

    Search Engine Landin SEO Google- 10 readers -
Get the top posts daily into your mailbox!