Seo: Crawling And Robots

    • Fun with robots.txt

      One of the most boring topics in technical SEO is robots.txt. Rarely is there an interesting problem needing to be solved in the file, and most errors come from not understanding the directives or from typos. The general purpose of a robots.txt file is simply to suggest to crawlers where they can and cannot go. Basic parts of the robots.txt file User-agent — specifies which robot.

      Search Engine Landin SEO- 17 readers -
  • It’s scary how many ways SEO can go wrong

    We’ve all had those moments of absolute terror where we just want to crawl into the fetal position, cry and pretend the problem doesn’t exist. Unfortunately, as SEOs, we can’t stay this way for long. Instead, we have to suck it up and quickly resolve whatever went terribly wrong. There are moments you know you messed up, and there are times a problem can linger for far too l ...

    Search Engine Land- 15 readers -
  • Exploring a newly-granted Google patent around social signals

    … fits that bill perfectly. We’re heard repeatedly from Google that social interactions are not a search ranking signal. In fact, you can read a Tweet from Google’s Gary Illyes in response to the statement, “Some controversy over whether Google takes social into account for SEO….” His reply: So the answer is “No,” right? Maybe, and here’s where…

    Dave Davies/ Search Engine Landin SEO Google- 11 readers -
  • How to check which URLs have been indexed by Google using Python

    … There are three main components to organic search: crawling, indexing and ranking. When a search engine like Google arrives at your website, it crawls all of the links it finds. Information about what it finds is then entered into the search engine’s index, where different factors are used to determine which pages to fetch, and in what order…

    Search Engine Landin SEO Google How To's- 12 readers -
  • The myth of the duplicate content penalty

    Many people are more afraid of duplicate content than they are of spammy links. There are so many myths around duplicate content that people actually think it causes a penalty and that their pages will compete against each other and hurt their website. I see forum posts, Reddit threads, technical audits, tools, and even SEO news websites publishing articles that show people ...

    Search Engine Land- 9 readers -
  • Case study: JavaScript blocking Google’s view of hreflang

    … The hreflang attribute has been an important part of the SEO toolkit for webmasters and digital marketers for a good many years. In order for Google to best understand your multilingual or multinational website, it is integral that your hreflang implementation is correct and that Google fully understands it. If you’re new to the hreflang…

    Search Engine Landin SEO Google- 13 readers -
  • 9 tools to help you succeed with Google SERP features

    … to get a little help from some friends — and by friends, I mean tools that help you leverage SERP features. Here are a few such tools that can sharpen your SEO sword: 1. Yotpo’s Search Enhancements Do you work in e-commerce? If so, you’ll definitely want to look into Yotpo, which focuses on integrating reviews into your website for greater SERP…

    Jordan Kasteler/ Search Engine Landin SEO Google- 16 readers -
  • 5 ways ads are killing your site (& SEO)

    …, but they can create issues if not implemented intelligently. 3. Are you top heavy? No, this isn’t about overdoing your chest flys. Back in 2012, Google announced the “Top Heavy” algorithm, which was designed to prevent sites that were “top heavy” with ads from ranking well in its listings. The recent change to Google’s AdSense rules suggests that they may…

    Kristine Schachinger/ Search Engine Landin SEO- 12 readers -
  • SEO requirements for a new website platform

    …). With that, I’d consider friendly URLs as key to a site’s SEO. 11. Navigation depth & inclusions able to be customized In other words, you should be able to choose to include (or not to include) subcategories in your top navigation. Similarly, retailers should have the ability to choose to not include an e-commerce category in top navigation…

    Search Engine Landin SEO- 20 readers -
  • Is your HTTPS setup causing SEO issues?

    … Google has been making the push for sites to move to HTTPS, and many folks have already started to include this in their SEO strategy. Recently at SMX Advanced, Gary Illyes from Google said that 34 percent of the Google search results are HTTPS. That’s more than I personally expected, but it’s a good sign, as more sites are becoming secured…

    Search Engine Landin SEO- 18 readers -
  • 10 factors that may be impacting your organic traffic

    … Whether you’re a seasoned SEO or someone who runs your own business, you know there are fluctuations in your organic traffic, but you may struggle to pinpoint the root cause. Organic search, unlike its paid counterpart, comes with a unique set of challenges in diagnosing a decline in traffic and conversions. There are some obvious places you…

    Search Engine Landin SEO- 20 readers -
  • Help! I just launched a new website and my search rankings tanked!

    … to launch. Suddenly, you realize you forgot to plan for one crucial element: the SEO best practices that you had so carefully incorporated into your old website. Unfortunately, this is not just a nightmare that can be forgotten once you’ve had your morning coffee, but something I’ve seen happen to countless small businesses over my 10 years…

    Will Scott/ Search Engine Landin SEO- 14 readers -
  • The role of technical SEO is “makeup?” Really?

    I was appalled by the main message of Clayburn Griffin‘s column the other day, “The role technical SEO should play: It’s makeup,” and I made my feelings towards the post pretty clear on Twitter. Many others shared my sentiments. So when Search Engine Land’s Executive Features Editor, Pamela Parker, reached out to see if I wanted to write a reaction piece to express some of t ...

    Search Engine Land- 17 readers -
  • How to quickly find and export all subdomains indexed by Google

    … An SEO audit is rarely limited to the www (or non-www) version of a website. When looking for potential duplicate content, it’s often important to know how many subdomains exist and, more importantly, how many of them are indexed by Google. The good old search operators An easy way to find indexed subdomains is to use search operators. Start…

    Search Engine Landin SEO Google How To's- 17 readers -
Get the top posts daily into your mailbox!