In part two, we wanted to know exactly how long Semrush and other tools take to find a new link and then display it in the tool’s user interface.
For this second step, we used RSS feeds to retrieve high traffic parts of the web where we could also see the publication time of an article.
Part 1. Who sees new links first: Semrush, Ahrefs, Moz or Majestic?
First, we looked at a random sample of URLs provided by an independent vendor – Common Crawl .
The question we wanted to answer was:
Using data from Semrush, Ahrefs, Moz, and Majestic, which tool will identify new links to these URLs first?
- We received a random sample of over 33,000 URLs from Common Crawl
- For each URL, we measured when it was discovered as a backlink by Semrush, Ahrefs, Moz, and Majestic
- We calculated the number and percentage of cases where each data provider found a backlink at least one day before the other data providers.
- If two data providers find the same backlink in the same day, we call it a tie and give one point to each provider.
- If a provider has not found a backlink at the time of evaluation, this provider is considered the last to discover this link.
As we can see from the graph below, Semrush outperformed the competition by a staggering 37% of cases.
Part 2 (a). How fast, exactly, can Semrush find new links?
Next, we wanted to determine exactly how fast the entire process takes, from the time you publish your new blog post to the time you see your new backlinks in Semrush.
That’s why we decided to take a look at the RSS feeds of big websites.
We used RSS feeds for two reasons:
- RSS feeds from news publications represent high traffic sites that would generate new content and immediately garner backlinks
- RSS feeds provide a date and time stamp , which allowed us to track exactly how much time elapsed between when a new page was published and when a new backlink to that page was seen in each tool.
First, we took about 20,000 URLs from
RSS feeds of various news outlets around the world.
Next, we measured how quickly Semrush discovered links to their new content compared to other data providers.
We then measured the median time it took each tool to check and discover a new backlink.
To do this, we followed these steps:
- We have identified the RSS feeds of the most popular media on the web
- For about a month we collected all the URLs from these feeds until we had collected 20,000 URLs
- For each URL, we calculated the difference between the time the URL was published according to the RSS feed and the time Semrush first saw that URL DiscoveryTimei=FirstSeenTimei-PublishedTimei
-
We then calculated the median of these differences
- We repeated the above process for Ahrefs, Moz, and Majestic
- Any URLs that have not been seen by any of the SEO tools within 30 days of the publication date have been discarded for each vendor mentioned above.
It was surprising to see that the median time Semrush took to display the new link after creating the target page was only 19 minutes!
Note: We had to exclude Moz and Majestic from this graph because they don’t offer timestamps on what time of day a link was viewed.
It is important to know not only the day, but also the exact time when the link appeared to get proper results. Moz and Majestic do not have this russia telegram data information in their API, so we decided to exclude them from this table.
Part 2 (b). Who won the backlink race in the RSS feed sample?
Finally, we measured the percentage of cases where each data provider discovered a backlink at least one day before any other provider , the same time frame we used with the Common Crawl data sample.
The results are very similar to what we got here, with Semrush winning with 32.9% of cases.
By combining our new architecture, the fastest backlink analysis tool and the latest database with our five backlink management tools, Semrush is the market leader for businesses that need dynamic backlink management solutions.
To be successful in SEO and link building or management, you need a strategy. You need to identify your main competitors and conduct a competitive analysis.
You’ll need a way to create new lauren robinson account director links and manage existing ones.
And since SEO is a competitive business. You’ll always want to be in the race. Getting results faster and more consistently than your competitors.
Here’s what you can do
The best way to understand data quality is to test it yourself! That’s why we’re offering extended access to our backlink database to anyone with a free Semrush account for a limited time.
Simply create a free account (no subscription required) to have the same level of access to our Backlink Analysis as someone with a Pro subscription.
Find backlinks faster than ever
with Semrush Backlink Analysis tool
Especially if you’re responsible for database d building links. And reporting on that growth. We’d love for you to try out our backlink analysis tool and let us know what you think.
Let us know which tool from our dynamic suite you use the most and how important speed is to you and your work.
Send us your feedback anytime on social media or by email at backlinks-feedback
Want to dive deeper and understand how we did this? Check out this follow-up blog post with the details of our process so you can understand exactly what we did.