DOCS
clock Last Modified: Oct 23, 2018

Bots and Adblocker

Last modified: October 23, 2018

Check out how well your site is being crawled by bots and how many of your users are using ad-blocking extensions, which can have a significant impact on your revenue.

Human vs Bot Traffic

We also keep track of the Human & Bot traffic. The Bot traffic is split into the following categories: Google Bot, Google Media Partners, Facebook Crawler, Twitter Crawler, Other Crawlers. You can use these statistics to find out if your site is correctly crawled by Google Bot and other bots.

Bot vs Human traffic, split by type
info Bot vs Human traffic, split by type

You can disable or enable the display of one of these categories by simply clicking on it.

You have a lot of time filtering possibilities, from the last minute to the last 6 months, along with the possibility of comparing these requests with another metric. All the information in categorized by timezone, based on your computer’s time and location settings.

AdBlocker

We have an automated way of collecting information about the traffic filtered by AdBlocker and other ad-blocking extensions. You can read more specifications here and we also have a detailed analysis on how ad-blocking is affecting your site’s revenue.

Here you can see the daily number of requests from visitors with an ad blocker enabled, compared to the number of pageviews without an ad blocker in the last 24 hours.

Number of requests from visitors with AdBlock enabled compared with the number of Pageviews
info Number of requests from visitors with AdBlock enabled compared with the number of Pageviews

You can disable or enable the display of one of these categories by simply clicking on it.

You have a lot of time filtering possibilities, from the last minute to the last 6 months, along with the possibility of comparing these requests with another metric. All the information in categorized by timezone, based on your computer’s time and location settings.

FAQs

How can I compare the traffic of Google Bot with the pageviews?

Our dashboard offers you the possibility to compare the pageviews with the traffic of Google Bot in the Stats section. You can choose to compare the Pageviews with the Bots traffic, and you also have the possibility to deselect the traffic graphs you are not interested in seeing with a simple click.

Is my site correctly crawled by bots?

We offer the Human vs Bots statistics for this exact purpose.

To check if your site is correctly crawled by bots, you can compare the Human vs Bot traffic with the Front-end responses for the last 24 hours, for example. Let’s say you want to check the Google Bot. For this, deselect all the other bots, along with all the Front-end responses, with the exception of the Server Errors.

Comparing the Bot Traffic with the Frontend responses
info Comparing the Bot Traffic with the Frontend responses

You can see in this case that there are very few server errors, which means the site is correctly crawled by the Google Bot. At 5 o’clock AM for example, which is the hour with the most server errors, there were 612 Google Bot requests and 2 server errors, which is insignificant.

What is the percentage of Adblocking-enabled browsers for my site?

You can check the percentage of Adblocking-enabled browsers for your site in our Stats section, where we have a tab dedicated to AdBlocker traffic.

Who is adblocking my ads more - desktop or mobile users?

Our stats dedicated to AdBlocker traffic also display the AdBlocking traffic split by mobile and desktop users.