CRAWLER OPERATOR
Datadog crawlers.
Datadog runs one bot in this directory, Datadog Synthetics. It can be allowed or blocked on its own.
- 1 bot
- 0 can be verified
- 0 follow robots.txt
DATADOG
Every Datadog bot.
Open a bot for its robots.txt rule, verification and documentation.
1 bot
Datadog Synthetics
No robots.txt token
User-triggered
No bots match these filters.
What does blocking Datadog’s crawlers cost?
None of Datadog’s bots build a search index, so blocking them does not change your search rankings.
How do I check a request really comes from Datadog?
Datadog publishes no way to check its requests, so a request using one of these names is only a claim.
Where does this come from?
From Datadog’s own documentation, checked for each bot and linked on its profile, through the registry Ndovu uses to classify crawler traffic in Crawl Analytics.
See which of these crawlers visit your site.
Crawl Analytics reads your own server and CDN logs and checks each claim against the operator’s published IP ranges and DNS.