These docs describe the current Dante AI platform. On the earlier platform? Your API reference is at api-v2.dante-ai.com/docs (sign-in needed), and your key goes in the x-api-key header.

DanteBot

DanteBot is the reader Dante AI uses to learn a website. It only reads a site after someone adds that site as a knowledge source for a Dante AI agent.

What DanteBot does

When you add your website to your AI agent, DanteBot reads its public pages so your agent can answer visitors from them. It reads the site you added and nothing else, and it reads it again only when you ask, or on the automatic refresh you chose for that source.

It reads public pages only. It never signs in and carries no passwords or cookies of yours.
It reads /robots.txt only to find your sitemaps. It does not yet follow Disallow lines in that file, so to keep DanteBot off your site, block it as described in Stop DanteBot reading your site.
It slows down when your site asks it to (it honours Retry-After on 429 and 503 answers).
It never solves a CAPTCHA, never changes its name or address to get past a block, and never retries a refusal under a different identity. If your site refuses it, it stops and tells the person who added the site.

How DanteBot names itself

Every request carries the DanteBot token in its User-Agent header. Plain page reads send:

Mozilla/5.0 (compatible; DanteBot/1.0 (+https://www.dante-ai.com/docs/bot.html) EchoBot/1.0 (+https://agents.dante-ai.com))

Page text is read in a normal browser, so pages built with JavaScript show their words. The browser sends its own name followed by the same tokens:

Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/126.0.0.0 Safari/537.36 DanteBot/1.0 (+https://www.dante-ai.com/docs/bot.html) EchoBot/1.0 (+https://agents.dante-ai.com)

EchoBot is DanteBot's earlier name. It stays in the header so a rule that looks for EchoBot anywhere in the user agent keeps working. A rule that matched the whole of the old header, or how it started, needs changing to match DanteBot.

Where DanteBot reads from

DanteBot reads from these addresses today, listed so you can recognise it in your logs:

46.101.75.169
165.232.101.189
139.59.169.205
161.35.172.7
46.101.81.65

These change when our hosting replaces a server, and an address we stop using can later be given to someone else. A security rule that lets these addresses through can stop working without warning, or later let a stranger in, so do not use them in one. Use the DanteBot rule below instead.

Let DanteBot through Cloudflare

If your site is on Cloudflare and your AI agent says your site's security layer blocked our reader, your Cloudflare settings are refusing DanteBot. Only someone who manages your Cloudflare account can change that. On a Pro, Business or Enterprise plan:

Open your site in the Cloudflare dashboard and go to Security, then WAF, then Custom rules (in the newer dashboard: Security, then Security rules). Choose Create rule.
Name it Allow DanteBot. Choose Edit expression and paste:
```
(http.user_agent contains "DanteBot")
```
Set the action to Skip, and tick All Super Bot Fight Mode rules only. Leave the managed rules, rate limiting and your security level as they are.
Save the rule and move it to the top of the list, so it runs before your other custom rules.
Back in Dante, open your AI agent's knowledge and read the website again.

Good to know. Anyone can copy a user agent, so this rule lets through anything that calls itself DanteBot. That is why it skips only the automated-traffic checks and leaves the rest of your protection on.

On Cloudflare's Free plan, Bot Fight Mode cannot be skipped by a custom rule. Your choices are to switch Bot Fight Mode off in your Cloudflare security settings, or to use one of the other ways to teach your agent below.

Other bot-protection services

Imperva, Akamai, Sucuri, Wordfence and similar services each have a setting for allowing a named crawler by its user agent. Ask whoever manages yours to allow user agents containing DanteBot, then read the website again from your AI agent's knowledge.

Teach your agent without changing your site's security

You do not have to change any security setting. Any of these works straight away:

Add your sitemap. If your sitemap address (often /sitemap.xml) is not behind the protection, add it as a sitemap source.
Paste your key pages. Copy the text of your most important pages and paste it in. Your agent learns from pasted text just as well as from a crawl.
Upload files. Upload PDFs or documents of your pages, price lists or help articles.

See Knowledge sources for what each message during setup means.

Stop DanteBot reading your site

Block user agents containing DanteBot (and EchoBot) at your firewall or bot-protection service. DanteBot takes the refusal and does not come back under another name. You can also contact us about any read of your site.

Questions?

Contact our team →