[crawler]

ChatbotPulseBot

ChatbotPulseBot is the website reader behind ChatbotPulse. When a business creates a chatbot and adds a website as a knowledge source, ChatbotPulseBot reads that site's public pages so the chatbot can answer visitors' questions about it.

How it identifies itself

Every request carries this User-Agent header:

ChatbotPulseBot/0.1 (+https://influbriz.com/bot)

The robots.txt product token is ChatbotPulseBot (matched case-insensitively).

When it visits

  • Only when a ChatbotPulse customer adds a website address, or asks to refresh one they added before.
  • It doesn't browse the web on its own and doesn't follow links to other domains.

What it reads, and what it doesn't

  • It reads robots.txt first and obeys its Allow and Disallow rules.
  • It reads sitemaps (from robots.txt, /sitemap.xml or /sitemap_index.xml) and links on the same site.
  • Public HTML pages only. It doesn't log in, submit forms, run JavaScript, or send or store cookies.
  • At most 500 pages per crawl, up to 3 requests at a time with a pause between batches, 2 MB per page and a 12-second timeout.
  • Standard web ports only (80, 443, 8080, 8443). It never fetches private or internal network addresses.

How to block or limit it

To keep ChatbotPulseBot off your whole site, add this to your robots.txt:

User-agent: ChatbotPulseBot
Disallow: /

To block only part of your site:

User-agent: ChatbotPulseBot
Disallow: /account/
Disallow: /checkout/

If your robots.txt has a group naming ChatbotPulseBot, only that group applies. Otherwise the User-agent: * rules apply. Changes take effect the next time a crawl starts.