ToolChronBot

What ToolChronBot is designed to do

When crawler execution begins, ToolChronBot will collect publicly accessible information about software products, including product pages, plans, pricing, usage limits, features, integrations and related public product information.

Information collected in the future may be structured, normalized, retained with source provenance and compared over time to build a historical software-product dataset.

Crawling principles

ToolChronBot:

• ✓accesses only publicly accessible resources
• ✓checks and respects robots.txt
• ✓identifies itself using the ToolChronBot User-Agent
• ✓uses conservative request behaviour
• ✓does not bypass authentication
• ✓does not bypass paywalls
• ✓does not bypass CAPTCHAs
• ✓does not bypass access controls
• ✓records acquisition failures rather than attempting evasive access
• ✓retains source provenance so collected information can be traced to its public source

Blocking ToolChronBot

Website operators can use standard robots.txt rules to block ToolChronBot from crawling their site.

User-agent: ToolChronBot
Disallow: /

robots.txt is a crawler policy input. It does not itself constitute legal authorization or allow ToolChronBot to bypass any other access boundary.