ClearRates bot

The daily worker requests provider pages that are implemented, and the official Bank Rate, CPI and gilt-yield series. It does not publish sample data.

When a provider is fetched, the client uses this user agent:

ClearRatesBot/1.0 (+https://clearrates.co.uk/bot)

A fetch will wait at least 10 seconds between requests to the same domain, send conditional requests where the site supports them, and stop if robots.txt disallows the path or the provider is marked manual-only or “ask first”. The provider record stores that policy. There is no login and no attempt to bypass a block.

Sunny holding a sign that reads 10 seconds, the minimum gap between fetches to one domain. — A future fetch waits at least this long between requests to the same domain.

To opt out of a future fetch, email hello@clearrates.co.uk. The provider will be set to manual-only.

Catch every sunny spell.