SpearPointSpearPointBot
SpearPoint is a legislative research service. Our data collector reads public government records so that subscribers can follow legislation, hearings and campaign finance in one place, with links back to the official source.
User agent
When our collector identifies itself, it sends this user agent:
SpearPointBot/1.0 (+https://spearpointdata.com/bot)What it collects
- Bills, bill text, sponsors, actions and roll-call votes published by state legislatures and Congress
- Committee and floor hearing schedules, agendas and public video
- Campaign finance reports filed with state election and ethics agencies
- Lobbyist registrations published by state registries
- Election results published by state and county election offices
How it behaves
- Reads only pages and files that are public without an account.
- For campaign finance and lobbyist sources, checks robots.txt and skips paths it disallows.
- Stops when it meets a CAPTCHA, a bot challenge, a login page or an HTTP 403. We do not try to get around these.
- Spaces out its requests and retries only a few times, with growing delays.
- Prefers official bulk downloads and APIs over page-by-page browsing when an agency offers them.
Site operators
If our collector is causing you trouble, you would like us to slow down or stop, or you offer a bulk export we should use instead, please contact us. Tell us the site and roughly when you saw the traffic, and we will respond promptly.