I’m sad but not surprised to learn that the wonderful folk at Democracy Club have had to put some constraints on the use of their awesome election data API. This is to stop bulk data scraper bots from overwhelming their whole service. There’s no point publishing open data if shitty bots take down your whole API.
There’s a generation of rogue bots out there, constantly scraping all and any data from the web that they can, probably to train LLMs. These bots try all manner of sneaky technical tricks to pretend that they’re normal human users, rather than indiscriminate data hogs.
They’re why I’ve put tight limits on unauthenticated use of the WhenIsBins API.
The open but respectful culture that made the Internet wonderful isn’t dead yet.
But it’s under serious threat from a warped West Coast culture which just doesn’t give a damn about the tragedy of the commons that is the inevitable long-term result of taking the piss like this.

Leave a Reply