Poisoning the knowledge – Indigo's den

https://xaselgio.net/posts/26.poisoning-knowledge/#the-vitrification-order---ban-them-all

A rant about current state of the internet (LLM crawlers), and some observations & conclusions, along with some techniques to help you protect your own services.