So I had a play with this search engine tonight and read everything about what this guy has done, amazing work! 👌 I’ve reached out to him via email to see if perhaps he’d be interested in teaming up with me in some way. Anyway I also wanted to point out something rather sad:

The crawler gets captchad by CDNs like Fastly and CloudFlare. I’ve prostrated myself before them and pleaded to get listed as a good bot, but they have yet to call back so until then they are blocked on a subnet level.

😢 😡 🤬 #Fastly and #Cloudflare sucks 😡