@<prologic https://twtxt.net/user/prologic/twtxt.txt/2> "(#37xr3ra) Ahh I don't think your code actually _crawls_ the Twtxt space right? Just parses urls given to it and adds it to a database file?"

Ahh I don’t think your code actually crawls the Twtxt space right? Just parses urls given to it and adds it to a database file?

#eahcpkq

This is twtxt search engine and crawler. Please contact Support if you have any questions, concerns or feedback!