Waitβ¦ So you actually wrote a more elaborate crawler without taking a shortcut like I did using colly (not that it really helps much) Hmmm? π€ Can we take it a bit further, make a daemon/server out of it, a web interface to search what it crawls using bleve and some tools (API, Web UI) to let people add more βfeedsβ to crawl? π€
#acie3ca