(#momapxa) @prologic It's close, but it's just a Web scraping library. I'm looking for something of the command line variety.

(#momapxa) @mckinley I was personally considering writing `man` pages for HTML elements at some point. `man` pages are very cool!

(#momapxa) @mckinley Ahh I see 👌 Well fortunately tool l linked above looks like it might do the trick for you 🤗

(#momapxa) @prologic I'm trying to make a static local mirror of MDN Web Docs. It's all free information on GitHub, but the whole system is extremely complicated. <​tinfoil-hat>I think it's so they can sell more MDN plus subscriptions, making people use their **terrible** MDN Offline system that uses the local storage of your browser.<​/tinfoil-hat> At this point, I'm willing to run a local dev server and just save each generated page and its dependencies. I really only need it to run JavaScript so it can request the browser compatibility JSON. It's but the MDN server, annoyingly, transforms it. Once the BCD data is rendered statically, I should be able to remove the references to the JavaScript. That will solve another issue I'm having where the JavaScript is constantly trying to download `/api/v1/whoami`, which seemingly has no purpose aside from user tracking.

(#momapxa) @prologic I'm trying to make a static local mirror of MDN Web Docs. It's all free information on GitHub, but the whole system is extremely complicated. <​tinfoil-hat>I think it's so they can sell more MDN plus subscriptions, making people use their **terrible** MDN Offline system that uses the local storage of your browser.<​/tinfoil-hat> At this point, I'm willing to run a local dev server and just save each generated page and its dependencies. I really only need it to run JavaScript so it can request the browser compatibility JSON. It's but the MDN server, annoyingly, transforms it. Once the BCD is rendered statically, I should be able to remove the references to the JavaScript. That will solve another issue I'm having where the JavaScript is constantly trying to download `/api/v1/whoami`, which seemingly has no purpose aside from user tracking.

(#momapxa) What about this? geziyor/geziyor: Geziyor, blazing fast web crawling

(#momapxa) @mckinley Wait what?! ... Why?! What are you doing? Are you trying to write a web search engine / crawler? 😅