A FirstPass Crawler (in node.js) to List URLs of any website
About the FirstPass Crawler (FPC) This is a simple Website crawler that I vibe-coded (mostly with ChatGpt, and 2 more AIs) , mainly for starting SEO analysis of non-wordpress websites. Why? Because the first thing that you need to check out a website, is to have a fast overview of it’s contents. Usually I fire…
Read More “A FirstPass Crawler (in node.js) to List URLs of any website” »