Crawl a site to find pages with links that match user-defined criteria.
The end output is a list of your website's pages, and the matching link destinations by page. Includes support for fuzzy match of multiple search terms, and ignored URLs.
Use case: Find links on your site that you know will become broken.
-
Run
npm installto include dependencies. -
Change the file name of
inputs-example.jstoinputs.js. -
Enter custom values for
startingUrl,searchFor,ignoreLinksandsupportedHostnames. -
In your CLI, run
npm startto start your crawl.