List of libraries, tools and APIs for web scraping and data processing.

SpideyX a multipurpose Web Penetration Testing tool with asynchronous concurrent performance with multiple mode and configurations.

📱 A utility for downloading Android apps from the Google Play Store and Xiaomi App Store (the Chinese App Store).

An declarative and easy to use web crawler and scraper in C#

🚀 OFFICIAL STARTER TEMPLATE FOR BOTASAURUS SCRAPING FRAMEWORK 🤖

Web crawling & scraping framework for Node.js on top of headless Chrome browser

🕷️ Easily scrap the web for torrent and media files.

🚀 THIS WEB SCRAPING TEMPLATE PROVIDES YOU WITH A GREAT STARTING POINT WHEN CREATING WEB SCRAPING BOTS. 🤖

Firetastic - a tool for automating interaction with FireTV apps

A Website Spider/Crawler, Python 3.x

This python script crawls course title, ratings, description and instructors from coursera.org

A web Crowler design , basic setup c++

Firetastic - a tool for automating interaction with FireTV apps

The DirFinder tool is user for bruteforce directory with dedicated Wordlist is very simple user-friendly to use

By scraping leads from Google Maps, you can build a database of potential customers who have shown interest in products or services related to your business. This data can be used for targeted marketing campaigns, email outreach, or sales prospecting.

A spam spider which is targeting 'Untitled' spam pages from the Google search results.

The DirFinder tool is user for bruteforce directory with dedicated Wordlist is very simple user-friendly to use

Selenium automatic test that visits every article on WordPress site.

Tourist is a simple tool that allows you to collect console messages, errors, unsuccessful requests of all your pages after the DOM loading with authentication support.