rainmana
Follow
OSINt
🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...
Tool to index and serve HTML files. Powered by Datasette.
List of libraries, tools and APIs for web scraping and data processing.
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, an…
artoo.js - the client-side scraping companion.
Websites crawler with built-in exploration and control web interface
DataHen Till is a companion tool to your existing web scraper that instantly makes it scalable, maintainable, and more unblockable, with minimal code changes on your scraper. Integrates with any sc…
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
An #OSINT Framework to perform various recon techniques on Companies, People, Phone Number, Bitcoin Addresses, etc., aggregate all the raw data, and give data in multiple formats.
Retrieve and parse whois data for IPv4 and IPv6 addresses
🔎 Most Advanced Open Source Intelligence (OSINT) Framework for scanning IP Address, Emails, Websites, Organizations.
A very high performance Domain Name parser package in Go.
A Linux eBPF rootkit with a backdoor, C2, library injection, execution hijacking, persistence and stealth capabilities.
A OSINT tool to obtain a target's phone number just by having his email address
Hunt down social media accounts by username across social networks
A temporary email right from your terminal written in POSIX sh
The Big List of Naughty Strings is a list of strings which have a high probability of causing issues when used as user-input data.
A machine learning tool that ranks strings based on their relevance for malware analysis.
Parse and stringify URL query strings