Skip to content

Latest commit

 

History

History
93 lines (63 loc) · 2.58 KB

README.md

File metadata and controls

93 lines (63 loc) · 2.58 KB

Cookie Scanner

This Python script is designed to send requests to the Cookie Doctor API to process a list of hostnames. The script reads a single hostname, a list of hostnames, or a .txt file containing hostnames, sends them to the Cookie Doctor API for processing, and saves the response in JSON or text format.

Features

  • Multi-threaded execution using Python's ThreadPoolExecutor for concurrent processing.
  • Input flexibility: Accepts a single hostname, a list of hostnames, or a .txt file containing hostnames.
  • Saves output: Responses are saved as JSON or plain text in an organized folder structure.
  • Error handling: Captures and logs errors during the request.

Requirements

  • Python 3.6+ is required to run this script.
  • Required Python libraries:
    • requests

You can install the required dependencies using:

pip install requests

Setup

  1. Clone the repository:

    git clone https://github.com/edgewatch/cookie.doctor.git
cd cookie.doctor

  2. Install dependencies:

    pip install -r requirements.txt

  3. Ensure the API endpoint for Cookie Doctor is configured correctly:

    API_COOKIE_DOCTOR='https://api.cookie.doctor/api/v1/process_host/'

Usage

The script can process a single hostname, a list of hostnames, or a .txt file containing multiple hostnames.

Command Line Usage:

python cookie_scanner.py <hostname|hostnames.txt|["hostname1", "hostname2", ...]>

  • Single Hostname:

    python cookie_scanner.py https://example.com

  • List of Hostnames (as a string):

    python cookie_scanner.py '["https://example.com", "http://test.com"]'

  • Hostnames from a .txt file:

    python cookie_scanner.py hostnames.txt

Output

  • The responses from the Cookie Doctor API are saved in the output/ directory.
  • For each hostname, a corresponding folder is created. The response is saved as a .json file if it's valid JSON or as a .txt file if not.
  • The filenames are timestamped to differentiate between scans.

Example File Structure:

output/
└── example.com/
    └── example.com_2023-09-30_15_23_45.json

Concurrency

The script processes hostnames concurrently using Python's ThreadPoolExecutor, with 4 worker threads by default. This can be adjusted inside the script if necessary.

Contributing

Contributions are welcome! If you find a bug or want to improve this script, feel free to submit a pull request or create an issue.

License

This project is licensed under the MIT License.