Skip to content

Latest commit

 

History

History
26 lines (13 loc) · 440 Bytes

README.md

File metadata and controls

26 lines (13 loc) · 440 Bytes

Sof crawler

A Crawler for stackoverflow.com's latest 5000 questions by tag

Run locally

  1. Clone the repository

  2. Install the requirements

    pip install -r requirements.txt

  3. Run the crawler

    scrapy crawl sof

Run with docker

  1. Clone the repository

  2. Run docker-compose

    docker-compose up -d --build

After this processes latest 5000 questions will be inserted to sof.db database file.