Releases: DevelopersTree/Crawler
Releases · DevelopersTree/Crawler
Version 0.6
Normalization command is now ready 😁
Version 0.5
- Accepts only one URL for the seed instead of a list of URLs
- Doesn't crawl a page more than once
Version 0.4
The Kurdish text extractor is now ready and it's integrated with the crawl command.
Version 0.3
Rename a couple of parameters:
-path
is now-output
-maxpages
is now-pages
Version 0.2
Bug fixes
- Crashed when save path didn't exists