Skip to content

rebornbd/WEBbot

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 

Repository files navigation

WEB CRAWLER

overview

backend

backend: django, celery, rabbitmq, Elasticsearch

# functionality
Fixed URL Crawling
Continious URL Crawling
WEB Indexing (using Elasticsearch)

frontend

frontend: react

# functionality
Setting seed URL
Set Crawling Type (Fixed | Continious)
Searching by (Keyword | long-string)
Show Search Result

Releases

No releases published

Packages

No packages published

Languages