Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge pull request #39 from bopoda/master_high_performance
RobotsTxtParser significantly improve performance (~1000x on large files)
- Loading branch information