Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add better news url detection automatically or add options #19

Open
ivbeg opened this issue Oct 13, 2022 · 0 comments
Open

Add better news url detection automatically or add options #19

ivbeg opened this issue Oct 13, 2022 · 0 comments
Assignees
@ivbeg
Labels
bug Something isn't working

Comments

@ivbeg
Copy link
Owner

ivbeg commented Oct 13, 2022

The current rule is to use the first link by default. It doesn't work well.

Example URL http://pskenergo.ru/news/branch/
instead of a post URL, each time a category URL is detected.

Solutions:

  1. Smarter analysis of link composition
  2. Add more options to detect urls
@ivbeg ivbeg added the bug Something isn't working label Oct 13, 2022
@ivbeg ivbeg self-assigned this Oct 13, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ivbeg ivbeg

Labels
bug Something isn't working
Projects
Automated scraping tools
Status: No status
Milestone
No milestone
Development

No branches or pull requests
1 participant
@ivbeg