New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Dealing with articles where content extraction fails #205

Open

jemrobinson opened this issue May 20, 2019 · 1 comment

Labels

Member

jemrobinson commented May 20, 2019

For some articles, content extraction fails. We should decide what to do with these:

keep them in the database but with some incorrect/invalid content
skip them when writing to the database

We should also log how often and where this occurs.

jemrobinson added the enhancement label

Member Author

jemrobinson commented May 20, 2019

Thoughts @martintoreilly ? I am leaning towards (2). Our current solution is (1).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment