Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Limit Elasticsearch upload size #38

Open
DavidLemayian opened this issue Aug 26, 2017 · 2 comments
Open

Limit Elasticsearch upload size #38

DavidLemayian opened this issue Aug 26, 2017 · 2 comments
Labels
bug enhancement help wanted

Comments

@DavidLemayian
Copy link
Contributor

Currently we are uploading all the data at once to Elasticsearch but this fails when you have a lot of data for example in the case of Health Facilities, we get the following error:

TransportError(413, u'{"Message":"Request size exceeded 10485760 bytes"}')
@TinaMurimi
Copy link
Contributor

Hi @DavidLemayian There are duplicates in the data. Would removing the duplicates also help?

@DavidLemayian
Copy link
Contributor Author

@tinamorale What do you mean by duplicates? Could you share an example and where the duplicate is being created?

@andela-mmakinde andela-mmakinde mentioned this issue Oct 24, 2017
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug enhancement help wanted
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@DavidLemayian @TinaMurimi