Skip to content
This repository has been archived by the owner on Sep 5, 2024. It is now read-only.

Doesn't handle pagination of results in index search? #39

Open
Cobertos opened this issue Mar 17, 2021 · 0 comments
Open

Doesn't handle pagination of results in index search? #39

Cobertos opened this issue Mar 17, 2021 · 0 comments

Comments

@Cobertos
Copy link

search_single_index doesn't handle pagination. As mentioned on the Common Crawl blog (Ctrl + f Pagination), this means it will max out at the first 15000 results. For my use case I was getting only half my dataset.
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@Cobertos