Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feat: Back-fill null docs #15

Open
mster opened this issue Aug 17, 2020 · 1 comment
Open

Feat: Back-fill null docs #15

mster opened this issue Aug 17, 2020 · 1 comment
Assignees
Labels
backburner This can wait for a later version. design We need to formally design this! something-cool Cool idea! We can turn this into a feature. SPEED We need this thing to go fast!

Comments

@mster
Copy link
Owner

mster commented Aug 17, 2020

PROBLEM:
We know a query has N results from the queryList. However, in some cases Redis document hash keys may expire, dropping the document from the cache.

To the user, this means they get < N documents back, even though they expected N.

PROPOSAL:
Allow users to enable:

  1. Back-filling of the cache after a returning only what the cache contained at the time (Could be zero documents).
  2. Force back-filling of data before returning to the user, and then filling the cache afterwards.

(1) is fast*, while (2) is expensive yet dependable.

(*) the work still exists, but will occur on the next tick (has shown to slow down consecutive requests that result in cache misses).

@mster mster added enhancement New feature or request SPEED We need this thing to go fast! labels Aug 17, 2020
@mster mster self-assigned this Aug 17, 2020
@mster
Copy link
Owner Author

mster commented Aug 17, 2020

The time consideration is bordering on a non-issue as it occurs with only large document requests (>10k).

FireFerret is intended for front-end fetch apis which typically require small queries.

@mster mster added design We need to formally design this! something-cool Cool idea! We can turn this into a feature. and removed enhancement New feature or request labels Aug 22, 2020
@mster mster added the backburner This can wait for a later version. label Sep 6, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backburner This can wait for a later version. design We need to formally design this! something-cool Cool idea! We can turn this into a feature. SPEED We need this thing to go fast!
Projects
None yet
Development

No branches or pull requests

1 participant