Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[perf] Run Inverted Index Before Other Operators #14764

Merged
merged 1 commit into from
Jan 8, 2025

Conversation

ankitsultana
Copy link
Contributor

Resolves #14744

This is still not the "ideal approach". Currently we always reorder AND predicates based on these priorities, but sometimes users may have selective filters which are lower priority.

We could do more sophisticated optimizations in the future, like dynamically re-arranging predicates, which could be helpful for scenarios where we have 1000s of segments to be filtered in a single server.

But I'll defer that to later.

@codecov-commenter
Copy link

codecov-commenter commented Jan 6, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 63.84%. Comparing base (59551e4) to head (d1e397a).
Report is 1538 commits behind head on master.

Additional details and impacted files
@@             Coverage Diff              @@
##             master   #14764      +/-   ##
============================================
+ Coverage     61.75%   63.84%   +2.09%     
- Complexity      207     1607    +1400     
============================================
  Files          2436     2703     +267     
  Lines        133233   150738   +17505     
  Branches      20636    23289    +2653     
============================================
+ Hits          82274    96236   +13962     
- Misses        44911    47298    +2387     
- Partials       6048     7204    +1156     
Flag Coverage Δ
custom-integration1 100.00% <ø> (+99.99%) ⬆️
integration 100.00% <ø> (+99.99%) ⬆️
integration1 100.00% <ø> (+99.99%) ⬆️
integration2 0.00% <ø> (ø)
java-11 63.81% <100.00%> (+2.10%) ⬆️
java-21 63.73% <100.00%> (+2.10%) ⬆️
skip-bytebuffers-false 63.83% <100.00%> (+2.09%) ⬆️
skip-bytebuffers-true 63.69% <100.00%> (+35.96%) ⬆️
temurin 63.84% <100.00%> (+2.09%) ⬆️
unittests 63.83% <100.00%> (+2.09%) ⬆️
unittests1 56.29% <100.00%> (+9.40%) ⬆️
unittests2 34.15% <0.00%> (+6.42%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@Jackie-Jiang Jackie-Jiang merged commit 0600185 into apache:master Jan 8, 2025
20 of 21 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Inverted Index Filters Run After All Other Index Filters
3 participants