Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use distributed data structures for interpolation #124

Open
5 tasks
adperezm opened this issue Feb 18, 2025 · 0 comments
Open
5 tasks

Use distributed data structures for interpolation #124

adperezm opened this issue Feb 18, 2025 · 0 comments

Comments

@adperezm
Copy link
Collaborator

When using the domain_binning option, use distributed data structures.

There are a number of improvements to do:

To make the kd-tree searches more efficient:

  • When initializing/creating the global maps: Make the check for GLL points on the bin tree be handled in chunks.
  • When Make the check for probes on the Global tree be handled in chunks, just as done for the rank_bbox option.

To distribute the data structure

  • Assign bins to ranks in a logical order.
  • Each rank should inform the bin owners if they have data in that bin. They do not need to inform that to EVERY other rank as it is done now.
  • At rank candidate identification, make the quering rank identify the bins in which it has query points. Then make it ask the bin owner which are the ranks that have points in that bin.

It is possible that for the global structure, instead of using KD-trees, just using a hash table is in fact more efficient. Consider that as well.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant