Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[trimaran.targetloadpacking]: Hot Issues in continuous scheduling #797

Open
ShyunnY opened this issue Aug 29, 2024 · 3 comments
Open

[trimaran.targetloadpacking]: Hot Issues in continuous scheduling #797

ShyunnY opened this issue Aug 29, 2024 · 3 comments
Labels
lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale.

Comments

@ShyunnY
Copy link

ShyunnY commented Aug 29, 2024

Background:
I am currently using the trimaran.targetloadpacking scheduler plugin. Because my current scenario will encounter multiple Pods being scheduled continuously at a certain point in time. The targetloadpacking plugin uses metricsWatch + eventHandler to avoid hot spots, but this seems to have limitations.
In the case of large-scale pod continuous scheduling, perhaps the previous pod has just experienced the SchedulerCycle and is still waiting for the Bind operation in the background. At this time, EventHandler cannot observe and draw conclusions (because the Pod is not actually bound to the node).

Idea:
Can we introduce a simple flag in targetloadpacking to identify the NodeName bound to the previous round of Pods? When calculating the Node score, if the current Node is the Node that was scheduled in the previous round, we will appropriately reduce the score.

Tasks

Preview Give feedback
No tasks being tracked yet.
@binacs
Copy link
Member

binacs commented Sep 8, 2024

/cc

In fact, the root of the problem is that "plugins are not aware of scheduling decisions based on memory operations."

More precisely: after the scheduler completes the scheduling algorithm and before handle the binding event, all Assume behaviors cannot have their due impact on the execution logic of the plugins (not just trimaran.targetloadpacking).

We should provide plug-in-granular universal storage in the scheduler's cache to eliminate such problems.

@ShyunnY
Copy link
Author

ShyunnY commented Sep 8, 2024

@binacs SGTM, if possible, I would like to work on this together

@k8s-triage-robot
Copy link

The Kubernetes project currently lacks enough contributors to adequately respond to all issues.

This bot triages un-triaged issues according to the following rules:

  • After 90d of inactivity, lifecycle/stale is applied
  • After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
  • After 30d of inactivity since lifecycle/rotten was applied, the issue is closed

You can:

  • Mark this issue as fresh with /remove-lifecycle stale
  • Close this issue with /close
  • Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle stale

@k8s-ci-robot k8s-ci-robot added the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Dec 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale.
Projects
None yet
Development

No branches or pull requests

4 participants