Skip to content

Pull requests: neuralmagic/gateway-api-inference-extension

New pull request New
10 Open 35 Closed
10 Open 35 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add load based scorer
#77 opened Apr 28, 2025 by mayabar Loading…
7
DO NOT MERGE Propagate request headers to plugins + support mutation headers in resp
#76 opened Apr 28, 2025 by mayabar Loading…
2
feat: Add scripts for kubernetes dev env using vLLM and vLLM-p2p
#60 opened Apr 25, 2025 by kfirtoledo Loading…
1
65
Minor fixes in instructions for deploying dev k8s env
#58 opened Apr 24, 2025 by elevran Loading…
1
Session affinity scorer
#52 opened Apr 24, 2025 by mayabar Loading…
3
Prefix Aware Scorer
#48 opened Apr 23, 2025 by oglok Loading…
25
Add scorer based on active loras
#43 opened Apr 22, 2025 by mayabar Loading…
5
Add second vLLM-sim instance to allow for routing
#41 opened Apr 21, 2025 by oglok Loading…
6
Fix in scorer manager in picking the best target
#35 opened Apr 20, 2025 by mayabar Loading…
5
Implemented KVCacheAwareScorer
#34 opened Apr 19, 2025 by vMaroon Loading…
20
ProTip! Mix and match filters to narrow down what you’re looking for.