Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[do-not-merge] Ibm 20241203 pt2 build image #256

Closed
wants to merge 229 commits into from
Closed

[do-not-merge] Ibm 20241203 pt2 build image #256

wants to merge 229 commits into from

Conversation

fialhocoelho
Copy link

No description provided.

simon-mo and others added 30 commits November 15, 2024 12:47
@simon-mo
[Docs] Add Nebius as sponsors (vllm-project#10371)
c76ac49 
Signed-off-by: simon-mo <simon.mo@hey.com>
@russellb
[Frontend] Add --version flag to CLI (vllm-project#10369)
a067f85 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
@russellb
[Doc] Move PR template content to docs (vllm-project#10159)
3e8d14d 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
@mikegre-google
[Docs] Misc updates to TPU installation instructions (vllm-project#10165
4f168f6 
)
@DarkLight1337
[Frontend] Automatic detection of chat content format from AST (vllm-…
32e46e0 
…project#9919)

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
@youkaichao
[doc] add doc for the plugin system (vllm-project#10372)
755b853 
Signed-off-by: youkaichao <youkaichao@gmail.com>
@youkaichao
[misc][plugin] improve log messages (vllm-project#10386)
2f427c2 
Signed-off-by: youkaichao <youkaichao@gmail.com>
@rasmith
[BugFix] [Kernel] Fix GPU SEGV occuring in fused_moe kernel (vllm-pro…
1d75472 
…ject#10385)

Signed-off-by: Randall Smith <Randall.Smith@amd.com>
@kakao-steve-ai
[Misc] Update benchmark to support image_url file or http (vllm-proje…
8b6725b 
…ct#10287)

Signed-off-by: rbbang <anjaehyun87@gmail.com>
@skylee-01
[Misc] Medusa supports custom bias (vllm-project#10361)
b98d89e
@imkero
[Bugfix] Fix M-RoPE position calculation when chunked prefill is enab…
361c29e 
…led (vllm-project#10388)

Signed-off-by: imkero <kerorek@outlook.com>
@WoosukKwon
[V1] Add code owners for V1 (vllm-project#10397)
661a34f 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
@youkaichao
[2/N][torch.compile] make compilation cfg part of vllm cfg (vllm-proj…
4fd9375 
…ect#10383)

Signed-off-by: youkaichao <youkaichao@gmail.com>
@ywang96
[V1] Refactor model executable interface for all text-only language m…
643ecf7 
…odels (vllm-project#10374)

Signed-off-by: Roger Wang <ywang@roblox.com>
@xuechendi
[CI/Build] Fix IDC hpu [Device not found] issue (vllm-project#10384)
905d0f0 
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
@Isotr0py
[Bugfix][CPU] Fix CPU embedding runner with tensor parallel (vllm-pro…
cf349c4 
…ject#10394)

Signed-off-by: Isotr0py <2037008807@qq.com>
@youkaichao
[platforms] refactor cpu code (vllm-project#10402)
8d74b5a 
Signed-off-by: youkaichao <youkaichao@gmail.com>
@jikunshang
[Hardware] [HPU]add mark_step for hpu (vllm-project#10239)
76aab90 
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
@imkero
[Bugfix] Fix mrope_position_delta in non-last prefill chunk (vllm-pro…
80d85c5 
…ject#10403)

Signed-off-by: imkero <kerorek@outlook.com>
@wchen61
[Misc] Enhance offline_inference to support user-configurable paramet… (
d1557e6 
vllm-project#10392)

Signed-off-by: wchen61 <wchen61@foxmail.com>
@Isotr0py
[Misc] Add uninitialized params tracking for AutoWeightsLoader (vll…
c4e4643 
…m-project#10327)

Signed-off-by: Isotr0py <2037008807@qq.com>
@HollowMan6
[Bugfix] Ignore ray reinit error when current platform is ROCm or XPU (…
47826ca 
…vllm-project#10375)

Signed-off-by: Hollow Man <hollowman@opensuse.org>
@youkaichao
[4/N][torch.compile] clean up set_torch_compile_backend (vllm-project…
51bb12d 
…#10401)

Signed-off-by: youkaichao <youkaichao@gmail.com>
@lk-chen
[VLM] Report multi_modal_placeholders in output (vllm-project#10407)
c7dec92 
Signed-off-by: Linkun Chen <lkchen+anyscale@github.com>
@Maybewuss
[Model] Remove redundant softmax when using PoolingType.STEP (vllm-pr…
01aae1c 
…oject#10415)
@B-201
[Model][LoRA]LoRA support added for glm-4v (vllm-project#10418)
5be4e52 
Signed-off-by: B-201 <Joy25810@foxmail.com>
@Isotr0py
[Model] Remove transformers attention porting in VITs (vllm-project#1…
e7ebb66 
…0414)

Signed-off-by: Isotr0py <2037008807@qq.com>
@B-201
[Doc] Update doc for LoRA support in GLM-4V (vllm-project#10425)
4186be8 
Signed-off-by: B-201 <Joy25810@foxmail.com>
@youkaichao
[5/N][torch.compile] torch.jit.script --> torch.compile (vllm-project…
7851b45 
…#10406)

Signed-off-by: youkaichao <youkaichao@gmail.com>
@ismael-dm
[Doc] Add documentation for Structured Outputs (vllm-project#9943)
31894a2 
Signed-off-by: ismael-dm <ismaeldm99@gmail.com>
jeejeelee and others added 22 commits December 2, 2024 17:53
@jeejeelee
[Misc][LoRA] Move the implementation of lora bias to punica.py (vllm-…
b45f0d7 
…project#10829)

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
@yma11 @youkaichao
[Misc][XPU] Avoid torch compile for XPU platform (vllm-project#10747)
519cc6c 
Signed-off-by: yan ma <yan.ma@intel.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
@janimo
Fix openvino on GPU (vllm-project#10793)
9b14d97
@Isotr0py @DarkLight1337
[Model] Add TP and BNB quantization support to LlavaMultiModalProject…
4c05edb 
…or (vllm-project#10834)

Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
@mgoin
[Bugfix] Prevent benchmark_throughput.py from using duplicated random…
4433195 
… prompts (vllm-project#10753)
@zixuanzhang226
[Model] support bitsandbytes quantization with minicpm model (vllm-pr…
d746268 
…oject#10842)

Signed-off-by: Ubuntu <zixuanzhang@bytedance.com>
@jeejeelee
[Bugfix] Fix QKVParallelLinearWithShardedLora bias bug (vllm-project#…
a4cf256 
…10844)

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
@youkaichao
[core][distributed] add pynccl broadcast (vllm-project#10843)
21fe7b4 
Signed-off-by: youkaichao <youkaichao@gmail.com>
@youkaichao
[torch.compile] remove compilation_context and simplify code (vllm-pr…
dc5ce86 
…oject#10838)

Signed-off-by: youkaichao <youkaichao@gmail.com>
@russellb @DarkLight1337
[Doc] Add github links for source code references (vllm-project#10672)
ef51831 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
@DarkLight1337
[Misc] Remove deprecated names (vllm-project#10817)
3257d44 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
@aarnphm @mgoin
[Core][Performance] Add XGrammar support for guided decoding and set …
9323a31 
…it as default (vllm-project#10785)

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: mgoin <michael@neuralmagic.com>
Co-authored-by: mgoin <michael@neuralmagic.com>
@zhengy001
[Speculative Decoding] Move indices to device before filtering output (…
f6084f6 
…vllm-project#10850)

Co-authored-by: Yang Zheng(SW)(Alex) <you@example.com>
@alexm-redhat @mgoin @ywang96
[V1] VLM - Run the mm_mapper preprocessor in the frontend process (vl…
3bc94ca 
…lm-project#10640)

Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
@yma11
[MISC][XPU] quick fix for XPU CI (vllm-project#10859)
2f2cdc7 
Signed-off-by: yan ma <yan.ma@intel.com>
@mgoin
[Bugfix] Only require XGrammar on x86 (vllm-project#10865)
7090c27 
Signed-off-by: mgoin <michael@neuralmagic.com>
@fialhocoelho
Merge branch 'main' of https://github.com/vllm-project/vllm into ibm-…
1016e4e 
…20241203

Signed-off-by: Jefferson Fialho <jfialho@ibm.com>
@fialhocoelho
Squash 6357
6369112 
Signed-off-by: Jefferson Fialho <jfialho@ibm.com>
@fialhocoelho
Squash 10235
dbf6855 
Signed-off-by: Jefferson Fialho <jfialho@ibm.com>
@fialhocoelho
pin mistral==1.5.0 and install adapter from branch main branch 🚀
9de0c53 
Signed-off-by: Jefferson Fialho <jfialho@ibm.com>
@fialhocoelho
Dockerfile.ubi fix
365d99a 
Signed-off-by: Jefferson Fialho <jfialho@ibm.com>
@fialhocoelho
Installing adapter from main
4873e9f 
Signed-off-by: Jefferson Fialho <jfialho@ibm.com>
@fialhocoelho fialhocoelho requested a review from njhill as a code owner December 5, 2024 03:17
@fialhocoelho fialhocoelho self-assigned this Dec 5, 2024
@openshift-ci OpenShift CI
Copy link

openshift-ci bot commented Dec 5, 2024

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: fialhocoelho
Once this PR has been reviewed and has the lgtm label, please assign danielezonca for approval. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci OpenShift CI
Copy link

openshift-ci bot commented Dec 5, 2024

@fialhocoelho: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/smoke-test 4873e9f link true /test smoke-test
ci/prow/rocm-pr-image-mirror 4873e9f link true /test rocm-pr-image-mirror
ci/prow/images 4873e9f link true /test images

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@njhill njhill Awaiting requested review from njhill njhill is a code owner

@dtrifiro dtrifiro Awaiting requested review from dtrifiro

@vaibhavjainwiz vaibhavjainwiz Awaiting requested review from vaibhavjainwiz

Assignees

@fialhocoelho fialhocoelho

Labels
do-not-merge/hold
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.