Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Odh release 051 ray #86

Closed
wants to merge 11 commits into from
Closed

Odh release 051 ray #86

wants to merge 11 commits into from

Conversation

fialhocoelho
Copy link

IBM Release of vLLM version 0.5.1 with Ray

avshalomman and others added 10 commits July 8, 2024 08:00
@avshalomman
[Kernel] reloading fused_moe config on the last chunk (vllm-project#6210
f7a8fa3 
)
@afeldman-nm @WoosukKwon
[Kernel] Correctly invoke prefill & decode kernels for cross-attentio…
543aa48 
…n (towards eventual encoder/decoder model support) (vllm-project#4888)

Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
@fialhocoelho
Merge branch 'main' of https://github.com/vllm-project/vllm into odh_…
73cd840 
…release_051

Signed-off-by: Jefferson Fialho <jfialho@ibm.com>
@fialhocoelho
Squash and merge vllm from branch nick/allowed_token_ids
a12bb5e 
Signed-off-by: Jefferson Fialho <jfialho@ibm.com>
@fialhocoelho
Squash 6172
4e5338d 
Signed-off-by: Jefferson Fialho <jfialho@ibm.com>
@fialhocoelho
Squash 4645
25f1b2e
@fialhocoelho
Squash 6034
d1b078f
@fialhocoelho
editing the path for pip installation
15ed802 
Signed-off-by: Jefferson Fialho <jfialho@ibm.com>
@fialhocoelho @prashantgupta24
Update setup.py
8c02f6c 
pr-review

Co-authored-by: Prashant Gupta <prashantgupta24@gmail.com>
@fialhocoelho
Squash 85
ce733ca
@openshift-ci OpenShift CI
Copy link

openshift-ci bot commented Jul 9, 2024

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: fialhocoelho
Once this PR has been reviewed and has the lgtm label, please assign rpancham for approval. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci OpenShift CI
Copy link

openshift-ci bot commented Jul 9, 2024

Hi @fialhocoelho. Thanks for your PR.

I'm waiting for a opendatahub-io member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@fialhocoelho
solving func error from build log
729bb12 
Signed-off-by: Jefferson Fialho <jfialho@ibm.com>

import Optional for get_extra_requirements() func

Signed-off-by: Jefferson Fialho <jfialho@ibm.com>
@openshift-ci OpenShift CI
Copy link

openshift-ci bot commented Jul 10, 2024

@fialhocoelho: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/smoke-test 729bb12 link true /test smoke-test
ci/prow/pr-image-mirror 729bb12 link true /test pr-image-mirror
ci/prow/images 729bb12 link true /test images

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

@prashantgupta24
Copy link

Will open a new one

prarit pushed a commit to prarit/vllm that referenced this pull request Oct 18, 2024
@divakar-amd
larger input lens tuning 8x7B-TP=1,2,4 and 8x22B-TP=2,4 (opendatahub-…
5630555 
…io#86)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@terrytangyuan terrytangyuan Awaiting requested review from terrytangyuan

@vaibhavjainwiz vaibhavjainwiz Awaiting requested review from vaibhavjainwiz

Assignees
No one assigned
Labels
ok-to-test
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@fialhocoelho @prashantgupta24 @danielezonca @avshalomman @afeldman-nm