Skip to content

Commit

Permalink
Installing adapter from main
Browse files Browse the repository at this point in the history
Signed-off-by: Jefferson Fialho <jfialho@ibm.com>
  • Loading branch information
fialhocoelho committed Dec 5, 2024
1 parent 365d99a commit 4873e9f
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion Dockerfile.ubi
Original file line number Diff line number Diff line change
Expand Up @@ -208,7 +208,9 @@ USER root
RUN --mount=type=cache,target=/root/.cache/pip \
--mount=type=cache,target=/root/.cache/uv \
--mount=type=bind,from=build,src=/workspace/dist,target=/workspace/dist \
HOME=/root uv pip install "$(echo /workspace/dist/*.whl)[tensorizer]" vllm-tgis-adapter==0.5.3
HOME=/root uv pip install "$(echo /workspace/dist/*.whl)[tensorizer]" --verbose && \
uv pip install \
"git+https://github.com/opendatahub-io/vllm-tgis-adapter@main" --verbose

ENV GRPC_PORT=8033 \
PORT=8000 \
Expand Down

0 comments on commit 4873e9f

Please sign in to comment.