Skip to content

Commit

Permalink
Update Dockerfile - flash-attn
Browse files Browse the repository at this point in the history
  • Loading branch information
ggbetz authored Apr 10, 2024
1 parent 7a67d07 commit 18a801f
Showing 1 changed file with 4 additions and 0 deletions.
4 changes: 4 additions & 0 deletions Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,10 @@ RUN cd lm-evaluation-harness && pip install -e ".[vllm]"
RUN cd cot-eval && pip install -e .
RUN pip install -U vllm==${VLLM_VERSION}

# reinstall flash-attn as torch might have gotten reinstalled above
RUN pip uninstall -y flash-attn
RUN pip install flash-attn --no-build-isolation


# Environment variables

Expand Down

0 comments on commit 18a801f

Please sign in to comment.