Skip to content

Commit

Permalink
save
Browse files Browse the repository at this point in the history
  • Loading branch information
xrdaukar committed Feb 12, 2025
1 parent efbe9d6 commit 6e99230
Showing 1 changed file with 2 additions and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,8 @@
# - Request access to Llama 3.2: https://huggingface.co/meta-llama/Llama-3.2-11B-Vision-Instruct
#
# Usage:
# oumi infer -i -c configs/recipes/vision/llama3_2_vision/inference/11b_sglang_infer.yaml --image tests/testdata/pdfs/oumi_getting_started.pdf
# oumi infer -i -c configs/recipes/vision/llama3_2_vision/inference/11b_sglang_infer.yaml \
# --image "tests/testdata/images/the_great_wave_off_kanagawa.jpg"
#
# Sample command to start SGLang server:
# CUDA_VISIBLE_DEVICES=0 python -m sglang.launch_server \
Expand Down

0 comments on commit 6e99230

Please sign in to comment.