Skip to content

Commit

Permalink
upload
Browse files Browse the repository at this point in the history
  • Loading branch information
ShuoXing98 committed Feb 18, 2025
1 parent 5e3ebcd commit 7414370
Show file tree
Hide file tree
Showing 2 changed files with 0 additions and 2 deletions.
1 change: 0 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -86,7 +86,6 @@ unzip train2014.zip
--warmup_ratio 0.03 \
--lr_scheduler_type "cosine" \
--bf16 True \
--run_name "llava-vicuna-7b-rdpo-lora-1e-6-beta-0.1" \
--lisa_enable False \
--lora_enable True \
--beta 0.1 \
Expand Down
1 change: 0 additions & 1 deletion train_lora_rdpo.sh
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,6 @@ deepspeed --include=localhost:2,3 --master_port 60000 train_rdpo.py \
--warmup_ratio 0.03 \
--lr_scheduler_type "cosine" \
--bf16 True \
--run_name "llava-vicuna-13b-rdpo-lora-$lr-beta-$beta-new-qkvo" \
--lisa_enable False \
--lora_enable True \
--beta $beta \
Expand Down

0 comments on commit 7414370

Please sign in to comment.