Skip to content

Commit

Permalink
update fine-tuning post
Browse files Browse the repository at this point in the history
hackathon link (as Openpipe demo)
update a few links/texts
  • Loading branch information
jschrier committed Nov 23, 2024
1 parent e5520c8 commit 8d966ed
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion _posts/2024-06-29-LLM-Finetuning-Notes.md
Original file line number Diff line number Diff line change
Expand Up @@ -39,6 +39,8 @@ What is frustrating (*circa late June/early July 2024*) is that you can't see wh

You've got to use the web-interface; as of late-June 2024, the API for fine-tuning is still in beta.

**(update: Nov 2024:)** I created a [short tutorial example](https://github.com/jschrier/KRICT_hackathon_phosphors/) of fine-tuning with various models on a chemistry prediction task using OpenPipe for a hackathon project. This shows off the convenience of the new


# Predibase

Expand Down Expand Up @@ -128,6 +130,6 @@ Unsloth is a library for performance tunning LLMs and they have a worked example

# Other things seen on the internet

- Alex Strick van Linschoten has been following the same LLM fine-tuning course as me, and has written blog posts about his experiences doing a [local (4-bit quantized) fine-tune using Axolotl](https://mlops.systems/posts/2024-06-15-isafpr-first-finetune.html) and comparing [one-click fine-tuning on Predibase, OpenPipe, and OpenAI](https://mlops.systems/posts/2024-06-17-one-click-finetuning.html) and [head to head comparisons and evals of his fine-tuned models against GPT-4](https://mlops.systems/posts/2024-07-01-full-finetuned-model-evaluation.html)
- Alex Strick van Linschoten followed the same LLM fine-tuning course as me, and has written blog posts about his experiences doing a [local (4-bit quantized) fine-tune using Axolotl](https://mlops.systems/posts/2024-06-15-isafpr-first-finetune.html) and comparing [one-click fine-tuning on Predibase, OpenPipe, and OpenAI](https://mlops.systems/posts/2024-06-17-one-click-finetuning.html) and [head to head comparisons and evals of his fine-tuned models against GPT-4](https://mlops.systems/posts/2024-07-01-full-finetuned-model-evaluation.html)
- [Distributed fine tuning Gemma 2 - 27B with Keras](https://developers.googleblog.com/zh-hans/fine-tuning-gemma-2-with-keras-hugging-face-update/) guide from Goog

0 comments on commit 8d966ed

Please sign in to comment.