LLM Finetuning

A project to get hands-on LLM finetuning by finetuning an LLM on a custom dataset.

ToDo

• Document code
• Understand hyperparams

Dataset

Finetuning

References

• Supervised Fine-tuning Trainer
• Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA
• Reference Notebook
• GPU compatibility with format
• Finetuninbg with PEFT
• DataCamp Llama Finetuning