This repository contains code for fine-tuning the LLama3 8b model using Alpaca prompts to generate Java codes. The code is based on a Google Colab notebook.
The provided notebook demonstrates how to fine-tune the LLama3 8b model for generating Java codes using Alpaca prompts. It utilizes the unsloth library for language model operations and the Hugging Face Transformers library for training and inference tasks.
2. Hugging Face Finrtuned Model
Install necessary packages by executing the following commands:
!pip install "unsloth[colab-new] @ git+https://github.com/unslothai/unsloth.git"
!pip install --no-deps "xformers<0.0.26" trl peft accelerate bitsandbytes1.Load the LLama3 8b model with pre-defined settings.
2.Format prompts using Alpaca prompt template and load the dataset.
3.Train the model using the provided dataset and Huggingface TRL's SFTTrainer.
1.Run inference on the trained model by providing an instruction and input. Leave the output blank for generation.
2.Optionally, use a TextStreamer for continuous inference to see the generation token by token.
1.Save the final model with LoRA adapters for inference.
2.Load the saved LoRA adapters for inference if needed.
1.Adjust parameters and settings as per your requirements.
2.Ensure to replace placeholder file paths with actual paths in the notebook.
1. Huggingface Transformers Documentation
Contributions are always welcome! Please create a PR to add Github Profile. Feel free to explore and modify the provided notebook as needed for your Java code generation tasks!
1. MIT
Give a ⭐️ if this project helped you!