Build it with TensorFlow and fine-tune BERT. for now, trying to fine-tune GPT-Neo with LoRA
For the data on this repo, you can get it on : https://www.kaggle.com/datasets/uciml/sms-spam-collection-dataset
For the requirements.txt, I got it from google colab