Mesolitica
We develop Multimodality Artificial Intelligence for South East Asia.
Pinned Loading
Repositories
Showing 10 of 47 repositories
- transformers-diloco-trainer Public Forked from huggingface/transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
mesolitica/transformers-diloco-trainer’s past year of commit activity - Chunk-loss-LoRA Public
Fused kernel chunk loss to include LoRA to reduce memory, support DeepSpeed ZeRO3.
mesolitica/Chunk-loss-LoRA’s past year of commit activity - initial-paged-flash-attention Public Forked from huggingface/transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
mesolitica/initial-paged-flash-attention’s past year of commit activity - transformers-openai-api Public
Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.
mesolitica/transformers-openai-api’s past year of commit activity - accelerate-torch-compile-speechlm Public Forked from huggingface/accelerate
🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support
mesolitica/accelerate-torch-compile-speechlm’s past year of commit activity
