Skip to content
@Infini-AI-Lab

Infini-AI-Lab

Next Generation AI algorithms and systems

Popular repositories Loading

  1. Sequoia Sequoia Public

    scalable and robust tree-based speculative decoding algorithm

    Python 342 37

  2. TriForce TriForce Public

    [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding

    Python 247 18

  3. MagicPIG MagicPIG Public

    [ICLR2025 Spotlight] MagicPIG: LSH Sampling for Efficient LLM Generation

    Python 201 14

  4. MagicDec MagicDec Public

    [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding

    Python 113 8

  5. UMbreLLa UMbreLLa Public

    LLM Inference on consumer devices

    Python 105 15

  6. gsm_infinite gsm_infinite Public

    Python 43 3

Repositories

Showing 10 of 18 repositories
  • UMbreLLa Public

    LLM Inference on consumer devices

    Infini-AI-Lab/UMbreLLa’s past year of commit activity
    Python 105 Apache-2.0 15 12 (6 issues need help) 9 Updated Mar 17, 2025
  • gsm_infinite Public
    Infini-AI-Lab/gsm_infinite’s past year of commit activity
    Python 43 3 1 0 Updated Feb 26, 2025
  • APE-Page Public
    Infini-AI-Lab/APE-Page’s past year of commit activity
    JavaScript 0 0 0 0 Updated Feb 12, 2025
  • APE Public
    Infini-AI-Lab/APE’s past year of commit activity
    Python 20 4 1 0 Updated Feb 12, 2025
  • RULER Public Forked from NVIDIA/RULER

    This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?

    Infini-AI-Lab/RULER’s past year of commit activity
    Python 0 Apache-2.0 81 0 0 Updated Jan 30, 2025
  • Sequoia Public

    scalable and robust tree-based speculative decoding algorithm

    Infini-AI-Lab/Sequoia’s past year of commit activity
    Python 342 37 7 3 Updated Jan 28, 2025
  • lm-evaluation-harness Public Forked from EleutherAI/lm-evaluation-harness

    A framework for few-shot evaluation of language models.

    Infini-AI-Lab/lm-evaluation-harness’s past year of commit activity
    Python 0 MIT 2,326 0 0 Updated Jan 11, 2025
  • S2FT Public
    Infini-AI-Lab/S2FT’s past year of commit activity
    Python 17 4 1 0 Updated Jan 3, 2025
  • S2FT-Page Public
    Infini-AI-Lab/S2FT-Page’s past year of commit activity
    JavaScript 0 0 0 0 Updated Dec 30, 2024
  • MagicPIG Public

    [ICLR2025 Spotlight] MagicPIG: LSH Sampling for Efficient LLM Generation

    Infini-AI-Lab/MagicPIG’s past year of commit activity
    Python 201 Apache-2.0 14 12 1 Updated Dec 16, 2024
View all repositories

Top languages

Loading…

Most used topics

Loading…