Skip to content

@hao-ai-lab Hao AI Lab

Change the repository type filter

All

    Repositories list

    13 repositories

    • cse234-w25-PA

      Public
      Python
      •33•20•0•0•Updated Feb 28, 2025Feb 28, 2025

    • vllm

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •6k•0•0•1•Updated Feb 28, 2025Feb 28, 2025

    • FastVideo

      Public
      FastVideo is a lightweight framework for accelerating large video diffusion models.
      Python
      •
      Apache License 2.0
      •69•1.2k•24•3•Updated Feb 28, 2025Feb 28, 2025

    • cse234-w25

      Public
      Website for CSE 234, Winter 2025
      SCSS
      •
      Other
      •42•6•0•3•Updated Feb 28, 2025Feb 28, 2025

    • hao-ai-lab.github.io

      Public
      HTML
      •8•1•1•0•Updated Feb 22, 2025Feb 22, 2025

    • Dynasor

      Public
      Simple extension on vLLM to help you speed up reasoning model without training.
      llmreasoning-modelsdeepseek-r1
      Python
      •
      MIT License
      •10•94•6•0•Updated Feb 21, 2025Feb 21, 2025

    • Consistency_LLM

      Public
      [ICML 2024] CLLMs: Consistency Large Language Models
      large-language-modelsefficient-llmefficient-llm-inference
      Python
      •
      Apache License 2.0
      •17•377•7•0•Updated Nov 16, 2024Nov 16, 2024

    • vllm-ltr

      Public
      [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank
      Python
      •
      Apache License 2.0
      •7•40•0•0•Updated Nov 4, 2024Nov 4, 2024

    • LookaheadDecoding

      Public
      [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
      Python
      •
      Apache License 2.0
      •72•1.2k•33•1•Updated Oct 14, 2024Oct 14, 2024

    • MuxServe

      Public
      Jupyter Notebook
      •4•50•2•0•Updated Jun 13, 2024Jun 13, 2024

    • dsc291-PA

      Public
      Jupyter Notebook
      •3•2•0•0•Updated Jun 6, 2024Jun 6, 2024

    • dsc291-s24

      Public
      Website for DSC 291, Spring 2024
      SCSS
      •
      Other
      •42•0•0•0•Updated Jun 5, 2024Jun 5, 2024

    • dsc204a-w24

      Public
      Website for DSC 204a, Winter 2024
      SCSS
      •
      Other
      •42•8•0•1•Updated Mar 24, 2024Mar 24, 2024