Skip to content

@pallas-inference Pallas Inference Server

Change the repository type filter

All

    Repositories list

    3 repositories

    • vllm

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •5.4k•0•0•0•Updated Nov 3, 2024Nov 3, 2024

    • triton-inference-server

      Public
      The Triton Inference Server provides an optimized cloud and edge inferencing solution.
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •1.5k•0•0•0•Updated Nov 2, 2024Nov 2, 2024

    • unilm-yoco

      Public
      Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
      Python
      •
      MIT License
      •2.6k•0•0•0•Updated Oct 30, 2024Oct 30, 2024