Skip to content
#

model-deployment-with-kserve

Star

Here is 1 public repository matching this topic...

akhil2308 / kserve-template

Star 0

The kserve-template repository offers a simple framework for deploying ML models with `KServe`, focusing on text generation models like `Meta-Llama 3.2-1B-Instruct`. It includes sample requests, deployment steps, and configurations to streamline building, testing, and deploying inference services

meta-llama meta-llama-3-1-8b-instruct kserve-integration model-deployment-with-kserve custom-model-serving inference-services-with-kserve text-generation-models
  • Updated Dec 16, 2024
  • Python

Improve this page

Add a description, image, and links to the model-deployment-with-kserve topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the model-deployment-with-kserve topic, visit your repo's landing page and select "manage topics."

Learn more