[Feat] KnowledgeBase/Vector Store - Log StandardLoggingVectorStoreRequest for requests made when a vector store is used

[ishaan-jaff]

[Feat] KnowledgeBase/Vector Store - Log StandardLoggingVectorStoreRequest for requests made when a vector store is used

Example of what litellm logs for users in StandardLoggingPayload (SLP)

[
    {
        "vector_store_id": "T37J8R4WTM",
        "query": "what is litellm?",
        "vector_store_search_response": {
            "search_query": "what is litellm?",
            "data": [
                {
                    "score": 0.47120637,
                    "content": [
                        {
                            "text": "Try LiteLLM Enterprise Try LiteLLM Enterprise Deploy LiteLLM Open Source Deploy LiteLLM Open Source #### \ud83d\ude85 LiteLLM Cost Tracking Cost Tracking Batches API Guardrails Model Access Model Access Budgets Budgets LLM Observability Rate Limiting Rate Limiting Prompt Management Prompt Management s3 Logging Pass-Through Endpoints User User User * * * * * * * 0M+ 0M+ docker pulls 1B+ 1B+ requests served 80% 80% uptime 425\\+ 425\\+ contributors ## What is LiteLLM? LiteLLM simplifies **model access**, **spend tracking** and **fallbacks** across 100+ LLMs. Watch this demo, to learn more. ## Features LiteLLM makes it easy for Platform teams to give developers LLM access Spend Tracking Budgets & Rate Limits OpenAI-Compatible LLM Fallbacks Accurately charge teams for their usage. * Attribute cost to key/user/team/org -> * Automatic spend tracking across OpenAI/Azure/Bedrock/GCP/etc. -> * Tag-based spend tracking -> * Log spend to s3/gcs/etc. -> * Prompt formatting support for HF models -> LiteLLM makes it easy for Platform teams to give developers LLM access Spend Tracking Budgets & Rate Limits OpenAI-Compatible LLM Fallbacks Accurately charge teams for their usage. * Attribute cost to key/user/team/org -> * Automatic spend",
                            "type": "text"
                        }
                    ]
                }
            ]
]

Relevant issues

Pre-Submission checklist

Please complete all items before asking a LiteLLM maintainer to review your PR

• I have Added testing in the tests/litellm/ directory, Adding at least 1 test is a hard requirement - see details
• I have added a screenshot of my new test passing locally
• My PR passes all unit tests on make test-unit
• My PR's scope is as isolated as possible, it only solves 1 specific problem

Type

🆕 New Feature
✅ Test

Changes

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
litellm	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	May 2, 2025 3:23pm