Add litellm-proxy CLI

[msabramo]

Title

Add litellm-proxy CLI

$ litellm-proxy
Usage: litellm-proxy [OPTIONS] COMMAND [ARGS]...

  LiteLLM Proxy CLI - Manage your LiteLLM proxy server

Options:
  --base-url TEXT  Base URL of the LiteLLM proxy server  [env var:
                   LITELLM_PROXY_URL]
  --api-key TEXT   API key for authentication  [env var:
                   LITELLM_PROXY_API_KEY]
  --help           Show this message and exit.

Commands:
  chat         Chat with models through the LiteLLM proxy server
  credentials  Manage credentials for the LiteLLM proxy server
  http         Make HTTP requests to the LiteLLM proxy server
  keys         Manage API keys for the LiteLLM proxy server
  models       Manage models on your LiteLLM proxy server

Right now this only has a limited set of commands, but in the future, more capabilities can be added.

More details at the README.md here

Screenshots

Relevant issues

Pre-Submission checklist

Please complete all items before asking a LiteLLM maintainer to review your PR

• I have Added testing in the tests/litellm/ directory, Adding at least 1 test is a hard requirement - see details
• I have added a screenshot of my new test passing locally
• My PR passes all unit tests on make test-unit
• My PR's scope is as isolated as possible, it only solves 1 specific problem

Type

🆕 New Feature

Changes

[msabramo]

What happened here? The tests passed but the job failed. Is the job timing out perhaps?

I wonder if #10484 would fix this...

[msabramo]

What happened here? The tests passed but the job failed. Is the job timing out perhaps?

I wonder if #10484 would fix this...

OK, I fixed this I think with ca39496 (Increase test job timeout to 8 minutes), though I think it would be preferable to merge #10484 and then this timeout increase wouldn't be necessary

[krrishdholakia]

Hey @msabramo let me know once this is ready for review

[msabramo]

Oh this is ready for review. I added a few things to it recently only because I thought you were busy with fixing the mypy issues, but go ahead and review now if you have the time!