ForkFree

AI models and chat

litellm

by BerriAI

LiteLLM is a gateway and Python library that lets you call more than 100 AI model providers, such as OpenAI, Anthropic, Bedrock and Azure, using one OpenAI-style format. It is for teams that want to switch between providers, track spending and control access from one place.

Worth a lookEstablished, with a few things to check (listed below).

View on GitHubProject website

Stars
62.1k +51 a day
Licence
MIT
Runs on
A small server
Setup
Moderate
Language
Python
Age
1188 days

What you can do with it

  • Call models from OpenAI, Anthropic, Gemini and others through one consistent interface
  • Run a central proxy server that issues virtual keys and tracks spend per user or team
  • Set up load balancing, fallbacks and guardrails across several AI providers

Make money with it

A freelancer could set up and manage a LiteLLM gateway for small businesses that want one place to control AI access and costs, charging for setup and support.

An idea, not financial advice. Check the licence before charging for anything built on it.

Ways a business could use it

  • Cut AI costs by routing requests to cheaper models and tracking spend per customer or project
  • Avoid being locked in to one AI provider by switching models without rewriting your code

Can you use it commercially?

Free to use, change and sell (MIT-style terms in the licence file). Some folders may carry other terms.

Not legal advice. Read the project's licence file before building a product on it.

Getting it running

Install the Python SDK with uv or pip, or run the proxy with 'uv tool install litellm[proxy]' and the 'litellm' command, or deploy it with Docker or one-click hosting templates.

Follow the official instructions in the project README.

Things to check

  • Licence is listed as unclear (NOASSERTION), and some features are in a paid Enterprise tier
  • You need your own paid API keys for the underlying AI providers
  • The README is partly cut off, so some features could not be checked

Who's talking about it

Checked 27 Oct 2026. Summary drafted by AI from the project's README.

More in AI models and chat

dsh-our-free-model Ebony-Vinyl
New and promising

This tool provides access to free AI models, including DeepSeek V4.1 Flash and Kimi K3, without requiring login or API keys. It integrates with DSH and offers features like model selection, usage tracking, and local gateway support.

Could replace Anthropic, LobsterAI

45.6k stars +876 a day MIT
magpie yetone
New and promising

magpie is a tool that allows you to switch between different AI models and agents from one local gateway, making it easier to manage multiple AI services.

Could replace Claude, ChatGPT

23.1k stars +565 a day MIT
Strata Niko1221
New and promising

Strata is an AI inference engine that allows users to run powerful AI models on their own computer, including chat, coding, and image processing capabilities.

34k stars +440 a day MIT