review galore

Review · LLM gateways

LiteLLM review

A capable free gateway for technical teams, with a serious security question to weigh before putting provider keys behind it.

6.0/10Review Galore score

We may earn a commission if you buy through links on this page. It never changes a score or a ranking. How we make money

The bottom line

A free, flexible AI gateway for technical teams willing to manage deployment and security carefully.

LiteLLM gives a small platform team one OpenAI-compatible API for models, agents, and MCP servers, with routing, spend tracking, budgets, and access controls. Its Open Source plan costs $0, so a team can start without a per-seat bill.

The trade-off is operational responsibility: teams self-host the gateway, and recent Reddit reports about compromised releases raise a real supply-chain concern. We’d consider it when the gateway’s flexibility matters and the team can pin versions and manage upgrades carefully.

Good fit if

  • Technical teams self-hosting a gateway
  • Teams routing across model providers
  • Budget-conscious platform engineers

Skip it if

  • Teams wanting a managed gateway
  • Teams without upgrade controls
  • Buyers needing published enterprise pricing
LiteLLM homepage
LiteLLM homepage, captured Nov 10, 2026

ScoresHow it rates

  • Features8
  • Ease of use5
  • Value for money9
  • Support5
  • User sentiment2

What works

  • Open Source plan costs $0
  • One API covers 100+ providers on the free plan
  • Routes requests and supports model swaps
  • Tracks spend with budgets and rate limits
  • Enterprise offers SSO, audit logs, and support

What doesn't

  • Self-hosting puts deployment and updates on your team
  • Enterprise pricing is custom and annual
  • No per-seat Enterprise price is published
  • Free-plan usage limits aren't listed
  • Reddit users report compromised releases

01Who LiteLLM is for

LiteLLM is best for a technical team of one to ten people that needs to put several AI providers behind a shared gateway. The Open Source plan costs $0, making it a low-cost option for a small platform team that can run its own infrastructure. LiteLLM says it offers one OpenAI-compatible API for 140+ providers and 1,800+ models, with routing, usage tracking, budgets, and access controls.

The job is broader than swapping model names: teams can track spend by key, user, team, org, tool, agent, and MCP, and set caps that stop requests when reached. That is useful when several apps or coworkers share provider access. But it is self-hosted software, not a hands-off subscription. A small team without someone responsible for deployments, secrets, and version updates may find the operational work outweighs the free license.

02LiteLLM free plan and trial

The Open Source plan is free forever. Its listed inclusions are 100+ providers through one OpenAI API, virtual keys, users and teams, spend tracking, budgets, rate limits, LLM fallbacks, request logging, and Prometheus metrics. For a team of one, three, or five, the listed software price remains $0 per month; the plan is not priced per seat.

The pricing page does not list usage caps or a seat limit for Open Source, so ask LiteLLM about any deployment or usage limits that matter to your setup. The pricing information also lists a 30-day free trial but does not say which plan it applies to. Enterprise is the paid route for SSO, SCIM, audit logs, multi-region control, and available 24/7 support. It is quoted annually rather than listed at a fixed price.

03What a small team pays for LiteLLM

For Open Source, the listed price is $0 per month: one person pays $0, three people pay $0, and five people pay $0. That is also $0 per year at the listed software price. The plan is not described as per-seat pricing, and the pricing page does not list a seat minimum. Hosting and model-provider usage costs are not itemized in the plan price, so confirm those separately for your setup.

Enterprise is annual custom pricing, not a published monthly or per-seat rate. LiteLLM says the quote depends on gateway request capacity, deployment architecture, and support needs. That means we can’t calculate a reliable one-person, three-person, or five-person total; ask for a quote based on your architecture and expected requests. The listed Enterprise features include SSO, SCIM, OIDC/JWT auth, audit logs, secret managers, and multi-region control, with 24/7 support and SLAs available. No paid add-ons are listed. The pricing page lists a 30-day trial but does not specify which plan it covers.

Full LiteLLM pricing breakdown →

04Getting started with LiteLLM

LiteLLM is self-hosted, so getting started means more than creating an account: your team needs to run the gateway and decide how to manage its credentials, deployment, and updates. The product’s unified OpenAI-compatible API and model routing can reduce app-side changes when switching models, but they do not remove the work of operating the gateway.

The vendor's site lists 100+ providers on Open Source and 140+ providers and 1,800+ models across the product. Those are useful options, but a small team should start with the providers and apps it actually needs. The materials here don’t establish a setup time or Windows installation steps, so check LiteLLM’s current docs before choosing a deployment. Reddit users also report that automatic Docker updates pulled a compromised image; pinning versions and reviewing updates deserves a place in the setup plan.

05When small teams outgrow LiteLLM

There is no published seat limit or Open Source usage cap to mark a clear point where a team must upgrade. The practical trigger is governance: when you need SSO, SCIM, audit logs, secret managers, multi-region control, or available 24/7 support and SLAs, those are listed under Enterprise. Its annual price is custom, so get a quote before treating the free plan as a long-term budget guarantee.

A different kind of growth problem is operational trust. Reddit users reported compromised LiteLLM releases, including version 1.107.0 and, in another thread, versions 1.82.7 and 1.82.8. One Reddit commenter advised pinning exact versions and checking keys after exposure. These reports do not establish the current state of the releases, but they are a reason to review security notices, control upgrades, and assess the risk of placing provider credentials behind a gateway. Teams unable to take on that work may prefer a managed approach.

From the threadsWhat users say

Reddit discussion is strongly negative around reported compromised releases and the security of the release process. Some commenters still value the gateway’s unified API, but trust and update controls dominate the conversation.

Supply-chain concern
the 1.107.0 release on PyPI and the official image litellm/litellm:1.107.0 carried an infostealer plus a backdoor
r/selfhosted · view thread
Prior incident worries
There was another incident yes
r/selfhosted · view thread
Pin versions
pin exact versions and hash check in ci, floating latest on a gateway is asking for exactly this
r/LocalLLM · view thread
Unified API value
It’s a tool that lets you switch between LLMs more easily. They all have different APIs; LiteLLM give you one API to work with and handles the different ways of communicating
r/LocalLLM · view thread

Questions people ask

Is LiteLLM free?

Yes. The Open Source plan is listed as free forever and includes provider access through one OpenAI API, virtual keys, users and teams, spend tracking, budgets, rate limits, fallbacks, request logging, and Prometheus metrics. Hosting and model usage costs are not itemized in the plan price.

What does LiteLLM do?

LiteLLM puts AI models, agents, and MCP servers behind one API and key. Its listed features include model routing, spend tracking, budgets, rate limits, and access controls. The product says its unified API covers 140+ providers and 1,800+ models.

Does LiteLLM add latency?

LiteLLM routes requests through a gateway, but no latency figure is listed in the pricing information. The added time for your setup will depend on its deployment and request path. Measure it with your own workloads before making a production decision.

Can I install LiteLLM on Windows?

LiteLLM is described as a self-hosted gateway, but the information here does not establish Windows support or installation steps. Check the current LiteLLM documentation for supported deployment environments before planning a Windows setup.

What happens when a LiteLLM budget cap is reached?

LiteLLM lists budgets and rate limits, and says requests stop when caps are reached. The exact behavior and available controls for a particular deployment are worth confirming in the current product documentation before you rely on a cap to control spend.

Sources

  1. LiteLLM homepage
  2. LiteLLM pricing page
  3. Reddit: Heads up if you self-host LiteLLM: the 1.107.0 Docker image (and the latest/main-latest/main-stable tags) shipped a credential stealer
  4. Reddit: litellm 1.107.0 on PyPI is compromised
  5. Reddit: Alert! LiteLLM 1.107.0 was compromised today
  6. Reddit: After the supply chain attack, here are some litellm alternatives