Langfuse launches AI Gateway

Product Announcement: One entry point for all your AI traffic, with spend tracked per person and model. In Public Beta.
͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏
  ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏
  ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏
  ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏
  ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏
  ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏
  ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­͏   ­
Hi Emre Elbeyoglu,
 
Exciting news: We’re launching Langfuse AI Gateway today (public beta).
 



 
Many of you have been asking for a gateway, now it’s here and we are very much looking forward to your feedback
[https://github.com/orgs/langfuse/discussions/19686] on it. Highlights of what we launch today: Fully open source (MIT), built in
Rust for performance and reliability, natively integrated with the Langfuse platform, and an ambitious roadmap for the coming
weeks based on your input.
 
Why build a gateway?
AI usage has sprawled in organizations, from coding agent use to custom agents. Keeping track of AI usage in an organization
across providers is hard, and in many cases there’s a jungle of issued API keys and no transparency on cost.
 
Langfuse AI Gateway Specs
The Langfuse AI Gateway is a single entry point for all AI traffic between your apps or coding agents and model providers, and can
(opt-in) turn every model call into a Langfuse trace.
 
For builders
 * Tracing with zero instrumentation: change the base URL and use a gateway key
   [https://langfuse.com/docs/gateway/get-started/first-request?utm_source=langfuse&utm_medium=email&utm_campaign=202611-gateway].
   No SDK or hooks needed.

 * Debug and evaluate gateway traffic
   [https://langfuse.com/docs/gateway/features/tracing?utm_source=langfuse&utm_medium=email&utm_campaign=202611-gateway]: with
   recording on, search, evaluate, and annotate it in Langfuse like any other trace.

 * See what your calls cost: each trace carries model, tokens, and cost, including coding-agent sessions.



 
 
For team leads and admins
 * Spend by person, team, and model
   [https://langfuse.com/docs/gateway/features/analytics?utm_source=langfuse&utm_medium=email&utm_campaign=202611-gateway]: every
   gateway key belongs to a person or service, so you no longer need to hand out provider keys across your org.

 * Choose which models your team can use
   [https://langfuse.com/docs/gateway/features/models?utm_source=langfuse&utm_medium=email&utm_campaign=202611-gateway].

 * Privacy controls: record usage and cost only (default), full prompts and responses, or nothing at all. You keep your provider
   contracts and rates, e.g. zero data retention.



 
Performance and availability
 * Built in Rust: <3ms median latency with tracing on and 1,000+ concurrent streams on a single 2 vCPU node. Self-hosted, it’s a
   single 22MB Docker image with no extra dependencies.

 * Supports OpenAI and Anthropic (more coming very soon, let us know what you need).

 * Available on Langfuse Cloud or self-hosted
   [https://langfuse.com/self-hosting/configuration/ai-gateway?utm_source=langfuse&utm_medium=email&utm_campaign=202611-gateway].
   Cloud: no token markup. Recorded calls are billed as regular units; unrecorded calls are free.

 
→ Read the full announcement
[https://langfuse.com/blog/introducing-gateway?utm_source=langfuse&utm_medium=email&utm_campaign=202611-gateway]
 
Org admins can turn it on today
[https://langfuse.com/docs/gateway/get-started/admin-setup?utm_source=langfuse&utm_medium=email&utm_campaign=202611-gateway]. Not
an admin? Forward this email to whoever manages your Langfuse org.
 
This is only the beginning, we have a strong roadmap for the AI Gateway, incl. spend limits (very soon), fallbacks, guardrails,
and much more. Feedback? Reply to this email or join the GitHub Discussion [https://github.com/orgs/langfuse/discussions/19686].
 
See a demo and ask questions live during our Langfuse Community Town Hall this Thursday, Nov 12 → Sign up
[https://luma.com/lvp5fx33]
 
Also: Next to Langfuse AI Gateway, ClickHouse announces a series of products today across Managed Postgres, Observability (if you
like Langfuse, you will like this), Security and AI Engineering. Read more here
[https://clickhouse.com/blog/announcing-clickhouse-platform-largest-expansion?utm_medium=referral&utm_source=langfuse&utm_campaign=unified-platform-launch].
 
See you on Thursday during the Town Hall,
Marc
 
PS: If you want to support the launch, feel free to drop a like or comment on our socials (X
[https://x.com/langfuse/status/2119837547555618872]/LinkedIn [https://lnkd.in/p/dgmw7nTM]).
 
—
Co-founder & CEO, langfuse.com
🐧 @marcklingen
⭐️ github.com/langfuse/langfuse
 
You are receiving this email because you opted in to receive email from the list Cloud Product Updates from Langfuse
Langfuse, Langfuse GmbH, Oranienburger Strasse 91, 10178, Berlin, Germany
Unsubscribe [https://app.loops.so/unsubscribe/cmw9sd27a0e3a01u99h5ffq6g/9134f84771e2f65e1f28e47c43babf9474d1b785cfe9d097b84858eed4bad3ad1d367fe261c9d5b7f0e5a4e65d6daeba8c94ba6dc5825ac0170ae24e]

Accession

nse/langfuse/2026-11-09/6480

From

Marc Klingen · marc@updates.langfuse.com

Sent

9 November 2026 · 21:00 UTC