🧠 Engineering Culture

Portkey Processes 2 Trillion Tokens Daily, Then Open-Sources Its AI Gateway

Two trillion tokens in a single day. That's Portkey's AI gateway in action, now open-sourced to free engineering teams from SaaS shackles.

Portkey AI Gateway dashboard displaying 2 trillion tokens processed daily with metrics on cost, latency, and agent governance

⚡ Key Takeaways

  • Portkey's gateway processed 2T tokens/day across 24K orgs, managing $180M AI spend.
  • Open-sourcing core tech democratizes AI governance while Portkey sells premium layers.
  • Agentic AI via MCP demands gateways; Portkey's poised as the NGINX of AI infra.

🧠 What's your take on this?

Cast your vote and see what DevTools Feed readers think

Aisha Patel
Written by

Aisha Patel

Former ML engineer turned writer. Covers computer vision and robotics with a practitioner perspective.

Worth sharing?

Get the best Developer Tools stories of the week in your inbox — no noise, no spam.

Originally reported by The NewStack

Stay in the loop

The week's most important stories from DevTools Feed, delivered once a week.