Summary
Highlights
Making GenAI rollout easy with Ivy League institutions and Internet2
Together with Internet2, we co-hosted a webinar where Ivy League institutions like NYU** shared how universities are deploying GenAI across classrooms, research, and student services. The session highlighted how Portkey’s AI Gateway provides secure model access, guardrails, and compliance support for educational institutions. Watch the recording here →.Protecting Your AI Platform - Palo Alto Networks x Portkey
Join us for an upcoming webinar in partnership with Palo Alto Networks where we’ll explore best practices for securing AI infrastructure at scale, implementing enterprise-grade guardrails, and maintaining compliance while enabling innovation. Click here to register.Platform
List models API
You can now see a list of all models available through Portkey—along with basic details for each one. This makes it easier to discover which models you can use and compare providers and options. Read more about it here.Unified + Portkey Batching
Optimize throughput and reduce costs with our improved batching capabilities. We’ve implemented unified batching across all supported providers with intelligent request grouping for optimized performance. This reduces per-request overhead while providing automatic batch size optimization and configurable parameters to suit your specific needs. See how you can get started here.OTel-based autoinstrumentation
Portkey now works as an OTel endpoint. Send telemetry from any OTel-compatible source into Portkey and view it alongside LLM call logs. End-to-end observability for performance, cost, and compliance. Super powerful for agent workflows. See how you can implement this here This strengthens our observability even further!Multiple guardrails at the workspace level
You can now define and enforce multiple guardrail policies at the workspace-level, making it easier to secure usage, filter content, and maintain compliance across your team.CRUD Guardrails API
Managing guardrails at scale just got easier. You can now create, update, retrieve, delete, and list guardrails directly via API. This makes it simple to keep policies consistent across environments, automate changes, and integrate guardrail management into your CI/CD workflows. Learn more.New Models and Providers
- Featherless.ai: Access 11,900+ open-source models with unlimited tokens through a single gateway. Learn more →
- GPT-OSS Models: OpenAI’s new open-weight models with strong reasoning and tool use capabilities.
- Claude Opus 4.1: Anthropic’s latest flagship model with 74.5% performance on SWE-bench Verified.
🌐 Community Highlights
Future of AI Platforms
Leaders from DoorDash, Postman, Qure.ai, and Qoala joined us for the Future of AI Platforms. It turned into a night of sharp ideas, candid discussions, and bold visions for where AI is headed. Where should we host it next? 👉 Send us an email if you’d be interested in attending!Enterprise Security with Falco Vanguard
Falco Vanguard is using Portkey’s AI infrastructure to build an innovative security platform that intelligently clusters security events and prioritizes critical threats. Their offline-first approach ensures data sovereignty while their integration with Portkey provides the reliability and production readiness enterprises demand. We’re excited to see how this collaboration transforms security operations for organizations. Read more about this here →.Resources
- Blog: Simplifying LLM batch reference
- Blog: OTel traces with LLM logs for end-to-end observability agent workflows
Community Contributors
A special thanks to our contributor this month:Coming this month!
Our MCP gateway is almost here! Reach out to us on support@portkey.ai for early access!Support
Need Help?
Open an issue on GitHub
Join Us
Get support in our Discord