Technology
United States
SME/Startup
"Alibaba Cloud has helped us deliver the widest open-model coverage behind a single API. With Qwen's spectrum of model sizes integrated into TrueForge, our users can right-size every agent task — from sub-billion-parameter quick edits to million-token repo-scale refactors — while maintaining one governance layer and one dashboard across all of it."
Nikunj Bajaj
CEO & Co-founder, TrueFoundry
About TrueFoundry
TrueFoundry is an AI infrastructure company headquartered in San Francisco, building the production layer for AI agents. Its flagship open-source product, TrueForge, provides teams with everything needed to build, deploy, debug, and govern production-grade AI agents — supporting any model and any MCP server within their own infrastructure. Enterprises including NetApp are already using TrueFoundry to run production agents at scale.▸TrueFoundry AI Gateway
Challenge
As the AI agent ecosystem matured, TrueFoundry identified four critical barriers teams face when moving from prototype to production:● Model fragmentation: Not every agent task requires the largest model. A quick file edit does not justify a frontier-scale invocation, and a repository-wide refactor demands the most capable model available. Most teams need both, but stitching together separate providers creates significant integration overhead.
● Vendor lock-in: Most managed agent platforms address production complexity by locking teams into a single model provider. Teams must choose between a streamlined agent-building experience and full ownership of their AI stack.
● Governance at scale: Multiple models often mean multiple integrations, multiple dashboards, and obscured cost structures. Without unified governance, teams lose visibility into spend, latency, and behavior across their agent fleet.
● Cost efficiency: Managed, single-vendor agent platforms carry significant cost premiums. Teams need a way to reduce total agent operating costs while maintaining production-grade reliability.
Why Alibaba Cloud
TrueFoundry chose Alibaba's Qwen as a founding model partner for TrueForge's open-source launch, driven by several key factors:● Broadest open-model spectrum: Qwen offers the widest range of open models of any AI lab — from sub-billion-parameter models to the flagship Qwen3-Coder-480B-A35B with up to one-million-token context on coding models. No other provider offers this breadth in an open-weight family.
● Family coherence: All Qwen models share a unified family identity and function-call format, so switching between sizes feels seamless rather than like integrating a new provider.
● Production-grade capabilities: The Qwen coding line achieves state-of-the-art results among open models on agentic coding and tool-use tasks, performing on par with leading closed models.
● Open-weight philosophy: Qwen's open-weight approach aligns with TrueFoundry's vendor-neutral ethos. Teams can deploy Qwen models on their own infrastructure without proprietary restrictions.
Architecture
TrueFoundry integrated the full Qwen model family into its Agent Harness, creating a unified platform where every model size sits behind one API:● One API, every size: An agent references a Qwen model by name, and the harness handles routing automatically. Swapping a 0.5B model for the 480B flagship is a name change, not a rewrite — no code changes are needed when switching sizes.
● Gateway-level governance: Every call runs through the AI Gateway, which applies the same observability and spend caps regardless of model size. Tokens, cost, and latency from every model aggregate into one dashboard, and one budget governs the entire range.
● Right-sizing workflow: Quick edits go to small Qwen models, repo-scale refactors go to the flagship with million-token context, and mid-range workloads go to efficient variants such as Qwen3-Coder-Next — all through the same API, routed through the same gateway, visible in one dashboard.
Key Results
● Cost optimization: Total agent operating costs reduced by approximately 50% compared to managed, single-vendor agent platforms.● Widest open coverage: Qwen's model spectrum — from sub-billion to 480B parameters — gives TrueForge users access to the most comprehensive selection of open models behind a single API.
● Zero-integration switching: Moving between model sizes is frictionless — no code rewrites or re-integrations required, making right-sizing a natural habit.
● Unified governance: One API, one dashboard, one budget — observability and spend caps apply consistently across every model size.
● Production-proven: Enterprises including NetApp are already running production agents at scale on the TrueFoundry platform with hundreds of active users.
● Open-source trust: Apache 2.0 license with vendor neutrality builds trust versus closed alternatives.
Looking Forward
TrueFoundry plans to deepen its partnership with Alibaba Cloud as the Qwen model family continues to expand — broadening model coverage with new sizes and specializations, and enriching the MCP ecosystem with more managed servers and tools. It also aims to scale TrueForge for enterprise adoption, leveraging Alibaba Cloud's global infrastructure for low-latency access worldwide.
Featured Products
Full-range, open-source, multimodal, and multi-functional
Accelerate deployment and scaling of Qwen, Wan, and more leading models on one secure Alibaba Cloud platform
The API gateway is responsible for coordinating and managing various API and AI requests, serving as a key infrastructure for building applications.
Other Related Stories
Infron
Infron, an AI gateway serving 400+ leading models through one OpenAI-compatible API, runs its customers’ open-source model workloads (Qwen, DeepSeek, Kimi, GLM) on Alibaba Cloud. Customers can pin workloads to specific regions for latency and data residency, while Infron scales from shared quotas to dedicated capacity as their traffic grows.
EaseMate
Through the adoption of Alibaba Cloud's AIGC services, large language models, and generative AI content safety capabilities, EaseMate achieved rapid user acquisition while significantly mitigating operational risks.
ReN3
ReN3, a Singapore-based agentic AI platform for regulated enterprises, leveraged Alibaba's Qwen models to reduce AI inference costs by 40%, improve output quality by 30%, and accelerate response times by 30%, while meeting strict data sovereignty requirements across Southeast Asia.
Snapshot
TrueFoundry, a San Francisco-based AI infrastructure company, integrated Alibaba's Qwen into TrueForge, an open-source, vendor-neutral agent harness. This delivers the industry's broadest open-model family behind a single API with unified observability and spend governance, and enables teams to build production agents at roughly 50% lower cost than managed single-vendor platforms.
Product/Solution Used
View More Solutions
Related Whitepaper
Alibaba Cloud Generative AI Solution Whitepaper
This whitepaper is a comprehensive guide on the generative AI (GenAI) products, technology, and capabilities of Alibaba Cloud.
Download
A Free Trial That Lets You Build Big!
Start building with 80+ products and up to 12 months usage for Elastic Compute Service
Get Started for Free Get Started for Free