API Gateway - AI Gateway supports model name pass-through in fallbacks
Mar 31 2025
API GatewayWhen the primary model malfunctions, the AI Gateway feature can pass model names to pre-configured fallback services.
Content
Target customers: All AI Gateway users Typical scenario: You established a qwq Large Language Model (LLM) service based on PAI, ACS, and Function Compute. The service encounters a performance bottleneck and requests are fallen back to an LLM by the same name in Alibaba Cloud Bailian. New features /specifications: The fallback configuration of an AI API allows model names to be passed through to a standby LLM service.
