| Parameter | Type | Description | Example |
|---|---|---|---|
| object | The struct description. | ||
| provider | string | The Large Language Model (LLM) provider. | qwen |
| address | string | The service endpoint. | https://dashscope.aliyun.com |
| enableHealthCheck | boolean | Specifies whether to enable health check. | true |
| paiEASServiceConfig | object | PAI-EAS service configuration settings. | |
| workspaceId | string | Workspace identifier. | plw-d5g7qsem1hkmih54g210 |
| serviceId | string | Service identifier. | svc-d33onfmm1hkn5duhuqjg |
| serviceName | string | Name of the service. | service-hello |
| endpointType | string | Type of endpoint. | "public"，"private" |
| bedrockServiceConfig | object | Bedrock service configuration. | |
| awsRegion | string | AWS-Region | us-west-2 |
| awsAccessKey | string | AWS-AccessKey | AKIAIOSFODNN7EXAMPLE |
| awsSecretKey | string | AWS-SecretKey | wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY |
| ApiKeyGenerateMode | string | API key generation mode. | - |
| defaultModelName | string | Default model name. | qwen-turbo |
| enableOutlierDetection | boolean | Enable outlier detection. | false |
| vertexServiceConfig | object | Vertex AI service configuration. | |
| vertexAuthKey | string | Vertex AI authentication key. | {\"type\":\"service_account\",\"project_id\":\"xxx\",\"private_key\":\"-----BEGIN PRIVATE KEY-----\",\"client_email\":\"xxx@xxx.iam.gserviceaccount.com\",\"token_uri\":\"https://oauth2.googleapis.com/token\"} |
| vertexRegion | string | Vertex AI region. | us-central1 |
| vertexProjectId | string | Vertex AI project ID. | my-gcp-project-123 |
| vertexAuthServiceName | string | Vertex AI auth service name. | custom-vertex-auth |
| geminiSafetySetting | object | Gemini safety settings. | |
| string | string | category":"HARM_CATEGORY_SEXUALLY_EXPLICIT | |
| vertexTokenRefreshAhead | integer | Vertex token refresh lead time. | 300 |
| protocols | array | The LLM protocols. | |
| string | The protocol. | OpenAI/v1 | |
| apiKeys | array | The API keys. | |
| string | apiKey | sk-xxx | |
| compatibleProtocols | array | Supported compatible protocols. | |
| string | string | "openai", "anthropic" |