|
Parameter |
Type |
Description |
Example |
|---|---|---|---|
|
object |
The struct description. |
||
| provider |
string |
The Large Language Model (LLM) provider. |
qwen |
| address |
string |
The service endpoint. |
https://dashscope.aliyun.com |
| enableHealthCheck |
boolean |
Specifies whether to enable health check. |
true |
| paiEASServiceConfig |
object |
PAI-EAS service configuration settings. |
|
| workspaceId |
string |
Workspace identifier. |
cb89d4de30042df4459442589664e00d |
| serviceId |
string |
Service identifier. |
svc-cvaeb0um1hkqp79k72v0 |
| serviceName |
string |
Name of the service. |
auto-ai-service |
| endpointType |
string |
Type of endpoint. |
"public"，"private" |
| bedrockServiceConfig |
object |
Bedrock service configuration. |
|
| awsRegion |
string |
AWS-Region |
us-east-1 |
| awsAccessKey |
string |
AWS-AccessKey |
AKIAIOSFODNN7EXAMPLE |
| awsSecretKey |
string |
AWS-SecretKey |
wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY |
| ApiKeyGenerateMode |
string |
API key generation mode. |
Custom |
| defaultModelName |
string |
Default model name. |
gpt-4 |
| enableOutlierDetection |
boolean |
Enable outlier detection. |
true |
| vertexServiceConfig |
object |
Vertex AI service configuration. |
|
| vertexAuthKey |
string |
Vertex AI authentication key. |
{\"type\":\"service_account\",\"project_id\":\"my-project\",\"private_key\":\"-----BEGIN PRIVATE KEY-----...\",\"client_email\":\"xxx@xxx.iam.gserviceaccount.com\",\"token_uri\":\"https://oauth2.googleapis.com/token\"} |
| vertexRegion |
string |
Vertex AI region. |
us-central1 |
| vertexProjectId |
string |
Vertex AI project ID. |
my-project |
| vertexAuthServiceName |
string |
Vertex AI auth service name. |
google-oauth2 |
| geminiSafetySetting |
object |
Gemini safety settings. |
|
|
string |
string |
{"BLOCK_NONE": "true"} |
|
| vertexTokenRefreshAhead |
integer |
Vertex token refresh lead time. |
300 |
| protocols |
array |
The LLM protocols. |
|
|
string |
The protocol. |
OpenAI/v1 |
|
| apiKeys |
array |
The API keys. |
|
|
string |
apiKey |
sk-xxx |
|
| compatibleProtocols |
array |
Supported compatible protocols. |
|
|
string |
string |
"openai", "anthropic" |