Error when calling Alibaba Cloud Model Studio models: OpenAI API hits APIConnectionError: Connection error
Alibaba Cloud Model Studio models require access through the Internet. When starting the runtime, configure a virtual private cloud (VPC), and make sure it can access the Internet, see Use the SNAT feature of an Internet NAT gateway to access the Internet.
How to choose between Faiss and Milvus vector databases when creating a knowledge base?
Faiss is typically used in testing environments and can be used without creating an additional database. In production environments, we recommend Milvus, which supports processing larger volumes of data.
Knowledge base with Faiss database error: The run failed due to reaching the timeout: 300
Cause: When using Faiss vector database, the vector database is stored in OSS and loaded in the runtime, which requires high machine performance. Therefore, we recommend you configure larger-scale resources for the runtime, such as 8 or 16 CPU cores, to make sure the system can efficiently process related tasks.
Solutions:
Method 1: Modify the runtime configuration. In the runtime list, click the runtime name. Then, click Change Settings in the upper-right corner and change the Resource Type.
Method 2: Delete the existing runtime, create a new runtime with higher resource specifications, and use it in the application flow.
Knowledge base with Faiss database error: Tool load failed in 'index_lookup': (ToolLoadError) Failed to load package tool 'Index Lookup': (AccessDenied)
Cause: When using Faiss as the vector database, the manifest generated by the application flow does not have permission to save to the configured OSS path.
Solution: Use the default PAI role to start the runtime during application flow development), recreate the knowledge base index, and ensure that the "Output OSS Path" parameter is set to a directory under the OSS Bucket where the current workspace default storage path is located. Then, reconfigure the knowledge base index node in the application flow. For more information, see Create a knowledge base.
Why am I billed for PAI-DSW when I only used PAI-LangStudio?
When you create an application flow in developer mode in LangStudio, starting the runtime consumes DSW resources, which incurs charges. To avoid unnecessary costs, stop the corresponding instance in the DSW instance list when you no longer need it.
