Runtime refers to the execution environment in the LangStudio development phase. Runtimes support the development and debugging of application flows, knowledge bases, and other features. A single runtime can be reused in multiple application flows and knowledge bases. You can create a runtime before LangStudio development to provide a consistent execution environment. This topic describes how to create and manage runtimes.
Create a runtime
Go to LangStudio, select a workspace, and then click the Runtime tab. On the Runtime tab, click Create Runtime to go to the New Runtime page.
Parameter | Description |
Runtime Name | The name of the runtime. |
Runtime Working Path | Select an Object Storage Service (OSS) path to store the runtime configurations, logs, and other files. We recommend that you select the default storage path of the workspace as the runtime working path.
|
Resource Type | Select an instance type, such as ecs.g6.xlarge. |
VPC | The development and debugging of application flows and knowledge bases depend on large language model (LLM) services, embedding model services, and vector databases. If these services are deployed in your virtual private cloud (VPC), you must select the VPC when you create a runtime. This ensures that the runtime can access the related services. |
Mount Configurations | Mount OSS objects or datasets based on your business requirements. |
Maximum Single Run Duration | The default timeout duration for online debugging of application flows. Default value: 5 minutes. If the running duration takes a long period of time, we recommend that you set the parameter to a larger value to avoid runtime interruption. |
Instance RAM Role | The RAM role injected into the runtime container. For more information, see Configure RAM roles for a DSW instance. |
Manage a runtime
You can start, stop, or delete a runtime on the Runtime tab.
What to do next
After you create a runtime, you can select the runtime when you create an application flow, or add the runtime to or remove the runtime from an application flow on the flow development page.
