Platform for AI (PAI) - Automatic scaling of the asynchronous inference service is supported in EAS
Sep 02 2023
Platform for AI (PAI)Content
Intended customers: customers of the model service and AI inference. New features: The EAS asynchronous inference service can automatically scale resources by monitoring the amount of data in the queue. This can help you manage the number of service instances in an effective manner, increase resource utilization, and achieve cost-effectiveness.