Platform for AI (PAI) - Model Gallery supports model inference acceleration
Jan 17 2025
Platform for AI (PAI)Helps customers automatically match and use model inference acceleration capabilities during model deployment to reduce inference costs.
Content
Target customers: customers who are sensitive to model inference costs and have high requirements on cost-effectiveness. New features: The model inference acceleration of PAI-Model Gallery can match supported inference acceleration capabilities (vllm and BladeLLM) based on machine specifications.
