Platform for AI (PAI) - QuickStart supports LLM evaluation
Jun 20 2024
Platform for AI (PAI)QuickStart provides end-to-end LLM evaluation services to help customers find the LLM that meets their business requirements.
Content
Intended customers: 1. Customers who want to easily select LLMs that meet their business requirements. 2. Customers who want to evaluate a model that is fine-tuned in QuickStart. New features: PAI-QuickStart provides the LLM evaluation feature. You can evaluate the comprehensive capabilities of a model based on authoritative public datasets, such as CMMLU, C- Eval, or MMLU, or custom datasets to compare the performance of multiple models and determine whether the model capabilities are suitable for your business scenarios.
