Platform for AI (PAI) - DataJuicer on DLC officially released
Aug 13 2025
Platform for AI (PAI)DLC now supports submitting DataJuicer framework jobs, enabling efficient cleaning, filtering, transformation, and augmentation of large-scale datasets through over 100 operators, multi-node scalability (single or distributed), and high availability with self-healing. This enhances text and multimodal data processing capabilities for large model workloads.
Content
Target audience: Large and medium-sized internet companies, AI firms, and academic research institutions. New Features/Specifications: DLC supports submitting DataJuicer jobs with over 100 operators (including aggregator, de-duplicator, filter, formatter, grouper, mapper, and selector), flexible scaling (single-node or multi-node), and self-healing for high availability. This enables efficient data cleaning, filtering, transformation, and augmentation, enhancing text and multimodal data processing for large model applications.
Help Document
https://www.alibabacloud.com/help/zh/pai/user-guide/quickly-submit-a-datajuicer-task
