E-MapReduce:Release notes for the console

Feature category

Description

Instance management

• New features:

  • The Event Center is now integrated with Cloud Monitor (CMS). You can view StarRocks cluster events in CMS.

  • Added support for alert templates. You can complete basic alert configurations with a single click.

  • Added new Cloud Monitor metrics, such as query, transaction, database lock, node status, FE memory, and MV. These metrics can be used to set alert configurations.

  • The health diagnosis daily report feature is officially released. This feature automatically performs daily health assessments and diagnostics for your instances. It provides evaluation items based on dimensions such as resource configuration, query tasks, import tasks, compaction, table analysis, and cache analysis. It also offers repair suggestions and best practices for optimization.

  • Cost details: You can now collect statistics and export data by the instance and compute group dimensions.

  • The Terraform Provider now supports elastic scaling for StarRocks clusters.

  • Added partial graceful shutdown support for scaling in cloud-native clusters. After a node is added to a denylist, the system waits for a default of 30 s before scaling in.

  • When scaling in an all-in-one cluster, you can now select and decommission multiple BE/CN nodes in parallel at once. This operation carries a high risk.

  • The BE node now opens port 9060 to allow public network access to StarRocks instances from Spark.

• Feature optimizations:

  • You can now modify the emr_internal_redirect parameter online in the console. This allows stream load to use V2 and avoid SLB streaming.

• Bug fixes:

  • Fixed an issue where the system disk could become full.

  • Removed invalid charts from the Compaction group in the instance monitoring section for cloud-native clusters.

StarRocks Manager

• Feature optimization:

  • The optimization job executed successfully, but the system reported a timeout.

• Bug fix:

  • Fixed an issue where a query was reported as failed even though it executed successfully. For example, adding `LIMIT 100` to the query SQL would return results and a normal task status.

Documentation

• Added the Critical bug notifications document.

• Added the Version lifecycle policy document.

• In the Limits document, added three parameters that cannot be modified during the table design phase.

Feature category

Description

Instance management

• New features:

  • The Event Center feature is officially released. It provides customers with notifications for underlying events from services such as ECS and OSS.

  • Elastic ephemeral disks are now supported for compute-storage separated instances. This feature is in beta testing and available only in specific regions and zones.

  • Disk scale-in is now supported for compute groups in compute-storage separated instances.

  • The multi-zone disaster recovery feature is officially released for compute-storage separated instances.

  • Added the Health Diagnosis feature. This feature includes the original Real-time Diagnosis module and adds the new Diagnostic Daily feature, which is currently in beta testing. Diagnostic Daily provides customers with an intuitive health score. It also offers health assessments, operational suggestions, and best practices for various dimensions.

  • You can now enable SLB and a standalone agent when you create an instance.

  • The EMR StarRocks API now supports querying instance lists.

• Feature optimizations:

  • Auto Scaling now supports multiple scaling rules.

  • The Health Report feature has been renamed to Business Insight. This feature focuses on providing customers with multi-dimensional business insight reports to support data governance and business administration.

  • A new report, "Tables Not Accessed in the Last 90 Days," has been added to Business Insight.

  • Log query now supports selecting specific log files to deliver. This helps save costs on SLS.

  • Optimized the default JAVA_OPTS parameters.

  • Optimized the restart flow.

  • Optimized the data sources for CPU and memory consumption in real-time diagnosis.

  • Optimized the user experience on the real-time diagnosis page.

  • Optimized several monitoring dashboards and added new monitoring metrics.

  • Optimized the user experience for selecting vSwitches and zones during instance creation.

  • Alert monitoring now supports quick time range selection.

• Fixed issues:

  • FE disks would become full.

  • The instance deletion process would sometimes be blocked.

StarRocks Manager

• New features:

  • Added 1 TB TPC-H and TPC-DS test templates to SQL Editor.

• Feature optimizations:

  • Added support for setting user properties when you create a new user.

  • Added support for associating existing StarRocks users with Resource Access Management (RAM) users. This enables permission integration with DLF.

  • Audit logs now support the SQL fingerprint feature.

• Fixed issues:

  • The browser would occasionally stutter on the SQL task list page.

Feature category

Description

Instance management

• Introduced the Compute Optimized CU type. This type has a vCPU-to-memory ratio of 1:2 and is suitable for high CPU consumption scenarios. This feature is currently available on a whitelist basis.

• Added support for Terraform during instance creation.

Feature category

Description

Instance management

• New features:

  • Added support for disk encryption on integrated storage and compute instances and Secure Sockets Layer (SSL) encryption to enhance product security.

  • FE nodes now support the memory-enhanced instance family. This is suitable for scenarios with high FE memory consumption.

  • Integrated storage and compute instances now support fast restart, which improves restart efficiency.

  • Configure a custom domain name for a StarRocks instance to access its custom endpoint.

  • For subscription instances, convert pay-as-you-go compute groups to the subscription model.

  • Apply specific coupons for discounts when you purchase an instance.

• Feature optimizations:

  • Improved the user experience of the instance purchase page.

  • Improved the display of configuration items for each software stack version in parameter configuration.

  • View new alert rules configured in CloudMonitor under Monitoring And Alerts > Alerting Settings in the console.

  • Added support for managing StarRocks with Apache Ranger.

  • Added a description feature for compute groups.

  • Added a link to the kernel release version on the Instance Details page.

  • Diversified monitoring metrics:

    • View the memory usage of FE nodes.

    • View historical trends for the average CPU, memory, and disk usage of BE nodes.

StarRocks Manager

• New feature:

  SQL Editor query results now include the corresponding data types and are compatible with null values.

• Feature optimizations:

  • Added documentation for executing SQL statements in SQL Editor. For statements that contain a semicolon (;), add $$ as the delimiter.

  • Improved the display of the runtime end time in the task list for asynchronous materialized views on integrated storage and compute instances.

  • Improved the content display on the Manager Overview page.

• Bug fixes:

  Optimized metadata management: Fixed an issue where Paimon Catalog sometimes failed to load or display data correctly.

Feature category

Description

Instance management

• New features:

  • Supports log search functionality, which allows you to query detailed instance logs to troubleshoot task exceptions.

  • Supports gateway management functionality, which allows you to isolate FE nodes into groups and restrict leader nodes to write operations only. It also supports enabling SLB load balancing to further enhance instance stability.

  • Supports scaling in FE nodes when the number of nodes is greater than 3.

  • Supports obtaining the token required for migration on the Instance Details page.

  • The Japan (Tokyo) region is now officially available.

• Feature optimizations:

  • Optimizes the restart prompt information during instance upgrades.

  • Improves the user experience on the real-time diagnostics page.

  • Supports displaying the latest minor version number when creating an instance.

  • Adds Kerberos and Ranger configurations.

  • Enhances the user experience on the monitoring chart.

  • Optimizes the console overview page.

  • Supports modifying configurations without immediately restarting the instance. You can combine the restart with other operations later to reduce service downtime.

StarRocks Manager

• The Metadata Management page's Catalogs area now supports search functionality.

• SQL query history: Optimizes performance while ensuring no impact on the current instance.

• Adds a search box to the user page for quickly finding target users.

• Improves the user interaction of the import task filter.

• Optimizes content display on the query details page.

• Enhances the user experience of SQL Editor.

Feature category

Description

Instance operations

• New features:

  • Supports new CU types like memory-enhanced (RCU) and network-enhanced (NCU) to meet different performance requirements in various scenarios.

  • Supports fast restart after configuration changes or instance scaling.

  • Supports password reset for admin users.

  • Shared-data instances support 1 CN node.

• Feature optimizations:

  • Enhances real-time diagnostics and health report functionality.

  • Optimizes the performance of the version upgrade process.

  • Optimizes monitoring and alerting metrics:

    • Adds support for new monitoring metrics, including FE disk metrics and compute node IOUtil.

    • Storage-related metrics are displayed on a separate storage tab for easier monitoring and management.

StarRocks Manager

• New features:

  • Metadata management: Supports visualized operations for creating tables, databases, materialized views, and provides the functionality to inspect materialized view information.

  • Security center: Supports visualized RBAC user, role, and authorization management.

  • SQL Editor: Supports LIMIT clause configuration.

• Feature optimizations:

  • Enhances the user experience of the SQL Editor.

  • Optimizes the display of the SQL profile.

  • Improves sorting and search capabilities for full data tables in metadata management.

Feature category

Description

Control platform capabilities

• Shared-nothing instances supports backup and recovery (now in public preview)

• Supports switching the time zone.

• Optimizes health report functionality:

  • Adds cache analysis report.

  • SQL query now includes Query Latency P99 and DB Lock metrics.

• SQL profile: Adds Top 10 by Time and Top 10 by Memory statistics.

• Slow query: Adds CPU and memory resource consumption fields.

Feature category

Description

Control platform capabilities

• Supports Alibaba Cloud resource group management, allowing you to manage instances more effectively by using resource groups and tags.

• Supports materialized view functionality. You can view materialized views and their task information in StarRocks Manager for daily operations and management.

• Supports ready-to-use TPC-DS and TPC-H test scripts. You can run tests directly in the SQL Editor of StarRocks Manager.

• Supports viewing INSERT INTO tasks. You can view related task records and detailed information directly in the Import Tasks or SQL Tasks in StarRocks Manager.

• Feature optimizations:

  • Enhances Profile metric content.

  • Optimizes disk space shortage notifications.

Feature category

Description

Control platform capabilities

• Supports instance automatic scaling based on time rules (currently limited to pay-as-you-go instances).

• Enriches monitoring metrics and optimizes monitoring reports.

StarRocks Manager capability enhancement

• SQL Profile supports diagnostic suggestion cards, helping you analyze and optimize SQL queries.

• Adds syntax compilation error type SQL in all queries.

Experience optimization

• Optimizes user prompts in the purchase process.

• Optimizes the link operations and related texts on the health report page for QueryId.

• Optimizes the text on the SQL Profile interface.

• Optimizes SQL Editor execution efficiency.

Feature category

Description

Control platform capabilities

• Supports three instance types: Shared-nothing, Data Lake Analytics Edition, and Shared-data.

• Enhances diagnostic analysis capabilities: Supports SQL query analysis, table analysis, import task analysis, and more to help you quickly identify problematic tasks or data.

• Optimizes the user experience of instance configuration.

Feature category

Description

Shared-data scenario

• Metadata management now supports displaying databases, tables, partitions, and cache.

• Adds cache hit analysis metrics in Query Profile.

Data lake analytics scenario

• Metadata management supports displaying foreign table information from external catalogs.

• Supports OSS password-free configuration.

Control platform capability enhancement

• Supports disk configuration changes, including upgrading disk performance levels.

• Supports upgrading disk configurations by increasing the number of disks.

• Supports adjusting the number of disks during instance creation.

• Optimizes default configuration items.

• Enhances monitoring with support for querying hotspot metrics.

• Operation task optimization, supports displaying operation details.

• Adds confirmation prompts for enabling audit logs.

StarRocks Manager capability enhancement

• Optimizes the StarRocks Manager connection and login interfaces.

• StarRocks Manager supports light and dark themes.

• User management now includes a Description field.

Regions

Adds the China (Zhangjiakou) region.