E-MapReduce:Console release history

Instance management

New features

• Compaction Service [Beta]: Introduced Compaction Service (StarRocks 3.5 only), which provides a flexible, isolated compaction service.

• Monitoring and alerts:

  • Deliver raw monitoring metric data to Simple Log Service (SLS) for custom monitoring.

  • Configure alerts for a materialized view when its status is Inactive or Invalid.

Improvements

• Restructured and optimized Business Insight, including Query Insight, Import Insight, and Cache Insight. For details, see the corresponding pages in the console.

• Improved the centralized operations menu.

Behavior changes

• External table size and data volume are no longer visible in the metadata of external tables. This prevents aggressive scanning that could affect the stability of external metadata services such as Hive Metastore (HMS).

StarRocks Manager

Improvements

• SQL Editor now defaults to the warehouse specified for the current user when opened.

• View the number of scanned rows in SQL Tasks.

• Optimized profile generation to fix an issue that prevented profile creation in some scenarios.

Instance management

New features

• Convert a subscription instance to a pay-as-you-go instance.

• Warehouses now support tags, letting you differentiate costs by warehouse in billing details.

• Introduced a centralized operations feature to quickly perform actions across all instances.

• Associate an instance with Data Lake Formation (DLF) during creation.

• AI Function [Beta]: Released AI Function.

• Manage warehouse permissions in Apache Ranger.

Improvements

• Added version upgrade recommendations for software stacks with critical bugs, along with highlighted warnings and event notifications.

• Health Diagnosis > Diagnostic Daily report: Added new diagnostic checks for whether primary key index persistence is enabled, whether the index type is cloud_native, and whether the bucket size is less than 5 GB.

• Added an inventory pre-check when scaling out or upgrading an instance.

• Real-time Diagnosis now supports filtering by warehouse.

• Modify Auto Scaling rules while a scaling event is in progress.

Bug fixes

• Resolved an issue that could cause the system disk to become full.

• Removed invalid charts from the Compaction group section on the monitoring page for shared-data instances.

StarRocks Manager

New features

• Associate users with a RAM role to integrate permissions with Data Lake Formation (DLF).

Improvements

• SQL Tasks > Running Tasks: Terminate multiple tasks at once and sort tasks by field.

• Import Tasks: Supports filtering and includes a field for task duration.

Instance management

New features

• Event Center is now integrated with Cloud Monitor (CMS). View StarRocks instance events in Cloud Monitor.

• Added support for alert templates, letting you complete basic alert configurations with a single click.

• Added new Cloud Monitor metrics, including query, transaction, database lock, node status, FE memory, and materialized view metrics. Use these to configure alerts.

• The health diagnosis daily report is now generally available. It automatically performs daily health assessments and provides evaluation items and optimization recommendations across dimensions such as resource configuration, queries, imports, compaction, and table and cache analysis.

• On the Cost Details page, collect statistics and export data by instance and warehouse.

• The Terraform Provider now supports Auto Scaling for StarRocks instances.

• Shared-data instances now support a partial graceful shutdown when scaling in. After a node is denylisted, the system waits 30 seconds (default) before scaling in.

• When scaling in a shared-nothing instance, select and decommission multiple BE/CN nodes in parallel.

  Warning

  This operation carries a high risk.

• BE nodes now expose port 9060 to allow public network access to StarRocks instances from Spark.

Improvements

• Modify the emr_internal_redirect parameter in the console to enable Stream Load V2 and avoid Server Load Balancer (SLB) streaming.

Bug fixes

• Resolved an issue that could cause the system disk to become full.

• Removed invalid charts from the Compaction group section on the monitoring page for shared-data instances.

StarRocks Manager

Improvements

• Addressed an issue where a task was reported as timed out even though it had completed successfully.

Bug fixes

• Resolved an issue where a query was reported as failed even though it executed successfully. For example, adding LIMIT 100 to the query SQL returned correct results and a normal task status.

Documentation

• Added the Critical Bug Notifications document.

• Added the Version Lifecycle Policy document.

• Updated the Limits document to include three parameters that cannot be modified during the table design phase.

Instance management

New features

• Event Center is now generally available. It provides notifications for underlying events from services such as ECS and Object Storage Service (OSS).

• Elastic temporary disks [Beta]: Elastic temporary disks are now supported for shared-data instances. Available in specific regions and zones only.

• Scale in cloud disks for warehouses in shared-data instances.

• Multi-zone disaster recovery is now generally available for shared-data instances.

• Introduced Health Diagnosis, which includes the existing Real-time Diagnosis module and the new Diagnostic Daily feature [Beta]. Diagnostic Daily provides a health score along with assessments, suggestions, and best practices for various health metrics.

• Enable Server Load Balancer (SLB) and a standalone agent when creating an instance.

• The EMR StarRocks API now supports querying instance lists.

Improvements

• Auto Scaling now supports multiple scaling rules.

• Renamed Health Report to Business Insight. This feature provides multi-dimensional business reports to support data and business governance.

• Business Insight: Added the "Tables not accessed in the last 90 days" report.

• Log Search: Select specific log files for delivery to reduce Simple Log Service (SLS) costs.

• Optimized default JAVA_OPTS parameters.

• Improved the instance restart process.

• Optimized the data sources for CPU and memory consumption in Real-time Diagnosis.

• Improved the Real-time Diagnosis page.

• Improved several monitoring dashboards and added new monitoring metrics.

• Improved the vSwitch and zone selection process during instance creation.

• Monitoring and alerts now supports quick time range selection.

Bug fixes

• Resolved an issue where FE disks could become full.

• Resolved an issue where the instance deletion process could sometimes get blocked.

StarRocks Manager

New features

• Added 1 TB TPC-H and TPC-DS test templates to SQL Editor.

Improvements

• Set user properties when creating a new user.

• Associate existing StarRocks users with a RAM role to integrate permissions with Data Lake Formation (DLF).

• Audit Logs now supports the SQL fingerprint feature.

Bug fixes

• Resolved an issue where the browser occasionally froze on the SQL Task List page.

Instance management

New features

• Compute-optimized CU type (available via allowlist): Introduced the compute-optimized CU type, which has a vCPU-to-memory ratio of 1:2 and is suitable for CPU-intensive scenarios.

• Create instances using Terraform.

Instance management

New features

• Cloud disk encryption for shared-nothing instances and SSL encryption to enhance security.

• FE nodes now support the memory-enhanced instance family, suitable for scenarios with high FE memory consumption.

• Shared-nothing instances now support fast restart to improve restart efficiency.

• Configure a custom domain name for your StarRocks instance.

• For subscription instances, convert pay-as-you-go warehouses to the subscription billing model.

• Apply specific coupons when purchasing an instance.

Improvements

• Improved the instance purchase page.

• Improved the display of configuration items for each software stack version in parameter configuration.

• View new alert rules from Cloud Monitor in the console on the Monitoring and alerts > Alerting settings page.

• Added support for managing StarRocks with Apache Ranger.

• Warehouses now support descriptions.

• Added a link to the kernel release notes on the Instance details page.

• Expanded monitoring metrics:

  • View the memory usage of FE nodes.

  • View historical trends for the average CPU, memory, and disk usage of BE nodes.

StarRocks Manager

New features

• Query results in SQL Editor now include corresponding data types and support null values.

Improvements

• Added documentation for executing SQL statements in SQL Editor. Statements that contain a semicolon (;) now require $$ as the delimiter.

• Improved the display of the end time for running asynchronous materialized view tasks on shared-nothing instances.

• Improved the content display on the Overview page of StarRocks Manager.

Bug fixes

• Resolved an issue in metadata management where a Paimon Catalog sometimes failed to load or display data correctly.

Instance management

New features

• Log search: Query detailed instance logs to troubleshoot task exceptions.

• Gateway management: Isolate FE nodes into groups, restrict leader nodes to write operations only, and enable Server Load Balancer (SLB) to further enhance instance stability.

• Scale in FE nodes when the node count exceeds three.

• Retrieve the token required for migration on the Instance details page.

• The Japan (Tokyo) region is now available.

Improvements

• Improved the restart prompt that appears during an instance upgrade.

• Improved the real-time diagnosis page.

• View the latest minor version number when creating an instance.

• Added configurations for Kerberos and Ranger.

• Improved the user experience of monitoring charts.

• Improved the console overview page.

• Modify configurations without immediately restarting the instance. Combine the restart with other operations later to reduce service downtime.

StarRocks Manager

• Metadata management: Supports search in the Catalogs section.

• SQL query history: Improved performance without affecting the current instance.

• Added a search box to the user page for quickly finding users.

• Improved the interaction design of the import task filter.

• Improved the content display on the Query Details page.

• Improved SQL Editor.

Instance management

New features

• Added support for new CU types: memory-enhanced (RCU) and network-enhanced (NCU), to meet diverse performance needs across different scenarios.

• Operations that require a restart — such as configuration changes and instance scaling — now support a fast restart option.

• Reset the password for the admin user.

• Shared-data instances now support a single CN node.

Improvements

• Enhanced the real-time diagnosis and health report features.

• Improved the performance of the version upgrade process.

• Improved monitoring and alert metrics:

  • Added new monitoring metrics, including FE disk metrics and compute node IOUtil.

  • Storage-related metrics are now displayed on a separate Storage tab for easier monitoring.

StarRocks Manager

New features

• Metadata management: Visually create tables, databases, and materialized views, and view materialized view information.

• Security center: Supports visual RBAC management for users, roles, and grants.

• SQL Editor: Supports LIMIT clause configuration.

Improvements

• Improved SQL Editor.

• Improved the display of SQL profiles.

• Improved features such as sorting and searching for full tables in metadata management.

Version 1.11.1

Release date: November 22, 2024

New features and changes

• StarRocks version 3.3 is now generally available.

• Purchase and adjust Manager Agent resource configurations independently, resolving connection instability caused by mixed Agent deployment.

• Data Lake Analytics Edition has been removed. Use shared-data instances for related scenarios instead.

• Restart a single node.

• Added a 5,000-record display limit to the SQL Tasks page to improve query performance and stability.

Version 1.11.0

Release date: October 16, 2024

New region: The Indonesia (Jakarta) region is now available.