This topic describes the metrics for Databricks DataInsight.

When you call an API operation provided by CloudMonitor, set the Namespace and Period parameters.

  • Set the Namespace parameter to acs_spark.
  • Set the Period parameter to an integral multiple of 60. Default value: 60. Unit: seconds.

The following table describes the valid values of the MetricName and Dimensions parameters.

Metric Unit MetricName Dimensions Statistics
Maximum percent used for all partitions % part_max_used userId, clusterId, and role Average, Maximum, and Minimum
BlockedProcess Count procs_blocked userId, clusterId, and role Average, Maximum, and Minimum
CreatedProcess Count procs_created userId, clusterId, and role Average, Maximum, and Minimum
RunningProcess Count proc_run userId, clusterId, and role Average, Maximum, and Minimum
TotalProcess Count proc_total userId, clusterId, and role Average, Maximum, and Minimum
Amount of available swap memory KB swap_free userId, clusterId, and role Average, Maximum, and Minimum
Total amount of swap space displayed in KBs KB swap_total userId, clusterId, and role Average, Maximum, and Minimum
InternetOutRate bit/s bytes_out userId, clusterId, and role Average, Maximum, and Minimum
LoadAverage15 Count load_fifteen userId, clusterId, and role Average, Maximum, and Minimum
LoadAverage5 Count load_five userId, clusterId, and role Average, Maximum, and Minimum
InternetInRate bit/s bytes_in userId, clusterId, and role Average, Maximum, and Minimum
AllocatedContainers Count AllocatedContainers userId, clusterId, and role Average
PendingContainers Count PendingContainers userId, clusterId, and role Average, Maximum, and Minimum
AggregateContainersAllocated Count AggregateContainersAllocated userId, clusterId, and role Average
AggregateContainersReleased Count AggregateContainersReleased userId, clusterId, and role Average
ActiveApplications Count ActiveApplications userId, clusterId, and role Average, Maximum, and Minimum
ActiveUsers Count ActiveUsers userId, clusterId, and role Average, Maximum, and Minimum
AvailableMB MB AvailableMB userId, clusterId, and role Average, Maximum, and Minimum
LoadAverage1 Count load_one userId, clusterId, and role Average, Maximum, and Minimum
Amount of buffered memory KB mem_buffers userId, clusterId, and role Average, Maximum, and Minimum
Amount of cached memory KB mem_cached userId, clusterId, and role Average, Maximum, and Minimum
FreeMemorySpace Byte mem_free userId, clusterId, and role Average, Maximum, and Minimum
Amount of shared memory KB mem_shared userId, clusterId, and role Average, Maximum, and Minimum
TotalMemorySpace Byte mem_total userId, clusterId, and role Average, Maximum, and Minimum
PackageInPerSecond Count/Second pkts_in userId, clusterId, and role Average, Maximum, and Minimum
PackageOutPerSecond Count/Second pkts_out userId, clusterId, and role Average, Maximum, and Minimum
Percent of time since boot idle CPU % cpu_aidle userId, clusterId, and role Average, Maximum, and Minimum
cpu_idle % cpu_idle userId, clusterId, and role Average, Maximum, and Minimum
Percent CPU interrupt % cpu_intr userId, clusterId, and role Average, Maximum, and Minimum
Percent CPU nice % cpu_nice userId, clusterId, and role Average, Maximum, and Minimum
Percent CPU soft interrupt % cpu_sintr userId, clusterId, and role Average, Maximum, and Minimum
CPUSystemUtilization % cpu_system userId, clusterId, and role Average
CPUUserUtilization % cpu_user userId, clusterId, and role Average
Percent CPU wait io % cpu_wio userId, clusterId, and role Average, Maximum, and Minimum
FreeDiskSpace Byte disk_free userId, clusterId, and role Average, Maximum, and Minimum
TotalDiskSpace Byte disk_total userId, clusterId, and role Average, Maximum, and Minimum
AppsCompleted Count AppsCompleted userId, clusterId, and role Average
AppsFailed Count AppsFailed userId, clusterId, and role Average
AppsKilled Count AppsKilled userId, clusterId, and role Average
AppsPending Count AppsPending userId, clusterId, and role Average
AppsRunning Count AppsRunning userId, clusterId, and role Average
AppsSubmitted Count AppsSubmitted userId, clusterId, and role Average, Maximum, and Minimum