The Lindorm compute engine includes the Spark UI, a web-based monitoring interface for Spark jobs. Use the Spark UI to check job status, submission time, resource usage, and execution details.
Access the Spark UI
Note
To get the Spark UI address, see View the Spark UI address. For open source Spark UI documentation, see the Apache Spark web UI guide.
Copy the Spark UI address into your browser's address bar to open the interface.
The Spark UI has the following tabs:
| Tab | What it shows |
|---|---|
| Jobs | Details about all running jobs. |
| Stages | Status information for all stages of a Spark job. |
| Storage | Storage details for persisted Resilient Distributed Datasets (RDDs) and DataFrames. |
| Environment | The environment where the Spark job runs. When the job starts, this environment is built from the runtime environment, configuration files, and user input parameters. |
| Executors | Status information for the Spark job's executors. |
| SQL | Detailed information about the SQL statements that the compute engine executes. |
| Kyuubi Query Engine | JDBC session information for queries submitted through the Kyuubi query engine. |