Data Lake Analytics allows you to debug Spark jobs by using open-source Spark UI.
Log on to the Data Lake Analytics console.
In the top navigation bar, select the region where Data Lake Analytics is deployed.
The Serverless Spark feature is available only to China(Hong Kong),Singapore,US(Silicon Valley).
In the left-side navigation pane, choose Serverless Spark > Submit job.
Find the target Spark job, click Operation in the Operation column, and select SparkUI.
On the Web UI page, the Driver UI is displayed when the Spark job is in the RUNNING state.
After the Spark job is complete or fails, the history jobs page is displayed.