SubmitSparkLogAnalyzeTask - AnalyticDB - Alibaba Cloud Documentation Center

Submits a Spark log analysis task and queries the analysis results.

Operation description

Regional public endpoint: adb.<region-id>.aliyuncs.com. Example: adb.cn-hangzhou.aliyuncs.com.
Regional Virtual Private Cloud (VPC) endpoint: adb-vpc.<region-id>.aliyuncs.com. Example: adb-vpc.cn-hangzhou.aliyuncs.com.

Note If HTTP status code 409 is returned when you call this operation in the China (Qingdao), China (Shenzhen), China (Guangzhou), or China (Hong Kong) region, contact technical support.

Debugging

You can run this interface directly in OpenAPI Explorer, saving you the trouble of calculating signatures. After running successfully, OpenAPI Explorer can automatically generate SDK code samples.

Debug

Authorization information

The following table shows the authorization information corresponding to the API. The authorization information can be used in the Action policy element to grant a RAM user or RAM role the permissions to call this API operation. Description:

Operation: the value that you can use in the Action element to specify the operation on a resource.
Access level: the access level of each operation. The levels are read, write, and list.
Resource type: the type of the resource on which you can authorize the RAM user or the RAM role to perform the operation. Take note of the following items:
- For mandatory resource types, indicate with a prefix of * .
- If the permissions cannot be granted at the resource level, All Resources is used in the Resource type column of the operation.
Condition Key: the condition key that is defined by the cloud service.
Associated operation: other operations that the RAM user or the RAM role must have permissions to perform to complete the operation. To complete the operation, the RAM user or the RAM role must have the permissions to perform the associated operations.

Operation	Access level	Resource type	Condition key	Associated operation
adb:SubmitSparkLogAnalyzeTask	create	*DBClusterLakeVersion `acs:adb:{#regionId}:{#accountId}:dbcluster/{#DBClusterId}`	none	none

Request parameters

Parameter	Type	Required	Description	Example
AppId	string	Yes	The ID of the Spark application.	s202301121553hzd9c6f7xxxx

Response parameters

Parameter	Type	Description	Example
	object	The response parameters.
RequestId	string	The request ID.	1DF5AF5B-C803-1861-A0FF-63666A557709
Data	SparkAnalyzeLogTask	The information about the Spark log analysis task.

Examples

Sample success responses

JSONformat

{
  "RequestId": "1DF5AF5B-C803-1861-A0FF-63666A557709",
  "Data": {
    "TaskId": 10,
    "UserId": 0,
    "SubmittedTimeInMillis": 1672123543000,
    "TerminatedTimeInMillis": 1672123543000,
    "TaskState": "WAITING",
    "Result": {
      "AppErrorCode": "EXCEEDED_QUOTA",
      "AppErrorLog": "exception: cpu is exceeded limits 12/10",
      "AppErrorAdvice": "Please increase cpu quota for your resource group"
    },
    "StartedTimeInMillis": 1672123543000,
    "RuleMatched": true,
    "TaskErrMsg": "Driver log not found",
    "DBClusterId": "amv-adbxxxxx"
  }
}

Error codes

HTTP status code	Error code	Error message	Description
400	Spark.InvalidParameter	Invalid parameter value: %s	Incorrect input parameter:%s.
400	Spark.InvalidState	The object of the operation is in an invalid state: %s	The operation object is invalid.
400	Spark.AnalyzeTask.AppStateNotAccepted	Only Spark applications in the terminated state can be analyzed. The specified application %s does not meet the requirement.	-
400	Spark.AnalyzeTask.FailedToKill	Failed to terminate the Spark log analysis task %s, because the task status has changed. Obtain the latest status and try again.	Failed to terminate the Spark log analysis task because the state of the task has changed. Obtain the latest state of the task and try again.
400	Spark.AnalyzeTask.InvalidStateWhenAnalyzingApp	Only logs of Spark applications in the terminated state can be analyzed. The specified application %s does not meet the requirement.	You can perform log analysis only on Spark jobs that are in the terminated state.
404	Spark.ObjectNotFound	The object is not found. More information: %s	-
404	Spark.AnalyzeTask.NotFound	The requested analysis task %s is not found.	The log analysis task you requested to view does not exist. %s.
500	Spark.ServerError	The Spark control component system encountered an error, please create a ticket to solve the problem or concat the supported engineer on duty. Error message: %s	An error occurred on the Spark control component system. Submit a ticket or contact technical support.

For a list of error codes, visit the Service error codes.

Change history

Change time	Summary of changes	Operation
2023-06-28	The Error code has changed	View Change Details