ExecuteSparkReplStatement - AnalyticDB - Alibaba Cloud Documentation Center

Executes part of the code in a Spark job.

Debugging

You can run this interface directly in OpenAPI Explorer, saving you the trouble of calculating signatures. After running successfully, OpenAPI Explorer can automatically generate SDK code samples.

Debug

Authorization information

The following table shows the authorization information corresponding to the API. The authorization information can be used in the Action policy element to grant a RAM user or RAM role the permissions to call this API operation. Description:

Operation: the value that you can use in the Action element to specify the operation on a resource.
Access level: the access level of each operation. The levels are read, write, and list.
Resource type: the type of the resource on which you can authorize the RAM user or the RAM role to perform the operation. Take note of the following items:
- For mandatory resource types, indicate with a prefix of * .
- If the permissions cannot be granted at the resource level, All Resources is used in the Resource type column of the operation.
Condition Key: the condition key that is defined by the cloud service.
Associated operation: other operations that the RAM user or the RAM role must have permissions to perform to complete the operation. To complete the operation, the RAM user or the RAM role must have the permissions to perform the associated operations.

Operation	Access level	Resource type	Condition key	Associated operation
adb:ExecuteSparkReplStatement	none	*DBClusterLakeVersion `acs:adb:{#regionId}:{#accountId}:dbcluster/{#dbClusterId}/resourcegroup/{#resourceGroupName}/sparkapp/{#sparkAppId}`	none	none

Request parameters

Parameter	Type	Required	Description	Example
AppId	string	No	The application ID. Note You can call the ListSparkApps operation to query Spark application IDs.	s202411071444hzdvk486d9d2001****
Code	string	Yes	The code that you want to execute.	print(1+1)
CodeType	string	Yes	The language type of the code. Valid values: SCALA PYTHON	PYTHON
SessionId	long	Yes	The ID of the session that you want to use to execute the code.	123

Response parameters

Parameter	Type	Description	Example
	object
RequestId	string	The request ID.	1AD222E9-E606-4A42-BF6D-8A4442913CEF
Data	object	The returned data.
StatementId	long	The unique ID of the code block in the Spark job.	123
Code	string	The code that is executed.	print(1+1)
CodeType	string	The code type. Valid values: SCALA PYTHON	PYTHON
CodeState	string	The code execution status. Valid values: CANCELLED RUNNING SUCCEEDED ERROR	RUNNING
AliyunUid	long	The ID of the Alibaba Cloud account that owns the cluster.	17108278707****
OutputType	string	The execution result type, which is in the JSON format. Valid values: TEXT: the text content that conforms to Apache Livy. TABLE: the table content that conforms to Apache Livy.	TEXT
Output	string	The code execution result, which is a JSON string that conforms to Apache Livy.	{"text/plain": 2}
Columns	array	The column names.
column	string	The column name.	col1
Error	string	The error message.	StackOverflow Exception
StartTime	long	The start time of the execution. This value is a UNIX timestamp representing the number of milliseconds that have elapsed since January 1, 1970, 00:00:00 UTC.	1730968125000
EndTime	long	The end time of the execution. This value is a UNIX timestamp representing the number of milliseconds that have elapsed since January 1, 1970, 00:00:00 UTC.	1730968125000

Examples

Sample success responses

JSONformat

{
  "RequestId": "1AD222E9-E606-4A42-BF6D-8A4442913CEF",
  "Data": {
    "StatementId": 123,
    "Code": "print(1+1)",
    "CodeType": "PYTHON",
    "CodeState": "RUNNING",
    "AliyunUid": 0,
    "OutputType": "TEXT",
    "Output": {
      "text/plain": 2
    },
    "Columns": [
      "col1"
    ],
    "Error": "StackOverflow Exception",
    "StartTime": 1730968125000,
    "EndTime": 1730968125000
  }
}

Error codes

HTTP status code	Error code	Error message	Description
400	Spark.App.ExceedQuotaLimitation	The requested resource exceeds the maximum limit: %s	-
400	Spark.App.InvalidAppTypeWhenSubmit	The specified AppType is INVALID or NULL. Please refer to the documentation to correct the parameters for %s.	The AppType type is illegal, please refer to using the document to specify the AppType suitable for your business.
400	Spark.App.InvalidResourceSpec	The requested resource type is not supported:\n %s	-
400	Spark.App.ParameterConflict	Conflicting parameters submitted:\n %s	-
400	Spark.App.ResourceNegativeError	The requested resource MUST be positive: %s	-
400	Spark.Config.InvalidAppFilePath	The main driver file MUST be a valid OSS path. Current is %s.	-
400	Spark.Config.invalidConnectors	The spark.adb.connectors configuration is invalid: %s	-
400	Spark.Config.InvalidDiskConfig	The requested disk mount parameter is invalid: %s	-
400	Spark.Config.InvalidHostAliasConfig	The requested host alias parameter %s is invalid. Example: 127.0.0.1 localhost local	-
400	Spark.Config.InvalidLogOssPath	The OSS address for log storage is illegal: %s	-
400	Spark.Config.InvalidRoleArnFormat	Configure RoleARN %s invalid format. It should match acs:ram::uid_number:role/role_name	-
400	Spark.Config.InvalidTimeZone	Unable to parse time zone configuration %s : %s	-
400	Spark.Config.MainAppFileNotExists	The main driver file is missing, [file] or [sqls] must be configured.	-
400	Spark.Config.OSSPathAccessError	The configured OSS address %s cannot be accessed.	-
400	Spark.Config.OSSPathNotExists	The OSS address %s requested does not exist or the permissions are insufficient.	-
400	Spark.Config.RoleArnVerifyFailed	RoleARN parameter verification failed. Error msg: %s when verify RoleArn %s	-
400	Spark.Config.SecurityGroupNotFound	The security group in the configuration does not exist or cannot be accessed. %s.	The configured resource group does not exist or cannot be accessed due to insufficient permissions. %s.
400	Spark.Config.VswitchNotFound	The vswitch in the configuration does not exist or cannot be accessed. %s.	-
400	Spark.InvalidParameter	Invalid parameter value: %s	Incorrect input parameter:%s.
400	Spark.InvalidState	The object of the operation is in an invalid state: %s	The operation object is invalid.
400	Spark.RoleArn.Invalid	%s is not found, or the RAM role has not been authorized.	-
400	Spark.SQL.BlankError	Input sql can not be blank string.	-
400	Spark.SQL.MultipleSQLError	Element in field [sqls] can not contain more than one sql statement: %s.	-
400	Spark.SQL.NotFoundExecutableSQLError	No executable statements are submitted. Please check the input SQL.	-
400	Spark.SQL.NotFoundExecutableSQLError	The execution part is not included in the current submitted SQL, please check the input SQL.	-
400	Spark.SQL.ParserError	Submit spark app failed when parser SQL %s. Error message: %s.	-
403	Spark.Forbidden	No permissions to access the resources: %s	Insufficient permissions to access the related resources. Information that you want to access: %s.
404	Spark.App.ContentNotFound	The requested content %s of the Spark application is not found.	-
404	Spark.App.NotFound	The Spark application %s is not found.	-
404	Spark.ObjectNotFound	The object is not found. More information: %s	-
500	Spark.ServerError	The Spark control component system encountered an error, please create a ticket to solve the problem or concat the supported engineer on duty. Error message: %s	An error occurred on the Spark control component system. Submit a ticket or contact technical support.

For a list of error codes, visit the Service error codes.