Automate Data Lake Partition Creation with BatchCreateDataLakePartitions API - Data Management - Alibaba Cloud - Data Management

Try it now

Try this API in OpenAPI Explorer, no manual signing needed. Successful calls auto-generate SDK code matching your parameters. Download it with built-in credential security for local usage.

Test

RAM authorization

The table below describes the authorization required to call this API. You can define it in a Resource Access Management (RAM) policy. The table's columns are detailed below:

Action: The actions can be used in the Action element of RAM permission policy statements to grant permissions to perform the operation.
API: The API that you can call to perform the action.
Access level: The predefined level of access granted for each API. Valid values: create, list, get, update, and delete.
Resource type: The type of the resource that supports authorization to perform the action. It indicates if the action supports resource-level permission. The specified resource must be compatible with the action. Otherwise, the policy will be ineffective.
- For APIs with resource-level permissions, required resource types are marked with an asterisk (*). Specify the corresponding Alibaba Cloud Resource Name (ARN) in the Resource element of the policy.
- For APIs without resource-level permissions, it is shown as All Resources. Use an asterisk (*) in the Resource element of the policy.
Condition key: The condition keys defined by the service. The key allows for granular control, applying to either actions alone or actions associated with specific resources. In addition to service-specific condition keys, Alibaba Cloud provides a set of common condition keys applicable across all RAM-supported services.
Dependent action: The dependent actions required to run the action. To complete the action, the RAM user or the RAM role must have the permissions to perform all dependent actions.

Action

Access level

Resource type

Condition key

Dependent action

dms:BatchCreateDataLakePartitions

create

*All Resource

*

None

Request syntax

POST  HTTP/1.1

Request parameters

Parameter	Type	Required	Description	Example
CatalogName	string	Yes	Data catalog name.	hive
DbName	string	Yes	Database name.	default
TableName	string	Yes	Table name.	test_table
PartitionInputs	array	Yes	Information about new partitions.
	DLPartitionInput	No	Data lake partition information.
IfNotExists	boolean	No	If the new partition name duplicates an existing partition name, ignore the exception. Values: true: Ignore. false: Do not ignore.	true
NeedResult	boolean	No	Return partition information. If set to true, the Partitions field is returned.	true
DataRegion	string	Yes	The region in which the data lake resides.	cn-hangzhou
Tid	integer	No	Tenant ID. Note To view the tenant ID, hover over the profile picture in the upper-right corner of the Data Management (DMS) console. For more information, see View tenant information.	3***
WorkspaceId	integer	No	Workspace ID.	12****

Response elements

Element	Type	Description	Example
	object	Schema of Response
RequestId	string	The request ID. Use it to locate logs and troubleshoot issues.	0C1CB646-1DE4-4AD0-B4A4-7D47DD52E931
ErrorCode	string	Error code.	UnknownError
ErrorMessage	string	The error message returned if the request failed.	UnknownError
Success	string	Indicates whether the request was successful. Valid values: true: The request was successful. false: The request failed.	true
Partitions	array	The list of newly created partition results. This parameter is returned when the NeedResult parameter is set to true.
	DLPartition	Partition list details.

Examples

Success response

JSON format

{
  "RequestId": "0C1CB646-1DE4-4AD0-B4A4-7D47DD52E931",
  "ErrorCode": "UnknownError",
  "ErrorMessage": "UnknownError",
  "Success": "true",
  "Partitions": [
    {
      "TableName": "table_name",
      "Sd": {
        "OriginalColumns": [
          {
            "Comment": "from deserializer",
            "Type": "string",
            "Name": "col"
          }
        ],
        "SortCols": [
          {
            "Order": 1,
            "Col": "col1"
          }
        ],
        "Parameters": {
          "test": "test",
          "test2": 1
        },
        "SkewedInfo": {
          "SkewedColValues": [
            [
              "\"123\""
            ]
          ],
          "SkewedColValueLocationMaps": {
            "test": "test",
            "test2": 1
          },
          "SkewedColNames": [
            "col1"
          ]
        },
        "InputFormat": "org.apache.hadoop.mapred.SequenceFileInputFormat",
        "OutputFormat": "org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat",
        "Columns": [
          {
            "Comment": "from deserializer",
            "Type": "string",
            "Name": "col"
          }
        ],
        "IsCompressed": false,
        "SerdeInfo": {
          "SerializationLib": "org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe",
          "DeserializerClass": "org.apache.hadoop.hive.serde2.OpenCSVSerde",
          "Parameters": {
            "serialization.format": "1"
          },
          "Description": "\"serialize\"",
          "SerdeType": 0,
          "SerializerClass": "org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe",
          "Name": "name"
        },
        "BucketCols": [
          "2010"
        ],
        "NumBuckets": -1,
        "Location": "oss://xxx"
      },
      "Parameters": {
        "key": "{\"key\":\"value\"}"
      },
      "CreateTime": 1735109884,
      "Values": [
        "part_val1"
      ],
      "CatalogName": "hive",
      "DbName": "default",
      "LastAccessTime": 1608707407
    }
  ]
}

Error codes

See Error Codes for a complete list.

Release notes

See Release Notes for a complete list.