MaxCompute:GET_SIGNED_URL_FROM_OSS

Step 1: Generate a download URL

1. Log on to the OSS console and upload the test file signedget.txt to the object-table-test/object_table_folder directory. For more information, see Upload files.

2. Use a local client (odpscmd) or create a MaxCompute SQL node in DataWorks to create an Object Table and refresh the metadata cache.

   -- Enable the three-layer model to support schemas in a MaxCompute project. 
   SET odps.namespace.schema=true;
   -- Select the MaxCompute project. 
   USE <project_name>;
   -- Select the schema. 
   USE SCHEMA <schema_name>;
   -- Enable the 2.0 data type system in the MaxCompute project. 
   SET odps.sql.type.system.odps2=true;
   -- This function is not supported for MaxQA query acceleration. 
   SET odps.mcqa.disable=true;
   -- Create an Object Table. 
   CREATE OBJECT TABLE IF NOT EXISTS test_get_signed_url_from_oss 
   WITH serdeproperties (
     'odps.properties.rolearn'='acs:ram::<uid>:role/<role_name>'
   ) 
   LOCATION 'oss://oss-cn-hangzhou-internal.aliyuncs.com/object-table-test/object_table_folder/';
   -- Refresh the table cache. 
   ALTER TABLE test_get_signed_url_from_oss REFRESH METADATA;

3. Query the metadata in the Object Table.

   SET odps.namespace.schema=true;
   SELECT * FROM test_get_signed_url_from_oss;

   Expected output:

   +---------------+------------+------------+---------------------+---------------+----------------------------------+--------------+------------+--------------------+
   | key           | size       | type       | last_modified       | storage_class | etag                             | restore_info | owner_id   | owner_display_name |
   +---------------+------------+------------+---------------------+---------------+----------------------------------+--------------+------------+--------------------+
   | signedget.txt | 38         | Normal     | 2025-06-04 01:36:52 | Standard      | 96D8258845DAB51BC9B****6E61A2563 | NONE         | 13****     | 13****             |
   +---------------+------------+------------+---------------------+---------------+----------------------------------+--------------+------------+--------------------+

4. Read the object data by using the GET_DATA_FROM_OSS function.

   SET odps.namespace.schema=true;
   SELECT 
     STRING(   
       GET_DATA_FROM_OSS(
         '<project_name>.<schema_name>.test_get_signed_url_from_oss',
         key
       )
     )
   FROM test_get_signed_url_from_oss;

   Expected output:

   +----------------------------------------+
   | _c0                                    |
   +----------------------------------------+
   | test maxcompute download files by url  |
   +----------------------------------------+

5. Query the Object Table and generate a pre-signed URL.

   SET odps.namespace.schema=true;
   SELECT GET_SIGNED_URL_FROM_OSS(  
     '<project_name>.<schema_name>.test_get_signed_url_from_oss',    
     key) 
   FROM test_get_signed_url_from_oss;

   Expected output:

   +------------+
   | _c0        |
   +------------+
   | http://object-table-test.oss-cn-hangzhou-internal.aliyuncs.com/object_table_folder%2Fsignedget.txt?Expires=17490****&OSSAccessKeyId=STS.****&Signature=****&security-token=**** |
   +------------+

Step 2: Download the object from ECS

1. Log on to the ECS console. In the left-side navigation pane, choose Instances & Images > Instances.

2. In the China (Hangzhou) region, select the target instance, click Remote Connection, and then connect to the instance by using Workbench.

3. In the terminal, run the following commands to download the OSS object:

   -- Change the directory to /opt.
   cd /opt
   -- Download the OSS object by using the pre-signed URL.
   curl -o /opt/ecs_signed.txt "http://object-table-test.oss-cn-hangzhou-internal.aliyuncs.com/object_table_folder%2Fsignedget.txt?Expires=17490****&OSSAccessKeyId=STS.****&Signature=****&security-token=****"

   Output:

   [xxx] opt]# curl -o /opt/ecs_signed.txt "http://object-table-test.oss-cn-hangzhou-inxxx&SAccessKeyId=STS.xxx&Signature=xxx&security-token=CAIS3gJxxx
   xxx
     % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                    Dload  Upload   Total   Spent    Left  Speed
   100    38  100    38    0     0    263      0 --:--:-- --:--:-- --:--:--   265
   opt]# ls
   aliyun-security  ecs_signed.txt
   [root@iZbp1al9u5z0axrqx50mptZ opt]# cat ecs_signed.txt
   test maxcompute download files by url
   xxx opt]#

Problem 1: The table path in the function is different from the path of the underlying table being queried

• Error message

  ODPS-0130071:[0,0] Semantic analysis exception - physical plan generation failed: Can't do ObjectTableTwoPhasesSplitting process (Caused by: java.lang.IllegalArgumentException: The first arg[xxx.default.test_get_signed_url_from_ossxxxxxx] of function GET_SIGNED_URL_FROM_OSS({object_table_full_name}, {object_key}, ...) can't be found in the underlying object table scans[xxx.default.test_get_signed_url_from_oss]).

• Problem description

  The table name test_get_signed_url_from_ossxxxxxx does not exist or is different from the table name specified in the SQL statement.

• Solution

  Specify the name of an existing Object Table in the project.schema.table format.

The `timeToLiveSeconds` parameter value is invalid

• Error message

  ODPS-0121095:[1,8] Invalid argument - The parameter <timeToLiveSeconds> of the function GET_SIGNED_URL_FROM_OSS() you specified (0) is invalid, it should be in the range [1, 604800].

• Problem description

  The value of the `timeToLiveSeconds` parameter is invalid. The value must be in the range [1, 604800].

• Solution

  Specify a valid value for the time-to-live (TTL).

The `HttpMethod` parameter value is invalid

• Error message

  ODPS-0121095:[1,8] Invalid argument - The parameter <httpMethod> of the function GET_SIGNED_URL_FROM_OSS() you specified 'PU' is invalid, it can only be 'GET' or 'PUT'.

• Problem description

  The value of the `HttpMethod` parameter is invalid.

• Solution

  Set the `HttpMethod` parameter to GET or PUT.

The link has expired because the validity period is too short

• Error message

  The `Request has expired` error is reported when you run the curl command.

• Problem Description

  The signed URL expired before it was used.

• Solution

  Set a reasonable value for the `expiration` parameter. Do not set an excessively long or short value.

The three-layer model syntax is not enabled

• Error message

  ODPS-0130071:[0,0] Semantic analysis exception - physical plan generation failed: Can't do ObjectTableTwoPhasesSplitting process (Caused by: java.lang.IllegalArgumentException: Invalid parameter of object table full name[str=xxx.test_get_signed_url_from_oss], which should be split up into 3 parts by '.' like '${project}.${schema}.${table}').

• Problem description

  The schema syntax is not enabled. Therefore, the project.schema.table format cannot be parsed.

• Solution

  Add the set odps.namespace.schema=true; command before the SQL statement to enable the schema syntax.