MaxCompute:GET_SIGNED_URL_FROM_OSS

Step 1: Generate a download URL

1. Masuk ke OSS console dan unggah file uji signedget.txt ke direktori object-table-test/object_table_folder. Untuk informasi selengkapnya, lihat Upload files.

2. Gunakan local client (odpscmd) atau buat MaxCompute SQL node di DataWorks untuk membuat Object Table dan merefresh cache metadata.

   -- Aktifkan model tiga lapis untuk mendukung schema dalam project MaxCompute. 
   SET odps.namespace.schema=true;
   -- Pilih project MaxCompute. 
   USE <project_name>;
   -- Pilih schema. 
   USE SCHEMA <schema_name>;
   -- Aktifkan sistem tipe data 2.0 dalam project MaxCompute. 
   SET odps.sql.type.system.odps2=true;
   -- Fungsi ini tidak didukung untuk akselerasi kueri MaxQA. 
   SET odps.mcqa.disable=true;
   -- Buat Object Table. 
   CREATE OBJECT TABLE IF NOT EXISTS test_get_signed_url_from_oss 
   WITH serdeproperties (
     'odps.properties.rolearn'='acs:ram::<uid>:role/<role_name>'
   ) 
   LOCATION 'oss://oss-cn-hangzhou-internal.aliyuncs.com/object-table-test/object_table_folder/';
   -- Refresh cache tabel. 
   ALTER TABLE test_get_signed_url_from_oss REFRESH METADATA;

3. Kueri metadata dalam Object Table.

   SET odps.namespace.schema=true;
   SELECT * FROM test_get_signed_url_from_oss;

   Output yang diharapkan:

   +---------------+------------+------------+---------------------+---------------+----------------------------------+--------------+------------+--------------------+
   | key           | size       | type       | last_modified       | storage_class | etag                             | restore_info | owner_id   | owner_display_name |
   +---------------+------------+------------+---------------------+---------------+----------------------------------+--------------+------------+--------------------+
   | signedget.txt | 38         | Normal     | 2025-06-04 01:36:52 | Standard      | 96D8258845DAB51BC9B****6E61A2563 | NONE         | 13****     | 13****             |
   +---------------+------------+------------+---------------------+---------------+----------------------------------+--------------+------------+--------------------+

4. Baca data objek menggunakan fungsi GET_DATA_FROM_OSS.

   SET odps.namespace.schema=true;
   SELECT 
     STRING(   
       GET_DATA_FROM_OSS(
         '<project_name>.<schema_name>.test_get_signed_url_from_oss',
         key
       )
     )
   FROM test_get_signed_url_from_oss;

   Output yang diharapkan:

   +----------------------------------------+
   | _c0                                    |
   +----------------------------------------+
   | test maxcompute download files by url  |
   +----------------------------------------+

5. Kueri Object Table dan hasilkan URL yang ditandatangani.

   SET odps.namespace.schema=true;
   SELECT GET_SIGNED_URL_FROM_OSS(  
     '<project_name>.<schema_name>.test_get_signed_url_from_oss',    
     key) 
   FROM test_get_signed_url_from_oss;

   Output yang diharapkan:

   +------------+
   | _c0        |
   +------------+
   | http://object-table-test.oss-cn-hangzhou-internal.aliyuncs.com/object_table_folder%2Fsignedget.txt?Expires=17490****&OSSAccessKeyId=STS.****&Signature=****&security-token=**** |
   +------------+

Step 2: Download the object from ECS

1. Masuk ke ECS console. Di panel navigasi kiri, pilih Instances & Images > Instances.

2. Di wilayah China (Hangzhou), pilih instans target, klik Remote Connection, lalu sambungkan ke instans menggunakan Workbench.

3. Di terminal, jalankan perintah berikut untuk mengunduh objek OSS:

   -- Ubah direktori ke /opt.
   cd /opt
   -- Unduh objek OSS menggunakan URL yang ditandatangani.
   curl -o /opt/ecs_signed.txt "http://object-table-test.oss-cn-hangzhou-internal.aliyuncs.com/object_table_folder%2Fsignedget.txt?Expires=17490****&OSSAccessKeyId=STS.****&Signature=****&security-token=****"

   Output:

   [xxx] opt]# curl -o /opt/ecs_signed.txt "http://object-table-test.oss-cn-hangzhou-inxxx&SAccessKeyId=STS.xxx&Signature=xxx&security-token=CAIS3gJxxx
   xxx
     % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                    Dload  Upload   Total   Spent    Left  Speed
   100    38  100    38    0     0    263      0 --:--:-- --:--:-- --:--:--   265
   opt]# ls
   aliyun-security  ecs_signed.txt
   [root@iZbp1al9u5z0axrqx50mptZ opt]# cat ecs_signed.txt
   test maxcompute download files by url
   xxx opt]#

Problem 1: The table path in the function is different from the path of the underlying table being queried

• Error message

  ODPS-0130071:[0,0] Semantic analysis exception - physical plan generation failed: Can't do ObjectTableTwoPhasesSplitting process (Caused by: java.lang.IllegalArgumentException: The first arg[xxx.default.test_get_signed_url_from_ossxxxxxx] of function GET_SIGNED_URL_FROM_OSS({object_table_full_name}, {object_key}, ...) can't be found in the underlying object table scans[xxx.default.test_get_signed_url_from_oss]).

• Problem description

  Nama tabel test_get_signed_url_from_ossxxxxxx tidak ada atau berbeda dari nama tabel yang ditentukan dalam pernyataan SQL.

• Solution

  Tentukan nama Object Table yang ada dalam format project.schema.table.

The `timeToLiveSeconds` parameter value is invalid

• Error message

  ODPS-0121095:[1,8] Invalid argument - The parameter <timeToLiveSeconds> of the function GET_SIGNED_URL_FROM_OSS() you specified (0) is invalid, it should be in the range [1, 604800].

• Problem description

  Nilai parameter `timeToLiveSeconds` tidak valid. Nilainya harus berada dalam rentang [1, 604800].

• Solution

  Tentukan nilai Waktu hidup (TTL) yang valid.

The `HttpMethod` parameter value is invalid

• Error message

  ODPS-0121095:[1,8] Invalid argument - The parameter <httpMethod> of the function GET_SIGNED_URL_FROM_OSS() you specified 'PU' is invalid, it can only be 'GET' or 'PUT'.

• Problem description

  Nilai parameter `HttpMethod` tidak valid.

• Solution

  Atur parameter `HttpMethod` menjadi GET atau PUT.

The link has expired because the validity period is too short

• Error message

  Terjadi error `Request has expired` saat menjalankan perintah curl.

• Problem Description

  URL yang ditandatangani telah kedaluwarsa sebelum digunakan.

• Solution

  Tentukan nilai yang wajar untuk parameter `expiration`. Jangan atur nilai yang terlalu panjang atau terlalu pendek.

The three-layer model syntax is not enabled

• Error message

  ODPS-0130071:[0,0] Semantic analysis exception - physical plan generation failed: Can't do ObjectTableTwoPhasesSplitting process (Caused by: java.lang.IllegalArgumentException: Invalid parameter of object table full name[str=xxx.test_get_signed_url_from_oss], which should be split up into 3 parts by '.' like '${project}.${schema}.${table}').

• Problem description

  Sintaks schema belum diaktifkan. Oleh karena itu, format project.schema.table tidak dapat diurai.

• Solution

  Tambahkan perintah set odps.namespace.schema=true; sebelum pernyataan SQL untuk mengaktifkan sintaks schema.