Object Storage Service:Multipart upload

Usar ferramentas para divisão automática de partes

Para tarefas de desenvolvimento, teste ou O&M, utilize ferramentas gráficas ou CLI que lidam com a divisão de partes automaticamente.

• Ferramenta de gerenciamento gráfico: OSS Browser

  O ossbrowser 2.0 ativa o upload multipart por padrão e fornece uma interface visual para monitorar o progresso do upload.

• ossutil

  O comando cp do ossutil 2.0 ativa automaticamente o upload multipart para arquivos maiores que 100 MiB. Para controlar manualmente o processo, use os comandos initiate-multipart-upload, upload-part e complete-multipart-upload juntos.

  package main
  
  // Sample for canceling a multipart upload using OSS Go SDK V1.
  
  import (
  	"fmt"
  
  	"github.com/aliyun/aliyun-oss-go-sdk/oss"
  )
  
  func main() {
  	// Obtain access credentials from environment variables.
  	provider, _ := oss.NewEnvironmentVariableCredentialsProvider()
  
  	// Create an OSS client instance.
  	client, _ := oss.New(
  		"oss-cn-hangzhou.aliyuncs.com",
  		"",
  		"",
  		oss.SetCredentialsProvider(&provider),
  		oss.AuthVersion(oss.AuthV4),
  		oss.Region("cn-hangzhou"),
  	)
  
  	// Obtain the bucket object.
  	bucket, _ := client.Bucket("example-bucket")
  
  	// Configure file information.
  	key := "dest.jpg"
  	uploadId := "D9F4****************************"
  
  	// Create an InitiateMultipartUploadResult object.
  	imur := oss.InitiateMultipartUploadResult{
  		UploadID: uploadId,
  		Key:      key,
  	}
  
  	// Cancel the multipart upload.
  	bucket.AbortMultipartUpload(imur)
  
  	fmt.Printf("Canceled multipart upload successfully. Upload ID: %s\n", uploadId)
  }
  

Controle programático com SDKs

Os SDKs encapsulam o upload multipart com tamanhos de parte personalizados, simultaneidade e tratamento de erros. As seções a seguir mostram exemplos para SDKs comuns. Para outras linguagens, consulte SDK Reference.

Antes de executar o código, instale o SDK e configure as credenciais de acesso como variáveis de ambiente. Se você usar um usuário RAM ou função RAM, conceda as permissões necessárias. Para mais informações, consulte API permissions .

package main

// Sample for canceling a multipart upload using OSS Go SDK V1.

import (
	"fmt"

	"github.com/aliyun/aliyun-oss-go-sdk/oss"
)

func main() {
	// Obtain access credentials from environment variables.
	provider, _ := oss.NewEnvironmentVariableCredentialsProvider()

	// Create an OSS client instance.
	client, _ := oss.New(
		"oss-cn-hangzhou.aliyuncs.com",
		"",
		"",
		oss.SetCredentialsProvider(&provider),
		oss.AuthVersion(oss.AuthV4),
		oss.Region("cn-hangzhou"),
	)

	// Obtain the bucket object.
	bucket, _ := client.Bucket("example-bucket")

	// Configure file information.
	key := "dest.jpg"
	uploadId := "D9F4****************************"

	// Create an InitiateMultipartUploadResult object.
	imur := oss.InitiateMultipartUploadResult{
		UploadID: uploadId,
		Key:      key,
	}

	// Cancel the multipart upload.
	bucket.AbortMultipartUpload(imur)

	fmt.Printf("Canceled multipart upload successfully. Upload ID: %s\n", uploadId)
}

package main

// Sample for canceling a multipart upload using OSS Go SDK V1.

import (
	"fmt"

	"github.com/aliyun/aliyun-oss-go-sdk/oss"
)

func main() {
	// Obtain access credentials from environment variables.
	provider, _ := oss.NewEnvironmentVariableCredentialsProvider()

	// Create an OSS client instance.
	client, _ := oss.New(
		"oss-cn-hangzhou.aliyuncs.com",
		"",
		"",
		oss.SetCredentialsProvider(&provider),
		oss.AuthVersion(oss.AuthV4),
		oss.Region("cn-hangzhou"),
	)

	// Obtain the bucket object.
	bucket, _ := client.Bucket("example-bucket")

	// Configure file information.
	key := "dest.jpg"
	uploadId := "D9F4****************************"

	// Create an InitiateMultipartUploadResult object.
	imur := oss.InitiateMultipartUploadResult{
		UploadID: uploadId,
		Key:      key,
	}

	// Cancel the multipart upload.
	bucket.AbortMultipartUpload(imur)

	fmt.Printf("Canceled multipart upload successfully. Upload ID: %s\n", uploadId)
}

package main

// Sample for canceling a multipart upload using OSS Go SDK V1.

import (
	"fmt"

	"github.com/aliyun/aliyun-oss-go-sdk/oss"
)

func main() {
	// Obtain access credentials from environment variables.
	provider, _ := oss.NewEnvironmentVariableCredentialsProvider()

	// Create an OSS client instance.
	client, _ := oss.New(
		"oss-cn-hangzhou.aliyuncs.com",
		"",
		"",
		oss.SetCredentialsProvider(&provider),
		oss.AuthVersion(oss.AuthV4),
		oss.Region("cn-hangzhou"),
	)

	// Obtain the bucket object.
	bucket, _ := client.Bucket("example-bucket")

	// Configure file information.
	key := "dest.jpg"
	uploadId := "D9F4****************************"

	// Create an InitiateMultipartUploadResult object.
	imur := oss.InitiateMultipartUploadResult{
		UploadID: uploadId,
		Key:      key,
	}

	// Cancel the multipart upload.
	bucket.AbortMultipartUpload(imur)

	fmt.Printf("Canceled multipart upload successfully. Upload ID: %s\n", uploadId)
}

package main

// Sample for canceling a multipart upload using OSS Go SDK V1.

import (
	"fmt"

	"github.com/aliyun/aliyun-oss-go-sdk/oss"
)

func main() {
	// Obtain access credentials from environment variables.
	provider, _ := oss.NewEnvironmentVariableCredentialsProvider()

	// Create an OSS client instance.
	client, _ := oss.New(
		"oss-cn-hangzhou.aliyuncs.com",
		"",
		"",
		oss.SetCredentialsProvider(&provider),
		oss.AuthVersion(oss.AuthV4),
		oss.Region("cn-hangzhou"),
	)

	// Obtain the bucket object.
	bucket, _ := client.Bucket("example-bucket")

	// Configure file information.
	key := "dest.jpg"
	uploadId := "D9F4****************************"

	// Create an InitiateMultipartUploadResult object.
	imur := oss.InitiateMultipartUploadResult{
		UploadID: uploadId,
		Key:      key,
	}

	// Cancel the multipart upload.
	bucket.AbortMultipartUpload(imur)

	fmt.Printf("Canceled multipart upload successfully. Upload ID: %s\n", uploadId)
}

package main

// Sample for canceling a multipart upload using OSS Go SDK V1.

import (
	"fmt"

	"github.com/aliyun/aliyun-oss-go-sdk/oss"
)

func main() {
	// Obtain access credentials from environment variables.
	provider, _ := oss.NewEnvironmentVariableCredentialsProvider()

	// Create an OSS client instance.
	client, _ := oss.New(
		"oss-cn-hangzhou.aliyuncs.com",
		"",
		"",
		oss.SetCredentialsProvider(&provider),
		oss.AuthVersion(oss.AuthV4),
		oss.Region("cn-hangzhou"),
	)

	// Obtain the bucket object.
	bucket, _ := client.Bucket("example-bucket")

	// Configure file information.
	key := "dest.jpg"
	uploadId := "D9F4****************************"

	// Create an InitiateMultipartUploadResult object.
	imur := oss.InitiateMultipartUploadResult{
		UploadID: uploadId,
		Key:      key,
	}

	// Cancel the multipart upload.
	bucket.AbortMultipartUpload(imur)

	fmt.Printf("Canceled multipart upload successfully. Upload ID: %s\n", uploadId)
}

package main

// Sample for canceling a multipart upload using OSS Go SDK V1.

import (
	"fmt"

	"github.com/aliyun/aliyun-oss-go-sdk/oss"
)

func main() {
	// Obtain access credentials from environment variables.
	provider, _ := oss.NewEnvironmentVariableCredentialsProvider()

	// Create an OSS client instance.
	client, _ := oss.New(
		"oss-cn-hangzhou.aliyuncs.com",
		"",
		"",
		oss.SetCredentialsProvider(&provider),
		oss.AuthVersion(oss.AuthV4),
		oss.Region("cn-hangzhou"),
	)

	// Obtain the bucket object.
	bucket, _ := client.Bucket("example-bucket")

	// Configure file information.
	key := "dest.jpg"
	uploadId := "D9F4****************************"

	// Create an InitiateMultipartUploadResult object.
	imur := oss.InitiateMultipartUploadResult{
		UploadID: uploadId,
		Key:      key,
	}

	// Cancel the multipart upload.
	bucket.AbortMultipartUpload(imur)

	fmt.Printf("Canceled multipart upload successfully. Upload ID: %s\n", uploadId)
}

Usar o console

1. Acesse a lista de Buckets e clique no bucket de destino.

2. Na lista Objects, clique em Parts para visualizar e excluir partes.

Usar regras de ciclo de vida

Regras de ciclo de vida limpam automaticamente partes expiradas, reduzindo a manutenção manual. Para mais informações, consulte Clean up expired parts using lifecycle rules.

Usar ferramentas

• ossbrowser

  Na página de lista de objetos do bucket, clique em Parts para visualizar e excluir partes.

• ossutil

  Use o comando abort-multipart-upload para cancelar um upload multipart e excluir os dados das partes:

  package main
  
  // Sample for canceling a multipart upload using OSS Go SDK V1.
  
  import (
  	"fmt"
  
  	"github.com/aliyun/aliyun-oss-go-sdk/oss"
  )
  
  func main() {
  	// Obtain access credentials from environment variables.
  	provider, _ := oss.NewEnvironmentVariableCredentialsProvider()
  
  	// Create an OSS client instance.
  	client, _ := oss.New(
  		"oss-cn-hangzhou.aliyuncs.com",
  		"",
  		"",
  		oss.SetCredentialsProvider(&provider),
  		oss.AuthVersion(oss.AuthV4),
  		oss.Region("cn-hangzhou"),
  	)
  
  	// Obtain the bucket object.
  	bucket, _ := client.Bucket("example-bucket")
  
  	// Configure file information.
  	key := "dest.jpg"
  	uploadId := "D9F4****************************"
  
  	// Create an InitiateMultipartUploadResult object.
  	imur := oss.InitiateMultipartUploadResult{
  		UploadID: uploadId,
  		Key:      key,
  	}
  
  	// Cancel the multipart upload.
  	bucket.AbortMultipartUpload(imur)
  
  	fmt.Printf("Canceled multipart upload successfully. Upload ID: %s\n", uploadId)
  }
  

Usar SDKs

Chame AbortMultipartUpload para cancelar um upload multipart e excluir os dados das partes. As seções a seguir mostram códigos de exemplo para SDKs comuns. Para outras linguagens, consulte SDK Reference.

Antes de executar o código, instale o SDK e configure as credenciais de acesso como variáveis de ambiente. Se você usar um usuário RAM ou função RAM, conceda as permissões necessárias. Para mais informações, consulte API permissions .

package main

// Sample for canceling a multipart upload using OSS Go SDK V1.

import (
	"fmt"

	"github.com/aliyun/aliyun-oss-go-sdk/oss"
)

func main() {
	// Obtain access credentials from environment variables.
	provider, _ := oss.NewEnvironmentVariableCredentialsProvider()

	// Create an OSS client instance.
	client, _ := oss.New(
		"oss-cn-hangzhou.aliyuncs.com",
		"",
		"",
		oss.SetCredentialsProvider(&provider),
		oss.AuthVersion(oss.AuthV4),
		oss.Region("cn-hangzhou"),
	)

	// Obtain the bucket object.
	bucket, _ := client.Bucket("example-bucket")

	// Configure file information.
	key := "dest.jpg"
	uploadId := "D9F4****************************"

	// Create an InitiateMultipartUploadResult object.
	imur := oss.InitiateMultipartUploadResult{
		UploadID: uploadId,
		Key:      key,
	}

	// Cancel the multipart upload.
	bucket.AbortMultipartUpload(imur)

	fmt.Printf("Canceled multipart upload successfully. Upload ID: %s\n", uploadId)
}

package main

// Sample for canceling a multipart upload using OSS Go SDK V1.

import (
	"fmt"

	"github.com/aliyun/aliyun-oss-go-sdk/oss"
)

func main() {
	// Obtain access credentials from environment variables.
	provider, _ := oss.NewEnvironmentVariableCredentialsProvider()

	// Create an OSS client instance.
	client, _ := oss.New(
		"oss-cn-hangzhou.aliyuncs.com",
		"",
		"",
		oss.SetCredentialsProvider(&provider),
		oss.AuthVersion(oss.AuthV4),
		oss.Region("cn-hangzhou"),
	)

	// Obtain the bucket object.
	bucket, _ := client.Bucket("example-bucket")

	// Configure file information.
	key := "dest.jpg"
	uploadId := "D9F4****************************"

	// Create an InitiateMultipartUploadResult object.
	imur := oss.InitiateMultipartUploadResult{
		UploadID: uploadId,
		Key:      key,
	}

	// Cancel the multipart upload.
	bucket.AbortMultipartUpload(imur)

	fmt.Printf("Canceled multipart upload successfully. Upload ID: %s\n", uploadId)
}

package main

// Sample for canceling a multipart upload using OSS Go SDK V1.

import (
	"fmt"

	"github.com/aliyun/aliyun-oss-go-sdk/oss"
)

func main() {
	// Obtain access credentials from environment variables.
	provider, _ := oss.NewEnvironmentVariableCredentialsProvider()

	// Create an OSS client instance.
	client, _ := oss.New(
		"oss-cn-hangzhou.aliyuncs.com",
		"",
		"",
		oss.SetCredentialsProvider(&provider),
		oss.AuthVersion(oss.AuthV4),
		oss.Region("cn-hangzhou"),
	)

	// Obtain the bucket object.
	bucket, _ := client.Bucket("example-bucket")

	// Configure file information.
	key := "dest.jpg"
	uploadId := "D9F4****************************"

	// Create an InitiateMultipartUploadResult object.
	imur := oss.InitiateMultipartUploadResult{
		UploadID: uploadId,
		Key:      key,
	}

	// Cancel the multipart upload.
	bucket.AbortMultipartUpload(imur)

	fmt.Printf("Canceled multipart upload successfully. Upload ID: %s\n", uploadId)
}

package main

// Sample for canceling a multipart upload using OSS Go SDK V1.

import (
	"fmt"

	"github.com/aliyun/aliyun-oss-go-sdk/oss"
)

func main() {
	// Obtain access credentials from environment variables.
	provider, _ := oss.NewEnvironmentVariableCredentialsProvider()

	// Create an OSS client instance.
	client, _ := oss.New(
		"oss-cn-hangzhou.aliyuncs.com",
		"",
		"",
		oss.SetCredentialsProvider(&provider),
		oss.AuthVersion(oss.AuthV4),
		oss.Region("cn-hangzhou"),
	)

	// Obtain the bucket object.
	bucket, _ := client.Bucket("example-bucket")

	// Configure file information.
	key := "dest.jpg"
	uploadId := "D9F4****************************"

	// Create an InitiateMultipartUploadResult object.
	imur := oss.InitiateMultipartUploadResult{
		UploadID: uploadId,
		Key:      key,
	}

	// Cancel the multipart upload.
	bucket.AbortMultipartUpload(imur)

	fmt.Printf("Canceled multipart upload successfully. Upload ID: %s\n", uploadId)
}

package main

// Sample for canceling a multipart upload using OSS Go SDK V1.

import (
	"fmt"

	"github.com/aliyun/aliyun-oss-go-sdk/oss"
)

func main() {
	// Obtain access credentials from environment variables.
	provider, _ := oss.NewEnvironmentVariableCredentialsProvider()

	// Create an OSS client instance.
	client, _ := oss.New(
		"oss-cn-hangzhou.aliyuncs.com",
		"",
		"",
		oss.SetCredentialsProvider(&provider),
		oss.AuthVersion(oss.AuthV4),
		oss.Region("cn-hangzhou"),
	)

	// Obtain the bucket object.
	bucket, _ := client.Bucket("example-bucket")

	// Configure file information.
	key := "dest.jpg"
	uploadId := "D9F4****************************"

	// Create an InitiateMultipartUploadResult object.
	imur := oss.InitiateMultipartUploadResult{
		UploadID: uploadId,
		Key:      key,
	}

	// Cancel the multipart upload.
	bucket.AbortMultipartUpload(imur)

	fmt.Printf("Canceled multipart upload successfully. Upload ID: %s\n", uploadId)
}

package main

// Sample for canceling a multipart upload using OSS Go SDK V1.

import (
	"fmt"

	"github.com/aliyun/aliyun-oss-go-sdk/oss"
)

func main() {
	// Obtain access credentials from environment variables.
	provider, _ := oss.NewEnvironmentVariableCredentialsProvider()

	// Create an OSS client instance.
	client, _ := oss.New(
		"oss-cn-hangzhou.aliyuncs.com",
		"",
		"",
		oss.SetCredentialsProvider(&provider),
		oss.AuthVersion(oss.AuthV4),
		oss.Region("cn-hangzhou"),
	)

	// Obtain the bucket object.
	bucket, _ := client.Bucket("example-bucket")

	// Configure file information.
	key := "dest.jpg"
	uploadId := "D9F4****************************"

	// Create an InitiateMultipartUploadResult object.
	imur := oss.InitiateMultipartUploadResult{
		UploadID: uploadId,
		Key:      key,
	}

	// Cancel the multipart upload.
	bucket.AbortMultipartUpload(imur)

	fmt.Printf("Canceled multipart upload successfully. Upload ID: %s\n", uploadId)
}

Melhores práticas

• Otimização de desempenho: Melhorar a velocidade e a estabilidade do upload

  • Controle o número de partes simultâneas: Equilibre a simultaneidade com a largura de banda disponível e a carga do dispositivo. Conexões excessivas causam congestionamento; poucas conexões subutilizam a rede.

  • Evite prefixos sequenciais nos nomes: Não use prefixos sequenciais, como timestamps, nos nomes dos objetos. Isso concentra solicitações em uma única partição e causa hotspots. Para mais informações, consulte OSS performance best practices.

• Garantia de confiabilidade: Implementar uploads retomáveis

  Uploads multipart não expiram e suportam pausa e retomada. Use o UploadId como identificador da tarefa. Se uma parte falhar, reenvie apenas essa parte em vez de todo o arquivo.

• Otimização de custos: Otimizar a estratégia de upload para Deep Cold Archive

  Para otimizar custos no Deep Cold Archive, envie arquivos como objetos Standard e use uma lifecycle rule para fazer a transição deles. Isso evita taxas PUT por solicitação mais altas decorrentes de uploads diretos.

• Uploads retransmitidos por proxy ou Function Compute

  Ao enviar objetos grandes através de um servidor proxy ou Function Compute, o upload pode falhar devido a limites de tempo limite do gateway, como um erro HTTP 524. Prefira usar uma URL pré-assinada para que o cliente envie diretamente para o OSS, ignorando a camada de proxy. Você também pode usar credenciais temporárias STS para permitir que o frontend envie diretamente para o OSS. Se os uploads precisarem passar por um proxy, use upload multipart para dividir o objeto grande em partes menores e envie-as uma a uma, o que reduz o risco de tempo limite em uma única solicitação.

Prevenção de riscos

• Segurança de dados: Evitar substituição de arquivos

  Defina x-oss-forbid-overwrite como true no cabeçalho da solicitação para impedir substituições de mesmo nome que podem causar perda de dados. Você também pode ativar versioning para reter versões históricas.