Simple Log Service:Replicate data from a Logstore

Scenarios

A company collects and stores access logs in multiple projects within a single Alibaba Cloud account. The company needs to replicate access logs from the logstore-a Logstore in the project-a project to the logstore-b Logstore in a new project-b project. This enables centralized query and analysis in project-b. Simple Log Service provides a replication function in its data transformation feature to copy data from logstore-a to logstore-b.

Prerequisites

• Create the logstore-a Logstore and write data to it. For more information, see Manage a Logstore.

• Create the logstore-b Logstore. Evaluate and plan the performance of logstore-b, such as the number of shards. For more information, see Performance guide.

Procedure

1. Log on to the Simple Log Service console.

2. In the Projects section, click the project-a project.

3. On the Log Storage > Logstores tab, click the logstore-a Logstore.

   

4. Click Data Transformation to enter data transformation mode.

   

5. On the right side of the page, click Preview Data. For more information about previewing data, see Preview and debug.

   

6. On the right side of the page, click Save as Transformation Job.

7. In the Create Data Transformation Job panel, configure the following parameters and click OK.

   Note

   For more information about other parameters, see Create a data transformation job.

   Parameter	Description
   Job Name	The default name of the data transformation job.
   Display Name	The custom name of the data transformation job. For example, enter test.
   Authorization Method	Authorize Simple Log Service to read data from the logstore-a Logstore. Select Default Role.
   Target Name	The name of the storage destination. Enter test.
   Target Region	The region where the destination project resides. Select China (Hangzhou).
   Target Project	The name of the destination project. Enter project-b.
   destination database	The name of the destination Logstore. Enter logstore-b.
   Authorization Method	Authorize Simple Log Service to write data to the logstore-b Logstore. Select Default Role.
   Time Range	The time range for the data transformation job. A value of All processes data in the source Logstore from the first log until you manually stop the job. Select All.