Simple Log Service:Collect logs from ECS instances in other Alibaba Cloud accounts to Simple Log Service

Step 1: Create a user identity file

1. Log on to the ECS server that belongs to Alibaba Cloud account B.

   Important

   You must create the user identity file on each ECS server in ECS cluster B.

2. Run the following command to create the user identity file.

   Set the user identity to Alibaba Cloud account A. This creates a file named after the ID of Alibaba Cloud account A. For more information, see Configure a user identity.

   touch /etc/ilogtail/users/12****456

Step 2: Create a custom identifier-based machine group

1. Create a custom identifier file for the machine group on the ECS server.

   Important

   You must create the custom identifier file for the machine group on each ECS server in ECS cluster B.

   1. Log on to the ECS server that belongs to Alibaba Cloud account B.

   2. In the specified directory, create the /etc/ilogtail/user_defined_id file and add a custom identifier.

      For example, to set the custom identifier to application_b, enter application_b in the file and save it. For more information about the file path, see Create a custom identifier-based machine group.

2. Create a machine group in the SLS console.

   1. Log on to the Simple Log Service console with Alibaba Cloud account A.

   2. In the Project List area, click the destination project.

   3. In the left-side navigation pane, choose Resources > Machine Groups.

   4. To the right of Machine Groups, click > Create Machine Group.

   5. In the Create Machine Group dialog box, configure the parameters and then click OK.

      Set Custom Identifier to the value that you configured in Step 1. For more information about other parameters, see Create a machine group with a custom identifier. Set Name to group-b, select Custom Identifier for Machine Group Identifier, and enter application_b for Custom Identifier.

3. Verify that the heartbeat status of the servers in the machine group is OK.

   1. In the machine group list, click the destination machine group.

   2. On the Machine Group Configurations page, view the ECS instances that use the same custom identifier and check their heartbeat status.

      A Heartbeat status of OK indicates that the ECS instance is connected to Simple Log Service. If the status is FAIL, see Troubleshoot Logtail machine group heartbeats. Confirm that all four machines in the machine group show an OK heartbeat status.

Step 3: Collect logs

1. Log on to the Simple Log Service console with Alibaba Cloud account A.

2. Click Quick Start.

   The Integrate Data section is in the lower-right corner of the console homepage.

3. In the Quick Data Import dialog box, select Regex - Text Log.

4. In the Import Data wizard, select the destination project and logstore, and then click Next.

5. Configure the Machine Group Configurations.

   1. Set Scenario to Servers.

   2. Set Installation Environment to ECS.

   3. Select the machine group that you created in Step 2. Move the machine group from Source Machine Group to Applied Machine Group, and then click Next.

6. Create a Logtail collection configuration and click Next.

   For more information about the parameters, see Collect logs in full regex mode.

   Important

   • By default, only one Logtail collection configuration can match a file. Because the collection configuration for account B is still active, the new configuration for account A cannot take effect. You can use one of the following methods to activate the configuration for account A:

     • Stop the log collection for account B. To do this, log on to the SLS console with account B and remove the Logtail collection configuration from the destination machine group. For more information, see Apply a Logtail configuration to a specified machine group.

     • Add a forced collection configuration for account A. For more information, see How to collect logs from a file multiple times.

   • After you create the Logtail collection configuration, delete the original configuration for Alibaba Cloud account B to prevent duplicate log collection. For more information, see Delete a Logtail configuration.

   In the Logtail collection configuration form, set Config Name to application_b, set Log Path to /tmp/**/*.log, select Full Regex Mode for Mode, and turn on Single Line.

7. Preview the data, configure indexes, and then click Next.

   SLS enables full-text indexing by default. You can also configure field indexes manually or automatically based on the collected logs. For more information, see Create indexes.

Related operations