You can use the Third-party Libraries feature to upload driver files to the configuration file of an Alibaba Cloud Logstash cluster. The Third-party Libraries feature also allows you to manage the uploaded driver files.

Procedure

  1. Log on to the Elasticsearch console.
  2. In the left-side navigation pane of the page that appears, click Cluster Configuration.
  3. In the Third-party Libraries section, click Manage on the right side of Upload.
    Manage
  4. In the lower part of the Modify Configuration panel, click Configure.
  5. Click Upload. Then, in the dialog box that appears, select the files that you want to upload.
    You can upload multiple driver files at a time. The file name extension of each driver file must be .jar, and each file name cannot exceed 100 characters in length. The system checks file names and MD5 checksum values before the files are uploaded. If the check fails, the system displays an error message, which indicates that the files cannot be uploaded.

    Logstash supports MySQL JDBC, PostgreSQL JDBC, and PolarDB JDBC driver files. The following table lists the driver files that are supported by Logstash.

    Driver type Driver file
    MySQL JDBC driver
    PolarDB JDBC driver PolarDB-O-JDBC.zip
    Note Alibaba Cloud PolarDB provides JDBC drivers that are compatible with Java 6, Java 7, or Java 8. The following driver files are provided:
    • polardb-jdbc16.jar
    • polardb-jdbc17.jar
    • polardb-jdbc18.jar
    You can select a PolarDB JDBC driver based on the Java Development Kit (JDK) version that is used by your application.
    PostgreSQL JDBC driver
    Warning After you upload driver files for a cluster, the system restarts the cluster. This may affect your services. Proceed with caution.
  6. Click Save.
    After the files are uploaded, the system returns to the Cluster Configuration page and restarts the cluster. After the cluster is restarted, the third-party libraries are configured.
  7. Optional:Click Manage on the right side of Upload to view the information about the third-party libraries in the Modify Configuration panel.
    The information of the third-party libraries contains File and Path. You can click the Delete icon next to a file to remove the file. Modify Configuration
    Notice
    • For security purposes, if you use a JDBC driver to configure a pipeline, you must add allowLoadLocalInfile=false&autoDeserialize=false at the end of the jdbc_connection_string parameter, such as jdbc_connection_string => "jdbc:mysql://xxx.drds.aliyuncs.com:3306/test-database?allowLoadLocalInfile=false&autoDeserialize=false". Otherwise, the system displays an error message that indicates a check failure.
    • To remove a file that you no longer use, go to the Modify Configuration panel, click Configure in the lower part, find the file, and then click the Delete icon.

References

  • API operation used to update the third-party libraries configured for a Logstash cluster: UpdateExtendfiles
  • API operation used to query the third-party libraries configured for a Logstash cluster: ListExtendfiles