Object Storage Service:Use Big Data Tools to connect JetBrains IDEs to OSS

What is Big Data Tools?

Big Data Tools is a JetBrains IDE plug-in that connects to remote storage systems such as OSS. Once connected, you can:

• Browse and manage objects the way you would in a file manager—copy, move, rename, delete, and download.

• Preview CSV files in Text view or Table view, and binary formats such as Parquet, ORC, and Avro.

• View object metadata such as modification time, object type, and storage class.

• Open buckets and directories in separate editor tabs.

For more information, see Big Data Tools.

Prerequisites

Before you begin, ensure that you have:

• One of the following JetBrains IDEs: IntelliJ IDEA Ultimate, PyCharm Professional, DataGrip, or DataSpell

• An AccessKey pair for a RAM user with access to your OSS bucket (see Create an AccessKey pair)

Step 1: Install the Big Data Tools plug-in

1. Open the IDE settings.

   • macOS: Choose IntelliJ IDEA > Preferences, or press ⌘,.

   • Windows or Linux: Choose File > Settings, or press Ctrl+Alt+S.

2. In the left-side navigation pane, click Plugins.

3. Click the Marketplace tab.

4. In the User Data search box, enter Big Data Tools.

5. Click Install next to the Big Data Tools result, then click OK.

   

After installation, Big Data Tools appears on the right side of the IDE.

Step 2: Connect to OSS

1. In the right-side bar of the IDE, click Big Data Tools > Alibaba OSS.

   

2. In the Big Data Tools dialog box, configure the connection:

   1. Enter a name for the connection.

   2. Select the region where your buckets are located. For a list of available regions, see Regions and endpoints.

   3. Select how to retrieve buckets:

      • Custom roots: Enter the bucket name or a path to a directory in the bucket. Separate multiple values with commas.

      • All buckets in the account: Shows all buckets. Use the bucket filter to narrow by name.

   4. From the Authentication type list, select Explicit access key and secret key. Enter the AccessKey ID of the RAM user in the Access key field, and the AccessKey secret in the Secret key field.

   5. Click OK.

   

Step 3: Manage OSS buckets and objects

Once connected, you can browse and manage your OSS data in the IDE.

Preview a bucket in a separate tab

Select the bucket and click Open in Separate Viewer.

The bucket opens in a separate editor tab. Expand directories and structured objects—including CSV, Parquet, ORC, and Avro—to view data columns and types.

From the tab, you can also:

• Click the icon to show or hide specific columns.

• Click the icon to upload data from disk, or click the icon to copy an object.

• Drag an object or directory to another bucket or directory to copy or move it.

Query object information

Right-click the object and select Show Info.

A panel displays the object's modification time, object type, and storage class.