DataService Studio's cold data storage feature allows you to view custom storage tables. This topic outlines the process for creating and managing these tables and their data.
Create custom storage tables
-
Log on to the IoT Platform console.
-
On the Instance Overview page, find the target Enterprise instance and click the instance to open the Instance Details page.
-
In the navigation pane on the left, choose DataService Studio > Data Storage.
-
On the Data Storage page, click the Offline Storage tab.
-
Navigate to the Cold Data Storage tab and single click Custom Storage Tables.
-
Under the Custom Storage Tables tab, single click Create Custom Storage Table.
-
In the Create Custom Storage Table dialog box, fill in the following settings:
Parameter
Example
Required
Description
Table Display Name
Daily Average Temperature Storage Table
Yes
Enter a name for the storage table, which cannot start with a number or underscore (_), and may include Chinese characters, English letters, numbers, and underscores (_), up to 30 characters.
Table Identifier
DailyAverageTemperature
Yes
Specify the identifier for the storage table, which must begin with an English letter and can include English letters, numbers, and underscores (_), up to 30 characters.
Description
Average temperature of the thermometer
No
Provide a brief description of the storage table's purpose.
Data Retention Period
More
No
The retention period of data in the storage table.
Data older than the specified period will be automatically deleted by the system, according to the time field within the table.
Options include One Month, Two Months, Three Months, Half a Year, One Year, Permanent, and More.
Selecting More requires you to specify both Time Unit and Time Value.
Time Unit
Year
No
Choose the time unit for data retention from Year, Month, or Day.
Time Value
10
No
Enter a positive integer for the time value. Maximum limits are 102 for Year, 2142 for Month, and 64260 for Day.
-
Year: 102.
-
Month: 2142.
-
Day: 64260.
-
-
To finalize the creation of the custom storage table, single click Confirm.
After the table is created, you can use it to store data from real-time pipelines.
Manage custom storage tables
On the Custom Storage Tables tab, locate the target table in the list and click the corresponding operation button.
-
To View a table:
ImportantCustom storage tables support various data analysis features:
-
Tables without data output can only be used as output targets for data pipelines or SQL analysis tasks.
-
Tables with data can be used as query sources for multiple SQL analysis tasks, and as data sources for data APIs and visualization reports.
-
If the table is not referenced by a data pipeline or SQL analysis task, you can view only the Table Name and Chinese Name.
-
If the table is referenced by a data pipeline or SQL analysis task, you can view its Basic Information and Table Structure.
-
Basic Information
Item
Example
Description
Table Identifier
${system.device_group_relation}
The identifier of the storage table.
Display Name
Device group relationship table
The display name of the storage table.
Number of Fields
8
The number of fields in the table header.
Data Source
System data source
The origin of the data. Valid values:
-
System data source: Data from a platform system table.
-
Product property data source or Product event data source: Data from a time series table or a snapshot table.
Description
This table describes the relationship between devices and groups.
The purpose of the storage table.
-
-
Table Schema: Lists the fields in the table header, including field names and field types.
-
-
-
To Edit a table:
ImportantOnce a table is referenced by a data pipeline or SQL analysis task, it cannot be edited.
-
To Delete a table:
ImportantYou cannot delete a table that is currently in use. First, stop any related data pipelines or SQL analysis tasks.
-
To access the Data Overview:
After the custom storage table is used in a real-time pipeline or SQL analysis task, you can preview the latest 20 entries.
-
To perform Static Data Import:
ImportantStatic data can only be imported after the storage table is successfully initialized.
-
To Export data:
Important-
Data can only be exported after the storage table is successfully initialized.
-
Under the same account, only one export task can be active at a time, with a daily limit of three export tasks, each supporting up to three downloads.
-
What to do next
-
After creating a custom storage table, populate it with data by using it as an output target for a data pipeline or SQL analysis task.
-
Once the table starts receiving data, it can serve as a query source for multiple SQL analysis tasks and as a data source for data APIs and visualization reports.