IoT Platform:Manage Offline Data Archiving

Prerequisites

Product data backup must be enabled. The archiving cycle should be shorter than the backup cycle for the device data within the instance, with a minimum archiving cycle of 1 Month. Ensure the backup cycle exceeds 1 Month. Both the 1-month and 1-year durations are calculated as 30 days and 365 days, respectively.

Limits

• Archive Storage supports only specific types of offline data.

  • Product property time series table and product event table within time series/snapshot tables

  • Partitioned table, time series table within custom storage tables

• Once data is archived, it cannot be queried for analysis in the SQL Data Service Studio of Analytics Insight. To query and analyze archived data, revoke the archiving. For details, see Revoke Archiving.

Usage Example

For instance, if you need to back up 5 years of device data for an instance but only analyze the most recent year, set the backup cycle to 5 years and the archiving cycle to 1 year. Under this configuration:

• Device data older than 5 years will be automatically deleted.

• Data from the past year will be stored in offline data Standard Storage.

• Data from 1 to 5 years old will be archived in offline data Archive Storage.

  

Billing Instructions

Data in Archive Storage is billed as offline data storage, with the space used by Archive Storage counted as one-fifth of that used by Standard Storage.

Example

For example, in the US (Virginia) region, consider 1 GB of offline data Standard Storage and 2 GB of offline data Archive Storage.

Here, 1 GB of offline data Standard Storage occupies 1 GB of space, while 2 GB of offline data Archive Storage occupies 2/5 GB of space.

The monthly cost for all offline data storage is: 0.1*(1+2/5)=0.14 dollars.

Enable Archiving

1. Access the IoT Platform console.

2. On the Instance Overview page, locate the desired Enterprise Edition instance and click it to open the Instance Details page.

3. In the left-side navigation pane, choose DataService Studio > Data Storage.

4. Navigate to the Data Storage page and select the Offline Storage tab.

5. Navigate to the Time Series/snapshot Table or Custom Storage Table tab.

6. In the data list, single-click the Table Type column's and choose either Product Property Time Series Table, Product Event Table, Partitioned Table, or Time Series Table. Then, single-click Confirm to locate the desired storage table within the selected category.

7. In the dialog box, choose the desired archiving cycle.

   Parameter	Description
   Archiving Cycle Selection	Choose Duration Unit, which only supports Month, and specify the Duration Value. Important For Product Property Time Series Table and Product Event Table, the Archiving Cycle Selection Duration Value must be shorter than the instance backup cycle to avoid archiving failure. For Custom Storage Table, the Archiving Cycle Selection Duration Value must be shorter than the table's data storage duration to prevent archiving failure.
   Execute Data Archiving Daily	The default selected check box indicates a daily archiving task is created for newly added data that meets the archiving criteria. Deselect the Execute Data Archiving Daily check box if you wish to create a single archiving task for current data only.

8. Click Confirm.

   To monitor the archiving process, click the Operation column next to the storage table and select Archiving Process.

View Archiving Records

1. In the Time Series/snapshot Table or Custom Storage Table tab, locate the completed archiving storage table and click the More > Archiving Records in the operation column.

2. On the archiving records page, select Schedule Date to view the records.

3. Click View in the operation column to see the archiving details.

Change Archiving

You can modify the archiving cycle or revoke archiving after it has been enabled for a storage table.

Change Archiving Cycle

1. Navigate to either the Time Series/snapshot Table or Custom Storage Table tab, locate the table where archiving is complete, and single click Change Archiving in the operation column.

2. In the dialog box, the default Change Type is Change Cycle. Adjust the Archiving Cycle Selection and Execute Data Archiving Daily settings as needed.

3. Click Confirm to apply the changes.

Revoke Archiving

1. Navigate to either the Time Series/snapshot Table or Custom Storage Table tab, locate the table designated for archive storage, and single click Change Archiving within the operation column.

2. In the dialog box, change the Change Type to Revoke Archiving.

3. Click Confirm to revert the archived data to offline data Standard Storage, which will be billed based on the actual space used.

After revoking archiving, the data will return to offline data Standard Storage, and billing will reflect the actual space occupied.