Use Tablestore SDK for Go to consume data in real time - Tablestore

Tablestore SDK for Go encapsulates the automatic data consumption framework and multiple API operations, such as the management operations, of Tunnel Service,

Quick start

Before you use Tunnel Service to consume data in a data table in real time, you must create a tunnel for the table. Then, you can use the tunnel to consume data in the data table. For more information, see Getting started.

Management operations

To create a tunnel for a data table, you must specify the name of the table and the name and type of the tunnel. For more information, see Create a tunnel.

After you create a tunnel, you can manage the tunnel based on your business requirements.

Operation	Description
Query information about all tunnels of a data table	Queries information about all tunnels of a data table.
Query information about a tunnel	Queries the channel information about a tunnel. A channel corresponds to a shard for the Stream operation of Tablestore.
Delete a tunnel	Deletes a tunnel of a data table.

Data consumption framework

In the automatic data consumption framework, tunnel clients regularly check heartbeats to detect active channels, update the status of channels and ChannelConnect tasks, and initialize, run, and end data processing tasks.

Tunnel clients support the following features for processing full and incremental data: load balancing, fault recovery, checkpoints, and partition information synchronization (which is used to ensure the sequence of data consumption in partitions). Tunnel clients allow you to focus only on the processing logic of each record. For more information, see Tunnel clients.

References

For more information about Tunnel Service, see Overview.
You can use Tunnel Service to migrate data. For more information, see Synchronize data from one table to another table in Tablestore.
Realtime Compute for Apache Flink can use the tunnels of Tunnel Service as the source of streaming data to compute and analyze Tablestore data. For more information, see Tutorial for the Wide Column model and Tutorial (TimeSeries model).
You are not charged for Tunnel Service. However, you are charged for the read throughput that is generated when you use tunnels to consume data. For more information, see Billing overview.