Use Flink to process and analyze data in Tablestore in real time.
Background information
Realtime Compute for Apache Flink is a one-stop, real-time big data analytics platform built on Apache Flink. It delivers sub-second data analytics and simplifies development with standard SQL. It includes a built-in Tablestore connector for reading, writing, and computing data in Tablestore. For more information, see Appendix 1: Tablestore sink connector.
Tablestore Tunnel Service is an integrated service built on the Tablestore data API that handles full and incremental data. You can create a data tunnel for a table and use stream processing to consume both existing and new data.
Scenarios
The combination of Tablestore and Flink supports the following scenarios:
-
Real-time data analytics and processing
Using Tablestore as a data source for Flink jobs lets you collect and process large volumes of structured data in real time. This enables real-time business monitoring and trend analysis, helping your enterprise respond quickly to market changes.
-
Internet of Things (IoT) data processing
Tablestore provides a time series model for storing and processing IoT device data. Combined with Flink, this enables real-time monitoring, predictive maintenance, and intelligent decision-making for applications such as vehicle trajectory analysis and environmental monitoring.
-
Risk monitoring in the finance industry
Financial institutions need to monitor transaction behavior in real time to identify potential threats and take appropriate action. Flink monitors transaction data streams in real time to detect abnormal behavior, such as frequent large-value transfers and unusual logons. It then writes risk scores or abnormal records to Tablestore for subsequent auditing and analysis.
For more information about Flink scenarios, see Scenarios.
Billing
-
Flink
Realtime Compute for Apache Flink charges for management resources and compute resources. For more information, see Product Billing.
-
Tablestore
Accessing Tablestore through a compute engine incurs charges for data reads and writes. Storage fees also apply based on the volume of stored data. For more information, see Billing overview.
References
-
Flink can use Tunnel Service data tunnels as a streaming data source to compute and analyze Tablestore data. For instructions, see Tutorials.