Data service (OneService) is the final step in building a data mid-end with Dataphin. As a unified data service access point, it centralizes service management, lowers the barrier to data access, and ensures data security.
Prerequisites
You have purchased the data service value-added service and activated the data service module for your tenant.
Feature description
The Dataphin data source feature has been deprecated. You can use the Dataphin Java Database Connectivity (JDBC) Driver as an alternative. For more information, see Connect to Dataphin using JDBC.
Common data application issues
The standard process from requirement submission to delivery includes requirement submission, analysis, product design, documentation, development, functional testing, deployment, and delivery. This process typically takes about two weeks with multiple iterations. The resulting interfaces are highly specific and serve only individual business analyses. After deployment, you cannot monitor interface usage online. If requirements change, you must submit a new requirement and schedule another development cycle. This leads to several issues:
-
Long data development cycles and slow responses: Development requires scheduled iterations, and the high barrier to data use prevents immediate application.
-
Siloed development: This approach has high development costs and low reusability because a specific data interface is created for each requirement.
-
Poor data security and query performance: Development often prioritizes data accessibility over data resource security and data access stability.
-
High maintenance costs: Without online platform management, you cannot monitor for exceptions or receive alerts. Issues are discovered only after they affect business operations, requiring code troubleshooting, fixing, and redeployment.
Value of Data service
To address these issues, Data service provides two modes for developers: a codeless UI and a flexible code editor. These modes lower the development barrier, improve efficiency, standardize code quality, and simplify change management. For business users, Data service ensures secure, stable access to data resources and prevents sensitive data exposure at the application layer. Data service also supports monitoring and alerting, enabling O&M and development teams to quickly identify and resolve issues based on abnormal data or alert notifications. Key capabilities include:
-
Data service creation features:
-
Associate one or more physical tables to form a logical table, and then create APIs based on it.
-
Create APIs in a codeless UI for simple queries, or use the code editor to write custom SQL scripts for complex queries involving table joins, complex conditions, or complex data processing logic.
-
-
Data service management and O&M features:
-
Environment isolation separates draft, development, and production. Tests in each environment use the corresponding data.
-
Service management features let you handle invocation requests, data query authentication, and asset owner transfers.
-
You can configure alerts for service timeouts, failures, and rate limits. You can receive alert notifications through DingTalk chatbots, email, text messages, or phone calls.
-
Monitor abnormal invocation statistics to identify services and applications with unusual patterns and trends.
-
Query detailed invocation logs to view error messages and the SQL statements that were executed.
-
Advantages of Data service
-
Unified interface standards: Data service provides consistent interface standards and service metadata, which standardizes development, reduces integration effort for downstream applications, and improves data access efficiency.
-
Security and compliance: Data service minimizes the storage and exposure of sensitive data at the application layer. Unified security policies — including API invocation requests, authentication, flow control, and whitelists — lower data security management costs.
-
Service Monitoring: Data service provides invocation statistics and detailed log queries, helping O&M and development teams efficiently troubleshoot and resolve service anomalies.
You can use the Data service platform to create interfaces, invoke services, and manage the entire service lifecycle. Simple configurations on the platform automatically generate and deploy data services.
Features
With Data service, you can create service project groups based on physical tables from business data sources or logical tables generated by Dataphin. Applications can then invoke APIs. Data service also supports API O&M and monitoring to help you promptly identify and resolve exceptions during API invocation.
For information about the data source types that Data service can read from physical tables, see Data sources supported by Dataphin.
Scenarios
You can use Data service to build an enterprise API ecosystem — for example, by opening APIs to partners and developers to turn data into valuable assets.
Scenarios and procedures
Before you use Data service, familiarize yourself with the scenarios and procedures for each role.