Configure the Salesforce input widget to import data from a Salesforce data source into Dataphin for data integration and development.
Prerequisites
Before you begin, ensure that the following requirements are met:
-
A Salesforce data source is created. For more information, see create a Salesforce data source.
-
The account used to configure the Salesforce input widget must have read-through permission for the data source. If you do not have this permission, see requesting data source permission.
Procedure
-
Select Development > Data Integration from the top menu bar on the Dataphin home page.
-
Choose a Project from the top menu bar on the integration page (the Dev-Prod pattern requires selecting an environment).
-
In the navigation pane on the left, click on the Batch Pipeline icon. From the Batch Pipeline list, select the offline pipeline you want to develop to access its configuration page.
-
To open the Component Library panel, click the Component Library icon in the upper right corner of the page.
-
In the Component Library panel's left-side navigation pane, select Input. Then, drag the Salesforce widget from the input widget list to the canvas.
-
To configure the widget, click the
icon on the Salesforce input widget card, which opens the Salesforce Input Configuration dialog box. -
Set the parameters in the Salesforce Input Configuration dialog box.
Parameter
Description
Step Name
The name of the Salesforce input widget. Dataphin generates a default name that you can modify as needed. The name must meet the following requirements:
-
Can only contain Chinese characters, letters, underscores (_), and numbers.
-
Cannot exceed 64 characters.
Datasource
Lists all Salesforce-type data sources in Dataphin. Click the
icon to copy the data source name.-
For data sources that you do not have read-through permission for, click Request next to the data source to apply for read permission. For more information, see request data source permission.
-
If you do not have a Salesforce-type data source yet, click Create Data Source to create a data source. For more information, see create a Salesforce data source.
Object
Select the Salesforce object from which to read data. You can search by keyword or enter the exact object name and click Exact Search. After you select an object, the system automatically detects the object status. Click the
icon to copy the selected object name.Bulk read
Turn on this switch to use the Bulk API to read data in batches.
NoteBatch mode does not support reading composite field types.
Input Filter (optional)
Specify a filter condition for the input data, such as
ds=${bizdate}. Input Filter applies to the following scenarios:-
A fixed part of the data.
-
Parameter filtering.
NoteThe supported comparison operators include =, !=, <, >, IN, NOT IN, etc.
Output Fields
Displays all fields of the selected object. To exclude fields from downstream widgets, delete the unwanted fields:
-
To delete individual fields, click the
icon in the Actions column. -
To delete multiple fields at once, click Field Management, select the fields, and click the
icon to move them from Selected Input Fields to Unselected Input Fields.
-
-
Finalize the property configuration of the Salesforce input widget by clicking Confirm.