PAI-Rec uses configuration files to define the entire recommendation pipeline, including recall, filtering, ranking, and re-ranking, without requiring any code.
Overall configuration overview
PAI-Rec allows you to configure the entire recommendation process in configuration files, covering candidate item retrieval, exposure blocking, ranking models, and re-ranking. No code is required. For algorithm and strategy engineers who need to run multiple experiments, PAI-Rec also provides a built-in A/B testing system.
PAI-Rec supports multiple Alibaba Cloud storage services, including Hologres, Tablestore, and ApsaraDB for Redis. You can choose a storage service based on your business requirements. For more details, see the relevant topics.
If your business introduces many new items daily, you can configure a cold start solution.
PAI-Rec supports hot reloading, so you can modify and republish configurations on the fly.
The following code block shows the overall configuration structure of the PAI-Rec engine:
{
"RunMode": "",
"ListenConf": {},
"RecallConfs": [],
"SceneConfs": {},
"FilterConfs": [],
"FilterNames": {},
"BeFilterConfs": {},
"GeneralRankConfs": {},
"AlgoConfs": [],
"RankConf": {},
"ColdStartGeneralRankConfs": {},
"ColdStartRankConfs": {},
"SortConfs": {},
"DPPConf": {},
"SortNames": {},
"FeatureConfs": {},
"UserFeatureConfs": {},
"HologresConfs": {},
"KafkaConfs": {},
"RedisConfs": {},
"MysqlConfs": {},
"GraphConfs": {},
"FeatureStoreConfs": {},
"KafkaConfs": {},
"SlsConfs": {},
"DatahubConfs": {},
"BEConfs": {},
"TableStoreConfs": {},
"PrometheusConfig": {},
"LogConf": {},
"DebugConfs": {},
"CallBackConfs": {},
"PipelineConfs": {},
"UserDefineConfs": {}
}|
Parameter |
Description |
Support for hot reloading |
|
RunMode |
The runtime environment of the PAI-Rec engine. Valid values: ● daily: the daily environment. ● prepub: the staging environment. ● product: the production environment. |
No |
|
ListenConf |
The listener configuration. |
Yes |
|
RecallConfs |
The recall configuration. |
Yes |
|
SceneConfs |
The scenario configuration. Allows you to assign specific recalls from the RecallConfs section to different scenarios. |
Yes |
|
FilterConfs |
The filter configuration. |
Yes |
|
FilterNames |
Custom filter names. Allows you to assign specific filters from the FilterConfs section to different scenarios. |
Yes |
|
BeFilterConfs |
Yes |
|
|
AlgoConfs |
The configuration of the coarse ranking model. |
Yes |
|
GeneralRankConfs |
Assigns specific coarse ranking models from the AlgoConfs section to different scenarios. |
Yes |
|
RankConf |
Assigns specific fine ranking models from the AlgoConfs section to different scenarios. |
Yes |
|
ColdStartGeneralRankConfs |
Assigns specific cold start coarse ranking models from the AlgoConfs section to different scenarios. |
Yes |
|
ColdStartRankConfs |
Assigns specific cold start models from the AlgoConfs section to different scenarios. |
Yes |
|
SortConfs |
The re-ranking configuration. |
Yes |
|
DPPConf |
The diversification configuration. |
Yes |
|
SortNames |
Assigns specific re-ranking models from the SortConfs section to different scenarios. |
Yes |
|
FeatureConfs |
Loads specific features for different scenarios. |
Yes |
|
UserFeatureConfs |
Loads specific user features for different scenarios. |
Yes |
|
HologresConfs |
The Hologres connection configuration. |
No |
|
KafkaConfs |
The ApsaraMQ for Kafka connection configuration. |
No |
|
RedisConfs |
The ApsaraDB for Redis connection configuration. |
No |
|
MysqlConfs |
The ApsaraDB RDS for MySQL connection configuration. |
No |
|
GraphConfs |
The GraphCompute connection configuration. |
No |
|
FeatureStoreConfs |
The FeatureStore connection configuration. |
No |
|
SlsConfs |
The Simple Log Service connection configuration. |
No |
|
DatahubConfs |
The DataHub connection configuration. |
No |
|
BEConfs |
No |
|
|
TableStoreConfs |
The Tablestore connection configuration. |
No |
|
PrometheusConfig |
The Managed Service for Prometheus connection configuration. |
No |
|
LogConf |
The log output configuration. |
Yes |
|
DebugConfs |
The debugging configuration. |
Yes |
|
CallBackConfs |
The callback configuration. For more information, see Callback API. |
Yes |
|
PipelineConfs |
The pipeline configuration. |
Yes |
|
UserDefineConfs |
The user-defined configuration. |
No |