Platform For AI:Create an experiment

Prerequisites

• An experiment project is created. For more information, see Create an experiment project.

• A table is registered. For more information, see Register a table.

• Experiment metrics are created. For more information, see Create experiment metrics.

Create an experiment

1. Go to the ABTest page.

   1. Log on to the PAI console.

   2. In the left-side navigation pane, click Workspaces. On the Workspaces page, click the name of the workspace that you want to manage.

   3. In the left-side navigation pane, choose Model Deployment > PAI-ABTest.

2. In the left-side navigation pane of the ABTest page, choose Experiment Management > Experiments.

3. On the page that appears, click Create Experiment.

4. On the Create Experiment page, configure the parameters.

   1. In the Configure Basic Information step, configure the parameters and click Next. The following table describes the parameters.

      Parameter	Description
      Name	The name of the experiment.
      Description	The description of the experiment. The description helps identify an experiment.
      Experiment Projects	Select an experiment project from the drop-down list. If no experiment project is available, click Create Project to create an experiment project.
      Experiment Layers	You can select an experiment layer only after you select an experiment project. Select an experiment layer from the drop-down list. If no experiment layer is available, click Create Experiment Layer to create an experiment layer.
      Traffic Allocation	Specify the percentage of traffic occupied by the experiment on the experiment layer. Valid values: 0 to 100.
      Experiment Period	Select the start time and the end time of the experiment.
      User Group	Configure the experiment whitelist: You can enter the IDs of one or more users and press the Enter key. Separate multiple UIDs with commas (,). Example: UID1,UID2. You can also select an existing user group from the drop-down list. If no group is available, click Create User Group to create a user group.

   2. In the Configure Experiment step, configure the parameters and click Next.

      In this step, you can configure up to five versions, including one control version and up to four experiment versions. You can configure the traffic percentage and experiment parameters for each version. The following table describes the parameters.

      Parameter		Description
      Traffic Allocation		If you select Even Allocation, the traffic is evenly allocated among the experiment versions that you configure.
      Version Configurations	Traffic	The percentage of the traffic allocated to the version.
      	Version Name	The name of the experiment version.
      	Version Description	The description of the version. The description helps you identify the version.
      	User Group	Configure the experiment whitelist: You can enter the IDs of one or more users and press the Enter key. Separate multiple UIDs with commas (,). Example: UID1,UID2. You can also select an existing user group from the drop-down list. If no group is available, click Create User Group to create a user group.
      	Parameter Configurations	You can configure multiple experiment parameters. Add parameters and configure the data types of the parameters in the control version. Then, the system automatically synchronizes the parameter configurations to other experiment versions. Configure different parameter values for each version to compare the results.

   3. In the Experiment Metrics step, configure the Core Metrics and Followed Metrics parameters.

      You can select one core metric and configure multiple followed metrics. The metrics that you configured are included and compared in the experiment report. You can also leave these parameters empty.

5. Click Complete. You can view the created experiment in the experiment list. The experiment is in the Preparing state.

Manage an experiment

After you create an experiment, you can view and manage the created experiment in the experiment list.

View experiment details

You can click the name of the experiment to go to the details page. On this page, you can view the basic information and reports for the experiment.

• On the Configure Basic Information tab, view the basic information and parameters of the experiment. Click Edit to modify the configurations.

• On the Experiment Reports tab, view the experiment reports. For more information, see View experiment reports.

Start an experiment

The initial status of the experiment is Preparing. You can start the experiment by performing the following steps:

1. Click Start in the Actions column of the experiment.

2. In the Note message, click OK. The experiment status is automatically changed to Running, Pending, or Stopped based on the current time.

   • If the current time is within the experiment lifecycle, the experiment status changes to Running.

   • If the current time is earlier than the start time of the experiment, the experiment status changes to Pending. After the experiment starts, the system automatically changes the experiment status to Running.

   • If the current time is later than the end time of the experiment, the experiment status changes to Stopped.

Clone an experiment

Click Clone in the Actions column of an experiment to clone the experiment. The new experiment uses the configurations of the original experiment.

Delete an experiment

You can delete only experiments that are not in the Running state. Click Delete in the Actions column to delete the experiment that you no longer require.

References

After you create and start an experiment, you can regularly view the experiment reports. For more information, see View experiment reports.