Test runs specify a set of test cases to execute and include the results of running the test cases, indicating whether actual results differ from expected results. When you create a test run, you select one or more test cases as the basis for the test run. You then schedule the test run to execute, which captures and stores values (results) for all test cases in the test run. Test then compares the returned values against the baseline values for each test case, and stores and reports the findings.

For example, a test run for use with the Salesforce CPQ Calculate Quote API specifies a number of test cases to execute to ensure that the latest Salesforce update did not introduce regressions in your CPQ pricing calculations. When you execute the test run, Test calls the Salesforce CPQ Calculate Quote API for each test case, stores the returned values in the test run, compares the results for each test against the test case’s baseline values, and stores pass/fail test run results in the test run.

A test run consists of:

• A list of test cases to execute.
• The results of executing the test cases.
• Pass/fail baseline comparison values.

The Test Runs Page

To access the page, in the left sidebar of the Test tab, click Test Runs.

The Test Run Results tab displays pertinent information for each executed test run:

• Test Run Number – Specifies an auto-generated tracking number for the test run. This field is system-generated and read only.
• Status – Indicates the progress of the test run. This field is system-generated and read only. These values are possible:
  • Not Started – Indicates there have never been any attempts to execute the test run.
  • In Progress – Indicates the test run is currently executing. To monitor progress, navigate to the Test Run Results page.
  • Complete – Indicates the test run has finished executing. To view the results, navigate to the Test Run Results page.
• Test Cases – Specifies the number of test cases associated with the test run. Hover over the numbers to see the names of the test cases.
• Run Date – Specifies when the test run execution took place.
• Details – Specifies the total number of tests run and number of those tests that passed.
• Run By – Specifies the user who initiated the test run.
• Test Ran In Org – Specifies the environment in which the test run took place.

Scheduled Test Runs Tab

The Test Runs page also contains the Scheduled Test Runs tab.

The Scheduled Test Runs tab displays pertinent information for each scheduled test run:

• Scheduled Job Key – Specifies an auto-generated tracking number for the test schedule. This field is system-generated and read only.