AppOps Test

Overview

AppOps Test automates regression testing of complex Salesforce workflows, for example, Salesforce CPQ. Tests are fully API-based, instead of click-based UI walkthroughs. Using an intuitive visual user interface, you create and execute test cases, analyze the results, then rerun the test cases anytime to compare the state of the system at various moments in time.

With AppOps Test, you can:

  • Iteratively run sanity tests during development, deployment, and project go-live.
  • Define and run test cases throughout the development and release cycles, and schedule them to rerun again after major and minor Salesforce releases.
  • Reliably confirm that your low-code application implementations, like Salesforce CPQ, drive your users to the correct expected results.
  • Quickly answer questions like:
    • Have my price rule changes inadvertently introduced errors?
    • Are specific quote lines still receiving the values I expect?
    • Have the list amounts, list totals, net amounts, and net totals been affected by the latest Salesforce push upgrade?

AppOps Test Building Blocks

Test templatestest cases, and test runs are the building blocks of AppOps Test.

  • A test template is simply a list of fields (from one or more objects) for future use by test cases.
  • A test case tests specific functionality using the fields from the test template.
  • A test run is a collection of test cases and the results of executing those test cases.

Workflow

For maximum flexibility and versatility, you build AppOps Test components in this order:

  1. Start by installing the Prodly AppOps managed package in the org where your Salesforce CPQ installation resides.
  2. Identify the object fields to test, storing the list of fields as a test template.
  3. Test templates are the building blocks for test cases. Create a test case by selecting a template and other parameters that define what to test. On save, the test case executes and captures the results in the test case to use later as a baseline.
  4. Test cases are the building blocks for test runs. Create a test run by first selecting one or more test cases and then executing the test cases to generate test run results, which are then stored in the test run.
  5. In the future, rerun (automatic clone and run) the test run to generate a new set of test run results.

Scope

The current release of AppOps Test focuses on testing and verifying this Salesforce CPQ functionality:

  • Quote and quote line price calculations
  • Quotes and quote lines created from the subscriptions and assets of an amended contract
  • Quotes and quote lines created from the subscriptions and assets of a renewed contract
  • A contract’s subscriptions and assets created from quotes and quote lines​

And can test these field types for both standard and custom fields:

  • Text fields (255 characters or less)
  • Number fields
  • Currency fields
  • Date fields
  • Formula fields

You can also include support for your custom fields. Refer to Adding Reference Fields for details.
Admins are responsible for many, many moving parts. Using the Salesforce CPQ Quote and Quote Line objects, testing price calculation, a contract amendment, and contract renewal can alert you to record level failures resulting from unintentional changes or errors. Potential causes for failures include changes to:

  • Price rules
  • Price rule formulas
  • Custom scripting in the quote calculator plugin
  • Evaluation order
  • Discount schedules
  • Contracted pricing
  • Multi-dimensional quoting setup
  • Process builder
  • Workflow rules
  • Approval thresholds
  • Target amount functionality
  • Price waterfall impacts
  • Apex triggers on the Quote and Quote Line objects
  • Quote and Quote Line object-related formula fields, field metadata, and lookup table data

AppOps Test is not a debugging tool that identifies the cause of failures. Instead, AppOps Test reports unexpected output results, which in turn alerts you that something related to quote and quote line records has unexpectedly changed.

Future development plans that Prodly is evaluating include:

  • Support for multiple remote connections
  • Automatic test case generation
  • Automatic and scheduled test runs
  • Expanding test coverage for these CPQ functions:
    • Orders
    • Product Configuration
  • Expanding test coverage to include other Salesforce low-code apps

What You See in AppOps Test

Prodly AppOps is a Lightning-ready application for Salesforce that contains tabs for all features of all Prodly AppOps products.

The AppOps Test functionality resides on the AppOps Test tab.

Just as you might expect, the tab contains separate Test TemplatesTest Cases, and Test Runs main pages, available in the left sidebar. You can navigate freely between the pages and their subpages.Each page contains multiple actions you can take, such as creating a test templaterefreshing baseline values, and viewing test run results.

Overview

AppOps Test automates regression testing of complex Salesforce workflows, for example, Salesforce CPQ. Tests are fully API-based, instead of click-based UI walkthroughs. Using an intuitive visual user interface, you create and execute test cases, analyze the results, then rerun the test cases anytime to compare the state of the system at various moments in time.

With AppOps Test, you can:

  • Iteratively run sanity tests during development, deployment, and project go-live.
  • Define and run test cases throughout the development and release cycles, and schedule them to rerun again after major and minor Salesforce releases.
  • Reliably confirm that your low-code application implementations, like Salesforce CPQ, drive your users to the correct expected results.
  • Quickly answer questions like:
    • Have my price rule changes inadvertently introduced errors?
    • Are specific quote lines still receiving the values I expect?
    • Have the list amounts, list totals, net amounts, and net totals been affected by the latest Salesforce push upgrade?

AppOps Test Building Blocks

Test templatestest cases, and test runs are the building blocks of AppOps Test.

  • A test template is simply a list of fields (from one or more objects) for future use by test cases.
  • A test case tests specific functionality using the fields from the test template.
  • A test run is a collection of test cases and the results of executing those test cases.

Workflow

For maximum flexibility and versatility, you build AppOps Test components in this order:

  1. Start by installing the Prodly AppOps managed package in the org where your Salesforce CPQ installation resides.
  2. Identify the object fields to test, storing the list of fields as a test template.
  3. Test templates are the building blocks for test cases. Create a test case by selecting a template and other parameters that define what to test. On save, the test case executes and captures the results in the test case to use later as a baseline.
  4. Test cases are the building blocks for test runs. Create a test run by first selecting one or more test cases and then executing the test cases to generate test run results, which are then stored in the test run.
  5. In the future, rerun (automatic clone and run) the test run to generate a new set of test run results.

Scope

The current release of AppOps Test focuses on testing and verifying this Salesforce CPQ functionality:

  • Quote and quote line price calculations
  • Quotes and quote lines created from the subscriptions and assets of an amended contract
  • Quotes and quote lines created from the subscriptions and assets of a renewed contract
  • A contract’s subscriptions and assets created from quotes and quote lines​

And can test these field types for both standard and custom fields:

  • Text fields (255 characters or less)
  • Number fields
  • Currency fields
  • Date fields
  • Formula fields

You can also include support for your custom fields. Refer to Adding Reference Fields for details.
Admins are responsible for many, many moving parts. Using the Salesforce CPQ Quote and Quote Line objects, testing price calculation, contract amendment, and contract renewal can alert you to record level failures resulting from unintentional changes or errors. Potential causes for failures include changes to:

AppOps Test is not a debugging tool that identifies the cause of failures. Instead, AppOps Test reports unexpected output results, which in turn alerts you that something related to quote and quote line records has unexpectedly changed.

  • Price rules
  • Price rule formulas
  • Custom scripting in the quote calculator plugin
  • Evaluation order
  • Discount schedules
  • Contracted pricing
  • Multi-dimensional quoting setup
  • Process builder
  • Workflow rules
  • Approval thresholds
  • Target amount functionality
  • Price waterfall impacts
  • Apex triggers on the Quote and Quote Line objects
  • Quote and Quote Line object-related formula fields, field metadata, and lookup table data

Future development plans that Prodly is evaluating include:

  • Support for multiple remote connections
  • Automatic test case generation
  • Automatic and scheduled test runs
  • Expanding test coverage for these CPQ functions:
    • Orders
    • Product Configuration
  • Expanding test coverage to include other Salesforce low-code apps

What You See in AppOps Test

Prodly AppOps is a Lightning-ready application for Salesforce that contains tabs for all features of all Prodly AppOps products.

The AppOps Test functionality resides on the AppOps Test tab.

Just as you might expect, the tab contains separate Test TemplatesTest Cases, and Test Runs main pages, available in the left sidebar. You can navigate freely between the pages and their subpages.Each page contains multiple actions you can take, such as creating a test templaterefreshing baseline values, and viewing test run results.