The Testing Suite is a centralized platform that includes a highly flexible and comprehensive suite of testing tools, allowing you to test new risk strategies during go-live or changes to your existing decisioning logic to see projected outcomes and impact. With an expanding catalog of testing options, you can continuously observe performance, test, and deploy changes powered by built-in analytics, in-line testing, reporting visualizations, and insights.
This makes testing easy, so policymakers are empowered to confidently iterate on policies, test changes, and launch new policies without the need for any technical resources.
This article will cover the following sections:
Testing Suite: Test Types
The Testing Suite accommodates various testing methodologies, including Backtesting, A/B Testing, Shadow Testing, and more. It offers guidance and recommendations on the most suitable testing approach based on the specific changes applied.
| Test name (status) | Supported Products | Description | What does this type of test solve for? |
| Backtesting / Batch Testing | Journeys, Workflows |
Take real, historical data and run through in production to see the type of results clients can expect to see prior to going live. Note: Self-serve batch testing is only available for Journeys clients. |
Can Alloy support our decisioning logic/policies? Does Alloy provide the desired results? |
| Sandbox Profiles | Journeys, Workflows |
Test your integration with fake entities. Note: Alloy will not reach out to external services in sandbox mode. |
How can I ensure my policy within Alloy is properly configured? |
| Champion Challenger | Journeys, Workflows | A/B test up to 5 different versions of your Journey or Workflows decisioning logic. | Does a different version of my policy yield better outcomes? |
| What If Analysis | Workflows | Test a workflow change by running a historical random sample of up to 5000 entities to compare outcomes prior to setting the change live. | Does making a change to my policy yield better outcomes? |
Test History Page
Part of the Test Suite is a new Test History Page, where you can access all the historical results for any test you ran. The Test History Page is accessed within the Workflows and Journeys pages.
- Workflows Test History Page
- Journeys Test History Page
Comments
0 comments
Article is closed for comments.