Continuously improve your risk strategies and understand your performance with Alloy. Derive insights and test your changes to validate projected outcomes. Alloy’s What If Analysis uses historical data to visualize how workflow changes impact outcomes.
This article contains the following sections:
What is What If Analysis
Alloy’s What If Analysis is a powerful testing feature that enables you to experiment with changes within your workflow safely. By leveraging historical data, you can test these changes and assess their impact on the outcome results. It allows you to utilize a sample of cached data to evaluate Workflow logic modifications and policy changes against the historical performance within Alloy. This empowers you to confidently test and validate your changes to drive better outcomes before implementing them live.
What If Analysis is highly configurable, allowing you to:
- Test changes such as changes to outcomes and output attributes.
- Select if you want to run a random or specific sample size.
- Select a sample size of up to 5000 evaluations.
- Select a date range for the evaluations to test.
- Copy and paste in specific evaluation tokens to test.
- Filter sample size by outcomes, tags, and timeframe.
- Preview a list of the evaluations selected as part of the test.
- Generate test evaluations to visualize high-level comparison results and dive into each evaluation if needed.
When to Use What If Analysis
What If Analysis is an excellent tool for testing any changes you make to your Workflow. Here are some common reasons why customers may want to utilize What If Analysis for testing:
- If you have a target approval, denial, and manual review rate, you need to hit and would like to explore updating your policy.
- If you have a fraud attack and would like to test if a rule change(s) could have prevented the fraud attack. With What If Analysis, you can drill down to the exact time of the fraud attack and only test out policy changes on a specific sample size.
Things to Note
What If Analysis can test almost any changes you make to your Workflow; however, there are a few known use cases it does not support testing.
- Adding, removing, and editing Input attributes.
- You can remove data sources, but it does not work with adding new data sources.
- Sandbox evaluations are not supported.
Additional Resources
As you get started with What If Analysis, you might find the following resources helpful:
- How to Use What If Analysis: Step-by-step instructions on how to use the What If Analysis.
- Test History Page for Workflows: A guide on the Test History page for workflows.
Comments
0 comments
Article is closed for comments.