Using What If Analysis

Step 1: Select a workflow

Determine which workflow you would like to improve results for e.g. your onboarding workflow has too many entities going to manual review and you'd like to decrease that number.

Step 2: In the workflow, find the "What If Analysis" link in the top right toolbar

If the link doesn't look clickable and has a tooltip beside it (see above), your workflow might not qualify for What If Analysis at the moment. Read the steps below of what needs to be completed: 

1. "Make sure your new workflow is saved"
   • To save your workflow, click the "Save" button on the top right corner of the toolbar
2. "Start running evaluations through so we can start collecting data" which will happen automatically after saving your workflow
   • In order to properly analyze your workflow, we need adequate data!
   • We need at least 2 live evaluations sent to the workflow version being edited; sandbox evaluations are not supported.

If the link looks like the below, continue to step 3:

Step 3: Start using What If!

Change a threshold on any existing data source, click the "What If Analysis" link in the top navigation to open the panel, see the change you just made and click the "run analysis" button!

Threshold panel changes:

Run Analysis button has been clicked:

Things to note

• Does not work with additional data sources (e.g. can't add Blockscore to your workflow and then run what if analysis)
• You can remove data sources 
• We will run up to 500 random evaluations

How to read your results

• Black bar = current rate for each outcome
• Purple bar = What If rate for each outcome
• Evaluations run = how many evaluations were run through this analysis out of how many evaluations you have total that have ever run through this workflow
• Bold percentage above an outcome indicate percent change for any deltas