This guide describes how to use the Vision AI Audit tool to review analyst coding, verify the accuracy of Vision AI detections, and apply any AI data where it is deemed more accurate.
To access the tool, go to Video > Vision AI > Run Vision AI Audit (Preview), select the desired Video Selection and Options settings, and then click Run Audit:
Once processing is complete, the Vision AI Match Audit Results dialogue opens, dividing the ball clips into two categories:
- High Confidence – ball clips where Vision AI has a high level of confidence that its detections are more accurate than the current coding (entered manually by the video analyst) for the data points highlighted in bold red.
- Low Confidence – ball clips where Vision AI has a low level of confidence that its detections are more accurate than the current coding. These are also highlighted in bold red.
For example, the batch processing below shows 193 High Confidence results and 164 Low Confidence results (click the expand/collapse arrows to view):
For High Confidence discrepancies:
- Click Apply All to update all relevant ball clips with the Vision AI detections.
- Click the Over.Ball number (in blue text, to the left of each result) to review a ball clip before applying changes.
- Click Apply Changes on any individual ball clip to update individually.
For Low Confidence discrepancies:
- Carefully review each ball clip (as above) and then click Apply Changes individually.
- Click Apply All only if you generally accept the Vision AI detections as more accurate.
You can untick any of the following checkboxes in the top right corner to exclude specific Vision AI detections from the audit and thus from the Apply All and Apply Changes functions:
- Keeper Up/Back
- Bowler Over/Around
- Bowler Wide on Crease
- Pitch Map
- Ball Arrival
The Audit Assessment percentage is calculated as the number of Passed Audit balls divided by the number of Total Balls Processed. This total does not include Detection Failed balls. The number of Differences Detected will always equal the combined total of High Confidence and Low Confidence balls.
When finished, click the X at the top right of the Vision AI Match Audit Results dialogue box to exit.
- This tool can be used by users with the Vision AI Engine feature for clips without existing Vision AI data, or by users with the Vision AI Display licence for clips with existing AI data.
- After clicking Apply Changes, the button will become inactive and labelled Change Applied. To undo an AI update on a ball, edit the ball manually and re-enter the original coding.
- If multiple balls require reversal, restore a backup version of the match as outlined in: Match Folder Backup and Restore.