Model validation let's you compare the counts of Reshape's AI analysis models with manual analysis.
Adding manual analysis
When you click a job name of a job that has a colony counting model applied and that is finished running, you'll see the option to Validate analysis data.
This will open up a guide to let you enter manual counts of plates. This can be done in two different ways:
1. You can click on the image at which point a counter will appear, or
2. You can directly add the count in the input field.
Note: when you want to validate plates in a timelapse job, you can first navigate to a point on the timeline where the plates are well countable. When you then click Validate analysis data, it will take that timepoint to add manual counts.
Understanding performance
Once you have added manual counts, you can review the performance in the analysis library page.
Performance score
The performance score indicates what percentage of validated data points are within the error margin (number of data points within error margin / all data points).
Error margin
The error margin is defined as follows:
- For plates with less than 30 colonies, the error margin is 3 colonies.
- For plates with more than 30 colonies, the error margin is 10%.