Model validation

Note: This functionality is currently limited to jobs and analysis models that are colony based.

Model validation let's you compare the counts of Reshape's AI analysis models with manual analysis.

Adding manual analysis

When you click a job name of a job that has a colony counting model applied and that is finished running, you'll see the option to Validate analysis data. 

This will open up a guide to let you enter manual counts of plates. This can be done in two different ways:

1. You can click on the image at which point a counter will appear, or

2. You can directly add the count in the input field.

Note: when you want to validate plates in a timelapse job, you can first navigate to a point on the timeline where the plates are well countable. When you then click Validate analysis data, it will take that timepoint to add manual counts.

Understanding performance

Once you have added manual counts, you can review the performance in the analysis library page. 

Performance score

The performance score indicates what percentage of validated data points are within the error margin (number of data points within error margin / all data points).

Error margin

The error margin is defined as follows:

- For plates with less than 30 colonies, the error margin is 3 colonies.

- For plates with more than 30 colonies, the error margin is 10%.