AI photo check (formerly AI check) is a feature that has AI review again the photos submitted by workers, and shows "No problem found / May differ / Cannot tell from photo" as reference observations. It works as a double check, adding AI as a second pair of eyes alongside a person's review. It never stops answers from being saved, and the results are only advice.
Customers on the Pro and Enterprise plans can use it. Settings are made from a PC browser. It can only be used on questions with Require photo submission turned On.
This feature is provided as a beta version. Its specifications and judgment accuracy will continue to improve. If you notice anything, such as cases that worked well or cases where the judgment was not what you intended, please send it to customer-success@episotech.com.
What is AI photo check?
For questions that require photo submission, AI checks the photos that workers take and submit. How the check is done depends on whether a model image has been registered.
- If a model image is registered: AI compares the submitted photo with the model (Check against the reference)
- If no model image is registered: AI checks the photo based on the question text and the procedure details
The results do not replace final decisions such as "Passed" or "Compliant." Please use them only as an aid, on the premise that the worker and an administrator will check the results themselves.
How to set it up
Open the target question in the SOP editing screen on a PC browser and configure it. AI photo check requires photo submission, so first set Require photo submission to On, and then enable AI photo check.
1. Require photo submission
- In the question editor, set [Require photo submission] to On.
When this is On, workers are asked to take and submit on-site photos when viewing (multiple photos are allowed). Specify what to photograph in the question's description text.
2. Enable AI photo check
- Set [Use AI photo check], which appears below [Require photo submission], to On.
3. Register a model image (optional)
- Set [Prepare a reference image], which appears below the question text, to On.
- Upload the image to use as the model.
When you register a model image, the check becomes "Check against the reference," which compares the submitted photo with the model. If you do not register one, the check is based on the question text and the procedure details. The model image is also shown directly below the question text when viewing. For pass/fail (inspection) questions, the "Normal" guideline is also shown to workers.
How workers use it (when viewing)
- Take an on-site photo for the question and submit it (you cannot save your answer without a photo).
- Once the photo has finished uploading, you can press [Check against the reference] (or [Check with AI] for questions without a model image).
- When you press the button, AI checks the photo within a few seconds and shows the result.
When you are offline, AI photo check cannot be used. It becomes available again once you are back online. Also, you cannot press the button until the photo has finished uploading.
Using it on smart glasses
You can also run AI photo check on the SOP playback screen of smart glasses. After taking and submitting a photo, press [Check against the reference] ([Check with AI]) using one of the following methods.
- Use the touchpad, or say "Up" or "Down" by voice to move focus to the button, then say "Select"
- Say "Check" by voice (this works regardless of where the focus is)
When "Check" can be used, a guide is also shown in the microphone hint on the question screen. Because the button cannot be pressed until the photo has finished uploading, the hint is not shown either.
While you are typing free text, such as a comment, "Check" is entered as text and does not work as a command. Once the focus leaves the input field, you can use it as a voice command again.
Also, while you are taking photos for a question, procedure video playback and read-aloud temporarily stop. When you finish taking photos, they resume as before.
How to read the results
Results are shown in one of the following three ways.
- Match confirmed / No problem found: The photo matches the model, or no problem was found (please do the final check yourself, using the reference observation as guidance)
- May differ / Needs re-check: It may differ from the model, or there may be a problem. Please check again
- Cannot tell from photo: The photo could not be judged, for example because the target is not clearly visible. Retake the photo so that the target is clearly visible, then check again
All of these results are reference observations. Final pass/fail decisions are made by the worker and the administrator.
Check results later in Work records
AI photo check results are not only shown to the worker on the spot, but are also saved in Work records (inspection checklist). Administrators can later check who did which work and what the AI said about each question.
- Table cells: A small badge appears next to the submitted photo (AI○ = No problem found / AI! = Needs re-check / AI? = Cannot tell). Hover over the cell to see the AI observation and reason.
- Details of one work record: Click a row to show the full AI observation and reason for each question.
- CSV export: A note is added to the end of the cell, such as "(AI: Needs check)".
AI observations are only listed as notes, and they never rewrite the worker's answer (the OK/NG judgment). As before, the worker's answers remain the primary record of the inspection.
Conditions of use
- Available only to customers on the Pro and Enterprise plans.
- Settings are made from a PC browser.
- Can only be used on questions with Require photo submission turned On.
- Not available when offline.