Best Practices

Learn best practices for working with Automation Service results.

Reviewing Automation Results at the Step Level.

Step details provide additional information on how a match was or wasn’t made. We include information about the time and the environment. Test information and actions are also available.

The majority of Automation Service failures are due to slight changes in the image that Rainforest is evaluating. To make the identification and updating of images as easy as possible, Rainforest provides suggestions where applicable.

  1. Click either the View details or Review link for the step.
  2. View the Target Image and Closest Match options.
  3. If the Closest Match option is correct and you want to use it, click the Update Target button. The image is automatically be updated.
  4. If the suggested option is not appropriate, update the test by selecting Go to Test at the top of the page.

Note: Currently, only one step can be updated this way. If multiple steps require review and update, click Go to Test to edit the test.

Updating an element mismatch.Updating an element mismatch.

Updating an element mismatch.

Possible element mismatch
A Possible element mismatch error occurs when we can’t confidently match the intended element visually. Still, we have high confidence that we matched it using text matching when Text Matching is enabled. Though the test step passed, we encourage you to review the element and, if appropriate, select the suggested element.

Element mismatch
An Element mismatch error occurs when we can’t confidently match the intended element either visually or with text matching (if it’s enabled). In this case, the test step fails.

  • If a visual match is made and the step passes, Target Image and Closest Match are shown, with High Confidence. No action is necessary.
  • If a visual match didn’t occur, but text matching succeeded, the Target Image and Closest Match are displayed. If you agree with the match, select “Update Target” to use the suggested target.
  • If no successful visual or text match is made, a Moderate Confidence, Low Confidence or no image might be shown. If you agree with the match, select “Update Target” to use the suggested target. Otherwise, click Go to Test to edit the test.

Categorizing Failures

Failure categorization ensures you get the most information about your test suite’s health. It also helps confirm that the correct action is being taken when a test fails. For more information, see How to Categorize Failures.


If you have any questions, reach out to us at [email protected] or via the chat bubble below.


Did this page help you?