How to Debug Automation Results

Learn how to troubleshoot your tests using Automation results.

The Results page provides valuable information on tests at the step level. However, if you want to gain a better understanding of how each step ran, you can use the Investigate Action feature. To view details on any step, click Investigate Action.

To return to the test results, click the back arrow at the top of the page. Note that you can use Investigate Action on any step.

Investigating actions.Investigating actions.

Investigating actions.

Reviewing a Passed Step

Sometimes, you might find it helpful to see how a match occurred in a step that passed. You can see the following information:

  • Attempted to find a match (image)
  • Closest match identified (image)
  • Results determined
  • Metadata
  • The Closest match location is shown in the screenshot to the right.
Detailed step results.Detailed step results.

Detailed step results.

If a visual match was performed using pixel data, detailed information on how close the match was is shown in the “Result determined” section.

An element matched using visual match.An element matched using visual match.

An element matched using visual match.

If a match was performed using Text Matching, the text is shown in the “Result determined” section. See Text Matching for more information.

An element matched using Text Matching.An element matched using Text Matching.

An element matched using Text Matching.

Reviewing a Failed Step

When you click Investigate Action on a failed step, you see the same information that displays for a passed test, except that neither visual nor Text Matching was successful.

Information, including the closest visual match and the text used to match (if applicable), is displayed. Note that additional information and actions are available for further troubleshooting.

Image Comparison

For failed steps, you can investigate further by comparing the requested and closest matched items.

  1. Click the Can’t see the difference? link under “Closest match identified” to compare the images.
  2. Use Swipe or Layered to determine whether the closest match should be used.
  3. When you’re finished, click Done.
Comparing differences.Comparing differences.

Comparing differences.

Update Action Screenshot

You can update the failed step directly from this screen. First, confirm the closest match is appropriate to use, then click the Accept Replacement button. Note that the test is automatically updated.

If the closest match isn’t acceptable, then open the test, edit the step, and capture the correct element.

The Site Can’t Be Reached When Navigating to the Test URL

You might find you cannot get to the site. Make sure to whitelist all Rainforest IP addresses. See Which IP Addresses Do Rainforest Tests Come From? for more information.

Example of a blocked IP address.Example of a blocked IP address.

Example of a blocked IP address.

HTTP and Video Logs for Troubleshooting

Using HTTPHTTP - Hypertext Transfer Protocol (HTTP) is data communication foundation for the World Wide Web. It provides access to hypertext documents, including hyperlinks to other resources. logs, you can view all HTTP traffic passing to and from each Rainforest virtual machine (VM). Use the logs to examine request interruptions at the network level and see the order in which HTTP requests were made.

To view a test’s HTTP browser logs or a copy of the video results:

  1. Click the test’s run results.
  2. Click the More dropdown.
  3. Click “HTTP Logs” or "Video" to download the HTTP logs or the video results.

View the HAR file in your text editor of choice, this recommended tool, or this Google Chrome extension.

Getting HTTP logs for troubleshooting.Getting HTTP logs for troubleshooting.

Getting HTTP logs for troubleshooting.

If you have any questions, reach out to us at [email protected] or via the chat bubble below.

Did this page help you?