The Test Results page provides test step by test step details on the individual test that you have selected. The following information is for Test Results run against the Rainforest Crowd. Please see Results - Test Results Page (Automation) for information about reviewing results for Rainforest Automation tests.
Selection of a test advances to the Test Results page.
The Test Results page provides step-by-step details of the individual test.
Test level details
- Test Name
- Draft - draft is noted on Test Name if the test was run in draft mode
Status - of last run
- Owner - who in your organization owns the test
- Started - start time of last run
- Completed - duration (how long it took to execute) the last run
Results History - how has the test performed the last five times.
This test was run on ten separate platform.
A listing of the step by step details of the test for the most selected execution.
Clicking into a step (by selecting green check, red X or grey dots) on the right shows the selected test step.
You can expect to see anywhere between one and three results, and in rare cases more than 3, if we don't reach consensus on a result with the first few testers.
If the test is run on multiple browsers, results are grouped by browser.
You may change the status of the test as well. If the test is failed by Rainforest, you may override and pass the test by selecting Change to passed. Conversely you may change a passed test step to Failed if needed by selecting Change to failed. Override reasoning must be provided.
NOTE: if you are reviewing tests that were selected from Draft Runs, only a single tester result is shown as only a single tester performs tests in Draft Runs.
Tester results, mouse tracking, video, logs and rating
Step results provide detailed information on the selected test step by tester. You can see what each tester did and why they either passed or failed the step
- Test instructions for this step are shown at the top of the page
- Tester response (pass / fail) provided at the top of the page
- Screenshot: Select Screenshot from the top and you will see the screenshot of when the tester clicks the 'Yes' or 'No' button. NOTE: to toggle on / off the mouse tracking. Select the EYE icon at the bottom left. If this is on, you will see the mouse tracking and click movements of the tester
- Video: Select Video from the top and you will see a video play-through of the tester on this step.
- Rate tester for this step: You can rate the tester from Very poor to Amazing! Ratings are used to determine the tester's overall reputation score. Testers with continuously low scores will be retrained or removed from the crowd. Rating a tester does not remove the tester from testing for your account. We encourage you to rate testers on their performance so we can improve results quality for everyone.
- View HTTP request log: See the HTTP log for this tester for this test step
- Download video: Download the video of the entire test for this tester
Things to note:
- Tester video is available for about 95% of results. There is a small percentage of videos that Rainforest is unable to capture and upload successfully due to the dynamic nature of applications being tested.
- Tester videos stored by Rainforest in Amazon S3 are encrypted-at-rest.
- If you encounter a video that is blank, please reach out to us and let us know.