Testing in Rainforest from a tester's perspective
Our testers are located around the globe. This helps us ensure we have 24x7 coverage and can you run your tests at any time.
Testers get new jobs through a Chrome extension or through a dedicated tester portal. Once they download the Chrome extension, they can turn it on and receive jobs. They can then click the extension to turn off when they no longer want to receive jobs.
Testing on Virtual Machines (VMs)
Testers don't use their own browser to do work. By default, each tester is given in a newly started virtual machine with the browser you requested. This ensures each test is performed with a clean state; no cookies, browser tool bars or existing logins.
The testing interface
If you preview a test, you will see exactly what our testers see: the action/question instructions, the Yes / No options as well as the bug report and other features related to the terminal. Testers can only go forward in a test, and never back. In addition to that, testers have the ability to hover over past and future steps if they need to access information for the step they're currently on.
Tester rules and instructions
In order to ensure quality results, we use strict testing instructions as well as rules that testers must abide by. We remind testers of the rules at the beginning of each job, as well as through reminders at various points during the test.
Ensuring consistent, reliable results requires that our testers clearly understand the expectations set for them, and the way in which they can perform well. A tester who may seem slightly particular in their reporting is likely doing their job correctly!
Commonly asked questions about our testers.
What connection speed do testers have locally? We do not control the connection the tester has, so there’s is variance. We do ask them to have a “high speed” connection, so you can assume they all have at least 5mbps. Usually, it's faster. Their geographical location varies from tester to tester, so that can also affect latency.
How fast can I expect their internet connection to be? There are two aspects to this:
- The testers' browser connection to the internet while testing. Testers have connection speed of 1 Gbps which is extremely fast (roughly 50x the American household average as of Sept 2014) and stable, and also comes from a known list of IPs, which you can use to whitelist Rainforest if needed for VPN access.
- The testers' connection to the virtual machine. This is generally not necessary to worry about as the browser connection is the most important. Their connection only affects the speed at which they can connect to our virtual machines, so it won't affect your tests unless you require extremely time sensitive actions (e.g. gaming, rendering).