What is the Test Designer?
You can use can use our Test Designer to initiate a new test writing request and have specially trained testers (test writers) create your test cases by submitting high-level test outlines about the desired tests to receive passing tests within 3-4 days.
The Test Designer (TD) lets users get test cases created quickly within Rainforest with a fraction of the effort currently needed for test writing. Through this, users can request up to 20 tests and get these tests back in a passing state. The Test Designer allows users to immediately add these new tests to their test suite for execution.
How does the Test Designer work today?
We are leveraging the top testers in our tester community to review, write, and run your tests for you. This is how the Test Designer works:
- Submission. Users fill out the form provided in the UI and submit the test writing run. We recommend submitting 10-20 tests in a batch.
- Input review. Rainforest immediately assigns a reviewer to review, clean up and confirm that the inputs are ready to use by the test writers. If the inputs are missing crucial information, the reviewer will block the run for the customer to review. (24 hours)
- Test writing and running. The reviewer will assign as many test writers that are needed to complete the run (up to four). Each test writer will spend 4 hours writing and optimizing the test – this means the test writer will run tests and get them to a passing state or they will block the test if there are any bugs, unclear instructions, environment issues, etc. that prevent the test from passing. (48 hours)
- Output review. Reviewers will then review the output and make any final adjustments. (24 hours)
- Test Writing Request completed. Once the reviewer is done, the tests are released to the customer’s account in Rainforest.
What kind of information do users need to provide for a successful run?
The most critical component that can define a successful or unsuccessful run is the submission. To ensure a high quality output, we recommend following these guidelines:
- Check that the environment you’re requesting works. This is a very common source of issues preventing successful test writing when test writers can’t access to environment.
- Make sure the credentials provided work.
- Provide enough detail for test writers to follow instructions. There should be detailed instructions on what the test writer should do. If test writers do not have enough information, they may not be able to successfully navigate the site or won’t know what the expected behavior is. They will struggle to move forward and they want to avoid this as the result may not align with the desired outcome.
- Avoid business and sector-specific jargon. You’ll be describing the test cases to test writers that may be unfamiliar with how your site works at the first run. It’s best practice to make sure that the test authors have enough information to complete the test writing.
Below are some good examples of Test Outlines that have yielded passing tests on first run:
- “Ensure that when the user is in the My Pay section, that clicking on the dependent will expand to reveal more information. Also make sure that the eye icon will show/hide the SSN of the dependent as well as the SSN of the employee in the upper right corner of the my profile page. Click on My Pay from the dashboard. Click on all of the links under Financial tools and verify that each page takes you to the correct calculator. Ensure that each page loads properly.
- “Please verify the following elements on the page work: All Links/buttons on the main article of the page. This includes all buttons/links below/next to/on the image carousel/hero image. Snippets (links to other articles) below the main article. Clicking on the image, clicking article's title, and Read more link. Links to other pages like Related articles, or any other links to the right of the main article. Do not check any dynamic content like news articles, events, videos.”
- “The context of this test is to check the Manage Business Hours function for both Doctors and Assistants. Go to www.fakeurl.com. Doctors and assistants are able to set the Business hours. It can be set for each clinic associated to the user, you can do this by going to Settings > Business hours. The hours can be set for a day or they can be repeated in a defined interval. Also users are able to remove the availability by hand.”
How will I be notified once my tests are completed?
- The Test Designer will provide users with a summary report providing information about the output of their test writing requests. The report provides a breakdown of the tests requested, tests written, tests passing, and any tests that are blocked. The report highlights any test that requires the client’s attention — from resolving blockers, to incorporating tests into their testing suite. Additionally, the report will highlight any bugs found during the writing process
- The report will be sent to automatically via email upon the conclusion of each test writing request to any users that have enabled email notifications about test writing runs.