What is a Run Group?

A run group is a collection of tests that you want to 

  • Run together
  • Run using the same platforms
  • Run on a scheduled basis (optional)

Easily manage run settings, schedules, and test suites in one place

Run groups let you manage your run settings, scheduled runs, and test suites in one place. They are a powerful way to achieve your desired coverage while maintaining complete control of your run settings.

Creating a Run Group

  1. Hover over the Tests icon
  2. Click Groups
  3. Click Create Run Group

This will bring up a modal that lets you specify the run settings and an optional schedule. Anything specific here can always be modified later.

Group Name
Enter a name for your run group; typical examples include “Smoke Suite”, “Regression Suite”, or “Mobile Test Suite”.

Run these tests with
This is how your tests will be executed.

  • Tester Community
    All tests will be run by the Rainforest Tester Community.
  • Rainforest Automation
    All tests will be run by Rainforest Automation (RFA). This only appears if ALL the tests in the group can be run by RFA and RFA is enabled.
  • Rainforest Automation + Crowd
    Tests will be run by either the crowd or by RFA. All tests that can be run by RFA will be run by RFA and all tests that cannot be run by RFA will be run by the crowd.
  • On-Premise Crowd
    All tests will be run by your on-premise crowd. On-Premise needs to be enabled.

Timezone (Optional)

Select the timezone you wish to use for scheduling your runs. UTC is the default, however, you change the schedule to any timezone using the dropdown.

Run time (Optional)
You have the option of running this run group on a regular schedule if you choose to use this feature. Select the start time and days.

Specify the environment you want your tests to run on.

Location (Optional)
If you want your tests to run on a specific geolocation, specify it here.

Choose Test Platforms(s)
Choose the platforms you want your tests to run on.

Test-Level Run Settings
This includes test level browser(s) and Location settings. So if the run group is set to run using Chrome but the test level is Safari - the specific tests will run in Safari if this is selected.

Once you create the run group, you are able to add tests to it. Any tests in this run group will run based on the settings specified.

Editing a Run Group

You can edit this run group by clicking on the wrench icon on the top menu.  It will open the Edit Run Group modal and you can change any of the Run Group settings as outlined above

Adding Tests to a Run Group

Run Groups let you add tests to them so you can run them as test suites with the specified settings. You can add any combination of individual tests and features.

Adding individual tests

Add a test or multiple tests to a Run Group from the 'All Test' List

  1. Go to Test Page
  2. Select the checkbox(es) for the test(s) you wish to add to the Run Group 
  3. Select Add to Group icon (clock) at the top
  4. Select the appropriate Group from the pop-up
  5. Repeat as needed

Adding Filters

You can add Saved Filters to a Run Group

  1. Go to Test Page
  2. Select the Saved Filter you want to add
  3. Select the checkbox at the top so ALL tests are selected
  4. Select Add to Group icon ( clock) at the top 
  5. Repeat as needed to add additional Filters

Adding Features

Add Features to Run Groups from the Features list

  1. Go to Tests
  2. Select Features
  3. Select the checkbox(s) for the Feature(s) you want to add 
  4. Select Add To Group icon (clock) at the top (appears once one Feature is selected)
  5. Select the appropriate Group from the pop-up
  6. Repeat as needed

Select Run instead of Add to Group to create a new Run Group for the selected feature. You may then add additional features or individual tests to the Run Group as previously detailed.

You may also add Features directly from the Run Group page.  

  1. Go to Run Groups
  2. Select the Group you wish to update, add Features to
  3. Select Add Feature button
  4. Select the Feature you wish to add
  5. Repeat as needed

Note: Individual tests and tests within a feature that are disabled may be added to a Run Group, but they will not execute until they are enabled.

Triggering Run Groups

Trigger a run group to run in three ways:

  1. On the Run Group page, click the “Run” button. Either use the Run Group settings or update for the specific run.
  2. CLI: Use the run --run-group [ID] command to trigger a run group from the CLI.
  3. Schedule: Any run groups with schedules will run based on that schedule (hit the wrench icon to edit the schedule).

Run Group Page Overview

  1. Run Group name, Edit and Delete.
    Update the Run Group name by selecting the Edit icon (wrench).  
    Delete the run group by selecting the trash can. This will NOT delete the tests.
  2. Test Options
    Tag - tag any of the selected tests. Will NOT work if Features are also selected.
    Add to Group - can use to add selected tests and features to any other Run Group
    Run - will open up modal to run the Run Group
    Disable Tests - disables selected tests. Will NOT work if Features are also selected.
    Remove - will remove the selected tests and features from the Run Group.  This will NOT delete the tests, will just remove them from the run group
  3. Features and Tests
    List of all the features and tests included in the run group.  
    Features are listed first and noted with a folder icon.
    Tests either individually added or added via a filter will be listed
  4. Add Feature and Run
    Select Add Feature to add additional features to the Run Group
    Select Run to run the run group
  5. CLI
    Use the information here to run the run group via the CLI.  Information can be copied and pasted.
  6. Schedule and Environment
    If the run group is set to have a schedule - information will be shown here.  Select the Edit Icon (wrench) at top of page to update Schedule information
  7. Platforms
    Platforms the run group is set to run on.  Select the Edit Icon (wrench) at top of page to update Platform information

Did this answer your question?