Organizing Tests by Run Group

A run group is a collection of tests that are meant to run together. Use run groups to execute multiple tests on a scheduled basis, on demand, or from the command line. Examples include tests for a smoke suite, a regression suite, or a nightly build validation.

Run groups allow you to manage test run settings, scheduling, and test suites in one place. You can schedule a run group to execute at a specific time, run it via the CLI, or execute it manually anytime.

See this article to learn how to create a run group.

Group Based on Test Execution Cadence

Use run groups to execute related tests together. For example, a smoke suite run group could include your core business-critical workflows. Run this group daily or integrate it into your CI pipeline. Another run group could be your regression suite, which contains all your tests. Run this group before each major release.

Group Based on Platform and Environment

Use run groups to group tests that should be run the same platforms. When creating a run group, you can set the environment and platforms the tests should use. We recommend separating your tests by platform.

Set a Run Schedule

Run groups are scheduled makes it easy to run your tests whenever you want. You can set specific days and times you want the run groups to be executed. Using the run scheduler eliminates the need to manually trigger the runs. For more information, see Running tests using schedules.

If you have any questions, reach out to us at [email protected].