Run Test Dialog

The New Run dialog box works similarly for any type of run you are executing.
The following configuration options are available for all run types:

  • Name
    of the run
  • How this run is to be executed
    Either through our Automation Service, the Tester Community, the AutomationService + Test Community or On-Premise Testers if available. Only applicable options are shown. See Executing tests for more information
  • Environment
    Where the test will run
  • Platform
    Platform(s) you wish to use to execute the test.
    Note: For Draft runs - only a single platform may be selected, all other runs can request multiple platforms.

Additional Options
The Additional Options allow you to further configure how you want to run your test(s)

  • Where should your traffic be routed through?
    See Executing your tests using specific Geolocations for more information
  • Should this run be tied to your release process?
    Usually a git SHA or custom version number
  • Use individual test settings for this run
    will be available for those runs that contain multiple tests and for those clients that have this option available.
    Note: Platform and location will default to either the Test’s own Test-Level Run Settings or your default settings if not enabled. See Test-Level Run settings for more information.

Some things to know about running your tests

The Run Test Dialog has been updated based on the type and number of tests you are running. The four types of runs are:

  • Single Draft Tests
  • Single Published Tests
  • Multiple Selected Tests
  • Run Groups

The Run Test Dialog acts slightly differently according to the type of test run being requested.

Single Draft Tests

For tests that are in a draft state:

  • Name
    Set to the test name of the single test selected and is non-editable

  • Platform
    Only one platform may be selected
    Note: Results will be displayed on the Draft Runs page

Single Published Tests

For a single published test (not in Draft or Disabled state)

  • Name
    Set to the test name of the single test selected and is editable

  • Platform
    Multiple platforms may be selected

Multiple Selected Tests

For several tests selected for a run:

  • Name
    Set to the first test name and count of additional tests selected. If a single Feature Group or smart filter has been selected, the name of the feature or smart filter will be used. May be edited.

  • How this run is to be executed
    Only those options that are applicable to the tests selected will be available.

  • Platform
    Determined from your default settings. Multiple platforms may be selected

  • Location
    Determined from your default settings but is editable

Run Groups

For a specific Run Group

  • Name
    Set to the name of the run group but may be edited.

  • How this run is to be executed
    Set to the run group method. If the method is not valid, will default to the next best method but may be edited if multiple options are available.

  • Platform
    Set to the run group platform defaults but may be edited.

  • Location
    Set to the run group location default.

Viewing Test-Level Run Settings

Select View All Tests link to see the test level run settings being used (when applicable).

Items to note

We have removed features that were not well utilized to make the run test dialog more useful and efficient

  • Ability to apply Run Group settings to arbitrary set to tests
  • Ability to enable desktop notification
  • Time/duration estimate at run creation has been removed. Actual run time/duration information will be shown at the completion of the run.

If you have any questions, please feel free to reach out to us at [email protected] or through Intercom!

Updated 5 months ago

Run Test Dialog

Suggested Edits are limited on API Reference Pages

You can only suggest edits to Markdown body content, but not to the API spec.