The New Run dialog box works similarly for any type of run you are executing.
The following configuration options are available for all run types:

• Name
  of the run
• How this run is to be executed
  Either through our Automation Service, the Tester Community, the AutomationService + Test Community or On-Premise Testers if available. Only applicable options are shown. See Executing tests for more information
• Environment
  Where the test will run
• Platform
  Platform(s) you wish to use to execute the test.
  Note: For Draft runs - only a single platform may be selected, all other runs can request multiple platforms.

Additional Options
The Additional Options allow you to further configure how you want to run your test(s)

• Where should your traffic be routed through?
  See Executing your tests using specific Geolocations for more information
• Should this run be tied to your release process?
  Usually a git SHA or custom version number
• Use individual test settings for this run
  will be available for those runs that contain multiple tests and for those clients that have this option available.
  Note: Platform and location will default to either the Test’s own Test-Level Run Settings or your default settings if not enabled. See Test-Level Run settings for more information.

Some things to know about running your tests

The Run Test Dialog has been updated based on the type and number of tests you are running. The four types of runs are:

• Single Draft Tests
• Single Published Tests
• Multiple Selected Tests
• Run Groups

The Run Test Dialog acts slightly differently according to the type of test run being requested.

Single Draft Tests

For tests that are in a draft state:

• Name
  Set to the test name of the single test selected and is non-editable

• Platform
  Only one platform may be selected
  Note: Results will be displayed on the Draft Runs page

Single Published Tests

For a single published test (not in Draft or Disabled state)

• Name
  Set to the test name of the single test selected and is editable

• Platform
  Multiple platforms may be selected

Multiple Selected Tests

For several tests selected for a run:

• Name
  Set to the first test name and count of additional tests selected. If a single Feature Group or smart filter has been selected, the name of the feature or smart filter will be used. May be edited.

• How this run is to be executed
  Only those options that are applicable to the tests selected will be available.

• Platform
  Determined from your default settings. Multiple platforms may be selected

• Location
  Determined from your default settings but is editable

Run Groups

For a specific Run Group

• Name
  Set to the name of the run group but may be edited.

• How this run is to be executed
  Set to the run group method. If the method is not valid, will default to the next best method but may be edited if multiple options are available.

• Platform
  Set to the run group platform defaults but may be edited.

• Location
  Set to the run group location default.

Viewing Test-Level Run Settings

Select View All Tests link to see the test level run settings being used (when applicable).

Items to note

We have removed features that were not well utilized to make the run test dialog more useful and efficient

• Ability to apply Run Group settings to arbitrary set to tests
• Ability to enable desktop notification
• Time/duration estimate at run creation has been removed. Actual run time/duration information will be shown at the completion of the run.

If you have any questions, please feel free to reach out to us at [email protected] or through Intercom!