The New Run dialog box works similarly for any type of run you are executing.
The following configuration options are available for all run types:


- Name
of the run - How this run is to be executed
Either through our Automation Service, the Tester Community, the AutomationService + Test Community or On-Premise Testers if available. Only applicable options are shown. See Executing tests for more information - Environment
Where the test will run - Platform
Platform(s) you wish to use to execute the test.
Note: For Draft runs - only a single platform may be selected, all other runs can request multiple platforms.


Additional Options
The Additional Options allow you to further configure how you want to run your test(s)
- Where should your traffic be routed through?
See Executing your tests using specific Geolocations for more information - Should this run be tied to your release process?
Usually a git SHA or custom version number - Use individual test settings for this run
will be available for those runs that contain multiple tests and for those clients that have this option available.
Note: Platform and location will default to either the Test’s own Test-Level Run Settings or your default settings if not enabled. See Test-Level Run settings for more information.


Some things to know about running your tests
The Run Test Dialog has been updated based on the type and number of tests you are running. The four types of runs are:
- Single Draft Tests
- Single Published Tests
- Multiple Selected Tests
- Run Groups
The Run Test Dialog acts slightly differently according to the type of test run being requested.
Single Draft Tests
For tests that are in a draft state:
-
Name
Set to the test name of the single test selected and is non-editable -
Platform
Only one platform may be selected
Note: Results will be displayed on the Draft Runs page
Single Published Tests
For a single published test (not in Draft or Disabled state)
-
Name
Set to the test name of the single test selected and is editable -
Platform
Multiple platforms may be selected
Multiple Selected Tests
For several tests selected for a run:
-
Name
Set to the first test name and count of additional tests selected. If a single Feature Group or smart filter has been selected, the name of the feature or smart filter will be used. May be edited. -
How this run is to be executed
Only those options that are applicable to the tests selected will be available. -
Platform
Determined from your default settings. Multiple platforms may be selected -
Location
Determined from your default settings but is editable
Run Groups
For a specific Run Group
-
Name
Set to the name of the run group but may be edited. -
How this run is to be executed
Set to the run group method. If the method is not valid, will default to the next best method but may be edited if multiple options are available. -
Platform
Set to the run group platform defaults but may be edited. -
Location
Set to the run group location default.
Viewing Test-Level Run Settings
Select View All Tests link to see the test level run settings being used (when applicable).




Items to note
We have removed features that were not well utilized to make the run test dialog more useful and efficient
- Ability to apply Run Group settings to arbitrary set to tests
- Ability to enable desktop notification
- Time/duration estimate at run creation has been removed. Actual run time/duration information will be shown at the completion of the run.
If you have any questions, please feel free to reach out to us at [email protected] or through Intercom!
Updated 2 months ago