The New Run dialog box works similarly for any type of run you are executing.
The following configuration options are available for all run types:
of the run
- How this run is to be executed
Either through our Automation Service, the Tester Community, the AutomationService + Test Community or On-Premise Testers if available. Only applicable options are shown. See Executing tests for more information
Where the test will run
Platform(s) you wish to use to execute the test.
Note: For Draft runs - only a single platform may be selected, all other runs can request multiple platforms.
The Additional Options allow you to further configure how you want to run your test(s)
- Where should your traffic be routed through?
See Executing your tests using specific Geolocations for more information
- Should this run be tied to your release process?
Usually a git SHA or custom version number
- Use individual test settings for this run
will be available for those runs that contain multiple tests and for those clients that have this option available.
Note: Platform and location will default to either the Test’s own Test-Level Run Settings or your default settings if not enabled. See Test-Level Run settings for more information.
The Run Test Dialog has been updated based on the type and number of tests you are running. The four types of runs are:
- Single Draft Tests
- Single Published Tests
- Multiple Selected Tests
- Run Groups
The Run Test Dialog acts slightly differently according to the type of test run being requested.
For tests that are in a draft state:
Set to the test name of the single test selected and is non-editable
Only one platform may be selected
Note: Results will be displayed on the Draft Runs page
For a single published test (not in Draft or Disabled state)
Set to the test name of the single test selected and is editable
Multiple platforms may be selected
For several tests selected for a run:
Set to the first test name and count of additional tests selected. If a single Feature Group or smart filter has been selected, the name of the feature or smart filter will be used. May be edited.
How this run is to be executed
Only those options that are applicable to the tests selected will be available.
Determined from your default settings. Multiple platforms may be selected
Determined from your default settings but is editable
For a specific Run Group
Set to the name of the run group but may be edited.
How this run is to be executed
Set to the run group method. If the method is not valid, will default to the next best method but may be edited if multiple options are available.
Set to the run group platform defaults but may be edited.
Set to the run group location default.
Select View All Tests link to see the test level run settings being used (when applicable).
We have removed features that were not well utilized to make the run test dialog more useful and efficient
- Ability to apply Run Group settings to arbitrary set to tests
- Ability to enable desktop notification
- Time/duration estimate at run creation has been removed. Actual run time/duration information will be shown at the completion of the run.
If you have any questions, please feel free to reach out to us at [email protected] or through Intercom!
Updated 5 months ago