How to Use Test Runs

Prepare the workload for the testers by assigning Test Cases and Users into Test Runs.

Test runs contain a set of test cases to be tested by one or more testers in a specific timeframe. Test runs allow you to assign individual test cases to testers who will be able to execute them. Test runs let testers know the tests they need to perform as well as the order and time tests have to be finished within. This feature is essential for planning your tests as well as monitoring its’ progress. 

Each test run is part of a milestone that provides a range of time for all work to be completed in, perfect for sprints, new project releases, or updates. The test runs can be assigned to different testers to prepare the workload for the testers and avoid questions of who is in charge of testing what cases.

Before You Begin

Make sure you've created one or more milestones before you proceed.

Test Runs Overview

Test runs are created as part of a milestone. Click Plan in the navigation menu and then select the milestone name or right arrow button to see the list of related test runs.

Add a Test Run

Test runs are created as part of a milestone. In order to create a new test run, first open the milestone and then click the Add Test Run button in the top right corner. A wizard will appear with the required and optional fields for the new test run. There are four steps in creating a new test run: Details, Test Cases, Users and Options. 

Step One: Details

• Name: Choose something that easily summarizes the tests you plan to run. This is a required field.
• Period: This is a required field that establishes the dates the test run is available for testers to run. Click the field to open the calendar and select both the start and end date to create the range of availability for testers. Remember to consider the milestones end date when selecting this period.
• Environment: Click to see a dropdown of all the environments for your project. This is an optional field for if you are testing in different test environments, browsers or operating systems. If you do not see the environment you need, create a new environment to be added to the dropdown.

If you have defined custom fields for test runs, they will show up here when the Show on Form option is enabled. You can manage your custom fields for test runs in the Custom fields section in the project settings.

When you have finished with the details step, click the green Test Cases button to go to the next step.

Step Two: Test Cases

The test cases step allows you to assign the test cases to a test run. The test cases from your entire project will be available to select from so you may want to filter the test cases to locate the ones you want.

• Filter Test Cases: To filter test cases, click the filter icon in the top left. Use the dropdowns to select the Test Suite, Requirements, Risks, Applications or Tags you want to filter by. 

• Add Test Cases to a Test Run: Once you have located your desired test cases, you have to actually add them to your test run. The default shows 5 test cases per page in the wizard, you can adjust this however to 15, 25, 50 or 100 if you want to assign a larger batch of test cases.
  • To add an individual test case, click the plus icon to the right. 
  • To add all of the displayed test cases to a test run, click the list icon in the header of the test case list. 
  • Test cases can easily be removed from a test run by clicking the cross to the right.§1
• Order Test Cases in a Test Run: Sometimes test cases need to be run in a specific order. Once you have added test cases to a test run, click the three horizontal lines to the left of a test case and drag the test case up or down in the list to change its order position.

When you have finished with the Test Case step, click the green Users button to go to the final step.

Step Three: Users

The users step allows you to assign the tester in charge of executing a test run. To add an individual user, click the plus icon to the right. To add all of the displayed users to a test run, click the list icon in the header of the user list. 

Step Four: Options

The options step provides some additional configuration options that are available for your test run:

• Priority: Toggle the switch to have the test run marked as a high priority with a red exclamation mark. Priority test runs should be done first when testing.
• Subscribers: Select one or more users to keep them informed about this run. They will receive a notification once the run has been completed. This is particularly useful for dependent test runs, where a tester of another test run can only start once this one is finished.

When you have finished with the options step, click Add to create the new test run. 

Update a Test Run

You can update a test run in both the sidebar view of the test run and on the detail page. In both views, you can update the basic fields, test cases and users of the test run. 

To see the sidebar view of a test run, click anywhere in the test run row and a panel with the test run information will popup on the right. To see the detail page for a test run, click on the code or right arrow and a new page will open with the test run information. To update the information:

1. Hover over a field and click the pencil edit icon.
2. Click the save icon by each field to keep the changes made.

Clone a Test Run

Test runs can be easily reused by cloning them. Cloning a test run allows you to schedule previously completed tests within the same milestone. You can clone a test run from the overview page and from the detail page. 

On the overview page:

1. Click the three dots in the test run row and select Clone.
2. A popup will give you the option to name the duplicate test run, set a new date range for the tests, select a test environment and set the test run priority. When you’re done, the newly cloned test run will appear in the bottom of the overview page.

On a test run detail page:

1. Click Clone in the top right of the page.
2. Fill out the resulting popup with the information for your new test run.

Delete and Restore

To delete an individual test run: 

1. Open a test run detail page and click the three dots in the top right corner.
2. Choose Delete and confirm you want to delete this test run.

If you deleted a test run by accident, you can easily restore the data:

1. Click the three dots in the top right corner of the test run overview page, and then click on Restore test runs. A list of all trashed test runs displays.
2. Locate the test run you want to restore and click the arrow button.
3. Click Restore in the confirmation box and the restored test run now displays on the overview page again.

Batch Update Test Runs

Using multi-select, you can quickly update or delete several test runs at once:

1. Use the check box next to the test run's code to select the run as part of your batch update.
2. Select additional test runs, as needed. To select all, check the box in the table header.
3. Click the selected button in the toolbar: 

• • When you select Update, a pop-up box displays. In this section you can edit a test run's tags, start and end date.
    • There is also an option to batch update the end date of test runs using the Expire… options. You can update all of the selected test runs to end that week or month or the next week and month.
  • There are options to batch add or remove a Priority notice from the test runs in the select menu as well. 
  • When you click Delete all the selected test runs will be deleted.