Test Set permutations is a great feature when you want to test the same test sets and instances multiple times, for example when you are supporting a large number of platforms, languages or even configurations.
In this case you want to be able to take one or a small number of test sets, and create multiple test sets for each of the different combinations you wish to test.
Creating a Test Set permutation
*Note: Permutations can only be created on existing TestSets, so if you have a new empty project you must first create at least one TestSet.
1. Start in the Test Sets and Runs module and select the Test Set you would like to duplicate, and then select ‘Create Permutations’ in the grid menu above.
(you can choose both multiple Test Sets or just a singular Test Set).
2. The next screen will present all existing Test Set List Fields of your custom fields and system fields.
Select the checkbox next to the field name to create permutations based on field value.
Unchecked values will be ignored.
3. After you have selected all the values, click ‘next’.
4. On the following screen you will see all the possible permutation combination from the fields you selected. Confirm all or only a number of the relevant permutations.
5. Before you finish, you can also define an existing filter under which these permutations should appear, otherwise by default, all permutations will be created and placed under “AllTestSets” in the filter tree.
The resulting test sets will have the same name as the original one, but with the addition of the permutations at the end of them. For example: “Feature 123 – Windows;IE”
Note: There is a max limit of 500 permutations combinations.
6. Click ‘Finish’ > and you’ll be returned to the Test Sets and Runs module where your new Test Set permutation/s and their designated filter will appear.
You will also receive a confirmation email regarding your project changes.