Reports are an important part of your testing process. PractiTest’s Reports Engine module helps you create reports with the use of professionally-predefined templates and takes advantage of the filter and field customizations you already use as part of your regular process.

The Report Engine Module offers unique options:

- Schedule reports on a daily, weekly, or monthly basis.
- Decide which users will receive the report by email.
- Modify report columns and graphs according to your needs.
- Re-run a report instantly with one click.
- Update report definition, rerun it, and update information with old data based on time created.

Page Table of Contents

Accessing the Report Center
Report Types
Creating & Editing Reports
Test, Test Set and Last Run fields in Instances Reports
Tabular Aggregated Report

Accessing the Report Center

To access your existing reports or create new ones, click the reports menu item from the settings panel on the left.

Accessing the reports center

Once in the Report Center, you can see all the reports already available in your project.
For each report, you can see all its relevant information. For example:
– Entity (Requirement/Test/Test Set/Instance/Issue/Run) and report type
– Name
– Report format (Excel and PDF)– Report owner (author)
– The filter used to create the report
– Created - report creation date
– Actions:

Under this section, you have a number of options:

Creating a New Report

  • The lightning icon - to re-run the report on the latest data. When pressing this - the old report will be saved under the new one as shown below.
  • The cloning icon - to duplicate the report.
  • The edit icon - to edit the report.
  • The trash can icon - to delete the report.

After making modifications to a specific report definition, the previously ran versions of this report will have a new cycle icon next to them. By pressing this cycle icon, you can rerun the report (with the new edited definitions) based on old data (at the time they were created).

rerun report on old data

When you create a new report it is generated and stored for future reference. This means that you can create reports not only to display the current status of your project but also to serve as snapshots to be accessed for future reference and auditing purposes.

Report Types

You can generate reports for each of your entities: Issues, Tests, Test Sets, Instances, and Requirements; and based on 4 different templates, providing distinct perspectives into your project.
1. Tabular Report – displaying a data tab with all the information based on the selected filter with a summaries tab including charts for illustrating the data.
2. Detailed Report – providing all the information for the entities based on the chosen filter.
3. Tabular With Steps – (Available for Tests and Test Instances) Tabular report for tests that includes steps names, descriptions, and expected results in the data tab, a summaries tab including charts for illustrating the data, and an issue tab including all issues information based on the scope of the report.
4. Tabular Aggregated Report – (Available only for Instances) providing all the information for tests across multiple test sets based on any list fields in your test instances.
5. Tabular Traceability Report – (Available only for Requirements) providing a traceability overview - the coverage of requirements by tests, test sets that contain each test, and issues that were created from each test instance.

Creating & Editing Reports

After pressing the 'New Report' button, you will see the below screen:

create new report

Choose the entity for the report; Issues, Tests, Test Sets, Runs, Instances, or Requirements, and the type of report you want to generate (Tabular, Tabular with steps, Detailed or Tabular Aggregated).

By pressing a report you will get to a description window that explains and shows the report type you chose. For example, this is the description for the Requirement traceability report:

Requirement treacibility report description

If this is the report you intended to create - press “I want this report” You can always go back to the screen presenting all report options by pressing “Choose a different report”.

When creating or editing reports, you can schedule reports to run on a Daily, Weekly, or Monthly basis, and determine who should be notified when the report is ready in the “Report Settings” section.

report settings

For each of your reports, you should provide a descriptive name that will help you understand the information stored in it. Try not using generic names such as “Issues Report” since other people, or even you in the future, will not be able to differentiate between your existing reports.

After choosing your report, you will get to a screen where you can customize the report according to your needs. First, choose the filter you want to use on your data for this report.

filter report

In case you are creating a report for an Instance entity, you will be able to select an additional filtering option allowing you to filter by Run Status.

instance tabular with steps filtering

For Tabular reports, you can decide which fields and charts you want to include in your report.

define fields and charts

Test, Test Set, and Last Run fields in Instances Reports

When creating an instance report of the type ‘Tabular’, ‘Tabular With Steps’, or 'Tabular Aggregated', you can select to show fields from the Test, Test Set, or Run level.

  • Fields from the Run level will show the information based on the Last Run of the instance.
  • Test level fields will show the information from the field in the original Test in the Test Library.
  • Test Set level fields will show field information from the Test Set in which the relevant Instance resides.

The following example is an Instance report of the type Tabular Summary. The selected fields are: the ‘Build’ field from the Run level, the ‘Test Level’ field from the Test Level, and the ‘Sprint’ field from the Test Set level, in addition to the ‘Run Status’, ‘Tester’ and ‘ID’ fields from the Instances level.

Test, Test Set and Run level fields in Instances reports

As you can see from the example, fields from different modules will start with the module’s name in Instances report selection. The ‘Sprint’ field from the Test Set level shows as ‘TestSet: Sprint’, ‘Build’ field from the Run level will show as ‘LastRun: Build’, etc.

Tabular Aggregated Report

(Available on Instances and Runs only)

The Tabular Aggregated report can be created for 2 purposes:

1. Compare your aggregated results of the same instances over different runs.

2. Analyze instances of aggregated results based on different parameters.

There are 2 preconditions to get this Report:

1. You need to have the custom fields that you like to analyze in the report within your instances' custom field (this is easy to do if you use the Batch Edit button). Please see the image below.

Custom fields for a tabular aggregated report
2. Your custom fields format must be of type List or Linked List.
Custom fields' types for the tabular aggregated report
When you create a Tabular Aggregated Report you have two options:

1. You can create a report choosing X Field only. Thus the tabular aggregated report will automatically aggregate the test instances on the y-axis based on their parent tests from the Test Library.
2. You can choose both X Field and Y Field, hence the report will aggregate the test instances based on these two fields.

tabular aggragated report

For more information on the Tabular Aggregated Reports, please visit this page.

Learn more about PractiTest Dashboard and how to create charts and graphs that provide an informative overview for your project.
<< Previous
All articles
Next >>