Metric Types

Zephyr automatically calculates and creates these high level Release/Iteration level metrics out-of-the-box. These are created for every Release:

 

  1. Test Case Distribution in Phase

  2. Test Case Created by User

  3. Test Case Execution Progress

  4. Test Case Execution Progress by User

  5. Defects Total by Resource

  6. Defect Backlog by Assignee

  7. Overall Defect Distribution by Component

  8. Overall Defect Distribution by Status

 

All metrics are updated live based on activity that occurs in Zephyr. Each of these metrics have a detailed view that is displayed when it is clicked on. Most metrics can be drilled down to the next several levels thereby showing a whole new metric.

1. Test Case Distribution in Phase

This metric displays the number of testcases that are present in the entire release/iteration and the initial view shows it distributed over the root-level Phases created in the Repository Setup and Testcase Creation applications. Clicking on a particular phase will drill-down to the next level which would be the details by System and so on. The testcases are stacked by Manual and Automated. This allows the tracking of what % the entire test repository is automated with drill-down capabilities into individual areas.

 

 

Selecting the check box will allow this metric to be displayed in the Project/Release Dashboard.

2. Test Case Created by User

This metric displays the number of testcases that are present in the entire release/iteration and the initial view shows it distributed the users who created them in the Repository Setup and Testcase Creation applications. Clicking on a particular user will drill-down to the next level which would be the details by System and so on. Again, this is stacked by Manual and Automated. This can also be used to track how many automation scripts a user has created or completed.

Selecting the check box will allow this metric to be displayed in the Project/Release Dashboard.

3. Test Case Execution Progress

This metric displays the test execution progress of the entire release/iteration and the initial view shows it distributed over the cycles created in the Testcase EAS application and testcases executed in the Testcase Execution application. Clicking on a particular cycle will drill-down to the next level which would be the details by Phase/System/Sub-system and so on. The status that is displayed is color coded with Unexecuted, Pass, Fail, WIP (Work in Progress) and Blocked. Drilling on each chart shows summaries and data tables with % of Unexecuted and P/F/WIP/B tests. This is realtime information that gets updated and calculated as Testers and Leads are working on the execution cycle(s).

Selecting the check box will allow this metric to be displayed in the Project/Release Dashboard.

4. Test Case Execution Progress by User

This metric displays the test execution progress for each user and the initial view shows it distributed over the various users and testcases executed in the Testcase Execution application by them. Clicking on a particular user will drill-down to the next level which would be the details by Cycle/Phase/System/Sub-system and so on. The status that is displayed is color coded with Unexecuted, Pass, Fail, WIP (Work in Progress) and Blocked. Drilling on each chart shows summaries and data tables with % of Unexecuted and P/F/WIP/B tests. This is realtime information that gets updated and calculated as Testers and Leads are working on the execution cycle(s).

 

 

Selecting the check box will allow this metric to be displayed in the Project/Release Dashboard.

5. Defects Total by Resource

This metric displays the total number of defects filed by each resource in the system. These numbers are further broken down to by the number of priority defects (P1, P2, P3 etc.)

 

 

Selecting the check box will allow this metric to be displayed in the Project/Release Dashboard.

6. Defects Backlog by Assignee

This metric displays the total number of defects owned by each user in the system that are in further grouped by their priorities (P1, P2, P3 etc.). Backlogs are defects that are in the statuses of Assigned + Reopened.

 

 

Selecting the check box will allow this metric to be displayed in the Project/Release Dashboard.

7. Overall Defect Distribution by Component

This metric displays the total number of defects by Components with the initial view across all Components in that Project. Each of the Components are also grouped by status (New, Resolved, Reopened etc.). Clicking on a component drills-down to the next level details for that component showing the various different statuses, all grouped by the priorities of defects.

 

 

Selecting the check box will allow this metric to be displayed in the Project/Release Dashboard.

8. Overall Defect Distribution by Status

This metric displays the total number of defects by Status with the initial view across all Statuses in that Project. Each of the statuses are also grouped by priority (P1, P2, P3 etc.). Clicking on a status drills-down to the next level details for that status showing the various different priorities.

 

 

Selecting the check box will allow this metric to be displayed in the Project/Release Dashboard.

Exporting Metrics

Metrics data can be exported by clicking on the "Export" button in the Detailed Metrics view. The chart is saved as a JPEG, the summary as TXT and the data table as an Excel file.