Release Readiness Index

Release Readiness Index (RRI) transforms fragmented testing data into a clear, actionable answer to a critical question: are we ready to release?  It is the first in a series of Opinionated Quality Models that will be included within PractiTest, and among the first-ever opinionated models in a QA Management System.

QA teams generate large volumes of data across requirements, test execution, and defects, but translating that data into a confident release decision remains challenging. RRI addresses this gap by combining key quality signals into a single, opinionated score that reflects both current progress and remaining risk.

Instead of relying on multiple dashboards, disconnected metrics, and manual interpretation, RRI provides a continuous, milestone-based view of release readiness, helping teams understand where they stand and what needs attention as they approach release.

Note: Release Readiness Index is currently in Public Beta for Team and Corporate accounts only.

How Release Readiness Index Works

The Release Readiness Quality Index is a composite score that combines multiple quality signals into a single, structured indicator of release readiness.

RRI is calculated based on three core components:

  • Coverage Confidence Score (CCS)
  • Execution Confidence Score (ECS)
  • Remaining Defect Risk Score (RDRS)

Each component is normalized to a 0–1 range and combined using weighted aggregation to produce the final RRI score.

The score is aligned with the milestone timeline, dynamically shifting the weight of each component based on the current phase of the milestone. This allows the index to reflect what matters most at each stage and helps teams understand whether they are progressing as expected.

Viewing the Release Readiness Index

The Release Readiness Index is available within the Milestones module, where each milestone displays its own RRI card.

The RRI is a score, normalized to a 0–1 range, providing a clear indication of the current release readiness.

Alongside the main score, the card includes:

  • The individual component scores:
    • Coverage Confidence Score (CCS)
    • Execution Confidence Score (ECS)
    • Remaining Defect Risk Score (RDRS)

A planned vs. actual progress graph, showing how the current readiness score compares to the expected linear progress based on the milestone timeline.

Release Readiness Index

RRI Behavior as Part of the Milestone’s Lifecycle

  • RRI is calculated only for active milestones based on start and end dates
  • For milestones that became active after RRI was enabled and later completed, the final RRI value is displayed as a snapshot
  • Upcoming milestones do not display RRI until they become active

Note: Historical milestones that were already completed before RRI was enabled, do not display an RRI score. In these cases, the score will appear as N/A.

Understanding the RRI Components

Coverage Confidence Score (CCS)

Measures how well testing aligns with the scope of delivery within the milestone. CCS reflects whether the requirements included in the milestone are properly covered by tests and whether those tests are being executed as expected.

This metric tracks the effectiveness of testing in identifying risks associated with User Stories. As coverage and validation improve, risk decreases and the score rises. Clicking the CCS score opens the Requirements tab within the milestone.

Takes into account:

  • Requirements included in the milestone
  • Linked tests
  • Execution progress of those tests

Note: Linked tests are those that are directly linked to the requirement via its traceability tab, and not specifically via the milestone

A high CCS indicates that:

  • Most requirements are covered by tests
  • Linked tests are actively being executed

A low CCS may indicate:

  • No or low requirement coverage by tests
  • Requirements that have not yet been tested
Execution Confidence Score (ECS)

Measures how much planned testing has been completed and how stable the results are. ECS reflects whether testing is progressing as expected and whether the results provide reliable confidence in the system’s behavior. Clicking the ECS score opens the Test Sets tab within the milestone.

Takes into account:

  • Instances that are part of Test Sets in the milestone
  • Planned vs. executed tests
  • Instances execution statuses (each status effect differently on the score)

A high ECS indicates that:

  • Most planned tests have been executed
  • Execution results are positive

A low ECS may indicate:

  • A gap between planned and executed testing
  • Delays in execution progress
  • Failed test results
Remaining Defects Risk Score (RDRS)

Measures the remaining risk based on unresolved defects. RDRS reflects how much risk is still present in the system, taking into account not just the number of open issues, but also their priority and impact on tested functionality. Clicking the RDRS graph opens the Issues tab within the milestone.

Takes into account:

  • Open issues (based on status, excluding those under closed)
  • Issue priority (based on the field in PractiTest, higher priority issues reducing the score more)
  • Milestone scope, as reflected by the number of requirements included

A high RDRS score indicates:

  • Low remaining and expected risk
  • Most defects are resolved or have limited impact

A low RDRS score may indicate:

  • A high number of unresolved defects
  • Showstopper or high-priority issues still to be closed

How the Main RRI Score Is Calculated

RRI is calculated by combining all three components, with dynamic weighting based on a milestone phase.

The milestone timeline is divided into three phases:

  • Early phase: Higher weight on Coverage (CCS)
  • Middle phase: Higher weight on Execution (ECS)
  • Final phase: Higher weight on Defect Risk (RDRS)

This ensures the score reflects what matters most at each stage of the release cycle.

Interpreting the RRI Score

The RRI score is presented as a gauge and ranges from 0 to 1.

The score label changes according to the milestone lifecycle stage. In the early and middle phases of the milestone, the label reflects whether the milestone is progressing as expected. In the final phase, the label reflects release readiness.

Early and Middle Phases

Score RangeColorScore Label
0–0.50RedNeeds Attention
0.51–0.75YellowNeeds Attention
0.76–1GreenOn Track

Final Phase

Score RangeColorScore Label
0–0.50RedOff Track
0.51–0.75YellowNeeds Attention
0.76–1GreenReady

Planned vs. Actual Progress Graph

Alongside the RRI score, a progress graph compares:

  • Expected linear progress based on milestone timeline
  • Actual progression of your milestone

This helps identify whether the team is:

  • Ahead of schedule
  • On track
  • Behind expected readiness

Note: The graph displays a maximum of 30 days. For milestones longer than 30 days, only the most recent 30-day period is shown based on the milestone timeline.

Using RRI to Support Release Decisions

RRI is designed to help teams assess release readiness, identify areas that need attention, and support release discussions with a clear, shared reference point. Use it to:

  • Quickly assess release readiness without analyzing multiple KPIs and reports
  • Identify which areas might require attention:
    • Coverage gaps
    • Execution delays
    • Unresolved defect risk
  • Track progress throughout the milestone lifecycle
  • Align release discussions around one clear readiness indicator

Additional Resources

Watch the full live training session about Milestones and Release Readiness Index:

Share

See it on your workflow, with your tools.