Evaluating the Quality of a Root Cause Analysis Investigation
Blog

Evaluating the quality of a root cause analysis investigation

Root Cause Analysis (RCA) is a structured methodology designed to uncover the underlying causes of adverse events or failures with the ultimate goal of preventing recurrence. While the effectiveness of an RCA is ultimately measured by whether its solutions eliminate the problem, assessing the quality of the investigation itself is equally important. A well-executed RCA increases the likelihood of generating effective, sustainable solutions and builds confidence in the process across the organization.

 

Why Audit RCA Investigations?

Auditing an RCA involves a methodical review of its structure, logic, and outputs. The Cordant™ RCA methodology emphasizes evidence-based analysis, causal clarity, and solution relevance. By applying a consistent set of evaluation criteria, organizations can ensure that RCA investigations are not only technically sound but also aligned with operational goals and capable of driving meaningful change.

 

Defining RCA Quality: Beyond Recurrence Prevention

While the ultimate success of an RCA lies in preventing recurrence, this outcome may take years to validate, especially for low-frequency events. Therefore, interim assessments must focus on tangible indicators of investigative quality. These include adherence to process principles, clarity of causal logic, completeness of analysis, and the strength of supporting evidence.

The Cordant method defines RCA as “a structured process used to understand the causes of past events for the purpose of preventing recurrence.” This definition underscores the importance of both process fidelity and outcome effectiveness.

 

Criteria for Auditing RCA Investigations

The following criteria provide a robust framework for evaluating RCA quality. These are consistent with Cordant’s principle-based approach and can be used to develop audit checklists and scoring templates.

1. Causal Statement Integrity

Binary Language: Cause statements should be concise and unambiguous, typically expressed in noun-verb format (e.g., “valve failed”). Avoid vague adjectives like “poor” or “inadequate.”

No Conjunctions: Statements containing “and,” “but,” “because,” or “if” may conflate multiple causes and should be revised for clarity.

2. Evidence-Based Validation

Each cause must be supported by valid, documented evidence. Unsupported causes risk leading to ineffective or misdirected solutions.

3. Logical Structure and Process Alignment
  • Space-Time Logic: Causes must co-exist in time and location with the effect.
  • Causal Logic: Removing a cause should eliminate the effect. If not, the cause may be irrelevant or misclassified.
  • Principle Conformance: The chart should reflect the four causation principles:
    • Causes and effects are interchangeable.
    • Causes exist in a continuous chain.
    • Each effect has both an action and a condition.
    • Effects only occur when causes align in space and time.
4. Branch Completion and Termination

Each causal path should end with a valid stop condition:

  • Desired Condition: No further inquiry needed.
  • Lack of Control: External constraints (e.g., laws of physics).
  • New Primary Effect: Requires separate RCA.
  • Action Item: More information needed.
  • Alternative Path More Productive: Redirect analysis.

Unfinished branches or unresolved questions indicate incomplete analysis and should be flagged for follow-up.

5. Solution Quality and Relevance
  • SMART Criteria: Solutions should be Specific, Measurable, Actionable, Relevant, and Timely.
  • Avoid vague verbs such as “investigate,” “review,” or “analyze” unless paired with concrete actions.
  • Solutions must directly address identified causes and be judged against standardized criteria to ensure objectivity.
  • Each solution should be assigned to a responsible party with a clear due date.
6. Report Clarity and Executive Relevance

RCA reports should be concise, well-structured, and tailored for executive review. Key elements include:

  • Problem definition and significance (e.g., cost, safety impact).
  • Brief causal summary.
  • Actionable solutions with timelines and expected outcomes.
  • Implementing an RCA Audit Framework

To ensure consistency, organizations should develop a scoring system based on the criteria above. A typical scale might range from 0 to 5:

0 – Does not exist

1 – Present but incorrect

2 – Partially correct

3 – Mostly correct

4 – Nearly complete and correct

5 – Fully correct and complete

Include reviewer notes to explain partial scores and calibrate scoring across auditors to minimize variability.

While structured criteria provide a strong foundation for auditing RCA investigations, it is important to recognize that human judgment plays a critical role. Even when an RCA meets all formal requirements, it may still contain flaws, particularly if the logic is sound but the causes are incorrect. These errors can stem from investigator inexperience, time constraints, biases, or language barriers. Therefore, a final integrity review by a qualified individual (whether internal, external, or a contractor) is essential to identify issues that automated checks may miss.

To further enhance consistency, RCA audits should be calibrated across reviewers. This can be achieved by assigning audits to a single individual, conducting group scoring sessions, or training auditors to align on scoring nuances. Such practices ensure that each RCA is measured against a repeatable standard, reducing subjectivity and improving the reliability of the audit process.

By embedding these principles into your RCA program, it enables organizations to elevate the quality and impact of investigations, ensuring that solutions are not only well-reasoned but also effective in preventing recurrence.