Written by ICAO Doc 995, AN/497. First Edition (2013).
Source: ICAO on Skybrary.
The ICAO Manual of Evidence-Based Training (Doc 9995, 1st Edition, 2013) is a foundational reference that formalises Evidence-Based Training (EBT) as an alternative, performance-centred approach to traditional recurrent pilot training and checking. It provides guidance for Civil Aviation Authorities, operators, and approved training organisations on implementing EBT in accordance with ICAO standards and recommended practices, particularly within Annex 6 and PANS-TRG.
The manual defines EBT philosophy and methodology, emphasising data-driven identification of core pilot competencies, recurrent assessment based on operational evidence, and scenario-based training designed to reflect real-world threats and errors rather than isolated manoeuvres. It outlines principles for training programme structure, instructor qualifications, performance measurement, and ongoing evaluation to ensure training effectiveness and continuous safety improvement.
Significant topics include the rationale for EBT, integration with competency-based training and assessment, roles of evidence and operational data in shaping curricula, and guidance on establishing and monitoring EBT programmes. As the first ICAO document dedicated to EBT, it matters because it provides a globally harmonised framework that helps shift training from prescriptive task lists to competency outcomes grounded in operational experience, enhancing both flight crew proficiency and overall aviation safety.
How does it fit into the CBTA framework?
The ICAO Manual of Evidence-Based Training (Doc 9995, 1st Edition) fits squarely within the Competency-Based Training and Assessment (CBTA) framework by operationalising CBTA principles specifically for recurrent and type-rating pilot training.
CBTA shifts the focus of training from completing prescribed manoeuvres to demonstrating observable competencies required for safe operations. EBT is ICAO’s practical application of CBTA in airline training: it defines what competencies matter, how they should be trained, and how performance should be assessed using operational evidence. The manual aligns with CBTA by emphasising scenario-based training, graded performance standards, instructor calibration, and continuous programme evaluation.
Crucially, EBT uses operational data and safety intelligence to prioritise training content, ensuring competencies reflect real-world threats, errors, and performance risks. In this way, EBT translates CBTA from a conceptual framework into an implementable, regulator-accepted training system that supports consistent, measurable, and safety-driven pilot competency development.
What is its significance to CRM Training?
The manual is highly significant to CRM training because it embeds CRM competencies into a formal, data-driven, competency-based training and assessment system, moving CRM from “stand-alone soft skills” into the core of flight crew performance management.
Traditionally, CRM was often delivered as classroom-based training with limited, indirect linkage to line operations or assessment. EBT changes this by explicitly incorporating non-technical skills—such as communication, leadership and teamwork, workload and stress management, situational awareness, and decision-making—into observable, assessable competencies exercised in realistic operational scenarios. CRM behaviours are no longer taught in isolation but are evaluated alongside technical performance during normal and abnormal operations.
EBT also strengthens CRM by using operational evidence (e.g. LOSA, incident data, and safety reports) to target the CRM behaviours that matter most in actual operations. This ensures CRM training remains relevant, risk-based, and aligned with current threats. In effect, Doc 9995 provides CRM with structure, credibility, and accountability, positioning CRM as a measurable safety intervention rather than a purely cultural or awareness-based programme.
Contents Overview
Part I – EBT Development & Programme Outline
- Background and rationale – Why evidence-based, historical context of pilot training evolution
- Principles and programme philosophy – Core EBT concepts and training philosophy
- Competencies and framework – The competency model (technical & non-technical) and behavioural indicators
- Evidence and data sources – Use of operational and safety data to inform training priorities
Part II – EBT Programme Guidance
- Programme design and approval – Structuring EBT modules, instructor qualifications, and regulatory considerations
- Training phases – Evaluation phase, manoeuvre retention, and scenario-based training
- Assessment and conduct of sessions – How to assess competencies and conduct scenarios
Appendices
- Competency framework tables and behavioural indicators
- Example scenario elements and topic groupings