Prior upper cervical spine injury classification systems have focused on injuries to the craniocervical junction (CCJ), atlas, and dens independently. However, no previous system has classified upper cervical spine injuries using a comprehensive system incorporating all injuries from the occiput to the C2-3 joint. To (1) determine the accuracy of experts at correctly classifying upper cervical spine injuries based on the recently proposed AO Spine Upper Cervical Injury Classification System (2) to determine their interobserver reliability and (3) identify the intraobserver reproducibility of the experts. International Multi-Center Survey. A survey of international spine surgeons on 29 unique upper cervical spine injuries. Classification accuracy, interobserver reliability, intraobserver reproducibility. Thirteen international AO Spine Knowledge Forum Trauma members participated in two live webinar-based classifications of 29 upper cervical spine injuries presented in random order, four weeks apart. Percent agreement with the gold-standard and kappa coefficients (ƙ) were calculated to determine the interobserver reliability and intraobserver reproducibility. Raters demonstrated 80.8% and 82.7% accuracy with identification of the injury classification (combined location and type) on the first and second assessment, respectively. Injury classification intraobserver reproducibility was excellent (mean, [range] ƙ=0.82 [0.58-1.00]). Excellent interobserver reliability was found for injury location (ƙ = 0.922 and ƙ=0.912) on both assessments, while injury type was substantial (ƙ=0.689 and 0.699) on both assessments. This correlated to a substantial overall interobserver reliability (ƙ=0.729 and 0.732). Early phase validation demonstrated classification of upper cervical spine injuries using the AO Spine Upper Cervical Injury Classification System to be accurate, reliable, and reproducible. Greater than 80% accuracy was detected for injury classification. The intraobserver reproducibility was excellent, while the interobserver reliability was substantial.

Study Design.: Global cross-sectional survey. Objective.: To determine the classification accuracy, interobserver reliability, and intraobserver reproducibility of the AO Spine Upper Cervical Injury Classification System based on an international group of AO Spine members. Summary of Background Data.: Previous upper cervical spine injury classifications have primarily been descriptive without incorporating a hierarchical injury progression within the classification system. Further, upper cervical spine injury classifications have focused on distinct anatomical segments within the upper cervical spine. The AO Spine Upper Cervical Injury Classification System incorporates all injuries of the upper cervical spine into a single classification system focused on a hierarchical progression from isolated bony injuries (type A) to fracture dislocations (type C). Methods.: A total of 275 AO Spine members participated in a validation aimed at classifying 25 upper cervical spine injuries through computed tomography scans according to the AO Spine Upper Cervical Classification System. The validation occurred on two separate occasions, three weeks apart. Descriptive statistics for percent agreement with the gold-standard were calculated and the Pearson χ² test evaluated significance between validation groups. Kappa coefficients (κ) determined the interobserver reliability and intraobserver reproducibility. Results.: The accuracy of AO Spine members to appropriately classify upper cervical spine injuries was 79.7% on assessment 1 (AS1) and 78.7% on assessment 2 (AS2). The overall intraobserver reproducibility was substantial (κ=0.70), while the overall interobserver reliability for AS1 and AS2 was substantial (κ=0.63 and κ=0.61, respectively). Injury location had higher interobserver reliability (AS1: κ = 0.85 and AS2: κ=0.83) than the injury type (AS1: κ=0.59 and AS2: 0.57) on both assessments. Conclusion.: The global validation of the AO Spine Upper Cervical Injury Classification System demonstrated substantial interobserver agreement and intraobserver reproducibility. These results support the universal applicability of the AO Spine Upper Cervical Injury Classification System. Level of Evidence: 4