Warning: mkdir(): Permission denied in /home/virtual/lib/view_data.php on line 81 Warning: fopen(/home/virtual/e-kjs/journal/upload/ip_log/ip_log_2024-03.txt): failed to open stream: No such file or directory in /home/virtual/lib/view_data.php on line 83 Warning: fwrite() expects parameter 1 to be resource, boolean given in /home/virtual/lib/view_data.php on line 84 Risk Analysis Index and Its Recalibrated Version Predict Postoperative Outcomes Better Than 5-Factor Modified Frailty Index in Traumatic Spinal Injury

Risk Analysis Index and Its Recalibrated Version Predict Postoperative Outcomes Better Than 5-Factor Modified Frailty Index in Traumatic Spinal Injury

Article information

Neurospine. 2022;19(4):1039-1048
Publication date (electronic) : 2022 December 31
doi : https://doi.org/10.14245/ns.2244326.163
1School of Medicine, New York Medical College, Valhalla, NY, USA
2Department of Neurosurgery, University of New Mexico Hospital (UNMH), Albuquerque, NM, USA
3Department of Surgery, University of New Mexico Hospital (UNMH), Albuquerque, NM, USA
Corresponding Author Christian A. Bowers Department of Neurosurgery, University of New Mexico Health Sciences Center, 1 University New Mexico, MSC10 5615, Albuquerque, NM 81731, USA Email: CABowers@salud.unm.edu
*Matthew Conlon and Rachel Thommen contributed equally to this study as cofirst authors.
Received 2022 May 1; Revised 2022 October 11; Accepted 2022 October 14.

Abstract

Objective

To assess the discriminative ability of the Risk Analysis Index-administrative (RAI-A) and its recalibrated version (RAI-Rev), compared to the 5-factor modified frailty index (mFI-5), in predicting postoperative outcomes in patients undergoing surgical intervention for traumatic spine injuries (TSIs).

Methods

The Current Procedural Terminology (CPT) and International Classification of Disease-9 (ICD-9) and ICD-10 codes were used to identify patients ≥ 18 years who underwent surgical intervention for TSI from National Surgical Quality Improvement Program (ACS-NSQIP) database 2015–2019 (n = 6,571). Multivariate analysis and receiver operating characteristic (ROC) curve analysis were conducted to evaluate the comparative discriminative ability of RAI-Rev, RAI-A, and mFI-5 for 30-day postoperative outcomes.

Results

Multivariate regression analysis showed that with all 3 frailty scores, increasing frailty tiers resulted in worse postoperative outcomes, and patients identified as frail and severely frail using RAI-Rev and RAI-A had the highest odds of poor outcomes. In the ROC curve/C-statistics analysis for prediction of 30-day mortality and morbidity, both RAI-Rev and RAI-A outperformed mFI-5, and for many outcomes, RAI-Rev showed better discriminative performance compared to RAI-A, including mortality (p = 0.0043, DeLong test), extended length of stay (p = 0.0042), readmission (p < 0.0001), reoperation (p = 0.0175), and nonhome discharge (p < 0.0001).

Conclusion

Both RAI-Rev and RAI-A performed better than mFI-5, and RAI-Rev was superior to RAI-A in predicting postoperative mortality and morbidity in TSI patients. RAI-based frailty indices can be used in preoperative risk assessment of spinal trauma patients.

INTRODUCTION

Traumatic spinal injury (TSI) includes injuries to the spinal cord, nerve roots, osseous structures, and discoligamentous components of the spinal column [1-3]. The main cause for spinal injury is blunt trauma, most commonly caused by motor vehicle accidents, followed by falls and sport injuries [1-3]. Spinal column injury can cause mechanical instability, impaired movements, and damage to neural structures can lead to partial or complete paralysis [1-3]. Among TSI, traumatic spinal cord injury (tSCI) is a subset, which leads to neurologic deficits secondary to traumatic injury [4]. The yearly incidence of TSI has been estimated to be 54 cases per 1 million people in the United States or about 17,810 new TSI cases each year [5]. Irrespective of TSI type, these injuries are a major cause of disability, with significant socioeconomic consequences [1-3].

While historically, TSI has been associated with average age in 40s and predominantly males, there has been a change in the epidemiological trends in recent years with an aging population, and the average of TSI continues to increase [1,5 6]. It has been predicted that major proportion of new TSI will occur in patients above 70 years of age [7], with similar projections for overall TSI [1,3]. It is imperative to perform risk stratification and to identify prognostic factors for TSI patients [8].

Frailty, a measure of physiological reserve, broadly defined as the cumulative burden of baseline comorbid conditions and functional status impairment, has been associated with worse postoperative outcomes across surgical subspecialties [9-13]. In recent years, several studies have assessed the impact of baseline frailty status on postoperative outcomes in patients undergoing spine surgery [14], though its application to spine trauma and TSI has been limited to 2 studies [15,16]. The lack of large scale, high quality, clinical studies on frailty and spine trauma has been emphasized before [17]. Furthermore, majority of previous studies on frailty and spine surgery outcomes have employed the modified frailty index-11 (mFI-11), or its abridged version, modified frailty index-5 (mFI-5) for preoperative frailty status assessment [14]. While the mFI indices have been classically used for frailty assessment, however mFI are more a measure of comorbidity rather than frailty. Though functional status has been commonly associated with the definition of frailty, the variables of diabetes, chronic obstructive pulmonary disease (COPD), hypertension, and congestive heart failure (CHF) are more commonly defined as comorbidities [18,19].

To more precisely incorporate the multifactorial nature of frailty, Hall et al. [20,21] developed the Risk Analysis Index (RAI) in 2017 in an effort to provide an effective screening tool to assess the frailty of surgical patients. This frailty index including both the prospective clinical RAI and the retrospective administrative RAI (RAI-A) could be easily calculated from variables captured by the Veterans Affairs Surgical Quality Improvement Program and the American College of Surgeons (ACS) National Surgical Quality Improvement Program (NSQIP) databases includes both comorbidities and functional status variables that robustly measures baseline frailty status, and has recently been validated in a prospective, single-center spine surgery study [22], and also by us in brain tumor resection patients [23]. Since its development the RAI has demonstrated significant utility in predicting 30-, 180-, and 365-day postoperative outcomes across multiple surgical subspecialties [20,21,24-28]. Recently, Arya et al. [24] have recalibrated and improved the original RAI (RAI-Rev) in order to better discriminate 30-day mortality and morbidity. Presently, there is a gap within the literature demonstrating the predictive utility of RAI-A and RAI-Rev within spine surgery, and, more specifically, in patients undergoing surgery for spinal trauma. The present study was performed to assess the predictive capability of RAI-A and RAI-Rev on 30-day postoperative outcomes in traumatic spine surgery patients utilizing large scale data from NSQIP. Based on the reported robustness of RAI-A and RAI-Rev in predicting postoperative outcomes in other surgical specialties, we hypothesized that RAI-A and RAI-Rev would be superior to the mFI-5 in predicting postoperative 30-day mortality and morbidity in patients undergoing surgery for spinal trauma.

MATERIALS AND METHODS

1. Data Source

The NSQIP is a nationally validated, multi-institutional database of over 700 participating hospitals with > 200 variables collected for pre-, intra-, and postoperative outcomes. Data are entered from each institution by ACS-trained surgical clinical reviewers to ensure consistency and reliability [29,30]. Our data were extracted from the NSQIP database for the years 2015 to 2019. The present study was performed under the data user agreement of the ACS with the University of New Mexico (UNM) and was approved by the Institutional Review Board of UNM School of Medicine (Study ID 21-315).

2. Patient Population and Baseline Characteristics

Current Procedural Terminology codes (Supplementary Table 1) were used to identify all patients over 18 years old that had undergone spine surgery in the NSQIP dataset. International Classification of Diseases (ICD)-9 and ICD-10 diagnostic codes were then used to identify spinal trauma patients (Supplementary Table 2). Forty-six patients were removed due to primary diagnosis codes unrelated to spinal trauma, and another 77 were excluded due to missing length of stay (LOS) duration. The final sample size of patients who underwent surgery for spinal trauma was 6,571. The baseline study variables included age, sex, body mass index (BMI), elective versus nonelective surgery type, LOS, transfer status, and operative time. The analyzed medical comorbidities included diabetes mellitus, COPD, CHF, dyspnea, hypertension, disseminated cancer (defined as multiple metastases by NSQIP), open wound, steroid use, weight loss (substantial unintentional weight loss > 10%), bleeding disorders, preoperative transfusion, transfer status, and preoperative sepsis/septic shock/systemic inflammatory response (SIRS). Preoperative SIRS criteria are defined by NSQIP as the presence of at least 2 of the following criteria: temperature > 38°C or < 36°C, heart rate > 90 beats per minute, respiratory rate > 20 breaths per minute or PaCO2 < 32 mmHg, leukocytosis or leukopenia (white blood cell count > 12,000/mm3 and < 4,000/mm3, respectively) or > 10% immature (band) forms, or anion gap acidosis [23,29]. Additional preoperative comorbidities extracted included functional dependence (both complete and partial dependence) and smoking status.

3. Retrospective Risk Analysis Index Scoring (RAI-A and RAI-Rev)

Retrospective RAI-A and the recalibrated RAI-Rev scoring, adapted from Hall et al. and Arya et al. are shown in Supplementary Table 3. RAI scoring system is based on 11 variables: sex, age, cancer diagnosis (excluding melanoma), weight loss defined as unintentional weight loss of 4.5 kg over 3 months, renal failure, CHF, poor appetite, shortness of breath at rest, residence defined as not independent living, cognitive deterioration, and activities of daily living (ADL) defined as functional status. Age scoring is related to having a cancer diagnosis, which can be seen in Supplementary Tables 4 and 5 for RAI-A and RAI-Rev, respectively. Cognitive deterioration over the past 3 months was originally included in Hall’s scoring method for RAI-A to be included with ADL scoring, however preoperative cognitive decline is not recorded in NSQIP and therefore was excluded from this study’s adaptation of Hall’s RAI-A scoring. Score stratification of RAI-A and RAI-Rev as they relate to frailty tiers is demonstrated in Supplementary Table 6 (nonfrail ≤ 10, prefrail 11–20, frail 21–30, and severely frail ≥ 31 RAI-A and RAI-Rev scores).

4. Modified Frailty Index-5 (mFI-5)

Although the modified frailty index was initially developed with 11 variables (mFI-11), in 2014, the NSQIP stopped mandating the reporting of some of the mFI-11 preoperative variables and as such the mFI-5 was adapted based on these 5 remaining variables: diabetes mellitus, hypertension, dependent functional status, COPD, and CHF (Supplementary Table 7). The presence of each mFI-5 variable receives one point. Thus, the mFI-5 scores range from 0 to 5, where a score of 0 is “nonfrail,” 1 is defined as “prefrail,” 2 as “frail,” and a score of 3 or more as “severely frail.”

5. Outcome Measures

The outcome measures included 30-day mortality, major complications, Clavien-Dindo physical status (PS) classification grade IV complications, 30-day unplanned readmission, 30-day unplanned reoperation, extended LOS (ELOS), and discharge destination. Major complications consisted of presence of one of the following: prolonged intubation exceeding 48 hours, unplanned reintubation, sepsis, septic shock, pneumonia, deep vein thrombosis/thrombophlebitis, pulmonary embolism (PE), acute cerebrovascular accident or stroke with neurological deficit, acute renal failure, myocardial infarction (MI), cardiac arrest requiring cardiopulmonary resuscitation, superficial surgical site infection (SSI), deep incisional SSI, organ space SSI, or wound disruption. Minor complication was defined as intra-/postoperative blood transfusion, renal insufficiency, or urinary tract infection. Clavien-Dindo PS classification grade IV complications were designated by the presence of life-threatening complications defined by single or multiple organ dysfunction requiring intensive care unit management. Clavien-Dindo PS classification grade IV complications included: sepsis or septic shock, acute renal failure, PE, MI, cardiac arrest requiring cardiopulmonary resuscitation, ventilation >48 hours, and unplanned reintubation [31]. ELOS was defined as > 75th percentile LOS of study population. The “nonhome discharge” location encompassed all patients discharged to any rehabilitation facility, skilled nursing facility, hospice care, and patients leaving against medical advice. Home or facility that is home are included in the “home destination.” Patients that expired were not included in either of these groups and only in mortality rate for the study.

6. Statistical Analysis

We conducted statistical analyses using IBM SPSS Statistics ver. 27.0 (IBM Co., Armonk, NY, USA), GraphPad Prism v 9.0 (GraphPad Software Inc., La Jolla, CA, USA), MedCalc for Windows, version 19.4 (MedCalc Software, Ostend, Belgium), and R statistical software version 3.5.3 (R Foundation for Statistical Computing, Vienna, Austria). Continuous variables with skewed distribution are reported as median with interquartile range (IQR). The normality of the data was determined by employing the D’Agostino-Pearson, Shapiro-Wilk, and Kolmogorov-Smirnov tests. We performed univariate and multivariate analyses (employing logistic regression) for mFI-5, RAI-A, and RAI-Rev for the following outcomes: 30-day mortality, major complications, Clavien-Dindo PS classification IV complications, 30-day unplanned reoperation, 30-day unplanned readmission, ELOS, and discharge to a nonhome destination. The effect sizes for dichotomous outcomes were summarized by odds ratio (OR) and associated 95% confidence intervals (CIs). We performed the receiver operating characteristic (ROC) curve analysis including the area under the curve (AUC)/C-statistics calculations to discern the predictive ability of mFI-5, RAI-A, and RAI-Rev for outcomes after spine surgery. We used the DeLong test to compute the significance of C-statistic comparison between mFI-5, RAI-A, and RAI-Rev [32]. For all purposes, p < 0.05 was considered statistically significant.

RESULTS

1. Study Population Characteristics

We identified 6,571 patients that underwent surgery for TSI and met our inclusion criteria. The median age of our cohort was 64 years (IQR, 52–75 years), 57.3% patients were male, and the median BMI was 27.7 kg/m2 (IQR, 24.2–32.2 kg/m2). Majority of the cases were nonelective (54.1%). Within the cohort the median LOS was 6 days (IQR, 3–10 days), and the median operation time was 160 minutes (IQR, 110–230 minutes). One point seven percent of the patient cohort expired, 5.5% were returned to the operating room, and 8% were readmitted to the hospital, all within 30 days from their respective TSI surgery. The distribution for frailty tiers based on mFI-5 was as follows: not frail 40.7%, prefrail 36.3%, frail 19.3%, and severely frail 4.2%. The distribution for frailty tiers based on RAI-A was as follows: not frail 69.6%, prefrail 25.1%, frail 4.5%, and severely frail 0.9%. The distribution for frailty tiers based on RAI-Rev was as follows: not frail 10.5%, prefrail 32.4%, frail 44.4%, and severely frail 13.1%. The most common comorbidities within our cohort were hypertension (52.4%), current smoking status (21.7%), and diabetes mellitus (20.2%). Thirteen point four percent of the patient cohort experienced at least one or more major postoperative complications and the most common were postoperative pneumonia (4.8%), prolonged intubation (3.7%), unplanned reintubation (2.4%), and sepsis (1.8%). Clavien-Dindo PS classification grade IV complications occurred in 8.1% of the patient cohort and 44.2% of the cohort was transferred to a nonhome destination following surgery. All patient demographics and clinical characteristics are summarized in Table 1.

Baseline demographic and clinical characteristics, 30-day mortality, readmission, reoperation, major and minor complications, and discharge disposition of patients with spine trauma from NSQIP database 2015–2019 (n=6,571)

2. Univariate Analysis of mFI-5, RAI-A, and RAI-Rev on Surgical Outcomes

While univariate analysis of frailty tiers by all 3 scoring systems showed that increasing frailty tiers were associated with poor postoperative outcomes, patients identified as frail and severely frail using RAI-A and RAI-Rev had the highest odds of worse outcomes (Table 2). In the RAI-A and RAI-Rev univariate analysis, each frailty index was the most predictive of 30-day mortality and discharge to a nonhome destination. For 30-day postoperative mortality, the severely frail group for RAI-A demonstrated OR of 20.78 (95% CI, 8.73–49.49; p< 0.001) and the severely frail group for RAI-Rev showed OR of 48.12 (95% CI, 6.64–348.52; p < 0.001). For discharge to a nonhome destination the severely frail group for RAI-A had OR of 9.27 (95% CI, 4.68–18.37; p< 0.001) and RAI-Rev had OR of 18.08 (95% CI, 13.70–23.84; p< 0.001). The mFI-5-based severely frail group demonstrated OR of 4.79 (95% CI, 2.50–9.17; p< 0.001) for 30-day mortality and 6.83 (95% CI, 5.18–9.02; p< 0.001) for nonhome discharge.

Univariate analysis of mFI-5, RAI-A, and RAI-Rev for 30-day postoperative outcomes: mortality, major complication, Clavien-Dindo physical status classification grade IV, reoperation, readmission, ELOS, and nonroutine discharge in TSI data from NSQIP 2015–2019

3. Multivariate Analysis of mFI-5, RAI-A, and RAI-Rev on Surgical Outcomes

Multivariate regression analysis of frailty scores for patients undergoing surgery for spinal trauma (adjusting for BMI, emergent surgery status, operative time, race, and ethnicity) demonstrated results similar to univariate analysis with all 3 frailty scores showing that increasing frailty tiers result in poor postoperative outcomes, and patients identified as frail and severely frail using RAI-A and RAI-Rev had the highest odds of poor outcomes (Table 3). The likelihood of an adverse event was markedly high in severely frail cohorts of both RAI-A and RAI-Rev scoring systems, however OR of mortality, major complication, Clavien-Dindo PS classification grade IV complication, readmission, ELOS, and nonroutine discharge show RAI-Rev’s superiority in its ability to predict adverse outcomes. RAI-Rev frail populations have an OR of mortality of 10.35 OR (95% CI, 1.27–78.03; p= 0.02) and severely frail had OR 28.77 (95% CI, 3.69–224.54; p= 0.001), whereas RAI-A frail had OR 2.22 (95% CI, 1.02–4.84; p=0.04) and severely frail had OR 4.64 (95% CI, 1.59–13.59; p = 0.005) for mortality (Table 3). Surprisingly, mFI-5 frailty tiers demonstrated decreased risk of mortality across all frailty types which might indicate conservative management of comorbid individuals or the inability of mFI-5 to truly capture frailty phenotype.

Multivariate analysis of mFI-5, RAI-A, and RAI-Rev for 30-day postoperative outcomes: mortality, major complication, Clavien-Dindo physical status classification grade IV, reoperation, readmission, ELOS, and nonroutine discharge in TSI data from NSQIP 2015–2019

4. ROC Curve Analysis and C-Statistics

The ROC analysis was conducted to assess the comparative predictive value of the mFI-5, RAI-A, and RAI-Rev for postoperative morbidity and mortality (Fig. 1). In the analysis for prediction of 30-day mortality, C-statistics indicated significantly better performance of RAI-Rev compared to mFI-5 (C-statistic = 0.819, 95% CI, 0.810–0.829 for RAI-Rev vs. C-statistic = 0.622, 95% CI, 0.610–0.634 for mFI-5, p< 0.0001, DeLong test). Similarly, for mortality, RAI-A performed better compared to mFI-5 (C-statistic= 0.768, 95% CI, 0.758–0.779 for RAI-A vs. C-statistic = 0.622, 95% CI, 0.610–0.634 for mFI-5, p < 0.001, DeLong test). Interestingly, RAI-Rev performed better than RAI-A in predicting postoperative mortality (C-statistic= 0.819, 95% CI, 0.810–0.829 for RAI-Rev vs. C-statistic=0.768, 95% CI, 0.758–0.779 for RAI-A, p = 0.0043, DeLong test). For most of other outcome variables, both RAI-Rev and RAI-A outperformed mFI-5, and for many outcomes, RAI-Rev showed better discriminative performance compared to RAI-A, including ELOS (p= 0.0042), readmission (p< 0.0001), reoperation (p= 0.0175), and nonhome discharge (p< 0.0001).

Fig. 1.

Receiver operating characteristic (ROC)/area under the curve (A-G) and ROC/C-statistics analysis (H) for the relative predictive abilities of the mFI-5 and RAI on mortality (A), major complication (B), Clavien-Dindo physical status classification IV complication (C), ELOS (D), nonhome discharge (E), readmission (F), and reoperation (G) in patients who underwent surgical intervention for traumatic spinal injury from NSQIP database 2015–2019. mFI-5, 5-factor modified frailty index; RAI-A, Risk Analysis Index-administrative; RAI-Rev, Risk Analysis Index recalibrated version; ELOS, extended length of stay; NSQIP, National Surgical Quality Improvement Program.

DISCUSSION

The goal of this study was to do a comparative analysis of discriminative ability of mFI-5, RAI-A, and RAI-Rev on postoperative outcomes of TSI based on large scale multicenter data from NSQIP. To the best of our knowledge, this is the first study evaluating RAI in spine trauma patients. Based on AUC/C-statistics analyses, both RAI-Rev and RAI-A outperformed mFI-5 in predicting worse postoperative outcomes, and among the 2 versions, the recalibrated RAI-Rev performed better than RAI-A for majority of outcomes. While RAI-Rev was a statistically significant predictor of worse postoperative outcomes, it performed the best for mortality, which is expected based on the fact that RAI-based frailty scales were originally developed using variables in the instrument that correlate the best with mortality [20,33]. The present study data provide evidence for the usage of RAI-based frailty scales in preoperative risk stratification of this patient population.

Frailty in spine trauma outcomes is a new topic, with only 2 previously published studies on the topic, utilizing mFI scores [15,16]. RAI-A, a recently developed frailty index, and its recalibrated version, RAI-Rev, have not previously been evaluated in TSI patients, however RAI has recently been reported to possess superior predictive ability in spine procedures and brain tumor resection patients [22,23]. RAI-based frailty scores comprise a 14-item scoring system as compared to mFI-5 which is based on 5 items, and additionally the 14 items in RAI are more relevant to functional status of the patient as compared to mFI scores, and are thus both conceptually and mathematically superior to mFI [20,33]. The present study data validates this in spine trauma patients. Previous studies have also demonstrated that how mFI-5 acts less as a metric of frailty and more as a comorbidity score [20,34-37]. This is corroborated by the data from the present study where in multivariate analysis for mortality, mFI-5 yielded unexpectedly low OR with decreased risk across all frailty tiers.

As individuals age, frailty becomes more prevalent, and with an increase in frailty comes an increased risk for falls and traumatic injury to the spine and spinal cord [38,39]. Not only does increased frailty predispose patients to the risk of TSI, but also individuals injured at older ages have an increased risk for mortality and morbidity [40]. The management and clinical decision making involving these patients provides a significant challenge to surgeons when considering surgical intervention. Because of this, it is important to have robust frailty tools for preoperative risk stratification of these patients. Both RAI-Rev and RAI-A come out as robust predictors of postoperative outcomes of TSI, and the present study advocates for their usage in clinical practice for prognostication of these patients, and to counsel them and their families regarding the expected outcomes.

The primary limitations of this study are those inherent to performing analysis using a national multicenter large database, understanding the limits of the recorded variables and ability to interpret results of their analysis. NSQIP variable limitations required modification of the RAI-A and RAI-Rev scores to exclude preoperative cognitive status. Additionally, weight loss and poor appetite are both captured in NSQIP under the same weight loss variable, “WTLOSS,” and therefore they cannot be differentiated within our adapted scoring. Despite these limitations, the NSQIP variables-based modifications of RAI scoring were in line with previous studies which demonstrated discriminative ability of this frailty measure [20,24,25]. In addition to NSQIP’s limitations impacting our RAI scoring, another limitation, particularly with reference to studying TSI, NSQIP also fails to provide an injury severity variable. Without an injury severity marker, we feel this study should be validated using a database such as the Trauma Quality Improvement Program which includes such variables. Lastly, as this study was only able to evaluate 30-day outcomes recorded in NSQIP, further analysis in long-term prospective studies is needed to further evaluate RAI’s ability to predict 90- and 180-day or further long-term outcomes.

CONCLUSION

Both RAI-A and RAI-Rev outperform mFI-5 in predicting postoperative worse outcomes following surgical intervention for TSI. Increasing RAI-Rev score was more discriminative than its former iteration, RAI-A, and mFI-5, in predicting likelihood of mortality, ELOS, readmission, reoperation, and nonhome discharge. Our analysis demonstrates that RAI-Rev may provide better preoperative risk assessment than these prior indices and should be included in preoperative risk stratification of TSI patients.

SUPPLEMENTARY MATERIALS

Supplementary Tables 1-7 can be found via https://doi.org/10.14245/ns.2244326.163.

Supplementary Table 1.

Current Procedural Terminology (CPT) codes used to identify patients undergoing spine surgery from National Surgical Quality Improvement Program database 2015–2019

ns-2244326-163-suppl1.pdf
Supplementary Table 2.

Most abundant International Classification of Diseases (ICD)-9 and ICD-10 codes among the spine trauma cohort, n=6,571, from National Surgical Quality Improvement Program 2015–2019

ns-2244326-163-suppl2.pdf
Supplementary Table 3.

RAI-A and RAI-Rev scoring adapted from Hall and colleagues, 2017 and Arya and colleagues, 2020 respectively

ns-2244326-163-suppl3.pdf
Supplementary Table 4.

Age and cancer diagnosis table scoring adapted from Hall and colleagues, 2017 for RAI-A scoring

ns-2244326-163-suppl4.pdf
Supplementary Table 5.

Age and cancer diagnosis table of scoring, adapted from Arya and colleagues, 2020, for RAI-Rev

ns-2244326-163-suppl5.pdf
Supplementary Table 6.

RAI-A and RAI-Rev scores stratified into frailty group status

ns-2244326-163-suppl6.pdf
Supplementary Table 7.

NSQIP clinical variables matched to mFI-5

ns-2244326-163-suppl7.pdf

Notes

Conflict of Interest

The authors have nothing to disclose.

Funding/Support

This study received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors.

Author Contribution

Conceptualization: MC, RT, SFK, AJD, MHS, RGM, CAB; Data curation: MC, RT, SFK, AJD, RGM, CAB; Formal analysis: MC, RT, SFK, AJD, RGM, CAB; Methodology: MC, RT, SFK, AJD, MHS, RGM, CAB; Project administration: M Schmidt, RGM, CAB; Visualization: M MC, RT, SFK, AJD, MHS, C Bowers; Writing - original draft: M MC, RT, SFK, AJD, MHS, C Bowers; Writing - review & editing: MC, RT, SFK, AJD, MHS, RGM, CAB.

References

1. Kumar R, Lim J, Mekary RA, et al. Traumatic spinal injury: global epidemiology and worldwide volume. World Neurosurg 2018;113:e345–63.
2. Looby S, Flanders A. Spine trauma. Radiol Clin North Am 2011;49:129–63.
3. Zhang S, Wadhwa R, Haydel J, et al. Spine and spinal cord trauma: diagnosis and management. Neurol Clin 2013;31:183–206.
4. Ahuja CS, Wilson JR, Nori S, et al. Traumatic spinal cord injury. Nat Rev Dis Primers 2017;3:17018.
5. National Spinal Cord Injury Statistical Center. Spinal cord injury facts and figures at a glance Birmingham (AL): National Spinal Cord Injury Statistical Center; 2020.
6. Ahn H, Bailey CS, Rivers CS, et al. Effect of older age on treatment decisions and outcomes among patients with traumatic spinal cord injury. CMAJ 2015;187:873–80.
7. van den Berg ME, Castellote JM, Mahillo-Fernandez I, et al. Incidence of spinal cord injury worldwide: a systematic review. Neuroepidemiology 2010;34:184–92. discussion 192.
8. Khan O, Badhiwala JH, Wilson JRF, et al. Predictive modeling of outcomes after traumatic and nontraumatic spinal cord injury using machine learning: review of current progress and future directions. Neurospine 2019;16:678–85.
9. Ali B, Choi EE, Barlas V, et al. Modified Frailty Index (mFI) predicts 30-day complications after microsurgical breast reconstruction. J Plast Surg Hand Surg 2022;56:229–35.
10. Jang HJ, Chin DK, Park JY, et al. Influence of frailty on life expectancy in octogenarians after lumbar spine surgery. Neurospine 2021;18:303–10.
11. Tracy BM, Wilson JM, Smith RN, et al. The 5-item modified frailty index predicts adverse outcomes in trauma. J Surg Res 2020;253:167–72.
12. Weaver DJ, Malik AT, Jain N, et al. The modified 5-item frailty index: a concise and useful tool for assessing the impact of frailty on postoperative morbidity following elective posterior lumbar fusions. World Neurosurg 2019;Jan. 11. S1878-8750(19)30038-5. https://doi.org/10.1016/j.wneu.2018.12.168. [Epub].
13. Zorbas KA, Velanovich V, Esnaola NF, et al. Modified frailty index predicts complications and death after non-bariatric gastrectomies. Transl Gastroenterol Hepatol 2021;6:10.
14. Chan V, Wilson JRF, Ravinsky R, et al. Frailty adversely affects outcomes of patients undergoing spine surgery: a systematic review. Spine J 2021;21:988–1000.
15. Banaszek D, Inglis T, Marion TE, et al. Effect of frailty on outcome after traumatic spinal cord injury. J Neurotrauma 2020;37:839–45.
16. Elsamadicy AA, Sandhu MRS, Freedman IG, et al. Impact of frailty on morbidity and mortality in adult patients presenting with an acute traumatic cervical spinal cord injury. World Neurosurg 2021;153:e408–18.
17. Kazim SF, Bowers CA, Lloyd RA, et al. Letter: frailty and outcomes of traumatic spinal cord injury. Neurosurgery 2021;89:E185–6.
18. McConaghy KM, Orr MN, Emara AK, et al. Can extant comorbidity indices identify patients who experience poor outcomes following total joint arthroplasty? Arch Orthop Trauma Surg 2021;Nov. 17. https://doi.org/10.1007/s00402-021-04250-y. [Epub].
19. Poon MTC. Letter to the Editor. Validating the 5-factor modified frailty index. J Neurosurg 2020;Nov. 13. :1–2. https://doi.org/10.3171/2020.8.JNS203241. [Epub].
20. Hall DE, Arya S, Schmid KK, et al. Development and initial validation of the risk analysis index for measuring frailty in surgical populations. JAMA Surg 2017;152:175–82.
21. Hall DE, Arya S, Schmid KK, et al. Association of a frailty screening initiative with postoperative survival at 30, 180, and 365 days. JAMA Surg 2017;152:233–40.
22. Agarwal N, Goldschmidt E, Taylor T, et al. Impact of frailty on outcomes following spine surgery: a prospective cohort analysis of 668 patients. Neurosurgery 2021;88:552–7.
23. Thommen R, Kazim SF, Rumalla K, et al. Preoperative frailty measured by risk analysis index predicts complications and poor discharge outcomes after Brain Tumor Resection in a large multi-center analysis. J Neurooncol 2022;160:285–97.
24. Arya S, Varley P, Youk A, et al. Recalibration and external validation of the risk analysis index: a surgical frailty assessment tool. Ann Surg 2020;272:996–1005.
25. George EL, Hall DE, Youk A, et al. Association between patient frailty and postoperative mortality across multiple noncardiac surgical specialties. JAMA Surg 2021;156:e205152.
26. Rothenberg KA, George EL, Trickey AW, et al. Assessment of the risk analysis index for prediction of mortality, major complications, and length of stay in patients who underwent vascular surgery. Ann Vasc Surg 2020;66:442–53.
27. Rothenberg KA, Stern JR, George EL, et al. Association of frailty and postoperative complications with unplanned readmissions after elective outpatient surgery. JAMA Netw Open 2019;2:e194330.
28. Tse W, Lavingia KS, Amendola MF. Using the risk analysis index to assess frailty in a veteran cohort undergoing endovascular aortic aneurysm repair. J Vasc Surg 2022;75:1591–7.e1.
29. Sellers MM, Merkow RP, Halverson A, et al. Validation of new readmission data in the American College of Surgeons National Surgical Quality Improvement Program. J Am Coll Surg 2013;216:420–7.
30. Shiloach M, Frencher SK Jr, Steeger JE, et al. Toward robust information: data quality and inter-rater reliability in the American College of Surgeons National Surgical Quality Improvement Program. J Am Coll Surg 2010;210:6–16.
31. Clavien PA, Barkun J, de Oliveira ML, et al. The ClavienDindo classification of surgical complications: five-year experience. Ann Surg 2009;250:187–96.
32. DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 1988;44:837–45.
33. Arya S, Kim SI, Duwayri Y, et al. Frailty increases the risk of 30-day mortality, morbidity, and failure to rescue after elective abdominal aortic aneurysm repair independent of age and comorbidities. J Vasc Surg 2015;61:324–31.
34. McIsaac DI, Aucoin SD, van Walraven C. A Bayesian comparison of frailty instruments in noncardiac surgery: a cohort study. Anesth Analg 2021;133:366–73.
35. Youngerman BE, Neugut AI, Yang J, et al. The modified frailty index and 30-day adverse events in oncologic neurosurgery. J Neurooncol 2018;136:197–206.
36. Gani F, Canner JK, Pawlik TM. Use of the modified frailty index in the american college of surgeons National Surgical Improvement Program Database: highlighting the problem of missing data. JAMA Surg 2017;152:205–7.
37. Subramaniam S, Aalberg JJ, Soriano RP, et al. New 5-factor modified frailty index using American College of Surgeons NSQIP data. J Am Coll Surg 2018;226:173–81. e8.
38. Buchman AS, Wilson RS, Bienias JL, et al. Change in frailty and risk of death in older persons. Exp Aging Res 2009;35:61–82.
39. Seel RT, Huang ME, Cifu DX, et al. Age-related differences in length of stays, hospitalization costs, and outcomes for an injury-matched sample of adults with paraplegia. J Spinal Cord Med 2001;24:241–50.
40. Liang HW, Wang YH, Lin YN, et al. Impact of age on the injury pattern and survival of people with cervical cord injuries. Spinal Cord 2001;39:375–80.

Article information Continued

Fig. 1.

Receiver operating characteristic (ROC)/area under the curve (A-G) and ROC/C-statistics analysis (H) for the relative predictive abilities of the mFI-5 and RAI on mortality (A), major complication (B), Clavien-Dindo physical status classification IV complication (C), ELOS (D), nonhome discharge (E), readmission (F), and reoperation (G) in patients who underwent surgical intervention for traumatic spinal injury from NSQIP database 2015–2019. mFI-5, 5-factor modified frailty index; RAI-A, Risk Analysis Index-administrative; RAI-Rev, Risk Analysis Index recalibrated version; ELOS, extended length of stay; NSQIP, National Surgical Quality Improvement Program.

Table 1.

Baseline demographic and clinical characteristics, 30-day mortality, readmission, reoperation, major and minor complications, and discharge disposition of patients with spine trauma from NSQIP database 2015–2019 (n=6,571)

Variable Value
Age (yr) 64 (52–75)
Sex, male:female 3,766 (57.3):2,805 (42.7)
Body mass index (kg/m2) 27.7 (24.2–32.2)
Surgery type
 Elective 3,006 (45.7)
 Nonelective 3,556 (54.1)
Length of stay (day) 6 (3–10)
Operative time (min) 160 (110–230)
Mortality 113 (1.7)
Reoperation 364 (5.5)
Readmission 527 (8)
mFI-5 frailty tiers
 Not frail (mFI-5 = 0) 2,637 (40.1)
 Prefrail (mFI-5 = 1) 2,387 (36.3)
 Frail (mFI-5 = 2) 1,270 (19.3)
 Severely frail (mFI-5 ≥ 3) 277 (4.2)
RAI-A frailty tiers 7 (5–13)
 Not frail (RAI-A ≤ 10) 4,573 (69.6)
 Prefrail (RAI-A = 11–20 1,647 (25.1)
 Frail (RAI-A = 21–30) 293 (4.5)
 Severely frail (RAI-A ≥ 31) 58 (0.9)
RAI-Rev frailty tiers 22 (16–27)
 Not frail (RAI-A ≤ 10) 692 (10.5)
 Prefrail (RAI-A = 11–20) 2,131 (32.4)
 Frail (RAI-A = 21–30) 2,889 (44)
 Severely Frail (RAI-A ≥ 31) 859 (13.1)
Preop clinical status/comorbidities
Functional status
 Partially dependent 463 (7)
 Totally dependent 75 (1.1)
Diabetes mellitus 1,328 (20.2)
COPD 395 (6)
CHF 97 (1.5)
Current smoker 1424 (21.7)
Dyspnea 345 (5.3)
Hypertension 3,444 (52.4)
Disseminated cancer 271 (4.1)
Open wound 222 (3.4)
Steroid use 317 (4.8)
Weight loss 92 (1.4)
Bleeding disorders 353 (5.4)
Preop transfusion 85 (1.3)
Transfer status 1,626 (24.7)
Major postoperative complications 879 (13.4)
 Prolonged intubation (≥ 48 hr) 244 (3.7)
 Unplanned reintubation 157 (2.4)
 Sepsis 118 (1.8)
 Septic shock 49 (0.7)
 Pneumonia 313 (4.8)
 DVT/thrombophlebitis 109 (1.7)
 Pulmonary embolism 62 (0.9)
 CVA/stroke with neurological deficit 36 (0.5)
 Acute renal failure 19 (0.3)
 Myocardial infarction 53 (0.8)
 Cardiac arrest requiring CPR 48 (0.7)
 Superficial SSI 90 (1.4)
 Deep incisional SSI 51 (0.8)
 Organ space SSI 60 (0.9)
 Wound disruption 45 (0.7)
Clavien-Dindo grade IV 531 (8.1)
Minor postoperative complications
 Intra-/postoperative blood transfusion 792 (12.1)
 Renal insufficiency 20 (0.3)
 Urinary tract infection 185 (2.8)
Discharge destination
 Home 3,601 (55.8)
 Nonroutine (Rehab, SNF, and Hospice, AMA) 2,857 (44.2)

Values are presented as median (interquartile range) or number (%).

NSQIP, National Surgical Quality Improvement Program; mFI-5, 5-factor modified frailty index; RAI-A, Risk Analysis Index-administrative; RAI-Rev, Risk Analysis Index recalibrated version; COPD, chronic obstructive pulmonary disease; CHF, congestive heart failure; DVT, deep vein thrombosis; CVA, cerebrovascular accident; CPR, cardiopulmonary resuscitation; SSI, surgical site infection; SIRS, systemic inflammatory response syndrome; SNF, skilled nursing facility; AMA, against medical advice.

Patients considered to have major complications experienced one or more of the following postoperative adverse events: prolonged intubation of 48 hours or more, unplanned reintubation, sepsis/septic shock, DVT/thrombophlebitis, pulmonary embolism (PE), coma, CVA/stroke with neurological deficit(s), myocardial infarction (MI)/cardiac arrest requiring CPR, SSI (superficial/deep/organ space), wound disruption/dehiscence, acute renal failure, and pneumonia. Patients considered to have Clavien-Dindo physical status classification grade IV complications by the presence of a life-threatening complication, defined by single or multiple organ system dysfunction requiring intensive care unit management. Clavien-Dindo physical status classification grade IV complications include the following: sepsis or septic shock, acute renal failure, PE, MI, cardiac arrest requiring CPR, ventilation >48 hours, and unplanned reintubation.

Table 2.

Univariate analysis of mFI-5, RAI-A, and RAI-Rev for 30-day postoperative outcomes: mortality, major complication, Clavien-Dindo physical status classification grade IV, reoperation, readmission, ELOS, and nonroutine discharge in TSI data from NSQIP 2015–2019

Variable Mortality Major complication Clavien-Dindo class IV Unplanned readmission Reoperation Extended hospital LOS Discharge to nonhome destination
mFI-5
Prefrail 1.34 (0.82–2.20) 1.84 (1.53–2.21)** 1.71 (1.36–2.16)*** 1.81 (1.45–2.26)*** 1.47 (1.13–1.91)* 1.88 (1.65–2.15)*** 2.68 (2.38–3.01)***
Frail 2.55 (1.55–4.19)*** 2.93 (2.41–3.57)*** 3.00 (2.35–3.82)*** 2.39 (1.87–3.05)*** 2.19 (1.65–2.91)*** 2.83 (2.43–3.29)*** 4.63 (4.02–5.34)***
Severely frail 4.79 (2.50–9.17)*** 5.41 (4.05–7.23)*** 4.39 (3.08–6.26)*** 4.28 (3.03–6.07)*** 2.57 (1.64–4.04)*** 5.90 (4.56–7.63)*** 6.83 (5.18–9.02)***
RAI-A
Prefrail 5.63 (3.61–8.76)*** 2.32 (1.98–2.71)*** 2.77 (2.28–3.37)*** 1.38 (1.13–1.68)* 1.39 (1.09–1.76) 2.63 (2.33–2.97)*** 4.13 (3.67–4.66)***
Frail 9.33 (5.08–17.12)*** 4.26 (3.27–5.57)*** 4.96 (3.64–6.75)*** 2.42 (1.73–3.38)*** 2.67 (1.82–3.92)*** 4.84 (3.81–6.16)*** 7.96 (5.92–10.70)***
Severely frail 20.78 (8.73–49.49)*** 8.24 (4.88–13.94)*** 8.99 (5.12–15.81)*** 3.75 (2.00–7.02)*** 4.77 (2.44–9.32)*** 5.70 (3.37–9.66)*** 9.27 (4.68–18.37)***
RAI-Rev
Prefrail 0.97 (0.10–9.37) 2.04 (1.37–3.03)*** 2.30 (1.28–4.15)* 2.06 (1.29–3.29)* 1.53 (0.94–2.51) 3.33 (2.42–4.60)*** 2.83 (2.20–3.66)***
Frail 12.90 (1.78–93.41)* 4.14 (2.83–6.04)*** 5.45 (3.11–9.57)*** 2.95 (1.87–4.64)*** 2.19 (1.37–3.51)* 6.72 (4.92–9.18)*** 11.64 (9.09–14.90)***
Severely frail 48.12 (6.64–348.52)*** 7.28 (4.89–10.83)*** 11.50 (6.47–20.45)*** 6.76 (4.23–10.80)*** 3.17 (1.91–5.25)*** 11.90 (8.55–16.57)*** 18.08 (13.70–23.84)***

Values are presented as odds ratio (95% confidence interval).

mFI-5, 5-factor modified frailty index; RAI-A, Risk Analysis Index-administrative; RAI-Rev, Risk Analysis Index recalibrated version; ELOS, extended length of stay; TSI, traumatic spine injury; NSQIP, National Surgical Quality Improvement Program; LOS, length of stay.

*

p<0.05.

***

p<0.001, statistically significant.

Table 3.

Multivariate analysis of mFI-5, RAI-A, and RAI-Rev for 30-day postoperative outcomes: mortality, major complication, Clavien-Dindo physical status classification grade IV, reoperation, readmission, ELOS, and nonroutine discharge in TSI data from NSQIP 2015–2019

Variable Mortality Major complication Clavien-Dindo grade IV Unplanned readmission Reoperation Extended Hospital LOS Discharge to nonhome destination
mFI-5
Prefrail 0.56 (0.32–0.97)* 1.27 (1.03–1.57)* 1.02 (0.78–1.33) 1.39 (1.08–1.78)* 1.31 (0.97–1.78) 1.22 (1.04–1.44)* 1.41 (1.22–1.63)***
Frail 0.56 (0.31–1.02) 1.69 (1.34–2.14)*** 1.48 (1.11–1.97)* 1.68 (1.27–2.23)*** 1.80 (1.29–2.53)*** 1.62 (1.35–1.95)*** 1.97 (1.65–2.36)***
Severely frail 0.59 (0.27-1.30) 2.07 (1.45–2.96)*** 1.27 (0.82–1.97) 2.23 (1.47–3.40)*** 1.59 (0.93–2.74) 2.13 (1.56–2.93)*** 1.41 (1.00–1.97)*
RAI-A
Prefrail 1.96 (1.15-3.34)* 1.39 (1.15–1.69)*** 1.53 (1.21–1.94)*** 0.82 (0.64–1.05) 1.02 (0.77–1.36) 1.64 (1.40–1.91)*** 2.50 (2.15–2.90)***
Frail 2.22 (1.02–4.84) 2.02 (1.44–2.85)*** 2.06 (1.38–3.08)*** 0.79 (0.51–1.21) 1.80 (1.10–2.95)* 2.39 (1.76–3.25)*** 4.09 (2.87–5.82)***
Severely frail 4.64 (1.59–13.59)* 3.90 (2.13–7.14)*** 3.42 (1.76–6.63)*** 1.17 (0.58–2.38) 3.39 (1.57–7.32)* 2.63 (1.42–4.86)* 5.18 (2.41–11.11)***
RAI-Rev
11-20 1.05 (0.11–10.19) 1.61 (1.05–2.45)* 2.22 (1.16–4.23)* 1.58 (0.97–2.55) 1.20 (0.72–2.00) 2.85 (2.01–4.04)*** 2.34 (1.78–3.09)***
21-30 10.35 (1.37–78.03)* 2.40 (1.57–3.67)*** 3.86 (2.03–7.34)*** 1.90 (1.16–3.10)* 1.34 (0.79–2.26) 4.32 (3.03–6.16)*** 7.42 (5.59–9.84)***
> 31 28.77 (3.69–224.54)* 2.57 (1.60–4.11)*** 5.31 (2.69–10.51)*** 3.99 (2.33–6.83)*** 1.34 (0.73–2.48) 4.39 (2.96–6.52)*** 5.74 (4.11–8.02)***

Values are presented as odds ratio (95% confidence interval).

mFI-5, 5-factor modified frailty index; RAI-A, Risk Analysis Index-administrative; RAI-Rev, Risk Analysis Index recalibrated version; ELOS, extended length of stay; TSI, traumatic spine injury; NSQIP, National Surgical Quality Improvement Program.

*

p<0.05.

***

p<0.001, statistically significant.

The multivariate model was controlled for covariates: body mass index, operative time, emergent surgery status, race, and ethnicity.