- Research article
- Open Access
Validation of age-specific survival prediction in pediatric patients with blunt trauma using trauma and injury severity score methodology: a ten-year Nationwide observational study
BMC Emergency Medicine volume 20, Article number: 91 (2020)
In-hospital mortality in trauma patients has decreased recently owing to improved trauma injury prevention systems. However, no study has evaluated the validity of the Trauma and Injury Severity Score (TRISS) in pediatric patients by a detailed classification of patients’ age and injury severity in Japan. This retrospective nationwide study evaluated the validity of TRISS in predicting survival in Japanese pediatric patients with blunt trauma by age and injury severity.
Data were obtained from the Japan Trauma Data Bank during 2009–2018. The outcomes were as follows: (1) patients’ characteristics and mortality by age groups (neonates/infants aged 0 years, preschool children aged 1–5 years, schoolchildren aged 6–11 years, and adolescents aged 12–18 years), (2) validity of survival probability (Ps) assessed using the TRISS methodology by the four age groups and six Ps-interval groups (0.00–0.25, 0.26–0.50, 0.51–0.75, 0.76–0.90, 0.91–0.95, and 0.96–1.00), and (3) the observed/expected survivor ratio by age- and Ps-interval groups. The validity of TRISS was evaluated by the predictive ability of the TRISS method using the receiver operating characteristic (ROC) curves that present the sensitivity, specificity, positive predictive value, negative predictive value, accuracy, area under the receiver operator characteristic curve (AUC) of TRISS.
In all the age categories considered, the AUC for TRISS demonstrated high performance (0.935, 0.981, 0.979, and 0.977). The AUC for TRISS was 0.865, 0.585, 0.614, 0.585, 0.591, and 0.600 in Ps-interval groups (0.96–1.00), (0.91–0.95), (0.76. − 0.90), (0.51–0.75), (0.26–0.50), and (0.00–0.25), respectively. In all the age categories considered, the observed survivors among patients with Ps interval (0.00–0.25) were 1.5 times or more than the expected survivors calculated using the TRISS method.
The TRISS methodology appears to predict survival accurately in Japanese pediatric patients with blunt trauma; however, there were several problems in adopting the TRISS methodology for younger blunt trauma patients with higher injury severity. In the next step, it may be necessary to develop a simple, high-quality prediction model that is more suitable for pediatric trauma patients than the current TRISS model.
Trauma scoring methods for survival prediction in trauma patients are essential to assess the quality of trauma care because they permit valid comparison of trauma patients who have different anatomical and physiological severities . The Trauma and Injury Severity Score (TRISS) method has been commonly used to calculate the statistical survival probability in trauma patients since its introduction in 1987 by Boyd et al. . After the validation of the revised-version of TRISS by the American College of Surgeons Committee on Trauma coordinated Major Trauma Outcome Study (MTOS) [3, 4] in the Japanese cohort, the TRISS method is reported as a standard technique for estimating survival probability and has commonly been used for evaluating the quality of trauma care [5,6,7,8].
The accuracy of the TRISS method, nevertheless, has various challenges in terms of the investigated area, time, and age. First, previous studies suggested that the TRISS has a low accuracy for survival prediction in patients with higher severity of the injury or younger pediatric patients [9, 10]. Second, previous studies suggested that there is a trend to improve the observed-to-expected mortality ratio in major trauma patients, and therefore, new coefficients should be calculated according to these improvements in trauma care for the TRISS to maintain the accuracy for survival prediction [9, 11]. Finally, there are also studies indicating that the modified TRISS methodology with local database-derived coefficients might enhance the accuracy of survival prediction in all regions except the USA, wherein the original TRISS methodology was developed because there are marked differences by region such as in Asian countries [12, 13].
Although the birth rate and mortality of the Japanese population have changed yearly [8, 14], to the best of our knowledge, no study has evaluated the validity of the TRISS method in a pediatric cohort by detailed classification of patients’ age and severity in Japan. Therefore, this study aimed to evaluate the validity of the TRISS method in predicting the survival of Japanese pediatric patients with blunt trauma by detailed classification of age (neonates/infants, preschool children, schoolchildren, and adolescents) and severity of the injury. This study analyzed data obtained from the Japan Trauma Data Bank (JTDB) for the 10-year study period during 2009–2018.
Study design, setting and population
This retrospective, nationwide, observational study analyzed data obtained from the JTDB, which registers data of patients with trauma and/or burn and records prehospitalization and hospital-related information. The JTDB records data of demographics, comorbidities, injury types, mechanism of injury, means of transportation, vital signs, Abbreviated Injury Scale (AIS) score, Injury Severity Score (ISS), prehospital/in-hospital procedures, trauma diagnosis as indicated using the AIS, and clinical outcomes. In most cases, physicians who are trained in AIS coding by using the 1990 revision of AIS  undertake the online registration of individual patient data. The JTDB data collection started in 55 hospitals in 2003. The number of participating hospitals in the JTDB registry increased yearly, up to a total of 280 hospitals, including 92% of Japanese government-approved tertiary emergency medical centers in March 2019. The Japan Association for the Surgery of Trauma permits open access and update of existing medical information and the Japan Association for Acute Medicine evaluates the submitted data.
Figure 1 shows a flow diagram of the patient disposition. In this study, we used a JTDB dataset that included information for the period January 1, 2009, to December 31, 2018, which initially yielded the data of 313,643 patients. The inclusion criteria for this study were as follows: the presence of trauma and age 18 years or less. Patients aged 19 years or more, with burns or penetrating trauma, with cardiac arrest on hospital arrival, or with missing data of outcome and TRISS prediction were excluded from this study. Among 26,329 patients with blunt trauma and younger than 18 years, 2480 (9.4%) patients had missing data of survival and 5446 (20.7%) patients had the missing data for TRISS predictor, and hence, the survival probability (Ps) was not calculated using the TRISS method. Furthermore, 683 (2.6%), 1948 (7.4%), 1608 (6.1%), and 3824 (14.5%) patients had missing data of ISS, Glasgow Coma Scale (GCS) score, systolic blood pressure (sBP), and respiratory rate (RR), respectively. Table S1 shows the number of patients who had missing data by age category and each variable.
We collected information on the following variables from the JTDB: age (years), sex, AIS, AIS of the injured region, Revised Trauma Score , ISS , Ps, and in-hospital mortality. The TRISS ranges from 0 (certain death) to 1 (certain survival), and the survival probability (Ps) is calculated as follows:
where b = b0 + b1(RTS) + b2(ISS) + b3(age).
RTS is calculated using the GCS score, the sBP, and the RR.
The outcomes were as follows: (1) patients’ characteristics and mortality by age groups (neonates/infants aged 0 years, preschool children aged 1–5 years, schoolchildren aged 6–11 years, and adolescents aged 12–18 years), (2) validity of Ps assessed using the TRISS methodology by the four age groups and six Ps-interval groups (0.00–0.25, 0.26–0.50, 0.51–0.75, 0.76–0.90, 0.91–0.95, and 0.96–1.00), and (3) the observed/expected survivor ratio by age- and Ps-interval groups. In the primary analysis, which was conducted to identify the characteristics of pediatric trauma patients during the study period, the Mann–Whitney U test and the Kruskal–Wallis test were used for analyzing continuous variables, whereas, a chi-square test was used for analyzing categorical variables. In the secondary analysis, the validity of TRISS was evaluated by the predictive ability of the TRISS method using the receiver operating characteristic (ROC) curves that present the sensitivity, specificity, positive predictive value, negative predictive value, accuracy, area under the receiver operator characteristic curve (AUC), and its 95% confidence interval (CI) of TRISS and show the ability of TRISS to distinguish between positive and negative outcomes. The AUC varies as < 0.7 (low performance), 0.7–0.9 (moderate performance), and > 0.9 (high performance) . In the third analysis, the expected survival calculated using TRISS Ps was compared with the actual Ps. The expected number of survivors in each Ps-interval group was calculated by integrating mean Ps and the number of patients for six Ps-interval group. The results of these comparisons are expressed as the medians and interquartile ranges (IQRs; 25th–75th percentile) for continuous variables and as the mean and percentages for categorical variables. All statistical analyses were performed using STATA/SE software, version 16.0 (StataCorp; College Station, Texas, USA). A two-tailed P-value of less than 0.05 indicated statistical significance.
During the 10-year study period, the data of 17,745 pediatric patients with blunt trauma were included (Fig. 1). The median age and Ps of the total cohort were 13 years (IQR, 8–17) and 0.99 (IQR, 0.98–0.99), respectively. The overall in-hospital mortality rate was 2.1%.
Table 1 shows the demographic and characteristics and variables by age. There were significant differences in all variables by the age category considered, except for neck injury with AIS ≥ 3. Neonates/infants had the highest percentage of head injury with AIS ≥ 3 (88%), highest mean ISS, lowest RTS, and lowest median Ps compared to those of the other age categories.
Table 2 shows the accuracy and AUC of TRISS for each age category. In all age categories, the AUC of TRISS demonstrated high performance (0.935, 0.981, 0.979, and 0.977). Table 3 shows the accuracy and AUC of TRISS by each Ps-interval group. The AUC for TRISS was 0.865, 0.585, 0.614, 0.585, 0.591, and 0.600 in Ps-interval groups (0.96–1.00), (0.91–0.95), (0.76. − 0.90), (0.51–0.75), (0.26–0.50), and (0.00–0.25), respectively. The AUC of TRISS demonstrated moderate performance in the Ps-interval (0.96–1.00) group (AUC, 0.865); however, the AUC of TRISS demonstrated low performance in other Ps-interval groups.
Table 4 shows the observed-to-expected survivor ratio in the Ps interval by age category. In all the age categories considered, the observed survivors among patients with Ps interval (0.00–0.25) were 1.5 times or more than the expected survivors calculated using the TRISS method.
We evaluated the validity of the TRISS method in Japanese pediatric patients with blunt trauma by age-group and severity of injury from the JTDB registry during 2009–2018. This study showed that the performance of the TRISS methodology was lower in the case of survival prediction for pediatric patients with younger age and/or Ps ≤ 0.95, and TRISS underestimated expected survivors in pediatric patients with Ps ≤ 0.25.
Because the accuracy of the TRISS model may reflect the influence of demographic differences in trauma such as the trauma care system or the population structure between the sample area and the USA, wherein the TRISS method was developed, local database-derived coefficients may further enhance the predictive performance of the TRISS [12, 13, 17, 18]. Previous studies based on a Japanese cohort, including children registered in the JTDB during 2005–2008 and 2009–2013 proved that the AUC of TRISS was 0.962 and 0.948 [9, 17]. These Japanese studies focused on pediatric patients with blunt trauma and demonstrated that the TRISS method had a high performance only for Japanese pediatric patients, as in a previous study [9, 18]. Although it is difficult to compare the results between previous studies and this study because of the different periods when the studies were conducted, our results suggest that the TRISS model may be appropriate for Japanese pediatric patients with blunt trauma. However, there is no unified consensus on whether TRISS is a suitable prediction model for pediatric patients. One study recommended the use of the TRISS methodology for both adult and pediatric patients because both TRISS models with and without pediatric coefficients equally predict survival with high performance in pediatric patients with blunt trauma [13, 19]. In the other study, the TRISS model had significantly lower performance than the revised TRISS model based on age-adjusted weights (AUC, 0.785 vs. 0.985, p < 0.05)) [10, 20]. Our results suggest several problems in adopting the TRISS model for pediatric blunt trauma patients of all ages or all severity, although our results showed that TRISS had high performance in the overall pediatric cohort.
In this subclass analysis by age category, the accuracy of the TRISS model for neonates/infants was lower than that of the other age categories. First, the neonate/infant group sustained the largest proportion of severe head injury with ISS ≥ 3 in this study. A previous study showed that the accuracy of the TRISS model for pediatric trauma patients with head injury or younger than 5 years was significantly inferior to that for the other pediatric-specific model . Second, the abovementioned finding might be attributed to the higher proportion of patients with a head injury in neonates /infants than the other age-groups in this study cohort (81% vs 31–39%, P < 0.001). Finally, another reason was considered that the evaluation of physiological status parameters such as GCS, sBP, and RR is challenging owing to their age-related variation and limited verbal communications/motor responses [21, 22]. There is a possibility of bias while evaluating the physiological status in younger pediatric patients and this may be reflected in the result of this study with a large rate of missing data of physiological status parameters in neonate/infant patients than the other age-groups (Table S1). Our results may suggest that a dataset with high-quality and without missing data may contribute to improving the accuracy of TRISS in predicting the survival of pediatric patients; however, improving the trauma database would arguably be difficult to achieve. Moreover, a previous study showed that RR data, which are missing in most cases in the Japan JTDB dataset, might be less needed for the calculation of TRISS Ps accuracy [9, 17, 23] and suggested that it may be effective to reduce the number of parameters or changes in the parameter in the prediction model for improving the accuracy of the model . In the next step of research, therefore, not only modifying the coefficient of the TRISS model but also developing a new different prediction model that requires only easily collected and fewer missing data, may be necessary to improve the accuracy of survival prediction for pediatric trauma patients.
In the subclass analysis by TRISS Ps-interval groups, the accuracy of the performance of the TRISS model for patients with Ps ≤ 0.95 was low and the observed-to-expected mortality ratio in pediatric patients with Ps ≤ 0.25 was 2.15. Previous studies also suggested similar results, which are as follows: TRISS had lower performance in Japanese blunt trauma patients with Ps < 0.9 than those with Ps ≥ 0.9  and TRISS underestimates survival for pediatric trauma patients with TRISS Ps ≤ 91% . Previous studies suggested that the decreasing trend of in-hospital mortality among trauma patients decreased in recent years would lead the TRISS model to be out of calibration [8, 11]. Previous studies conducted using the JTDB data suggested that improvements in trauma care and trauma care systems account for decreasing mortality, especially in major trauma after the Japan Advanced Trauma Evaluation and Care was introduced in 2002 [7, 8, 25]. Therefore, our results may suggest that new coefficients related to injury severity should be calculated periodically to keep up with changes in trauma care in their own country.
Our study had several limitations. First, there was a selection bias because not all Japanese hospitals that treat have registered in the JTDB. Table S1 shows the rate of missing data by age category in the JTDB dataset. The number of neonates/infants with blunt trauma was lowest (N = 771, 2.9% of all), but the proportion of patients with missing data on survival and TRISS prediction was the largest (53.7% of neonate/infants with blunt trauma). These might have an adverse effect on the prediction accuracy of TRISS in neonates/infants. Therefore, a dataset with high-quality and without missing data should be constructed to improve the accuracy of TRISS in predicting the survival of pediatric patients. In addition, the number of participating hospitals differed across the study period. Furthermore, pediatric blunt trauma patients younger than 18 years whose data were registered in the JTDB (N = 7926, 30.1%) had missing data on important variables, although selection bias occurred in the data set with more than 10% missed rate . Although this study population represents the Japanese trauma experience, our results may be nearly close to those obtained in many other Asian countries such as South Korea, Hong Kong, and Thailand, where trauma patient demographics are similar [12, 18, 26]. Our study attempted to utilize cross-validation procedures to assess the validity of the results obtained. In the next step, assessing the quality of the trauma care exactly by using the survival prediction model with higher accuracy than the current TRISS method could be achieved by using the data of each hospitals and type of trauma . Therefore, developing a new regression model that is more suitable to the country’s situation, would result in better outcomes of trauma patients in that country, contributing to a decrease in the number of preventable trauma deaths.
This study showed that overall the TRISS methodology appears to accurately predict survival in Japanese pediatric patients with blunt trauma. However, there were several problems in adopting the TRISS model for blunt trauma patients who are younger and/or with higher injury severity. In the future, it may be necessary to consider developing a simple, high-quality prediction model that is more suitable for pediatric trauma patients than the current TRISS model.
Availability of data and materials
The datasets supporting the conclusions of this article are available from the corresponding author on reasonable request.
Trauma and Injury Severity Score
Area under the curve
Major Trauma Outcome Study
Japan Trauma Data Bank
Abbreviated Injury Scale
Injury Severity Score
Glasgow Coma scale
Systolic blood pressure
Receiver operating characteristic
95% confidence interval
Lecky F, Woodford M, Edwards A, Bouamra O, Coats T. Trauma scoring systems and databases. Br J Anaesth. 2014;113:286–94. https://doi.org/10.1093/bja/aeu242.
Boyd CR, Tolson MA, Copes WS. Evaluating trauma care: the TRISS method. Trauma score and the injury severity score. J Trauma. 1987;27:370–8.
Champion HR, Sacco WJ, Copes WS, Gann DS, Gennarelli TA, Flanagan ME. A revision of the trauma score. J Trauma. 1989;29:623–9. https://doi.org/10.1097/00005373-198905000-00017.
Champion HR, Copes WS, Sacco WJ, Lawnick MM, Keast SL, Bain LW, et al. The major trauma outcome study: establishing national norms for trauma care. J Trauma. 1990;30:1356–65.
Japan Advanced Trauma Evaluation and Care. http://www.jtcr-jatec.org/index_jatec.html (In Japanese). Accessed 20 July 2020.
Japan Trauma Data Bank Report 2019 (2014–2018). https://www.jtcr-jatec.org/traumabank/dataroom/data/JTDB2019e.pdf. Accessed 20 July 2020.
Hondo K, Shiraishi A, Fujie S, Saitoh D, Otomo Y. In-hospital trauma mortality has decreased in Japan possibly due to trauma education. J Am Coll Surg. 2013;217:850–7.e1. https://doi.org/10.1016/j.jamcollsurg.2013.05.026.
Nagata I, Abe T, Uchida M, Saitoh D, Tamiya N. Ten-year inhospital mortality trends for patients with trauma in Japan: a multicentre observational study. BMJ Open. 2018;8:e018635. https://doi.org/10.1136/bmjopen-2017-018635.
Suzuki T, Kimura A, Sasaki R, Uemura T. A survival prediction logistic regression models for blunt trauma victims in Japan. Acute Med Surg. 2017;4:52–6. https://doi.org/10.1002/ams2.228.
Schall LC, Potoka DA, Ford HR. A new method for estimating the probability of survival in paediatric patients using the revised TRISS methodology based on age-adjusted weights. J Trauma. 2002;52:235–41. https://doi.org/10.1097/00005373-200202000-00006.
Rogers FB, Osler T, Krasne M, Rogers A, Bradburn EH, Lee JC, et al. Has TRISS become an anachronism? A comparison of mortality between the National Trauma Data Bank and major trauma outcome study databases. J Trauma Acute Care Surg. 2012;73:326–31. https://doi.org/10.1097/TA.0b013e31825a7758.
Chan CKO, Yau KKW, Cheung MT. Trauma survival prediction in Asia population: a modification of TRISS to improve accuracy. Emerg Med J. 2014;31:126–31. https://doi.org/10.1136/emermed-2012-201831.
Orliaguet G, Meyer P, Blanot S, Schmautz E, Charron B, Riou B, et al. Validity of applying TRISS analysis to paediatric blunt trauma patients managed in a French paediatric level I trauma Centre. Intensive Care Med. 2001;27:743–50. https://doi.org/10.1007/s001340100905.
Ministry of Health Labour and Welfare. Vital Statistics/Vital statistics of Japan Final Data Classification table. http://www.mhlw.go.jp/english/database/db-hw/vs01.html. Accessed 6 Aug 2020.
Association for the Advancement of Automotive Medicine. The Abbreviated Injury Scale: 1990 Revision updated 1998. https://www.tarn.ac.uk/content/downloads/72/coding.pdf. Accessed 20 Sep 2020.
Akobeng AK. Understanding diagnostic tests 3: receiving operating characteristic curves. Acta Paediatr. 2007;96:644–7. https://doi.org/10.1111/j.1651-2227.2006.00178.x.
Kimura A, Chadbunchachai W, Nakahara S. Modification of the trauma and injury severity score (TRISS) method provides better survival prediction in Asian blunt trauma victims. World J Surg. 2012;36:813–8. https://doi.org/10.1007/s00268-012-1498-z.
Schluter PJ, Cameron CM, Davey TM, Civil I, Orchard J, Dansey R, et al. Contemporary New Zealand coefficients for the trauma injury severity score: TRISS(NZ). N Z Med J. 2009;122:54–64.
Eichelberger MR, Champion HR, Sacco WJ, Gotschall CS, Copes WS, Bowman L.M. Pediatric coefficients for TRISS analysis. J Trauma 1993;34:319–322. doi: https://doi.org/10.1097/00005373-199303000-00001.
Potoka DA, Schall LC, Ford HR. Development of a novel age-specific pediatric trauma score. J Pediatr Surg. 2001;36:106–12. https://doi.org/10.1053/jpsu.2001.20023.
Nuttall AG, Paton KM, Kemp AM. To what extent are GCS and AVPU equivalent to each other when assessing the level of consciousness of children with head injury? A cross-sectional study of UK hospital admissions. BMJ Open. 2018;8:e023216. https://doi.org/10.1136/bmjopen-2018-023216.
Fleming S, Thompson M, Stevens R, Heneghan C, Plüddemann A, Maconochie I, et al. Normal ranges of heart rate and respiratory rate in children from birth to 18 years of age: a systematic review of observational studies. Lancet. 2011;377:1011–8. https://doi.org/10.1016/S0140-6736(10)62226-X.
Tohira H, Matsuoka T, Watanabe H, Ueno M. Characteristics of missing data of the Japan trauma data Bank. JJAAM. 2011;22:147–55.
Nakahara S, Ichikawa M, Kimura A. Simplified alternative to the TRISS method for resource-constrained settings. World J Surg. 2011;35:512–9. https://doi.org/10.1007/s00268-010-0865-x.
Japan Advanced Trauma Evaluation and Care. Available online: http://www.jtcr-jatec.org/index_jatec.html (In Japanese). Accessed 20 July 2020.
Kuwabara K, Matsuda S, Imanaka Y, Fushimi K, Hashimoto K, Ishikawa KB, et al. Injury severity score resource use and outcome for trauma patients within a Japanese administrative database. J Trauma. 2010;68:463–70. https://doi.org/10.1097/TA.0b013e3181a60275.
The authors acknowledge Editage (https://www.editage.jp) for assistance in English language editing.
Ethics approval and consent to participate
This study was approved by the Institutional Ethics Committees of Yokohama City University Medical Centre (approval no. B170900003). The approving authority for data access was the Japanese Association for the Surgery of Trauma (Trauma Registry Committee). The need for consent to individual participate was waived by the Institutional Ethics Committees that approved our study due to the observational nature of the study design.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Toida, C., Muguruma, T., Gakumazawa, M. et al. Validation of age-specific survival prediction in pediatric patients with blunt trauma using trauma and injury severity score methodology: a ten-year Nationwide observational study. BMC Emerg Med 20, 91 (2020). https://doi.org/10.1186/s12873-020-00385-0
- Trauma scoring system
- Trauma and injury severity score
- Survival probability
- Japan trauma data bank