Skip to main content

Predicting venous thromboembolism in hospitalized trauma patients: a combination of the Caprini score and data-driven machine learning model

Abstract

Background

Venous thromboembolism (VTE) is a common complication of hospitalized trauma patients and has an adverse impact on patient outcomes. However, there is still a lack of appropriate tools for effectively predicting VTE for trauma patients. We try to verify the accuracy of the Caprini score for predicting VTE in trauma patients, and further improve the prediction through machine learning algorithms.

Methods

We retrospectively reviewed emergency trauma patients who were admitted to a trauma center in a tertiary hospital from September 2019 to March 2020. The data in the patient’s electronic health record (EHR) and the Caprini score were extracted, combined with multiple feature screening methods and the random forest (RF) algorithm to constructs the VTE prediction model, and compares the prediction performance of (1) using only Caprini score; (2) using EHR data to build a machine learning model; (3) using EHR data and Caprini score to build a machine learning model. True Positive Rate (TPR), False Positive Rate (FPR), Area Under Curve (AUC), accuracy, and precision were reported.

Results

The Caprini score shows a good VTE prediction effect on the trauma hospitalized population when the cut-off point is 11 (TPR = 0.667, FPR = 0.227, AUC = 0.773), The best prediction model is LASSO+RF model combined with Caprini Score and other five features extracted from EHR data (TPR = 0.757, FPR = 0.290, AUC = 0.799).

Conclusion

The Caprini score has good VTE prediction performance in trauma patients, and the use of machine learning methods can further improve the prediction performance.

Peer Review reports

Introduction

Venous thromboembolism (VTE), including deep vein thrombosis (DVT) and pulmonary embolism (PE), is a critical cause of death and disability in hospitalized patients. It is believed that around 5% ~ 10% of hospitalized deaths are caused by PE [1]. In the United States, there are more than 600,000 cases of symptomatic VTE per year, of which 2/3 are hospital-acquired and VTE-related deaths are about 296,000 cases per year [2]. Complications secondary to VTE, such as pulmonary hypertension, post-thrombotic syndrome, VTE recurrence, can also cause a huge health burden and long-term impact on the quality of life of patients [3, 4].

A combination of multiple factors leads to VTE, including gender, age, hospitalization, surgery, trauma, fracture, cancer, paralysis, cardiovascular or cerebrovascular events, etc. [5]. Specifically, trauma events usually contain the three main causes of thrombosis proposed by Virchow: blood flow stasis, blood hypercoagulability, and vascular endothelial injury, leading to the fact that the impact of trauma on the body is second only to surgery and is an independent risk factor for the occurrence of VTE [6].

Predicting the risk of VTE can guide prevention. Risk prediction tools for VTE prediction in trauma populations are often based on literature review and clinical experience, such as the Risk Assessment Profile (RAP) [7, 8] proposed by Greenfield L.J. in 1997, and the latter two simplified RAP scoring tools [9, 10] based on it, by which the scoring items selected are not inconsistent. In 2012, Rogers F.B. et al. retrospectively analyzed trauma-related VTE risk factors in 16,608 trauma patients, then formed the Traumatic Thrombosis Score System (TESS) [11]. However, in 2015, a study conducted by Zander A.L. et al. [12] shows that the prediction using both TESS and RAP does not get ideal results (TESS: sensitivity = 0.49, specificity = 0.72, AUC = 0.66; RAP: sensitivity = 0.83, specificity = 0.37, AUC = 0.66), revealing that the validity of VTE prediction tools are still inconsistent and not repeatable.

As a general VTE risk assessment scale in the surgical population, the Caprini risk assessment model (Caprini RAM) proposed by Caprini J.A. et al. in 1991 [13] has verified its application effects in more than 200 publications. It has been successfully received and recommended for surgical patients by the American College of Chest Physicians Association (ACCP) [14] and guidelines in some regions of China [15, 16]. The Caprini RAM has already taken many risk factors of hospitalized patients into account including fractures and some other trauma-related factors, but except in hip and lower limb fractures [17,18,19,20], there is still no definitive evidence proving its effectiveness for trauma populations. This paper will try to verify the accuracy of the Caprini RAM in predicting trauma-related VTE.

The empirical scale models usually based on the unary linear relationships between the variables and set score weights according to the relative thrombosis risk reported in the literature. However, there are several problems. On the one hand, there may be inaccuracies in estimating the effect based on experience; on the other hand, the weights of influencing factors may be inconsistent in different specific disease groups. In addition, linear scoring tools could not assess the interaction between multiple influencing factors accurately. In contrast, data-driven modeling methods can optimize the combination of all feature weights to the greatest extent, to better tap the potential of data prediction.

Machine learning methods help to improve the effect of linear predictions made by some traditional risk assessment models. For example, Wang X. et al. [17] compare the prediction effects of different machine learning models with the PADUA risk assessment scale in medical patients, finding out that machine learning model, especially the random forest model (RF), can obtain better prediction performance. Besides, researchers have made successful predictions for asymptomatic VTE events based on natural language processing and machine learning methods [18]. The results show that the key features for accurately predicting VTE can be extracted from text description factors, and machine learning may provide a new way for prediction and identification. However, in these papers, the data especially the medical history assessment and laboratory examination results have not been fully utilized, which should reflect multiple aspects of the medical system in detail and are more important for the modeling.

Medical data usually come from diverse sources and often possess attributes such as high dimension, nonlinearity, and imbalance in positive and negative samples. In machine learning, traditional methods such as multivariate linear regression and logistic regression (LR) may come to problems like heavy computational burden and multicollinearity in feature selection, which can be overcome by adding regularization and loss function settings under the premise of a linear model. Meanwhile, the mutual information entropy (MIE) algorithm based on information theory can also realize the selection through the calculation of the joint probability density function. In practice, which method should be chosen from the above is often determined by whether the data characteristics meet the prerequisites of a certain one [21]. Since there is no relevant research so far confirming which method is the most helpful for improving the clinical prediction model, in this paper, we will try to use different feature selection methods combined with a machine learning model to extract features that relate to VTE. A large number of electronic healthcare records (EHR) will be used for prediction modeling, including medical history evaluation and laboratory examination results.

In summary, this paper will try to achieve effective prediction for VTE in the trauma hospitalized population, which includes three parts: (1) Empirical modeling: verify the prediction effect of the empirical Caprini RAM for the trauma population; (2) Data-driven modeling: extract effective feature groups from the EHR data with different methods, then build different data-driven prediction models and compare them with the former empirical Caprini RAM; (3) Combine the Caprini RAM from part (1) with the best features group selected from part (2) to form a new machine learning model to obtain the best performance for the VTE prediction.

Methods

Study population and data collection

The West China Hospital Research Ethics Committee approved the study, all methods were performed in accordance with relevant guidelines, and informed consent was waived due to the retrospective nature of the study. The information of emergency trauma patients hospitalized in the Trauma Center of West China Hospital (a Tertiary hospital in Sichuan Province) were reviewed from September 2019 to March 2020 and obtained relevant data in the patient’s EHR.

The inclusion criteria in this study contain: (1) Days from injury to admission < 30; (2) age ≥ 18-year-old; (3) length of stay > 3 days; The exclusion criteria is: diagnosed with VTE on admission. The outcome indicator is the VTE that occurred during the patients’ hospitalization, including DVT and PE. The patient should get routine color duplex ultrasonography after admission and surgery, or any time found symptoms of limb swelling during hospitalization; If the patient has symptoms such as dyspnea, chest pain, decreased pulse oximetry, or abnormal arterial blood gas, Computed Tomography Pulmonary Angiography (CTPA) is used to diagnose PE.

All patients have to get VTE risk assessment on the day of hospitalization, which follows the widely accepted Caprini RAM version 2005 [22], then clinicians use low molecular weight heparin (LMWH) for chemoprophylaxis by risk stratification and clinical judgment.

In this paper, all the features for the VTE prediction are extracted from the EHR data, including 10 basic indicators, 18 medical history and comorbidity indicators, 24 laboratory examination indicators, 5 vital signs indicators, and 12 trauma-related indicators, which form a dataset containing 69 potential predicting factors (details are shown in additional file 1). Among these indicators, vital signs indicators and laboratory test indicators are based on the earliest results obtained after admission.

Statistical methods and machine learning algorithms

All the EHR data extracted from the hospital information system are saved in Comma-Separated Values (CSV) format. Software such as Python 3.7, PyCharm IDE as well as python packages like Pandas, NumPy, and scikit-learn are adopted for data processing and modeling. For categorical indicators, One-Hot encoding is applied; while for numerical indicators, original values are kept. Missing values are implemented by the mean values. Due to the high dimensionality of the EHR data, multiple methods including Least absolute shrinkage and selection operator (Lasso) regression, Ridge regression, ElasticNet regression, Logistic regression (LR), Mutual Information Entropy (MIE) as well as Recursive Feature Elimination (RFE) are combined to filter the indicators into different feature groups for building the VTE prediction model.

The principle of Lasso regression, Ridge regression, and ElasticNet regression is to reduce the magnitude of the corresponding feature coefficients to eliminate irrelevant features and avoid over-fitting of the model by introducing a regularization term in the fitting objective function. Among these methods, the Lasso regression takes L1 norm regularization [23] and Ridge regression takes L2 norm regularization [24], while ElasticNet regression is a combination of the former two regularization terms [25]. This combination can maintain the sparse results of Lasso regression and inherit the stability of Ridge regression. Another feature screening method MIE considers the influence of indicator X on the distribution of target Y, i.e. VTE in this paper, as the correlation strength between these two variables. The information entropy H(X) represents the amount of information contained in a random variable X itself. When there is a correlation between two variables X and Y, the addition of X will significantly reduce the uncertainty of Y, thus the correlation strength between variable X and Y, I(X; Y), can be calculated as I(X; Y) = H(X) - H(X|Y), which is also called as mutual information entropy between X and Y [26]. A larger MIE value means a stronger correlation between X and Y, and thus X should be more likely to be taken into the prediction model for Y.

Once the feature screening is completed, different feature groups obtained by the above screening methods are selected to build the prediction models for VTE. This paper adopts the random forest (RF) model based on decision tree for the prediction modeling because it has better performance on high dimensional and unbalanced data sets with outliers. It can also achieve higher accuracy and better generalization ability compared with other machine learning algorithms and is widely used in medical predictions [27,28,29]. Additionally, the K-fold method is also adopted for internal validation. The fold number k and repeat times r are set to 10, 10, which means, for each model, a 10-fold validation test is conducted 10 times to reduce the type I errors [30]. Finally, for each model, average values of prediction metrics are obtained from the test set results including True Positive Rate (TPR, Recall, Sensitivity), False Positive Rate (FPR, 1-Sepcifity), AUC, Accuracy and Precision, and then compared with the metrics of Caprini RAM.

Results

Patient characteristics

The data of 1121 trauma patients admitted to the emergency department from September 2019 to March 2020 is extracted from the EHR. Finally, only 903 patients met the inclusion and exclusion criteria. The inclusion and exclusion process are listed in Fig. 1.

Fig. 1
figure 1

A Flowchart of the inclusion and exclusion process for the EHR data

The demographics of the 903 patients are shown in Table 1, among which 561 are males while the other 342 are females. The medians of age, Injury Severity Scale (ISS), the Caprini scores, and BMI are 51, 9, 9, and 23.35 ± 3.62, respectively. 193 patients developed VTE, including 187 cases with DVT and 6 cases with both DVT and PE. The missing rates of all the fields in the EHR data are low, of which the highest is 5.2% and corresponds to the Body Mass Index (BMI) (additional file 1).

Table 1 Patients Demographicsa

Model metrics of the Caprini RAM

The total Caprini scores distributions for the 903 patients are plotted in Fig. 2a, scores range from 1 to 18 points, among which the VTE group scores distribution is 11 (10 ~ 12) points, while for the non-VTE patients the distribution is 9 (5 ~ 11) points. Comparing the incidence in different scoring segments shows that the Caprini score increases as the risk grows (Fig. 2c). This Caprini RAM gets AUC = 0.773 with the best cut-off score = 11 points (Fig. 2b), corresponding model metrics are listed in Table 2.

Fig. 2
figure 2

(a) Caprini scores distribution for the VTE and non-VTE patients; (b) receiver operating characteristic (ROC) curve of the Caprini RAM. (c) VTE incidence curve of the Caprini RAM

Table 2 Prediction Metrics of Different Models based on EHR Data (Compared with the Caprini RAM)

Model metrics of machine learning models based on EHR data

69 feature indicators are extracted from the EHR data to build the data-driven risk prediction models for VTE. For each feature, the MIE between itself and the target VTE is calculated to measure the strength of the feature’s importance. In the ranking of different features MIE values, the Caprini RAM score has the strongest correlation with VTE, besides other features extracted from EHR, like serum albumin (ALB), chemoprophylaxis, etc. (additional file 1).

Based on the preliminary observations, we use feature screening methods in machine learning such as Lasso regression, Ridge regression, ElasticNet regression, LR, and MIE separately to screen all the 69 features, in which Lasso, Ridge, ElasticNet, and LR are combined with the RFE framework, while MIE is combined with multicollinearity feature filtration. The number of features selected by the five screening methods ranges from 14 to 52, in which chemoprophylaxis, age, ISS, weight, pelvic injury, upper extremity injury, trauma history, red blood cell counts (RBC), and serum chloride level (CL) are commonly confirmed by all the methods (additional file 2).

Next, we carry out the machine learning modeling for predicting VTE according to the results of each feature screening method, which adopts the RF algorithm as the prediction model. The final model metrics are averaged on the testing sets, respectively. All the models testing metrics are shown in Table 2, and they are also compared to the testing metrics of the Caprini RAM.

Figure 3 shows the distributions of the metrics from the above 5 RF models (blue box plots) compared with the Caprini RAM (horizontal dash line). It shows that the Caprini RAM gets better performance on metrics like accuracy, precision, FPR, and AUC, while the data-driven methods have slightly higher TPRs. In general, the Caprini RAM shows better prediction performance than RF models that are only based on EHR data.

Fig. 3
figure 3

Prediction Metrics Distributions of Different Random Forest Models Based on EHR data

Model metrics of machine learning models based on Caprini scores and EHR data

We try to combine the Caprini RAM with the fields from the EHR data and perform the feature screening and modeling again to check if it is useful to get better model results. After adding the Caprini score, the feature screening results have some major changes. For Lasso and ElasticNet, the feature numbers decreased significantly to 5 and 6, while for Ridge, LR, and MIE, their modeling feature numbers change slightly. Features selected by all the five screening methods simultaneously are age, ISS, Caprini score, weight, and CL (additional file 2).

Similarly, we adopt a 10-fold validation framework to test all features set from the five screening methods and use the RF model to predict VTE. Metrics of each model are listed in Table 3. After adding the Caprini score into the features set, all the model prediction metrics get improved. Specifically, for group Caprini + MIE + RF, its TPR value reaches 0.780 and has increased a lot compared to the value 0.668 from Caprini RAM. However, gaps remain in Accuracy, Precision, and FPR between the data-driven random forest models and the Caprini RAM. Details are shown in Fig. 4.

Table 3 Prediction Metrics of Different Models based on EHR Data & Caprini Scores (Compared with the Caprini RAM)
Fig. 4
figure 4

Prediction Metrics Distributions of Different Random Forest Models Based on EHR data & Caprini Scores

Figure 5 shows the ROC curve and the corresponding best cut-off point for all the above models. It is obvious that the ROC of each model has been greatly improved after adding the Caprini scores.

Fig. 5
figure 5

Comparisons on ROC curves and best cut-off points

In summary, comparing all the random forest models combining with the Caprini scores, there are no significant differences in metrics such as Accuracy, AUC, TPR, and FPR, but the group Caprini + Lasso + RF exploits the least features.

Discussion

This paper verifies the effect of Caprini RAM in trauma patients for the first time and Caprini RAM shows good discrimination ability in predicting VTE events (TPR = 0.667, FPR = 0.227, AUC = 0.773). However, when divided by fraction, conventional risk stratification used in general surgical patients (0–1 point, 2 points, 3–4 points, ≥ 5 points) cannot effectively distinguish the risk of VTE in hospitalized trauma patients. Our research shows that VTE risk stratification based on 0–2 points, 3–6 points, 7–10 points, ≥ 11 points can be more appropriate for trauma patients. Existing research shows that there are differences in the cut-off point of Caprini RAM for different populations. The high-risk group of general surgical patients is defined by ≥5 points [14]. But for patients with hip fractures, some research shows that the best cut-off point is 12 points [20]. Dash J et al. [19] explored the cut-off point of Caprini RAM for lower extremity fracture is 12 overall. For total joint replacement, the cut-off point should be 10 points [31]. The ROC curve in this paper shows that the best cut-off point lies at 11 points, this tells us that for different disease populations, it is necessary to redefine the high-risk events and reassess the timing of chemical anticoagulation measures.

The effect of using anticoagulant measures for VTE prevention has already been recognized but as Defloor T. et al. [32] commented on pressure ulcer risk assessment, targeted preventive measures may reduce the risk of VTE in high-risk patients, reduce the actual VTE events, and reduce the sensitivity and specificity of prediction. In this study, a large number of patients used LMWH for anticoagulation therapy. It is reasonable to infer that the prediction accuracy of the risk assessment based on the Caprini score at the beginning of the patient’s admission should be better than our models’ accuracies.

In our research, physiological and biochemical indicators are directly incorporated into the VTE risk prediction models, because some research has shown that Caprini scores combined with serum markers can achieve better predictive performance [33]. Besides, using clinical and serological indicators is more helpful for computer-aided decision making [34]. Indicators that are unanimously selected in the feature screening processes with or without the Caprini scores include age, ISS, weight, and serum chloride (CL), in which the former 3 indicators are the same with the clinical experience and previous research [34,35,36], while the last CL is unexpectedly associated to the happening of VTE. Although there is no relevant literature report, considering that hyperchloremia is often associated with hypoproteinemia, hemoconcentration, renal insufficiency, and large amounts of fluid replacement, this association may be reasonable. It can be further verified in a prospective, large-sample study in the future.

When compared with machine learning models that only use features from EHR, Caprini RAM shows better prediction performance. But it is worthy to note that the Caprini RAM is a face-to-face evaluation of patients after admission and its score items are not completely included in the feature fields extracted by EHR, including recent sepsis, abnormal lung function, plaster fixation, family history of VTE, etc. It is reasonable to believe that the features extracted from the EHR cannot cover all the risk factors that Caprini RAM included. This may be one of the reasons why the prediction performance of the Caprini score is better than the performance of the machine learning models. Besides, the face-to-face evaluation of patients after admission may have higher data accuracy than the retrospective acquisition of feature fields from EHR [37].

There are certain differences in the prediction effects of the final constructed models, which are from different feature screening methods, but considering the risk of overfitting caused by the use of excessive features, we tend to choose the model with fewer features and better prediction performance. When only using EHR, the model LR + RF is more prominent and achieves the best TPR and the second-best AUC (worse than the AUC of Caprini RAM) with the least features. But when combining EHR and Caprini scores, all the models built by different feature screening methods achieve improved prediction performance with a reduction in the number of features. Although the Caprini + LR + RF model still keeps the highest AUC, its TPR and FPR are worse than those of other models. Here take the Caprini + Lasso + RF model, which only relies on 5 features, as an example. With the combination of EHR and Caprini scores, its sensitivity increases from 0.667 to 0.757 (the highest is 0.760), and AUC increased from 0.773 to 0.799 (the highest is 0.800), achieving a satisfying prediction effect. The Caprini score itself may be related to multiple features in EHR, and the L1 regularization used in Lasso regression can efficiently achieve dimensionality reduction of collinearity features, especially in high-dimensional sparse data [38]. It is shown in the screening results that the number of features decreased significantly after adding Caprini RAM into the data set. In summary, Caprini RAM can obtain better results when combined with Lasso + RF in feature screening and modeling.

Compared with all machine learning models, the Caprini RAM still keeps an advantage in Precision and FPR. When Caprini RAM is combined with machine learning models, it can identify the high-risk patients more effectively, while the Caprini model itself has a better ability in identifying low-risk patients. When it goes to guide VTE prevention, further considerations between risks caused by overtreatment and missed diagnosis should be confirmed by further diagnostic research.

As far as we know, this research is the first to focus on the effect of the Caprini RAM in trauma patients, which is rarely mentioned in previous studies. It can be concluded from the study that Caprini has good VTE prediction performance and discrimination in trauma patients, but its cut-off point is inconsistent with other diseases, and specific VTE risk stratification should be carried out for trauma patients.

We try to introduce the data extracted from EHR into the VTE prediction of trauma patients and verified that it has the potential to obtain better VTE prediction results when combined with the Caprini score and EHR data. Research shows that different feature screening methods will cause certain differences between the selected risk factors and the final modeling prediction effect. It is worth noting that as the number of features increases, the model is more likely to overfit, which leads to restrictions on external promotion. We suggest that, in feature selection, the number of features should be effectively reduced by regularization, to reduce the overuse of computing resources and the possibility of overfitting.

There are still some shortcomings in the research: (1) The study is retrospective, with small sample size and a single center. The model effect is cross-validated, and it has not to be evaluated in a multi-center, large-sample extensive trauma population; (2) Although we have focused on the occur of VTE in the patient’s hospital stay, we do not follow up with patients after discharge for a fixed period, which can lead to the missed screening of VTE events and underestimate the risk of VTE in trauma patients; (3) The data extracted from EHR cannot fully cover the Caprini score index, which may result in insufficient feature fields and affect the modeling effect of machine learning methods. Since the Caprini score is evaluated face-to-face when the patient is admitted to the hospital, the scores obtained can be more accurate than the data extracted from EHR. These two points may also be the reasons why the prediction effects of machine learning models are not as good as the Caprini RAM’s; (4) Although a variety of methods were used in feature screening, only RF is used in modeling, and other machine learning models such as support vector machines, gradient boosting machines, neural network, etc. are not evaluated, and no deep learning method was attempted. The above shortcomings will be further improved in future studies.

Conclusion

Risk prediction plays an important role in clinical decision-making, and the introduction of machine learning methods provides exciting prospects for improving risk assessment and the formulation of targeted prediction strategies. Our results confirm the validity of the Caprini risk assessment scale and the improvement of the prediction effect of machine learning methods. In the future, we can further optimize the feature combination method of the existing VTE risk prediction scale through machine learning methods, or combine the clinical indicators available in the trauma database on this basis to improve the effect of VTE prediction. This will help the design of more automatic and efficient VTE risk assessment and decision support tools. We will try to further embed it in the electronic medical record system.

Availability of data and materials

The datasets used or analyzed during the current study are not expected to be made available due to IRB approval restrictions but are available from the corresponding author on reasonable request.

References

  1. Alikhan R, Peters F, Wilmott R, Cohen A. Fatal pulmonary embolism in hospitalised patients: a necropsy review. J Clin Pathol. 2004;57(12):1254–7. https://doi.org/10.1136/jcp.2003.013581.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  2. Heit JA, Cohen AT, Anderson FA Jr, Group oBotVIA. Estimated Annual Number of Incident and Recurrent, Non-Fatal and Fatal Venous Thromboembolism (VTE) Events in the US. Blood. 2005;106(11):910. https://doi.org/10.1182/blood.V106.11.910.910.

  3. Peacock A, Simonneau G, Rubin L. Controversies, uncertainties and future research on the treatment of chronic thromboembolic pulmonary hypertension. Proc Am Thorac Soc. 2006;3(7):608–14. https://doi.org/10.1513/pats.200605-114LR.

    Article  PubMed  Google Scholar 

  4. Kahn SR, Hirsch A, Shrier I. Effect of postthrombotic syndrome on health-related quality of life after deep venous thrombosis. Arch Intern Med. 2002;162(10):1144–8. https://doi.org/10.1001/archinte.162.10.1144.

    Article  PubMed  Google Scholar 

  5. Heit JA. Epidemiology of venous thromboembolism. Nat Rev Cardiol. 2015;12(8):464–74. https://doi.org/10.1038/nrcardio.2015.83.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Heit JA, Silverstein MD, Mohr DN, Petterson TM, O'Fallon WM, Melton LJ. Risk factors for deep vein thrombosis and pulmonary embolism: a population-based case-control study. Arch Intern Med. 2000;160(6):809–15. https://doi.org/10.1001/archinte.160.6.809.

    Article  CAS  PubMed  Google Scholar 

  7. Greenfield LJ, Proctor MC, Rodriguez JL, Luchette FA, Cipolle MD, Cho J. Posttrauma thromboembolism prophylaxis. J Trauma. 1997;42(1):100–3. https://doi.org/10.1097/00005373-199701000-00017.

    Article  CAS  PubMed  Google Scholar 

  8. Hegsted D, Gritsiouk Y, Schlesinger P, Gardiner S, Gubler KD. Utility of the risk assessment profile for risk stratification of venous thrombotic events for trauma patients. Am J Surg. 2013;205(5):517–20. https://doi.org/10.1016/j.amjsurg.2013.01.022.

    Article  PubMed  Google Scholar 

  9. Tachino J, Yamamoto K, Shimizu K, Shintani A, Kimura A, Ogura H, et al. Quick risk assessment profile (qRAP) is a prediction model for post-traumatic venous thromboembolism. Injury. 2019;50(9):1540–4. https://doi.org/10.1016/j.injury.2019.06.020.

    Article  PubMed  Google Scholar 

  10. Meizoso JP, Karcutskie CA IV, Ray JJ, Ruiz X, Ginzburg E, Namias N, et al. A simplified stratification system for venous thromboembolism risk in severely injured trauma patients. J Surg Res. 2017;207:138–44. https://doi.org/10.1016/j.jss.2016.08.072.

    Article  PubMed  Google Scholar 

  11. Rogers FB, Shackford SR, Horst MA, Miller JA, Wu D, Bradburn E, et al. Determining venous thromboembolic risk assessment for patients with trauma: the trauma embolic scoring system. J Trauma Acute Care Surg. 2012;73(2):511–5. https://doi.org/10.1097/TA.0b013e3182588b54.

    Article  PubMed  Google Scholar 

  12. Zander AL, Van Gent J-M, Olson EJ, Shackford SR, Badiee J, Dunne CE, et al. Venous thromboembolic risk assessment models should not solely guide prophylaxis and surveillance in trauma patients. J Trauma Acute Care Surg. 2015;79(2):194–8. https://doi.org/10.1097/TA.0000000000000439.

    Article  PubMed  Google Scholar 

  13. Caprini J, Arcelus J, Hasty J, Tamhane A, Fabrega F. Clinical assessment of venous thromboembolic risk in surgical patients. Semin Thromb Hemost. 1991;17(Suppl 3):304–12.

    PubMed  Google Scholar 

  14. Gould MK, Garcia DA, Wren SM, Karanicolas PJ, Arcelus JI, Heit JA, et al. Prevention of VTE in nonorthopedic surgical patients: antithrombotic therapy and prevention of thrombosis: American College of Chest Physicians Evidence-Based Clinical Practice Guidelines. Chest. 2012;141(2):e227S–e77S. https://doi.org/10.1378/chest.11-2297.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  15. Surgery CSo. Guidelines for prevention and Management of Perioperative Venous Thrombosis in general surgery in China. Chin J Surg. 2016;54(5):321–7.

    Google Scholar 

  16. Lu Q, Zhang W, Wang X, Niu T, Zhong H, Liu C, et al. Guidelines for prevention of venous thromboembolism of hospitalized patients in Changhai hospital. Hosp Adm J Chin PLA. 2018;25(11):1032–7.

    Google Scholar 

  17. Dashe J, Parisien RL, Pina M, De Giacomo AF, Tornetta P, 3rd. Is the Caprini Score Predictive of Venothromboembolism Events in Orthopaedic Fracture Patients? J Orthop Trauma. 2019;33(6):269–75. https://doi.org/10.1097/BOT.0000000000001451.

  18. Luksameearunothai K, Sa-Ngasoongsong P, Kulachote N, Thamyongkit S, Fuangfa P, Chanplakorn P, et al. Usefulness of clinical predictors for preoperative screening of deep vein thrombosis in hip fractures. BMC Musculoskelet Disord. 2017;18(1):208. https://doi.org/10.1186/s12891-017-1582-5.

  19. Wang X, Yang YQ, Liu SH, Hong XY, Sun XF, Shi J. Comparing different venous thromboembolism risk assessment machine learning models in Chinese patients. J Eval Clin Pract. 2020;26(1):26–34. https://doi.org/10.1111/jep.13324.

    Article  CAS  PubMed  Google Scholar 

  20. Sabra S, Malik KM, Alobaidi M. Prediction of venous thromboembolism using semantic and sentiment analyses of clinical narratives. Comput Biol Med. 2018;94:1–10. https://doi.org/10.1016/j.compbiomed.2017.12.026.

    Article  PubMed  Google Scholar 

  21. Neto EC, Bare JC, Margolin AA. Simulation studies as designed experiments: the comparison of penalized regression models in the “large p, small n” setting. PLoS One. 2014;9(10):e107957. https://doi.org/10.1371/journal.pone.0107957.

    Article  CAS  Google Scholar 

  22. Caprini JA. Thrombosis risk assessment as a guide to quality patient care. Dis Mon. 2005;51(2–3):70–8. https://doi.org/10.1016/j.disamonth.2005.02.003.

    Article  PubMed  Google Scholar 

  23. Tibshirani R. Regression shrinkage and selection via the Lasso. J R Stat Soc B (Methodological). 1996;58(1):267–88.

    Article  Google Scholar 

  24. Le Cessie S, Van Houwelingen JC. Ridge estimators in logistic regression. J R Stat Soc: Ser C: Appl Stat. 1992;41(1):191–201.

    Google Scholar 

  25. Zou H, Hastie T. Regularization and variable selection via the elastic net. J R Stat Soci B (statistical methodology). 2005;67(2):301–20. https://doi.org/10.1111/j.1467-9868.2005.00503.x.

    Article  Google Scholar 

  26. Cover TM, Thomas JA. Entropy, relative entropy and mutual information. Elements Information Theory. 1991;2:1–55.

    Google Scholar 

  27. Bhak Y, Jeong HO, Cho YS, Jeon S, Cho J, Gim JA, et al. Depression and suicide risk prediction models using blood-derived multi-omics data. Transl Psychiatry. 2019;9(1):262. https://doi.org/10.1038/s41398-019-0595-2.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Tajik F, Wang M, Zhang X, Han J. Evaluation of the impact of body mass index on venous thromboembolism risk factors. PLoS One. 2020;15(7):e0235007. https://doi.org/10.1371/journal.pone.0235007.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  29. Gupta P, Chiang SF, Sahoo PK, Mohapatra SK, You JF, Onthoni DD, et al. Prediction of Colon Cancer Stages and Survival Period with Machine Learning Approach. Cancers (Basel). 2019;11(12):2007. https://doi.org/10.3390/cancers11122007.

  30. Bouckaert RR. Choosing Between Two Learning Algorithms Based on Calibrated Tests. Machine Learning, Twentieth International Conference; 2003; Washington DC; 2003.

    Google Scholar 

  31. Krauss ES, Segal A, Cronin M, Dengler N, Lesser ML, Ahn S, et al. Implementation and validation of the 2013 Caprini score for risk stratification of Arthroplasty patients in the prevention of venous thrombosis. Clin Appl Thromb Hemost. 2019;25:1076029619838066. https://doi.org/10.1177/1076029619838066.

  32. Defloor T, Grypdonck MFH. Validation of pressure ulcer risk assessment scales: a critique. J Adv Nurs. 2010;48(6):613–21. https://doi.org/10.1111/j.1365-2648.2004.03250.x.

  33. Fu Y, Liu Y, Chen S, Jin Y, Jiang H. The combination of Caprini risk assessment scale and thrombotic biomarkers to evaluate the risk of venous thromboembolism in critically ill patients. Medicine (Baltimore). 2018;97(47):e13232. https://doi.org/10.1097/MD.0000000000013232.

    Article  Google Scholar 

  34. Bradley M, Shi A, Khatri V, Schobel S, Silvius E, Kirk A, et al. Prediction of venous thromboembolism using clinical and serum biomarker data from a military cohort of trauma patients. BMJ Military Health. 2020; bmjmilitary-2019-001393.

  35. Borch KH, Nyegaard C, Hansen JB, Mathiesen EB, Njølstad I, Wilsgaard T, et al. Joint effects of obesity and body height on the risk of venous thromboembolism: the Tromsø study. Arterioscler Thromb Vasc Biol. 2011;31(6):1439–44. https://doi.org/10.1161/ATVBAHA.110.218925.

    Article  CAS  PubMed  Google Scholar 

  36. Berndtson AE, Costantini TW, Smith AM, Kobayashi L, Coimbra R. Does sex matter? Effects on venous thromboembolism risk in screened trauma patients. J Trauma Acute Care Surg. 2016;81(3):493–9. https://doi.org/10.1097/TA.0000000000001157.

    Article  PubMed  Google Scholar 

  37. Pannucci CJ, Fleming KI. Comparison of face-to-face interaction and the electronic medical record for venous thromboembolism risk stratification using the 2005 Caprini score. J Vasc Surg Venous Lymphat Disord. 2018;6(3):304–11. https://doi.org/10.1016/j.jvsv.2017.10.016.

    Article  PubMed  Google Scholar 

  38. Zhao Y, Dantony E, Roy P. Optimism Bias correction in Omics studies with big data: assessment of penalized methods on simulated data. Omics. 2019;23(4):207–13. https://doi.org/10.1089/omi.2018.0191.

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

Not applicable.

Code availability

The code used in the current study are available from the corresponding author on reasonable request.

Funding

Not applicable.

Author information

Authors and Affiliations

Authors

Contributions

LX.H. and DB.L. designed the whole study framework, interpreted the data, and wrote the manuscript; L.L. and R.L. performed the statistical analysis and data modeling; XL.H. and CW.O. collected patients’ data; GL.W. provided guidance and support on research design, data analysis and critically reviewed the manuscript. All authors approved the final version of the manuscript.

Corresponding author

Correspondence to Guanglin Wang.

Ethics declarations

Ethics approval and consent to participate

The study had the approval from Ethics Committee on Biomedical Research of West China Hospital (No. 2020–411). Due to the retrospective nature of the study, the Ethical Committee on Biomedical Research of West China Hospital waived the need for written informed consent.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

He, L., Luo, L., Hou, X. et al. Predicting venous thromboembolism in hospitalized trauma patients: a combination of the Caprini score and data-driven machine learning model. BMC Emerg Med 21, 60 (2021). https://doi.org/10.1186/s12873-021-00447-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12873-021-00447-x

Keywords

  • Venous thromboembolism
  • Wounds and injuries
  • Risk assessment
  • Machine learning
  • Models, statistical