Skip to main content
  • Research article
  • Open access
  • Published:

ABCDE cognitive aid tool in patient assessment – development and validation in a multicenter pilot simulation study

Abstract

Background

The so called ABCDE approach (Airway-Breathing-Circulation-Disability-Exposure) is a golden standard of patient assessment. The efficacy of using cognitive aids (CA) in resuscitation and peri-arrest situations remains an important knowledge gap. This work aims to develop an ABCDE CA tool (CAT) and study its potential benefits in patient condition assessment.

Methods

The development of the ABCDE CAT was done by 3 rounds of modified Delphi method performed by the members of the Advanced Life Support Science and Education Committee of the European Resuscitation Council.

A pilot multicentre study on 48 paramedic students performing patient assessment in pre-post cohorts (without and with the ABCDA CAT) was made in order to validate and evaluate the impact of the tool in simulated clinical scenarios.

The cumulative number and proper order of steps in clinical assessment in simulated scenarios were recorded and the time of the assessment was measured.

Results

The Delphi method resulted in the ABCDE CAT. The use of ABCDE CAT was associated with more performed assessment steps (804: 868; OR = 1.17, 95% CI: 1.02 to 1.35, p = 0.023) which were significantly more frequently performed in proper order (220: 338; OR = 1.68, 95% CI: 1.40 to 2.02, p < 0.0001). The use of ABCDE CAT did not prolong the time of patient assessment.

Conclusion

The cognitive aid for ABCDE assessment was developed. The use of this cognitive aid for ABCDE helps paramedics to perform more procedures, more frequently in the right order and did not prolong the patient assessment in advanced life support and peri-arrest care.

Peer Review reports

Background

The ABCDE assessment (Airway-Breathing-Circulation-Disability-Exposure) is the standard of care used by the European Resuscitation Council for advanced life support and many other international organisations in every patient examination. It is referred to in several parts of the European Resuscitation Council (ERC) Guidelines 2015 [1,2,3,4] and is a part of the curriculum of the ERC Advanced Life Support (ALS) Provider Course as an international standardised course [5]. The ERC Guidelines are one of the few documents that mention ABCDE on such level as international guidelines are. To the best of our knowledge there is no published ABCDE tool used as a cognitive aid (CA) so far and studies addressed this topic are lacking. The use of cognitive aids and its time consumption was also part of International Liaison Committee on Resuscitation PICOs (population, intervention, comparator, outcome) questions [6]. On the other hand there are published CAs and checklists to provide trauma care, which are in many details different from the approach to non-traumatic patients where the ABCDE approach is used. CAs are a promising means of support for resolving complex, rare or critical situations [7]. The effect of each CA should be tested and validated before implementation into the practice.

The primary and main objective of this study is to develop an ABCDE CA tool (CAT). Secondary objective is to examine whether the CAT can improve patient assessment using ABCDE approach in number and order of assessments performed and shortening examination time.

Methods

Development of ABCDE cognitive aid tool

First design of the ABCDE CAT was made by the Non-physician Section of the Czech Society of the Emergency and Disaster Medicine based on the information in the ERC Guidelines and ALS Provider Course Manual [1, 5]. This tool was offered to the ERC ALS Science and Education Committee (SEC). The ERC ALS SEC conducted a modified Delphi process with three consensus rounds including 10 members from the ERC ALS SEC started in December 2018. The processing and design of an individual CA can be evaluated by using the “Cognitive Aids in Medicine Assessment Tool (CMAT)” [8]. The potential advantages are: linear design, single page, simple typeface, minimal use of one colour base for the entire block [9]. A linear design algorithm improves teamwork more than a branched algorithm [10].

Round 1: The first round was done as an electronic survey where respondents could provide free text comments on the first design of the ABCDE CAT– regarding what should be excluded or included. Their responses were collected in 1 month via emails. During the first round of an email communication 11 suggestions for changes were collected. The survey was responded by 4 group members (of 10). Due to the low response rate an email with the suggestions for changes was sent to the other members. All of the 10 respondents agreed with 7 suggestions. Four suggestions were adopted with changes. The survey also resulted in one new suggestion.

Round 2: All comments were added to an online survey (February 2019) and all SEC members voted if they wanted to keep the suggested changes or not. New comments were also collected at this instance. At this point 7 full changes and 4 partial changes were made and the CA was sent again for final comments and suggestions. One new suggestion occurred during the survey. All changes were adopted after the survey and sent out for another round (round 3) of free text comments by email.

Round 3: A teleconference was made to discuss the last changes of content and graphics. The final approval was done after 1 month on 1st May 2019.

Study to validate the ABCDE cognitive aid tool

Study design

A multicentre simulation pilot study on paramedic students performing patient assessment in pre-post cohorts design (without and with the use of ABCDE CA tool) was done in September 2019 in order to evaluate the impact of the ABCDE CA tool. The study took place on two paramedic schools in Prague (Czech Republic).

Representatives of the paramedic programmes of both schools made a written consent to participate in the study. The participation in the study was voluntary for paramedic students. All of the participants made a verbal consent to participate in the study.

The study design is in compliance with Czech legislation and ethical regulations in the Czech Republic. No ethical committee approval was needed.

Study location and setting

Students from two different paramedic schools in Prague participated in the study. Higher Professional School with paramedic study on the level of graduate certificate (Secondary Nursing School and Nursing College 5. kvetna, Prague, Czech Republic) with number of participants n = 24 and University School with paramedic bachelor degree study (Medical College, Prague, Czech Republic) with number of participants n = 24. The schools have different curricula but the same set of final competences of the students.

The simulation part of the study was performed in a simulation centre of the Prague Emergency Medical Services with high fidelity environment.

Eligibility criteria

Only students who completed their first and second year of the full-time study programme were included. Students with ongoing jobs as paramedic, emergency medical technician or nurse were excluded.

The potential bias of the students experience with ABCDE approach as part of school curricula was minimised by using two different schools with different curriculum, but the same competences after graduation, and students from different years of study. To minimise the influence of the researchers the simulations were evaluated by two observers and the results were analysed by two independent researchers.

The group of students consisted of 48 students, 46 students of them (95.8%) were familiar with the ABCDE approach before the study but 0 (0%) had specific training in the ABCDE approach.

Interventions

All study participants performed patient assessment alone without any further help on scene. There was an instructor of the scenario and the patient was impersonated by an experienced paramedic responding realistically according to the scenario (standardized patient). The assessment findings were as presented by the actor and if some invasive examination was needed the lead instructor provided the results. All standard equipment of an emergency department was on a trolley. In scenario 2 (described later) the participants got the ABCDE cognitive aid at the beginning of the simulation without any other preparation or instructions on how to use it.

Each participant did two similar scenarios (first without and then with the ABCDE CA tool) with at least 1 h break between the scenarios. The descriptions of the scenarios are shown below. During 5 min of briefing the participants were asked to perform a proper A-to-E assessment during the simulation, without pointing out the endpoints of the study.

Simulated scenario 1 (without the ABCDE cognitive aid). Situation: A gentlemen (born 1945) brought by his wife to the emergency department of the university hospital. He hasn’t been feeling well since yesterday, he is weak and slightly confused. You are asked to perform an examination on Emergency Department (ED) including all diagnostic aids.

Simulated scenario 2 (with the ABCDE cognitive aid). Situation: A gentlemen (born 1950) coming to the emergency department of the university hospital. He hasn’t been feeling well since yesterday and feels weakness of his legs. You are asked to perform an examination on ED including all diagnostic aids.

Outcome measures

There was a total of 1584 potential assessment steps to achieve during each scenario by all participants (each scenario has 33 assessment steps, multiplied by number of participating paramedic students). The time needed to resolve the scenarios was tested by the ALS instructors and identically determined for both scenarios to be 5 min.

Two instructors recorded the results of each paramedic’s assessment of the standardized patients in the scenarios using evaluation forms with three columns (Fig. 1). The participant’s steps in patient assessment were evaluated as: “Made in the right order”, “Made in wrong order” and “Not made at all”. Only fully and correctly performed assessments and interventions were evaluated as complete. Instructors also measured the time needed to complete the A-to-E assessment.

Fig. 1
figure 1

Evaluation form. Legend: RR – respiratory rate; CRT – capillary refill time; BP – blood pressure; ECG – electrocardiogram; IV – intravenous; AVPU – Alert/Voice/Pain/Unresponsive; GCS – Glasgow Coma Scale

Sample size and data analysis

This is pilot study with no available data from previous studies. The sample size was not determined and calculated before starting the study. The cohort of paramedics was chosen and defined on a voluntary basis from cooperating schools.

Statistical methods

Odds ratios were used to compare the proportions of correctly and timely performed steps in patient assessment with and without ABCDE cognitive aid tool. The duration of the assessment with and without CA was tested by Mann-Whitney U test after exclusion of normal data distribution by Kolmogorov-Smirnov Test. Data are presented as median and 25th a 75th percentile. Statistical software STATISTICA 7.0 (StatSoft, Inc., Tulsa, Oklahoma, USA) was used for statistical analysis, calculations and creating graphs. The significance level was stated as p < 0.05.

Results

Primary objective, the ABCDE cognitive aid tool development

The final design of the ABCDE CA tool made during the Delphi method is shown in Fig. 2. The main aim of the tool is to visualise the assessment measures in primary and secondary assessment and to set the goal of each part (A-B-C-D-E).

Fig. 2
figure 2

ABCDE tool

Validation pilot study results

The participant characteristics are presented in Table 1. The use of the ABCDE CAT was associated with more performed assessment steps (804 steps without and 868 with the CAT; OR = 1.17, 95% CI: 1.02 to 1.35, p = 0.02) which were significantly more frequently performed in proper order (220 without and 338 with the CAT; OR = 1.68, 95% CI: 1.40 to 2.02, p < 0.001) (Table 2). The use of ABCDE CA did not shorten or prolong the median time of patient assessment significantly (6.88 [5.17; 9.56] minutes) vs (5.79 [5.19; 7.32] minutes); (U = 921, Z = − 1.69, p = 0.09, r = − 0.018) (Fig. 3).

Table 1 Participant characteristics
Table 2 Objective measurements
Fig. 3
figure 3

Graph of time needed to perform ABCDE evaluation. Legend: Data in box plots with whiskers are median, quartiles and range

Discussion

The main finding of the study is that the newly developed ABCDE cognitive aid (CA) tool can be used to facilitate patient assessment. When used, participants provide more diagnostic steps and also more steps in the right order without consuming more time, but the results are not significant as this is only a pilot simulation study.

The primary objective of this study was to design a novel cognitive aid for patient assessment based on the ABCDE approach. The ABCDE CA is in compliance with the CMAT in the way of linear design, colours, single page and a very simple typeface, which might affect the use of it in clinical practice.

The use of cognitive aids in advanced life support have received special attention in the recent years [11,12,13]. The main objective of CAs is to support the execution of all the diagnostic and treatment steps in the right order and to improve technical and non-technical skills [14,15,16,17]. This statement was the basis for determination of the secondary objective – validation of the tool. The validation was done in a pilot design with voluntarily participating students. In the pilot design the ABCDE CA helped participants of this study to perform a proper A-to-E examination. Other studies also stated that CAs help to ensure that all treatment steps are performed in the right order. While they are no substitute for the expertise of the team members, CAs are an important tool for multidisciplinary teams [15, 18].

On the other hand, it has also been shown that cognitive aids that are not routinely used or are used only with minimal training are not well understood. In crisis situations they can be applied inappropriately, thus they may cause more uncertainty [19, 20]. Cognitive aid users often skip critical steps, deviate from recommended procedures or do not use the aids at all, despite evaluating them positively [20,21,22]. The results of this study support the statement that this particular CA is facilitating patient assessment. Students and young medical providers might derive a greater benefit from the use of CA [7]. Other studies confirm that CA is often used by younger groups as well as the most experienced providers. They are used least by healthcare providers with 2–10 years’ experience [12]. In this study the participants were all at the beginning of their professional career and the results support the claim that the ABCDE CA helps young providers.

Gilfoyle E et al. [6] published a systematic review on Cognitive Aids in Resuscitation where is mentioned that CA might prolong some procedures during resuscitation. In this study with limited number of participants the time needed to provide proper simulated patient assessment was not prolonged. Another study with greater population is needed to find out the effect of this particular tool on time consumption.

Studies also stated that CA increase the safety of provided care [23,24,25]. Similarly, there is the parallel of our work with research focused on the impact of the Pre-Hospital Trauma Life Support training program on improving the quality of documentation in trauma [26]. This CA seems to be a promising tool to facilitate patient assessment in education and also in clinical practice. The safety of care might be increased with clinicians providing more diagnostic steps and also more steps in the right order. Students might benefit from use of the tool when learning patient assessment in the early stage of the study process.

This pilot study brings another hypothesis for further research. A randomised controlled trial is needed to verify the results of this pilot study. More participants are needed to prove the effect on time consumption.

Limitations

As this is a pilot study, we agree that a larger group of participants, randomisation and blinded design will be needed for more accurate results. This is also a simulation study without a validated assessment protocol. Authors used the students as participants to minimise the impact of personal professional experience of working paramedics, but the pre-screening of the students’ knowledge was done by a questionnaire only. This was an observational study, and the learning effect from the first simulation to the second cannot be excluded either. This study aimed at mastering all the steps of the ABCDE approach and they were given the same weight as this CA is not aiming on improvement of the quality of each step. We also did not evaluate any differences between the two schools as their students are comparable.

Conclusion

This newly developed ABCDE cognitive aid chart could be used as a cognitive aid during patient assessment. The use of this cognitive aid is associated with more procedures being performed and in the right order during patient assessment provided by students. The use of cognitive aid did not prolong the examination time.

Availability of data and materials

Data set is available on a reasonable request from the corresponding author.

Abbreviations

ALS:

Advanced Life Support

CA:

Cognitive aid

CAT:

Cognitive aid tool

CMAT:

Cognitive Aids in Medicine Assessment Tool

ECG:

Electrocardiogram

ED:

Emergency department

ERC:

European Resuscitation Council

ILCOR:

International Liaison Committee on Resuscitation

OR:

Odds ratio

PICO:

Population, intervention, comparator, outcome

SEC:

Science and Education Committee

References

  1. Soar J, Nolan JP, Böttiger BW, et al. European resuscitation council guidelines for resuscitation 2015: section 3. Adult advanced life support. Resuscitation. 2015;95:100–47. https://doi.org/10.1016/j.resuscitation.2015.07.016.

    Article  PubMed  Google Scholar 

  2. Maconochie IK, Bingham R, Eich C, et al. European resuscitation council guidelines for resuscitation 2015. Section 6. Paediatric life support. Resuscitation. 2015;95:223–48. https://doi.org/10.1016/j.resuscitation.2015.07.028.

    Article  PubMed  Google Scholar 

  3. Truhlář A, Deakin CD, Soar J, et al. European resuscitation council guidelines for resuscitation 2015. Section 4. Cardiac arrest in special circumstances. Resuscitation. 2015;95:148–201. https://doi.org/10.1016/j.resuscitation.2015.07.017.

    Article  PubMed  Google Scholar 

  4. Greif R, Lockey AS, Conaghan P, et al. European resuscitation council guidelines for resuscitation 2015. Section 10. Education and implementation of resuscitation. Resuscitation. 2015;95:288–301. https://doi.org/10.1016/j.resuscitation.2015.07.032.

    Article  PubMed  Google Scholar 

  5. Lott C et al. Advanced life support: course manual. European Resuscitacion Council; 2015.

    Google Scholar 

  6. Gilfoyle E, Duff J, Bhanji F, et al. Cognitive Aids in Resuscitation (EIT #629): Systematic Review. Int Liaison Comm Resusc Educ Implement Teams Task Force. 2020;online. Accessed 22 July 2020. https://costr.ilcor.org/document/cognitive-aids-in-resuscitation-eit-629-systematic-review.

  7. St.Pierre M, Luetcke B, Strembski D, Schmitt C, Breuer G. The effect of an electronic cognitive aid on the management of ST-elevation myocardial infarction during caesarean section: A prospective randomised simulation study. BMC Anesthesiol. 2017;17(1). doi:https://doi.org/10.1186/s12871-017-0340-4.

  8. Evans D, McCahon R, Barley M, Norris A, Khajuria A, Moppett I. Cognitive AIDS in medicine assessment tool (CMAT): preliminary validation of a novel tool for the assessment of emergency cognitive AIDS. Anaesthesia. 2015;70(8):922–32. https://doi.org/10.1111/anae.13015.

    Article  CAS  PubMed  Google Scholar 

  9. King R, Hanhan J, Harrison TK, et al. Using eye tracking technology to compare the effectiveness of malignant hyperthermia cognitive aid design. Korean J Anesthesiol. 2018;71(4):317–22. https://doi.org/10.4097/kja.d.18.00016.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Marshall SD, Sanderson P, McIntosh CA, Kolawole H. The effect of two cognitive aid designs on team functioning during intra-operative anaphylaxis emergencies: a multi-Centre simulation study. Anaesthesia. 2016;71(4):389–404. https://doi.org/10.1111/anae.13332.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  11. Committee Opinion No. 680 Summary. Obstet Gynecol. 2016;128(5):1200. doi:https://doi.org/10.1097/aog.0000000000001766.

  12. Krombach JW, Edwards WA, Marks JD, Radke OC. Checklists and other cognitive aids for emergency and routine anesthesia care-a survey on the perception of anesthesia providers from a large academic US institution. Anesthesiol Pain Med. 2015;5(4). doi:https://doi.org/10.5812/aamp.26300v2.

  13. Hales B, Terblanche M, Fowler R, Sibbald W. Development of medical checklists for improved quality of patient care. Int J Qual Heal Care. 2008;20(1):22–30. https://doi.org/10.1093/intqhc/mzm062.

    Article  Google Scholar 

  14. Marshall SD, Mehra R. The effects of a displayed cognitive aid on non-technical skills in a simulated “can’t intubate, can’t oxygenate” crisis. Anaesthesia. 2014;69(7):669–77. https://doi.org/10.1111/anae.12601.

    Article  CAS  PubMed  Google Scholar 

  15. Eberl S, Koers L, Van Haperen M, Preckel B. Cognitive aids: “a must” for procedures performed by multidisciplinary sedation teams outside the operation room? BMJ Case Rep. 2017;2017. https://doi.org/10.1136/bcr-2017-221645.

  16. Marshall SD. Lost in translation? Comparing the effectiveness of electronic-based and paper-based cognitive AIDS. Br J Anaesth. 2017;119(5):869–71. https://doi.org/10.1093/bja/aex263.

    Article  CAS  PubMed  Google Scholar 

  17. Lelaidier R, Balança B, Boet S, et al. Use of a hand-held digital cognitive aid in simulated crises: the MAX randomized controlled trial. Br J Anaesth. 2017;119(5):1015–21. https://doi.org/10.1093/bja/aex256.

    Article  CAS  PubMed  Google Scholar 

  18. Macdougall N, Dong F, Broussard L, Comunale ME. Preventing Mistransfusions: an evaluation of institutional knowledge and a response. Anesth Analg. 2018;126(1):247–51. https://doi.org/10.1213/ANE.0000000000002443.

    Article  PubMed  Google Scholar 

  19. Weiss MJ, Kramer C, Tremblay S, Côté L. Attitudes of pediatric intensive care unit physicians towards the use of cognitive aids: A qualitative study. BMC Med Inform Decis Mak. 2016;16(1). doi:https://doi.org/10.1186/s12911-016-0291-6.

  20. Watkins SC, Anders S, Clebone A, et al. Paper or plastic? Simulation based evaluation of two versions of a cognitive aid for managing pediatric peri-operative critical events by anesthesia trainees: evaluation of the society for pediatric anesthesia emergency checklist. J Clin Monit Comput. 2016;30(3):275–83. https://doi.org/10.1007/s10877-015-9714-7.

    Article  PubMed  Google Scholar 

  21. Nelson KL, Shilkofski NA, Haggerty JA, Saliski M, Hunt EA. The use of cognitive aids during simulated pediatric cardiopulmonary arrests. Simul Healthc. 2008;3(3):138–45. https://doi.org/10.1097/SIH.0b013e31816b1b60.

    Article  PubMed  Google Scholar 

  22. Hilton G, Daniels K, Goldhaber-Fiebert SN, Lipman S, Carvalho B, Butwick A. Checklists and multidisciplinary team performance during simulated obstetric hemorrhage. Int J Obstet Anesth. 2016;25:9–16. https://doi.org/10.1016/j.ijoa.2015.08.011.

    Article  CAS  PubMed  Google Scholar 

  23. Hart EM, Owen H. Errors and omissions in anesthesia: a pilot study using a pilot’s checklist. Anesth Analg. 2005;101(1):246–50. https://doi.org/10.1213/01.ANE.0000156567.24800.0B.

    Article  PubMed  Google Scholar 

  24. Ziewacz JE, Arriaga AF, Bader AM, et al. Crisis checklists for the operating room: development and pilot testing. J Am Coll Surg. 2011;213(2):212–7.e10. https://doi.org/10.1016/j.jamcollsurg.2011.04.031.

    Article  PubMed  Google Scholar 

  25. Arriaga AF, Bader AM, Wong JM, et al. Simulation-based trial of surgical-crisis checklists. N Engl J Med. 2013;368(3):246–53. https://doi.org/10.1056/NEJMsa1204720.

    Article  CAS  PubMed  Google Scholar 

  26. Häske D, Beckers SK, Hofmann M, et al. Quality of Documentation as a Surrogate Marker for Awareness and Training Effectiveness of PHTLS-Courses. Part of the Prospective Longitudinal Mixed-Methods EPPTC-Trial. PLoS One. 2017;12(1):e0170004. https://doi.org/10.1371/journal.pone.0170004.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

The authors would like to thank all the people who participated in the consensus process, the students who agreed to participate in the study, and the ERC ALS Science and Education Committee members for support and participation on the mDelphi method (in alphabetical order: Carmona Francesc, Cimpoesu Diana, Greif Robert, Lott Carsten, Lulic Ileana, Mpotos Nicolas, Mustafa Tageldin Mahmoud, Peran David, Sari Ferenc, Schlieber Joachim, Truhlar Anatolij, Yeung Joyce).

Funding

No funding. This work received no specific grant from any funding agency in the public, commercial or non-profit sectors.

Author information

Authors and Affiliations

Authors

Contributions

DP, JK, AT are authors of the first ABCDE chart, DP, AT, KGL and FS prepared and evaluated the mDelphi method and made the final cognitive aid. DP, PCM, LM, RS and JP prepared the validation process and made the simulations. RS, DP, JP and PCM made the statistical analysis and manuscript draft, DP, KGL and RS critically revised and edited the manuscript and made the final version. All authors read and approved the manuscript.

Corresponding author

Correspondence to David Peran.

Ethics declarations

Ethics approval and consent to participate

No interventions on patients were done and there is no need for ethical approval in the Czech Republic (Act No. 378/2007 Sb., 226/2008 Sb. and 268/2014 Sb.). Verbal consent to participate was obtained by all students and written consent by school representatives according to the Czech legislation.

Consent for publication

Not applicable.

Competing interests

Authors DP, FS, KGL, and AT are members of the ERC ALS Science and Education Committee. Other authors declare no conflicts of interest.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Description of Scenario 1 and Scenario 2.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Peran, D., Kodet, J., Pekara, J. et al. ABCDE cognitive aid tool in patient assessment – development and validation in a multicenter pilot simulation study. BMC Emerg Med 20, 95 (2020). https://doi.org/10.1186/s12873-020-00390-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12873-020-00390-3

Keywords