Cumulative evaluation data: pediatric airway management simulation courses for pediatric residents

Advances in Simulation, Aug 2017

Objectives To utilize cumulative evaluation data of the pediatric airway management simulation-based learning course on knowledge and practical skills of residents in the Saudi Commission for Health Speciality (SCFHS) in order to measure its efficacy and areas for improvement. Methods The evaluation is a retrospective cohort study that compares pre- and post-test (knowledge and skills) of a pediatric airway management simulation course. The 2-day course has been conducted four times annually at CRESENT and is comprised of interactive lectures on airway management and crew resource management, a demonstration of fundamentals of intubation, three skill stations, and six case scenarios with debriefing. Our evaluation data includes all pediatric residents who attended the course between January and December 2015. Results Forty-six residents participated, of whom 30 (65.2%) are male and 16 (34.78%) are female. Overall, there is statistically significant improvement between the pre-test and post-test knowledge and practical skill scores. The pre-test scores are significantly different between the four different resident levels with p values of 0.003 and <0.001 respectively. However, there are no statistically significant differences in the post-test scores among the four different resident levels with p values of 0.372 and 0.133 respectively. The practical skill assessment covers four main domains. Improvements were noted in pharmacology (811%), equipment setup (250%), intubation steps (200%), and patient positioning (130%). The post-test scores are similar in all practical skill categories for the four different residency levels. Discussion Our outcome-based evaluation strategy demonstrated that residents met the course learning objectives. The pediatric airway management simulation course at CRESENT is effective in improving the knowledge and practical skills of pediatric residents. Although the greatest improvement is noted among junior residents, learners from different residency levels have comparable knowledge and practical skills at the end of the course. Things that can be improved based on our study results include stressing more the type and dosages of the medications used in airway management and mandating the course for all junior pediatric residents. Although residents scored well, specific knowledge and skill elements still led us to targeted areas for course excellence. Similar courses need to be integrated in the pediatric residency curriculum. Further research is needed to study skill retention and more importantly its impact on patients’ care. Although resource-intensive, the use of cumulative evaluation data helped to focus quality improvement in our courses.

Article PDF cannot be displayed. You can download it here:

https://link.springer.com/content/pdf/10.1186%2Fs41077-017-0044-3.pdf

Cumulative evaluation data: pediatric airway management simulation courses for pediatric residents

Alyousef et al. Advances in Simulation (2017) 2:11 DOI 10.1186/s41077-017-0044-3 INNOVATION Open Access Cumulative evaluation data: pediatric airway management simulation courses for pediatric residents Sawsan Alyousef1,2*, Haifa Marwa1, Najd Alnojaidi4, Hani Lababidi2 and Muhammad Salman Bashir3 Abstract Objectives: To utilize cumulative evaluation data of the pediatric airway management simulation-based learning course on knowledge and practical skills of residents in the Saudi Commission for Health Speciality (SCFHS) in order to measure its efficacy and areas for improvement. Methods: The evaluation is a retrospective cohort study that compares pre- and post-test (knowledge and skills) of a pediatric airway management simulation course. The 2-day course has been conducted four times annually at CRESENT and is comprised of interactive lectures on airway management and crew resource management, a demonstration of fundamentals of intubation, three skill stations, and six case scenarios with debriefing. Our evaluation data includes all pediatric residents who attended the course between January and December 2015. Results: Forty-six residents participated, of whom 30 (65.2%) are male and 16 (34.78%) are female. Overall, there is statistically significant improvement between the pre-test and post-test knowledge and practical skill scores. The pre-test scores are significantly different between the four different resident levels with p values of 0.003 and <0.001 respectively. However, there are no statistically significant differences in the post-test scores among the four different resident levels with p values of 0.372 and 0.133 respectively. The practical skill assessment covers four main domains. Improvements were noted in pharmacology (811%), equipment setup (250%), intubation steps (200%), and patient positioning (130%). The post-test scores are similar in all practical skill categories for the four different residency levels. Discussion: Our outcome-based evaluation strategy demonstrated that residents met the course learning objectives. The pediatric airway management simulation course at CRESENT is effective in improving the knowledge and practical skills of pediatric residents. Although the greatest improvement is noted among junior residents, learners from different residency levels have comparable knowledge and practical skills at the end of the course. Things that can be improved based on our study results include stressing more the type and dosages of the medications used in airway management and mandating the course for all junior pediatric residents. Although residents scored well, specific knowledge and skill elements still led us to targeted areas for course excellence. Similar courses need to be integrated in the pediatric residency curriculum. Further research is needed to study skill retention and more importantly its impact on patients’ care. Although resource-intensive, the use of cumulative evaluation data helped to focus quality improvement in our courses. * Correspondence: 1 Specialized Children Hospital, King Fahad Medical City, Riyadh, Saudi Arabia 2 Center for Research, Education & Simulation Enhanced Training (CRESENT), King Fahad Medical City, Riyadh, Saudi Arabia Full list of author information is available at the end of the article © The Author(s). 2017 Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated. Alyousef et al. Advances in Simulation (2017) 2:11 Page 2 of 6 Introduction Airway management is a common procedure performed in the Pediatric Intensive Care Unit (PICU) and Emergency Department (ED). In contrast to the clinical experience with elective intubation in the operating room, intubation of critically ill patients has been associated with several complications [1]. Most airway management situations in the PICU/ED are emergent, leaving providers with limited time to perform a systematic airway assessment. Critically ill patients frequently have significant cardiac and pulmonary disease and limited physiologic reserve [2, 3]. These complicating factors commonly result in significant preoxygenation difficulty, limitations in the choice and dose of commonly used induction and paralytic agents, and less time for intubation preparation and performance. Loss of muscle tone, secretions and upper airway edema also increase the technical difficulty of glottis visualization and successful procedure performance [4, 5]. The number of intubation attempts increases the risk of adverse tracheal intubation associated events such as severe hypoxia, hypotension and cardiac arrest [2, 6, 7]. It also increases the risk of intraventricular hemorrhage in low birth weight neonates [8]. The pediatric airway management simulation course is conducted four times per year at CRESENT, King Fahad Medical City (KFMC), Riyadh, Saudi Arabia. The course was adapted from the American College of Chest Physicians (ACCP). The course has been selected by pediatric residents at KFMC in the top five most common simulation courses needed. We wanted to utilize cumulative evaluation data of the pediatric airway management simulation-based learning course on knowledge and practical skills of residents in the Saudi Commission for Health Speciality (SCFHS) in order to measure its efficacy and areas for improvement. with an instructor to resident ratio of 1:6. Learning objectives are listed in Table 1. During the introduction, the course director introduces the instructors and simulation technicians. The course director and instructors are all pediatric intensivists with experience in simulation-based education including targeted training on using simulation to support learning. The faculty has participated in faculty development courses at CRESENT, namely the FD-Sim course, and IMS course from the Center of Medical Simulation (CMS). The residents tour the simulation center and are familiarized with the simulation rooms, debriefing rooms, simulators and all the equipment. The course director introduces the basic assumption and safety container [12]. The simulation rooms resemble PICU rooms and equipped with SimJunior® or SimBaby®, crash cart with a defibrillator and airway tools for infants and children. The course utilizes three skills station rooms: 1) basic airway tools and infant and child intubation heads (Fig. 1), 2) advanced airway tools such as video laryngoscope and intubation bronchoscope and 3) surgical airway tools for cricothyroi (...truncated)


This is a preview of a remote PDF: https://link.springer.com/content/pdf/10.1186%2Fs41077-017-0044-3.pdf
Article home page: https://link.springer.com/article/10.1186/s41077-017-0044-3

Sawsan Alyousef, Haifa Marwa, Najd Alnojaidi, Hani Lababidi, Muhammad Salman Bashir. Cumulative evaluation data: pediatric airway management simulation courses for pediatric residents, Advances in Simulation, 2017, pp. 11, Volume 2, Issue 1, DOI: 10.1186/s41077-017-0044-3