Welcome to Journal Of Pakistan Medical Association
October, 2017 >>

Simulation based medical education; teaching normal delivery on intermediate fidelity simulator to medical students

Nighat Shah, Lubna Baig  ( Appna Institute of Public Health, Jinnah Sindh Medical University, Karachi )

Nusrat Shah  ( Department of Obstetrics & Gynecology, Dow University of Health Sciences, Karachi )

Riffat Hussain  ( Department of Radiology, Aga Khan University Hospital, Karachi, Pakistan )

Syed Moyn Aly  ( Department of Medical Education, College of Medicine, Taif University, Saudi Arabia. )

Abstract

Objective: To assess the effectiveness of medium fidelity simulator in teaching normal vaginal delivery to medical students.

Methods: The quasi-experimental study was conducted at the professional development centre of the Jinnah Sindh Medical University, Karachi, from June to December 2015, and comprised medical students. Third-year medical students were included. They were divided into two groups. Group A was taught normal delivery through traditional PowerPoint and group B through simulator. The instruments used for assessing knowledge were pre-test and post-test, for skills of labour/delivery checklist of performance was used, and perception forms were filled to evaluate workshops/learning environment by students.

Results: Of the 76 participants, there were 36(47.4%) in group A and 40(52.6%) in group B. The overall mean age of the participants was 20.86±0.76 years in group B and 20.60±0.95 years in group A (p=0.19). The mean grade point average of the participants was 2.89±0.47 in group A and 2.87±0.48 in group B (p=0.81).Group B performed much better in skill of delivery having a mean score of 8.91±3.20compared to group A which had mean of 5.67±1.84 (p<0.01).
Conclusion:
Simulation-based skill learning showed significantly better results.
Keywords:
Simulation, Medical education, Intermediate fidelity, Maternal mortality. (JPMA 67: 1476; 2017)

Introduction

A simulation is a virtual reality, an experience that may reproduce reality events or phenomena.1 Modern medical education greatly values simulation as it replicates reality without associated risks and harm.2 Trial and error on human patients is morally and ethically unacceptable. Since the Hippocratic days, the medical mantra stays the same: first, do no harm. The patient safety movement based on research highlights a huge number of avoidable patient injuries due to medical management. This has re-established the principle of "first, do no harm" in policy discussions and debates.3 Simulation offers a suitable alternative.4

Globally, around 289,000 maternal deaths, 2.6 million stillbirths and 2.4 million newborn deaths occur each year, with the majority of them occurring at the time of childbirth. Most maternal and newborn deaths are preventable. There is a need to have health care providers who are well versed in the management of pregnancy and childbirth.5,6

Preventing maternal and neonatal morbidity and mortality is a universal priority, especially in Pakistan where maternal mortality is second highest in the region at 276/100,000, according to Pakistan Demographic and Health Survey (PDHS) of 2013.6 All health care providers need to learn the art and science of normal delivery to save precious lives.7

Learning delivery is stressful in a labour room and can conflict with the safety of mother/neonate. Furthermore, in our conservative society many women do not generally consent to be examined by male students. Medical simulation has been proposed as a technique to bridge this educational gap.4

The current study was conducted to assess the effectiveness of medium fidelity simulator in teaching normal vaginal delivery to medical students.

Subjects and Methods


The quasi-experimental study was conducted at the professional development centre (PDC) of the Jinnah Sindh Medical University (JSMU), Karachi, from June to December 2015, and comprised medical students.

Approval was obtained from the institutional review board (IRB). Two groups of students were compared on their knowledge, skills and perceptions with regards to the traditional and new teaching method. Group A comprised controls who were taught normal delivery through PowerPoint interactive lecture, while the experimental group B was taught normal delivery on medium fidelity simulator.

JSMU has Sindh Medical College for undergraduate medical education and is affiliated with Jinnah Postgraduate Medical Centre (JPMC), National Institute of Cardiovascular Diseases (NICVD) and National Institute of Child Health (NICH).

Third-year medical students were included in the study.

This study gave equal priority to both male and female students. The only reason there were more females in both groups was that the class had 75% girls. Non-probability, convenience sampling was used. It is important that students who had just started and those who will start rotation in obstetrics and gynaecology (OB/GYN) should be enrolled for the workshops, as the learning will be strengthened in labour ward. The sample was based on the number of medical students available at that time; all medical students who were rotating through the obstetrics and gynaecology clerkship during that time frame were included in the control group. The experimental group students were to be posted in OB/GYN a month later, so that the skill taught on mannequin could be reinforced.

Medical students who had already learnt normal delivery or completed their rotation in OB/GYN were excluded.

This was a medical education intervention study, comparing the most appropriate method of transferring obstetrics delivery skills. In medical education intervention studies, it is not possible to do random sampling because it is not possible to control for the contamination and blinding.

The groups and batches were already made for rotations and as per objective of the study the group which was posted in OB/GYN and the one about to be posted in OB/GYN were asked to participate in the study so that the skills learnt on the simulator were observed and learnt on real patient. Further simulators are resource intense and hands-on practice to transfer skills has to be on limited number of participants for optimum learning.

On the sample size, a study done on evaluating and researching the effectiveness of educational interventions says:

In educational research, especially in postgraduate and continuing medical education, the numbers that can be enrolled in a study may not be large to allow researchers to achieve statistically significant quantitative results.8

A study on "surgical skills training: simulation and multimedia combined" had 14 participants in 3 groups.9

Another study conducted on the undergraduate inter-professional education using high-fidelity paediatric simulation also had the sample size of 49 participants in each group.10

The number of participants in each group in the current study was similar to other studies. A study on vicarious learning during simulations quoted 33 students in each group.11

Informed consent was obtained from all participants. The teaching/learning workshops then started with the introduction of faculty and participants. Faculty for the sessions included primary investigator and 2 lecturers. Primary researcher conducted the teaching session. An objective structured clinical examination (OSCE) was conducted by lecturers to reduce bias. The students were introduced to the teaching session for normal delivery, which gave them the brief of process and also informed them that no personal data will be shared. The data generated was analysed and used in aggregate only for research purposes. A pre-test was conducted before the start of the workshop. This test consisted of basic labour delivery knowledge component. It also had some demographic questions like name, age, sex, prior experience of performance of normal delivery and students grade point average (GPA). The questions were based on the stages of labour and management of all three stages of labour. The post-test was the same, because the purpose was to see the change in knowledge.

The workshop in control group started with PowerPoint having essential evidence based information about labour/delivery. It covered global maternal morbidity and mortality data, Pakistan data and then stages of labour and management of the stages of labour. When discussing management, two short videos of steps of delivery were also shown. The session was highly interactive and was paced as per needs of learners.

The experimental group teaching was through simulator. This was through intermediate fidelity simulator, which was partially mechanical and partially manual. On moving the wheel on one side the baby performed the essential second stage rotations and delivered through maternal birth canal mimicking normal birth. The simulator had an anterior view having baby and maternal abdomen.(figure 1)



The students were then exposed to simulator exercise. The students were asked to believe that the simulator was the birthing mother (R) and they were to interact with this mother as a real patient. They learnt and practised labour and delivery and also communication skills and worked in teams. The students adjusted the movements of simulator as per their own learning and practised till they were fully satisfied.

After this learning workshop, both the groups had to perform skill-based exam to demonstrate their skill. Under direct supervision of faculty, the students had to effectively communicate with virtual patient, which was low fidelity simulator and also perform the steps of normal delivery. This process was marked as per standardised checklist.

In the end, all students filled perception forms. These were standard evaluation forms including, knowledge, procedural skills, and communication skills.

Data collection was through checklist, pre-test and Post-test and students' perception forms of education experience. These instruments were formed after reviewing medical education research literature and expert review for face and content validity.

The data was cross-validated by random checking. SPSS was used for data analysis. Categorical variables were summarised by frequencies and percentages, while for continuous variables means and standard deviation was used. For all statistical analyses, p< 0.05 was considered significant.

The descriptive categorical variables of the participants (gender, level of experience) were compared for both groups by applying chi-square test. Independent sample t-test was used for comparing descriptive continuous variables (age, 1st-year GPA). Fisher's exact test was applied for categorical variables when there were less than 5 participants in any category. Internal reliability of instrument items was conducted through Cronbach's alpha.

The data analysis was done on SPSS version 20.
  
Results

Of the 76 participants, there were 36(47.4%) controls in group A and 40(52.6%) in the experimental group B. Overall, 65(85.5%) of them were girls and 11(14.5%) were boys.

The overall mean age of the participants was 20.86±0.76 years in the control group and 20.60±0.95 years in the experimental group (p=0.19). The mean GPA of the participants was 2.89±0.47 in group A and 2.87±0.48 in group B (p=0.81)(Table-1).



The pre- test mean score was 3.33±1.45 in the control and 3.58±1.74 in the experimental group (p=0.51). The mean post-session test scores were 7.11±1.30 and 6.95±1.68 in groups A and B, respectively (p=0.64). The perception forms were scored through Likert scale from 0-5. Both the groups rated teaching experience and environment highly, with the mean score of 91.83±8.46 among controls and 90.45±7.87 in the experimental group (p=0.47). The skill was assessed by checklist/OSCE scores; the experimental group had a mean score of 8.91±3.20 as compared to the control group which had a mean score of 5.67±1.84 (p<0.01)(Table-2).



Discussion


This study on simulation-based medical education determined innovative teaching method of simulation-based medical education (SBME) in obstetrics. The independent variable was teaching methodology, traditional (PowerPoint presentation) vs. simulation on intermediate fidelity simulator (Power Point plus simulator) and the dependent variables were students' scores in pre-test, post-test, OSCE for skill performance, and students' perception forms.

Our study showed that teaching medical students on simulator provided much better learning experience as compared to controls. This has been shown in other studies as well, including those conducted by Deering et al.13 and Issenberg et al.,14 who showed improvement in performance of specific tasks/ skills when learning was conducted on simulator. Simulations are now in wide-spread use in medical education and provide many advantages as compared to didactic teaching/ learning methodology.12-14 In a teaching process, which is focused on psychomotor processes the didactic or traditional methods of teaching has to be strengthened by hands on practice.1 Teaching them first line on patients has many dilemmas and literature is now abundant on patient safety priority.4

In skill-based studies, the trend has been the same. The study on practice of caesarean section on an obstetrics simulator reported higher levels of confidence in residents regarding their skills to assist caesarean section and perform abdominal closure during caesarean section under minimal supervision.15

A growing body of evidence shows that clinical skills acquired in medical simulation laboratory settings transfer directly to improved patient care practices and better patient outcomes. Examples of improved patient care practices linked directly to simulation mostly includes emergency drills in obstetrics include studies of better management of difficult obstetrical deliveries, including shoulder dystocia.16

The knowledge component in both groups improved significantly, as checked by pre-test and post-test. In the study by Clark and Paparello, the pre-test and post-test were skill-based and intervention was on simulator. The results of that study demonstrated significant improvement;17 pre- and post-tests were knowledge-based pen and pencil tests and skill element was checked through practical assessment on low fidelity simulator (OSCE). There are, however, other studies like the one by Jude et al. where the skill was assessed by student's perception forms. The students rated high confidence in skill.18

The studies to date have aptly documented the effectiveness of simulation-based learning, especially in neonatal resuscitation and obstetric emergencies like post-partum haemorrhage,19 eclampsia,20,21 sepsis, cord prolapse,22 breech delivery,23 and shoulder dystocia.24

Normal delivery can be complicated by an emergency at any time, especially if it is not performed safely. Maternal morbidity and mortality is unpredictable and is highest during labour / delivery.25 Skills and drills competency-based training is successful in improving knowledge and skills as seen in current study and international research. The skills and drills are most appropriately conducted by simulation-based education for emergency obstetrics and newborn care. As it allows reflection, trial and error practice, provides feedback and stress free controlled environment.26

Simulation is an expensive teaching modality, especially when its conducted for skills and assessment, it's important to conduct vigorous research to justify its routine use and the cost.27 In index study found profound conceptual change in knowledge, significant difference in task performance along with soft skills like body language and communication skills. One randomised control trial found no difference in scores when comparing video / visual learning to simulation.28

In the performance of delivery the components were per-abdominal examination, per vaginal examination, showing the rotations of foetal head, recognising crowing and delivery of foetus. In all these components the experimental group performed much better and the results were statistically significant. This is also shown in many international studies that task performance improves significantly after learning on simulators.29,30

The students filled perception forms to evaluate the workshop and learning environment. The experimental group scored highly as is shown by literature as well. Students rate these opportunities of integrated learning very highly. This included knowledge,31 skills,32,33 communication skills, teamwork, faculty support and teaching/leaning environment. Both groups rated it highly.34,35

The findings of this study regarding students' positive perceptions of SBME as a teaching strategy are consistent with data reported throughout the medical education literature.36,37 Additionally, the control group was equal if not better satisfied with teaching session. This could be due to various reasons: firstly, their session was extremely interactive and thought-provoking, secondly, it had two videos, and thirdly, knowledge component was comprehensively dealt with and students were given individual attention. Last but not least, as students were not part of simulation workshop they didn't know that any better teaching modality exists. The very fact that their performance for conducting labour and delivery on low fidelity simulator checklist was less than experimental group confirms that they were not able to learn the skill well. This means learning skills requires different modality of teaching as compared to knowledge.38

The current study was not without its limitations. This was a small study, with limited resources and therefore low fidelity and intermediate fidelity simulators were used. The skills learnt were not assessed on real patients. In the present study, intermediate and low fidelity simulators were used due to cost and constraints of availability.

The skills that students learned in this workshop were assessed on simulator and not on real patients. Therefore, whether or not this skill will be translated to actual improvement in practice is not known and this is one area in which further research should be carried out.

Simulation-based education requires hands-on teaching and therefore only limited number of students can be accommodated at a particular time. This was because the teaching and learning workshops could not cater to large group for individualised teaching as is required in simulation-based learning. This is one drawback of this method of teaching as well in addition to being resource intense.

The study also had a few strengths. For instance, had a control group which was compared with the experimental group. The students learnt concepts of delivery and also performed in controlled environment. They gained confidence as shown through OSCE and perception forms. The study was conducted from different angles and data was collected through pre-test, post-test for knowledge improvement, checklist/OSCE to evaluate the confidence in performing the skill and finally students' own perceptions of learning.

Students rated the learning experience highly.

Conclusion


Simulation-based skill learning showed significantly better results as seen through performance in OSCE. It is known now for more than a decade that simulation-based medical education is evidence-based teaching learning modality. Unfortunately, it is still not incorporated in the undergraduate curriculum. Through this study we recommend regular use of low-cost simulators for obstetric curriculum. It translates into more confident skilled birth attendants.

Future research can be conducted to justify the need of high fidelity, computer-based simulators and whether they are essential and cost-effective in low-resource setting. Further research is also required to see if students can retain this skill and are confident in performing delivery in labour room on an actual patient.

Disclaimer: None.
Conflict of Interest: None.
Source of Funding: None.

 
References

1. Torkington J, Smith S, Rees B, Darzi A. The role of simulation in surgical training. Ann R Coll Surg Engl  2000; 82: 88

2. Maran N, Glavin R. Low-to high-fidelity simulation - a continuum of medical education? Med Educ 2003; 37: 22-8.

3. Johannsson H, Ayida G, Sadler C. Faking it? Simulation in the training of obstetricians and gynaecologists. Curr Opin Obstet Gynecol 2005; 17: 557-61.

4. Ennen CS, Satin AJ. Training and assessment in obstetrics: the role of simulation. Best Pract Res Clin Obstet Gynaecol 2010; 24: 747-58.

5. Mahmood A, Sultan M. National Institute of Population Studies (NIPS)(Pakistan), and Macro International Inc. Pakistan Demographic Health Survey 2006; 7: 123-45.

6. NIPS. Pakistan Demographic Health Survey. Islamabad, Pakistan, and Calverton, Maryland, USANational Institute of Population Studies (NIPS) and ICF International, 2012-2013.

7. Campbell OM, Graham WJ, Lancet Maternal Survival Series steering group. Strategies for reducing maternal mortality: getting on with what works. Lancet 2006; 368: 1284-99.

8. Hutchinson L. Evaluating and researching the effectiveness of educational interventions. Br Med J 1999; 318:1267.

9. Kneebone R, ApSimon D. Surgical skills training: simulation and multimedia combined. Med Educ 2001; 35: 909-15.

10. Stewart M, Kennedy N, Cuene-Grandidier H. Undergraduate interprofessional education using high-fidelity paediatric simulation. Clin Teach 2010; 7: 90-6.

11. Stegmann K, Pilz F, Siebeck M, Fischer F. Vicarious learning during simulations: is it more effective than hands-on training? Med Educ 2012; 46: 1001-8.

12. Good M. Patient simulation for training basic and advanced clinical skills. Med Educ 2003; 37: 14-21.

13. Deering S, Poggi S, Macedonia C, Gherman R, Satin AJ. Improving resident competency in the management of shoulder dystocia with simulation training. Obstet Gynecol 2004; 103: 1224-8.

14. Barry Issenberg S, Mcgaghie WC, Petrusa ER, Lee Gordon D, Scalese RJ. Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review. Med Teach 2005; 27: 10-28.

15. Vellanki VS, Gillellamudi SB. Teaching surgical skills in obstetrics using a cesarean section simulator-bringing simulation to life. Adv Med Educ Pract 2010; 1: 85.

16. Draycott TJ, Crofts JF, Ash JP, Wilson LV, Yard E, Sibanda T, et al. Improving neonatal outcome through practical shoulder dystocia training. Obstet Gynecol 2008; 112: 14-20.

17. Clark EG, Paparello JJ, Wayne DB, Edwards C, Hoar S, McQuillan R, et al. Use of a national continuing medical education meeting to provide simulation-based training in temporary hemodialysis catheter insertion skills: a pre-test post-test study. Can J Kidney Health Dis 2014; 1: 25.

18. Jude DC, Gilbert GG, Magrane D. Simulation training in the obstetrics and gynecology clerkship. Am J Obstet Gynecol 2006; 195: 1489-92.

19. Deering SH, Chinn M, Hodor J, Benedetti T, Mandel LS, Goff B. Use of a postpartum hemorrhage simulator for instruction and evaluation of residents. J Grad Med Educ 2009; 1: 260-3.

20. Draycott T, Broad G, Chidley K. The development of an eclampsia box and fire drill. Br J Midwifery 2000; 8: 26-30.

21. Ellis D, Crofts JF, Hunt LP, Read M, Fox R, James M. Hospital, simulation center, and teamwork training for eclampsia management: a randomized controlled trial. Obstet Gynecol 2008; 111: 723-31.

22. Siassakos D, Hasafa Z, Sibanda T, Fox R, Donald F, Winter C, et al. Retrospective cohort study of diagnosis-delivery interval with umbilical cord prolapse: the effect of team training. Int J Obstet Gynaecol 2009; 116: 1089-96.

23. Deering S, Brown J, Hodor J, Satin AJ. Simulation training and resident performance of singleton vaginal breech delivery. Obstet Gynecol 2006; 107: 86-9.

24. Crofts JF, Bartlett C, Ellis D, Hunt LP, Fox R, Draycott TJ. Training for shoulder dystocia: a trial of simulation using low-fidelity and high-fidelity mannequins. Obstet Gynecol 2006; 108: 1477-85.

25. Koblinsky M, Anwar I, Mridha MK, Chowdhury ME, Botlero R. Reducing maternal mortality and improving maternal health: Bangladesh and MDG 5. J Health Popul Nutr 2008; 280-94.

26. Ameh CA, van den Broek N. Making It Happen: Training health-care providers in emergency obstetric and newborn care. Best Pract Res Clin Obstet Gynaecol 2015; 29: 1077-91.

27. Issenberg SB, McGaghie WC, Hart IR, Mayer JW, Felner JM, Petrusa ER, et al. Simulation technology for health care professional skills training and assessment. JAMA 1999; 282: 861-6.

28. Morgan PJ, Cleave-Hogg D, McIlroy J, Devitt JH. Simulation TechnologyA Comparison of Experiential and Visual Learning for Undergraduate Medical Students. Anesthesiology 2002; 96: 10-6.

29. McGaghie WC, Issenberg SB, Cohen ER, Barsuk JH, Wayne DB. Does simulation-based medical education with deliberate practice yield better results than traditional clinical education? A meta-analytic comparative review of the evidence. Acad Med 2011; 86: 706.

30. Daniels K, Arafeh J, Clark A, Waller S, Druzin M, Chueh J. Prospective randomized trial of simulation versus didactic teaching for obstetrical emergencies. Simul Health 2010; 5: 40-5.

31. Levett-Jones T, Lapkin S, Hoffman K, Arthur C, Roche J. Examining the impact of high and medium fidelity simulation experiences on nursing students' knowledge acquisition. Nurse Educ Pract 2011; 11: 380-3.

32. Weller JM. Simulation in undergraduate medical education: bridging the gap between theory and practice. Med Educ 2004; 38: 32-8.

33. Swamy M, Sawdon M, Chaytor A, Cox D, Barbaro-Brown J, McLachlan J. A study to investigate the effectiveness of SimMan as an adjunct in teaching preclinical skills to medical students. BMC Med Educ 2014; 14: 231.

34. Laschinger S, Medves J, Pulling C, McGraw D, Waytuck B, Harrison MB, et al.  Effectiveness of simulation on health profession students' knowledge, skills, confidence and satisfaction. Int J Evid Based Healthc. 2008; 6: 278-302.

35. Halm BM, Lee MT, Franke AA. Improving medical student toxicology knowledge and self-confidence using mannequin simulation. Hawaii Med J 2010; 69: 4-7

36. Swamy M, Bloomfield TC, Thomas RH, Singh H, Searle RF. Role of SimMan in teaching clinical skills to preclinical medical students. BMC Med Educ 2013; 13: 20.

37. Kneebone R, Kidd J, Nestel D, Asvall S, Paraskeva P, Darzi A. An innovative model for teaching and learning clinical procedures. Med Educ 2002; 36: 628-34.

38. askins Z, Peile E. Final year medical students' views on simulation-based teaching: a comparison with the Best Evidence Medical Education Systematic Review. Med Teach 2010; 32: 569-77.


NEWS AND EVENTS

ANIMAL-BASED STUDIES


Research articles conducted on animals, will not be considered for processing or publication in the JPMA.

FOR REVIEWERS

ANNOUNCEMENT

SUPPLEMENT

INDEX

INSTRUCTIONS TO AUTHORS

COMMITTEE ON PUBLICATION ETHICS


This journal is a member of and subscribes to the principles of the Committee on Publication Ethics.

Copyrights © 2015 JPMA- All rights reserved
Powered by: PakCyber