By Author
  By Title
  By Keywords

July 2022, Volume 72, Issue 7

Research Article

An indirect evaluation of medical residents’ research writing skills by research synopsis review

Tayyaba Faisal  ( Department of Epidemiology, College of Physicians & Surgeons, Islamabad,Pakistan )
Sajida Naseem  ( Department of Community and Family Medicine, Shifa College of Medicine, Islamabad. )
Tabinda Ashfaq  ( Department of Family Medicine, Jinnah Sindh Medical University, Karachi, Pakistan. )
Fasih Hashmi  ( Allama Iqbal Open University, Islamabad,Pakistan )
Aman Ullah  ( Shifa College of Medicine, Islamabad, Pakistan. )

Abstract

Objective: To scrutinise the research proposals of medical residents fo inadequacies in writing dissertation synopsis.

 

Method: The analytical cross-sectional study was conducted at the regional centre of the College of Physicians and Surgeon Pakistan, Islamabad, Pakistan, and comprised synopsis from January t June 2020 of postgraduate residents attached wit different hospitals in Rawalpindi and Islamabad. For evaluation purposes, an institutional checklist was used that had  domains: general, epidemiological, statistical, and bibliographical review. These were assessed by a single epidemiologist Data was analysed using SPSS 21.

 

Results: Of the 400 research proposals, 224(56%) were submitted by male and 176(44%) by female residents. Also, 208(52% proposals were submitted by residents at public-sector hospitals, a 114(28.5%) by those at private-sector hospitals, while

78(19.5%) were from military hospitals. Significant association of errors was found with training institutions, speciality an duration of training (p<0.05). No gender difference was seen (p>0.05).

 

Conclusion: Majority of the research proposals lacke correcunderstanding of all the concepts related to research.

Difference in research writing skills across specialties and trainin institutions may be related to the lack of availability o research assistance and good mentorship

 

Keywords: EBM, Residents, CPSP, Research, EBP, Epidemiolog Statistics. (JPMA 72: .1345; 2022)

 

DOI: https://doi.org/10.47391/JPMA.3143

 

 

Introduction

In this era of evidence-based medicine (EBM), we are all dependent on the understanding and knowledge gained by epidemiological studies. Epidemiology is important for the understanding of disease aetiology and prevention by specific measures, such as screening and immunisation.1 The main source of information in EBM is research and the goal of research is to improve healthcare. To design and carry out research, epidemiological knowledge is important.2  Epidemiology and biostatistics should be taught to medical students during undergraduate levels, and regular exercises should be provided during postgraduate training. It is the responsibility of the educators to accord importance to research and develop the right attitude among all undergraduate and postgraduate medical students.3

The development of research capacity is peremptory at individual and institutional levels to attain a sustainable upgradation in health research. Several strategies are being employed for this purpose, which include research assignments, scientific conferences focussing on students, transformation of medical curriculum to integrate capacity building for research, and holding of workshops on different aspects of research methodology.4

The negative attitude of medical students towards research has been found to serve as an obstacle to learning associated with poor performance in research. In one study, only 44% students felt that research will play a beneficial role in their future career. Most of the students are doing their research just as a mandatory requirement of residency.5

Most postgraduate fellowship students face difficulty in preparing research proposals for dissertations, mainly due to lack of support from the supervisors and institutions. Well-equipped research facilitation centres and mentorship should be established to improve the skills of students.4

There is need to gather data on the analysis of research proposals and to investigate the errors in writing proposals for dissertation or manuscript writing. This is important for effective and efficient interventions.6  The current study was planned to scrutinise the research proposals of medical residents for identifying inadequacies in writing dissertation synopsis.

 

Materials and Methods

 

The analytical cross-sectional study was conducted at the regional centre of the College of Physicians and Surgeons Pakistan (CPSP), Islamabad, Pakistan, and comprised synopsis submitted between January and June 2020. All residents are required to conduct a research during their

4-5 years of training before being considered eligible to take the fellowship examination. About 800 synopses are submitted every year. After approval from the institutional ethics review committee, the sample was raised without employing any particular sampling technique as all the proposals submitted during the study period by postgraduate residents attached with different hospitals in Rawalpindi and Islamabad were included.

For evaluation purposes, an institutional checklist was used by a single consultant epidemiologist who also happened to be a mentor for the students. The checklist is shared with the residents during the routine 4-day mandatory workshop on research methodology biostatistics and dissertation writing (RMBDW) once during the first two years of their training in which basic concepts of research methodology are explained and discussed.

The checklist covered four major domains: general review (hospital, specialty, duration of training), epidemiological review, statistical review, and bibliography. All the variables in the checklist were based on the application of epidemiological and biostatistics knowledge during the designing and writing of synopsis. Each domain had multiple categories that were evaluated separately.

In the domain of epidemiological review, the evaluated components included wordings of topic, writing introduction and rationale, explaining methodology that includes study design, sample size, sampling technique, hypothesis statement, operational definitions, selection criteria, and data-collection proforma.

In the domain of statistical review, evaluation was done based on the listing of variables, correct statistical test application, and controlling of confounders. In the domain of bibliography review, Vancouver style of referencing along with recent literature cited from the preceding 5 years were assessed.

Data was analysed using SPSS 21. Descriptive statistics were calculated. Frequencies and percentages were calculated for each domain used for the evaluation of synopsis. Independent samples  test and one-way analysis of variance (ANOVA) were applied for comparison of continuous variables. P<0.05 was considered statistically significant.

 

Results

 

Of the 400 research proposals, 224(56%) were submitted by male and 176(44%) by female residents. Also, 208(52%) proposals were submitted by residents at public-sector hospitals, and 114(28.5%) by those at private-sector hospitals, while 78(19.5%) were from military hospitals.

The largest number of proposals were submitted by residents in the specialty of Medicine and Allied 106(26.5%), followed by Paediatrics 64(16%), Surgery and Anaesthesia 60(15%), Obstetrics and Gynaecology 60(15%), Dentistry 26(6.5%), Pathology28(7%), Ear-Nose-Throat (ENT) 22(5.5%), Diagnostic Radiology 18(4.5%), and Ophthalmology 16(4%).

A range of errors were detected, with the most common being related to operational definition, rationale, sample size calculation, objective writing and statistical analysis (Table 1).

 

 

Mean errors based on type of institution among different specialties showed significant difference both is epidemiological and statistical issues (p<0.05) (Table 2), but there was no significant difference in general issues and bibliography (p>0.05).

 

 

Comparison of total mean errors across different specialties showed significant difference (Figure).

 

 

Discussion

 

Research writing is an integral part of postgraduate training. Thesis is product of systematic collection, analysis and interpretation of data based on the research objective and hypothesis. Thesis writing facilitates the learning process related to all the steps of research writing, from selection of topic to defining methodology and implementation of statistical knowledge.7

One study done in Pakistan on postgraduate residents also exhibited the same demographic features as in the current study.1  The current findings, however, were not consistent with those of a study done in the Middle East where the majority (49.3%) was from specialty of Surgery.4

Consent and ethical certificates are mandatory to be attached with synopsis submission, and majority of the residents in the current study attached ethical certificates and consent forms.

Sudheesh K et al. supported the fact that a well-thought-out clear synopsis is the backbone of research. The objective behind submitting a research proposal is to gain approval from institutional authorities and ethical committee also. The research topic should be selected with the rationale that what that particular study adds to the existing knowledge and what will be the benefits of that research. The topic should be innovative, relevant, acceptable to the committee and cost-effective.8

In the current study, objective along with rationale and hypothesis writing was incorrect in large proportions. One-third of the residents were unable to write appropriate title for their thesis proposal. Major mistakes were done in writing operational definition (66%), which are meant to control misclassification bias. However, majority knew the correct application of epidemiological study design owing to a good amount of time spent on this topic in research methodology workshops, which is compulsory for the students to attend before their research proposal writing and intermediate module examination.

According to a local study done on postgraduate trainees (PGTs) at a hospital in Peshawar, most had difficulty in writing research proposals, which was significantly associated with specialty and setting.6  It concluded that a well-equipped research facilitation centre should be developed in each hospital. The CPSP is endeavouring to strengthen the research culture among the fellows. For this purpose, research methodology workshops are made obligatory for both the students and the supervisors. Despite all these efforts, students face difficulty at every step of the way, from selection of topic to writing dissertation or article. About 30% students were unclear about their title, 66% had unsatisfactory introduction, 70% had wrongly developed introduction, and 90% were wrong in methodology. Similar results were reported by another qualitative study, which identified lack of time and lack of coordination between supervisors and students as the main challenges.9  In a study done in the Middle East, 50.9% subjects had difficulty in getting approval of topic from the authorities, 50% had obstacles in sample size collection and 77.10% in patient follow-ups.4  An Indian study concluded that residents had problems in writing research proposals.10 But an Iranian study showed contrary outcomes, showing that 77.8% subjects had favourable knowledge of epidemiology.11   In a local study , good knowledge required for synopsis writing was found only in 18.6% of the fellows, 76% had average knowledge of epidemiology.1  It concluded that the reason behind inappropriate knowledge was poor understanding of study design and biostatistics.1

Sudheesh K et al. supported the fact that Introduction should be written in such a way that it sets the scene and provides the context of the research. The methodology should be written in such a way that it should represent a study’s objective, rationale and hypothesis. Data analysis should also be related to the theme behind the research. Statistical test should be chosen as per the study variables. Software used should be mentioned as well.8  The same was recommended by Bahadori M.12 

In the current study, >60% residents had incorrect application based on poor understanding. But this understanding was statistically different with regards to specialty and hospital setting. In another study done on postgraduate students of Islamabad, poor understanding was seen related to biostatistics for application in writing research proposals (42%), which improved (57%) after research methodology workshops were conducted.13  Only 30% PGTs had knowledge of application of test of significance in research proposals and article writing. Only 58.9% correctly gave the meaning of ‘p’ value.13

Research methodology workshops are an important source in the perception and understanding of residents.14,15

The importance of sample size and its calculation is critical in any research.  A study showed that 46.61% residents had done research as a mandatory requirement, and only 7.5% did this to improve their skills. Residents found the elements of statistical analysis and sample size as difficult tasks, with 36.48% having little understanding of them.16  Another study showed that medical students had moderate knowledge of biostatistics, with 75% of them saying they were unable to read and write the statistical portion of a research paper.17

In Pakistan, medical residents have interest in research writing, but inadequate facilities and curriculum are major hurdles. This is supported by a study in Karachi where lack of support from the institution was cited by 79.5% subjects.18  Biostatistical knowledge, including the use of SPSS software, is crucial for the training of students regarding research writing. To overcome this difficulty, the major task is to impart knowledge followed by comprehension of biostatistics and epidemiology.19

According to one study, postgraduate students had difficulty in writing synopsis due to poor knowledge of epidemiology and research. There are many factors involved in regarding lack of interest in research. The most common among them are failure to understand the role of practical applicability and time constraint.20

Errors in writing a manuscript or proposal should be dealt with in a positive manner without developing feelings of discouragement. This should be believed that these errors are highlighted just to improve the standard of research.21

A study also stated that practical and theoretical knowledge of research plays a vital role in planning and designing and later writing of research proposal. When responsibilities of individuals are not well-defined and unstructured career pathways exist, then these factors can lead to a lack of critical thinking, resulting in research-based problems. Some institutions have started training mentors for their research pro¬grammes.22  Institutions should be aiming at the development of programmes for the training of residents and undergraduate medical students in research. Mentors should encourage the students, and grants should be provided.22,24

The current study, having been done at a single centre, has its limitations. The incorporation of multiple CPSP regional centres may be helpful in understanding the trend among residents across Pakistan.

Some institutions are paying attention to the cause of developing and strengthening the research culture. For this purpose, there is a need to train doctors in research methodology who can provide consultation to both the residents and the supervisors through a research cell within the premises of every tertiary care hospital. Periodic training of these skilled personnel in research is also required to keep them updated with EBM and evidence-based practice (EBP).

 

Conclusion

 

Majority of research proposals submitted by medical residents were found to have inadequacies. Difference in research writing skills across specialties and training institutions may be related to the lack of research assistance and good mentorship.

 

Acknowledgement: The author would like to thank all participants for providing valuable data for this research.

 

Disclaimer: None.

 

Conflict of Interest: None.

 

Source of Funding: None.

 

References

1.      Shafi S, Faisal T, Naseem S, Javed S, Ghazanfar H. Knowledge of Postgraduate Medical Trainees Regarding Epidemiology. Cureus 2018; 10: e2171.

2.      Szajewska H. Evidence-Based Medicine and Clinical Research: Both Are Needed, Neither Is Perfect. Ann Nutr Metab 2018; 3: 13-23.

3.      Shilpashree YD, Nusrath A, Rajeshwari A. Perception and concerns of undergraduate medical students towards research: A cross sectional study. J Med Sci Health 2016; 2: 19-22.

4.      Alghamdi KM, Moussa NA, Alessa DS, Alothimeen N, Al-Saud AS. Perceptions, attitudes and practices toward research among senior medical students. Saudi Pharm J 2014; 22: 113-7.

5.      Siemens DR, Punnen S, Wong J, Kanji N. A survey on the attitudes towards research in medical school. BMC Med Educ 2010; 10: 4.

6.      Mahboob U, Ahmed F. An analysis of research proposals and challenges faced by postgraduate trainees in internal medicine and allied disciplines during fellowship training program: A qualitativ study. Khyber Med Uni J 2016; 8: 82-7.

7.      Matin MA, Khan MAW. Common problems faced by postgraduate students during their thesis works in Bangladesh. Bangladesh J Med Educ 2017; 8: 22-7.

8.      Sudheesh K, Duggappa DR, Nethra SS. How to write a research0 proposal? Indian J Anaesth 2016; 60: 631-4.

9.      Manchishi PC, Ndhlovu D, Mwanza DS. Common Mistakes Committed and Chal¬lenges Faced in Research Proposal Writing by University of Zambia Postgraduate Students. Int J of Humanit SocSci Educ 2015; 2: 126-38.

10.    Giri PA, Bangal VB, Phalke DB. Knowledge, Attitude and Practices towards Medical Research amongst the Postgraduate Students of Pravara Institute of Medical Sciences University of Central India. J Family Med Prim Care 2014; 3: 22-4

11.    Memarpour M, Fard AP, Ghasemi R. Evaluation of attitude to, knowledge of and barriers toward research among medical science students. Asia Pac Fam Med 2015; 14:1.

12.    Bahadori M, Momeni K, Ravangard R, Yaghoubi M, Alimohammazdeh K, Teymourzadeh E, et al. Challenges of the health research system in a medical research institute in Iran: a qualitative content analysis. Glob J Health Sci 2014; 7: 69-78

13.    Shafi MS, Faisal T, Naseem S, Javed S. Postgraduate Medical Trainees Understanding of Biostatistics: A Pre- and Post-Research Methodology Workshop Experience. J Coll Physicians Surg Pak 2018; 28: 196-200.

14.    Penmetsa GS, Dubba K, Mohammad Z. Knowledge, attitude and perception regarding biostatistics among postgraduate Assoc. Public Health Dent 2017; 15: 68-72.

15.    Sharma N, Pramila M, Krishnamurthy A, Umashankar GK, Ranganath, Ahuja NA. Knowledge, attitude, and practices in research among postgraduate students in dental institutions in Bengaluru City, India.Indian Assoc Public Health Dent 2014; 12: 189-93.

16.    Shanmukhappa SC, Abraham RR, Venkatesh VS, Abraham RR. Motivators and barriers to research among doctors in the Indian medical scenario: A cross-sectional study from Karnataka, India. JFamily Med Prim Care 2020; 9: 4053-61.

17.    Wadhwa M, Kalyan P, Kalatharkath T. Knowledge and attitude of medical and dental postgraduate students towards practice of biostatistics. J Postgrad Med Edu Res 2015; 49: 1-4.

18.    Bilal M, Haseeb A, Mari A, Ahmed S, Sher Khan MA, Saad M. Knowledge, attitudes, and barriers toward research among medical students of Karachi. Cureus. 2019; 11: e5599.

19.    Vasudevan S. Biostatistics teaching to the undergraduate medical students through research-oriented medical education posting program in a Teaching Medical Institute in Coastal Area  Pondicherry: An experience of a biostatistician. J Pharm Bioallied Sci 2016; 8:78-9.

20.    Kowalski JR, Hoops GC, Johnson RJ. Implementation of a collaborative series of classroom-based undergraduate research experiences spanning chemical biology, biochemistry, an neurobiology. CBE Life Sci Educ 2016; 15: ar55.

21.    Dhammi IK, Rehan-Ul-Haq. Rejection of manuscripts: Problems and solutions. Indian J Orthop 2018; 52: 97-9.

22.    Yousefi A, Bazrafkan L, Yamani N. A qualitative inquiry into the challenges and complexities of research supervision: viewpoints of postgraduate students and faculty members. J Adv Med Educ Pro 2015; 3: 91-8.

23.    Soe K, Hitoo H, Than NN, Lwin H, Nu Htay MNN, Phyu KL, et al. Knowledge, attitudes, and barriers toward research: The perspectives of undergraduate medical and dental students. J Educ Healt Promot 2018; 7:23.

24.    Chellaiyan VG, Manoharan A, Jasmine M, Liaquathali F. Medical research: Perception and barriers to its practice among medical school students of Chennai. J Educ Health Promot 2019; 8: 134.

Journal of the Pakistan Medical Association has agreed to receive and publish manuscripts in accordance with the principles of the following committees: