• No results found

Does faculty development influence the quality of in-training evaluation reports in pharmacy?

N/A
N/A
Protected

Academic year: 2020

Share "Does faculty development influence the quality of in-training evaluation reports in pharmacy?"

Copied!
7
0
0

Loading.... (view fulltext now)

Full text

(1)

R E S E A R C H A R T I C L E

Open Access

Does faculty development influence the

quality of in-training evaluation reports in

pharmacy?

Kerry Wilbur

Abstract

Background:In-training evaluation reports (ITERs) of student workplace-based learning are completed by clinical supervisors across various health disciplines. However, outside of medicine, the quality of submitted workplace-based assessments is largely uninvestigated. This study assessed the quality of ITERs in pharmacy and whether clinical supervisors could be trained to complete higher quality reports.

Methods:A random sample of ITERs submitted in a pharmacy program during 2013–2014 was evaluated. These ITERs served as a historical control (control group 1) for comparison with ITERs submitted in 2015–2016 by clinical supervisors who participated in an interactive faculty development workshop (intervention group) and those who did not (control group 2). Two trained independent raters scored the ITERs using a previously validated nine-item scale assessing report quality, the Completed Clinical Evaluation Report Rating (CCERR). The scoring scale for each item is anchored at 1 (“not at all”) and 5 (“exemplary”), with 3 categorized as“acceptable”.

Results:Mean CCERR score for reports completed after the workshop (22.9 ± 3.39) did not significantly improve when compared to prospective control group 2 (22.7 ± 3.63,p= 0.84) and were worse than historical control group 1 (37.9 ± 8.21,p= 0.001). Mean item scores for individual CCERR items were below acceptable thresholds for 5 of the 9 domains in control group 1, including supervisor documented evidence of specific examples to clearly explain weaknesses and concrete recommendations for student improvement. Mean item scores for individual CCERR items were below acceptable thresholds for 6 and 7 of the 9 domains in control group 2 and the intervention group, respectively.

Conclusions:This study is the first using CCERR to evaluate ITER quality outside of medicine. Findings demonstrate low baseline CCERR scores in a pharmacy program not demonstrably changed by a faculty development workshop, but strategies are identified to augment future rater training.

Keywords:Workplace-based assessment, Faculty development, Pharmacy

Background

Health professional students participate in workplace-based training as a fundamental aspect of their education. Conducted in practice settings under the supervision of clinician mentors, students have opportunities to reinforce and shape development of existing knowledge and skills while engaged in direct patient care [1]. The in-training evaluation report (ITER) is a ubiquitous feature of this ex-periential training [2]. Also referred to asfield practicum,

rotation, or clerkship evaluations, these forms are

documents of clinical supervisors’judgements of student performance in patient care settings and serve as workplace-based assessment (WBA) instruments across health disciplines [3].

Despite programs’ reliance on an ITER as an account of trainees’clerkship performance and collectively, as a reliable summative record of a student’s demonstrated skills, knowledge, and behaviours over time, rater vari-ability pervades WBA and is typically considered un-desirable [4]. Although most ITERs outline the student competency components to guide users, studies demon-strate that clinical supervisors do not uniformly interpret

Correspondence:[email protected]

College of Pharmacy, Qatar University, PO Box 2713, Doha, Qatar

(2)

these descriptions or the accompanying defined rating scales, nor do they assign the same value to the perfor-mances expected to be evaluated [5, 6]. The standards against which they judge students are variable and in-clude themselves, peers, and other trainees [7, 8]. Global student impressions may additionally shape specific do-main scores indiscriminately; the mental workload re-quired to process and score multiple dimensions further contributes to unconscious cognitive biases. [9, 10].

The ability of rater-training to effectively mitigate such influences on WBA is mixed [4, 11–13]. However, Dudek

el al have demonstrated that ITER quality can be improved by both live workshop and asynchronous web-based faculty development which systematically em-phasizes the written element clinical supervisors use to elaborate on physician trainee performance [14, 15]. A nine-item Completed Clinical Evaluation Report Rating (CCERR) scale was devised and validated by medical edu-cators, including attending physicians who supervise stu-dents and resistu-dents [16]. ITER comments are rated according to the inclusion of both student strengths and weaknesses and the documentation of specific descrip-tions, recommendations for improvement, and the use of supportive language. Following initial in-person faculty development workshop, improvements in total CCERR scores reflected a moderate to large effect size and authors recommend the scale to others as a highly reliable object-ive measure of clinical supervisor evaluations [14].

Unlike medicine, the literature outlining the quality of documented student workplace-based performance in pharmacy is lacking. Direct patient care clerkships repre-sent significant proportions of pharmacy curricula and merit the same audit that campus-based assessment strategies receive (e.g. course quizzes and exams, object-ive structured clinical examinations (OSCEs)) [17, 18]. Similarly, demonstrated evidence of direct patient care activities, assessment forms, and practice site feedback is expected of various accrediting bodies to ensure ad-equate intensity, breadth and structure of practice expe-riences [19, 20]. We hypothesize that the quality of narrative comments documented in pharmacy ITERs is deficient and as in medicine, may be improved through clinical faculty education. Herewithin, we report on the first experience using CCCER as a measure of ITER quality in pharmacy student experiential training and the effects of a professional development workshop.

Methods

Study design

A quasi-experiemental design using both retrospective and prospective controls was used to investigate the ef-fectiveness of a faculty development workshop on the quality of narrative comments documented in pharmacy ITERs as measured by the CCERR instrument.

Study Setting

The Doctor of Pharmacy (PharmD) program at the Col-lege of Pharmacy (CPH) at Qatar University (QU) is a Canadian-accredited post-baccalaureate degree support-ing the trainsupport-ing of graduate students to assume ad-vanced pharmacy practice positions as integrated members of multidisciplinary teams delivering direct patient care. PharmD students complete 32 -weeks of experiential training (8 internships of 4 -weeks’duration) for which ITERs are submitted by each internship’s clinical supervisor. The ITER used is a 25-item assess-ment instruassess-ment organized according to the seven domains of expected educational outcomes for graduating

medication therapy experts(care provider, communicator, collaborator, manager, advocate, scholar, professional) and are akin to the CanMEDS framework for training the

medical expert (physician) [19, 21, 22]. Assigned categorization for each described performance is “exceeds

expectations”;“meets expectations”;or“below expectations” represented by 3, 2, and 1, respectively.

Study Sample and Data Collection

(3)

Intervention

In the fall of the 2015–2016 academic year, a faculty de-velopment program was devised for all undergraduate and PharmD clinical supervisors similar in content to a workshop for medical trainee supervisors previously re-ported [14]. All local pharmacists who supervise and evaluate pharmacist trainee clinical internships were in-vited through direct emails and university announce-ments to participate in the workshop. The investigators led a structured discussion exploring roles of WBA tools and features of well-completed ITERs. Videos portraying (simulated) student patient encounters were shown and participants recorded their judgements in the relevant ITER sections. These resources were developed and shared with investigators by The Australasian College for Emergency Medicine [23].These narrative comments were then peer-reviewed in small groups using the CCERR tool and overall feedback for improvement shared by facilitators. Following the workshop, we then evaluated a blinded, random sample of PharmD student ITERs completed during the academic year (November 2015 to June 2016 inclusive) by those clinical faculty who attended the workshop (Intervention Group) and those who did not (Control Group 2). Random selection of ITERs followed the same process conducted for Control Group 1.

Statistical analysis

The overall and weighted mean scores for each of the nine CCERR item categories in the intervention group were independently compared to both the historic and concurrent control groups using Mann-Whitney tests

for non-parametric continuous data with significant level (2-sided) set at alpha 0.05. The proportion of CCERR item categories scored below the threshold score for ac-ceptability (less than 3) was also calculated. Inter-rater reliability was calculated mid-way and at the conclusion of ITER review for the 2013–2014 and the 2015–2016 data sample. At the conclusion of ITER review of the 2013–2014 and of the 2015–2016 sample, each research assistant was asked to re-rate the same two randomly se-lected ITERs. Acceptable inter- and intra-rater reliability was set at 0.75 as measured by the intraclass correlation coefficient [24]. Ethics approval for each year of study conduct was obtained from the QU Institutional Review Board.

Results

A random sample of 54 ITERs were reviewed as part of control group 1 (Fig. 1). The ability to clearly understand the student’s performance on the internship was rated acceptable for 37 (68.5%) of ITERs when total CCERR scores were considered. Mean scores for individual CCERR items were below acceptable thresholds for 5 of the 9 domains, including documented evidence of spe-cific examples to clearly explain weaknesses (mean rat-ing 2.48 ± 0.84) and concrete recommendations for student improvement (mean rating 2.26 ± 0.62) (Fig. 1). The aggregate mean CCERR score for this control group 1 was 37.9 ± 8.21.

Nine (19.6%) PharmD clinical supervisors attended the faculty development workshop and 77 student internships were subsequently completed during the remainder of the academic year (Table 1). All ITERs (10) submitted by

(4)

participating clinical supervisors were reviewed (interven-tion group). A random sample of 14 ITERs completed by non-participating clinical supervisors (37, 80.4%) served as control group 2. When total CCERR scores were calcu-lated, the overall ability to clearly understand the student’s internship performance was rated acceptable for 7 (50%) in the control group 2 and 7 (70%) in the intervention group (Fig. 1). However, mean scores for individual CCERR items were below acceptable thresholds for 6 and 7 of the 9 items, respectively, which represents more than that found in control group 1. There was no statistically significant difference in individual CCERR item scores when the intervention and control group 2 was compared, although 7 of the 9 category scores increased somewhat. When intervention group CCERR item scores were com-pared with control group 1, statistically significant de-crease in item scores for clear documentation of examples of student strengths and weaknesses were found. The dif-ference in aggregate mean CCERR score for the interven-tion group (22.9 ± 3.39) and control group 2 (22.7 ± 3.63) was not statistically significant (p= 0.84), but was found to be when each was compared to control group 1 (p = 0.0001). Interrater reliability between the two independent ITER assessors for the entire data set was 0.77. Overall assessor intrarater reliability was 0.87 and 0.91, respectively.

Discussion

Ours is the first known study to use the CCERR scale as a measure of ITER quality in a health professional cur-riculum other than medicine. Clinical supervisor docu-mentation of pharmacy student performance in workplace-based settings was considered below accept-able thresholds in most of CCERR item domains in both control groups. However, unlike improvements observed in medical student or residency training evaluations, negligible changes in ITER quality were demonstrated following a professional development workshop for pharmacist clinical supervisors.

As an instrument to determine ITER quality, the CCERR is unique, as to date no other tool for compar-able use has been developed. While our findings could

suggest that its utility outside medicine is poor given how health professions have distinct scopes of practice and student competencies to assess, the CCERR scale would appear suitably generic for application across disciplines. The majority of highquality ITER features -identified by medical participants through focus group discussion, distilled into the nine CCERR items by Del-phi consensus methodologies and subsequently validated - resonate with fundamental feedback principles for workplace-based learning, such as basing feedback on direct observation (e.g. specific examples of perform-ance) and concluding with an action plan [25]. While we would not dispute the importance of confirming and fa-cilitating student acceptance of feedback, it would not be a typical pharmacy program expectation for clinical supervisors to document the student’s response onto the ITER form. Instead, it may be reflected in clinical supervisors’ stated impression of the trainee’s overall attitude or professionalism [26]. Consequently, the re-lated CCERR item score, documented trainee response to feedback and/or remediation was rated very low in our study.

Despite reinforcement through faculty development ini-tiatives, shortcomings in the amount and nature of ITER narrative persist, especially as it pertains to constructive comments [27, 28]. In cases of poor performance espe-cially, physicians have professed aversion to documenting even slightly negative feedback out of concern for a dis-proportionate effect on the trainee’s future career oppor-tunities [29]. In our study, the CCERR item corresponding to the provision of specific descriptions for identified stu-dent weakness was rated lowest among control and inter-vention ITERs. Clinical supervisors in our setting may also share perspectives of the Canadians physicians previ-ously described, but cultural factors may be additionally implicated. Members of high context societies (as Arab countries like Qatar are often characterized) exhibit pref-erences for nuanced non-verbal communication and may therefore be reluctant to record feedback, especially com-ments that may be interpreted as overly critical [30]. Such preferences for verbal communication may have contrib-uted to the low scores on most other CCERR items. If the

Table 1Clinical Supervisor Demographics

2013–2014 Academic Year 2015–2016 Academic Year

Control Group 1N= 41 Intervention GroupN= 9 Control Group 2N= 37 Female 17 (41%) 6 (67%) 19 (51%)

ITERs completeda(median, range) 2 (15) 1 (12) 2 (15)

New Preceptor 15 (37%) 5 (56%) 8 (22%) Cumulative Supervisory Experience

Students (median, range) 3 (1–7) 2 (0–7) 2 (1–5) Years (median, range) 2 (0–3) 2 (0–2) 2 (0–4)

a

(5)

ITER is additionally considered a surrogate marker for feedback exchange in the workplace-based setting, it may have been worthwhile to triangulate our data collection with trainee interviews following the faculty development workshop to determine if they recall receiving verbal feed-back from their clinical supervisors to help further dis-criminate the numeric scores of rated skills and performances recorded on their ITER. Although English is the predominant language of care delivery in Qatar, our clinical supervisors, many of who are of Arab-origin, complete ITERs in their second language (English). We do not know if a notion or idea for a commentary about the trainee occurs to an Arab clinical supervisor in their native language, but then not translated to English for ITER documentation, further confounding culturally-oriented barriers to documented narrative evaluation.

As an objective measure of quality, the CCERR scale still relies on subjective assessment (not unlike a pa-tient’s self-reported pain scale, for example). Use of mul-tiple independent raters for CCERR administration may mitigate this phenomenon, but inherent cognitive biases invariably persist, especially as it pertains to language use and interpretation [31, 32]. In our study, CCERR item scoring the supportive nature of ITER comments was among those items rated lowest, but admittedly, we may not have exhausted potential examples among our research assistants. Is advocated clinical supervisors use of specific neutral language focusing on performance in ITER documentation incompatible with support or en-couragement and therefore this CCERR item? [25]. Prior work suggests written comments in ITERs are actually often vague and subject to‘decoding’by the reader [33]. Indeed, linguistic analysis of the non-literal language found in Canadian medical ITERs detected the presence of politeness strategies, such as ‘hedging’, whereby a word is used to lessen the impact of the an utterance (or in the case of an ITER, the impact of the written mes-sage) [34]. These readers also interpreted clinical super-visors’ use of verbs indicating change (e.g. improving, developing) as having negative implications and consid-ered a “good” resident below average. It is unclear then how CCERR scoring among distinct professions and contexts may be influenced by rater understanding of language used.

Our orphan assessment of ITER quality in pharmacy education is concerning. The medical literature is replete with study of the validity and reliability of the ITER numeric scoring component and increasingly, scrutiny of narrative comment but thus far our work is without apparent precedent in any other health profession. [14–16, 29, 35]. Experiential training programs use submitted ITERs to capture student demonstrated day-to-day abilities as important data points to determine student achievement of expected competencies and ultimately

fitness to graduate and eligibility for professional licensure. Comments may serve as more useful clues than scores in identifying students in difficulty. [36]. Quality assurance findings in health professional training experiences may also serve as a surrogate marker of communication be-tween the clinical supervisor and student as it pertains to constructive feedback and supportive reinforcement. The ITER serves as a tool for formative assessment docu-mented at the midpoint and conclusion of the student’s clerkship with each clinical supervisor. Perceived student progress in demonstrating achievement of the seven main educational outcomes of amedication expertare formally discussed and recorded. Irrespective of undocumented verbal feedback exchanges between trainer and trainee throughout this learning experience, our program expects suitable support of the summative judgement of student performance and ultimately clerkship outcome (to pass or to fail). We have found through the low CCERR scores that this narrative element of ITER completion among our clinical supervisors can be improved. We encourage adoption of systematic ITER quality assurance processes for pharmacy programs and other health disciplines.

Although our absolute aggregate mean CCERR scores are in fact higher than those found following ITER faculty development among physicians, the small number of completed ITERs considered for evaluation following the faculty development workshop, especially in the interven-tion group, is a limitainterven-tion to our findings [14]. Inherent high quality ITERs in our first control group may have minimized the ability to detect a difference following the workshop. However, even within this cohort of randomly selected ITERs, the majority of CCERR items were still scored less than the acceptable threshold. Additionally, clinical supervisors demonstrating enhanced written feed-back on ITERs within an undistracted workshop setting may not be able to replicate the protected time in busy clinical settings. In analysis of control group 1, we de-tected the ITER layout may itself restrict the capacity for documenting narrative feedback [37]. However, our great-est failing in demonstrating improvements in ITER quality following the faculty development workshop is quite likely our lack of follow-up with feedback. In subsequent study, the CCERR developers created a distance-based faculty development program whereby participants received bian-nual feedback on the quality of their submitted ITERs over 2 years [15]. Similar reinforcement of written feed-back principles over time may also result in improved ITER quality in our pharmacy clinical supervisors [38].

Conclusion

(6)

believe the CCERR instrument can be a useful vehicle to support improved WBA documentation in pharmacy student workplace-based training. The challenges to securing professional development attendance is widely acknowledged and our program is also exploring distance-based faculty development models that would incorporate routine personalized ITER feedback to clinical supervisors [15]. Greater understanding of the barriers clinical supervisors face in documenting assess-ment of health professional trainees is necessary. In future study, we will also further explore the applicability of CCERR scoring of ITERs in distinct cultural contexts.

Additional file

Additional file 1:Completed clinical evaluation report rating (CCERR)– Final scale. Instrument used to rate In-Training Evaluation Reports (ITERs) in our study. (DOC 46 kb)

Abbreviations

CCERR:Completed Clinical Evaluation Report Rating; CPH: College of Pharmacy; ITER: In-training evaluation reports; QU: Qatar University; WBA: Workplace-based assessments

Acknowledgements

The author wishes to thank Dr. Barbara Blackie, Co-Associate Chief of Medical Education, Senior Attending Emergency Services, Sidra Medical & Research Program, Doha, Qatar, for her contributions to the faculty development workshop design and delivery.

Funding

This research was funded by a Qatar University internal grant. The funding body was not involved in the design, collection, analysis or interpretation of the data.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Author’s contributions

The individual author conducted all aspects of research and manuscript writing. The author has read and approved the final version of this manuscript.

Ethics approval and consent to participate

Ethics approval was obtained from the QU Institutional Review Board (QU IRB- 517/E-15). Written consent was obtained from the human subjects.

Consent for publication Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Received: 12 May 2017 Accepted: 2 November 2017

References

1. Lave J. Teaching, as learning, in practice. Mind Cult Act. 1996;3:149–64. 2. Magnier KM, Dale VH, Pead MJ. Workplace-based assessment instruments in

the health sciences. J Vet Med Educ. 2012;39:389–95.

3. Turnbull J, Van Barneveld C. Assessment of clinical performance: in-training evaluation. In: Norman GR, van der Vleuten CPM, Newbie DI, editors. International handbook of research in medical education. London: Kluwer. Academic Publishers; 2002. p. 793–810.

4. Williams RG, Klamen DA, McGaghie WC. Cognitive, social and environmental sources of bias in clinical performance ratings. Teach Learn Med. 2003;15: 27092.

5. Govaerts MJ, Van de Wiel MW, Schuwirth LW, Van der Vleuten CP, Muijtjens AM. Workplace-based assessment: raters' performance theories and constructs. Adv Health Sci Educ Theory Pract. 2013;18:37596. 6. Kogan JR, Conforti LN, Bernabeo E, Iobst W, Holmboe E. How faculty

members experience workplace-based assessment rater training: a qualitative study. Med Educ. 2015;49:692–708.

7. Yeates P, Cardell J, Byrne G, Eva KW. Relatively speaking: contrast effects influence assessors’scores and narrative feedback. Med Educ. 2015;49:909–19.

8. Gauthier G, St-Onge C, Tavares W. Rater cognition: review and integration of research findings. Med Educ. 2016;50:51122.

9. Tavares W, Eva KW. Exploring the impact of mental workload on rater-based assessments. Adv Health Sci Educ Theory Pract. 2013;18:291–303. 10. Haber RJ, Avins AL. Do ratings on the American Board of Internal Medicine

Resident Evaluation Form detect differences in clinical competence? J Gen Intern Med. 1994;9:140–5.

11. Littlefield JH, Darosa DA, Paukert J, Williams RG, Klamen DL, Schoolfield JD. Improving resident performance assessment data: numeric precision and narrative specificity. Acad Med. 2005;80:489–95.

12. Holmboe ES, Hawkins RE, Huot SJ. Effects of training in direct observation of medical residents' clinical competence: a randomized trial. Ann Intern Med. 2004;140:87481.

13. Cook DA, Dupras DM, Beckman TJ, Thomas KG, Pankratz VS. Effect of rater training on reliability and accuracy of mini-CEX scores: a randomized. Control Trial J Gen Intern Med. 2009;24:749.

14. Dudek NL, Marks MB, Wood TJ, Dojeiji S, Bandiera G, Hatala R, Cooke L, Sadownik L. Quality evaluation reports: can a faculty development program make a difference? Med Teach. 2012;34:e725–e31.

15. Dudek NL, Marks MB, Bandiera G, White J, Wood TJ. Quality in-training evaluation reportsdoes feedback drive faculty performance? Acad Med. 2013;88:1129–34.

16. Dudek N, Marks M, Wood T, Lee A. Assessing the quality of supervisors' completed clinical evaluation reports. Med Educ. 2008;42:81622. 17. DiVall MV, Alston GL, Bird E, Buring SM, Kelley KA, Murphy NL, Schlesselman

LS, Stowe CD, Szilagyi JE. A faculty toolkit for formative assessment in pharmacy education. Am J Pharm Educ. 2014;78:160.

18. Schuwirth LW, van der Vleuten CP. General overview of the theories used in assessment: AMEE guide no. 57. Med Teach. 2011;33:783–97.

19. Canadian Council of Accredtiation of Pharmacy Programs. Accreditation standards for the first professional degree in pharmacy programs. Toronto: Canadian Council of Accredtiation of Pharmacy Programs; 2014. 20. Accreditation standards and key elements for the professional program in

pharmacy leading to the doctor of pharmacy degree. Chicago: Accreditation Council for Pharmacy Education; 2015.

21. Educational outcomes for first professional degree programs in pharmacy (entry-to-practice pharmacy programs) in Canada. Ottawa: Association of Faculties of Pharmacy of Canada (AFPC); 2017.

22. CanMEDS. Physician competency framework. Ottawa: Royal College of Physicians and Surgeons of Canada; 2015.

23. Kwan J, Ramani S. Conference workshop: driving student learning through developmental assessment: designing faculty development for workplace based assessment. In: AMEE: an International Association for Medical Education. Glasgow; 2015.

24. Fleiss JL. Statistical methods for rates and proportions. New York: John Wiley; 1981.

25. Ramani S, Krackov SK. Twelve tips for giving feedback effectively in the clinical environment. Med Teach. 2012;34:787–91.

26. Hill WT. White paper on pharmacy student professionalism: what we as pharmacists believe our profession to be determines what it is. J Am Pharm Assoc. 2000;40:96–102.

(7)

28. McConnell MM, Harms S, Saperson K. Meaningful feedback in medical education: challenging thefailure to failusing narrative methodology. Acad Psychiatry. 2015;40:377–9.

29. Patel R, Drover A, Chafe R. Pediatric faculty and residents’perspectives on in-training evaluation reports (ITERs). Can Med Educ J. 2015;6:e41–53. 30. Hall ET. Beyond culture. New York: Anchor Books/Doubleday; 1976. 31. Maass A. Linguistic intergroup bias: stereotype perpetuation through

language. Adv Exp Soc Psychol. 1999;31:79–121.

32. Gernsbacher MA, Kaschak MP. Language comprehension. Encyclopedia of cognitive science. Wiley Online Library; 2003

33. Ginsburg S, Regehr G, Lingard L, Eva KW. Reading between the lines: faculty interpretations of narrative evaluation comments. Med Educ. 2015;49:296–306. 34. Ginsburg S, van der Vleuten C, Eva KW, Lingard L. Hedging to save face: a

linguistic analysis of written comments on in-training evaluation reports. Adv Health Sci Educ Theory Pract. 2016;21:175–88.

35. Hatala R, Sawatsky AP, Dudek N, Ginsburg S, Cook DA. Using in-training evaluation report (ITER) qualitative comments to assess medical students and residents: a systematic review. Acad Med. 2016. https://doi.org/10.1097/ ACM.0000000000001506.

36. Guerrasio J, Cumbler E, Trosterman A, Wald H, Brandenburg S, Aagaard E. Determining need for remediation through postrotation evaluations. J Grad Med Educ. 2012;4:4751.

37. Yousef S, Mohamed H, Wilbur K. Assessing the quality of clinical internship evaluations in a Middle East doctor of pharmacy program. Glasgow: AMEE (an International Association for Medical Education); 2015.

38. Dudek N, Dojeiji S. Twelve tips for completing quality in-training evaluation reports. Med Teach. 2014;36:1038–42.

We accept pre-submission inquiries

Our selector tool helps you to find the most relevant journal

We provide round the clock customer support

Convenient online submission

Thorough peer review

Inclusion in PubMed and all major indexing services

Maximum visibility for your research

Submit your manuscript at www.biomedcentral.com/submit

Figure

Fig. 1 CCERR Item Scores for Pharmacy ITERs Before (Control Group 1) and Following (Control Group 2, Intervention Group) a FacultyDevelopment Workshop
Table 1 Clinical Supervisor Demographics

References

Related documents