Health Care
Learning communication from erroneous video-based examples: A double-blind randomised controlled trial

https://doi.org/10.1016/j.pec.2017.01.016Get rights and content

Highlights

  • Video-based worked examples do foster initial communication skills learning.

  • The learning effect is very strong when examples are erroneous.

  • Self-explanation prompts and elaborated feedback should be provided too.

Abstract

Objective

Appropriate training strategies are required to equip undergraduate healthcare students to benefit from communication training with simulated patients. This study examines the learning effects of different formats of video-based worked examples on initial communication skills.

Methods

First-year nursing students (N = 36) were randomly assigned to one of two experimental groups (correct v. erroneous examples) or to the control group (no examples). All the groups were provided an identical introduction to learning materials on breaking bad news; the experimental groups also received a set of video-based worked examples. Each example was accompanied by a self-explanation prompt (considering the example’s correctness) and elaborated feedback (the true explanation).

Results

Participants presented with erroneous examples broke bad news to a simulated patient significantly more appropriately than students in the control group. Additionally, they tended to outperform participants who had correct examples, while participants presented with correct examples tended to outperform the control group.

Conclusion

The worked example effect was successfully adapted for learning in the provider-patient communication domain.

Practice Implications

Implementing video-based worked examples with self-explanation prompts and feedback can be an effective strategy to prepare students for their training with simulated patients, especially when examples are erroneous.

Introduction

Appropriate provider-patient communication is associated with high levels of treatment adherence [1], [2], [3], patient recovery [4], [5], [6], and patient satisfaction [2], [7], [8]. As evidence reveals that successful communication with patients can be learned [9], [10], the question of how to best teach and assess communication skills is a key issue in international healthcare education [11], [12]. This also holds true for medical and other health professions schools in Switzerland [13], [14].

Since Swiss health professions schools are tasked with preparing their undergraduate students for successful interaction with real patients [15], [16], training with simulated patients including structured feedback is a widely used method strongly recommended in the literature [17], [18], [19], [20]. Through this training approach, students become familiar with various communication principles, such as eliciting the patient’s perspective [21] and expressing empathy and concern [22], [23]. However, achieving skilled communication is challenging (mostly due to time- and cost-effectiveness), which is why students must extract maximum benefit from their limited training time [24] with simulated patients [25], [26], [27].

Consequently, we chose an instructional approach with video-based worked examples to prepare students effectively. The use of video material as a teaching aid has several benefits. First, videos are highly valued by learners [28], [29]. Second, compared to text-based presentations, video-based presentations more accurately illustrate communication scenarios by providing ‘approximation to real-life practice’ [28]. Third, this realistic presentation format can facilitate the transfer of newly acquired skills into practice [30]. Alternatively, worked examples refer to how (video-based) learning materials can be scaffolded in order to support initial skills learning [31]. Worked examples usually contain an introduction to a formulated problem including a task (e.g. a bad diagnosis that has to be delivered to the patient) and a demonstration of each solution step required to achieve this task (i.e. effective communication) [32]. This direct, performance-oriented form of instruction, successfully induces [33], [34] schemas (also known as scripts) [35], [36]. Schemas are regarded as knowledge systems consisting of numerous elements of information stored as single units in long-term memory [37]. Consequently, they are essential for reducing working memory load: ‘even a highly complex schema can be retrieved and processed as one information element in working memory’ [38]. Accordingly, communication schemas permit providers to readily act upon given principles [39] by representing easily accessible actions ‘used to select effective and appropriate communication behaviour’ [27].

We postulate that students must be encouraged to develop schemas related to intended communication principles prior to their training with simulated patients. Thus, students can link this theoretical knowledge with their practical training experience, which is a precondition for developing skilled habits [40].

Our literature review on contemplative approaches in the domain of provider-patient communication revealed three prominent observations. First, studies examining the effectiveness of video-based examples often do not implement the materials in worked examples. Further, these studies do not focus on learning that occurs prior to communication training. The relevant studies explore the effects of learners’ own videoed interactions with (simulated) patients including individualised feedback on behavioural change [41], [42] or self-reported learning success [43], [44]. Second, studies that use content presented in a worked example manner inevitably do not focus on healthcare students and their communication skills. Respective studies focus on patients viewing video-based examples with high versus low patient-centred communication [45] or on lecturers studying videos illustrating how to deal with challenges in providing feedback on clinical skills [46]. Only a few studies simultaneously incorporate worked examples (whether or not video-based) and address healthcare students’ acquisition of communication schemas. Third and most importantly, these studies either assess schemas for provider-patient communication [39], [47], [48], [49] or evaluate entire communication skills training programmes, wherein worked-example-related elements are used among other extensive interventions [50]. In the first case, for instance, Hulsman et al. [48] used standardised video cases of provider-patient interactions embedded in a summative assessment to examine students’ abilities to recognise communication skills. In the latter, role-plays [50] or repeated individual supervision [29] were implemented. Hence, due to the scope of those studies, the implemented worked example approaches were not evaluated as a standalone training strategy to prepare healthcare students for communication training.

To summarise, research examining the learning effects of worked example approaches (whether or not video-based) in the domain of provider-patient communication is sparse. Nonetheless, authors from other disciplines have demonstrated that learning from certain formats of worked examples is an effective means for facilitating schema construction, especially when examples are accompanied with further aids. This concept is addressed in the following sections.

A large body of evidence confirms that learning from worked examples is associated with effective schema construction, leading to improved outcomes [51]. This ‘worked example effect’ [51] has been proven in well-structured learning domains such as mathematics and physics [52], [53]. Recent studies have further shown that studying erroneous examples (worked examples that include one or more errors) can foster learning in less structured but more complex domains such as medical diagnosis [54], [55], [56]. Erroneous examples can increase learners’ attention [40], [51] and encourage critical thinking [57]. Consequently, their involvement in the learning process increases [58]. High involvement and elaboration both promote schema construction [59]. Furthermore, studying errors can foster the acquisition of ‘negative knowledge’ [60], or ‘knowing what not to do’ [61]. Such knowledge is devoted to specific tasks and activities [61], [62] and contributes to the formation of schemas [63], [64]. However, studies show that only learners with sufficient prior knowledge profit from erroneous examples [65], [66], since they need to identify the error(s) and understand the correct solution by comparing the erroneous solution with the correct one [54].

Kopp et al. [55] and Stark et al. [56] demonstrated that erroneous examples enhance learning when students are provided with additional feedback explaining why a given example is erroneous. More importantly, they indicated that such elaborated feedback fosters learning independently of students’ prior knowledge. An explanation for this finding is provided by van Gog [67], who argues that elaborated information about the errors, just as it does in correct examples, can act as a reference for a performance standard. Correspondingly, learners can infer the correct solution while they also acquire negative knowledge, both of which lead to schema construction.

Self-explanation prompts also increase the effectiveness of example-based learning [59], [68], [69]. Such prompts guide learners to reflect on the given examples by asking them to identify and explain their underlying principles in a self-directed manner [70]. Thus, learners can increase their understanding and gain knowledge that is not directly presented in the learning material [31]. Accordingly, in the context of learning from worked examples, self-explanation prompts have been shown to promote elaboration and schema construction [71]. In this context, worked examples in conjunction with self-explanation prompts have the potential to promote learning not only for correct examples but also for erroneous examples [56]. However, the effectiveness of self-explanation prompts depends on the students’ prior knowledge [72], [73]. Consequently, corresponding elaborated feedback should be provided too [74].

Inspired by previous findings from other disciplines, we aim to clarify whether the worked example effect is applicable to initial learning in the domain of provider-patient communication by implementing an instructional approach using either correct or erroneous video-based examples. To enhance the effectiveness of this approach, both example formats are accompanied by self-explanation prompts and elaborated feedback. Since provider-patient communication is regarded as a complex task [48], not only learning from correct examples, but especially from erroneous examples might help students familiarise themselves with given principles (schema construction) and thus, enhance their initial performance levels on related communication tasks with simulated patients. Consequently, we also aim at exploring whether erroneous examples can facilitate initial communication skills learning more successfully than correct examples, when both formats are accompanied by prompts and feedback. Accordingly, we derived the following hypotheses:

  • (1)

    Undergraduate healthcare students studying correct or erroneous examples accompanied by self-explanation prompts and elaborated feedback will perform better on a communication task with simulated patients than students from a control group without worked examples.

  • (2)

    Undergraduate healthcare students studying erroneous examples will exhibit task-related communication principles more appropriately than students studying correct worked examples.

Section snippets

Methods

This study applies a double-blind randomised controlled design to clarify our initial hypotheses. Randomisation was balanced by gender. The participants were assigned either to an experimental group with correct examples, an experimental group with erroneous examples, or a control group without examples. The examples in the two experimental groups were accompanied by self-explanation prompts and elaborated feedback. Blinding of the participants and outcome assessors was achieved by not

Results

The three groups were homogenous with regard to age (χ2(df = 2, N = 36) = 0.13, p = 0.94). The participants reported high interest in provider-patient communication, whereas their prior knowledge was insufficient (Table 2). Importantly, neither the degree of interest in the subject matter nor the level of prior knowledge differed between the three groups (χ2(df = 2, N = 36) = 2.0, p = 0.37); (χ2(df = 2, N = 36) = 0.32, p = 0.85).

Discussion

This study revealed the following findings regarding our initial hypotheses. First, students who were presented with video-based worked examples accompanied by self-explanation prompts and elaborated feedback attained higher learning outcomes compared to students from the control group (supporting Hypothesis 1). In particular, the students confronted with the erroneous examples broke bad news to a simulated patient significantly more appropriately than students from the control group. This

Conflict of interest

The authors declare no conflicts of interest.

Funding

No external funding was received for this study.

Ethical approval

This study does not fall under the Article 2 paragraph 1 (Scope) of the Federal Act on Research involving Human Beings (Human Research Act, HRA). Thus, the independent ethics committee deemed the subject exempt from formal review. The participants of this study provided their confirmed consent for the material to be used for research purposes. Moreover, the undergraduate students in the video-based worked examples consented to have their videos used for teaching and research purposes.

Author contribution

FMS contributed to the conception and design of the study as well as the collection, analysis and interpretation of data and drafted the manuscript. KPS contributed to the conception and design of the study and the interpretation of data. DS contributed to the analysis and interpretation of data. MRF contributed to the design of the study. SG contributed to the conception of the study.

All authors contributed to the critical revision of the paper and approved the final manuscript for

Acknowledgements

We are very grateful to Ulrich Woermann for enabling the selection of the video-based examples, Beate Brem for the training of the simulated patient, and Stefanie Carola Hautz for providing critical advice regarding the editing of the manuscript.

Felix Michael Schmitz, lic. phil, is a research collaborator at the Institute of Medical Education, at the University of Bern, Switzerland. He focuses on usability consulting, lecturing, and research in higher education. He is engaged in several research projects that broadly aim to improve undergraduate healthcare training. In 2013 he entered the PhD programme at the Graduate School for Health Sciences; his thesis investigates instructional approaches in the area of provider-patient

References (92)

  • Y. Doherty et al.

    Change counselling in diabetes: the development of a training programme for the diabetes team

    Patient Educ. Couns.

    (2000)
  • C. Heaven et al.

    Transfer of communication skills training from workshop to workplace: the impact of clinical supervision

    Patient Educ. Couns.

    (2006)
  • W.M.C.M. Caris-Verhallen et al.

    Effects of video interaction analysis training on nurse-patient communication in the care of the elderly

    Patient Educ. Couns.

    (2000)
  • J. Noordman et al.

    Web-enabled video-feedback: a method to reflect on the communication skills of experienced physicians

    Patient Educ. Couns.

    (2011)
  • A. Zick et al.

    First-year medical students' assessment of their own communication skills: a video-based open-ended approach

    Patient Educ. Couns.

    (2007)
  • S. Saha et al.

    The impact of patient-centered communication on patients' decision making and evaluations of physicians: a randomized study using video vignettes

    Patient Educ. Couns.

    (2011)
  • G. Harrison et al.

    Improving health care professionals’ feedback on communication skills: development of an on-line resource

    Patient Educ. Couns.

    (2012)
  • R.L. Hulsman et al.

    Using standardized video cases for assessment of medical communication skills: reliability of an objective structured video examination by computer

    Patient Educ. Couns.

    (2006)
  • T.L. Stensrud et al.

    Improving communication in general practice when mental health issues appear: piloting a set of six evidence-based skills

    Patient Educ. Couns.

    (2014)
  • J. Sweller

    The worked example effect and human cognition

    Learn. Instr.

    (2006)
  • F. Paas et al.

    Optimising worked example instruction: different ways to increase germane cognitive load

    Learn. Instr.

    (2006)
  • R. Stark et al.

    Case-based learning with worked examples in complex domains: two experimental studies in undergraduate medical education

    Learn. Instr.

    (2011)
  • J. Sweller

    Cognitive load during problem-solving – effects on learning

    Cogn. Sci.

    (1988)
  • S. Ohlsson

    Learning from error and the design of task environments

    Int. J. Educ. Res.

    (1996)
  • M.T.H. Chi et al.

    Eliciting self-explanations improves understanding

    Cogn. Sci.

    (1994)
  • M.T.H. Chi et al.

    Self-Explanations – how students study and use examples in learning to solve problems

    Cogn. Sci.

    (1989)
  • A. Renkl

    Learning from worked-out examples: a study on individual differences

    Cogn. Sci.

    (1997)
  • Y.F. Yeh et al.

    Optimal self-explanation prompt design in dynamic multi-representational learning environments

    Comput. Educ.

    (2010)
  • N.T. Miyaji

    The power of compassion: truth-telling among American doctors in the care of dying patients

    Soc. Sci. Med.

    (1993)
  • G. Makoul

    The SEGUE Framework for teaching and assessing communication skills

    Patient Educ. Couns.

    (2001)
  • J. Schildmann et al.

    Teaching and evaluating breaking bad news: a pre-post evaluation study of a teaching intervention for medical students and a comparative analysis of different measurement instruments and raters

    Patient Educ. Couns.

    (2012)
  • S. Peters et al.

    What do medical trainees think is so difficult about communicating with patients?

    Patient Educ. Couns.

    (2011)
  • L. Osterberg et al.

    Adherence to medication

    N. Engl. J. Med.

    (2005)
  • E.E. Rosenberg et al.

    Lessons for clinicians from physician-patient communication literature

    Arch. Fam. Med.

    (1997)
  • K.B.H. Zolnierek et al.

    Physician communication and patient adherence to treatment. a meta-analysis

    Med. Care

    (2009)
  • J.K. Rao et al.

    Visit-specific expectations and patient-centered outcomes: a literature review

    Arch. Fam. Med.

    (2000)
  • M.A. Stewart

    Effective physician-patient communication and health outcomes: a review

    Can. Med. Assoc. J.

    (1995)
  • P. Kinnersley et al.

    The patient-centredness of consultations and outcome in primary care

    Br. J. Gen. Pract.

    (1999)
  • S. Williams et al.

    Doctor-patient communication and patient satisfaction: a review

    Fam. Pract.

    (1998)
  • W. Langewitz

    Erlernbarkeit der Arzt-Patient-Kommunikation in der medizinischen Ausbildung [Physician–patient communication in medical education: can it be learned?]

    Bundesgesundheitsbl

    (2013)
  • S. Guttormsen et al.

    The new licencing examination for human medicine: from concept to implementation

    Swiss Med. Wkly.

    (2013)
  • Swiss Catalogue of Learning Objectives for Undergraduate Medical Training, Working Group under a Mandate of the Joint...
  • GesBG, Bundesgesetz über die Gesunheitsberufe [Federal Law on Health Professions],...
  • MedBG, Bundesgesetz über die universitären Medizinalberufe [Federal Law on Academically Trained Medical Professions],...
  • L. Bokken et al.

    Feedback by simulated patients in undergraduate medical education: a systematic review of the literature

    Med. Educ.

    (2009)
  • S. Smith et al.

    Teaching patient communication skills to medical students: a review of randomized controlled trials

    Eval. Health Prof.

    (2007)
  • Cited by (29)

    • Video feedback with error-focused or correct-focused examples in surgical skills distance learning: A randomized trial

      2022, Surgery (United States)
      Citation Excerpt :

      Two randomized controlled studies examined nonprocedural skills. One randomized controlled study found that nursing students exposed to error-focused examples of communication did significantly better at communicating during simulated assessments than a group that received no examples.14 Another randomized controlled study demonstrated that medical students who received error-focused feedback when developing medical diagnoses for clinical cases performed significantly better on medical knowledge tests than the students who received correct-focused feedback.15

    • Breaking bad news: A randomized controlled trial to test a novel interactive course for medical students using blended learning

      2022, Patient Education and Counseling
      Citation Excerpt :

      Yet, it also poses a potential lack of comparability between the videos since it makes detection of differences more difficult. A possibility to improve our E-learning could be the use of more erroneous teaching videos as a previous trial showed that erroneous video-based examples foster better communication skills [56]. Still, the E-learning significantly minimized the number of inappropriate annotations unrelated to the BAD scheme, therefore, communication techniques that are especially relevant for BBN might be identified more precisely by using the E-learning.

    • Learning how to break bad news from worked examples: Does the presentation format matter when hints are embedded? Results from randomised and blinded field trials

      2020, Patient Education and Counseling
      Citation Excerpt :

      This result was independant of the example’s presentation format (video vs. text). Therefore, we add to previous investigations [25,26] that not only video- but also text-based worked examples are an effective means of preparing students for their SP training on BBN, provided examples include hints marking critical learning content. This seems a striking finding with immediate practical applicability for educators, as adding hints to worked examples only requires a small effort and because generating text examples requires less resources than video examples.

    View all citing articles on Scopus

    Felix Michael Schmitz, lic. phil, is a research collaborator at the Institute of Medical Education, at the University of Bern, Switzerland. He focuses on usability consulting, lecturing, and research in higher education. He is engaged in several research projects that broadly aim to improve undergraduate healthcare training. In 2013 he entered the PhD programme at the Graduate School for Health Sciences; his thesis investigates instructional approaches in the area of provider-patient communication.

    Kai Philipp Schnabel, Dr. med. & MME, is a lecturer at the University of Bern and leads the Department of Education and Media at the Institute of Medical Education. He co-founded the pbl track at the Charité in Berlin. He completed his Masters of Medical Education (MME) in Bern and works at the two MME programmes in Germany and Switzerland. He is the head of the committee for practical skills of the German Association for Medical Education, is certified for medical informatics, biometrics and epidemiology and chairs the Swiss standardised patient trainers. His current research interests are computer-assisted learning in medical communication and skills education, simulations in medicine, effects of e-learning on learning outcomes and e-learning in general.

    Daniel Stricker, PhD, is a research collaborator at the Institute of Medical Education at the University of Bern, Switzerland. As an expert in statistics, he supports the IML in its research activities. He was a lecturer in statistics at the Department of Distance Education in Brig, Switzerland, and at the Institute of Psychology at the University of Bern, Switzerland. He developed a web-based application for statistical analysis and data visualisation.

    Martin R. Fischer, Prof. Dr. med. & MME, is a general internist and endocrinologist and Professor for Medical Education at the University Hospital and Medical Faculty of Ludwig-Maximilians-University Munich, Germany. He also serves as the Associate Dean for Education. He received a Masters of Medical Education (MME) at the University of Bern, Switzerland, and is also certified in medical informatics.

    Sissel Guttormsen Schär, Prof. Dr. phil., is psychologist with a research track in cognitive science, learning technologies and assessment. She is a professor of medical education and the director of the Institute of Medical Education at the medical faculty of Bern, Switzerland. She is actively promoting research and services for medical education with the IML as well as professional education in the field.

    View full text