Found 14 bookmarks
Newest
Masters' Q&A - Clark Quinn
Masters' Q&A - Clark Quinn
Clark Quinn answers 5 questions on simulations for training leaders and how they help provide practice opportunities. I appreciate the clarification on what he means by a simulation and the differentiation between "simulation" and "branching scenario," as those terms are often muddy.
Scenarios can be implemented in actual simulations (where the world is actively modeled, and the consequences are calculated), or in branching scenarios where the relationships are hard-coded in the consequences attached to a decision.
scenarios give us contextualized practice, which research shows leads to better retention and transfer. With the right choices, the scenario is engaging and provides meaningful practice, which leads to acquiring new abilities.
<div data-breakout="normal"><p class="-Zro6 -ZADH IjV6v AnCKd _57WYp" id="viewer-avnma"><span class="d0767"><span style="font-weight:700"><span>DAN: What makes learning through a simulation experience unique and meaningful?</span></span></span></p></div><div type="paragraph" data-hook="rcv-block26"></div><div data-breakout="normal"><p class="-Zro6 -ZADH IjV6v AnCKd _57WYp" id="viewer-d53db"><span class="d0767"><span style="font-weight:700"><span>CLARK</span></span><span>: As above, research says that contextualized practice (with feedback) is the best way to develop new abilities. They need to have a ’story’ setting: a context, then something happens that precipitates the need for a decision, and then the decision has consequences. That’s just a better-written multiple-choice question (please!), but if we drive the outcomes from a branching or simulation basis, this can lead to new decisions (they travel in packs!)</span></span></p></div>
·topfbusinesslearning.com·
Masters' Q&A - Clark Quinn
Memory and comprehension of narrative versus expository texts: A meta-analysis - PMC
Memory and comprehension of narrative versus expository texts: A meta-analysis - PMC
The full text of the meta-analysis comparing memory and understanding of stories versus expository text. The researchers are careful to note the limitations of this evidence, but overall found that narratives have an advantage over expository text and explanations.
Stories may be easier to remember and comprehend than essays because stories resemble our everyday experiences (Bruner, <a href="#CR10" rid="CR10" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">1986</a>; Graesser et al., <a href="#CR39" rid="CR39" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">1991</a>). People experience life in the real world as temporally ordered causal events, organized around personal goals, with the encountering and overcoming of obstacles to these goals resulting in emotional experiences; this parallels the structure of stories (Graesser, McNamara, &amp; Louwerse, <a href="#CR37" rid="CR37" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">2003</a>; Graesser, Singer, &amp; Trabasso, <a href="#CR38" rid="CR38" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">1994</a>).
Familiarity with the structure and content of a text is referred to as relevant “prior knowledge” (Dochy, Segers, &amp; Buehl, <a href="#CR28" rid="CR28" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">1999</a>), and stories might be more memorable and comprehensible thanks to readers having greater prior knowledge.
Readers are less likely to benefit from prior knowledge while reading an essay, relative to stories, and are therefore less likely to benefit from easy inferences. This combination could easily put expository texts at a disadvantage when it comes to memory and comprehension (Coté, Goldman, &amp; Saul, <a href="#CR18" rid="CR18" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">1998</a>; McNamara, <a href="#CR68" rid="CR68" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">2004</a>).
A final reason to believe that narratives may be more memorable than expository texts hinges on the ability of emotions to facilitate memory (Hamann, <a href="#CR42" rid="CR42" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">2001</a>). Affectively charged recollections have been dubbed “flash-bulb” memories, to communicate the idea that emotional events are deeply imprinted on the mind, like a flash aiding photography (Winograd &amp; Neisser, <a href="#CR107" rid="CR107" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">1992</a>). This emotional facilitation of memory appears to result from a prioritizing of emotional material when it comes to attention and perception (Brosch, Pourtois, &amp; Sander, <a href="#CR9" rid="CR9" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">2010</a>), with personal relevance playing a key role (Levine &amp; Edelstein, <a href="#CR58" rid="CR58" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">2009</a>). To the extent that stories are better able to evoke strong emotions than expository texts (cf. Mar, Oatley, Djikic, &amp; Mullin, <a href="#CR62" rid="CR62" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">2011</a>), we would expect stories to be better recalled than exposition.
Our primary research question was whether memory and comprehension differ for narrative versus expository texts. Our three-level random-effects meta-analysis of 150 effect-sizes found that, on average, memory and comprehension of narrative texts was superior to that for expository texts.
Our meta-analysis of 150 effect-sizes (from over 75 unique samples and more than 33,000 participants) found that people had an easier time comprehending and recalling narrative texts compared to expository ones. The average magnitude of this effect was more than a half a standard deviation, with a 95% CI ranging from just more than one-quarter to slightly more than three-quarters of a standard deviation. Moreover, this result appears to be robust, and not driven by any one particular effect-size or study. There was a great deal of variability in these effects, however, almost all of which represents true heterogeneity and not random sampling error. This variability originated primarily from differences between studies.
In closing, the totality of the evidence available finds that people have an easier time comprehending and recalling information presented in a story compared to that presented in an essay. This has potential implications for a number of disciplines, not least of which is the realm of education.
To that end, the advantage afforded to narratives over exposition in this domain should be considered whenever possible. We must emphasize, however, that these results should not be interpreted as a suggestion to force all information into a narrative form for pedagogical purposes, especially when such information is not typically presented in this way.
It is quite possible that mixed genres like narrative journalism, for example, could hold the key for leveraging the advantages of narrative–its ability to capture interest and communicate experience through imagination – to meet the goals of exposition to inform and educate (van Krieken &amp; Sanders, <a href="#CR102" rid="CR102" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">in press</a>).
·ncbi.nlm.nih.gov·
Memory and comprehension of narrative versus expository texts: A meta-analysis - PMC
Memory and comprehension of narrative versus expository texts: A meta-analysis - PubMed
Memory and comprehension of narrative versus expository texts: A meta-analysis - PubMed
A meta-analysis comparing how people remember and understand text, broadly categorized as narratives (stories) and expository texts (which they call essays). They acknowledge that the research is mixed, but overall found a "robust" result that stories were easier to understand and remember.
Based on over 75 unique samples and data from more than 33,000 participants, we found that stories were more easily understood and better recalled than essays. Moreover, this result was robust, not influenced by the inclusion of a single effect-size or single study, and not moderated by various study characteristics. This finding has implications for any domain in which acquiring and retaining information is important.
·pubmed.ncbi.nlm.nih.gov·
Memory and comprehension of narrative versus expository texts: A meta-analysis - PubMed
Does writing style change how learners perceive choices in a branched scenario? – Learningworld Design
Does writing style change how learners perceive choices in a branched scenario? – Learningworld Design
Description of PhD research on how the writing style of choices in a branching scenario affected which options learners chose and how they thought about those options. This is a small sample size, but still interesting results in favor of using dialog for branching scenario choices.
Finally, version with dialogue-based choices (see screenshot above) was perceived as more personal and engaging, “lively” and helpful for making a selection (“made me feel like I was talking out loud in my head”).
The findings from this pilot questionnaire seem to indicate that providing framing in the options themselves has more effect on the learner than providing it in an introductory text.
Additionally, options written as dialogue were experienced as more personal and elicited higher emotional reactions of the learner towards the characters. This may be of use in courses about soft skills.
·learningworlddesign.co.nz·
Does writing style change how learners perceive choices in a branched scenario? – Learningworld Design
The power of feedback and reflection: Testing an online scenario-based learning intervention for student teachers - ScienceDirect
The power of feedback and reflection: Testing an online scenario-based learning intervention for student teachers - ScienceDirect
Study looking at how feedback and reflection affect the effectiveness of scenario-based learning in improving self-efficacy and classroom readiness for student teachers. Providing automatic feedback and opportunity to reflect had the biggest effect.
The student teachers were randomly assigned to one of three experimental conditions:control group (online scenario-based learning activity), intervention group 1 (online scenario-based learning activity and feedback), and intervention group 2 (online scenario-based learning, feedback, and reflection). The findings indicated that, compared to the control group, both intervention conditions had a significant positive effect on cognitive classroom readiness. A significant positive effect on self-efficacy was found for intervention group 2. Overall, our research demonstrates the potential of an easy-to-implement online intervention in enhancing self-efficacy and classroom readiness and points towards the importance of combining feedback and reflection within online scenario-based learning activities.
·sciencedirect.com·
The power of feedback and reflection: Testing an online scenario-based learning intervention for student teachers - ScienceDirect
Issue 58: Are Group Projects Actually Dreaded?
Issue 58: Are Group Projects Actually Dreaded?
This issue summarizes a study comparing in-class scenario-based learning to scenario-based elearning. The study found no significant differences in perceived learning, flow, or enjoyment in the in-class and online settings. In effect, the self-paced elearning version of the case study had comparable results to the in-person version.
While the e-learning SBL was not better than the classroom experience, it was comparable. The lack of significance tells us that the online learning students view their engagement, enjoyment, and learning similarly.
<strong>Key Takeaway:</strong> Scenario-based learning is beneficial, both online and in-person. Thus, implementing SBL into e-learning settings, particularly when preparing learners for real-world settings, is an effective way to engage learners.
·learningscienceweekly.com·
Issue 58: Are Group Projects Actually Dreaded?
Accelerating Expertise with Scenario-Based e-Learning - The Watercooler Newsletter : The Watercooler Newsletter
Accelerating Expertise with Scenario-Based e-Learning - The Watercooler Newsletter : The Watercooler Newsletter
Ruth Clark on how scenario-based elearning accelerates expertise and when to use it
What is Scenario-Based e-Learning?
<em>A. The learner assumes the role of an actor responding to a job realistic situation.</em>&nbsp;
<em>B. The learning environment is preplanned</em>.&nbsp;
<em>C. Learning is inductive rather than instructive.</em>&nbsp;
<em>D. The instruction is guided</em>.&nbsp;
<em>E. Scenario lessons incorporate instructional resources.</em>&nbsp;
<em>F. The goal is to accelerate workplace expertise.</em>&nbsp;
As you consider incorporating scenario-based e-Learning into your instructional mix, consider whether the acceleration of expertise will give you a return on investment.&nbsp; For example, interviews with subject matter experts indicated that automotive technicians must complete about 100 work orders to reach a reasonable competency level in any given troubleshooting domain.&nbsp; Comparing delivery alternatives, OJT would require around 200+ hours, instructor-led training would require around 100 hours, and scenario-based e-Learning simulations require approximately 33–66 hours.
Finally, many learners find scenario-based e-Learning more motivating than traditional instructional formats.&nbsp; Solving a work-related problem makes the instruction immediately relevant.
·watercoolernewsletter.com·
Accelerating Expertise with Scenario-Based e-Learning - The Watercooler Newsletter : The Watercooler Newsletter
Scenario-based-learning.pdf
Scenario-based-learning.pdf

"Scenario-based learning is based on the principles of situated learning theory (Lave & Wenger, 1991), which argues that learning best takes place in the context in which it is going to be used, and situated cognition, the idea that knowledge is best acquired and more fully understood when situated within its context (Kindley, 2002)."

"SBL usually works best when applied to tasks requiring decision-making and critical thinking in complex situations. Tasks that are routine to the students will require little critical thinking or decision-making, and may be better assessed using other methods. "

"Checklist: Is SBL the right option? (Clark, 2009)

  • Are the outcomes based on skills development or problem-solving?
  • Is it difficult or unsafe to provide real-world experience of the skills?
  • Do your students already have some relevant knowledge to aid decision-making?
  • Do you have time and resources to design, develop, and test an SBL approach?
  • Will the content and skills remain relevant for long enough to justify the development of SBL?"
·quality4digitallearning.org·
Scenario-based-learning.pdf
Will at Work Learning: Case Question -- Concept Mapping, Question Answering, Multiple Sessions
Will at Work Learning: Case Question -- Concept Mapping, Question Answering, Multiple Sessions
Research on the effectiveness of concept mapping, answering retrieval questions, and reading in multiple sessions. I like the presentation of this in a scenario where you are asked to predict the results of research rather than simply summarizing the study.
·willatworklearning.com·
Will at Work Learning: Case Question -- Concept Mapping, Question Answering, Multiple Sessions
Spaced education improves the retention of clinical knowledge by medical students: a randomised controlled trial - Kerfoot - 2006 - Medical Education - Wiley Online Library
Spaced education improves the retention of clinical knowledge by medical students: a randomised controlled trial - Kerfoot - 2006 - Medical Education - Wiley Online Library
Research summary on spaced education for medical students. The e-learning included emailed scenarios and questions. The summary and conclusion talk about medical knowledge, but since this is about scenarios it seems like there might be some decision-making skills being reinforced here too.
<b>Conclusion </b> Spaced education consisting of clinical scenarios and questions distributed weekly via e-mail can significantly improve students' retention of medical knowledge.
·onlinelibrary.wiley.com·
Spaced education improves the retention of clinical knowledge by medical students: a randomised controlled trial - Kerfoot - 2006 - Medical Education - Wiley Online Library
Will at Work Learning: New Research Report on Using Culturally, Linguistically, and Situationally Relevant Scenarios
Will at Work Learning: New Research Report on Using Culturally, Linguistically, and Situationally Relevant Scenarios
Research on how to support learning with scenarios that are relevant to the specific situation. Even though this is explicitly about workplace training, the major recommendations could be adapted for instructional design in education contexts too.
Utilize decision-making scenarios. Consider using them not just in a minor role—for example at the end of a section—but integrated into the main narrative of your learning design.
Determine the most important points you want to get across AND the most important situations in which these points are critical. Then, provide extra repetitions spaced over time on these key points and situations.
·willatworklearning.com·
Will at Work Learning: New Research Report on Using Culturally, Linguistically, and Situationally Relevant Scenarios