Found 77 bookmarks
Newest
Reflecting on Research and Practice
Reflecting on Research and Practice
How do we put research into practice in L&D? Clark Quinn reflects on the work of the LDA (Learning Development Accelerator) to improve the field of L&D with approaches informed by science and research. Clark discusses how science is always improving, so our understanding can change over time. Research can also be misleading or biased (or shared in misleading ways). Still, we can be more effective in our work with evidence-informed practices.
·linkedin.com·
Reflecting on Research and Practice
Memory and comprehension of narrative versus expository texts: A meta-analysis - PMC
Memory and comprehension of narrative versus expository texts: A meta-analysis - PMC
The full text of the meta-analysis comparing memory and understanding of stories versus expository text. The researchers are careful to note the limitations of this evidence, but overall found that narratives have an advantage over expository text and explanations.
Stories may be easier to remember and comprehend than essays because stories resemble our everyday experiences (Bruner, <a href="#CR10" rid="CR10" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">1986</a>; Graesser et al., <a href="#CR39" rid="CR39" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">1991</a>). People experience life in the real world as temporally ordered causal events, organized around personal goals, with the encountering and overcoming of obstacles to these goals resulting in emotional experiences; this parallels the structure of stories (Graesser, McNamara, &amp; Louwerse, <a href="#CR37" rid="CR37" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">2003</a>; Graesser, Singer, &amp; Trabasso, <a href="#CR38" rid="CR38" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">1994</a>).
Familiarity with the structure and content of a text is referred to as relevant “prior knowledge” (Dochy, Segers, &amp; Buehl, <a href="#CR28" rid="CR28" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">1999</a>), and stories might be more memorable and comprehensible thanks to readers having greater prior knowledge.
Readers are less likely to benefit from prior knowledge while reading an essay, relative to stories, and are therefore less likely to benefit from easy inferences. This combination could easily put expository texts at a disadvantage when it comes to memory and comprehension (Coté, Goldman, &amp; Saul, <a href="#CR18" rid="CR18" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">1998</a>; McNamara, <a href="#CR68" rid="CR68" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">2004</a>).
A final reason to believe that narratives may be more memorable than expository texts hinges on the ability of emotions to facilitate memory (Hamann, <a href="#CR42" rid="CR42" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">2001</a>). Affectively charged recollections have been dubbed “flash-bulb” memories, to communicate the idea that emotional events are deeply imprinted on the mind, like a flash aiding photography (Winograd &amp; Neisser, <a href="#CR107" rid="CR107" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">1992</a>). This emotional facilitation of memory appears to result from a prioritizing of emotional material when it comes to attention and perception (Brosch, Pourtois, &amp; Sander, <a href="#CR9" rid="CR9" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">2010</a>), with personal relevance playing a key role (Levine &amp; Edelstein, <a href="#CR58" rid="CR58" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">2009</a>). To the extent that stories are better able to evoke strong emotions than expository texts (cf. Mar, Oatley, Djikic, &amp; Mullin, <a href="#CR62" rid="CR62" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">2011</a>), we would expect stories to be better recalled than exposition.
Our primary research question was whether memory and comprehension differ for narrative versus expository texts. Our three-level random-effects meta-analysis of 150 effect-sizes found that, on average, memory and comprehension of narrative texts was superior to that for expository texts.
Our meta-analysis of 150 effect-sizes (from over 75 unique samples and more than 33,000 participants) found that people had an easier time comprehending and recalling narrative texts compared to expository ones. The average magnitude of this effect was more than a half a standard deviation, with a 95% CI ranging from just more than one-quarter to slightly more than three-quarters of a standard deviation. Moreover, this result appears to be robust, and not driven by any one particular effect-size or study. There was a great deal of variability in these effects, however, almost all of which represents true heterogeneity and not random sampling error. This variability originated primarily from differences between studies.
In closing, the totality of the evidence available finds that people have an easier time comprehending and recalling information presented in a story compared to that presented in an essay. This has potential implications for a number of disciplines, not least of which is the realm of education.
To that end, the advantage afforded to narratives over exposition in this domain should be considered whenever possible. We must emphasize, however, that these results should not be interpreted as a suggestion to force all information into a narrative form for pedagogical purposes, especially when such information is not typically presented in this way.
It is quite possible that mixed genres like narrative journalism, for example, could hold the key for leveraging the advantages of narrative–its ability to capture interest and communicate experience through imagination – to meet the goals of exposition to inform and educate (van Krieken &amp; Sanders, <a href="#CR102" rid="CR102" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">in press</a>).
·ncbi.nlm.nih.gov·
Memory and comprehension of narrative versus expository texts: A meta-analysis - PMC
Memory and comprehension of narrative versus expository texts: A meta-analysis - PubMed
Memory and comprehension of narrative versus expository texts: A meta-analysis - PubMed
A meta-analysis comparing how people remember and understand text, broadly categorized as narratives (stories) and expository texts (which they call essays). They acknowledge that the research is mixed, but overall found a "robust" result that stories were easier to understand and remember.
Based on over 75 unique samples and data from more than 33,000 participants, we found that stories were more easily understood and better recalled than essays. Moreover, this result was robust, not influenced by the inclusion of a single effect-size or single study, and not moderated by various study characteristics. This finding has implications for any domain in which acquiring and retaining information is important.
·pubmed.ncbi.nlm.nih.gov·
Memory and comprehension of narrative versus expository texts: A meta-analysis - PubMed
The minimal relationship between simulation fidelity and transfer of learning - PubMed
The minimal relationship between simulation fidelity and transfer of learning - PubMed
Does a high-fidelity simulation produce better results than a low-fidelity simulation? This meta analysis didn't find a significant advantage, at least in training for clinical and patient care skills. That doesn't mean some other skills wouldn't benefit from high-fidelity simulations, but it does support the idea that the lower cost simulations can still provide positive results.
·pubmed.ncbi.nlm.nih.gov·
The minimal relationship between simulation fidelity and transfer of learning - PubMed
The 85% Rule for Learning - Scott H Young
The 85% Rule for Learning - Scott H Young
We don't learn very well if the tasks are so easy that we get it perfectly right every time, or so hard that we're constantly failing. While it's not the same for every task, this suggests that learning is more effective if you can succeed 80-85% of the time.
The 85% rule suggests growth will be maximized when we practice tasks we can succeed at roughly four-fifths of the time.
If you succeed in every attempt, you probably don’t have the difficulty high enough to improve. If you fail most of the time, you will likely make more progress if you start picking smaller, more manageable challenges.
·scotthyoung.com·
The 85% Rule for Learning - Scott H Young
David Kelly’s Curated L&D Content for the Week of 2/28/22 – The Learning Guild’s TWIST
David Kelly’s Curated L&D Content for the Week of 2/28/22 – The Learning Guild’s TWIST
David Kelly included my post on how research informs my work as part of his list of curated content
<strong><a href="https://www.christytuckerlearning.com/how-research-informs-my-work/" target="_blank" rel="noreferrer noopener">How Research Informs My Work</a><br></strong><em>Research plays an important role in the work of learning professionals. While our work often serves organizational performance goals, educational research forms the foundations upon which we can build programs that can effectively target those goals. It’s not about one being more important than the other; as Christy Tucker explains in this inciteful post, research informs the work we do in L&amp;D.</em>
·twist.learningguild.net·
David Kelly’s Curated L&D Content for the Week of 2/28/22 – The Learning Guild’s TWIST
Best from the Brightest: Key Ideas and Insights for L&P Professionals - TiER1 Performance
Best from the Brightest: Key Ideas and Insights for L&P Professionals - TiER1 Performance
48 learning and performance leaders share their favorite content shared in 2021. Use this list to find both new sources to read and new people to follow. Many of the participants also shared trends to watch in 2022, other recommended content, and additional people to follow. This list is heavy on evidence-informed design.
·tier1performance.com·
Best from the Brightest: Key Ideas and Insights for L&P Professionals - TiER1 Performance
The power of feedback and reflection: Testing an online scenario-based learning intervention for student teachers - ScienceDirect
The power of feedback and reflection: Testing an online scenario-based learning intervention for student teachers - ScienceDirect
Study looking at how feedback and reflection affect the effectiveness of scenario-based learning in improving self-efficacy and classroom readiness for student teachers. Providing automatic feedback and opportunity to reflect had the biggest effect.
The student teachers were randomly assigned to one of three experimental conditions:control group (online scenario-based learning activity), intervention group 1 (online scenario-based learning activity and feedback), and intervention group 2 (online scenario-based learning, feedback, and reflection). The findings indicated that, compared to the control group, both intervention conditions had a significant positive effect on cognitive classroom readiness. A significant positive effect on self-efficacy was found for intervention group 2. Overall, our research demonstrates the potential of an easy-to-implement online intervention in enhancing self-efficacy and classroom readiness and points towards the importance of combining feedback and reflection within online scenario-based learning activities.
·sciencedirect.com·
The power of feedback and reflection: Testing an online scenario-based learning intervention for student teachers - ScienceDirect
Issue 58: Are Group Projects Actually Dreaded?
Issue 58: Are Group Projects Actually Dreaded?
This issue summarizes a study comparing in-class scenario-based learning to scenario-based elearning. The study found no significant differences in perceived learning, flow, or enjoyment in the in-class and online settings. In effect, the self-paced elearning version of the case study had comparable results to the in-person version.
While the e-learning SBL was not better than the classroom experience, it was comparable. The lack of significance tells us that the online learning students view their engagement, enjoyment, and learning similarly.
<strong>Key Takeaway:</strong> Scenario-based learning is beneficial, both online and in-person. Thus, implementing SBL into e-learning settings, particularly when preparing learners for real-world settings, is an effective way to engage learners.
·learningscienceweekly.com·
Issue 58: Are Group Projects Actually Dreaded?
Learning Objectives: GOAL!?! – 3-Star learning experiences
Learning Objectives: GOAL!?! – 3-Star learning experiences
Summary of research on the value of telling learners the objectives at the beginning of training. The research supports giving learners specific "focusing objectives" to help them recognize what's important. However, that doesn't mean those objectives need to be the same formal learning objectives we use as IDs. In fact, using objectives as multiple choice questions to show people what they don't know yet may be effective.
As instructors and designers, we need to keep in mind that there can be other reasons to use objectives <em>and </em>we need to clearly distinguish between objectives that we use as instructional/learning designers versus the ones we might use for learners.
·3starlearningexperiences.wordpress.com·
Learning Objectives: GOAL!?! – 3-Star learning experiences
Brain Science: Enable Your Brain to Remember Almost Everything | Learning Solutions Magazine
Brain Science: Enable Your Brain to Remember Almost Everything | Learning Solutions Magazine
Use memory boosters to reduce how much people forget after training.
So how often should information be boostered? We recommend that you send boosters out in three phases. You can keep this in mind by remembering 2+2+2. Send out boosters after two days, two weeks, and two months.
This first set of boosters should be “recognition boosters.” The strategy here is just to get people to try to recognize the right answer from a list of options.
The second phase of boosters should be sent about two weeks after the training and at this time you should send out “generative boosters.” In a generative booster, the learner does not just recognize the right answer from a list. Instead, they have to think about the topic and then create an answer out of their head.
The third phase of boosters should be sent about two months after the training, and at this time you should send out “integrative boosters.” An integrative booster again prompts the learner to retrieve the information, but this question specifically asks them to provide concrete examples of how they have made use of this information in their job.
·learningsolutionsmag.com·
Brain Science: Enable Your Brain to Remember Almost Everything | Learning Solutions Magazine
The Mindset Controversy: Carol Dweck Speaks... |Education & Teacher Conferences
The Mindset Controversy: Carol Dweck Speaks... |Education & Teacher Conferences
A summary of Dweck's response to recent unsuccessful research on growth mindset. It's probably less important to teach the concept of mindset than to adjust methods of teaching and providing feedback.
<p>Dweck emphasizes that mindset interventions should not be one-time events.</p> <p>Anything that happens just once — “a chart at the front of the room, a lecture where you define the two mindsets” — isn’t likely to work.</p> <p>Instead, we should focus on “the policies and practices in the classroom. <em>It is not about teaching the concept alone</em>, it is much more about implementing practices that focus on growth and learning.” [emphasis added] </p>
·learningandthebrain.com·
The Mindset Controversy: Carol Dweck Speaks... |Education & Teacher Conferences
Learning Technology Mystery Series Presents “The Case of the Disengaged Learner” with Cara North - The Training, Learning, and Development Community
Learning Technology Mystery Series Presents “The Case of the Disengaged Learner” with Cara North - The Training, Learning, and Development Community
Cara North's recorded presentation on engagement in learning. Engagement can be cognitive, behavioral, or emotional. Additional resources at go.osu.edu/disengaged
·tldc.us·
Learning Technology Mystery Series Presents “The Case of the Disengaged Learner” with Cara North - The Training, Learning, and Development Community
Book — The Learning Scientists
Book — The Learning Scientists
Quick summaries of key points from each chapter in a book on learning science and effective strategies (spacing, elaboration, concrete examples, visuals, and retrieval practice). I wish the graphics were easier to read though. Medium blue italicized serif text on a lighter blue background isn't enough contrast. I don't think low contrast counts as desirable difficulty, just bad accessibility.
·learningscientists.org·
Book — The Learning Scientists
Factual Knowledge Must (Not?) Precede Higher Order Thinking |Education & Teacher Conferences
Factual Knowledge Must (Not?) Precede Higher Order Thinking |Education & Teacher Conferences
Summary of Pooja Agarwal's research on retrieval practice for higher order thinking
That is: when students <span style="color: #000000;"><b>didn’t&nbsp;</b></span>review a particular set of facts, they could still reason with them — as long as they <strong>had practiced</strong> doing that kind of reasoning.
·learningandthebrain.com·
Factual Knowledge Must (Not?) Precede Higher Order Thinking |Education & Teacher Conferences
Retrieval Practice & Bloom’s Taxonomy: Do Students Need Fact Knowledge Before Higher Order Learning?
Retrieval Practice & Bloom’s Taxonomy: Do Students Need Fact Knowledge Before Higher Order Learning?
The title is a little misleading. This isn't about needing knowledge per se, but about what kinds of retrieval practice are more helpful for supporting higher order learning. Factual questions helped increase factual knowledge, but they didn't help higher order reasoning. Higher order retrieval practice (on its own or mixed with factual questions) resulted in better performance on the higher order reasoning. If we view this as practicing in context, then it makes sense that practicing skills of similar difficulty would produce better results. However, this is contrary to some of the research that factual knowledge has to be mastered first.
Although fact quizzes were beneficial for fact learning, they did not facilitate higher order learning, contrary to popular intuition based on Bloom’s taxonomy.
Contrary to popular intuition, building a foundation of factual knowledge via retrieval practice did not enhance students’ higher order learning. Instead, students’ final fact test and higher order test performance was greatest following retrieval practice that matched in cognitive complexity based on Bloom’s taxonomy: fact quizzes enhanced final fact test performance and higher order quizzes enhanced final higher order test performance. Retrieval practice increased learning by 20–30% under laboratory conditions with college students and also in an authentic K-12 classroom.
Why didn’t fact quizzes improve higher order learning in the present study, as many cognitive scientists and educators contend? First, students may have been unaware that information on fact quizzes was related to final higher order tests, thus they did not transfer their knowledge without explicit instructions to do so.
Mixed quizzes, comprising both fact and higher order questions, increased higher order test performance more than fact quizzes (in Experiment 2) and slightly more than higher order quizzes (in Experiment
If we want to reach the top of Bloom’s taxonomy, building a foundation of knowledge via fact-based retrieval practice may be less potent than engaging in higher order retrieval practice at the outset, a key finding for future research and classroom application.
·diigo.com·
Retrieval Practice & Bloom’s Taxonomy: Do Students Need Fact Knowledge Before Higher Order Learning?
Does Gamification Actually Work? Yes, and Here's Why | BLP
Does Gamification Actually Work? Yes, and Here's Why | BLP
Gamification works when it's designed thoughtfully and stays focused on learning goals. Sharon Boller shares guidelines and picks apart some questionable research.
1. Keep game complexity simple, particularly when you are using a game to support relatively short lessons.
<strong>2. Reward players for performance, not completion</strong>.
<strong>3. Be cautious with leaderboards</strong>.
4. As much as possible, align the game element choices you use to the learner’s actual job context.
<strong>5. Make the in-game goal align with the learning goal in a reasonable way that “makes sense” for the learners who will play your game or complete your gamified lesson</strong>.
6. Stop thinking you have to make the game super “fun.”
·bottomlineperformance.com·
Does Gamification Actually Work? Yes, and Here's Why | BLP
The Backfire Effect is NOT Prevalent: Good News for Debunkers, Humans, and Learning Professionals! – Work-Learning Research
The Backfire Effect is NOT Prevalent: Good News for Debunkers, Humans, and Learning Professionals! – Work-Learning Research
The "backfire effect" is when sharing facts to correct misconceptions results in people holding onto that belief more strongly, rather than changing their opinion. Newer research, summarized here, finds that the backfire effect is uncommon and mostly related to attitudes which are strongly tied to the person's identity.
·worklearning.com·
The Backfire Effect is NOT Prevalent: Good News for Debunkers, Humans, and Learning Professionals! – Work-Learning Research
Accelerating Expertise with Scenario-Based e-Learning - The Watercooler Newsletter : The Watercooler Newsletter
Accelerating Expertise with Scenario-Based e-Learning - The Watercooler Newsletter : The Watercooler Newsletter
Ruth Clark on how scenario-based elearning accelerates expertise and when to use it
What is Scenario-Based e-Learning?
<em>A. The learner assumes the role of an actor responding to a job realistic situation.</em>&nbsp;
<em>B. The learning environment is preplanned</em>.&nbsp;
<em>C. Learning is inductive rather than instructive.</em>&nbsp;
<em>D. The instruction is guided</em>.&nbsp;
<em>E. Scenario lessons incorporate instructional resources.</em>&nbsp;
<em>F. The goal is to accelerate workplace expertise.</em>&nbsp;
As you consider incorporating scenario-based e-Learning into your instructional mix, consider whether the acceleration of expertise will give you a return on investment.&nbsp; For example, interviews with subject matter experts indicated that automotive technicians must complete about 100 work orders to reach a reasonable competency level in any given troubleshooting domain.&nbsp; Comparing delivery alternatives, OJT would require around 200+ hours, instructor-led training would require around 100 hours, and scenario-based e-Learning simulations require approximately 33–66 hours.
Finally, many learners find scenario-based e-Learning more motivating than traditional instructional formats.&nbsp; Solving a work-related problem makes the instruction immediately relevant.
·watercoolernewsletter.com·
Accelerating Expertise with Scenario-Based e-Learning - The Watercooler Newsletter : The Watercooler Newsletter
Scenario-based-learning.pdf
Scenario-based-learning.pdf

"Scenario-based learning is based on the principles of situated learning theory (Lave & Wenger, 1991), which argues that learning best takes place in the context in which it is going to be used, and situated cognition, the idea that knowledge is best acquired and more fully understood when situated within its context (Kindley, 2002)."

"SBL usually works best when applied to tasks requiring decision-making and critical thinking in complex situations. Tasks that are routine to the students will require little critical thinking or decision-making, and may be better assessed using other methods. "

"Checklist: Is SBL the right option? (Clark, 2009)

  • Are the outcomes based on skills development or problem-solving?
  • Is it difficult or unsafe to provide real-world experience of the skills?
  • Do your students already have some relevant knowledge to aid decision-making?
  • Do you have time and resources to design, develop, and test an SBL approach?
  • Will the content and skills remain relevant for long enough to justify the development of SBL?"
·quality4digitallearning.org·
Scenario-based-learning.pdf
How Relearning Old Concepts Alongside New Ones Makes It All Stick | MindShift | KQED News
How Relearning Old Concepts Alongside New Ones Makes It All Stick | MindShift | KQED News
Rather than studying and practicing a single skill in blocks, it's more effective to use "interleaved" or variable practice of multiple skills. You remember better this way. It's the opposite of cramming where you might do well on a test but forget it all soon after.
·ww2.kqed.org·
How Relearning Old Concepts Alongside New Ones Makes It All Stick | MindShift | KQED News