Found 196 bookmarks
Newest
Reflecting on Research and Practice
Reflecting on Research and Practice
How do we put research into practice in L&D? Clark Quinn reflects on the work of the LDA (Learning Development Accelerator) to improve the field of L&D with approaches informed by science and research. Clark discusses how science is always improving, so our understanding can change over time. Research can also be misleading or biased (or shared in misleading ways). Still, we can be more effective in our work with evidence-informed practices.
·linkedin.com·
Reflecting on Research and Practice
The Pesky Challenge of Evaluating AI Outputs – Usable Learning
The Pesky Challenge of Evaluating AI Outputs – Usable Learning
Julie Dirksen observes that lots of people (myself included) talk about the importance of making sure that any content created by AI is reviewed by a person. The task of evaluating the outputs of AI is a challenging one though, and it's one worth paying attention to as we continue to explore the possibilities of AI.
First of all, you need <em>the expertise to judge an output</em>, and second you need <em>the discipline to exert the effort </em>required to assess an output.
<p>More thoughts to come on this, but for now, I think there are a few questions we should be asking:</p> <ul> <li>Does this person have the knowledge and expertise to judge this output?</li> <li>Is it reasonable to expect this person has the discipline to evaluate the outputs in detail?</li> <li>What is the risk if output errors are not caught?</li></ul>
·usablelearning.com·
The Pesky Challenge of Evaluating AI Outputs – Usable Learning
Memory and comprehension of narrative versus expository texts: A meta-analysis - PMC
Memory and comprehension of narrative versus expository texts: A meta-analysis - PMC
The full text of the meta-analysis comparing memory and understanding of stories versus expository text. The researchers are careful to note the limitations of this evidence, but overall found that narratives have an advantage over expository text and explanations.
Stories may be easier to remember and comprehend than essays because stories resemble our everyday experiences (Bruner, <a href="#CR10" rid="CR10" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">1986</a>; Graesser et al., <a href="#CR39" rid="CR39" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">1991</a>). People experience life in the real world as temporally ordered causal events, organized around personal goals, with the encountering and overcoming of obstacles to these goals resulting in emotional experiences; this parallels the structure of stories (Graesser, McNamara, &amp; Louwerse, <a href="#CR37" rid="CR37" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">2003</a>; Graesser, Singer, &amp; Trabasso, <a href="#CR38" rid="CR38" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">1994</a>).
Familiarity with the structure and content of a text is referred to as relevant “prior knowledge” (Dochy, Segers, &amp; Buehl, <a href="#CR28" rid="CR28" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">1999</a>), and stories might be more memorable and comprehensible thanks to readers having greater prior knowledge.
Readers are less likely to benefit from prior knowledge while reading an essay, relative to stories, and are therefore less likely to benefit from easy inferences. This combination could easily put expository texts at a disadvantage when it comes to memory and comprehension (Coté, Goldman, &amp; Saul, <a href="#CR18" rid="CR18" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">1998</a>; McNamara, <a href="#CR68" rid="CR68" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">2004</a>).
A final reason to believe that narratives may be more memorable than expository texts hinges on the ability of emotions to facilitate memory (Hamann, <a href="#CR42" rid="CR42" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">2001</a>). Affectively charged recollections have been dubbed “flash-bulb” memories, to communicate the idea that emotional events are deeply imprinted on the mind, like a flash aiding photography (Winograd &amp; Neisser, <a href="#CR107" rid="CR107" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">1992</a>). This emotional facilitation of memory appears to result from a prioritizing of emotional material when it comes to attention and perception (Brosch, Pourtois, &amp; Sander, <a href="#CR9" rid="CR9" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">2010</a>), with personal relevance playing a key role (Levine &amp; Edelstein, <a href="#CR58" rid="CR58" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">2009</a>). To the extent that stories are better able to evoke strong emotions than expository texts (cf. Mar, Oatley, Djikic, &amp; Mullin, <a href="#CR62" rid="CR62" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">2011</a>), we would expect stories to be better recalled than exposition.
Our primary research question was whether memory and comprehension differ for narrative versus expository texts. Our three-level random-effects meta-analysis of 150 effect-sizes found that, on average, memory and comprehension of narrative texts was superior to that for expository texts.
Our meta-analysis of 150 effect-sizes (from over 75 unique samples and more than 33,000 participants) found that people had an easier time comprehending and recalling narrative texts compared to expository ones. The average magnitude of this effect was more than a half a standard deviation, with a 95% CI ranging from just more than one-quarter to slightly more than three-quarters of a standard deviation. Moreover, this result appears to be robust, and not driven by any one particular effect-size or study. There was a great deal of variability in these effects, however, almost all of which represents true heterogeneity and not random sampling error. This variability originated primarily from differences between studies.
In closing, the totality of the evidence available finds that people have an easier time comprehending and recalling information presented in a story compared to that presented in an essay. This has potential implications for a number of disciplines, not least of which is the realm of education.
To that end, the advantage afforded to narratives over exposition in this domain should be considered whenever possible. We must emphasize, however, that these results should not be interpreted as a suggestion to force all information into a narrative form for pedagogical purposes, especially when such information is not typically presented in this way.
It is quite possible that mixed genres like narrative journalism, for example, could hold the key for leveraging the advantages of narrative–its ability to capture interest and communicate experience through imagination – to meet the goals of exposition to inform and educate (van Krieken &amp; Sanders, <a href="#CR102" rid="CR102" class=" bibr popnode" role="button" aria-expanded="false" aria-haspopup="true">in press</a>).
·ncbi.nlm.nih.gov·
Memory and comprehension of narrative versus expository texts: A meta-analysis - PMC
Memory and comprehension of narrative versus expository texts: A meta-analysis - PubMed
Memory and comprehension of narrative versus expository texts: A meta-analysis - PubMed
A meta-analysis comparing how people remember and understand text, broadly categorized as narratives (stories) and expository texts (which they call essays). They acknowledge that the research is mixed, but overall found a "robust" result that stories were easier to understand and remember.
Based on over 75 unique samples and data from more than 33,000 participants, we found that stories were more easily understood and better recalled than essays. Moreover, this result was robust, not influenced by the inclusion of a single effect-size or single study, and not moderated by various study characteristics. This finding has implications for any domain in which acquiring and retaining information is important.
·pubmed.ncbi.nlm.nih.gov·
Memory and comprehension of narrative versus expository texts: A meta-analysis - PubMed
WIIFM: Beyond Traditional Learning Objectives — Arboth
WIIFM: Beyond Traditional Learning Objectives — Arboth
I appreciate how this post includes examples of how to grab learner's attention with stories and other tactics rather than just listing the full formal learning objectives. This article cites my blog post on learning objectives.
Next example: a training on "Cryogenic nitrogen and associated dangers". We started this training with an impactful image: An industry hall, exit door in the back and some materials obstructing the exit. All of a sudden, a cryogenic fog sets up, making it impossible to see the floor. Question to the learner was: Find your way out, without stumbling (and thus suffocating). Remember the materials? Remember you are dealing with nitrogen? Without explicitly listing learning objectives in the beginning of the e-Learning, we captured learners' attention, making them eager to learn more about other characteristics of nitrogen and the safety measures in such environments.
·arboth.squarespace.com·
WIIFM: Beyond Traditional Learning Objectives — Arboth
Recordings - IDEAL22: The Inclusion, Diversity, Equity, and Accessibility for Learning Conference
Recordings - IDEAL22: The Inclusion, Diversity, Equity, and Accessibility for Learning Conference
All recordings from the IDEAL 2022 conference by the TLDC. Hear Bela Gaytan, Kayleen Holt, Bridget Brown, Devin Torres and others speak about inclusive learning. This was a free conference, and the recordings are available even if you didn't attend live.
·thetldc.com·
Recordings - IDEAL22: The Inclusion, Diversity, Equity, and Accessibility for Learning Conference
The minimal relationship between simulation fidelity and transfer of learning - PubMed
The minimal relationship between simulation fidelity and transfer of learning - PubMed
Does a high-fidelity simulation produce better results than a low-fidelity simulation? This meta analysis didn't find a significant advantage, at least in training for clinical and patient care skills. That doesn't mean some other skills wouldn't benefit from high-fidelity simulations, but it does support the idea that the lower cost simulations can still provide positive results.
·pubmed.ncbi.nlm.nih.gov·
The minimal relationship between simulation fidelity and transfer of learning - PubMed
The 85% Rule for Learning - Scott H Young
The 85% Rule for Learning - Scott H Young
We don't learn very well if the tasks are so easy that we get it perfectly right every time, or so hard that we're constantly failing. While it's not the same for every task, this suggests that learning is more effective if you can succeed 80-85% of the time.
The 85% rule suggests growth will be maximized when we practice tasks we can succeed at roughly four-fifths of the time.
If you succeed in every attempt, you probably don’t have the difficulty high enough to improve. If you fail most of the time, you will likely make more progress if you start picking smaller, more manageable challenges.
·scotthyoung.com·
The 85% Rule for Learning - Scott H Young
David Kelly’s Curated L&D Content for the Week of 2/28/22 – The Learning Guild’s TWIST
David Kelly’s Curated L&D Content for the Week of 2/28/22 – The Learning Guild’s TWIST
David Kelly included my post on how research informs my work as part of his list of curated content
<strong><a href="https://www.christytuckerlearning.com/how-research-informs-my-work/" target="_blank" rel="noreferrer noopener">How Research Informs My Work</a><br></strong><em>Research plays an important role in the work of learning professionals. While our work often serves organizational performance goals, educational research forms the foundations upon which we can build programs that can effectively target those goals. It’s not about one being more important than the other; as Christy Tucker explains in this inciteful post, research informs the work we do in L&amp;D.</em>
·twist.learningguild.net·
David Kelly’s Curated L&D Content for the Week of 2/28/22 – The Learning Guild’s TWIST
Best from the Brightest: Key Ideas and Insights for L&P Professionals - TiER1 Performance
Best from the Brightest: Key Ideas and Insights for L&P Professionals - TiER1 Performance
48 learning and performance leaders share their favorite content shared in 2021. Use this list to find both new sources to read and new people to follow. Many of the participants also shared trends to watch in 2022, other recommended content, and additional people to follow. This list is heavy on evidence-informed design.
·tier1performance.com·
Best from the Brightest: Key Ideas and Insights for L&P Professionals - TiER1 Performance
Ask the Cognitive Scientist | American Federation of Teachers
Ask the Cognitive Scientist | American Federation of Teachers
Daniel Willingham summarizes some of the research on how stories can improve learning. In addition to the research examples, he explains elements of story as found in movies and explains how these can be applied in learning. While the learning examples are all focused on classroom teaching, some of this could be applied to workplace training too.
·aft.org·
Ask the Cognitive Scientist | American Federation of Teachers
The power of feedback and reflection: Testing an online scenario-based learning intervention for student teachers - ScienceDirect
The power of feedback and reflection: Testing an online scenario-based learning intervention for student teachers - ScienceDirect
Study looking at how feedback and reflection affect the effectiveness of scenario-based learning in improving self-efficacy and classroom readiness for student teachers. Providing automatic feedback and opportunity to reflect had the biggest effect.
The student teachers were randomly assigned to one of three experimental conditions:control group (online scenario-based learning activity), intervention group 1 (online scenario-based learning activity and feedback), and intervention group 2 (online scenario-based learning, feedback, and reflection). The findings indicated that, compared to the control group, both intervention conditions had a significant positive effect on cognitive classroom readiness. A significant positive effect on self-efficacy was found for intervention group 2. Overall, our research demonstrates the potential of an easy-to-implement online intervention in enhancing self-efficacy and classroom readiness and points towards the importance of combining feedback and reflection within online scenario-based learning activities.
·sciencedirect.com·
The power of feedback and reflection: Testing an online scenario-based learning intervention for student teachers - ScienceDirect
Issue 58: Are Group Projects Actually Dreaded?
Issue 58: Are Group Projects Actually Dreaded?
This issue summarizes a study comparing in-class scenario-based learning to scenario-based elearning. The study found no significant differences in perceived learning, flow, or enjoyment in the in-class and online settings. In effect, the self-paced elearning version of the case study had comparable results to the in-person version.
While the e-learning SBL was not better than the classroom experience, it was comparable. The lack of significance tells us that the online learning students view their engagement, enjoyment, and learning similarly.
<strong>Key Takeaway:</strong> Scenario-based learning is beneficial, both online and in-person. Thus, implementing SBL into e-learning settings, particularly when preparing learners for real-world settings, is an effective way to engage learners.
·learningscienceweekly.com·
Issue 58: Are Group Projects Actually Dreaded?
Learning Objectives: GOAL!?! – 3-Star learning experiences
Learning Objectives: GOAL!?! – 3-Star learning experiences
Summary of research on the value of telling learners the objectives at the beginning of training. The research supports giving learners specific "focusing objectives" to help them recognize what's important. However, that doesn't mean those objectives need to be the same formal learning objectives we use as IDs. In fact, using objectives as multiple choice questions to show people what they don't know yet may be effective.
As instructors and designers, we need to keep in mind that there can be other reasons to use objectives <em>and </em>we need to clearly distinguish between objectives that we use as instructional/learning designers versus the ones we might use for learners.
·3starlearningexperiences.wordpress.com·
Learning Objectives: GOAL!?! – 3-Star learning experiences
How to Use Plain Language to Improve Learning Outcomes | Scissortail Creative Services, LLC
How to Use Plain Language to Improve Learning Outcomes | Scissortail Creative Services, LLC
We all probably know we should use easier to understand language in instructional writing, but this article provides more specifics on how to actually do that. The before and after writing example shows what a significant difference it can make.
·scissortailcs.com·
How to Use Plain Language to Improve Learning Outcomes | Scissortail Creative Services, LLC
The State and Future of Learning & Development in 2021: See What the Experts Think!
The State and Future of Learning & Development in 2021: See What the Experts Think!
Jeffrey Dalto collected responses from a number of L&D professionals for insights on how COVID-19 has affected L&D and how this affects the future trends for the field.
We’d like to thank all of the contributors for sharing their time, knowledge, and insight. They include Connie Malamed, Arun Pradhan, Patti Shank, Cara North, Clark Quinn, Stella Lee, Zsolt Olah, Julie Dirksen, Mike Taylor, Jacinta Penn, Guy Wallace, Emily Wood, Kassy Laborie, Alexander Salas, Michelle Ockers, Shannon Tipton, Christy Tucker, Linda Berberich, and Richard (Dick) Clark.
·convergencetraining.com·
The State and Future of Learning & Development in 2021: See What the Experts Think!
Brain Science: Enable Your Brain to Remember Almost Everything | Learning Solutions Magazine
Brain Science: Enable Your Brain to Remember Almost Everything | Learning Solutions Magazine
Use memory boosters to reduce how much people forget after training.
So how often should information be boostered? We recommend that you send boosters out in three phases. You can keep this in mind by remembering 2+2+2. Send out boosters after two days, two weeks, and two months.
This first set of boosters should be “recognition boosters.” The strategy here is just to get people to try to recognize the right answer from a list of options.
The second phase of boosters should be sent about two weeks after the training and at this time you should send out “generative boosters.” In a generative booster, the learner does not just recognize the right answer from a list. Instead, they have to think about the topic and then create an answer out of their head.
The third phase of boosters should be sent about two months after the training, and at this time you should send out “integrative boosters.” An integrative booster again prompts the learner to retrieve the information, but this question specifically asks them to provide concrete examples of how they have made use of this information in their job.
·learningsolutionsmag.com·
Brain Science: Enable Your Brain to Remember Almost Everything | Learning Solutions Magazine
The Mindset Controversy: Carol Dweck Speaks... |Education & Teacher Conferences
The Mindset Controversy: Carol Dweck Speaks... |Education & Teacher Conferences
A summary of Dweck's response to recent unsuccessful research on growth mindset. It's probably less important to teach the concept of mindset than to adjust methods of teaching and providing feedback.
<p>Dweck emphasizes that mindset interventions should not be one-time events.</p> <p>Anything that happens just once — “a chart at the front of the room, a lecture where you define the two mindsets” — isn’t likely to work.</p> <p>Instead, we should focus on “the policies and practices in the classroom. <em>It is not about teaching the concept alone</em>, it is much more about implementing practices that focus on growth and learning.” [emphasis added] </p>
·learningandthebrain.com·
The Mindset Controversy: Carol Dweck Speaks... |Education & Teacher Conferences
Learning Technology Mystery Series Presents “The Case of the Disengaged Learner” with Cara North - The Training, Learning, and Development Community
Learning Technology Mystery Series Presents “The Case of the Disengaged Learner” with Cara North - The Training, Learning, and Development Community
Cara North's recorded presentation on engagement in learning. Engagement can be cognitive, behavioral, or emotional. Additional resources at go.osu.edu/disengaged
·tldc.us·
Learning Technology Mystery Series Presents “The Case of the Disengaged Learner” with Cara North - The Training, Learning, and Development Community
Book — The Learning Scientists
Book — The Learning Scientists
Quick summaries of key points from each chapter in a book on learning science and effective strategies (spacing, elaboration, concrete examples, visuals, and retrieval practice). I wish the graphics were easier to read though. Medium blue italicized serif text on a lighter blue background isn't enough contrast. I don't think low contrast counts as desirable difficulty, just bad accessibility.
·learningscientists.org·
Book — The Learning Scientists