Wired Campus: Electronic Portfolios: a Path to the Future of Learning - Chronicle.com
Argument for the use of electronic portfolios as a more student-centered assessment of learning
If we truly want to advance from a focus on teaching to a focus on student learning, then a strategy involving something like electronic student portfolios, or ePortfolios, is essential.
On Implementing Web-Based Electronic Portfolios (pdf)
2002 Educause article about using online portfolios. Some of the technical details are dated, but the checklist of "critical factors for successful implementation" is still a good resource
Researching Electronic Portfolios and Learner Engagement (pdf)
Whitepaper on electronic portfolios providing a background on the theory and research. Motivation, engagement, storytelling, and tools are also covered.
Internet Resources for Higher Education Outcomes Assessment
Mega list of online resources related to assessment--tools, journals, conferences, consultants, glossaries, online discussions, portfolio tools, handbooks, and more
The Ultimate eLearning Design and Development Checklist « Flirting w/ eLearning
Checklist for e-learning design and development, with points in many categories: instructional design, technical issues, accessibility, assessment, navigation, design, videos & animation, audio, graphics, text, fonts, testing (QA). This would be a nice starting point for customizing a checklist for a specific organization, tweaking it for particular needs.
Alternatives To ‘Correct’ and ‘Incorrect’: The eLearning Coach
Ideas for better feedback than the generic "correct" and "incorrect" used too often in e-learning. Consequences in a simulation are a form a feedback. So is branching in a scenario.
LearnletsSolutions for Tight Cycles of Assessment - Learnlets
Mini-scenarios and branching scenarios provide better assessment than traditional multiple choice, but this provides some other options for deeper assessment that can still be scored by a computer.
Smile Sheet Questions — New Examples July 2016 – Work-Learning Research
Will Thalheimer shares some new questions using the techniques in his Performance-Based Smile Sheet book, including a simplified version of his "world's best smile sheet question."
<p>Recently, in working with a company to improve their smile sheet, a first draft included the so-called World’s Best Smile Sheet Question. But they were thinking of piloting the new smile sheet for a course to teach basic electronics to facilities professionals. Given the topic and audience, I recommended a simpler version:</p>
<p style="padding-left: 30px;"><strong>How able will you be to put what you’ve learned into practice on the job? Choose one.</strong></p>
<p style="padding-left: 30px;">A. I am NOT AT ALL ready to use the skills taught.<br>
B. I need MORE GUIDANCE to be GOOD at using these skills<br>
C. I need MORE EXPERIENCE to be GOOD at using these skills.<br>
D. I am FULLY COMPETENT in using these skills.<br>
E. I am CAPABLE at an EXPERT LEVEL in using these skills.</p>
<p>This version nicely balances precision with word count.</p>
Three Answer Options Are All You Need on Multiple-Choice Tests!
While we are used to providing 4 options in multiple choice questions, using 3 is just effective. Writing good distractors is the hardest part of writing multiple choice questions. If you only have to write 2 distractors instead of 3, you can create questions faster. While it's not mentioned in this post, reducing the number of options also immensely reduces the complexity of branching scenarios.
So here’s the main finding: <u>no significant differences were found in terms of item difficulty</u>. There were also <u>no differences found in terms of test reliability</u>. Thus, Baghaei and Amrahi (2011) concluded that three answer options are all you need. If the test characteristics are essentially the same, there doesn’t seem to be any reason to spend our time developing additional answer options.
Rodriguez (2005) argues that shifting to three answer options also increases the amount of content that can be tested. Because students don’t have to spend as much time reading four or five answer options, there will be more time during the test for students to read additional questions on different course content. Instead of spending your time on identifying more answer options, spend your time developing additional test questions.
Workshop on Writing Scenario Questions » Work-Learning Research
Will Thalheimer's workshop on writing scenario questions using his SEDA model. His prices for a 2-day workshop definitely reflect his research and expertise.
<h3 style="text-align: center;"><strong>Two-Day Workshop Fee:</strong></h3>
<p style="text-align: center;">Starting at $19,500<br>
(including travel within contiguous US)<br>
plus workbooks at $95 per participant.</p>
Clark Quinn digs into the process of mapping information from SMEs into miniscenarios for assessment. This is about what information you need to get from SMEs (context, decisions, misconceptions, consequences, models for good performance). Those aspects of the information are then maps to parts of the miniscenario (e.g., misconceptions become wrong answers).
So, first, let’s talk about the <a href="https://blog.learnlets.com/2018/11/making-multiple-choice-work/" target="_blank" rel="noopener">structure</a> of a mini-scenario. I’ve suggested that it’s an initial context or story, in which a situation precipitates the need for a decision. There’s the right one, and then alternatives. Not random or silly ones, but ones that represent ways in which learners reliably go wrong. There’s also feedback, which is best as story-based consequences first, then actual conceptual feedback.
Miniscenarios aren’t necessarily the best practice, but they’re typically available in your authoring environment. Writing them isn’t necessarily as easy as generating typical recognition questions, but they more closely mimic the actual task, and therefore lead to better transfer.
Generate multiple choice questions based on your text quickly. Enter text of at least 1000 words and get questions. I think the questions will probably need some editing and definitely need review, but I can see the value of this for a first draft quiz.