The Pesky Challenge of Evaluating AI Outputs – Usable Learning
Julie Dirksen observes that lots of people (myself included) talk about the importance of making sure that any content created by AI is reviewed by a person. The task of evaluating the outputs of AI is a challenging one though, and it's one worth paying attention to as we continue to explore the possibilities of AI.
First of all, you need <em>the expertise to judge an output</em>, and second you need <em>the discipline to exert the effort </em>required to assess an output.
<p>More thoughts to come on this, but for now, I think there are a few questions we should be asking:</p>
<ul>
<li>Does this person have the knowledge and expertise to judge this output?</li>
<li>Is it reasonable to expect this person has the discipline to evaluate the outputs in detail?</li>
<li>What is the risk if output errors are not caught?</li></ul>
