Short Answer & The Stanford EdClub were honored to cohost Dr. Dylan Wiliam for a conversation on AI and K12 assessment on Thursday, August 1st 2024. The recording, along with research and resources discussed in the conversation, are linked below.
About Short Answer
Short Answer supports writing across the curriculum initiatives by making it fun and easy to embed writing practice in any content area. As a part of that work, we lead writing-focused workshops and professional development with K12 schools across the country.
Resources Discussed
Dr. Wiliam’s works discussed in introduction:
- Black, Paul, and Dylan Wiliam. “Inside the Black Box: Raising Standards Through Classroom Assessment.” Phi Delta Kappan, vol. 92, no. 1, Oct. 1998.
- Wiliam, Dylan. Embedded Formative Assessment. Solution Tree Press, 2011.
- Wiliam, Dylan. Creating the Schools Our Children Need: Why What We’re Doing Now Won’t Help Much (and What We Can Do Instead). Learning Sciences International, 2018
- Hamilton, Arran, John Hattie, and Dylan Wiliam. Making Room for Impact: A De-implementation Guide for Educators. 1st ed., Corwin, 2023
- Hamilton, Arran, et al. “The Future of AI in Education: 13 Things We Can Do to Minimize the Damage.” EdArXiv, 13 Aug. 2023.
Research discussed in conversation:
- Using Feedback to Improve Learning, a resource referenced around the 5:15 mark when discussing the work of Dr. Min Lee and Dr. Maria Ruiz Primo.
- Kluger & DeNisi Meta-analysis on the effects of feedback on learning discussed at the 5:39 mark
- Marie Clay’s work on Reading Recovery was discussed around the 8:50 mark
- Leon Furze’s AI Assessment Scale and Adrian Cotterell’s classroom-level guidance on approaching AI & assessment through a tiered level of influence discussed around the 19 minute mark
- Illusions of Competence by Dr. Asher Koriat and Dr. Robert Bjork was discussed towards the end when discussing issues of memory, recall, and AI’s influence on student metacognition and self regulated learning
- Dr. Daniel Willingham’s work on metacognition and the challenges students face in judging their own learning effectively was discussed around the 39-minute mark
- Adam Sparks’ post on AI detection research and alternatives to AI detection