Presentation: Graders as Meta-Reviewers: Simultaneously Scaling and Improving Expert Evaluation for Large Online Classrooms

Learning @ Scale 2016 provided a “flipped” track, where presenters would record a presentation in advance for attendees to watch, then discuss the presentation during the conference. Presentations were compiled on EdX.

Watch on EdX

We recommend viewing the presentation on EdX to see all the interactive elements, poll questions, references, and related readings. To view on EdX, click here and create an account.

Watch Here

If you would prefer, the entire presentation has been compiled into a single video below. Note that any abrupt cuts or inaccuracies are likely due to additional materials being available only on EdX.

Part 1

Part 2

Associated People

Associated Projects

Scaling Online Assessment

Associated Publications

2016: Graders as Meta-Reviewers: Simultaneously Scaling and Improving Expert Evaluation for Large Online Classrooms. David Joyner, Wade Ashby, Liam Irish, Yeeling Lam, Jacob Langston, Isabel Lupiani, Mike Lustig, Paige Pettoruto, Dana Sheahen, Angela Smiley, Amy Bruckman, & Ashok Goel. In Proceedings of the Third Annual ACM Conference on Learning @ Scale. Edinburgh, UK.