Associated Projects

• Virtual Reality in Online Education
• Models of Course Satisfaction
• CS1 at Scale
• Scaling Online Assessment
• Detecting and Deterring Plagiarism
• Designing Online Courses
• Leveraging AI in Classroom Forum Interactions

Associated Publications

• 2020: Attitudinal Trajectories in an Online CS1 Class: Demographic and Performance Trends. David A. Joyner, Lily Bernstein, Maria-Isabelle Dittamo, Ben Englelman, Alysha Naran, Amber Ott, Jasmine Suh & Abby Thien. In Proceedings of the 2020 ACM Conference on Innovation and Technology in Computer Science Education.
• 2020: Enrollment Motivations in an Online Graduate CS Program: Trends & Gender- and Age-Based Differences. Alex Duncan, Bobbie Eicher & David A. Joyner. In Proceedings of the 51st ACM Technical Symposium on Computer Science Education (SIGCSE).
• 2020: Advising of the Students, by the Students, for the Students: The Case of a Student-Owned Peer Advising Community. Alex Duncan & David A. Joyner. In Proceedings of the 18th Annual Hawaii International Conference on Education.
• 2020: Eroding Investment in Repeated Peer Review: A Reaction to Unrequited Aid?. David A. Joyner & Alex Duncan. In Proceedings of the 18th Annual Hawaii International Conference on Education.
• 2019: Surveying the MOOC Data Set Universe. James J. Lohse, Christine A. McManus & David A. Joyner. In 2019 IEEE Learning With MOOCS (LWMOOCS).
• 2019: Annotation-free Automatic Examination Essay Feedback Generation. Filipe Altoe & David A. Joyner. In 2019 IEEE Learning With MOOCS (LWMOOCS).
• 2019: Creating Cadence: Fostering Persistent Engagement in Asynchronous Online Courses. David A. Joyner. In Domizi, D. P. (Ed.) Engaged Student Learning: Essays on Best Practices in the University System of Georgia.
• 2019: Master’s at Scale: Five Years in a Scalable Online Graduate Degree. David A. Joyner & Charles Isbell. In Proceedings of the Sixth Annual ACM Conference on Learning at Scale.
• 2019: Synchronous at Scale: Investigation and Implementation of a Semi-Synchronous Online Lecture Platform. Denise Kutnick & David A. Joyner. In Proceedings of the 6th Annual ACM Conference on Learning at Scale.
• 2019: Peer Advising at Scale: Content and Context of a Learner-Owned Course Evaluation System. Alex Duncan & David A. Joyner. In Proceedings of the 6th Annual ACM Conference on Learning at Scale.
• 2019: Three papers presented at the 2019 Learning @ Scale conference. LucyLabs members presented three papers at Learning @ Scale this week: "Master’s at Scale: Five Years in a Scalable Online Graduate Degree", "Synchronous at Scale: Investigation and Implementation of a Semi-Synchronous Online Lecture Platform", and "Peer Advising at Scale: Content and Context of a Learner-Owned Course Evaluation System".
• 2019: Designing and Developing Video Lessons for Online Learning: A Seven-Principle Model. Chaohua Ou, David A. Joyner & Ashok Goel. Online Learning, 23(2).
• 2019: Replicating and Unraveling Performance and Behavioral Differences between an Online and a Traditional CS Course. David A. Joyner & Melinda McDaniel. In ACM Global Computing Education Conference 2019 (CompEd ’19).
• 2019: Five Years of Graduate CS Education Online and at Scale. David A. Joyner, Charles Isbell, Thad Starner, & Ashok Goel. In ACM Global Computing Education Conference 2019 (CompEd ’19).
• 2019: Building Purposeful Online Learning: Outcomes from Blending CS1. In Madden, A., Margulieux, L., Kadel, R., & Goel, A. (Eds.) Blended Learning in Practice.
• 2019: Collaboration versus Cheating: Reducing Code Plagiarism in an Online MS Computer Science Program. Tony Mason, Ada Gavrilovska, & David A. Joyner. In Proceedings of the 50th ACM Technical Symposium on Computer Science Education (SIGCSE).
• 2019: From Clusters to Content: Using Code Clustering for Course Improvement. David A. Joyner, Ryan Arrison, Mehnaz Ruksana, Evi Salguero, Zida Wang, Ben Wellington, & Kevin Yin. In Proceedings of the 50th ACM Technical Symposium on Computer Science Education (SIGCSE).
• 2018: The CHI of Teaching Online: Blurring the Lines Between User Interfaces and Learning Interfaces. David A. Joyner. In Kapros, E. & Koutsombogera, M. (Eds.) Designing for the User Experience in Learning Systems. New York: Springer.
• 2018: Measuring Learner Tone and Sentiment at Scale Via Text Analysis of Forum Posts. Michael Schubert, Damian Durruty, & David Joyner. In Proceedings of the 8th Edition of the International Workshop on Personalization Approaches in Learning Environments (PALE).
• 2018: Sentiment Analysis of Student Evaluations of Teaching. Heather Newman & David Joyner. In Proceedings of the 19th International Conference on AI in Education.
• 2018: Squeezing the Limeade: Policies and Workflows for Scalable Online Degrees. David Joyner. In Proceedings of the 5th Annual ACM Conference on Learning at Scale.
• 2018: Intelligent Evaluation and Feedback in Support of a Credit-Bearing MOOC. David Joyner. In Proceedings of the 19th International Conference on AI in Education.
• 2018: Toward CS1 at Scale: Building and Testing a MOOC-for-Credit Candidate. David Joyner. In Proceedings of the 5th ACM Conference on Learning at Scale.
• 2017: Project Disco: A Video Alternative for Online Learning. Govin Vatsan, Allan Reyes, Robert Almendarez, & David Joyner. In Proceedings of Learning with MOOCs IV.
• 2017: Harnessing professionals' motivations and experiences to improve accredited MOOC-based education. David Joyner. In Proceedings of Learning with MOOCs IV.
• 2017: A holistic approach to academic integrity in a CS1 MOOC. David Joyner. In Proceedings of Learning with MOOCs IV.
• 2017: Seven design principles for scalable for-credit CS1 education. David Joyner. In Proceedings of Learning with MOOCs IV.
• 2017: Using AI to Teach AI: Lessons from an Online AI Class. Ashok Goel & David Joyner. In AI Magazine 38(2). 48-58.
• 2017: Congruency, Adaptivity, Modularity, and Personalization: Four Experiments in Teaching Introduction to Computing. David Joyner. In Proceedings of the Fourth Annual ACM Conference on Learning at Scale. Cambridge, Massachusetts.
• 2017: Scaling Expert Feedback: Two Case Studies. David Joyner. In Proceedings of the Fourth Annual ACM Conference on Learning at Scale. Cambridge, Massachusetts.
• 2017: Introduction to Computing. David Joyner. McGraw-Hill. 978-1-260-08227-2.
• 2016: Metrics for evaluating classroom community interactivity in MOOCs. Amanda Madden & David Joyner. In Proceedings of Learning with MOOCs III.
• 2016: Formative Assessment and Implicit Feedback in Online Learning. Ashok Goel & David Joyner. In Proceedings of Learning with MOOCs III. Philadelphia, Pennsylvania.
• 2016: Gauging student sentiment using IBM Watson. Damian Durruty & David Joyner. In Proceedings of Learning with MOOCs III. Philadelphia, Pennsylvania.
• 2016: Scaling the human expert’s role in large online programs. David Joyner. In Proceedings of Learning with MOOCs III. Philadelphia, Pennsylvania.
• 2016: TAPS: A MOSS Extension for Detecting Software Plagiarism at Scale. Dana Sheahen & David Joyner. In Proceedings of the Third Annual ACM Conference on Learning @ Scale. Edinburgh, UK.
• 2016: Expert Evaluation of 300 Projects per Day. David Joyner. In Proceedings of the Third Annual ACM Conference on Learning @ Scale. Edinburgh, UK.
• 2016: Graders as Meta-Reviewers: Simultaneously Scaling and Improving Expert Evaluation for Large Online Classrooms. David Joyner, Wade Ashby, Liam Irish, Yeeling Lam, Jacob Langston, Isabel Lupiani, Mike Lustig, Paige Pettoruto, Dana Sheahen, Angela Smiley, Amy Bruckman, & Ashok Goel. In Proceedings of the Third Annual ACM Conference on Learning @ Scale. Edinburgh, UK.
• 2016: The Unexpected Pedagogical Benefits of Making Higher Education Accessible. David Joyner, Ashok Goel, & Charles Isbell. In Proceedings of the Third Annual ACM Conference on Learning @ Scale. Edinburgh, UK.
• 2016: Designing Videos with Pedagogical Strategies: Online Students’ Perceptions of Their Effectiveness. Chaohua Ou, David Joyner, Daniel Haynes, & Ashok Goel. In Proceedings of the Third Annual ACM Conference on Learning @ Scale. Edinburgh, UK.
• 2016: Design of an Online Course on Knowledge-Based AI. Ashok Goel & David Joyner. In Proceedings of the Sixth Symposium on Educational Advances in Artificial Intelligence. Phoenix, Arizona.
• 2016: An Experiment in Teaching Cognitive Systems Online. Ashok Goel & David Joyner. In D. Haynes (Ed.) the International Journal for Scholarship of Technology-Enhanced Learning 1(1). 3-23.

Associated Media

• Presentation: Graders as Meta-Reviewers: Simultaneously Scaling and Improving Expert Evaluation for Large Online Classrooms. The flipped presentation for the corresponding paper at Learning @ Scale 2016.
• Presentation: The Unexpected Pedagogical Benefits of Making Higher Education Accessible. The flipped presentation for the corresponding paper at Learning @ Scale 2016.
• Presentation: Expert Evaluation of 300 Projects per Day. The flipped presentation for the corresponding paper at Learning @ Scale 2016.
• Presentation: TAPS: A MOSS Extension for Detecting Software Plagiarism at Scale. The flipped presentation for the corresponding paper at Learning @ Scale 2016.
• Presentation: Designing Videos with Pedagogical Strategies: Online Students’ Perceptions of Their Effectiveness. The flipped presentation for the corresponding paper at Learning @ Scale 2016.
• C21U Seminar Series Talk: The Unexpected Pedagogical Benefits of Making Higher Education Accessible. David Joyner's C21U talk on the unique benefits derived from the combination of the OMSCS's unique student body and forum-based structure.
• GVU Brown Bag Talk: Impact of the Students in the Georgia Tech OMSCS. David Joyner's GVU Brown Bag talk on the unique role students play in the OMSCS program.
• Course: CS6460: Educational Technology. The Georgia Tech OMSCS course CS6460: Educational Technology, available to the public at Udacity.com.
• GVU Brown Bag Talk: Putting Online Learning and Learning Sciences Together. Ashok Goel's and David Joyner's Brown Bag talk on the design of CS7637: Knowledge-Based AI.
• Course: CS7637: Knowledge-Based Artificial Intelligence. The Georgia Tech OMSCS course CS7637: Knowledge-Based AI, available to the public at Udacity.com.

Associated News

• 14 Mar 2020: David Joyner presents remotely to SIGCSE 2020. David Joyner presented the paper "Enrollment Motivations in an Online Graduate CS Program: Trends & Gender- and Age-Based Differences" remotely to the 2020 SIGCSE conference.
• 02 Mar 2020: Paper accepted to ITICSE 2020. David Joyner and the teaching assistants for CS1301 authored a paper on what determines students' attitudes towards CS during a semester in a CS1 class.
• 02 Jan 2020: Alex Duncan presents two papers at HICE. Alex Duncan presented "Advising of the Students, by the Students, for the Students: The Case of a Student-Owned Peer Advising Community" and "Eroding Investment in Repeated Peer Review: A Reaction to Unrequited Aid?" to the 2020 HICE conference.
• 25 Oct 2019: David Joyner presents two papers at Learning with MOOCs 2019. David Joyner presented the papers "Annotation-free Automatic Examination Essay Feedback Generation" and "Surveying the MOOC Data Set Universe" at the 2019 Learning with MOOCs conference this week.
• 04 Oct 2019: Full paper accepted to 2020 SIGCSE conference. Alex Duncan, Bobbie Eicher, and David Joyner have had "Enrollment Motivations in an Online Graduate CS Program: Trends & Gender- and Age-Based Differences" accepted to the 2020 SIGCSE conference.
• 25 Jul 2019: Two papers accepted to Learning with MOOCs 2019. Filipe Altoe, James Lohse, Christine McManus, and David Joyner have had papers accepted to the 2019 Learning with MOOCs conference.
• 01 Jul 2019: Chapter published in USG Essays on Best Practices. David Joyner's article, "Creating Cadence: Fostering Persistent Engagement in Asynchronous Online Courses", was published in a USG handbook on teaching practices.
• 01 Jun 2019: Journal article published in Online Learning. "Designing and Developing Video Lessons for Online Learning: A Seven-Principle Model" by Chaohua Ou, David Joyner, and Ashok Goel has been published in the journal Online Learning.
• 02 May 2019: Two short papers accepted to Learning @ Scale 2019. Alex Duncan, Denise Kutnick, and David Joyner have had papers accepted for presentation as posters at Learning @ Scale 2019.
• 19 Apr 2019: David Joyner wins Georgia Tech Teaching Excellence Award. David Joyner has won the inaugural Georgia Tech Teaching Excellence Award for Online Teaching.
• 01 Apr 2019: Book chapter published in MIT Press Blended Learning volume.
• 12 Mar 2019: Full paper accepted to 2019 ACM Learning @ Scale conference. David Joyner's and Charles Isbell's paper "Master’s at Scale: Five Years in a Scalable Online Graduate Degree" has been accepted for Learning @ Scale 2019.
• 08 Feb 2019: David Joyner wins USG Regents' Award. David Joyner has been awarded the USG Regents' Teaching Excellence Award for Online Teaching.
• 18 Jan 2019: Two full papers accepted for ACM CompEd 2019. Two papers, one co-authored by David Joyner, Charles Isbell, Thad Starner, and Ashok Goel and one co-authored by David Joyner and Melinda McDaniel, have been accepted to ACM CompEd 2019.
• 01 Dec 2018: Book chapter published in Springer volume. David Joyner authored the chapter "The CHI of Teaching Online: Blurring the Lines Between User Interfaces and Learning Interfaces" for the book Designing for the User Experience in Learning Systems.
• 10 Jul 2018: Mozilla Grant Received for VR in Online Education. We have received a Mozilla Research gift of $45,000 to research the use of virtual reality in online education.
• 26 Jun 2018: Presenting at the 2018 Festival of Learning. David Joyner is presenting five papers at the Festival of Learning between ICLS, AI in Education, and Learning @ Scale this week.
• 15 May 2018: Paper accepted for the PALE Workshop at AIED 2018. Michael Schubert, Damian Durruty, and David Joyner have had a paper accepted to the 2018 Personalization Approaches in Learning Environments (PALE) workshop.
• 26 Apr 2018: Two full papers accepted to Learning @ Scale 2018. David Joyner has had two full papers accepted for Learning at Scale 2018, one on policies and workflows in the OMSCS and one on results from CS1 online.
• 13 Apr 2018: David Joyner wins the Georgia Tech Curriculum Innovation Award. David Joyner has won the 2018 Georgia Tech Center for Teaching and Learning Curriculum Innovation Award!
• 24 Mar 2018: Two short papers accepted to AI in Education 2018. LucyLabs has had two short papers accepted to AI in Education 2018: one by David Joyner and Heather Newman, the other by David Joyner alone.
• 08 Oct 2017: Presenting four papers at Learning with MOOCs IV. This week, David Joyner is presenting four papers at Learning with MOOCs IV.
• 28 Jul 2017: Four papers accepted to Learning with MOOCs 2017. Four papers have been accepted for the 2017 Learning with MOOCs conference at UT-Austin.
• 12 Jun 2017: Article published in AI Magazine. Ashok Goel and David Joyner have co-authored an article for the most recent issue of AI Magazine.
• 24 Apr 2017: David Joyner wins College of Computing Outstanding Instructor. David Joyner has won the College of Computing's 2017 Outstanding Instructor award.
• 20 Apr 2017: Presenting two papers at Learning @ Scale. This week, David Joyner is presenting two papers at Learning @ Scale 2017 in Cambridge, Massachusetts.
• 10 Feb 2017: Work in Progress Paper accepted to Learning @ Scale 2017. David Joyner's short paper "Congruency, Adaptivity, Modularity, and Personalization: Four Experiments in Teaching Introduction to Computing" has been accepted to Learning @ Scale 2017
• 15 Dec 2016: Full paper accepted to Learning @ Scale 2017. David Joyner's paper "Scaling Expert Feedback: Two Case Studies" has been accepted to Learning @ Scale 2017
• 05 Oct 2016: Presenting at Learning with MOOCs 2016. David Joyner is presenting a talk and three posters at Learning with MOOCs this week.
• 03 Sep 2016: Three short papers accepted to Learning with MOOCs 2016. Three additional papers have been accepted as posters for Learning with MOOCs III in Philadelphia on October 6th and 7th. Congratulations to authors Amanda Madden, Damian Durruty, Ashok Goel, and David Joyner!
• 01 Sep 2016: David Joyner featured in 2016 Faces of Inclusive Excellence. David Joyner was featured in Georgia Tech's Faces of Inclusive Excellence from the Office of Institute Diversity.
• 16 Jun 2016: Paper accepted to Learning with MOOCs 2016. “Scaling the human expert’s role in large online programs” has been accepted for publication at Learning with MOOCs III. The paper is authored by David Joyner and covers efforts to increase human touch in Udacity's Nanodegree programs through expert project review and mentorship. Congratulations, David!
• 25 Apr 2016: David, Dana, and Chaohua present at Learning @ Scale 2016. David Joyner, Dana Sheahen, and Chaohua Ou are in Edinburgh, Scotland presenting our five papers. All five presentations are part of the conference's flipped sessions, and the pre-recorded presentations are available here.
• 15 Apr 2016: Learning @ Scale Flipped Presentations Now Available. For our five Learning @ Scale papers, we are participating in a flipped session. This entails filming the presentation in advance. The presentations are open to the public and now available.
• 07 Apr 2016: David Joyner wins the CoC Doctoral Dissertation Award. David Joyner has been selected as the winner of the 2016 College of Computing Doctoral Dissertation Award. The award will be presented on April 25th at the CoC Award Luncheon.
• 29 Mar 2016: David Joyner wins the Lockheed Excellence in Teaching Award. David Joyner has been announced as the winner of the 2016 Lockheed Excellence in Teaching Award. The award will be presented on April 25th at the CoC Award Luncheon.
• 26 Feb 2016: David Joyner joins C21U. Effective today, David Joyner has joined the faculty for the Georgia Tech Center for 21st Century Universities.
• 13 Feb 2016: Ashok Goel Delivers Paper to EAAI 2016. In Phoenix, Arizona today, Ashok presented "Design of an Online Course on Knowledge-Based AI" at the 6th Symposium on Educational Advances in AI.
• 10 Feb 2016: Fifth Paper Accepted to Learning @ Scale 2016. "TAPS: A MOSS Extension for Detecting Software Plagiarism at Scale", co-authored by Dana Sheahen and David Joyner, has been accepted as a short paper to Learning @ Scale 2016. Congratulations, Dana and David!
• 14 Dec 2015: Paper on Udacity's project review system accepted to Learning @ Scale 2016. "Expert Evaluation of 300 Projects per Day", authored by David Joyner, has been accepted to Learning @ Scale 2016. Congratulations, David!
• 14 Dec 2015: Paper on the designing course videos accepted to Learning @ Scale 2016. "Designing Videos with Pedagogical Strategies: Online Students’ Perceptions of Their Effectiveness", co-authored by Chaohua Ou, Ashok Goel, David Joyner, and Daniel Haynes, has been accepted as a short paper to Learning @ Scale 2016. Congratulations!
• 14 Dec 2015: Paper on the OMSCS accepted to Learning @ Scale 2016. "The Unexpected Pedagogical Benefits of Making Higher Education Accessible" has been accepted to Learning @ Scale 2016. The paper is co-authored by David Joyner, Ashok Goel, and Charles Isbell. Congratulations!
• 14 Dec 2015: Paper on "Graders as Meta-Reviewers" Accepted to Learning @ Scale 2016. "Graders as Meta-Reviewers: Simultaneously Scaling and Improving Expert Evaluation for Large Online Classrooms" has been accepted to Learning @ Scale 2016. The paper is co-authored by David Joyner, Wade Ashby, Liam Irish, Yeeling Lam, Jacob Langston, Isabel Lupiani, Mike Lustig, Paige Pettoruto, Dana Sheahen, Angela Smiley, Amy Bruckman, and Ashok Goel. Congratulations, everyone!
• 08 Nov 2015: Paper accepted to EAAI 2016. "Design of an Online Course on Knowledge-Based AI", co-authored by Ashok Goel and David Joyner, has been accepted to the Sixth Symposium on Educational Advances in Artificial in Intelligence. Congratulations, Ashok and David!
• 19 Oct 2015: Paper accepted to the International Journal for Scholarship of Technology Enhanced Learning. "An Experiment in Teaching Artificial Intelligence Online", co-authored by Ashok Goel and David Joyner, has been accepted to the International Journal for Scholarship of Technology Enhanced Learning. Congratulations, Ashok and David!