Summary

The focus of this workshop is on multidisciplinary research in the area of machine learning to enable new forms of digital education and assessment tools.

The organizing committee includes experts from fields of educational measurement, psychometrics, and adaptive testing (Alina von Davier), machine learning and adaptive learning (Mihaela van der Schaar & Richard Baraniuk). These scientists bring many years of experience and deep knowledge from their respective fields and are passionate about making connections across disciplines. They are actively involved in several research initiatives that explore new forms of teaching and assessment tools that combine research from both machine learning and educational measurement fields.

Recent developments indicate that the society is interested in redesigning learning and assessment systems (LAS) and not merely improving the systems we have. The educators request assessments that reflect the way people actually teach, learn and work, and that are merged with the learning experience. There is a renewed interest in performance assessments that are individualized and adaptive and efforts are being made to develop these complex assessments in virtual settings. Traditional assessments are unable to address certain questions about why students perform as they do, and are unsuited to assessing important constructs like collaboration. The desire to create better LASs which can provide actionable evidence to improve students' skills and shape educational policies combined with recent advances in technology have led to the proliferation of virtual systems. These systems have the potential to be better suited to provide the additional feedback and information needed, however, virtual LASs come with a number of psychometric and operational challenges that must be addressed if they are to realize their potential as formative assessment tools. Recent advances in machine learning and recent applications of ML algorithms to some educational areas provide new opportunities to address these challenges by collecting and analyzing the data students generate when they interact with a LAS (the little ''Big Data'').

We believe multidisciplinary research and collaboration is key to developing the next generation learning and assessment systems that adapt to student needs and bring the sophistication and pedagogical nuances of a good teacher. This workshop would provide an excellent platform for the sharing of knowledge and ideas across disciplines including computational psychometrics, adaptive learning and testing, and learning analytics, machine learning, computer vision, educational measurement and natural language processing. The research is relevant and timely for advances in educational games, learning and performance assessment simulation systems and collaborative LASs. Our expectation is that by bringing together some of the best minds in these fields we will be able to further the state of the art and generate further interest and excitement in this area.

The applications considered in this workshop include: adaptive learning and testing, analytics, scoring of written essays, collaborative assessments, use of audio and video data in conjunction with the LASs' data (multimodal data), and MOOCs.

Each speaker will present her or his current research and will give a brief overview of the state of the art methods and applications in the speaker's field.