WORKSHOPS

The AEA-Europe Conference is pleased to offer five highly relevant pre-conference workshops that address some of the most important developments, challenges, and innovations currently shaping educational assessment. Designed for researchers, practitioners, policymakers, and assessment professionals, these interactive sessions provide opportunities to explore emerging ideas, strengthen practical skills, and engage with leading experts in the field.

 The 2026 workshop programme includes:

Details

  • November 25, 2026
  • }Full-Day
  • Room: TBA

Workshop #1

Identifying and analysing evidence to determine whether tasks elicit the intended constructs: bridging the gap between modern validity theory and innovative validation practice.

Establishing that assessment tasks elicit performances that reflect the intended constructs is a fundamental component of assessment validation. However, literature on this question is dominated by theoretical perspectives, with little practical guidance for practitioners. In addition, recent developments in the assessment landscape, including the emergence of technological advances (e.g. process data) and novel forms of assessment (including 21st-century skills such as collaboration and self-reflection), mean that established guidance may not adequately address contemporary requirements. Through a combination of presentations, discussion and group activities, this workshop explores the challenges in identifying and analysing validation evidence to determine whether assessment tasks elicit performances that reflect the intended constructs. Participants will explore a range of validation evidence sources, from traditional statistical and qualitative approaches to innovative methods like process data and eye-tracking. Attendees will work through real-world scenarios, critically examining the alignment between task design and cognitive processes, and considering the implications of emerging technologies on validation practices. Participants will leave with a deeper understanding of how to strengthen their validation arguments, navigate trade-offs in assessment design, and leverage both classic and emerging techniques to enhance validity in diverse educational contexts.

This workshop is intended to make the complexities of validation theory and practice less challenging and more readily operational. Accordingly, the workshop is relevant to many key actors in educational assessment.

  • Gain a clearer understanding of modern validity theory and its practical application.
  • Explore a range of validation evidence sources, including statistical, qualitative, process data, and eye-tracking approaches.
  • Examine how assessment tasks can be designed to better reflect intended cognitive processes and learning outcomes.
  • Work through real-world validation scenarios and discuss common challenges faced by assessment practitioners.
  • Learn how emerging technologies are influencing validation practices and assessment design.
  • Strengthen your ability to build convincing validity arguments for diverse educational contexts.
  • Consider trade-offs and decision-making strategies when evaluating assessment quality.
  • Leave with practical ideas and tools that can be applied immediately to assessment development and validation activities.

Stuart Shaw

Stuart Shaw is an educational assessment consultant, researcher, and author, and Honorary Professor at University College London’s Institute of Education. With over 20 years of experience in international awarding organisations, his work has focused on ensuring the validity, reliability, and fairness of educational, psychological, and vocational assessments.

He has published extensively in educational assessment and language testing and is Chair of the Board of Trustees of the Chartered Institute of Educational Assessors (CIEA). Stuart is a Fellow and Council member of the Association for Educational Assessment in Europe (AEA-Europe), where he also chairs the Scientific Programme Committee. He additionally serves on the Board of the e-Assessment Association and chairs its Research Awards judging panel.

_

Ezekiel Sweiry

Ezekiel Sweiry is an Associate Director at Ofqual, a non-governmental department that regulates qualifications, examinations and assessments in England. He has over 25 years’ experience in assessment, with the majority of those years spent in paper-based and digital test development and item validity research.

He has worked for the three largest UK awarding bodies, where he has been involved in the development of a range of high-stakes assessments and responsible for the training of examiners. His particular research interests include the factors that affect the difficulty and accessibility of test items, the item and mark scheme features that affect marking reliability, and the comparability of paper-based and digital assessments.

Details

  • November 25, 2026
  • }Full-Day
  • Room: TBA

Workshop #2

Boost your assessment literacy with your best friend, the psychometrician.

Assessment literacy refers to the competence needed to design, interpret, and use assessments effectively to support learning. It is a multi-faceted and dynamic construct that continuously evolves for individuals, due to new experiences with educational activities and educational measurement.

This workshop will engulf you in new experiences with educational assessment. The interaction with your friendly neighbourhood psychometrician will help you boost your assessment literacy. In this interactive session we discover together how the timely involvement of a psychometrician can refresh your assessment knowledge, assessment skills, and attitudes toward assessment of all stakeholders involved in testing in your particular context.

During the workshop we’ll follow a scheme of activities needed to develop high-quality assessments, for anybody involved in setting up (new) exams, tests, and testing programs. We’ll cover several psychometric topics without formulas and the need to know R. The workshop helps broadening your assessment literacy. We do so by linking psychometrics to the practical decisions and challenges you’ll face, and show how broader assessment literacy helps address and solve these issues. In each block, we’ll give guidelines and illustrate best practices. We’ll invite you to share your experiences with the topics and ask us for advice.

  • Develop a deeper understanding of assessment literacy and its role in effective educational assessment.
  • Discover how psychometricians can support the development of high-quality exams, tests, and assessment programs.
  • Explore key psychometric concepts through practical examples, without formulas or technical programming requirements.
  • Learn how to make informed assessment decisions based on evidence and best practices.
  • Gain insights into common challenges faced when designing and evaluating assessments.
  • Connect assessment theory with real-world testing scenarios and practical solutions.
  • Exchange experiences and ideas with fellow participants and assessment professionals.
  • Receive practical guidance that can be applied immediately within their own educational or testing context.

 

 

 

 

 

 

Bas Hemker

Bas Hemker has been the head of the psychometric department of Cito. He worked as an assistant professor at Vrije Universiteit Brussel. He currently works at Cito, specialized as an educational measurement researcher, working on the quality of school exams and novel approaches to measuring reading ability. He is actively involved in the work of CitoLab International, Cito’s international department.

He is also a member of the Dutch Committee on Test Matters (COTAN) and was a member for many years of the Professional Development Committee of AEA Europe.

_

 

 

Marieke Vanonna

Marieke Vanonna worked for a few years as an assistant professor for statistics and methodology in psychology before joining Cito. At Cito she coordinates all psychometric analyses that are necessary for the national exams in Dutch secondary education.

She has ample experience with standard settings, in national and international contexts? She also works on a variety of smaller assessment and research programs.

_

 

 

 

Cor Sluijter

Cor Sluijter is a former head of the psychometric department of Cito and a former head of the department for middle and higher vocational education.

He currently works as an independent consultant on test quality and test use and is a lecturer in educational measurement at Fontys University of Applied Sciences. He is an external member of several Exam Boards of various universities in the Netherlands. He is also the Vice-President of AEA-Europe since November 2024.

_

 

Details

  • November 25, 2026
  • }Full-Day
  • Room: TBA

Workshop #3

Building Assessment Literacy That Lasts: From Effective Training Design to System-Level Reform.

Assessment literacy becomes valuable when it is embedded it into institutions and assessment systems. Well-designed training programmes can often fail due to systemic pressures, changes of leadership or due to accountability misalignment. This workshop addresses these issues directly, by exploring the factors that underpin success in educational assessment related training, and how they are realised utilising a series of case studies. Delegates will leave with a practical framework for designing assessment training that is genuinely differentiated to stakeholder need, a focused analytical tool for identifying the conditions that will determine whether their own reform takes root, and a structured approach to evaluation that goes beyond measuring knowledge gain to asking whether assessment practice has actually changed.

The first section will focus on understanding the stakeholders involved in developing assessment literacy and how this understanding transfers into the design of the professional development intervention. The second section will focus on implementation strategies including the optimal approaches for evaluation and impact analysis.

This workshop is designed for practitioners and researchers who are actively engaged in assessment literacy development at scale including assessment professionals within national and regional assessment bodies, policymakers and teacher educators

  • Learn how to design assessment literacy initiatives that address the needs of different stakeholder groups.
  • Explore the institutional and system-level factors that influence the success of assessment reform efforts.
  • Examine real-world case studies highlighting effective approaches to assessment literacy development.
  • Gain practical tools for identifying barriers and enablers within your own organizational context.
  • Develop strategies for implementing assessment training that leads to sustainable change.
  • Discover methods for evaluating impact beyond knowledge acquisition and measuring changes in assessment practice.
  • Understand how leadership, accountability structures, and organizational culture affect reform outcomes.
  • Leave with a practical framework for planning, implementing, and evaluating assessment literacy initiatives at scale.

Simon Child

Simon Child is Head of Assessment Training at The Assessment Network at Cambridge, part of Cambridge University Press & Assessment. He is also the co-course director for the Postgraduate Advanced Certificate in Educational Studies: Educational Assessment at the University of Cambridge. He works with schools, universities, ministries and professional bodies on developing assessment practices for the benefit of learners. In 2021, he co-authored the What, why and how of assessment: A guide for teachers and school leaders with Paul Ellis.

Previously, Simon was Senior Research Officer in the Assessment Research and Development Division of Cambridge University Press & Assessment. His research interests include assessment ‘literacy’, formative assessment practices and professional development methodologies. His background is in developmental psychology. In 2011, he received his Ph.D. from the University of Manchester, which focused on the development of symbolic cognition in pre-school children.

_

Brooke Wyatt

Brooke Wyatt is Head of Assessment Reform at Cambridge University Press & Assessment, bringing over a decade of specialist experience in assessment reform to her work. With a foundation built on a distinguished career in teaching, Brooke transitioned into assessment reform ten years ago, developing expertise in assessment training and large-scale reform projects.

In her current role, Brooke leads the Assessment Reform Group, an experienced team responsible for the end-to-end delivery of complex, multi-faceted assessment projects. The group's portfolio spans the design and development of assessment materials through to capacity building initiatives to a range of stakeholders, supporting organisations and systems to strengthen their assessment practices at scale. Brooke brings both strategic leadership and hands-on expertise to her work in this field.

Details

  • November 25, 2026
  • }Full-Day
  • Room: TBA

Workshop #4

Comparing assessment cultures in Europe.

This workshop will raise questions about ways of carrying out education assessment in different countries. The concept of ‘Assessment Cultures’ opens the door to such questioning and to celebration of differences. The thinking for the workshop is underpinned by ideas from Cristina Alarcon Lopez, the first person to present a webinar for our SIG. She is working with the team that is planning and will present this workshop.

In her webinar Cristina counselled against neglecting ‘the cultural and historical conditions of assessment’. But how can we develop the language to describe what it is that we are seeking to nurture, and to avoid?

Success for the workshop will be seen if participants achieve a better understanding of how their culture differs from others, and why. They will take away a draft of elements of a paper which they might further develop with their colleagues.

  • Explore the concept of assessment cultures and how they influence educational assessment practices across Europe.
  • Gain a deeper understanding of the cultural and historical factors that shape assessment policies and approaches.
  • Compare your own assessment context with those of other countries and identify key similarities and differences.
  • Develop a richer language for discussing assessment values, traditions, and reform priorities.
  • Engage in meaningful discussions with colleagues from diverse educational and professional backgrounds.
  • Reflect critically on practices that should be preserved, adapted, or avoided within different assessment systems.
  • Contribute to collaborative activities aimed at analysing and interpreting assessment cultures.
  • Leave with a draft framework or paper outline that can be further developed with colleagues after the workshop.

Andrew Watts

Andrew Watts was one of the initiators of the Assessment Cultures Special Interest Group within the Association and continues to serve on the Steering Group for that SIG. He has taken a leading part in a number of pre-conference workshops.

_

Cristina Alarcón López

Cristina Alarcón López is a postdoctoral researcher and lecturer at the Institute of Education at the University of Vienna. Her publications include "Assessment Cultures" (Peter Lang), which she co-edited with Martin Lawn in 2018.

_

Isabel Nisbet

Isabel Nisbet was the founding CEO of Ofqual, the regulator of examinations and qualifications in England. She brings her academic background in philosophy to her current work on educational assessment, and has co-authored (with Stuart Shaw) two books on assessment.

_

Dr. Christoph Schneider

Dr. Christoph Schneider is a full professor of educational sciences at the University of Trier, Germany. Within teacher education programmes, he is responsible for a study module on educational assessment. He has presented at several AEA-Europe conferences.

_

Details

  • November 25, 2026
  • }Full-Day
  • Room: TBA

Workshop #5

AI Literacy for assessment practitioners in the age of Large Language Models.

AI literacy is becoming a necessity for navigating many aspects of the modern world. Nowhere is this more true than in assessment, where it is vital that human oversight and ethical and responsible use is front and centre.

This workshop will equip attendees to judge when and how it is (and is not) appropriate to use AI in their work and daily lives. By building a practical understanding of how these systems work, participants will make those decisions with greater confidence. Aimed at a non-technical audience, we will explain and demystify the underlying technology, what drives error and inconsistency, and how those behaviours follow from the way these systems operate.

We will also facilitate discussions on the ethics, advantages and pitfalls of their use, with the aim of helping participants look past the hype and recognise when to trust, when to double check, and when to walk away.

  • Develop a practical understanding of how AI and Large Language Models operate.
  • Learn when AI can be a useful tool and when human judgment remains essential.
  • Explore the strengths, limitations, and common sources of error in AI-generated outputs.
  • Gain confidence in evaluating the reliability and appropriateness of AI-assisted work.
  • Discuss ethical considerations, responsible use, and the importance of human oversight in assessment.
  • Examine real-world examples of AI applications within educational and assessment contexts.
  • Learn strategies for identifying risks, biases, and potential misuse of AI technologies.
  • Build the skills needed to critically assess AI outputs rather than simply accept them at face value.

Alex Dunhill

Alex Dunhill is a data scientist with an interest in applying machine learning and AI techniques to assessment data and processes in novel ways. Having joined AQA in 2019, his work focuses on how we can use these approaches to improve assessment quality, including research into using AI to support marking quality and item writing. With a background in computational astrophysical simulations, he has experience communicating complex concepts and results through outreach talks.

_

Daryl Stevens

Daryl Stevens leads the Data Science & Innovation team. He has a background in computer science, machine learning and software engineering, with 12 years’ experience across assessment research, standards setting and technical analysis. He works with his team to apply data science and machine learning to deepen AQA’s understanding of assessment. Alongside this, Daryl is engaged in the technical, societal and ethical impacts of modern AI, and aims to support careful, evidence-led and positive use of AI in assessment.

_

Victoria Tassie

Victoria Tassie is a data scientist at AQA, having joined the awarding body in 2019. She is particularly interested in natural language processing (NLP) and in the ethical implications of artificial intelligence and machine learning models. Her recent work has primarily focused on handwriting-related NLP, including developing and comparing approaches for machine transcription of handwritten text, alongside methods for post-hoc, context-driven correction of those transcriptions and clustering methods for student responses.

_

Rob Carruthers

Rob Carruthers previously taught Music and Mathematics in UK secondary schools for 10 years, across the independent and state education sectors, and led on data in several roles. He became a full-time data scientist at AQA in 2024 and, in this role, he has led work on large-scale document classification and analysis using machine-learning methods. His current work centres around ethical human-centric AI to assist with assessment delivery, as well as research into synthetic response generation.

SPACES ARE LIMITED!

Workshops are expected to fill up quickly. Secure your spot today.