Reliability and Validity of International Large-Scale Assessment: Understanding IEA's Comparative Studies of Student Achievement

The book discusses the development of quality control mechanisms and methodologies in the International Educational Assessment (IEA) program of educational research. It highlights the challenges of providing high-quality, comparable data in a complex multinational context and explores the methods used to ensure trustworthiness. It also examines the consequential validity of ILSAs and their influence on policy and reform in education.

Format: Paperback / softback
Length: 277 pages
Publication date: 04 September 2021
Publisher: Springer Nature Switzerland AG

This open-access book comprehensively explores and evaluates the evolution of quality control mechanisms and methodologies associated with the International Educational Assessment (IEA)'s extensive program of educational research. A distinguished group of international researchers, actively involved in the design and execution of IEA's international large-scale assessments (ILSAs), provides detailed insights into the operational and quality control procedures employed to address the complex challenges inherent in delivering high-quality, comparable data.

Throughout the IEA's extensive history of conducting international large-scale assessments, ensuring the quality of the data has remained a paramount concern. Research conducted in the intricate multinational context in which IEA studies operate presents significant methodological and technological challenges, necessitating the development of robust methodologies and technologies to achieve the stated study objectives. The demands of satisfying the twin imperatives of validity and reliability in the context of diverse cultures, languages, orthographies, educational structures, educational histories, and traditions pose significant hurdles.

This book aims to provide readers with an in-depth understanding of the IEA's approach to these challenges and the methods employed to ensure the trustworthiness of the data provided to policymakers and researchers. An often overlooked area of investigation, namely the consequential validity of ILSAs, is explored, examining issues related to reporting, dissemination, and impact, including a discussion of the limitations of interpretation.

The final chapters of the book address the influence of ILSAs on policy and reform in education, including a case study from Singapore, a country renowned for its outstanding levels of achievement but continually seeking means of continual improvement. This case study illustrates best practice use of ILSA data, highlighting the potential for ILSAs to inform education policy and reform efforts worldwide.

In conclusion, this open-access book offers a valuable resource for scholars, policymakers, and educators interested in understanding the development of quality control mechanisms and methodologies in educational research. By providing a comprehensive exploration of the IEA's program of educational research, it sheds light on the challenges and opportunities associated with delivering high-quality, comparable data in a globalized world.

Weight: 450g
Dimension: 235 x 155 (mm)
ISBN-13: 9783030530839
Edition number: 1st ed. 2020