This book compares the evaluation systems of national and international large-scale R&D programmes using a meta-evaluation framework, covering six programmes. It aims to develop meta-evaluation for R&D programmes and assess different evaluation approaches, providing a detailed comparison of programme designs and operations.

Format: Hardback
Publication date: 01 January 2021
Publisher: Taylor & Francis Ltd

This title, originally published in 2003, presents a comprehensive analysis of evaluation systems across a diverse range of national and international large-scale R&D programmes. The book identifies and compares six prominent R&D programmes: the Alvey Programme (UK), the Advanced Technology Programme (US), the EUREKA initiative (European), the Human Frontier Science Programme (International), the Brite-Euram Programme (EU), and the HAN Programme (Korea). The primary objective of this study is to enhance the methodology of meta-evaluation for R&D programmes and to conduct a thorough and systematic comparison of their evaluation approaches. Additionally, the book offers a detailed comparison of the various R&D programme designs and operations, providing valuable insights into the effectiveness of different evaluation strategies. By examining these programmes, the authors aim to contribute to the development of more effective and efficient evaluation systems for R&D initiatives.

Title: "Meta-Evaluation of National and International Large-Scale R&D Programmes"

This title, originally published in 2003, presents a comprehensive analysis of evaluation systems across a diverse range of national and international large-scale R&D programmes. The book identifies and compares six prominent R&D programmes: the Alvey Programme (UK), the Advanced Technology Programme (US), the EUREKA initiative (European), the Human Frontier Science Programme (International), the Brite-Euram Programme (EU), and the HAN Programme (Korea). The primary objective of this study is to enhance the methodology of meta-evaluation for R&D programmes and to conduct a thorough and systematic comparison of their evaluation approaches. Additionally, the book offers a detailed comparison of the various R&D programme designs and operations, providing valuable insights into the effectiveness of different evaluation strategies. By examining these programmes, the authors aim to contribute to the development of more effective and efficient evaluation systems for R&D initiatives.

Introduction

The evaluation of research and development (R&D) programmes is crucial for assessing their effectiveness and impact. However, the evaluation of R&D programmes can be complex and challenging due to the diverse range of programmes, objectives, and evaluation approaches. To address this challenge, meta-evaluation has emerged as a valuable methodology for evaluating R&D programmes. Meta-evaluation involves the systematic review and analysis of evaluation studies across multiple programmes to identify common themes, patterns, and best practices. It provides a comprehensive overview of the evaluation landscape and helps to identify areas for improvement. In this book, we present a meta-evaluation of six prominent national and international R&D programmes: the Alvey Programme (UK), the Advanced Technology Programme (US), the EUREKA initiative (European), the Human Frontier Science Programme (International), the Brite-Euram Programme (EU), and the HAN Programme (Korea).

Methodology

The methodology of meta-evaluation involves several steps. First, a framework for meta-evaluation is developed. This framework includes a set of criteria for evaluating R&D programmes, such as the programme's objectives, design, implementation, and outcomes. The criteria are designed to be comprehensive and flexible, allowing for the evaluation of a wide range of programmes. Next, a systematic review of evaluation studies is conducted. This review includes a search of relevant databases, such as PubMed, Scopus, and Google Scholar, as well as a manual search of relevant websites and publications. The review includes both quantitative and qualitative studies, and the findings are analyzed using a variety of statistical techniques. Finally, the findings are summarized and presented in a report. The report includes a description of the evaluation studies, a comparison of the evaluation approaches, and recommendations for improvement. The report is intended to be a valuable resource for policymakers, researchers, and practitioners in the field of R&D evaluation.

Results

The results of the meta-evaluation of the six R&D programmes are presented in this section. The findings include a range of common themes and patterns across the programmes. For example, all of the programmes had a clear programme objective, and all of the programmes had a well-defined evaluation approach. However, there were also some differences between the programmes. For example, the Alvey Programme had a more focused approach to R&D, while the EUREKA initiative had a more collaborative approach. The Brite-Euram Programme had a more innovative approach to R&D, while the HAN Programme had a more traditional approach. The findings also suggest that there are several areas for improvement in the evaluation of R&D programmes. For example, more emphasis should be placed on the evaluation of the impact of R&D programmes on society, and more attention should be paid to the evaluation of the effectiveness of R&D programmes in achieving their objectives. Additionally, more research should be conducted on the evaluation of R&D programmes in different contexts, such as different countries and industries.

Conclusion

In conclusion, this book presents a comprehensive meta-evaluation of six prominent national and international R&D programmes. The findings of the meta-evaluation suggest that there are several areas for improvement in the evaluation of R&D programmes. By using a framework for meta-evaluation, policymakers, researchers, and practitioners can gain a better understanding of the evaluation landscape and identify areas for improvement. The book also provides a detailed comparison of the various R&D programme designs and operations, providing valuable insights into the effectiveness of different evaluation strategies. By examining these programmes, the authors aim to contribute to the development of more effective and efficient evaluation systems for R&D initiatives.

ISBN-13: 9781138714281