Despite the fact that the topic of “women in research and innovation” has been on the agenda for decades and numerous measures have been implemented at both national and supranational levels to improve gender equality in research and innovation systems, it is still unclear which measures and under which conditions these measures are most effective. Even less research has been carried out on the effects of better representation of women in terms of research and innovation. This paper is based on the application of an innovative evaluation framework, which encompasses complexity and theory of change approaches and aims at exploring the link between interventions and their subsequent effects to two case studies. We discuss two major German flagship programmes aiming at increasing the participation of female researchers in the science system, the “Women Professorship Programme” and the “Pact for Research and Innovation”. Through the two programmes, we tested and validated the evaluation framework and its indicators. As part of the validation process, a theory of change has been developed for each of the programmes. The theory-based evaluation approach helped not only to identify gender equality impacts but also broader effects on research and innovation that might have otherwise remained undetected. We studied the effects of the two programmes on the number of women in leadership positions and analysed whether an increase in the proportion of women leaders influences publication patterns. Although linear linkages are challenging to establish due to the complexity of the process, the findings suggest that the flagship programmes have contributed not only to higher shares of women researchers but also to improved female publication and citation rates. There are clear benefits for Germany in terms of scientific results from the increased proportion of female researchers in research and innovation.
1 December 2019 in Evaluation and Program Planning
This article provides an overview of the theoretical assumptions, methods, and key results from the Evaluation Framework for Promoting Gender Equality in Research and Innovation (EFFORTI) project, which was funded by the European Commission. The purpose of EFFORTI was to analyse the impact of interventions to promote gender equality in research and innovation (R&I), and to establish criteria for more responsible and responsive research and innovation (RRI) systems in Europe. This article provides an overview of the project's main results and the lessons learnt from the empirical analysis of R&I systems in several European countries and a comparison of 19 gender equality intervention measures.
4 August 2017 in The Journal of Technology Transfer
In this article, we present the mutually development of R&I policies and R&I policy evaluation with a specific focus on Germany and the EU. We show that there has been considerable development in the field of R&I policy evaluation over the past decades, in terms of underlying theories, methodological approaches and the emergence of an R&I evaluation community. The field of R&I policy evaluation has naturally interacted and grown in parallel with the changes in R&I policy and practice as well as scientific advances. In line with the actual claims of R&I policy to support transformation, R&I policy evaluation has engaged in a debate around more responsible and inclusive evaluation procedures. The discussion about “responsible metrics” and societal stakeholder engagement in evaluation studies are examples of it. Our overview of evaluation practice has shown that the R&I policy evaluation community need continuous, in-built critical reflection on the (incessantly changing) role of evaluation in R&I policy.