The purpose of large-scale international assessments is to compare educational achievement across countries. For such cross-national comparisons to be meaningful, the participating students must be representative of the target population. In this paper, we consider whether this is the case for Canada, a country widely recognised as high performing in the Programme for International Student Assessment (PISA). Our analysis illustrates how the PISA 2015 sample for Canada only covers around half of the 15-year-old population, compared to over 90% in countries like Finland, Estonia, Japan and South Korea. We discuss how this emerges from differences in how children with special educational needs are defined and rules for their inclusion in the study, variation in school participation rates and the comparatively high rates of pupils’ absence in Canada during the PISA study. The paper concludes by investigating how Canada’s PISA 2015 rank would change under different assumptions about how the non-participating students would have performed were they to have taken the PISA test.
We examine how first-in-family (FiF) graduates — those whose parents do not have university degrees — fare in the labor market in England. We find that among women, FiF graduates earn 7.4% less on average than graduates whose parents have a university degree. For men, we do not find a FiF wage penalty. A decomposition of the wage difference between FiF and non-FiF graduates reveals two interesting findings. First, two-thirds of the female FiF penalty is explained by certain characteristics, including having lower educational attainment, not attending an elite university, selecting particular degree courses, working in smaller firms, working in jobs that do not require their degree, and motherhood. Second, FiF graduate men also differ in their endowments from non-FiF graduate men; however, FiF men earn higher returns on their endowments than non-FiF men and thus compensate for their relative social disadvantage, while FiF women do not. We also estimate the returns to graduation for potential FiF and non-FiF young people. We find that the wage returns to graduation are not lower among FiF graduates compared to those who match their parents with a degree.
1 August 2018 in Educational Measurement: Issues and Practice
The Programme for International Student Assessment (PISA) is an important international study of 15‐olds' knowledge and skills. New results are released every 3 years, and have a substantial impact upon education policy. Yet, despite its influence, the methodology underpinning PISA has received significant criticism. Much of this criticism has focused upon the psychometric scaling model used to create the proficiency scores. The aim of this article is to therefore investigate the robustness of cross‐country comparisons of PISA scores to subtle changes to the underlying scaling model used. This includes the specification of the item‐response model, whether the difficulty and discrimination of items are allowed to vary across countries (item‐by‐country interactions) and how test questions not reached by pupils are treated. Our key finding is that these technical choices make little substantive difference to the overall country‐level results.
While it has been shown that university attendance is strongly predicted by parental education, we know very little about why some potential first-generation students make it to university and others do not. This paper looks at the role of non-cognitive skills in the university participation of this disadvantaged group in England. We find that having higher levels of locus of control, academic self-concept, work ethic, and self-esteem in adolescence is positively related to intergenerational educational mobility to university. Our results indicate these skills help potential first-generation students to compensate for their relative disadvantage, and they are especially crucial for boys.
22 February 2025 in Journal of Population Economics
It is well established that boys perceive themselves to be better in mathematics than girls, even when their ability is the same. We examine the drivers of the gender gap in self-assessed mathematics ability using a longitudinal study of twins. Using measures of individual self-assessment in mathematics from childhood, along with mathematics levels and test scores, cognitive skills, parent and teacher mathematics assessments, and characteristics of their families and siblings, we examine potential channels of the gender gap. Our results confirm that objective mathematics abilities only explain a small share of the gender gap in self-assessed mathematics abilities, and the gap is even larger within boy-girl twin pairs. We find that the self-assessment of boys is positively correlated with the self-assessment of their male co-twins, not just in mathematics, but also in other abilities. However, this positive correlation is not observed between girls and their male co-twins; if anything, it is negative. This indicates that boys and girls have different reactions to highly confident male peers. We also find that parents are more likely to overestimate boys’ and underestimate girls’ mathematics abilities. Gender-biased parental assessments explain a large part of the gender gap in mathematics self-assessment, highlighting the potential of the intergenerational transmission of gender stereotypes.
7 March 2025 in Journal of Behavioral and Experimental Economics