Ratings and rankings are criticized for being simplistic, obscurantist, inaccurate, and subjective, yet they are becoming an increasingly influential social form. We elaborate the criticisms of ratings and rankings in various fields but go on to argue that analysis should shift its target. The problem that ratings deal with is not observation of an independent world. Instead, the challenge they face is the circularity of second-order observation in which observations must take into account the observations of others. To this purpose they function well enough not because they mirror how things are but because they offer a highly visible reference point to which others are attentive and thereby provide an orientation to navigate uncertainty. The concluding section places the problem of ratings and rankings in a broader historical perspective, contrasting the ranked society to the society of rankings. Responding to uncertainty, ratings and rankings perpetuates rather than eliminates anxiety.
In an age defined by computational innovation, testing seems to have become ubiquitous, and tests are routinely deployed as a form of governance, a marketing device, an instrument for political intervention, and an everyday practice to evaluate the self. This essay argues that something more radical is happening here than simply attempts to move tests from the laboratory into social settings. The challenge that a new sociology of testing must address is that ubiquitous testing changes the relations between science, engineering, and sociology: Engineering is today in the very stuff of where society happens. It is not that the tests of 21st‐century engineering occur within a social context but that it is the very fabric of the social that is being put to the test. To understand how testing and the social relate today, we must investigate how testing operates on social life, through the modification of its settings. One way to clarify the difference is to say that the new forms of testing can be captured neither within the logic of the field test nor of the controlled experiment. Whereas tests once happened inside social environments, today’s tests directly and deliberately modify the social environment.
1 November 2002 in Environment and Planning A: Economy and Space
In this paper we examine how web-design firms in the new-media industry probe and experiment with possible forms and sources of value that give shape to the new economy. Focusing on the collaborative engineering of cross-disciplinary web-design project teams, we examine how websites emerge as provisional settlements among heterogeneous disciplines as they negotiate working compromises across competing performance criteria.
This commentary reviews key themes posed by papers in this Special Issue and points to open questions. For example, does resilience in socio-technical systems degrade with use or, like immune systems, is resilience upgraded with use? Similarly, is resilience about responding in the face of the rare event? Or, is it being prepared for the rare event? Is it useful to think about the evolution of resilience? What are the risks posed by models of risk? That is, do models to reduce vulnerability to risk, increase vulnerability? What is the role of reflexivity in the analysis of resilience?
Ratings and rankings are criticized for being simplistic, obscurantist, inaccurate, and subjective, yet they are becoming an increasingly influential social form. The authors elaborate the criticisms of ratings and rankings in various fields but go on to argue that analysis should shift its target. The problem that ratings deal with is not observation of an independent world. Instead, the challenge they face is the circularity of second-order observation in which observations must take into account the observations of others. To this purpose they function well enough not because they mirror how things are but because they offer a highly visible reference point to which others are attentive and thereby provide an orientation to navigate uncertainty. The concluding section places the problem of ratings and rankings in a broader historical perspective contrasting the ranked society to the society of rankings. Responding to uncertainty, ratings and rankings perpetuate rather than eliminate anxiety.