Interdisciplinarity is a polysemous concept with multiple, reasoned and intuitive, interpretations across scholars and policy-makers. Historically, quantifying the interdisciplinarity of research has been challenging due to the variety of methods used to identify metadata, taxonomies, and mathematical formulas. This has resulted in considerable uncertainty about the ability of quantitative models to provide clear insights for policy-making. This study proposes a systemic design, grounded in an advanced literature review, to demonstrate that the quantification of the interdisciplinarity of research can be treated as a process of decision-making in mathematical modelling, where alternatives choices are evaluated based on how closely their mathematical properties align with the theoretical objectives of the research design. The study addresses modeling choices regarding the stylisation of metadata into units of observation, and the operational definition of the conceptual dimensions of interdisciplinarity, presenting both established and novel methods and formulas. The final section discusses advanced topics in modelling the measurement, including a dedicated discussion on the difference in analysing the status of papers versus collective bodies of research; and distinguishing between reflective, formative, and inferential causal models of interdisciplinary research.
Multiverse analysis involves systematically sampling a vast set of model specifications, known as a multiverse, to estimate the uncertainty surrounding the validity of a scientific claim. By fitting these specifications to a sample of observations, statistics are obtained as analytical results. Examining the variability of these statistics across different groups of model specifications helps to assess the robustness of the claim and gives insights into its underlying assumptions. However, the theoretical premises of multiverse analysis are often implicit and not universally agreed upon. To address this, a new formal categorisation of the analytical choices involved in modelling the set of specifications is proposed. This method of indexing the specification highlights that the sampling structure of the multiversal sample does not conform to a model of independent and identically distributed draws of specifications and that it can be modelled as an information network instead. Hamming’s distance is proposed as a measure of network distance, and, with an application to a panel dataset, it is shown how this approach enhances transparency in procedures and inferred claims and that it facilitates the check of implicit parametric assumptions. In the conclusions, the proposed theory of multiversal sampling is linked to the ongoing debate on how to weigh a multiverse, including the debate on the epistemic value of crowdsourced multiverses.
Previous research yielded conflicting results on the association between cigarette smoking and risk of SARS-CoV-2 infection. Since the prevalence of smoking is high globally, the study of its impact on COVID-19 pandemic may have considerable implications for public health. This study is the first to investigate the association between the SARS-CoV-2 antibody sero-positivity and biochemically verified smoking status, to refine current estimates on this association. SARS-CoV-2-specific IgG and serum cotinine levels (a well-known marker of tobacco exposure) were assessed in a large sero-epidemiological survey conducted in the town of Troina (Sicily, Italy). A propensity score matching was carried out to reduce the effect of possible factors on SARS-CoV-2 infection risk among study participants. Of the 1785 subjects included in our study, one-third was classified as current smokers, based on serum cotinine levels. The overall proportion of subjects with positive serology for SARS-CoV-2 IgG was 5.4%. The prevalence of SARS-CoV-2 antibody positivity and previous COVID-19 diagnosis were reduced in smokers. This reduced prevalence persisted after adjusting for possible confounders (such as sex, age, previous infection, chronic conditions, and risk group) at regression analyses, and the point estimates based on the PS-matched models resulted consistent with those for the unmatched population. This study found a lower proportion of positive SARS-CoV-2 serology among current smokers, using direct laboratory measures of tobacco exposure and thus avoiding possible bias associated with self-reported smoking status. Results may also serve as a reference for future clinical research on potential pharmaceutical role of nicotine or nicotinic-cholinergic agonists against COVID-19.
The parameter that captures the similarity among disciplinary categories is a key quantity of many measures of interdisciplinarity. This study evaluates the feasibility of using large language models to estimate this parameter rather than using traditional methods based on citational networks among disciplines. An experimental procedure tested the precision, agreement, resilience, robustness, and explainability of estimates from OpenAI’s ChatGPT, Google’s Gemini, and Anthropic’s Claude. The experiment collected a sample of 228 similarity matrices among two disciplinary taxonomies, for a total of 16,200 sampled estimate values. The experiment concludes that Gemini reaches precise estimates, comparable to traditional methods. ChatGPT stands out only for its superior resilience when dealing with semantically trivial changes in how disciplines are described. Claude resulted in a balanced profile. While rarely in full agreement, all three models undertake the estimation task sufficiently well.
A review bomb is a surge in online reviews, coordinated by a group of people willing to manipulate public opinions. This is a study on a prominent case of review bombing (n = 51,120) of the video game The Last of Us Part II, challenging the assumption that review bombing should be framed solely as misinformation. The impact of fake reviews is substantially small. Ideology-driven ratings associated with a conservative ideology are followed by a grassroots counter-bombing from progressives, aimed at mitigating the effects of the negative ratings. These factions are very similar in other metrics. Preventive measures are proposed.
12 November 2024 in Advances in Data Analysis and Classification
Multiverse Analysis is a heuristic for robust multiple models estimation where data fit many connected specifications of the same abstract model, instead of a singular or a small selection of specifications. Differently from the canonical application of multimodels, in Multiverse Analysis the probabilities of the specifications to be included in the analysis are never assumed independent of each other. Grounded in this consideration, this study provides a compact statistical characterisation of the process of elicitation of the specifications in Multiverse Analysis and conceptually adjacent methods, connecting previous insights from meta-analytical Statistics, model averaging, Network Theory, Information Theory, and Causal Inference. The calibration of the multiversal estimates is treated with references to the adoption of Bayesian Model Averaging vs. alternatives. In the applications, it is checked the theory that Bayesian Model Averaging reduces both error and uncertainty for well-specified multiversal models but amplifies errors when a collider variable is included in the multiversal model. In well-specified models, alternatives do not perform better than Uniform weighting of the estimates, so the adoption of a gold standard remains ambiguous. Normative implications for misinterpretation of Multiverse Analysis and future directions of research are discussed.