Ali I. Ozkes

Dr. Ali I. Ozkes

orcid

Research Focus & Metrics

Academic Career Length

12Years (2015-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 March 2024 in Management Science
Verified
Journal Article
Closed access
MFMiloš Fišar
Miloš Fišar
BGBen Greiner
Ben Greiner
CHChristoph Huber
Christoph Huber
EKElena Katok
Elena Katok
AOAli I. Ozkes
Ali I. Ozkes
TCthe Management Science Reproducibility Collaboration
the Management Science Reproducibility Collaboration
With the help of more than 700 reviewers, we assess the reproducibility of nearly 500 articles published in the journal Management Science before and after the introduction of a new Data and Code Disclosure policy in 2019. When considering only articles for which data accessibility and hardware and software requirements were not an obstacle for reviewers, the results of more than 95% of articles under the new disclosure policy could be fully or largely computationally reproduced. However, for 29% of articles, at least part of the data set was not accessible to the reviewer. Considering all articles in our sample reduces the share of reproduced articles to 68%. These figures represent a significant increase compared with the period before the introduction of the disclosure policy, where only 12% of articles voluntarily provided replication materials, of which 55% could be (largely) reproduced. Substantial heterogeneity in reproducibility rates across different fields is mainly driven by differences in data set accessibility. Other reasons for unsuccessful reproduction attempts include missing code, unresolvable code errors, weak or missing documentation, and software and hardware requirements and code complexity. Our findings highlight the importance of journal code and data disclosure policies and suggest potential avenues for enhancing their effectiveness. This paper was accepted by David Simchi-Levi, behavioral economics and decision analysis–fast track. Supplemental Material: The online appendices and data are available at https://doi.org/10.1287/mnsc.2023.03556 .

1 June 2021 in Journal of Economic Behavior & Organization
Verified
Journal Article
Closed access
YKYukio Koriyama
Yukio Koriyama
AOAli I. Ozkes
Ali I. Ozkes

11 January 2021 in Social Choice and Welfare
Verified
Journal Article
Closed access
PDF file
AOAli I. Ozkes
Ali I. Ozkes
MSM. Remzi Sanver
M. Remzi Sanver

1 September 2015 in Social Choice and Welfare
Verified
Journal Article
Closed access
PDF file
JLJean Lainé
Jean Lainé
AOAli I. Ozkes
Ali I. Ozkes
RSRemzi Sanver
Remzi Sanver

1 November 2015 in Mathematical Social Sciences
Verified
Journal Article
Closed access
BCBurak Can
Burak Can
AOAli I. Ozkes
Ali I. Ozkes
TSTon Storcken
Ton Storcken

10 December 2022 in Social Choice and Welfare
Verified
Journal Article
Closed access
PDF file
UGUmberto Grandi
Umberto Grandi
JLJérôme Lang
Jérôme Lang
AOAli I. Ozkes
Ali I. Ozkes
SAStéphane Airiau
Stéphane Airiau