Joshua A. Kroll

Joshua A. Kroll

Auto-generated profile, based on publicly available information

Joshua A. Kroll

Naval Postgraduate School, Monterey, California, United States of America

Research Focus & Metrics

Academic Career Length

9Years (2018-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
15 October 2018 in Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences
Verified
Journal Article
Closed access
PDF file
JKJoshua A. Kroll
Joshua A. Kroll
Contrary to the criticism that mysterious, unaccountable black-box software systems threaten to make the logic of critical decisions inscrutable, we argue that algorithms are fundamentally understandable pieces of technology. Software systems are designed to interact with the world in a controlled way and built or operated for a specific purpose, subject to choices and assumptions. Traditional power structures can and do turn systems into opaque black boxes, but technologies can always be understood at a higher level, intensionally in terms of their designs and operational goals and extensionally in terms of their inputs, outputs and outcomes. The mechanisms of a system's operation can always be examined and explained, but a focus on machinery obscures the key issue of power dynamics. While structural inscrutability frustrates users and oversight entities, system creators and operators always determine that the technologies they deploy are fit for certain uses, making no system wholly inscrutable. We investigate the contours of inscrutability and opacity, the way they arise from power dynamics surrounding software systems, and the value of proposed remedies from disparate disciplines, especially computer ethics and privacy by design. We conclude that policy should not accede to the idea that some systems are of necessity inscrutable. Effective governance of algorithms comes from demanding rigorous science and engineering in system design, operation and evaluation to make systems verifiably trustworthy. Rather than seeking explanations for each behaviour of a computer system, policies should formalize and make known the assumptions, choices, and adequacy determinations associated with a system. This article is part of the theme issue ‘Governing artificial intelligence: ethical, legal, and technical opportunities and challenges’.

19 April 2023
Verified
Conference Paper
Open access
SRShalaleh Rismani
Shalaleh Rismani
RSRenee Shelby
Renee Shelby
ASAndrew Smart
Andrew Smart
EJEdgar Jatho
Edgar Jatho
JKJoshua Kroll
Joshua Kroll
NRNegar Rostamzadeh
Negar Rostamzadeh
Inappropriate design and deployment of machine learning (ML) systems lead to negative downstream social and ethical impacts – described here as social and ethical risks – for users, society, and the environment. Despite the growing need to regulate ML systems, current processes for assessing and mitigating risks are disjointed and inconsistent. We interviewed 30 industry practitioners on their current social and ethical risk management practices and collected their first reactions on adapting safety engineering frameworks into their practice – namely, System Theoretic Process Analysis (STPA) and Failure Mode and Effects Analysis (FMEA). Our findings suggest STPA/FMEA can provide an appropriate structure for social and ethical risk assessment and mitigation processes. However, we also find nontrivial challenges in integrating such frameworks in the fast-paced culture of the ML industry. We call on the CHI community to strengthen existing frameworks and assess their efficacy, ensuring that ML systems are safer for all people.

7 June 2021 in Computer
Verified
Journal Article
Closed access
JKJoshua A. Kroll
Joshua A. Kroll
JMJames Bret Michael
James Bret Michael
DTDavid B. Thaw
David B. Thaw
Recent advances in artificial intelligence challenge classical models of productivity by increasing the scale, complexity, and range of tasks that can be meaningfully automated, including those associated with cybersecurity.

20 August 2021 in IT Professional
Verified
Journal Article
Closed access
TCThomas Carter
Thomas Carter
JKJoshua A. Kroll
Joshua A. Kroll
JMJames Bret Michael
James Bret Michael
Contact tracing can be beneficial, such as helping to curb the spread of disease, but the handling of the resulting data poses privacy-related risks. This article provides some lessons learned and recommendations regarding the application of the NIST Privacy Framework.

10 March 2026 in Harvard Data Science Review
Verified
Journal Article
Closed access
JKJoshua A. Kroll
Joshua A. Kroll
ASAndrew Smart
Andrew Smart
RGR. Stuart Geiger
R. Stuart Geiger
AJAbigail Z. Jacobs
Abigail Z. Jacobs