Matthew Kay

Matthew Kay

Auto-generated profile, based on publicly available information

Matthew Kay

Northwestern University, USA

Research Focus & Metrics

Academic Career Length

19Years (2008-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
18 April 2015
Verified
Conference Paper
Open access
MKMatthew Kay
Matthew Kay
CMCynthia Matuszek
Cynthia Matuszek
SMSean A. Munson
Sean A. Munson

7 May 2016
Verified
Conference Paper
Open access
MKMatthew Kay
Matthew Kay
TKTara Kola
Tara Kola
JHJessica R. Hullman
Jessica R. Hullman
SMSean A. Munson
Sean A. Munson
Users often rely on realtime predictions in everyday contexts like riding the bus, but may not grasp that such predictions are subject to uncertainty. Existing uncertainty visualizations may not align with user needs or how they naturally reason about probability. We present a novel mobile interface design and visualization of uncertainty for transit predictions on mobile phones based on discrete outcomes. To develop it, we identified domain specific design requirements for visualizing uncertainty in transit prediction through: 1) a literature review, 2) a large survey of users of a popular realtime transit application, and 3) an iterative design process. We present several candidate visualizations of uncertainty for realtime transit predictions in a mobile context, and we propose a novel discrete representation of continuous outcomes designed for small screens, quantile dotplots. In a controlled experiment we find that quantile dotplots reduce the variance of probabilistic estimates by ~1.15 times compared to density plots and facilitate more confident estimation by end-users in the context of realtime transit prediction scenarios.

10 September 2018 in IEEE Transactions on Visualization and Computer Graphics
Verified
Journal Article
Closed access
JHJessica Hullman
Jessica Hullman
XQXiaoli Qiao
Xiaoli Qiao
MCMichael Correll
Michael Correll
AKAlex Kale
Alex Kale
MKMatthew Kay
Matthew Kay
Understanding and accounting for uncertainty is critical to effectively reasoning about visualized data. However, evaluating the impact of an uncertainty visualization is complex due to the difficulties that people have interpreting uncertainty and the challenge of defining correct behavior with uncertainty information. Currently, evaluators of uncertainty visualization must rely on general purpose visualization evaluation frameworks which can be ill-equipped to provide guidance with the unique difficulties of assessing judgments under uncertainty. To help evaluators navigate these complexities, we present a taxonomy for characterizing decisions made in designing an evaluation of an uncertainty visualization. Our taxonomy differentiates six levels of decisions that comprise an uncertainty visualization evaluation: the behavioral targets of the study, expected effects from an uncertainty visualization, evaluation goals, measures, elicitation techniques, and analysis approaches. Applying our taxonomy to 86 user studies of uncertainty visualizations, we find that existing evaluation practice, particularly in visualization research, focuses on Performance and Satisfaction-based measures that assume more predictable and statistically-driven judgment behavior than is suggested by research on human judgment and decision making. We reflect on common themes in evaluation practice concerning the interpretation and semantics of uncertainty, the use of confidence reporting, and a bias toward evaluating performance as accuracy rather than decision quality. We conclude with a concrete set of recommendations for evaluators designed to reduce the mismatch between the conceptualization of uncertainty in visualization versus other fields.

15 December 2015 in Journal of Clinical Sleep Medicine
Verified
Journal Article
Closed access
PKPing-Ru T. Ko
Ping-Ru T. Ko
JKJulie A. Kientz
Julie A. Kientz
ECEun Kyoung Choe
Eun Kyoung Choe
MKMatthew Kay
Matthew Kay
CLCarol A. Landis
Carol A. Landis
NWNathaniel F. Watson
Nathaniel F. Watson
To review sleep related consumer technologies, including mobile electronic device "apps," wearable devices, and other technologies. Validation and methodological transparency, the effect on clinical sleep medicine, and various social, legal, and ethical issues are discussed. We reviewed publications from the digital libraries of the Association for Computing Machinery, Institute of Electrical and Electronics Engineers, and PubMed; publications from consumer technology websites; and mobile device app marketplaces. Search terms included "sleep technology," "sleep app," and "sleep monitoring." Consumer sleep technologies are categorized by delivery platform including mobile device apps (integrated with a mobile operating system and utilizing mobile device functions such as the camera or microphone), wearable devices (on the body or attached to clothing), embedded devices (integrated into furniture or other fixtures in the native sleep environment), accessory appliances, and conventional desktop/website resources. Their primary goals include facilitation of sleep induction or wakening, self-guided sleep assessment, entertainment, social connection, information sharing, and sleep education. Consumer sleep technologies are changing the landscape of sleep health and clinical sleep medicine. These technologies have the potential to both improve and impair collective and individual sleep health depending on method of implementation.

19 April 2018
Verified
Conference Paper
Open access
MFMichael Fernandes
Michael Fernandes
LWLogan Walls
Logan Walls
SMSean Munson
Sean Munson
JHJessica Hullman
Jessica Hullman
MKMatthew Kay
Matthew Kay
Everyday predictive systems typically present point predictions, making it hard for people to account for uncertainty when making decisions. Evaluations of uncertainty displays for transit prediction have assessed people's ability to extract probabilities, but not the quality of their decisions. In a controlled, incentivized experiment, we had subjects decide when to catch a bus using displays with textual uncertainty, uncertainty visualizations, or no-uncertainty (control). Frequency-based visualizations previously shown to allow people to better extract probabilities (quantile dotplots) yielded better decisions. Decisions with quantile dotplots with 50 outcomes were(1) better on average, having expected payoffs 97% of optimal(95% CI: [95%,98%]), 5 percentage points more than control (95% CI: [2,8]); and (2) more consistent, having within-subject standard deviation of 3 percentage points (95% CI:[2,4]), 4 percentage points less than control (95% CI: [2,6]).Cumulative distribution function plots performed nearly as well, and both outperformed textual uncertainty, which was sensitive to the probability interval communicated. We discuss implications for real time transit predictions and possible generalization to other domains.

26 October 2023 in IEEE Transactions on Visualization and Computer Graphics
Verified
Journal Article
Closed access
MKMatthew Kay
Matthew Kay
The grammar of graphics is ubiquitous, providing the foundation for a variety of popular visualization tools and toolkits. Yet support for uncertainty visualization in the grammar graphics—beyond simple variations of error bars, uncertainty bands, and density plots—remains rudimentary. Research in uncertainty visualization has developed a rich variety of improved uncertainty visualizations, most of which are difficult to create in existing grammar of graphics implementations. ggdist, an extension to the popular ggplot2 grammar of graphics toolkit, is an attempt to rectify this situation. ggdist unifies a variety of uncertainty visualization types through the lens of distributional visualization, allowing functions of distributions to be mapped to directly to visual channels (aesthetics), making it straightforward to express a variety of (sometimes weird!) uncertainty visualization types. This distributional lens also offers a way to unify Bayesian and frequentist uncertainty visualization by formalizing the latter with the help of confidence distributions. In this paper, I offer a description of this uncertainty visualization paradigm and lessons learned from its development and adoption: ggdist has existed in some form for about six years (originally as part of the tidybayes R package for post-processing Bayesian models), and it has evolved substantially over that time, with several rewrites and API re-organizations as it changed in response to user feedback and expanded to cover increasing varieties of uncertainty visualization types. Ultimately, given the huge expressive power of the grammar of graphics and the popularity of tools built on it, I hope a catalog of my experience with ggdist will provide a catalyst for further improvements to formalizations and implementations of uncertainty visualization in grammar of graphics ecosystems. A free copy of this paper is available at https://osf.io/2gsz6. All supplemental materials are available at https://github.com/mjskay/ggdistpaper and are archived on Zenodo at doi:10.5281/zenodo.7770984.