Mallak Alkhathlan

Mallak Alkhathlan

Auto-generated profile, based on publicly available information

Mallak Alkhathlan

Worcester Polytechnic Institute

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
3 June 2024
Verified
Conference Paper
Open access
MAMallak Alkhathlan
Mallak Alkhathlan
KCKathleen Cachel
Kathleen Cachel
HSHilson Shrestha
Hilson Shrestha
LHLane Harrison
Lane Harrison
ERElke Rundensteiner
Elke Rundensteiner
Algorithmic decision-making using rankings— prevalent in areas from hiring and bail to university admissions— raises concerns of potential bias. In this paper, we explore the alignment between people’s perceptions of fairness and two popular fairness metrics designed for rankings. In a crowdsourced experiment with 480 participants, people rated the perceived fairness of a hypothetical scholarship distribution scenario. Results suggest a strong inclination towards relying on explicit score values. There is also evidence of people’s preference for one fairness metric, NDKL, over the other metric, ARP. Qualitative results paint a more complex picture: some participants endorse meritocratic award schemes and express concerns about fairness metrics being used to modify rankings; while other participants acknowledge socio-economic factors in score-based rankings as justification for adjusting rankings. In summary, we find that operationalizing algorithmic fairness in practice is a balancing act between mitigating harms towards marginalized groups and societal conventions of leveraging traditional performance scores such as grades in decision-making contexts.


12 June 2023
Verified
Conference Paper
Open access
HSHilson Shrestha
Hilson Shrestha
KCKathleen Cachel
Kathleen Cachel
MAMallak Alkhathlan
Mallak Alkhathlan
ERElke Rundensteiner
Elke Rundensteiner
LHLane Harrison
Lane Harrison
For applications where multiple stakeholders provide recommendations, a fair consensus ranking must not only ensure that the preferences of rankers are well represented, but must also mitigate disadvantages among socio-demographic groups in the final result. However, there is little empirical guidance on the value or challenges of visualizing and integrating fairness metrics and algorithms into human-in-the-loop systems to aid decision-makers. In this work, we design a study to analyze the effectiveness of integrating such fairness metrics-based visualization and algorithms. We explore this through a task-based crowdsourced experiment comparing an interactive visualization system for constructing consensus rankings, ConsensusFuse, with a similar system that includes visual encodings of fairness metrics and fair-rank generation algorithms, FairFuse. We analyze the measure of fairness, agreement of rankers’ decisions, and user interactions in constructing the fair consensus ranking across these two systems. In our study with 200 participants, results suggest that providing these fairness-oriented support features nudges users to align their decision with the fairness metrics while minimizing the tedious process of manually having to amend the consensus ranking. We discuss the implications of these results for the design of next-generation fairness oriented-systems and along with emerging directions for future research.

2 August 2022 in arXiv
Verified
Preprint
Open access
PDF file
HSHilson Shrestha
Hilson Shrestha
KCKathleen Cachel
Kathleen Cachel
MAMallak Alkhathlan
Mallak Alkhathlan
ERElke Rundensteiner
Elke Rundensteiner
LHLane Harrison
Lane Harrison
Fair consensus building combines the preferences of multiple rankers into a single consensus ranking, while ensuring any group defined by a protected attribute (such as race or gender) is not disadvantaged compared to other groups. Manually generating a fair consensus ranking is time-consuming and impractical -- even for a fairly small number of candidates. While algorithmic approaches for auditing and generating fair consensus rankings have been developed, these have not been operationalized in interactive systems. To bridge this gap, we introduce FairFuse, a visualization system for generating, analyzing, and auditing fair consensus rankings. We construct a data model which includes base rankings entered by rankers, augmented with measures of group fairness, and algorithms for generating consensus rankings with varying degrees of fairness. We design novel visualizations that encode these measures in a parallel-coordinates style rank visualization, with interactions for generating and exploring fair consensus rankings. We describe use cases in which FairFuse supports a decision-maker in ranking scenarios in which fairness is important, and discuss emerging challenges for future efforts supporting fairness-oriented rank analysis. Code and demo videos available at https://osf.io/hd639/.

23 May 2025 in Computer Graphics Forum
Verified
Journal Article
Closed access
HSH. Shrestha
H. Shrestha
KCK. Cachel
K. Cachel
MAM. Alkhathlan
M. Alkhathlan
ERElke Rundensteiner
Elke Rundensteiner
LHL. Harrison
L. Harrison

15 October 2025 in Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society
Verified
Journal Article
Open access
PDF file
MAMallak Alkhathlan
Mallak Alkhathlan
HSHilson Shrestha
Hilson Shrestha
LHLane Harrison
Lane Harrison
ERElke Rundensteiner
Elke Rundensteiner
The plethora of fairness metrics developed for ranking-based decision-making raises the question which metrics align best with people’s perceptions of fairness, and why? Most prior studies examining people’s perceptions of fairness metrics tend to use ordinal rating scales (e.g., Likert scales). However, such scales can be ambiguous in their interpretation across participants and offer imprecise connections to specific interface features. We address this gap by adapting two-alternative forced choice methodologies—used extensively outside the fairness community for comparing visual stimuli—to quantitatively compare participant perceptions, fairness metrics, and ranking characteristics. We report a crowdsourced experiment with 224 participants across four conditions: two popular rank fairness metrics—ARP and NDKL—and two ranking characteristics—lists of 20 and 100 candidates—resulting in over 170,000 individual judgments. Our quantitative results show systematic patterns of differences in the metrics, as well as surprising exceptions where fairness metrics disagree with people’s perceptions. Our qualitative analysis reveals an interplay between cognitive and visual strategies that affects people’s perceptions of fairness. From these results, we discuss future work in aligning fairness metrics with people’s perceptions, and highlight the need and benefits of expanding methodologies for fairness studies.