Mehrnoosh Sameki

Mehrnoosh Sameki

Auto-generated profile, based on publicly available information

Mehrnoosh Sameki

Computer Science Computer Science Emerging Media Studies Emerging Media Studies Electrical and Computer Engineering Computer Science Boston University Boston University Boston University Boston University Boston University Boston University

Research Focus & Metrics

Academic Career Length

10Years (2017-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
12 April 2017 in International Journal of Computer Vision
Verified
Journal Article
Closed access
PDF file
JZJianming Zhang
Jianming Zhang
SMShugao Ma
Shugao Ma
MSMehrnoosh Sameki
Mehrnoosh Sameki
Stan SclaroffStan Sclaroff
Stan Sclaroff
MBMargrit Betke
Margrit Betke
RMRadomír Měch
Radomír Měch

11 January 2019 in arXiv
Verified
Preprint
Open access
PDF file
MSMehrnoosh Sameki
Mehrnoosh Sameki
SLSha Lai
Sha Lai
KMKate K. Mays
Kate K. Mays
LGLei Guo
Lei Guo
PIPrakash Ishwar
Prakash Ishwar
MBMargrit Betke
Margrit Betke
Due to concerns about human error in crowdsourcing, it is standard practice to collect labels for the same data point from multiple internet workers. We here show that the resulting budget can be used more effectively with a flexible worker assignment strategy that asks fewer workers to analyze easy-to-label data and more workers to analyze data that requires extra scrutiny. Our main contribution is to show how the allocations of the number of workers to a task can be computed optimally based on task features alone, without using worker profiles. Our target tasks are delineating cells in microscopy images and analyzing the sentiment toward the 2016 U.S. presidential candidates in tweets. We first propose an algorithm that computes budget-optimized crowd worker allocation (BUOCA). We next train a machine learning system (BUOCA-ML) that predicts an optimal number of crowd workers needed to maximize the accuracy of the labeling. We show that the computed allocation can yield large savings in the crowdsourcing budget (up to 49 percent points) while maintaining labeling accuracy. Finally, we envisage a human-machine system for performing budget-optimized data analysis at a scale beyond the feasibility of crowdsourcing.