Andrea Burns

Andrea Burns

Auto-generated profile, based on publicly available information

Andrea Burns

Boston University

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
12 November 2022
Verified
Book Chapter
Closed access
PDF file
ABAndrea Burns
Andrea Burns
DADeniz Arsan
Deniz Arsan
SASanjna Agrawal
Sanjna Agrawal
RKRanjitha Kumar
Ranjitha Kumar
Kate SaenkoKate Saenko
Kate Saenko
BPBryan A. Plummer
Bryan A. Plummer

29 October 2020
Verified
Book Chapter
Closed access
PDF file
ABAndrea Burns
Andrea Burns
DKDonghyun Kim
Donghyun Kim
DWDerry Wijaya
Derry Wijaya
Kate SaenkoKate Saenko
Kate Saenko
BPBryan A. Plummer
Bryan A. Plummer

1 January 2023
Verified
Conference Paper
Open access
PDF file
ABAndrea Burns
Andrea Burns
KSKrishna Srinivasan
Krishna Srinivasan
JAJoshua Ainslie
Joshua Ainslie
GBGeoff Brown
Geoff Brown
BPBryan Plummer
Bryan Plummer
MGMandy Guo
Mandy Guo
Andrea Burns, Krishna Srinivasan, Joshua Ainslie, Geoff Brown, Bryan Plummer, Kate Saenko, Jianmo Ni, Mandy Guo. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing. 2023.

1 January 2024
Verified
Conference Paper
Open access
PDF file
ABAndrea Burns
Andrea Burns
Kate SaenkoKate Saenko
Kate Saenko
BPBryan Plummer
Bryan Plummer
Andrea Burns, Kate Saenko, Bryan Plummer. Findings of the Association for Computational Linguistics ACL 2024. 2024.

15 August 2022 in arXiv
Verified
Preprint
Open access
PDF file
ABAndrea Burns
Andrea Burns
DADeniz Arsan
Deniz Arsan
SASanjna Agrawal
Sanjna Agrawal
RKRanjitha Kumar
Ranjitha Kumar
Kate SaenkoKate Saenko
Kate Saenko
BPBryan A. Plummer
Bryan A. Plummer
Vision-language navigation (VLN), in which an agent follows language instruction in a visual environment, has been studied under the premise that the input command is fully feasible in the environment. Yet in practice, a request may not be possible due to language ambiguity or environment changes. To study VLN with unknown command feasibility, we introduce a new dataset Mobile app Tasks with Iterative Feedback (MoTIF), where the goal is to complete a natural language command in a mobile app. Mobile apps provide a scalable domain to study real downstream uses of VLN methods. Moreover, mobile app commands provide instruction for interactive navigation, as they result in action sequences with state changes via clicking, typing, or swiping. MoTIF is the first to include feasibility annotations, containing both binary feasibility labels and fine-grained labels for why tasks are unsatisfiable. We further collect follow-up questions for ambiguous queries to enable research on task uncertainty resolution. Equipped with our dataset, we propose the new problem of feasibility prediction, in which a natural language instruction and multimodal app environment are used to predict command feasibility. MoTIF provides a more realistic app dataset as it contains many diverse environments, high-level goals, and longer action sequences than prior work. We evaluate interactive VLN methods using MoTIF, quantify the generalization ability of current approaches to new app environments, and measure the effect of task feasibility on navigation performance.

27 August 2020 in arXiv
Verified
Preprint
Open access
PDF file
ABAndrea Burns
Andrea Burns
DKDonghyun Kim
Donghyun Kim
DWDerry Wijaya
Derry Wijaya
Kate SaenkoKate Saenko
Kate Saenko
BPBryan A. Plummer
Bryan A. Plummer
Current multilingual vision-language models either require a large number of additional parameters for each supported language, or suffer performance degradation as languages are added. In this paper, we propose a Scalable Multilingual Aligned Language Representation (SMALR) that supports many languages with few model parameters without sacrificing downstream task performance. SMALR learns a fixed size language-agnostic representation for most words in a multilingual vocabulary, keeping language-specific features for just a few. We use a masked cross-language modeling loss to align features with context from other languages. Additionally, we propose a cross-lingual consistency module that ensures predictions made for a query and its machine translation are comparable. The effectiveness of SMALR is demonstrated with ten diverse languages, over twice the number supported in vision-language tasks to date. We evaluate on multilingual image-sentence retrieval and outperform prior work by 3-4% with less than 1/5th the training parameters compared to other word embedding methods.