Michael Rabbat

Michael Rabbat

Auto-generated profile, based on publicly available information

Michael Rabbat

Facebook AI Research

Research Focus & Metrics

Academic Career Length

20Years (2007-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
17 April 2018 in Proceedings of the IEEE
Verified
Journal Article
Closed access
ANAngelia Nedic
Angelia Nedic
AOAlex Olshevsky
Alex Olshevsky
MRMichael G. Rabbat
Michael G. Rabbat
In decentralized optimization, nodes cooperate to minimize an overall objective function that is the sum (or average) of per-node private objective functions. Algorithms interleave local computations with communication among all or a subset of the nodes. Motivated by a variety of applications..decentralized estimation in sensor networks, fitting models to massive data sets, and decentralized control of multirobot systems, to name a few..significant advances have been made toward the development of robust, practical algorithms with theoretical performance guarantees. This paper presents an overview of recent work in this area. In general, rates of convergence depend not only on the number of nodes involved and the desired level of accuracy, but also on the structure and nature of the network over which nodes communicate (e.g., whether links are directed or undirected, static or time varying). We survey the state-of-theart algorithms and their analyses tailored to these different scenarios, highlighting the role of the network topology.

1 January 2020 in Radiology: Artificial Intelligence
Verified
Journal Article
Closed access
FKFlorian Knoll
Florian Knoll
JZJure Zbontar
Jure Zbontar
ASAnuroop Sriram
Anuroop Sriram
MMMatthew J. Muckley
Matthew J. Muckley
MBMary Bruno
Mary Bruno
YLYvonne W. Lui
Yvonne W. Lui
A publicly available dataset containing k-space data as well as Digital Imaging and Communications in Medicine image data of knee images for accelerated MR image reconstruction using machine learni...

26 April 2019 in IEEE Signal Processing Magazine
Verified
Journal Article
Closed access
XDXiaowen Dong
Xiaowen Dong
DTDorina Thanou
Dorina Thanou
MRMichael Rabbat
Michael Rabbat
PFPascal Frossard
Pascal Frossard
The construction of a meaningful graph topology plays a crucial role in the effective representation, processing, analysis, and visualization of structured data. When a natural choice of the graph is not readily available from the data sets, it is thus desirable to infer or learn a graph topology from the data. In this article, we survey solutions to the problem of graph learning, including classical viewpoints from statistics and physics, and more recent approaches that adopt a graph signal processing (GSP) perspective. We further emphasize the conceptual similarities and differences between classical and GSP-based graph-inference methods and highlight the potential advantage of the latter in a number of theoretical and practical scenarios. We conclude with several open issues and challenges that are keys to the design of future signal processing and machine-learning algorithms for learning graphs from data.

21 August 2017 in IEEE Transactions on Signal and Information Processing over Networks
Verified
Journal Article
Closed access
BPBastien Pasdeloup
Bastien Pasdeloup
VGVincent Gripon
Vincent Gripon
GMGregoire Mercier
Gregoire Mercier
DPDominique Pastor
Dominique Pastor
MRMichael G. Rabbat
Michael G. Rabbat
Many tools from the field of graph signal processing exploit knowledge of the underlying graph's structure (e.g., as encoded in the Laplacian matrix) to process signals on the graph. Therefore, in the case when no graph is available, graph signal processing tools cannot be used anymore. Researchers have proposed approaches to infer a graph topology from observations of signals on its vertices. Since the problem is ill-posed, these approaches make assumptions, such as smoothness of the signals on the graph, or sparsity priors. In this paper, we propose a characterization of the space of valid graphs, in the sense that they can explain stationary signals. To simplify the exposition in this paper, we focus here on the case where signals were i.i.d. at some point back in time and were observed after diffusion on a graph. We show that the set of graphs verifying this assumption has a strong connection with the eigenvectors of the covariance matrix, and forms a convex set. Along with a theoretical study in which these eigenvectors are assumed to be known, we consider the practical case when the observations are noisy, and experimentally observe how fast the set of valid graphs converges to the set obtained when the exact eigenvectors are known, as the number of observations grows. To illustrate how this characterization can be used for graph recovery, we present two methods for selecting a particular point in this set under chosen criteria, namely graph simplicity and sparsity. Additionally, we introduce a measure to evaluate how much a graph is adapted to signals under a stationarity assumption. Finally, we evaluate how state-of-the-art methods relate to this framework through experiments on a dataset of temperatures.

8 October 2020 in Proceedings of the IEEE
Verified
Journal Article
Closed access
MAMahmoud Assran
Mahmoud Assran
AAArda Aytekin
Arda Aytekin
HFHamid Reza Feyzmahdavian
Hamid Reza Feyzmahdavian
MJMikael Johansson
Mikael Johansson
MRMichael G. Rabbat
Michael G. Rabbat
Motivated by large-scale optimization problems arising in the context of machine learning, there have been several advances in the study of asynchronous parallel and distributed optimization methods during the past decade. Asynchronous methods do not require all processors to maintain a consistent view of the optimization variables. Consequently, they generally can make more efficient use of computational resources than synchronous methods, and they are not sensitive to issues like stragglers (i.e., slow nodes) and unreliable communication links. Mathematical modeling of asynchronous methods involves proper accounting of information delays, which makes their analysis challenging. This article reviews recent developments in the design and analysis of asynchronous optimization methods, covering both centralized methods, where all processors update a master copy of the optimization variables, and decentralized methods, where each processor maintains a local copy of the variables. The analysis provides insights into how the degree of asynchrony impacts convergence rates, especially in stochastic optimization methods.

1 August 2007
Verified
Conference Paper
Closed access
TATuncer C. Aysal
Tuncer C. Aysal
MCMark Coates
Mark Coates
MRMichael Rabbat
Michael Rabbat
In this paper, we develop algorithms for distributed computation of averages of the node data over networks with bandwidth/power constraints or large volumes of data. Distributed averaging algorithms fail to achieve consensus when deterministic uniform quantization is adopted. We propose a distributed algorithm in which the nodes utilize probabilistically quantized information to communicate with each other. The algorithm we develop is a dynamical system that generates sequences achieving a consensus, which is one of the quantization values. In addition, we show that the expected value of the consensus is equal to the average of the original sensor data. We report the results of simulations conducted to evaluate the behavior and the effectiveness of the proposed algorithm in various scenarios.