Luca Sestini

Luca Sestini

Auto-generated profile, based on publicly available information

Luca Sestini

ICube, University of Strasbourg, CNRS, France; Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milano, Italy

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
28 October 2022 in npj Digital Medicine
Verified
Journal Article
Open access
PDF file
PMPietro Mascagni
Pietro Mascagni
DADeepak Alapatt
Deepak Alapatt
LSLuca Sestini
Luca Sestini
MAMaria S. Altieri
Maria S. Altieri
AMAmin Madani
Amin Madani
DHDaniel A. Hashimoto
Daniel A. Hashimoto
Hundreds of millions of operations are performed worldwide each year, and the rising uptake in minimally invasive surgery has enabled fiber optic cameras and robots to become both important tools to conduct surgery and sensors from which to capture information about surgery. Computer vision (CV), the application of algorithms to analyze and interpret visual data, has become a critical technology through which to study the intraoperative phase of care with the goals of augmenting surgeons’ decision-making processes, supporting safer surgery, and expanding access to surgical care. While much work has been performed on potential use cases, there are currently no CV tools widely used for diagnostic or therapeutic applications in surgery. Using laparoscopic cholecystectomy as an example, we reviewed current CV techniques that have been applied to minimally invasive surgery and their clinical applications. Finally, we discuss the challenges and obstacles that remain to be overcome for broader implementation and adoption of CV in surgery.

24 May 2023 in Medical Image Analysis
Verified
Journal Article
Open access
SRSanat Ramesh
Sanat Ramesh
VSVinkle Srivastav
Vinkle Srivastav
DADeepak Alapatt
Deepak Alapatt
TYTong Yu
Tong Yu
AMAditya Murali
Aditya Murali
NPNicolas Padoy
Nicolas Padoy
The field of surgical computer vision has undergone considerable breakthroughs in recent years with the rising popularity of deep neural network-based methods. However, standard fully-supervised approaches for training such models require vast amounts of annotated data, imposing a prohibitively high cost; especially in the clinical domain. Self-Supervised Learning (SSL) methods, which have begun to gain traction in the general computer vision community, represent a potential solution to these annotation costs, allowing to learn useful representations from only unlabeled data. Still, the effectiveness of SSL methods in more complex and impactful domains, such as medicine and surgery, remains limited and unexplored. In this work, we address this critical need by investigating four state-of-the-art SSL methods (MoCo v2, SimCLR, DINO, SwAV) in the context of surgical computer vision. We present an extensive analysis of the performance of these methods on the Cholec80 dataset for two fundamental and popular tasks in surgical context understanding, phase recognition and tool presence detection. We examine their parameterization, then their behavior with respect to training data quantities in semi-supervised settings. Correct transfer of these methods to surgery, as described and conducted in this work, leads to substantial performance gains over generic uses of SSL - up to 7.4% on phase recognition and 20% on tool presence detection - as well as state-of-the-art semi-supervised phase recognition approaches by up to 14%. Further results obtained on a highly diverse selection of surgical datasets exhibit strong generalization properties. The code is available at https://github.com/CAMMA-public/SelfSupSurg.

19 January 2023 in Medical Image Analysis
Verified
Journal Article
Closed access
LSLuca Sestini
Luca Sestini
BRBenoit Rosa
Benoit Rosa
EMElena De Momi
Elena De Momi
GFGiancarlo Ferrigno
Giancarlo Ferrigno
NPNicolas Padoy
Nicolas Padoy

25 February 2021 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
LSLuca Sestini
Luca Sestini
BRBenoit Rosa
Benoit Rosa
EMElena De Momi
Elena De Momi
Giancarlo FerrignoGiancarlo Ferrigno
Giancarlo Ferrigno
NPNicolas Padoy
Nicolas Padoy
3-D pose estimation of instruments is a crucial step towards automatic scene understanding in robotic minimally invasive surgery. Although robotic systems can potentially directly provide joint values, this information is not commonly exploited inside the operating room, due to its possible unreliability, limited access and the time-consuming calibration required, especially for continuum robots. For this reason, standard approaches for 3-D pose estimation involve the use of external tracking systems. Recently, image-based methods have emerged as promising, non-invasive alternatives. While many image-based approaches in the literature have shown accurate results, they generally require either a complex iterative optimization for each processed image, making them unsuitable for real-time applications, or a large number of manually-annotated images for efficient learning. In this letter, we propose a self-supervised image-based method, exploiting, at training time only, the imprecise kinematic information provided by the robot. In order to avoid introducing time-consuming manual annotations, the problem is formulated as an auto-encoder, smartly bottlenecked by the presence of a physical model of the robotic instruments and surgical camera, forcing a separation between image background and kinematic content. Validation of the method was performed on semi-synthetic , phantom and in-vivo datasets, obtained using a flexible robotized endoscope, showing promising results for real-time image-based 3-D pose estimation of surgical instruments.

16 February 2022 in arXiv
Verified
Preprint
Open access
PDF file
LSLuca Sestini
Luca Sestini
BRBenoit Rosa
Benoit Rosa
EMElena De Momi
Elena De Momi
Giancarlo FerrignoGiancarlo Ferrigno
Giancarlo Ferrigno
NPNicolas Padoy
Nicolas Padoy
Automatic surgical instrument segmentation of endoscopic images is a crucial building block of many computer-assistance applications for minimally invasive surgery. So far, state-of-the-art approaches completely rely on the availability of a ground-truth supervision signal, obtained via manual annotation, thus expensive to collect at large scale. In this paper, we present FUN-SIS, a Fully-UNsupervised approach for binary Surgical Instrument Segmentation. FUN-SIS trains a per-frame segmentation model on completely unlabelled endoscopic videos, by solely relying on implicit motion information and instrument shape-priors. We define shape-priors as realistic segmentation masks of the instruments, not necessarily coming from the same dataset/domain as the videos. The shape-priors can be collected in various and convenient ways, such as recycling existing annotations from other datasets. We leverage them as part of a novel generative-adversarial approach, allowing to perform unsupervised instrument segmentation of optical-flow images during training. We then use the obtained instrument masks as pseudo-labels in order to train a per-frame segmentation model; to this aim, we develop a learning-from-noisy-labels architecture, designed to extract a clean supervision signal from these pseudo-labels, leveraging their peculiar noise properties. We validate the proposed contributions on three surgical datasets, including the MICCAI 2017 EndoVis Robotic Instrument Segmentation Challenge dataset. The obtained fully-unsupervised results for surgical instrument segmentation are almost on par with the ones of fully-supervised state-of-the-art approaches. This suggests the tremendous potential of the proposed method to leverage the great amount of unlabelled data produced in the context of minimally invasive surgery.

22 January 2025 in Medical Image Analysis
Verified
Journal Article
Closed access
LSLuca Sestini
Luca Sestini
BRBenoit Rosa
Benoit Rosa
EMElena De Momi
Elena De Momi
Giancarlo FerrignoGiancarlo Ferrigno
Giancarlo Ferrigno
NPNicolas Padoy
Nicolas Padoy