Kevis-Kokitsi Maninis

Kevis-Kokitsi Maninis

Auto-generated profile, based on publicly available information

Kevis-Kokitsi Maninis

Google research

Research Focus & Metrics

Academic Career Length

11Years (2016-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
23 May 2018 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
KMK.-K. Maninis
K.-K. Maninis
SCS. Caelles
S. Caelles
YCY. Chen
Y. Chen
JPJ. Pont-Tuset
J. Pont-Tuset
LLL. Leal-Taixe
L. Leal-Taixe
LGL. Van Gool
L. Van Gool
Video Object Segmentation, and video processing in general, has been historically dominated by methods that rely on the temporal consistency and redundancy in consecutive video frames. When the temporal smoothness is suddenly broken, such as when an object is occluded, or some frames are missing in a sequence, the result of these methods can deteriorate significantly. This paper explores the orthogonal approach of processing each frame independently, i.e., disregarding the temporal information. In particular, it tackles the task of semi-supervised video object segmentation: the separation of an object from the background in a video, given its mask in the first frame. We present Semantic One-Shot Video Object Segmentation (OSVOSS), based on a fully-convolutional neural network architecture that is able to successively transfer generic semantic information, learned on ImageNet, to the task of foreground segmentation, and finally to learning the appearance of a single annotated object of the test sequence (hence one shot). We show that instance-level semantic information, when combined effectively, can dramatically improve the results of our previous method, OSVOS. We perform experiments on two recent single-object video segmentation databases, which show that OSVOSS is both the fastest and most accurate method in the state of the art. Experiments on multi-object video segmentation show that OSVOSS obtains competitive results.

2 October 2016
Verified
Book Chapter
Closed access
PDF file
KMKevis-Kokitsi Maninis
Kevis-Kokitsi Maninis
JPJordi Pont-Tuset
Jordi Pont-Tuset
PAPablo Arbeláez
Pablo Arbeláez
LGLuc Van Gool
Luc Van Gool

2 May 2017 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
KMKevis-Kokitsi Maninis
Kevis-Kokitsi Maninis
JPJordi Pont-Tuset
Jordi Pont-Tuset
PAPablo Arbeláez
Pablo Arbeláez
LGLuc Van Gool
Luc Van Gool
We present Convolutional Oriented Boundaries (COB), which produces multiscale oriented contours and region hierarchies starting from generic image classification Convolutional Neural Networks (CNNs). COB is computationally efficient, because it requires a single CNN forward pass for multi-scale contour detection and it uses a novel sparse boundary representation for hierarchical segmentation; it gives a significant leap in performance over the state-of-the-art, and it generalizes very well to unseen categories and datasets. Particularly, we show that learning to estimate not only contour strength but also orientation provides more accurate results. We perform extensive experiments for low-level applications on BSDS, PASCAL Context, PASCAL Segmentation, and NYUD to evaluate boundary detection performance, showing that COB provides state-of-the-art contours and region hierarchies in all datasets. We also evaluate COB on high-level tasks when coupled with multiple pipelines for object proposals, semantic contours, semantic segmentation, and object detection on MS-COCO, SBD, and PASCAL; showing that COB also improves the results for all tasks.

17 September 2016
Verified
Book Chapter
Closed access
PDF file
KMKevis-Kokitsi Maninis
Kevis-Kokitsi Maninis
JPJordi Pont-Tuset
Jordi Pont-Tuset
PAPablo Arbeláez
Pablo Arbeláez
LGLuc Van Gool
Luc Van Gool

25 January 2022 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
KMKevis-Kokitsi Maninis
Kevis-Kokitsi Maninis
SPStefan Popov
Stefan Popov
MNMatthias Niesner
Matthias Niesner
VFVittorio Ferrari
Vittorio Ferrari
We address the task of aligning CAD models to a video sequence of a complex scene containing multiple objects. Our method can process arbitrary videos and fully automatically recover the 9 DoF pose for each object appearing in it, thus aligning them in a common 3D coordinate frame. The core idea of our method is to integrate neural network predictions from individual frames with a temporally global, multi-view constraint optimization formulation. This integration process resolves the scale and depth ambiguities in the per-frame predictions, and generally improves the estimate of all pose parameters. By leveraging multi-view constraints, our method also resolves occlusions and handles objects that are out of view in individual frames, thus reconstructing all objects into a single globally consistent CAD representation of the scene. In comparison to the state-of-the-art single-frame method Mask2CAD that we build on, we achieve substantial improvements on the Scan2CAD dataset (from 11.6% to 30.7% class average accuracy).

27 November 2017 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
TPThomas Probst
Thomas Probst
KMKevis-Kokitsi Maninis
Kevis-Kokitsi Maninis
ACAjad Chhatkuli
Ajad Chhatkuli
MOMouloud Ourak
Mouloud Ourak
EPEmmanuel Benjamin Vander Poorten
Emmanuel Benjamin Vander Poorten
LGLuc Van Gool
Luc Van Gool
Computer vision and robotics are being increasingly applied in medical interventions. Especially in interventions where extreme precision is required, they could make a difference. One such application is robot-assisted retinal microsurgery. In recent works, such interventions are conducted under a stereo-microscope, and with a robot-controlled surgical tool. The complementarity of computer vision and robotics has, however, not yet been fully exploited. In order to improve the robot control, we are interested in three-dimensional (3-D) reconstruction of the anatomy and in automatic tool localization using a stereo microscope. In this letter, we solve this problem for the first time using a single pipeline, starting from uncalibrated cameras to reach metric 3-D reconstruction and registration, in retinal microsurgery. The key ingredients of our method are 1) surgical tool landmark detection, and 2) 3-D reconstruction with the stereo microscope, using the detected landmarks. To address the former, we propose a novel deep learning method that detects and recognizes keypoints in high-definition images at higher than real-time speed. We use the detected two-dimensional keypoints along with their corresponding 3-D coordinates obtained from the robot sensors to calibrate the stereo microscope using an affine projection model. We design an online 3-D reconstruction pipeline that makes use of smoothness constraints and performs robot-to-camera registration. The entire pipeline is extensively validated on open-sky porcine eye sequences. Quantitative and qualitative results are presented for all steps.