Sebastian Schwarz

Sebastian Schwarz

Auto-generated profile, based on publicly available information

Sebastian Schwarz

Nokia Technologies, Tampere, Finland

Research Focus & Metrics

Academic Career Length

18Years (2009-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
10 December 2018 in IEEE Journal on Emerging and Selected Topics in Circuits and Systems
Verified
Journal Article
Open access
SSSebastian Schwarz
Sebastian Schwarz
MPMarius Preda
Marius Preda
VBVittorio Baroncini
Vittorio Baroncini
MBMadhukar Budagavi
Madhukar Budagavi
PCPablo Cesar
Pablo Cesar
VZVladyslav Zakharchenko
Vladyslav Zakharchenko
Due to the increased popularity of augmented and virtual reality experiences, the interest in capturing the real world in multiple dimensions and in presenting it to users in an immersible fashion has never been higher. Distributing such representations enables users to freely navigate in multi-sensory 3D media experiences. Unfortunately, such representations require a large amount of data, not feasible for transmission on today’s networks. Efficient compression technologies well adopted in the content chain are in high demand and are key components to democratize augmented and virtual reality applications. The Moving Picture Experts Group, MPEG, as one of the main standardization groups dealing with multimedia, identified the trend and started recently the process of building an open standard for compactly representing 3D point clouds, which are the 3D equivalent of the very well-known 2D pixels. This paper introduces the main developments and technical aspects of this ongoing standardization effort.

28 October 2013 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
SSSebastian Schwarz
Sebastian Schwarz
MSMarten Sjostrom
Marten Sjostrom
RORoger Olsson
Roger Olsson
Acquiring scenery depth is a fundamental task in computer vision, with many applications in manufacturing, surveillance, or robotics relying on accurate scenery information. Time-of-flight cameras can provide depth information in real-time and overcome short-comings of traditional stereo analysis. However, they provide limited spatial resolution and sophisticated upscaling algorithms are sought after. In this paper, we present a sensor fusion approach to time-of-flight super resolution, based on the combination of depth and texture sources. Unlike other texture guided approaches, we interpret the depth upscaling process as a weighted energy optimization problem. Three different weights are introduced, employing different available sensor data. The individual weights address object boundaries in depth, depth sensor noise, and temporal consistency. Applied in consecutive order, they form three weighting strategies for time-of-flight super resolution. Objective evaluations show advantages in depth accuracy and for depth image based rendering compared with state-of-the-art depth upscaling. Subjective view synthesis evaluation shows a significant increase in viewer preference by a factor of four in stereoscopic viewing conditions. To the best of our knowledge, this is the first extensive subjective test performed on time-of-flight depth upscaling. Objective and subjective results proof the suitability of our approach to time-of-flight super resolution approach for depth scenery capture.

1 May 2012
Verified
Conference Paper
Closed access
SSSebastian Schwarz
Sebastian Schwarz
RORoger Olsson
Roger Olsson
MSMårten Sjöström
Mårten Sjöström
STSylvain Tourancheau
Sylvain Tourancheau
Consumer interest in 3D television (3DTV) is growing steadily, but current available 3D displays still need additional eye-wear and suffer from the limitation of a single stereo view pair. So it can be assumed that autostereoscopic multiview displays are the next step in 3D-at-home entertainment, since these displays can utilize the Multiview Video plus Depth (MVD) format to synthesize numerous viewing angles from only a small set of given input views. This motivates efficient MVD compression as an important keystone for commercial success of 3DTV. In this paper we concentrate on the compression of depth information in an MVD scenario. There have been several publications suggesting depth down- and upsampling to increase coding efficiency. We follow this path, using our recently introduced Edge Weighted Optimization Concept (EWOC) for depth upscaling. EWOC uses edge information from the video frame in the upscaling process and allows the use of sparse, non-uniformly distributed depth values. We exploit this fact to expand the depth down-/upsampling idea with an adaptive low-pass filter, reducing high energy parts in the original depth map prior to subsampling and compression. Objective results show the viability of our approach for depth map compression with up-to-date High-Efficiency Video Coding (HEVC). For the same Y-PSNR in synthesized views we achieve up to 18.5% bit rate decrease compared to full-scale depth and around 10% compared to competing depth down-/upsampling solutions. These results were confirmed by a subjective quality assessment, showing a statistical significant preference for 87.5% of the test cases.

1 June 2018
Verified
Conference Paper
Closed access
SSSebastian Schwarz
Sebastian Schwarz
MHMiska M. Hannuksela
Miska M. Hannuksela
VFVida Fakour-Sevom
Vida Fakour-Sevom
NSNahid Sheikhi-Pour
Nahid Sheikhi-Pour
Due to the increased popularity of augmented and virtual reality experiences, the interest in representing the real world in an immersive fashion has never been higher. Distributing such representations enables users all over the world to freely navigate in never seen before media experiences. Unfortunately, such representations require a large amount of data, not feasible for transmission on today's networks. Thus, efficient compression technologies are in high demand. This paper proposes an approach to compress 3D video data utilizing 2D video coding technology. The proposed solution was developed to address the needs of `tele-immersive' applications, such as virtual (VR), augmented (AR) or mixed (MR) reality with Six Degrees of Freedom (6DoF) capabilities. Volumetric video data is projected on 2D image planes and compressed using standard 2D video coding solutions. A key benefit of this approach is its compatibility with readily available 2D video coding infrastructure. Furthermore, objective and subjective evaluation shows significant improvement in coding efficiency over reference technology.

22 November 2013 in IEEE MultiMedia
Verified
Journal Article
Closed access
SSSebastian Schwarz
Sebastian Schwarz
RORoger Olsson
Roger Olsson
MSMarten Sjostrom
Marten Sjostrom
In the context of 3D video systems, depth information could be used to render a scene from additional viewpoints. Although there have been many recent advances in this area, including the introduction of the Microsoft Kinect sensor, the robust acquisition of such information continues to be a challenge. This article reviews three depth-sensing approaches for 3DTV. The authors discuss several approaches for acquiring depth information and provides a comparative analysis of their characteristics.

1 October 2019
Verified
Conference Paper
Closed access
NSNahid Sheikhipour
Nahid Sheikhipour
MPMika Pesonen
Mika Pesonen
SSSebastian Schwarz
Sebastian Schwarz
VVVinod Kumar Malamal Vadakital
Vinod Kumar Malamal Vadakital
The Moving Picture Experts Group (MPEG) recently has developed a standard for compressing volumetric content known as video-based point cloud compression (V-PCC). The V-PCC standard is a multi-layer approach in which the point cloud information is mapped onto multiple image layers. The second layer is considered for including the points that were not projected into the first layer. Even though this dual-layer scheme provides better coding efficiency and reconstruction quality compared to the single-layer approach, but it is considered to be very complex due to high frame rate, memory buffer, execution time, etc. Hence, the single-layer scheme is considered in practical scenarios. This work attempts to improve the coding efficiency and reconstruction quality of the single-layer scheme. The proposed method in this work estimates the most important patches (MIPs) of the second layer and includes them in the patch generation of the first layer. The proposed method provided on average 9.8% and 5.7% bitrate reductions in all intra configuration in different quality metrics when compared to the single-layer scheme. Moreover, the proposed method in random access configuration has reduced the bitrate on average by 8.6% and 4.3% in different quality metrics compared to the single-layer scheme.