Daniel Thalmann

Prof. Daniel Thalmann


Research Focus & Metrics

Academic Career Length

44Years (1983-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
11 July 2006 in The Visual Computer
Verified
Journal Article
Closed access
PDF file
SCSylvain Cardin
Sylvain Cardin
DTDaniel Thalmann
Daniel Thalmann
FVFrédéric Vexo
Frédéric Vexo

16 April 2018 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
LGLiuhao Ge
Liuhao Ge
HLHui Liang
Hui Liang
JYJunsong Yuan
Junsong Yuan
DTDaniel Thalmann
Daniel Thalmann
In this paper, we present a novel method for real-time 3D hand pose estimation from single depth images using 3D Convolutional Neural Networks (CNNs). Image-based features extracted by 2D CNNs are not directly suitable for 3D hand pose estimation due to the lack of 3D spatial information. Our proposed 3D CNN-based method, taking a 3D volumetric representation of the hand depth image as input and extracting 3D features from the volumetric input, can capture the 3D spatial structure of the hand and accurately regress full 3D hand pose in a single pass. In order to make the 3D CNN robust to variations in hand sizes and global orientations, we perform 3D data augmentation on the training data. To further improve the estimation accuracy, we propose applying the 3D deep network architectures and leveraging the complete hand surface as intermediate supervision for learning 3D hand pose from depth images. Extensive experiments on three challenging datasets demonstrate that our proposed approach outperforms baselines and state-of-the-art methods. A cross-dataset experiment also shows that our method has good generalization ability. Furthermore, our method is fast as our implementation runs at over 91 frames per second on a standard computer with a single GPU.

9 November 2017 in IEEE Transactions on Visualization and Computer Graphics
Verified
Journal Article
Closed access
Ke GuKe Gu
Ke Gu
JQJunfei Qiao
Junfei Qiao
XMXiongkuo Min
Xiongkuo Min
GYGuanghui Yue
Guanghui Yue
WLWeisi Lin
Weisi Lin
DTDaniel Thalmann
Daniel Thalmann
With the quick development and popularity of computers, computer-generated signals have drastically invaded into our daily lives. Screen content image is a typical example, since it also includes graphic and textual images as components as compared with natural scene images which have been deeply explored, and thus screen content image has posed novel challenges to current researches, such as compression, transmission, display, quality assessment, and more. In this paper, we focus our attention on evaluating the quality of screen content images based on the analysis of structural variation, which is caused by compression, transmission, and more. We classify structures into global and local structures, which correspond to basic and detailed perceptions of humans, respectively. The characteristics of graphic and textual images, e.g. limited color variations, and the human visual system are taken into consideration. Based on these concerns, we systematically combine the measurements of variations in the above-stated two types of structures to yield the final quality estimation of screen content images. Thorough experiments are conducted on three screen content image quality databases, in which the images are corrupted during capturing, compression, transmission, etc. Results demonstrate the superiority of our proposed quality model as compared with state-of-the-art relevant methods.

30 August 2021 in IEEE Transactions on Neural Networks and Learning Systems
Verified
Journal Article
Closed access
Ke GuKe Gu
Ke Gu
HLHongyan Liu
Hongyan Liu
ZXZhifang Xia
Zhifang Xia
JQJunfei Qiao
Junfei Qiao
WLWeisi Lin
Weisi Lin
DTDaniel Thalmann
Daniel Thalmann
This article devises a photograph-based monitoring model to estimate the real-time PM 2.5 concentrations, overcoming currently popular electrochemical sensor-based PM 2.5 monitoring methods’ shortcomings such as low-density spatial distribution and time delay. Combining the proposed monitoring model, the photographs taken by various camera devices (e.g., surveillance camera, automobile data recorder, and mobile phone) can widely monitor PM 2.5 concentration in megacities. This is beneficial to offering helpful decision-making information for atmospheric forecast and control, thus reducing the epidemic of COVID-19. To specify, the proposed model fuses Information Abundance measurement and Wide and Deep learning, dubbed as IAWD, for PM 2.5 monitoring. First, our model extracts two categories of features in a newly proposed DS transform space to measure the information abundance (IA) of a given photograph since the growth of PM 2.5 concentration decreases its IA. Second, to simultaneously possess the advantages of memorization and generalization, a new wide and deep neural network is devised to learn a nonlinear mapping between the above-mentioned extracted features and the groundtruth PM 2.5 concentration. Experiments on two recently established datasets totally including more than 100 000 photographs demonstrate the effectiveness of our extracted features and the superiority of our proposed IAWD model as compared to state-of-the-art relevant computing techniques.

1 December 1987 in IEEE Computer Graphics and Applications
Verified
Journal Article
Closed access
Nadia ThalmannNadia Thalmann
Nadia Thalmann
DTDaniel Thalmann
Daniel Thalmann
This article describes how the synthetic actors Marilyn Monroe and Humphrey Bogart were directed in the film Rendez-vous a Montreal, using the Human Factory software. Innovative points are emphasized. The recreation of famous persons and reconstitution of their personalities, as well as the corresponding animation, are considered from an artistic point of view. Technical points discussed are personalized expressions, abstract muscle action (AMA) procedures, expression key-frame interpolation, multitrack mixing and synchronization, automatic body mapping using joint-dependent local deformation (JLD) operators, and semi-automatic object grasping. Task-level problems are also explained. Finally, how a fifth-generation animation system might evolve is discussed.

1 December 2002 in Computer Graphics Forum
Verified
Journal Article
Closed access
PDF file
BUBranislav Ulicny
Branislav Ulicny
DTDaniel Thalmann
Daniel Thalmann