Christopher D. Twigg

Christopher D. Twigg

Auto-generated profile, based on publicly available information

Christopher D. Twigg

Meta Reality Labs

Research Focus & Metrics

Academic Career Length

16Years (2011-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
11 November 2022
Verified
Book Chapter
Closed access
PDF file
PGPatrick Grady
Patrick Grady
CTChengcheng Tang
Chengcheng Tang
SBSamarth Brahmbhatt
Samarth Brahmbhatt
CTChristopher D. Twigg
Christopher D. Twigg
CWChengde Wan
Chengde Wan
CKCharles C. Kemp
Charles C. Kemp

1 June 2021 in IEEE Transactions on Visualization and Computer Graphics
Verified
Journal Article
Closed access
MPMathias Parger
Mathias Parger
CTChengcheng Tang
Chengcheng Tang
YXYuanlu Xu
Yuanlu Xu
CTChristopher D. Twigg
Christopher D. Twigg
LTLingling Tao
Lingling Tao
MSMarkus Steinberger
Markus Steinberger
Tracking body and hand motions in 3D space is essential for social and self-presence in augmented and virtual environments. Unlike the popular 3D pose estimation setting, the problem is often formulated as egocentric tracking based on embodied perception (e.g., egocentric cameras, handheld sensors). In this article, we propose a new data-driven framework for egocentric body tracking, targeting challenges of omnipresent occlusions in optimization-based methods (e.g., inverse kinematics solvers). We first collect a large-scale motion capture dataset with both body and finger motions using optical markers and inertial sensors. This dataset focuses on social scenarios and captures ground truth poses under self-occlusions and body-hand interactions. We then simulate the occlusion patterns in head-mounted camera views on the captured ground truth using a ray casting algorithm and learn a deep neural network to infer the occluded body parts. Our experiments show that our method is able to generate high-fidelity embodied poses by applying the proposed method to the task of real-time egocentric body tracking, finger motion synthesis, and 3-point inverse kinematics.

5 August 2011
Verified
Conference Paper
Open access
PDF file
CTChristopher D. Twigg
Christopher D. Twigg
ZKZoran Kačić-Alesić
Zoran Kačić-Alesić

30 September 2022 in arXiv
Verified
Preprint
Open access
PDF file
PGPatrick Grady
Patrick Grady
CTChengcheng Tang
Chengcheng Tang
SBSamarth Brahmbhatt
Samarth Brahmbhatt
CTChristopher D. Twigg
Christopher D. Twigg
CWChengde Wan
Chengde Wan
CKCharles C. Kemp
Charles C. Kemp
People often interact with their surroundings by applying pressure with their hands. While hand pressure can be measured by placing pressure sensors between the hand and the environment, doing so can alter contact mechanics, interfere with human tactile perception, require costly sensors, and scale poorly to large environments. We explore the possibility of using a conventional RGB camera to infer hand pressure, enabling machine perception of hand pressure from uninstrumented hands and surfaces. The central insight is that the application of pressure by a hand results in informative appearance changes. Hands share biomechanical properties that result in similar observable phenomena, such as soft-tissue deformation, blood distribution, hand pose, and cast shadows. We collected videos of 36 participants with diverse skin tone applying pressure to an instrumented planar surface. We then trained a deep model (PressureVisionNet) to infer a pressure image from a single RGB image. Our model infers pressure for participants outside of the training data and outperforms baselines. We also show that the output of our model depends on the appearance of the hand and cast shadows near contact regions. Overall, our results suggest the appearance of a previously unobserved human hand can be used to accurately infer applied pressure. Data, code, and models are available online.

9 August 2022 in arXiv
Verified
Preprint
Open access
PDF file
PGPatrick Grady
Patrick Grady
JCJeremy A. Collins
Jeremy A. Collins
SBSamarth Brahmbhatt
Samarth Brahmbhatt
CTChristopher D. Twigg
Christopher D. Twigg
CTChengcheng Tang
Chengcheng Tang
CKCharles C. Kemp
Charles C. Kemp
Soft robotic grippers facilitate contact-rich manipulation, including robust grasping of varied objects. Yet the beneficial compliance of a soft gripper also results in significant deformation that can make precision manipulation challenging. We present visual pressure estimation & control (VPEC), a method that infers pressure applied by a soft gripper using an RGB image from an external camera. We provide results for visual pressure inference when a pneumatic gripper and a tendon-actuated gripper make contact with a flat surface. We also show that VPEC enables precision manipulation via closed-loop control of inferred pressure images. In our evaluation, a mobile manipulator (Stretch RE1 from Hello Robot) uses visual servoing to make contact at a desired pressure; follow a spatial pressure trajectory; and grasp small low-profile objects, including a microSD card, a penny, and a pill. Overall, our results show that visual estimates of applied pressure can enable a soft gripper to perform precision manipulation.