Rhys Newbury

Rhys Newbury

Auto-generated profile, based on publicly available information

Rhys Newbury

Monash University, Clayton, Vic, Australia

Research Focus & Metrics

Academic Career Length

35Years (1992-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
13 June 2023 in IEEE Transactions on Robotics
Verified
Journal Article
Closed access
RNRhys Newbury
Rhys Newbury
MGMorris Gu
Morris Gu
LCLachlan Chumbley
Lachlan Chumbley
AMArsalan Mousavian
Arsalan Mousavian
CEClemens Eppner
Clemens Eppner
ACAkansel Cosgun
Akansel Cosgun
Grasping is the process of picking up an object by applying forces and torques at a set of contacts. Recent advances in deep learning methods have allowed rapid progress in robotic object grasping. In this systematic review, we surveyed the publications over the last decade, with a particular interest in grasping an object using all six degrees of freedom of the end-effector pose. Our review found four common methodologies for robotic grasping: sampling-based approaches, direct regression, reinforcement learning, and exemplar approaches In addition, we found two “supporting methods” around grasping that use deep learning to support the grasping process, shape approximation, and affordances. We have distilled the publications found in this systematic review (85 papers) into ten key takeaways we consider crucial for future robotic grasping and manipulation research.

25 March 2021 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
CSCristino de Souza
Cristino de Souza
RNRhys Newbury
Rhys Newbury
ACAkansel Cosgun
Akansel Cosgun
PGPedro Castillo Garcia
Pedro Castillo Garcia
BVBorislav Vidolov
Borislav Vidolov
DKDana Kulic
Dana Kulic
Pursuit-evasion is the problem of capturing mobile targets with one or more pursuers. We use deep reinforcement learning for pursuing an omni-directional target with multiple,homogeneous agents that are subject to unicycle kinematic constraints. We use shared experience to train a policy for a given number of pursuers, executed independently by each agent at run-time. The training uses curriculum learning, a sweeping-angle ordering to locally represent neighboring agents and a reward structure that encourages good formation and combines individual and group rewards. Simulated experiments with a reactive evader and up to eight pursuers show that our learning-based approach outperforms recent reinforcement learning techniques as well non-holonomic adaptations of classical algorithms.The learned policy is successfully transferred to the real world in a proof-of-concept demonstration with three motion-constrained pursuer drones.

9 July 2024 in IEEE Access
Verified
Journal Article
Open access
RNRhys Newbury
Rhys Newbury
JCJack Collins
Jack Collins
KHKerry He
Kerry He
JPJiahe Pan
Jiahe Pan
IPIngmar Posner
Ingmar Posner
ACAkansel Cosgun
Akansel Cosgun
Differentiable simulators continue to push the state of the art across a range of domains including computational physics, robotics, and machine learning. Their main value is the ability to compute gradients of physical processes, which allows differentiable simulators to be readily integrated into commonly employed gradient-based optimization schemes. To achieve this, a number of design decisions need to be considered representing trade-offs in versatility, computational speed, and accuracy of the gradients obtained. This paper presents an in-depth review of the evolving landscape of differentiable physics simulators. We introduce the foundations and core components of differentiable simulators alongside common design choices. This is followed by a practical guide and overview of open-source differentiable simulators that have been used across past research. Finally, we review and contextualize prominent applications of differentiable simulation. By offering a comprehensive review of the current state-of-the-art in differentiable simulation, this work aims to serve as a resource for researchers and practitioners looking to understand and integrate differentiable physics within their research.We conclude by highlighting current limitations as well as providing insights into future directions for the field.

15 June 2021 in Cartography and Geographic Information Science
Verified
Journal Article
Closed access
RNRhys Newbury
Rhys Newbury
KSKadek Ananta Satriadi
Kadek Ananta Satriadi
JBJesse Bolton
Jesse Bolton
JLJiazhou Liu
Jiazhou Liu
MCMaxime Cordeil
Maxime Cordeil
BJBernhard Jenny
Bernhard Jenny
With the increasing availability of head-mounted displays for virtual reality and augmented reality, we can create immersive maps in which the user is closer to the data. Embodiment is a key concept, allowing the user to act upon virtual objects in an immersive environment. Our work explores the use of embodied interaction for immersive maps. We propose four design considerations for embodied maps and embodied gesture interaction with immersive maps: object presence, consistent physics, human body skills, and direct manipulation. We present an example of an immersive flow map with a series of novel embodied gesture interactions, which adhere to the proposed design considerations. The embodied interactions allow users to directly manipulate immersive flow maps and explore origin-destination flow data in novel ways. Authors of immersive maps can use the four proposed design considerations for creating embodied gesture interactions. The discussed example interactions apply to diverse types of immersive maps and will hopefully incite others to invent more embodied interactions for immersive maps.

4 July 2022 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
KHKerry He
Kerry He
RNRhys Newbury
Rhys Newbury
TTTin Tran
Tin Tran
JHJesse Haviland
Jesse Haviland
BBBen Burgess-Limerick
Ben Burgess-Limerick
ACAkansel Cosgun
Akansel Cosgun
Occlusions caused by a robot’s own body is a common problem for closed-loop control methods employed in eye-to-hand camera setups. We propose an optimization-based reactive controller that minimizes self-occlusions while achieving a desired goal pose. The approach allows coordinated control between the robot’s base, arm and head by encoding the line-of-sight visibility to the target as a soft constraint along with other task-related constraints, and solving for feasible joint and base velocities. The generalizability of the approach is demonstrated in simulated and real-world experiments, on robots with fixed or mobile bases, with moving or fixed objects, and multiple objects. The experiments revealed a trade-off between occlusion rates and other task metrics. While a planning-based baseline achieved lower occlusion rates than the proposed controller, it came at the expense of highly inefficient paths and a significant drop in the task success. On the other hand, the proposed controller is shown to improve visibility to the target object(s) without sacrificing too much from the task success and efficiency. Videos and code can be found at: http://rhys-newbury.github.io/projects/vmc/.

29 August 2022
Verified
Conference Paper
Open access
RNRhys Newbury
Rhys Newbury
ACAkansel Cosgun
Akansel Cosgun
TCTysha Crowley-Davis
Tysha Crowley-Davis
WCWesley P. Chan
Wesley P. Chan
TDTom Drummond
Tom Drummond
ECElizabeth A. Croft
Elizabeth A. Croft
Humans are highly skilled in communicating their intent for when and where a handover would occur. However, even the state-of-the-art robotic implementations for handovers typically lack of such communication skills. This study investigates visualization of the robot’s internal state and intent for Human-to-Robot Handovers using Augmented Reality. Specifically, we explore the use of visualized 3D models of the object and the robotic gripper to communicate the robot’s estimation of where the object is and the pose in which the robot intends to grasp the object. We tested this design via a user study with 16 participants, in which each participant handed over a cube-shaped object to the robot 12 times. Results show communicating robot intent via augmented reality substantially improves the perceived experience of the users for handovers. Results also indicate that the effectiveness of augmented reality is even more pronounced for the perceived safety and fluency of the interaction when the robot makes errors in localizing the object.