Yukiyasu Domae

Yukiyasu Domae

Auto-generated profile, based on publicly available information

Yukiyasu Domae

National Institute of Advanced Industrial Science and Technology (AIST), Tokyo, Japan

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
10 December 2021 in Sensors
Verified
Journal Article
Open access
PDF file
TMTsubasa Maruyama
Tsubasa Maruyama
TUToshio Ueshiba
Toshio Ueshiba
MTMitsunori Tada
Mitsunori Tada
HTHaruki Toda
Haruki Toda
YEYui Endo
Yui Endo
KSKazutsugu Suita
Kazutsugu Suita
Advances are being made in applying digital twin (DT) and human–robot collaboration (HRC) to industrial fields for safe, effective, and flexible manufacturing. Using a DT for human modeling and simulation enables ergonomic assessment during working. In this study, a DT-driven HRC system was developed that measures the motions of a worker and simulates the working progress and physical load based on digital human (DH) technology. The proposed system contains virtual robot, DH, and production management modules that are integrated seamlessly via wireless communication. The virtual robot module contains the robot operating system and enables real-time control of the robot based on simulations in a virtual environment. The DH module measures and simulates the worker’s motion, behavior, and physical load. The production management module performs dynamic scheduling based on the predicted working progress under ergonomic constraints. The proposed system was applied to a parts-picking scenario, and its effectiveness was evaluated in terms of work monitoring, progress prediction, dynamic scheduling, and ergonomic assessment. This study demonstrates a proof-of-concept for introducing DH technology into DT-driven HRC for human-centered production systems.

7 December 2019 in Advanced Robotics
Verified
Journal Article
Open access
MFM. Fujita
M. Fujita
YDY. Domae
Y. Domae
ANA. Noda
A. Noda
GRG. A. Garcia Ricardez
G. A. Garcia Ricardez
TNT. Nagatani
T. Nagatani
TOT. Ogasawara
T. Ogasawara
Bin picking is still a challenge in robotics, as patent in recent robot competitions. These competitions are an excellent platform for technology comparisons since some participants may use state-of-the-art technologies, while others may use conventional ones. Nevertheless, even though points are awarded or subtracted based on the performance in the frame of the competition rules, the final score does not directly reflect the suitability of the technology. Therefore, it is difficult to understand which technologies and their combination are optimal for various real-world problems. In this paper, we propose a set of performance metrics selected in terms of actual field use as a solution to clarify the important technologies in bin picking. Moreover, we use the selected metrics to compare our four original robot systems, which achieved the best performance in the Stow task of the Amazon Robotics Challenge 2017. Based on this comparison, we discuss which technologies are ideal for practical use in bin picking robots in the fields of factory and warehouse automation.

17 November 2022 in IEEE Robotics and Automation Letters
Verified
Journal Article
Open access
XZXinyi Zhang
Xinyi Zhang
YDYukiyasu Domae
Yukiyasu Domae
Weiwei WanWeiwei Wan
Weiwei Wan
Kensuke HaradaKensuke Harada
Kensuke Harada
Wire harnesses are essential connecting components in manufacturing industry but are challenging to be automated in industrial tasks such as bin picking. They are long, flexible and tend to get entangled when randomly placed in a bin. This makes it difficult for the robot to grasp a single one in dense clutter. Besides, training or collecting data in simulation is challenging due to the difficulties in modeling the combination of deformable and rigid components for wire harnesses. In this work, instead of directly lifting wire harnesses, we propose to grasp and extract the target following a circle-like trajectory until it is untangled. We learn a policy from real-world data that can infer grasps and separation actions from visual observation. Our policy enables the robot to efficiently pick and separate entangled wire harnesses by maximizing success rates and reducing execution time. To evaluate our policy, we present a set of real-world experiments on picking wire harnesses. Our policy achieves an overall 84.6% success rate compared with 49.2% in baseline. We also evaluate the effectiveness of our policy under different clutter scenarios using unseen types of wire harnesses. Results suggest that our approach is feasible for handling wire harnesses in industrial bin picking.

1 May 2020
Verified
Conference Paper
Open access
JXJingren Xu
Jingren Xu
Kensuke HaradaKensuke Harada
Kensuke Harada
Weiwei WanWeiwei Wan
Weiwei Wan
TUToshio Ueshiba
Toshio Ueshiba
YDYukiyasu Domae
Yukiyasu Domae
In this paper, we address efficiently and robustly collecting objects stored in different trays using a mobile manipulator. A resolution complete method, based on precomputed reachability database, is proposed to explore collision-free inverse kinematics (IK) solutions and then a resolution complete set of feasible base positions can be determined. This method approximates a set of representative IK solutions that are especially helpful when solving IK and checking collision are treated separately. For real world applications, we take into account the base positioning uncertainty and plan a sequence of base positions that reduce the number of necessary base movements for collecting the target objects, the base sequence is robust in that the mobile manipulator is able to complete the part-supply task even there is certain deviation from the planned base positions. Our experiments demonstrate both the efficiency compared to regular base sequence and the feasibility in real world applications.

13 December 2021 in IEEE Access
Verified
Journal Article
Open access
JXJingren Xu
Jingren Xu
YDYukiyasu Domae
Yukiyasu Domae
TUToshio Ueshiba
Toshio Ueshiba
Weiwei WanWeiwei Wan
Weiwei Wan
Kensuke HaradaKensuke Harada
Kensuke Harada
Mobile manipulators are able to operate in a large workspace, and have the potential to replace human workers to perform a sequence of pick-and-place tasks at separate locations. Many existing works optimize the base position or manipulator configuration for a single manipulation task, however, very few of them consider a sequence of tasks. In this paper, we present a planner that plans a minimum sequence of base positions for a mobile manipulator to robustly collect objects stored in multiple trays. We use inverse kinematics to determine the base region where a mobile manipulator can grasp the target objects stored in a tray, and move the mobile manipulator to the intersections of base regions to reduce the operation time for moving the base. We ensure robustness by only considering the intersection whose radius of the inscribed circle is larger than the base positioning error. Then the minimization of the number of base positions is formulated as a 0-1 knapsack problem. Besides, considering different object placements in the tray, we analyze feasible policies for dynamically updating the base sequence based on either the remaining objects or the target objects to be picked. In the experiment, we examine our planner on various scenarios, including different object placements: (1) Regularly placed toy objects; (2) Randomly placed industrial parts; and different implementation policies: (1) Apply globally static base positions; (2) Dynamically update the base positions. The experiment results show that the time for moving the base decreases by 11.22 seconds (29.37%) to 17.26 seconds (36.77%) by reducing one base movement, and demonstrate the feasibility and potential of the proposed method.

30 June 2023 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
XZXinyi Zhang
Xinyi Zhang
YDYukiyasu Domae
Yukiyasu Domae
Weiwei WanWeiwei Wan
Weiwei Wan
Kensuke HaradaKensuke Harada
Kensuke Harada
Industrial bin picking for tangled-prone objects requires the robot to either pick up untangled objects or perform separation manipulation when the bin contains no isolated objects. The robot must be able to flexibly perform appropriate actions based on the current observation. It is challenging due to high occlusion in the clutter, elusive entanglement phenomena, and the need for skilled manipulation planning. In this paper, we propose an autonomous, effective and general approach for picking up tangled-prone objects for industrial bin picking. First, we learn PickNet - a network that maps the visual observation to pixel-wise possibilities of picking isolated objects or separating tangled objects and infers the corresponding grasp. Then, we propose two effective separation strategies: Dropping the entangled objects into a buffer bin to reduce the degree of entanglement; Pulling to separate the entangled objects in the buffer bin planned by PullNet - a network that predicts position and direction for pulling from visual input. To efficiently collect data for training PickNet and PullNet, we embrace the self-supervised learning paradigm using an algorithmic supervisor in a physics simulator. Real-world experiments show that our policy can dexterously pick up tangled-prone objects with success rates of 90%. We further demonstrate the generalization of our policy by picking a set of unseen objects. Supplementary material, code, and videos can be found at https://xinyiz0931.github.io/tangle.