Labor shortages have been reported in numerous developed economies, and they are becoming increasingly severe, particularly in convenience stores. An important task in a convenience store is the display and disposal of a wide variety of products. However, there are technological gaps between the present technology and the expected setup. To solve the demand for the display and disposal tasks in convenience stores, ‘World Robot Summit Future Convenience Store Challenge(WRS FCSC)’ was established in 2017. The tasks of WRS FCSC are important; however, it is difficult to completely achieve the required tasks because the tasks in convenience stores are optimized for human workers. In this study, we first analyze the functions required to solve the problems of tasks in WRS FCSC. Through the analysis, we have developed several system components including two kinds of grippers for dual-arm and its manipulation strategy, intelligent shelf with manipulation support function and human detection function surrounding the shelf, object pose detection algorithm, precise autonomous navigation strategy, and management system to integrate the all the components. The effectiveness of the developed system is evaluated through the same scenario of WRS FCSC. Through the experiment, we confirmed the effectiveness our developed system. GRAPHICAL ABSTRACT
30 October 2009 in IEEE Transactions on Nanobioscience
Automated continuous individual cell transfer is a critical step in single-cell applications using microfluidic devices. Cells must be aspirated gently from a buffer before transferring to operation zone so as not to artificially perturb their biostructures. Vision-based manipulation is a key technique for allowing nondestructive cell transportation. In this paper, we presented a design for an automated single-cell loading and supply system that can be integrated with complex microfluidic applications for examining or processing one cell at a time such as the current nuclear transplantation method. The aim of the system is to automatically transfer mammalian donor (~ 15 ¿m) or oocyte (~ 100 ¿ m) cells one by one from a container to a polydimethylsiloxane (PDMS) microchannel and then transport them to other modules. The system consists of two main parts: a single-cell suction module, and a PDMS-based microfluidic chip controlled by an external pump. The desired number of vacuumed cells can be directed into the microfluidic chip and stored in a docking area. From the batch, they can be moved to next module by activating pneumatic pressure valves located on two sides of the chip. The entire mechanism is combined with monitoring systems that perform detection/tracking and control.
Recently, with the development of life science field, micromanipulation technology has attracted attention. A two-fingered microhand system, that has been developed as a micro manipulator, can perform dexterous cell manipulation such as grasping, rotating, and transferring using two end effectors in a chopstick-like motion. The automated manipulation uses processing results based on all-in-focus (AIF) images and depth map obtained from the vision system; however, errors in the results still reduce the efficiency of the system. In this study, we introduce an automated grasping system that corrects the image processing error using the reaction force from the target object during grasping maneuvers. In our improved microhand system, micro force sensors that comprises strain gauge are attached to the two fingers of microhand. The two fingers with micro force sensor are set to be able to measure the horizontal and vertical forces to detect grasping state, precisely. Using the sensor information and the image processing results, we demonstrate that this system improves the accuracy and success rate of automated grasping.
Real-time trajectory planning using model predictive control with constraints is proposed for mobile manipulators. The proposed method employs Quadratic Programming( QP) for optimizing control inputs. The control inputs and outputs are limited corresponding to the required motion and the hardware specifications of the mobile manipulator. The required motion is changed frequently according to the situation and the hardware limitations, concretely the torque, the angular velocity, the mobile base velocity and the acceleration, which are subject to the hardware design. The velocity and acceleration of the tip of the hand depend on the motion required by the user or on the environmental situation, and the required motion has to be changed flexibly. Thus, the mobile manipulator has to possess a high degree of freedom and be able to manage redundant system flexibly under constraints. These issues are solved by using the generalized mobile manipulator model with model predictive controller. In this paper, first, the generalized 2-D mobile Manipulator model is shown. The holonomic and nonholonomic mobile base by changing the constraint of the mobile base output is simulated, and the effectiveness of the mobile manipulator control design is confirmed. The proposed method is implemented to a real mobile manipulator model and real-time trajectory modification is demonstrated on a real mobile robot.
Prediction and observation of human motion are essential functions for robots co-existing with humans in everyday environments. We propose a people motion tracking and prediction approach by using the advantage of detailed 3D information about the positions of body joints. Using the shoulder position displayed in a geometrical skeleton diagram of a human's upper body part, the body pose from the proposed human kinematic model is estimated. Human motion tracking and path prediction are achieved via the extended Kalman Filter. The proposed method is verified in an indoor environment where humans pass by each other. Experiment results demonstrate that walking people and their body pose are robustly tracked and predicted accurately, with less occlusions compared to traditional human tracking.
This paper discusses the modeling and analysis of a high-speed adjustable grasping robot controlled by a pneumatic actuator. The robot is composed of two grippers, two wires for connecting a pneumatic cylinder and an arm with gripper joints with a spring as well as two stoppers for controlling the gripper stopping point with a brake. By supplying pressurized air into the pneumatic cylinder, the two grippers move forward together with the arm and capture the object by adjusting the air pressure in the cylinder. After capturing the target object, the system can release the object by changing the pressure air in the air cylinder using another port. By considering the state equation of the air, we obtain a dynamic model of the robot, including the actuator. Through numerical simulation, we show that the simulation results can explain the experimental results from the developed robot system. Through our experiments, we confirm that the developed high-speed grasping robot can grasp continuously moving objects with a gap of ±15 mm at 300 mm/s.