Limb motion capture is essential in human motion-recognition, motor-function assessment and dexterous human-robot interaction for assistive robots. Due to highly dynamic nature of limb activities, conventional inertial methods of limb motion capture suffer from serious drift and instability problems. Here, a motion capture method with integral-free velocity detection is proposed and a wearable device is developed by incorporating micro tri-axis flow sensors with micro tri-axis inertial sensors. The device allows accurate measurement of three-dimensional motion velocity, acceleration, and attitude angle of human limbs in daily activities, strenuous, and prolonged exercises. Additionally, we verify an intra-limb coordination relationship exists between thigh and shank in human walking and running, and establish a neural network model for it. Using the intra-limb coordination model, dynamic motion capture of human lower limbs including thigh and shank is tactfully implemented by a single shank-worn device, which simplifies the capture device and reduces cost. Experiments in strenuous activities and long-time running validate excellent performance and robustness of the wearable device in dynamic motion recognition and reconstruction of human limbs.
As robots are increasingly participating in our daily lives, the quests to mimic human abilities have driven the advancements of robotic multimodal senses. However, current perceptual technologies still unsatisfied robotic needs for home tasks/environments, particularly facing great challenges in multisensory integration and fusion, rapid response capability, and highly sensitive perception. Here, we report a flexible tactile sensor utilizing thin-film thermistors to implement multimodal perceptions of pressure, temperature, matter thermal property, texture, and slippage. Notably, the tactile sensor is endowed with an ultrasensitive (0.05 mm/s) and ultrafast (4 ms) slip sensing that is indispensable for dexterous and reliable grasping control to avoid crushing fragile objects or dropping slippery objects. We further propose and develop a robotic tactile-visual fusion architecture that seamlessly encompasses multimodal sensations from the bottom level to robotic decision-making at the top level. A series of intelligent grasping strategies with rapid slip feedback control and a tactile-visual fusion recognition strategy ensure dexterous robotic grasping and accurate recognition of daily objects, handling various challenging tasks, for instance grabbing a paper cup containing liquid. Furthermore, we showcase a robotic desktop-cleaning task, the robot autonomously accomplishes multi-item sorting and cleaning desktop, demonstrating its promising potential for smart housekeeping.
In a forest of a hundred thousand trees, no two leaves are alike. Similarly, no two cells in a genetically identical group are the same. This heterogeneity at the single-cell level has been recognized to be vital for the correct interpretation of diagnostic and therapeutic results of diseases, but has been masked for a long time by studying average responses from a population. To comprehensively understand cell heterogeneity, diverse manipulation and comprehensive analysis of cells at the single-cell level are demanded. However, using traditional biological tools, such as petri-dishes and well-plates, is technically challengeable for manipulating and analyzing single-cells with small size and low concentration of target biomolecules. With the development of microfluidics, which is a technology of manipulating and controlling fluids in the range of micro- to pico-liters in networks of channels with dimensions from tens to hundreds of microns, single-cell study has been blooming for almost two decades. Comparing to conventional petri-dish or well-plate experiments, microfluidic single-cell analysis offers advantages of higher throughput, smaller sample volume, automatic sample processing, and lower contamination risk, etc., which made microfluidics an ideal technology for conducting statically meaningful single-cell research. In this review, we will summarize the advances of microfluidics for single-cell manipulation and analysis from the aspects of methods and applications. First, various methods, such as hydrodynamic and electrical approaches, for microfluidic single-cell manipulation will be summarized. Second, single-cell analysis ranging from cellular to genetic level by using microfluidic technology is summarized. Last, we will also discuss the advantages and disadvantages of various microfluidic methods for single-cell manipulation, and then outlook the trend of microfluidic single-cell analysis.