This work proposes an online task-scheduling method using mixed-integer programming for a multi-tasking problem regarding a dual-arm cooking robot in a controlled environment. Given each task’s processing time, their location in the working space, dependency, the required number of arms, and the kinematic constraints of the dual-arm robot, the proposed optimization algorithm can produce a feasible solution to scheduling the cooking order for each task and for each associated arms so that the total cooking time and the total moving distance for each arm are minimized. We use a subproblem optimization strategy in which the number of tasks to be planned is divided into several groups instead of planning all tasks at the same time. By doing so, the planning time can be significantly decreased, making the algorithm practical for online implementation. The feasibility of our optimization method and the effectiveness of the subproblem optimization strategy were verified through simulated experiments consisting of 30 to 120 tasks. The results showed that our strategy is advantageous in terms of computation time and makespan for large problems.

This work presents the first full disclosure of BALLU, Buoyancy Assisted Lightweight Legged Unit, and describes the advantages and challenges of its concept, the hardware design of a new implementation (BALLU2), a motion analysis, and a data-driven walking controller. BALLU is a robot that never falls down due to the buoyancy provided by a set of helium balloons attached to the lightweight body, which solves many issues that hinder current robots from operating close to humans. The advantages gained also lead to the platform’s distinct difficulties caused by severe nonlinearities and external forces such as buoyancy and drag. The paper describes the nonconventional characteristics of BALLU as a legged robot and then gives an analysis of its unique behavior. Based on the analysis, a data-driven approach is proposed to achieve non-teleoperated walking: a statistical process using Spearman Correlation Coefficient is proposed to form low-dimensional state vectors from the simulation data, and an artificial neural network-based controller is trained on the same data. The controller is tested both on simulation and on real-world hardware. Its performance is assessed by observing the robot’s limit cycles and trajectories in the Cartesian coordinate. The controller generates periodic walking sequences in simulation as well as on the real-world robot even without additional transfer learning. It is also shown that the controller can deal with unseen conditions during the training phase. The resulting behavior not only shows the robustness of the controller but also implies that the proposed statistical process effectively extracts a state vector that is low-dimensional yet contains the essential information of the high-dimensional dynamics of BALLU’s walking.

The light and soft characteristics of Buoyancy Assisted Lightweight Legged Unit (BALLU) robots have a great potential to provide intrinsically safe interactions in environments involving humans, unlike many heavy and rigid robots. However, their unique and sensitive dynamics impose challenges to obtaining robust control policies in the real world. In this work, we demonstrate robust sim-to-real transfer of control policies on the BALLU robots via system identification and our novel residual physics learning method, Environment Mimic (EnvMimic). First, we model the nonlinear dynamics of the actuators by collecting hardware data and optimizing the simulation parameters. Rather than relying on standard supervised learning formulations, we utilize deep reinforcement learning to train an external force policy to match real-world trajectories, which enables us to model residual physics with greater fidelity. We analyze the improved simulation fidelity by comparing the simulation trajectories against the real-world ones. We finally demonstrate that the improved simulator allows us to learn better walking and turning policies that can be successfully deployed on the hardware of BALLU.