In this paper, we present a Bayesian framework for the active multimodal perception of 3-D structure and motion. The design of this framework finds its inspiration in the role of the dorsal perceptual pathway of the human brain. Its composing models build upon a common egocentric spatial configuration that is naturally fitting for the integration of readings from multiple sensors using a Bayesian approach. In the process, we will contribute with efficient and robust probabilistic solutions for cyclopean geometry-based stereovision and auditory perception based only on binaural cues, modeled using a consistent formalization that allows their hierarchical use as building blocks for the multimodal sensor fusion framework. We will explicitly or implicitly address the most important challenges of sensor fusion using this framework, for vision, audition, and vestibular sensing. Moreover, interaction and navigation require maximal awareness of spatial surroundings, which, in turn, is obtained through active attentional and behavioral exploration of the environment. The computational models described in this paper will support the construction of a simultaneously flexible and powerful robotic implementation of multimodal active perception to be used in real-world applications, such as human-machine interaction or mobile robot navigation.

This paper describes a prototype of an inertial navigation system for use in mobile land vehicles, such as cars or mobile robots. The complete system is composed by sensors, their mechanical mount and cabling, these connect to a PC card with local processing and memory, based on a Intel 80C196KC microcontroller. The sensors used were a piezoelectric vibrating gyroscope, two silicon accelerometers, two clinometers and also a magnetic flux-gate compass acting as an independent source for drift compensation. The working principle of the various sensors are presented. The experimental setup used for testing is based on a robot arm controlled in real-time to move the sensors along a known trajectory (velocity control).