Purpose: This paper reports a few results of an ongoing research project that aims to explore ways to command an industrial robot using the human voice. This feature can be interesting with several industrial, laboratory and clean‐room applications, where a close cooperation between robots and humans is desirable.Design/methodology/approach: A demonstration is presented using two industrial robots and a personal computer (PC) equipped with a sound board and a headset microphone. The demonstration was coded using the Microsoft Visual Basic and C#.NET 2003 and associated with two simple robot applications: one capable of picking‐and‐placing objects and going to predefined positions, and the other capable of performing a simple linear weld on a work‐piece. The speech recognition grammar is specified using the grammar builder from the Microsoft Speech SDK 5.1. The paper also introduces the concepts of text‐to‐speech translation and voice recognition, and shows how these features can be used with applications built using the Microsoft.NET framework.Findings: Two simple examples designed to operate with a state‐of‐the‐art industrial robot manipulator are then built to demonstrate the applicability to laboratory and industrial applications. The paper is very detailed in showing implementation aspects enabling the reader to explore immediately from the presented concepts and tools. Namely, the connection between the PC and the robot is explained in detail since it was built using a RPC socket mechanism completely developed from the scratch.Practical implications: Finally, the paper discusses application to industrial cases where close cooperation between humans and robots is necessary.Originality/value: The presented code and examples, along with the fairly interesting and reliable results, indicate clearly that the technology is suitable for industrial utilization.

Purpose – Most industrial robots are still programmed using the typical teaching process, through the use of the robot teach pendant. This is a tedious and time-consuming task that requires some technical expertise, and hence new approaches to robot programming are required. The purpose of this paper is to present a robotic system that allows users to instruct and program a robot with a high-level of abstraction from the robot language. Design/methodology/approach – The paper presents in detail a robotic system that allows users, especially non-expert programmers, to instruct and program a robot just showing it what it should do, in an intuitive way. This is done using the two most natural human interfaces (gestures and speech), a force control system and several code generation techniques. Special attention will be given to the recognition of gestures, where the data extracted from a motion sensor (three-axis accelerometer) embedded in the Wii remote controller was used to capture human hand behaviours. Gestures (dynamic hand positions) as well as manual postures (static hand positions) are recognized using a statistical approach and artificial neural networks. Findings – It is shown that the robotic system presented is suitable to enable users without programming expertise to rapidly create robot programs. The experimental tests showed that the developed system can be customized for different users and robotic platforms. Research limitations/implications – The proposed system is tested on two different robotic platforms. Since the options adopted are mainly based on standards, it can be implemented with other robot controllers without significant changes. Future work will focus on improving the recognition rate of gestures and continuous gesture recognition. Practical implications – The key contribution of this paper is that it offers a practical method to program robots by means of gestures and speech, improving work efficiency and saving time. Originality/value – This paper presents an alternative to the typical robot teaching process, extending the concept of human-robot interaction and co-worker scenario. Since most companies do not have engineering resources to make changes or add new functionalities to their robotic manufacturing systems, this system constitutes a major advantage for small- to medium-sized enterprises.