This article presents a conceptual program model that integrates three main methods: object recognition, color classification, and QR decoding of information. These methods are well-established in the fields of Robotics and Artificial Intelligence, yet they remain subjects of ongoing research interest. The program model organizes the execution of the methods in a sequence directed toward recognized objects. In this way, color classification and QR decoding are performed only on already recognized objects. Colors and QR codes that do not belong to recognized objects are not analyzed, which can provide intelligent robots with reliable and accurate information about the objects they can recognize. For research purposes, image sensors (cameras), images saved to disk, clipboard, or shared memory between applications are used. The article shows that the program model can be augmented with various sensors and algorithms for the comprehensive construction of program control of autonomous robots. Future research that builds on current studies will focus on measuring the distance to recognized objects and structuring the collected information about these objects, which will create opportunities for perceptual anchoring and logical reasoning in the program control of intelligent robots.
The developed omnidirectional mobile manipulator is an educational omnidirectional mobile manipulator that utilizes the Raspberry Pi Pico W and is programmed in Python. It is designed to enhance STEM education by providing an interactive environment for studying robotics, sensor integration, and programming techniques. The robot is built on an off-the-shelf chassis equipped with Mecanum wheels and a robotic arm actuated by servo motors. As part of this project, the control electronics were designed and implemented to enable seamless operation. While the platform allows students to program the robot as part of the STEM curriculum, our base software solution, developed in Python, provides control of both the mobile base and the robotic arm via a web interface accessible through the robot’s Wi-Fi hotspot.