Vyacheslav Vital'evich Shumaev

Dr. Vyacheslav Vital'evich Shumaev

Department of Data Analysis and Machine Learning at the Financial University under the Government of the Russian Federation
orcid

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
13 January 2022 in Symmetry
Verified
Journal Article
Open access
PDF file
Nikita AndriyanovNikita Andriyanov
Nikita Andriyanov
Ilshat KhasanshinIlshat Khasanshin
Ilshat Khasanshin
DUDaniil Utkin
Daniil Utkin
TGTimur Gataullin
Timur Gataullin
SIStefan Jerzy Ignar
Stefan Jerzy Ignar
Vladimir SolovievVladimir Soloviev
Vladimir Soloviev
Despite the great possibilities of modern neural network architectures concerning the problems of object detection and recognition, the output of such models is the local (pixel) coordinates of objects bounding boxes in the image and their predicted classes. However, in several practical tasks, it is necessary to obtain more complete information about the object from the image. In particular, for robotic apple picking, it is necessary to clearly understand where and how much to move the grabber. To determine the real position of the apple relative to the source of image registration, it is proposed to use the Intel Real Sense depth camera and aggregate information from its depth and brightness channels. The apples detection is carried out using the YOLOv3 architecture; then, based on the distance to the object and its localization in the image, the relative distances are calculated for all coordinates. In this case, to determine the coordinates of apples, a transition to a symmetric coordinate system takes place by means of simple linear transformations. Estimating the position in a symmetric coordinate system allows estimating not only the magnitude of the shift but also the location of the object relative to the camera. The proposed approach makes it possible to obtain position estimates with high accuracy. The approximate root mean square error is 7–12 mm, depending on the range and axis. As for precision and recall metrics, the first is 100% and the second is 90%.

8 March 2022 in IEEE Access
Verified
Journal Article
Open access
AOAleksey Osipov
Aleksey Osipov
Vyacheslav Vital'evich ShumaevVyacheslav Vital'evich Shumaev
Vyacheslav Vital'evich Shumaev
Adam EkielskiAdam Ekielski
Adam Ekielski
TGTimur Gataullin
Timur Gataullin
SSStanislav Suvorov
Stanislav Suvorov
Sergey GataullinSergey Gataullin
Sergey Gataullin
Detecting sugar beetroot crops with mechanical damage using machine learning methods is necessary for fine-tuning beet harvester units. The Agrifac HEXX TRAXX harvester with an installed computer vision system was investigated. A video camera (24 fps) was installed above the turbine, which receives the dug-out beets after the digger and is connected to a single-board computer. At the preprocessing stage, static and insignificant image details were revealed. Canny edge detector and excess green minus excess red (ExGR) method were used. The identified areas were excluded from the image. The remaining areas were glued with similar areas of another image. As a result, the number of images entering the second stage of preprocessing was reduced by half. Then Otsu’s binarization was used. The main stage of image processing is divided into two sub-stages: detection and classification. The improved YOLOv4-tiny method was chosen for root crop detection using a single-board computer (SBC). This method allows processing up to 14 images of 416 × 416 pixels with 86% precision and 91% recall. To classify root crop damage, we considered two algorithms as candidates: 1. bag of visual words (BoVW) with a support vector machine (SVM) classifier using histogram of oriented gradients (HOG) and scale-invariant feature transform (SIFT) descriptors; 2. convolutional neural networks (CNN). Under normal lighting conditions, CNN showed the best accuracy, which ranged from 97% to 100%, depending on the damage class. The implemented methods were used to detect and classify blurred images of sugar beetroots, which were previously rejected. For improved YOLOv4-tiny precision was 74% and recall was 70%. CNN classification accuracy ranged from 90% to 95% depending on the root crops damage class.