Sergey Lavrushkin

Mr. Sergey Lavrushkin

Institute for Artificial Intelligence, Lomonosov Moscow State University, Moscow, Moskva, Russia
orcid

Research Focus & Metrics

Academic Career Length

11Years (2016-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
24 March 2024 in Proceedings of the AAAI Conference on Artificial Intelligence
Verified
Journal Article
Open access
PDF file
AAAnastasia Antsiferova
Anastasia Antsiferova
KAKhaled Abud
Khaled Abud
AGAleksandr Gushchin
Aleksandr Gushchin
Ekaterina ShumitskayaEkaterina Shumitskaya
Ekaterina Shumitskaya
SLSergey Lavrushkin
Sergey Lavrushkin
Dmitriy VatolinDmitriy Vatolin
Dmitriy Vatolin
Nowadays, neural-network-based image- and video-quality metrics perform better than traditional methods. However, they also became more vulnerable to adversarial attacks that increase metrics' scores without improving visual quality. The existing benchmarks of quality metrics compare their performance in terms of correlation with subjective quality and calculation time. Nonetheless, the adversarial robustness of image-quality metrics is also an area worth researching. This paper analyses modern metrics' robustness to different adversarial attacks. We adapted adversarial attacks from computer vision tasks and compared attacks' efficiency against 15 no-reference image- and video-quality metrics. Some metrics showed high resistance to adversarial attacks, which makes their usage in benchmarks safer than vulnerable metrics. The benchmark accepts submissions of new metrics for researchers who want to make their metrics more robust to attacks or to find such metrics for their needs. The latest results can be found online: https://videoprocessing.ai/benchmarks/metrics-robustness.html.

5 November 2024 in Technologies
Verified
Journal Article
Open access
PDF file
ACAnna Chistyakova
Anna Chistyakova
AAAnastasia Antsiferova
Anastasia Antsiferova
MKMaxim Khrebtov
Maxim Khrebtov
SLSergey Lavrushkin
Sergey Lavrushkin
KAKonstantin Arkhipenko
Konstantin Arkhipenko
DTDenis Turdakov
Denis Turdakov
The adversarial robustness of image quality assessment (IQA) models to adversarial attacks is emerging as a critical issue. Adversarial training has been widely used to improve the robustness of neural networks to adversarial attacks, but little in-depth research has examined adversarial training as a way to improve IQA model robustness. This study introduces an enhanced adversarial training approach tailored to IQA models; it adjusts the perceptual quality scores of adversarial images during training to enhance the correlation between an IQA model’s quality and the subjective quality scores. We also propose a new method for comparing IQA model robustness by measuring the Integral Robustness Score; this method evaluates the IQA model resistance to a set of adversarial perturbations with different magnitudes. We used our adversarial training approach to increase the robustness of five IQA models. Additionally, we tested the robustness of adversarially trained IQA models to 16 adversarial attacks and conducted an empirical probabilistic estimation of this feature.

Verified
Journal Article
Open access
PDF file
KAKhaled Abud
Khaled Abud
SLSergey Lavrushkin
Sergey Lavrushkin
Dmitriy VatolinDmitriy Vatolin
Dmitriy Vatolin
Neural-network-based models have made considerable progress in many computer vision areas over recent years. However, many works have exposed their vulnerability to malicious input data manipulation—that is, to adversarial attacks. Although many recent works have thoroughly examined the adversarial robustness of classifiers, the robustness of Image Quality Assessment (IQA) methods remains understudied. This paper addresses this gap by proposing FM-GOAT (Frequency-Masked Gradient Orthogonalization Attack), a novel white box adversarial method tailored for no-reference IQA models. Using a novel gradient orthogonalization technique, FM-GOAT uniquely optimizes adversarial perturbations against multiple perceptual constraints to minimize visibility, moving beyond traditional lp-norm bounds. We evaluate FM-GOAT on seven state-of-the-art NR-IQA models across three image and video datasets, revealing significant vulnerability to the proposed attack. Furthermore, we examine the applicability of adversarial purification methods to the IQA task, as well as their efficiency in mitigating white box adversarial attacks. By studying the activations from models’ intermediate layers, we explore their behavioral patterns in adversarial scenarios and discover valuable insights that may lead to better adversarial detection.

18 January 2021 in Electronic Imaging
Verified
Journal Article
Open access
SLSergey Lavrushkin
Sergey Lavrushkin
IMIvan Molodetskikh
Ivan Molodetskikh
KKKonstantin Kozhemyakov
Konstantin Kozhemyakov
Dmitriy VatolinDmitriy Vatolin
Dmitriy Vatolin
Fast track article for IS&T International Symposium on Electronic Imaging 2021: Stereoscopic Displays and Applications XXXII proceedings.

1 June 2018
Verified
Conference Paper
Closed access
SLSergey Lavrushkin
Sergey Lavrushkin
VLVitaliy Lyudvichenko
Vitaliy Lyudvichenko
Dmitriy VatolinDmitriy Vatolin
Dmitriy Vatolin
Many factors can cause color distortions between stereoscopic views during 3D-video shooting. Numerous viewers experience discomfort and headaches when watching stereoscopic videos that contain such distortions. In addition, 3D videos with color differences are hard to process because many algorithms assume brightness constancy.We propose an automatic method for correcting color distortions between stereoscopic views and compare it with analogs. The comparison shows that our proposed method combines high color-correction accuracy with relatively low computational complexity.

7 February 2023 in arXiv
Verified
Preprint
Open access
PDF file
AAAnastasia Antsiferova
Anastasia Antsiferova
SLSergey Lavrushkin
Sergey Lavrushkin
MSMaksim Smirnov
Maksim Smirnov
AGAlexander Gushchin
Alexander Gushchin
Dmitriy VatolinDmitriy Vatolin
Dmitriy Vatolin
DKDmitriy Kulikov
Dmitriy Kulikov
Video-quality measurement is a critical task in video processing. Nowadays, many implementations of new encoding standards - such as AV1, VVC, and LCEVC - use deep-learning-based decoding algorithms with perceptual metrics that serve as optimization objectives. But investigations of the performance of modern video- and image-quality metrics commonly employ videos compressed using older standards, such as AVC. In this paper, we present a new benchmark for video-quality metrics that evaluates video compression. It is based on a new dataset consisting of about 2,500 streams encoded using different standards, including AVC, HEVC, AV1, VP9, and VVC. Subjective scores were collected using crowdsourced pairwise comparisons. The list of evaluated metrics includes recent ones based on machine learning and neural networks. The results demonstrate that new no-reference metrics exhibit a high correlation with subjective quality and approach the capability of top full-reference metrics.