Gokhan Cetiner

Gokhan Cetiner

Auto-generated profile, based on publicly available information

Gokhan Cetiner

Computer Engineering Department, University of Eskisehir Osmangazi, Eskiehir, Trkiye

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
16 October 2024 in IEEE Access
Verified
Journal Article
Open access
GÇGökhan Çetiner
Gökhan Çetiner
UYUgur Yayan
Ugur Yayan
AYAhmet YAZICI
Ahmet YAZICI
Deep Neural Networks (DNNs) are used in many critical areas, such as autonomous vehicles, generative AI systems, etc. Therefore, testing DNNs is vital, especially for models used in critical areas. Mutation-based testing is a very successful technique for testing DNNs by mutating their complex structures. Deep Mutation Module was developed to address mutation-based testing and the robustness challenges of DNNs. It analyses the structures of DNNs in detail. It tests models by applying mutation to parameters and structures using its fault library. Testing DNN structures and detecting faults is a highly complex and open-ended challenge. The method proposed in this study applies mutations to DNN parameters to expose faults and weaknesses in the models, thereby testing their robustness. The paper focuses on mutation-based tests of an Reinforce Learning (RL) model developed for electric vehicle routing, a Long Short-Term Memory (LSTM) model developed for prognostic predictions, and a Transformer-based neural network model for electric vehicle routing tasks. The best mutation scores for the LSTM model were measured as 96%, 91.02%, 71.19%, and 68.77%. The test results for the RL model resulted in mutation scores of 93.20%, 72.13%, 77.47%, 79.28%, and 55.74%. The mutation scores of the Transformer model were 75.87%, 76.36%, and 74.93%. These results show that the module can successfully test the targeted models and generate mutants classified as "survived mutants" that outperform the original models. In this way, it provides critical information to researchers to improve the overall performance of the models. Conducting these tests before using them in real-world applications minimizes faults and maximizes model success.

16 October 2024
Verified
Conference Paper
Closed access
GCGokhan Cetiner
Gokhan Cetiner
CBCem Baglum
Cem Baglum
UYUgur Yayan
Ugur Yayan
AYAhmet YAZICI
Ahmet YAZICI
Artificial intelligence is actively becoming widespread in every field. The complex structure of deep neural network models, especially those used in real-world applications, may contain faults that lead to unexpected model behavior, even well-trained AI models. To detect these types of faults and model behaviors, it is necessary to perform a white box test of the model's reliability and adequacy by mutating its layers, activation functions, and similar model structures and parameters. White box testing is a method that tests the logical flow of software to detect possible faults and deficiencies in the code. The proposed module performs model-based testing using this testing technique. The module was developed as an extension of the traditional testing tool IM-FIT. It was inspired by IM-FIT's advanced fault detection capacity in traditional software testing, autonomous or customized testing options, and detailed report generation capabilities. The module carries out an advanced scanning and mutation process using its own unique fault library for deep neural networks. The module successfully performed the test by autonomously generating mutants and classifying these mutants. Tests were performed on a Transformer model using the TensorFlow library during the testing process. As a result of the tests performed with 5, 10, and 20 epoch values, a total of 606 mutants were produced. While 414 of these mutants were classified as killed, 192 were classified as survived. This study presents it to the literature as an effective mutation testing tool focusing on deep neural networks.