Internet of Things Operating Systems (IoT OSs) run, manage and control IoT devices. Therefore, it is important to secure the source code for IoT OSs, especially if they are deployed on devices used for human care and safety. In this paper, we report the results of our investigations of the security status and the presence of security vulnerabilities in the source code of the most popular open source IoT OSs. Through this research, three Static Analysis Tools (Cppcheck, Flawfinder and RATS) were used to examine the code of sixteen different releases of four different C/C++ IoT OSs, with 48 examinations, regarding the presence of vulnerabilities from the Common Weakness Enumeration (CWE). The examination reveals that IoT OS code still suffers from errors that lead to security vulnerabilities and increase the opportunity of security breaches. The total number of errors in IoT OSs is increasing from version to the next, while error density, i.e., errors per 1K of physical Source Lines of Code (SLOC) is decreasing chronologically for all IoT Oss, with few exceptions. The most prevalent vulnerabilities in IoT OS source code were CWE-561, CWE-398 and CWE-563 according to Cppcheck, (CWE-119!/CWE-120), CWE-120 and CWE-126 according to Flawfinder, and CWE-119, CWE-120 and CWE-134 according to RATS. Additionally, the CodeScene tool was used to investigate the development of the evolutionary properties of IoT OSs and the relationship between them and the presence of IoT OS vulnerabilities. CodeScene reveals strong positive correlation between the total number of security errors within IoT OSs and SLOC, as well as strong negative correlation between the total number of security errors and Code Health. CodeScene also indicates strong positive correlation between security error density (errors per 1K SLOC) and the presence of hotspots (frequency of code changes and code complexity), as well as strong negative correlation between security error density and the Qualitative Team Experience, which is a measure of the experience of the IoT OS developers.
Internet of Things (IoT) 's devices are ubiquitous and operate in a heterogonous environment with potential security breaches. IoT Operating Systems (IoT OSs) are the backbone software for running such devices. If IoT OSs are vulnerable to security breaches, higher-level security measures may not help. This paper aims to use Machine Learning (ML) to create a tool called iDetect for detecting vulnerabilities in C/C++ source code of IoT OSs. The source code for 16 releases of IoT OSs (RIOT, Contiki, FreeRTOS, Amazon FreeRTOS) and the Software Assurance Reference Dataset (SARD) were used to create a labeled dataset of vulnerable and benign code with the reference being the Common Weakness Enumeration (CWE) vulnerabilities present in IoT OSs. Studies showed that only a subset of CWEs is present in the C/C++ source code of low-end IoT OSs.The labeled dataset was used to train three ML models for vulnerability detection: Random Forest (RF), Convolutional Neural Network (CNN), and Recurrent Neural Network (RNN). The three models were used independently and RF; compared to CNN and RNN, gave the highest accuracy during the testing phase for binary and multiclass classification. RF was chosen as iDetect's ML classifier. Further evaluation was done on an unseen dataset of 322 code snippets taken from TinyOS. iDetect achieved a macro-averaged F1 score (mF1) of 98.5% and weighted-average F1 score (wF1) of 98% for multiclass classification, F1 score (F1) of 97.8% for binary classification, and superior results compared to all three Static Analysis Tools (SATs) used to collect the training dataset.
1 January 2006 in Lecture Notes in Computer Science
Object--Relational Mapping (ORM) frameworks make it easier to develop applications but often incur a significant performance overhead. This paper presents a comprehensive experimental evaluation of four popular relational databases (MySQL, PostgreSQL, Oracle, and Microsoft SQL Server) accessed via Django's ORM. Using the TPC-H benchmark, we measured query execution time, throughput, and resource utilization under varying query complexities and concurrency levels. PostgreSQL delivered the best overall performance under complex queries via the ORM, whereas Oracle’s superior raw SQL speed was largely offset by high ORM overhead. SQL Server showed balanced results, and MySQL performed well on simple queries but struggled with complex ones. We quantify the ORM-induced slowdown---ranging from 2.6 times in PostgreSQL to 5 times in Oracle---and demonstrate that proper indexing can improve performance by over 60% across all systems. These statistically significant findings underscore important trade-offs when using ORM frameworks. Our study provides new insights and practical guidance for selecting and tuning ORM-database combinations to achieve optimal performance.
Unmanned Aerial Vehicle (UAV) systems have become increasingly prominent in recent decades in both civilian and military applications, owing to their ability to perform a wide range of complex tasks quickly and accurately. The software architecture of UAVs is inherently complex, requiring coordinated management of hardware, software, communications, and sensors, along with integration of advanced technologies like the Internet of Things. As a result, UAV systems face significant security and privacy challenges. They are frequently viewed as attractive targets for malicious actors and remain vulnerable to diverse attacks that threaten data confidentiality, integrity, and availability. This paper presents a pilot analytical study of security vulnerabilities in UAV systems by examining the growth rate and density of security related-errors measured as the number of errors per 1K physical Source Lines of Code (SLoC) across four releases of the ArduPilot system. To identify these vulnerabilities, a static analysis tool, Cppcheck, was applied to detect weaknesses categorized under the Common Weakness Enumeration (CWE). In addition, the study explores the evolutionary properties of UAV systems using the CodeScene tool, aiming to establish how these properties correlate with the presence of security vulnerabilities. The findings show that ArduPilot exhibits a consistently high rate of source code vulnerabilities across the analyzed versions. The most frequently detected vulnerabilities were CWE-398, CWE-563, and CWE-758. Overall, this work advances the comprehension of UAV system security by providing detailed analytical insights into source code vulnerabilities, thereby serving as a guiding resource for future research and secure UAV development.