Imaging system range defines the maximal distance at which a selected object can be seen and perceived following surveillance task perception criteria. Thermal imagers play a key role in long-range surveillance systems due to the ability to form images during the day or night and in adverse weather conditions. The thermal imager range depends on imager design parameters, scene and transmission path properties. Imager range prediction is supported by theoretical models that provide the ability to check range performance, compare range performances for different systems, extend range prediction in field conditions, and support laboratory measurements related to range. A condensed review of the theoretical model’s genesis and capabilities is presented. We applied model-based performance calculation for several thermal imagers used in our long-range surveillance systems and compared the results with laboratory performance measurement results with the intention of providing the range prediction in selected field conditions. The key objective of the paper is to provide users with reliable data regarding expectations during a field mission.
SWIR imaging bears considerable advantages over visible-light (color) and thermal images in certain challenging propagation conditions. Thus, the SWIR imaging channel is frequently used in multi-spectral imaging systems (MSIS) for long-range surveillance in combination with color and thermal imaging to improve the probability of correct operation in various day, night and climate conditions. Integration of deep-learning (DL)-based real-time object detection in MSIS enables an increase in efficient utilization for complex long-range surveillance solutions such as border or critical assets control. Unfortunately, a lack of datasets for DL-based object detection models training for the SWIR channel limits their performance. To overcome this, by using the MSIS setting we propose a new cross-spectral automatic data annotation methodology for SWIR channel training dataset creation, in which the visible-light channel provides a source for detecting object types and bounding boxes which are then transformed to the SWIR channel. A mathematical image transformation that overcomes differences between the SWIR and color channel and their image distortion effects for various magnifications are explained in detail. With the proposed cross-spectral methodology, the goal of the paper is to improve object detection in SWIR images captured in challenging outdoor scenes. Experimental tests for two object types (cars and persons) using a state-of-the-art YOLOX model demonstrate that retraining with the proposed automatic cross-spectrally created SWIR image dataset significantly improves average detection precision. We achieved excellent improvements in detection performance in various variants of the YOLOX model (nano, tiny and x).
In this paper, we propose a new algorithm for distributed spectrum sensing and channel selection in cognitive radio networks based on consensus. The algorithm operates within a multi-agent reinforcement learning scheme. The proposed consensus strategy, implemented over a directed, typically sparse, time-varying low-bandwidth communication network, enforces collaboration between the agents in a completely decentralized and distributed way. The motivation for the proposed approach comes directly from typical cognitive radio networks’ practical scenarios, where such a decentralized setting and distributed operation is of essential importance. Specifically, the proposed setting provides all the agents, in unknown environmental and application conditions, with viable network-wide information. Hence, a set of participating agents becomes capable of successful calculation of the optimal joint spectrum sensing and channel selection strategy even if the individual agents are not. The proposed algorithm is, by its nature, scalable and robust to node and link failures. The paper presents a detailed discussion and analysis of the algorithm’s characteristics, including the effects of denoising, the possibility of organizing coordinated actions, and the convergence rate improvement induced by the consensus scheme. The results of extensive simulations demonstrate the high effectiveness of the proposed algorithm, and that its behavior is close to the centralized scheme even in the case of sparse neighbor-based inter-node communication.
In this paper, we present a hardware and software platform for signal processing (SPP) in long-range, multi-spectral, electro-optical systems (MSEOS). Such systems integrate various cameras such as lowlight color, medium or long-wave-infrared thermal and short-wave-infrared cameras together with other sensors such as laser range finders, radars, GPS receivers, etc. on rotational pan-tilt positioner platforms. An SPP is designed with the main goal to control all components of an MSEOS and execute complex signal processing algorithms such as video stabilization, artificial intelligence-based target detection, target tracking, video enhancement, target illumination, multi-sensory image fusion, etc. Such algorithms might be very computationally demanding, so an SPP enables them to run by splitting processing tasks between a field-programmable gate array (FPGA) unit, a multicore microprocessor (MCuP) and a graphic processing unit (GPU). Additionally, multiple SPPs can be linked together via an internal Gbps Ethernet-based network to balance the processing load. A detailed description of the SPP system and experimental results of workloads for typical algorithms on demonstrational MSEOS are given. Finally, we give remarks regarding upgrading SPPs as novel FPGAs, MCuPs and GPUs become available.
The steady increase of the world population and economy leads to an increase in both types and amounts of goods transported over seas, which further inevitably leads to an increase of criminal activities in the maritime arena. In order to stifle criminal activities nations are forced to develop sophisticated sensor networks. The backbone of any sensor network is a communication network which connects all sensors with the command centers, most often located hundreds of kilometers away from the sensors. In developing countries, communication networks are very often poorly developed, leaving only satellite links as somewhat reliable means of communication. Henceforth, in this paper, a laboratory for the Internet of Things (IoT) communication infrastructure environment designed to facilitate maritime sensor network design process in areas where communication network is dependent on data transfer over satellite links is presented. In order to successfully describe and develop a laboratory for IoT communication infrastructure environment, necessary data are collected during the design and deployment of a maritime surveillance network in the Gulf of Guinea. The main advantage of the proposed laboratory environment is the inclusion of satellite link simulation in the IoT laboratory environment. This feature provides an opportunity to cover a much broader scope of IoT solutions compared to other IoT laboratories.
Terrestrial radio signals at frequencies above 70 GHz are vulnerable to atmospheric absorption by rain. In order to prevent traffic loss in radio network, caused by finite duration of rerouting algorithm convergence, protection method based on pre-calculated backup routes is proposed. Using two-dimensional rain cell model, a performance analysis is held out for different rain parameters in network with adaptive modulation/capacity links. It is shown that under influence of moderate rain intensity, a network protected by proposed method can have performance very close to that of a rerouted network.