16 September 2015 in IEEE Communications Magazine
Over the last few years, the number of indoor localization solutions has grown exponentially, and a wide variety of different technologies and approaches are being explored. Unfortunately, there is currently no established standardized evaluation method for comparing their performance. As a result, each solution is evaluated in a different environment using proprietary evaluation metrics. Consequently, it is currently extremely hard to objectively compare the performance of multiple localization solutions with each other. To address the problem, we present the EVARILOS Benchmarking Platform, which enables automated evaluation and comparison of multiple solutions in different environments using multiple evaluation metrics. We propose a testbed-independent benchmarking platform, combined with multiple testbed-dependent plugins for executing experiments and storing performance results. The platform implements the standardized evaluation method described in the EVARILOS Benchmarking Handbook, which is aligned with the upcoming ISO/IEC 18305 standard “Test and Evaluation of Localization and Tracking Systems.” The platform and plug-ins can be used in real time on existing wireless testbed facilities, while also supporting a remote offline evaluation method using precollected data traces. Using these facilities, and analyzing and comparing the performance of three different localization solutions, we demonstrate the need for objective evaluation methods that consider multiple evaluation criteria in different environments.
5 April 2016 in IEEE Transactions on Industrial Informatics
Since Global Positioning System technologies cannot be used indoors, a significant amount of research focuses on developing radio-frequency-based alternatives for indoor localization. Unfortunately, most of the suggested solutions for indoor localization consist of theoretical work or have been evaluated in non-industrial environments, typically office spaces. To evaluate the influence of industrial environments on localization accuracy, in this paper, a time-of-arrival (ToA) approach was used to determine the stationary locations of a robot inside the w-iLab.t II testbed, an open industrial-like environment containing several metal obstacles. The ToA method utilizes the measured propagation time of a radio wave between a sender and receiver to estimate their corresponding distance. This paper evaluates several industrial-related deployment aspects that influence location accuracy and describes how their negative impact can be reduced, resulting in an almost 50% accuracy improvement in industrial environments.