Localization in urban environments is becoming increasingly important and used in tools such as ARCore [18], ARKit [34] and others. One popular mechanism to achieve accurate indoor localization and a map of the space is using Visual Simultaneous Localization and Mapping (Visual-SLAM). However, Visual-SLAM is known to be resource-intensive in memory and processing time. Furthermore, some of the operations grow in complexity over time, making it challenging to run on mobile devices continuously. Edge computing provides additional compute and memory resources to mobile devices to allow offloading tasks without the large latencies seen when offloading to the cloud.In this article, we present Edge-SLAM, a system that uses edge computing resources to offload parts of Visual-SLAM. We use ORB-SLAM2 [50] as a prototypical Visual-SLAM system and modify it to a split architecture between the edge and the mobile device. We keep the tracking computation on the mobile device and move the rest of the computation, i.e., local mapping and loop closing, to the edge. We describe the design choices in this effort and implement them in our prototype. Our results show that our split architecture can allow the functioning of the Visual-SLAM system long-term with limited resources without affecting the accuracy of operation. It also keeps the computation and memory cost on the mobile device constant, which would allow for the deployment of other end applications that use Visual-SLAM. We perform a detailed performance and resources use (CPU, memory, network, and power) analysis to fully understand the effect of our proposed split architecture.
Materials recovery facilities (MRFs) require new automated technologies if growing recycling demands are to be met. Current optical screening devices use visible (VIS) and near-infrared (NIR) wavelengths, frequency ranges that can experience challenges during the characterization of postconsumer plastic waste (PCPW) because of the overly-absorbing spectral bands from dyes and other polymer additives. Technological bottlenecks such as these contribute to 91% of plastic waste never actually being recycled. The mid-infrared (MIR) region has attracted recent attention due to inherent advantages over the VIS and NIR. The fundamental vibrational modes found therein make MIR frequencies promising for high fidelity machine learning (ML) classification. To-date, there are no ML evaluations of extensive MIR spectral datasets reflecting PCPW that would be encountered at MRFs. This study establishes quantifiable metrics, such as model accuracy and prediction time, for classification of a comprehensive MIR database consisting of five PCPW classes that are of economic interest: polyethylene terephthalate (PET #1), high-density polyethylene (HDPE #2), low-density polyethylene (LDPE #4), polypropylene (PP #5), and polystyrene (PS #6). Autoencoders, an unsupervised ML algorithm, were applied to the random forest (RF), k-nearest neighbor (KNN), support vector machine (SVM), and logistic regression (LR) models. The RF model achieved accuracies of 100.0% in both the C–H stretching region (2990–2820 cm−1) and molecular fingerprint region (1500–650 cm−1). The C–H stretching region was found to be free from additives that were responsible for misclassification in other regions, making it a fruitful frequency range for future PCPW sorting technologies. The MIR classification of black plastics and polyethylene PCPW using ML autoencoders was also evaluated for the first time.
This study describes the design and implementation of several bioinspired algorithms for providing guidance to an ultra-lightweight micro-aerial vehicle (MAV) using a 2.6 g omnidirectional vision sensor. Using this visual guidance system we demonstrate autonomous speed control, centring, and heading stabilisation on board a 30 g MAV flying in a corridor-like environment. In addition to the computation of wide-field optic flow, the comparatively high-resolution omnidirectional imagery provided by this sensor also offers the potential for image-based algorithms such as landmark recognition to be implemented in the future.
Autonomous vehicles and human drivers are prone to line-of-sight limitations. Road-side mounted 3D sensors like LiDARs can augment a vehicle's on-board perception. However, this entails fusing 3D frames at low latency and high accuracy. Road-side and vehicle 3D frames are captured from different viewpoints. This adversely affects alignment accuracy and can be computationally expensive. To this end, VRF optimizes for both latency and accuracy by decoupling the alignment process into indirect and direct alignments. First, VRF indirectly aligns the 3D frames by aligning them to a common reference point i.e., a vehicle's on-board 3D map. Then, it directly aligns the two point clouds to refine this alignment. To ensure high accuracy, it incorporates novel offline registration and alignment accuracy forecasting modules. To ensure low latency, it uses a fast fusion pipeline that caches previous and offline computations. To our knowledge, VRF is the first vehicle road-side cooperative system to ensure cm-level accuracy and end-to-end latency less than 20 ms. Most importantly, its latency is below the 100 ms threshold required for autonomous vehicles to react to external events. Finally, VRF can improve reaction time to external events by as much as 5 seconds1.
Mapping 3D airflow fields is important for many HVAC, industrial, medical, and home applications. However, current approaches are expensive and time-consuming. We present Anemoi, a sub-$100 drone-based system for autonomously mapping 3D airflow fields in indoor environments. Anemoi leverages the effects of airflow on motor control signals to estimate the magnitude and direction of wind at any given point in space. We introduce an exploration algorithm for selecting optimal waypoints that minimize overall airflow estimation uncertainty. We demonstrate through microbenchmarks and real deployments that Anemoi is able to estimate wind speed and direction with errors up to 0.41 m/s and 25.1° lower than the existing state of the art and map 3D airflow fields with an average RMS error of 0.73 m/s.