Biden School of Public Policy and Administration, Department of Physics and Astronomy and Data Science Institute, University of Delaware, Newark, DE 19716, USA
Prof. Gregory Dobler
Biden School of Public Policy and Administration, Department of Physics and Astronomy and Data Science Institute, University of Delaware, Newark, DE 19716, USA
Using side-facing observations of the New York City (NYC) skyline, we identify lighting technologies via spectral signatures measured with Visible and Near Infrared (VNIR) hyperspectral imaging. The instrument is a scanning, single slit spectrograph with 872 spectral channels from 0.4–1.0 m. With a single scan, we are able to clearly match the detected spectral signatures of 13 templates of known lighting types. However, many of the observed lighting spectra do not match those that have been measured in the laboratory. We identify unknown spectra by segmenting our observations and using Template-Activated Partition (TAP) clustering with a variety of underlying unsupervised clustering methods to generate the first empirically-determined spectral catalog of roughly 40 urban lighting types. We show that, given our vantage point, we are able to determine lighting technology use for both interior and exterior lighting. Finally, we find that the total brightness of our scene shows strong peaks at the 570 nm - , 595 nm - and 818 nm - lines that are common in high pressure sodium lamps, which dominate our observations.
We describe an “Urban Observatory” facility designed for the study of complex urban systems via persistent, synoptic, and granular imaging of dynamical processes in cities. An initial deployment of the facility has been demonstrated in New York City and consists of a suite of imaging systems—both broadband and hyperspectral—sensitive to wavelengths from the visible (∼400 nm) to the infrared (∼13 micron) operating at cadences of ∼0.01–30 Hz (characteristically ∼0.1 Hz). Much like an astronomical survey, the facility generates a large imaging catalog from which we have extracted observables (e.g., time-dependent brightnesses, spectra, temperatures, chemical species, etc.), collecting them in a parallel source catalog. We have demonstrated that, in addition to the urban science of cities as systems, these data are applicable to a myriad of domain-specific scientific inquiries related to urban functioning including energy consumption and end use, environmental impacts of cities, and patterns of life and public health. We show that an Urban Observatory facility of this type has the potential to improve both a city’s operations and the quality of life of its inhabitants.
We present a study of the potential for convolutional neural networks (CNNs) to enable separation of astrophysical transients from image artifacts, a task known as “real–bogus” classification, without requiring a template-subtracted (or difference) image, which requires a computationally expensive process to generate, involving image matching on small spatial scales in large volumes of data. Using data from the Dark Energy Survey, we explore the use of CNNs to (1) automate the real–bogus classification and (2) reduce the computational costs of transient discovery. We compare the efficiency of two CNNs with similar architectures, one that uses “image triplets” (templates, search, and difference image) and one that takes as input the template and search only. We measure the decrease in efficiency associated with the loss of information in input, finding that the testing accuracy is reduced from ∼96% to ∼91.1%. We further investigate how the latter model learns the required information from the template and search by exploring the saliency maps. Our work (1) confirms that CNNs are excellent models for real–bogus classification that rely exclusively on the imaging data and require no feature engineering task and (2) demonstrates that high-accuracy (>90%) models can be built without the need to construct difference images, but some accuracy is lost. Because, once trained, neural networks can generate predictions at minimal computational costs, we argue that future implementations of this methodology could dramatically reduce the computational costs in the detection of transients in synoptic surveys like Rubin Observatory's Legacy Survey of Space and Time by bypassing the difference image analysis entirely.
Background: Vegetation spectral reflectance obtained with hyperspectral imaging (HSI) offer non-invasive means for the non-destructive study of their physiological status. The light intensity at visible and near-infrared wavelengths (VNIR, 0.4–1.0µm) captured by the sensor are composed of mixtures of spectral components that include the vegetation reflectance, atmospheric attenuation, top-of-atmosphere solar irradiance, and sensor artifacts. Common methods for the extraction of spectral reflectance from the at-sensor spectral radiance offer a trade-off between explicit knowledge of atmospheric conditions and concentrations, computational efficiency, and prediction accuracy, and are generally geared towards nadir pointing platforms. Therefore, a method is needed for the accurate extraction of vegetation reflectance from spectral radiance captured by ground-based remote sensors with a side-facing orientation towards the target, and a lack of knowledge of the atmospheric parameters.Results: We propose a framework for obtaining the vegetation spectral reflectance from at-sensor spectral radiance, which relies on a time-dependent Encoder-Decoder Convolutional Neural Network trained and tested using simulated spectra generated from radiative transfer modeling. Simulated at-sensor spectral radiance are produced from combining 1440 unique simulated solar angles and atmospheric absorption profiles, and 1000 different spectral reflectance curves of vegetation with various health indicator values, together with sensor artifacts. Creating an ensemble of 10 models, each trained and tested on a separate 10% of the dataset, results in the prediction of the vegetation spectral reflectance with a testing r2of 98.1% (±0.4). This method produces consistently high performance with accuracies >90% for spectra with resolutions as low as 40 channels in VNIR each with 40 nm full width at half maximum (FWHM) and greater, and remains viable with accuracies >80% down to a resolution of 10 channels with 60 nm FWHM. When applied to real sensor obtained spectral radiance data, the predicted spectral reflectance curves showed general agreement and consistency with those corrected by the Compound Ratio method.Conclusions: We propose a method that allows for the accurate estimation of the vegetation spectral reflectance from ground-based HSI platforms with sufficient spectral resolution. It is capable of extracting the vegetation spectral reflectance at high accuracy in the absence of knowledge of the exact atmospheric compositions and conditions at time of capture, and the lack of available sensor-measured spectral radiance and their true ground-truth spectral reflectance profiles.
We examine the impact of changes in ozone (O3), particulate matter (PM2.5), temperature, and humidity on the health of vegetation in dense urban environments, using a very high-resolution, ground-based Visible and Near-Infrared (VNIR, 0.4–1.0 μm with a spectral resolution of 0.75 nm) hyperspectral camera deployed by the Urban Observatory (UO) in New York City. Images were captured at 15 min intervals from 08h00 to 18h00 for 30 days between 3 May and 6 June 2016 with each image containing a mix of dense built structures, sky, and vegetation. Vegetation pixels were identified using unsupervised k-means clustering of the pixel spectra and the time dependence of the reflection spectrum of a patch of vegetation at roughly 1 km from the sensor that was measured across the study period. To avoid illumination and atmospheric variability, we introduce a method that measures the ratio of vegetation pixel spectra to the spectrum of a nearby building surface at each time step relative to that ratio at a fixed time. This “Compound Ratio” exploits the (assumed) static nature of the building reflectance to isolate the variability of vegetation reflectance. Two approaches are used to quantify the health of vegetation at each time step: (a) a solar-induced fluorescence indicator () calculated as the simple ratio of the amplitude of the Compound Ratio at 0.75 μm and 0.9 μm, and (b) Principal Component Analysis (PCA) decomposition designed to capture more global spectral features. The time dependence of these vegetation health indicators is compared to that of O3, PM2.5, temperature, and humidity values from a distributed and publicly available in situ air quality sensor network. Assuming a linear relationship between vegetation health indicators and air quality indicators, we find that changes in both SIF indicator values and PC amplitudes show a strong correlation ( value of 40% and 47%, respectively) with changes in air quality, especially in comparison with nearby buildings used as controls ( value of 1% and 4%, respectively, and with all molecular correlations consistent with zero to within 3 uncertainty). Using the SIF indicator, O3 and temperature exhibit a positive correlation with changes in photosynthetic rate in vegetation, while PM2.5 and humidity exhibit a negative correlation. We estimate full covariant uncertainties on the coefficients using a Markov Chain Monte Carlo (MCMC) approach and demonstrate that these correlations remain statistically significant even when controlling for the effects of diurnal sun-sensor geometry and temperature variability. This work highlights the importance of quantifying the effects of various air quality parameters on vegetation health in urban environments in order to uncover the complexity, covariance, and interdependence of the numerous factors involved.
We present a comparative analysis of urban magnetic fields between two American cities: Berkeley (California) and Brooklyn Borough of New York City (New York). Our analysis uses data taken over a four-week period during which magnetic field data were continuously recorded using a fluxgate magnetometer with 70 pT/Hz noise. We identified significant differences in the magnetic signatures. In particular, we noticed that Berkeley reaches a near-zero magnetic field activity at night, whereas magnetic activity in Brooklyn continues during nighttime. We also present auxiliary measurements acquired using magnetoresistive vector magnetometers (VMRs), with the noise of 300 pT/Hz, and demonstrate how cross correlation, and frequency-domain analysis, combined with data filtering can be used to extract urban-magnetometry signals and study local anthropogenic activities. Finally, we discuss the potential of using magnetometer networks to characterize the global magnetic field of cities and give directions for future development.