Spectral imaging modalities, including reflectance and X-ray fluorescence, play an important role in conservation science. In reflectance hyperspectral imaging, the data are classified into areas having similar spectra and turned into labeled pigment maps using spectral features and fusing with other information. Direct classification and labeling remain challenging because many paints are intimate pigment mixtures that require a non-linear unmixing model for a robust solution. Neural networks have been successful in modeling non-linear mixtures in remote sensing with large training datasets. For paintings, however, existing spectral databases are small and do not encompass the diversity encountered. Given that painting practices are relatively consistent within schools of artistic practices, we tested the suitability of using reflectance spectra from a subgroup of well-characterized paintings to build a large database to train a one-dimensional (spectral) convolutional neural network. The labeled pigment maps produced were found to be robust within similar styles of paintings.

The split window technique has been used for over thirty years to derive surface temperatures of the Earth with image data collected from spaceborne sensors containing two thermal channels. The latest NASA/USGS Landsat satellites contain the Thermal Infrared Sensor (TIRS) instruments that acquire Earth data in two longwave infrared bands, as opposed to a single band with earlier Landsats. The United States Geological Survey (USGS) will soon begin releasing a surface temperature product for Landsats 4 through 8 based on the single spectral channel methodology. However, progress is being made toward developing and validating a more accurate and less computationally intensive surface temperature product based on the split window method for Landsat 8 and 9 datasets. This work presents the progress made towards developing an operational split window algorithm for TIRS. Specifically, details of how the generalized split window algorithm was tailored for the TIRS sensors are presented, along with geometric considerations that should be addressed to avoid spatial artifacts in the final surface temperature product. Validation studies indicate that the proposed algorithm is accurate to within 2 K when compared to land-based measurements and to within 1 K when compared to water-based measurements, highlighting the improved accuracy that may be achieved over the current single-channel methodology being used to derive surface temperature in the Landsat Collection 2 surface temperature product. Surface temperature products using the split window methodologies described here can be made available upon request for testing purposes.

With the launch of Landsat-9 on 27 September 2021, Landsat continues its fifty-year continuity mission of providing users with calibrated Earth observations. It has become a requirement that an underflight experiment be performed during commissioning to support sensor cross-calibration. In this most recent experiment, Landsat-9 flew under Landsat-8 for nearly three days with over 50% ground overlap, from 13 to 15 November 2021. To address the scarcity of reference data that are available to support calibration and validation early-on in the mission, a ground campaign was planned and executed by the Rochester Institute of Technology (RIT) on 14 November 2021 to provide full spectrum measurements for early mission comparisons. The primary experiment was conducted in the Outer Banks, North Carolina at Jockey’s Ridge Sand Dunes. Full-spectrum ground-based measurements were acquired with calibrated reference equipment, while a novel Unmanned Aircraft System (UAS)-based platforms acquired hyperspectral visible and near-infrared (VNIR)/Short-wave infrared (SWIR) imagery data and coincident broadband cooled thermal infrared (TIR) imagery. Results of satellite/UAS/ground comparisons were an indicator, during the commissioning phase, that Landsat-9 is behaving consistently with Landsat-8, ground reference, and UAS measurements. In the thermal infrared, all measurements agree to be within 1 K over water and to within 2 K over sand, which represents the most challenging material for estimating surface temperature. For the surface reflectance product(s), Landsat-8 and -9 are in good agreement and only deviate slightly from ground reference in the SWIR bands; a deviation of 2% in the VNIR and 5–8% in the SWIR regime. Subsequent longer-term studies indicate that Landsat 9 continues to perform as expected. The behavior of Thermal Infrared Sensor-2 (TIRS-2) against reference is also shown for the first year of the mission to illustrate its consistent performance.

Reflectance imaging spectroscopy (RIS) is invaluable in mapping and identifying artists’ materials in paintings. The analysis of the RIS image cube first involves classifying the cube into spatial regions, each having a unique reflectance spectrum (endmember). Second, endmember spectra are analyzed for spectral features useful to identify the pigments present to create labeled classes. The analysis process for paintings remains semi-automated because of the complex diffuse reflectance spectra due to the use of intimate pigment mixtures and optically thin paint layers by the artist. As a result, even when a group of related paintings are analyzed, each RIS cube is analyzed individually, which is time consuming. There is a need for new approaches to more efficiently analyze RIS cubes of related paintings to address the growing interest in the study of related paintings within a group of artists or artistic schools. This work builds upon prior investigations of 1-D spectral convolutional neural networks (CNNs) to address this need in two ways. First, an expanded training set was used—ten illuminated manuscripts created by artists stylistically grouped under the notname “Master of the Cypresses” (15th century Seville, Spain). Second, two 1-D CNN models were trained from the RIS cubes: reflectance and the first derivative. The results showed that the first derivative-trained CNN generally performed better than the reflectance-trained CNN in creating accurate labeled material maps for these illuminated manuscripts.

To better understand and preserve works of art, knowledge is needed about the pigments used to create the artwork. Various noninvasive techniques have been used previously to create pigment maps, such as combining X-ray fluorescence and hyperspectral imaging data. Unfortunately, most museums have limited funding for the expense of specialized research equipment, such as hyperspectral reflectance imaging systems. However, many museums have hand-held point X-ray fluorescence systems attached to motorized easels for scanning artwork. To assist museums in acquiring data that can produce similar results to that of HSI systems, while minimizing equipment costs, this study designed and modeled a prototype system to demonstrate the expected performance of a low-cost multispectral system that can be attached to existing motorized easels. We show that multispectral systems with a well-chosen set of spectral bands can often produce classification maps with value on par with hyperspectral systems. This study analyzed the potential for capturing data with a point scanning system through predefined filters. By applying the system and noise modeling parameters to HSI data captured from a 14th-Century illumination, the study reveals that the proposed multispectral imaging system is a viable option for this need.