Results for “evaluation datasets” — Page 21

NASA NTRSDate not supplied

Enhancing Radiative Transfer Models for Optimized Assimilation of Microwave and Radar Observations

Radiative transfer models are extensively used for the assimilation of satellite observations into NWP models as well as retrieving geophysical products from satellite measurements. The Community Radiative Transfer Model (CRTM) is a community model developed by NOAA JCSDA and widely used for different purposes requiring RT calculations. CRTM requires bulk optical properties of hydrometeors in the form of lookup tables in order to perform all-sky RT calculations. However, the current cloud scattering lookup tables in CRTM assume spherical shapes for all frozen hydrometeors, whereas actual clouds contain frozen particles with diverse shapes. The first part of this talk presents the implementation and validation of a comprehensive Discrete Dipole Approximation (DDA) cloud scattering database into CRTM, specifically targeting microwave frequencies. The DDA technique proves effective in simulating the optical properties of non-spherical hydrometeors in the microwave region. The original DDA database assumes total random orientation in calculating single scattering properties. To generate the required mass scattering parameters for CRTM, the single scattering properties and water content dependent particle size distributions are used. The evaluation of results involved a collocated dataset comprising short-term forecasts from the Integrated Forecast System of the European Center for Medium-Range Weather Forecasts and satellite microwave data. The findings demonstrate that the DDA lookup tables significantly reduce discrepancies between simulated and observed values when compared to the Mie tables. Passive instruments lack the ability to provide vertically resolved measurements of clouds and precipitation, which can be obtained by active radar instruments. However, incorporating these active measurements into data assimilation systems presents challenges due to the absence of fast forward radiative transfer models and difficulties in error modeling. The second part of the talk focuses on the development, evaluation, and sensitivity analysis of a forward radar model integrated into CRTM. The forward radar model utilizes scattering properties obtained from hydrometeor lookup tables generated using the discrete dipole approximation. By utilizing CRTM instrument-specific coefficients, the model can calculate both reflectivity and attenuated reflectivity for any given radar instrument and zenith angles. Evaluation using CloudSat measurements demonstrates a strong agreement between simulations and observations when the input profiles of hydrometeors align with the measured reflectivity profiles.

Isaac Moradi↗

NASA NTRSDate not supplied

Optimizing Assimilation of Microwave and Radar Observations in the NWP Models

Radiative transfer models are extensively used for the assimilation of satellite observations into NWP models as well as retrieving geophysical products from satellite measurements. The Community Radiative Transfer Model (CRTM) is a community model developed by NOAA JCSDA and widely used for different purposes requiring RT calculations. CRTM requires bulk optical properties of hydrometeors in the form of lookup tables in order to perform all-sky RT calculations. However, the current cloud scattering lookup tables in CRTM assume spherical shapes for all frozen hydrometeors, whereas actual clouds contain frozen particles with diverse shapes. The first part of this talk presents the implementation and validation of a comprehensive Discrete Dipole Approximation (DDA) cloud scattering database into CRTM, specifically targeting microwave frequencies. The DDA technique proves effective in simulating the optical properties of non-spherical hydrometeors in the microwave region. The original DDA database assumes total random orientation in calculating single scattering properties. To generate the required mass scattering parameters for CRTM, the single scattering properties and water content dependent particle size distributions are used. The evaluation of results involved a collocated dataset comprising short-term forecasts from the Integrated Forecast System of the European Center for Medium-Range Weather Forecasts and satellite microwave data. The findings demonstrate that the DDA lookup tables significantly reduce discrepancies between simulated and observed values when compared to the Mie tables. Passive instruments lack the ability to provide vertically resolved measurements of clouds and precipitation, which can be obtained by active radar instruments. However, incorporating these active measurements into data assimilation systems presents challenges due to the absence of fast forward radiative transfer models and difficulties in error modeling. The second part of the talk focuses on the development, evaluation, and sensitivity analysis of a forward radar model integrated into CRTM. The forward radar model utilizes scattering properties obtained from hydrometeor lookup tables generated using the discrete dipole approximation. By utilizing CRTM instrument-specific coefficients, the model can calculate both reflectivity and attenuated reflectivity for any given radar instrument and zenith angles. Evaluation using CloudSat measurements demonstrates a strong agreement between simulations and observations when the input profiles of hydrometeors align with the measured reflectivity profiles.

Isaac Moradi↗

NASA NTRSDate not supplied

Assimilation of Spaceborne Microwave and Radar Observations

Radiative transfer models are extensively used for the assimilation of satellite observations into NWP models as well as retrieving geophysical products from satellite measurements. The Community Radiative Transfer Model (CRTM) is a community model developed by NOAA JCSDA and widely used for different purposes requiring RT calculations. CRTM requires bulk optical properties of hydrometeors in the form of lookup tables in order to perform all-sky RT calculations. However, the current cloud scattering lookup tables in CRTM assume spherical shapes for all frozen hydrometeors, whereas actual clouds contain frozen particles with diverse shapes. The first part of this talk presents the implementation and validation of a comprehensive Discrete Dipole Approximation (DDA) cloud scattering database into CRTM, specifically targeting microwave frequencies. The DDA technique proves effective in simulating the optical properties of non-spherical hydrometeors in the microwave region. The original DDA database assumes total random orientation in calculating single scattering properties. To generate the required mass scattering parameters for CRTM, the single scattering properties and water content dependent particle size distributions are used. The evaluation of results involved a collocated dataset comprising short-term forecasts from the Integrated Forecast System of the European Center for Medium-Range Weather Forecasts and satellite microwave data. The findings demonstrate that the DDA lookup tables significantly reduce discrepancies between simulated and observed values when compared to the Mie tables. Passive instruments lack the ability to provide vertically resolved measurements of clouds and precipitation, which can be obtained by active radar instruments. However, incorporating these active measurements into data assimilation systems presents challenges due to the absence of fast forward radiative transfer models and difficulties in error modeling. The second part of the talk focuses on the development, evaluation, and sensitivity analysis of a forward radar model integrated into CRTM. The forward radar model utilizes scattering properties obtained from hydrometeor lookup tables generated using the discrete dipole approximation. By utilizing CRTM instrument-specific coefficients, the model can calculate both reflectivity and attenuated reflectivity for any given radar instrument and zenith angles. Evaluation using CloudSat measurements demonstrates a strong agreement between simulations and observations when the input profiles of hydrometeors align with the measured reflectivity profiles.

Isaac Moradi↗

NASA NTRS2018

Evaluation of Multiple Doppler Retrievals of Convection in Darwin

Climate Model Development and Validation: (1) DOE's E3SM model being developed with goal of an increased resolution of 13 km (right arrow) assumptions made in convective parameterizations may not apply. (2) Need long term dataset with quantifiable large scale forcings to evaluate performance of convective parameterizations. (3) Vertical velocities are critical for calculating mass fluxes but are poorly represented in GCMs. (4) Dual Doppler techniques can retrieve vertical velocities, but uncertainties can be high due to sampling, mass continuity assumptions, fall speed assumptions, boundary conditions. (5) Can use high-resolution model simulated radar variables to assess impacts of such uncertainties

Doppler↗

DOE OSTI2024

Model-ready benchmarks for NPP, ANPP, litter fluxes, and recruitment into the 1 cm dbh size class

The intended use of this dataset is to serve as an observational benchmark to evaluate model predictions of NPP, ANPP, litter fluxes, and recruitment at Barro Colorado Island, Panama. This dataset contains four CSV files and one text file. “Benchmarks-NPP-ANPP-R-L.csv” provides estimates of annual ecosystem-level reproductive litter flux (R), leaf litter flux (L), aboveground net primary productivity (ANPP), and net primary productivity (NPP) for 61 field plots throughout tropical, temperate, and boreal forest biomes. An additional 499 plots (n = 550) include estimates of just R, L, and R/L. Each row reports a distinct set of estimates for one sampling interval at one plot. “Metadata-Benchmarks-NPP-ANPP-R-L.csv” contains field descriptions for all data fields in “Benchmarks-NPP-ANPP-R-L.csv”. “References-Benchmarks-NPP-ANPP-R-L.txt” contains full references to the original studies used to produce the observations at each plot included in the data. “Benchmarks-Recruitment.csv” provides estimates of species-level recruitment rates into the 1 cm dbh size class at four CTFS-ForestGeo sites using methods that account for unobserved mortality of new recruits between census intervals (Kohyama et al., 2018). “Metadata-Benchmarks-Recruitment.csv” contains field descriptions for all data fields in “Benchmarks-Recruitment.csv”.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

A fine pore-preserved deep neural network for porosity analytics of a high burnup U-10Zr metallic fuel

Abstract U-10 wt.% Zr (U-10Zr) metallic fuel is the leading candidate for next-generation sodium-cooled fast reactors. Porosity is one of the most important factors that impacts the performance of U-10Zr metallic fuel. The pores generated by the fission gas accumulation can lead to changes in thermal conductivity, fuel swelling, Fuel-Cladding Chemical Interaction (FCCI) and Fuel-Cladding Mechanical Interaction (FCMI). Therefore, it is crucial to accurately segment and analyze porosity to understand the U-10Zr fuel system to design future fast reactors. To address the above issues, we introduce a workflow to process and analyze multi-source Scanning Electron Microscope (SEM) image data. Moreover, an encoder-decoder-based, deep fully convolutional network is proposed to segment pores accurately by integrating the residual unit and the densely-connected units. Two SEM 250 × field of view image datasets with different formats are utilized to evaluate the new proposed model’s performance. Sufficient comparison results demonstrate that our method quantitatively outperforms two popular deep fully convolutional networks. Furthermore, we conducted experiments on the third SEM 2500 × field of view image dataset, and the transfer learning results show the potential capability to transfer the knowledge from low-magnification images to high-magnification images. Finally, we use a pre-trained network to predict the pores of SEM images in the whole cross-sectional image and obtain quantitative porosity analysis. Our findings will guide the SEM microscopy data collection efficiently, provide a mechanistic understanding of the U-10Zr fuel system and bridge the gap between advanced characterization to fuel system design.

36 MATERIALS SCIENCE↗

DOE OSTI2023

Modeling dust mineralogical composition: sensitivity to soil mineralogy atlases and their expected climate impacts

Soil dust aerosols are a key component of the climate system, as they interact with short- and long-wave radiation, alter cloud formation processes, affect atmospheric chemistry and play a role in biogeochemical cycles by providing nutrient inputs such as iron and phosphorus. The influence of dust on these processes depends on its physicochemical properties, which, far from being homogeneous, are shaped by its regionally varying mineral composition. The relative amount of minerals in dust depends on the source region and shows a large geographical variability. However, many state-of-the-art Earth system models (ESMs), upon which climate analyses and projections rely, still consider dust mineralogy to be invariant. The explicit representation of minerals in ESMs is more hindered by our limited knowledge of the global soil composition along with the resulting size-resolved airborne mineralogy than by computational constraints. In this work we introduce an explicit mineralogy representation within the state-of-the-art Multiscale Online Nonhydrostatic AtmospheRe CHemistry (MONARCH) model. We review and compare two existing soil mineralogy datasets, which remain a source of uncertainty for dust mineralogy modeling and provide an evaluation of multiannual simulations against available mineralogy observations. Soil mineralogy datasets are based on measurements performed after wet sieving, which breaks the aggregates found in the parent soil. Our model predicts the emitted particle size distribution (PSD) in terms of its constituent minerals based on brittle fragmentation theory (BFT), which reconstructs the emitted mineral aggregates destroyed by wet sieving. Our simulations broadly reproduce the most abundant mineral fractions independently of the soil composition data used. Feldspars and calcite are highly sensitive to the soil mineralogy map, mainly due to the different assumptions made in each soil dataset to extrapolate a handful of soil measurements to arid and semi-arid regions worldwide. For the least abundant or more difficult-to-determine minerals, such as iron oxides, uncertainties in soil mineralogy yield differences in annual mean aerosol mass fractions of up to ~ 100 %. Although BFT restores coarse aggregates including phyllosilicates that usually break during soil analysis, we still identify an overestimation of coarse quartz mass fractions (above 2 µm in diameter). In a dedicated experiment, we estimate the fraction of dust with undetermined composition as given by a soil map, which makes up ~ 10 % of the emitted dust mass at the global scale and can be regionally larger. Changes in the underlying soil mineralogy impact our estimates of climate-relevant variables, particularly affecting the regional variability of the single-scattering albedo at solar wavelengths or the total iron deposited over oceans. All in all, this assessment represents a baseline for future model experiments including new mineralogical maps constrained by high-quality spaceborne hyperspectral measurements, such as those arising from the NASA Earth Surface Mineral Dust Source Investigation (EMIT) mission.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2023

Modeling Dust Mineralogical Composition: Sensitivity to Soil Mineralogy Atlases and Their Expected Climate Impacts

Soil dust aerosols are a key component of the climate system, as they interact with short- and long-wave radiation, alter cloud formation processes, affect atmospheric chemistry and play a role in biogeochemical cycles by providing nutrient inputs such as iron and phosphorus. The influence of dust on these processes depends on its physicochemical properties, which, far from being homogeneous, are shaped by its regionally varying mineral composition. The relative amount of minerals in dust depends on the source region and shows a large geographical variability. However, many state-of-the-art Earth system models (ESMs), upon which climate analyses and projections rely, still consider dust mineralogy to be invariant. The explicit representation of minerals in ESMs is more hindered by our limited knowledge of the global soil composition along with the resulting size-resolved airborne mineralogy than by computational constraints. In this work we introduce an explicit mineralogy representation within the state-of-the-art Multiscale Online Nonhydrostatic AtmospheRe CHemistry (MONARCH) model. We review and compare two existing soil mineralogy datasets, which remain a source of uncertainty for dust mineralogy modeling and provide an evaluation of multiannual simulations against available mineralogy observations. Soil mineralogy datasets are based on measurements performed after wet sieving, which breaks the aggregates found in the parent soil. Our model predicts the emitted particle size distribution (PSD) in terms of its constituent minerals based on brittle fragmentation theory (BFT), which reconstructs the emitted mineral aggregates destroyed by wet sieving. Our simulations broadly reproduce the most abundant mineral fractions independently of the soil composition data used. Feldspars and calcite are highly sensitive to the soil mineralogy map, mainly due to the different assumptions made in each soil dataset to extrapolate a handful of soil measurements to arid and semi-arid regions worldwide. For the least abundant or more difficult-to-determine minerals, such as iron oxides, uncertainties in soil mineralogy yield differences in annual mean aerosol mass fractions of up to ∼ 100 %. Although BFT restores coarse aggregates including phyllosilicates that usually break during soil analysis, we still identify an overestimation of coarse quartz mass fractions (above 2 µm in diameter). In a dedicated experiment, we estimate the fraction of dust with undetermined composition as given by a soil map, which makes up ∼ 10 % of the emitted dust mass at the global scale and can be regionally larger. Changes in the underlying soil mineralogy impact our estimates of climate-relevant variables, particularly affecting the regional variability of the single-scattering albedo at solar wavelengths or the total iron deposited over oceans. All in all, this assessment represents a baseline for future model experiments including new mineralogical maps constrained by high-quality spaceborne hyperspectral measurements, such as those arising from the NASA Earth Surface Mineral Dust Source Investigation (EMIT) mission.

Soil dust↗

DOE OSTI2022

What you get is not always what you see—pitfalls in solar array assessment using overhead imagery

Effective integration planning for small, distributed solar photovoltaic (PV) arrays into electric power grids requires access to high quality data: the location and power capacity of individual solar PV arrays. Unfortunately, national databases of small-scale solar PV do not exist; those that do are limited in their spatial resolution, typically aggregated up to state or national levels. While several promising approaches for solar PV detection have been published, strategies for evaluating the performance of these models are often highly heterogeneous from study to study. The resulting comparison of these methods for practical applications for energy assessments becomes challenging and may imply that the reported performance evaluations overly optimistic. The heterogeneity comes in many forms, each of which we explore in this work: the degree of diversity of the locations and sensors (e.g. different satellites, aerial photography) from which the training and validation data originate, the validation of ground truth (manual annotation of imagery vs known solar PV locations), the level of spatial aggregation (e.g. array-level vs regional estimates), and inconsistencies in the training and validation datasets (e.g. different datasets are used for each study and those data are not always made accessible). For each, we discuss emerging practices from the literature to address them or suggest directions of future research. As part of our investigation, we evaluate solar PV identification performance in two large regions: the entire state of Connecticut and the city of San Diego, CA. In Connecticut, we also use 33,114 known parcel-level solar PV installations from Berkeley Lab’s Tracking the Sun dataset to evaluate parcel-level performance and evaluate capacity estimates using 169 municipalities. We also make our code (which we call SolarMapper), pre-trained models, training data, and predictions publicly available and provide a web portal for interactively inspecting each prediction that was made. Here our findings suggest that traditional performance evaluation of the automated identification of solar PV from satellite imagery may be optimistic due to common limitations in the validation process. The takeaways from this work are intended to inform and catalyze the large-scale practical application of automated solar PV assessment techniques by energy researchers and professionals.

14 SOLAR ENERGY↗

DOE OSTI2025

Dayflow-PR: High-Resolution Streamflow Reanalysis for Puerto Rico, Version 1.0

This dataset presents a high-resolution historical streamflow reanalysis for NHDPlusV2 stream reaches across Puerto Rico (PR) spanning 1950 - 2019. The reanalysis is generated using the calibrated VIC-RAPID hydrologic modeling framework at the Hydrologic Unit Code Sub-basin (HUC08) scale, forced with sub-daily and daily meteorological forcings from Daymet. Runoff is simulated on 1- and 6-km grids, and the resulting total runoff is routed through the NHDPlusV2 river network using the RAPID routing model to produce Naturalized Streamflow Reanalysis. Where complete observational records are available over 1980 - 2019, streamflows are assimilated (substituted) and subsequently routed downstream through the river network to produce Assimilated Streamflow Reanalysis. The dataset includes streamflow outputs from eight distinct hydrologic modeling configurations along with key performanc evaluation metrics at daily and monthly scales, supporting a wide range of water resource applications. This dataset is derived to support the Non-Powered Dam Assessment, as well as 9505 Secure Water Assessment projects for the US Department of Energy (DOE) Water Power Technologies Office (WPTO). For further details, refer to Ghimire et al. (2023), Kao et al. (2024), and Ghimire et al. (2025).

13 HYDRO ENERGY↗

NASA NTRS2022

Microstructure Segmentation With Deep Learning Encoders Pre-Trained on a Large Microscopy Dataset

This study examined the improvement of microscopy segmentation intersection over union accuracy by transfer learning from a large dataset of microscopy images called MicroNet. Many neural network encoder architectures were trained on over 100,000 labeled microscopy images from 54 material classes. These pre-trained encoders were then embedded into multiple segmentation architectures including UNet and DeepLabV3+ to evaluate segmentation performance on created benchmark microscopy datasets. Compared to ImageNet pre-training, models pre-trained on MicroNet generalized better to out-of-distribution micrographs taken under different imaging and sample conditions and were more accurate with less training data. When training with only a single Ni-superalloy image, pre-training on MicroNet produced a 72.2% reduction in relative intersection over union error. These results suggest that transfer learning from large in-domain datasets generate models with learned feature representations that are more useful for downstream tasks and will likely improve any microscopy image analysis technique that can leverage pre-trained encoders.

machine learning↗

DOE OSTI2021

Machine-Learning-based Algorithms for Automated Image Segmentation Techniques of Transmission X-ray Microscopy (TXM)

Four state-of-the-art Deep Learning-based Convolutional Neural Networks (DCNN) were applied to automate the semantic segmentation of a 3D Transmission x-ray Microscopy (TXM) nanotomography image data. The standard U-Net architecture as baseline along with UNet++, PSPNet, and DeepLab v3+ networks were trained to segment the microstructural features of an AA7075 micropillar. A workflow was established to evaluate and compare the DCNN prediction dataset with the manually segmented features using the Intersection of Union (IoU) scores, time of training, confusion matrix, and visual assessment. Comparing all model segmentation accuracy metrics, it was found that using pre-trained models as a backbone along with appropriate training encoder-decoder architecture of the Unet++ can robustly handle large volumes of x-ray radiographic images in a reasonable amount of time. This opens a new window for handling accurate and efficient image segmentation of in situ time-dependent 4D x-ray microscopy experimental datasets.

36 MATERIALS SCIENCE↗

DOE OSTI2022

Evaluation of artificial neural network performance for classification of potato plants infected with potato virus Y using spectral data on multiple varieties and genotypes

Potato virus Y (Potyviridae, PVY) is a plant virus that poses a significant threat to potato producers on a global basis. The pathogen has disrupted seed potato supplies and negatively impacted yield and quality of commercial potato crops. The potato industry currently manages PVY infection levels via insecticide applications, regional seed certification programs that rely on field scouting to visually assess individual plants for infection status, and destructive and costly tissue sampling coupled with laboratory assays. Despite these efforts, PVY continues to confound potato industry stakeholders resulting in economic harm. Remote sensing and machine learning provide for the development of new tools to more accurately detect and spatially quantify PVY-infected plants versus the current state of the art. However, there is a need to understand how the occurrence of many different potato varieties impact the dynamics of developing models to detect potato plants impacted with PVY and their potential effectiveness. This study evaluates classification modelling outcomes using spectral datasets collected in different temporal and spatial environments (greenhouse and a production field) on multiple potato varieties consisting of labelled instances of plants infected with PVY and those not infected with the virus. A modelling framework was developed to support iterative modelling runs using artificial neural network (ANN) architectures configured as binary classifiers to develop sample populations to support statistical analysis on model performance using specific spectral subsets. When using spectral data to detect PVY-infected plants, ANN models achieved the highest mean accuracy of 0.894 on a single variety. Conversely, the same ANN model architecture only achieved a mean accuracy of 0.575 on a spectral data set representing 29 potato breeding lines. Additionally, statistical analysis indicates spectral regions including the red edge, near infrared and shortwave infrared contain more important spectral features for the ANN classifier introduced in this research.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2022

Recurrent neural networks for short-term and long-term prediction of geothermal reservoirs

Accurate prediction of geothermal reservoir responses to alternative energy production scenarios is critical for optimizing the development of the underlying resources. While the conventional physics-based models offer a comprehensive prediction tool, data-driven models provide an efficient alternative to build fit-for-purpose predictive models by extracting and using the statistical patterns in the collected data to make predictions. The recurrent neural network (RNN) is a data-driven model that is commonly applied to predict time series sequences. This paper presents a variant of RNN that also utilizes the efficiency of convolutional neural networks (CNN) for the prediction of energy production from geothermal reservoirs. Specifically, a CNN–RNN architecture is developed that takes historical well controls as input (features) and their corresponding production response data as output (labels) to learn an input-output mapping that can predict the future well production responses/performance for any given future well control inputs. The model is paired with a labeling scheme to handle real field disturbances that create data gaps. In addition to the model structure, we introduce a thorough workflow for applying the model, which includes data pre-processing, feature selection, as well as different training strategies for short-term and long-term prediction. Finally, the performance and accuracy of the model are evaluated by applying it to multiple datasets, including a field reservoir model.

15 GEOTHERMAL ENERGY↗

DOE OSTI2024

Identifying Outliers in AI-based Image Compression

Image compression using artificial intelligence (AI) is becoming increasingly prevalent across various fields, including scientific research. Scientific instruments can generate hundreds of images per second, and effectively compressing these images with high compression ratios is crucial for facilitating scientific discoveries. However, automatically detecting outlier cases, where compression may not have succeeded or where interesting scientific phenomena are present, poses a significant challenge. To address this, we have developed a methodology based on unsupervised machine learning techniques for detecting outlier compressed images. This methodology utilizes metrics such as peak signal-to-noise ratio (PSNR), structural similarity index measure (SSIM), structural texture similarity index measure (STSIM), and deep image and structural texture similarity index (DISTS). We have evaluated our methodology on several unlabeled datasets, including microscopy and x-ray images, and have successfully identified multiple outlier images using our proposed approach. Furthermore, our approach has enabled us to identify image semantics that are valuable for post-experiment analysis by scientists.

Data Analysis↗

DOE OSTI2025

Spatiotemporal Automatic Calibration of Infrastructure Lidar, Radar, and Camera with a Global Navigation Satellite System

Robust and accurate perception is important for modern intelligent transportation systems (ITS), which use sensors of various modalities for data fusion to create a digital twin of an intersection. Sensor calibration is an important process that creates a unified coordinate frame for the sensor output data so that it can be used for data fusion. Classical approaches for sensor calibration are time-consuming, require an overlapping field of view for feature matching, and are not feasible for ITS application as they cause disruptions in the flow of traffic. In this paper, we present a spatiotemporal automatic calibration approach to calibrate multiple infrastructure lidar, radar, and cameras installed at a traffic intersection. The approach uses global navigation satellite system (GNSS) positioning information shared by connected vehicles, and when the vehicle is detected by the sensor, we match the sensor detections with the GNSS coordinates. The proposed algorithm is evaluated with a real-world dataset utilizing detections from two radars, cameras, and lidars with a test vehicle instrumented with a post-processing kinematic (PPK)-corrected GNSS driving past the sensors installed at a four-way traffic intersection. The experimental results show that the proposed automatic calibration approach can achieve the transformation with a root mean squared error of less than 0.5 for radar and lidar and less than 2 for camera detections. The ability to rapidly calibrate sensors not only benefits initial installations, but can also be used for system health monitoring, while utilizing available connected vehicle data to test the real-time sensor fidelity and operational status.

ADVANCED PROPULSION SYSTEMS,ENERGY CONSERVATION, C↗

DOE OSTI2024

Error-controlled Progressive Retrieval of Scientific Data under Derivable Quantities of Interest

The unprecedented amount of scientific data has introduced heavy pressure on the current data storage and transmission systems. Progressive compression has been proposed to mitigate this problem, which offers data access with on-demand precision. However, existing approaches only consider precision control on primary data, leaving uncertainties on the quantities of interest (QoIs) derived from it. In this work, we present a progressive data retrieval framework with guaranteed error control on derivable QoIs. Our contributions are three-fold. (1) We carefully derive the theories to strictly control QoI errors during progressive retrieval. Our theory is generic and can be applied to any QoIs that can be composited by the basis of derivable QoIs proved in the paper. (2) We design and develop a generic progressive retrieval framework based on the proposed theories, and optimize it by exploring feasible progressive representations. (3) We evaluate our framework using five real-world datasets with a diverse set of QoIs. Experiments demonstrate that our framework can faithfully respect any user-specified QoI error bounds in the evaluated applications. This leads to over 2.02× performance gain in data transfer tasks compared to transferring the primary data while guaranteeing a QoI error that is less than 1E-5.

Wu, Xuan↗

DOE OSTI2021

Deep Cellular Recurrent Network for Efficient Analysis of Time-Series Data With Spatial Information

Efficient processing of large-scale time series data is an intricate problem in machine learning. Conventional sensor signal processing pipelines with hand engineered feature extraction often involve huge computational cost with high dimensional data. Deep recurrent neural networks have shown promise in automated feature learning for improved time-series processing. However, generic deep recurrent models grow in scale and depth with increased complexity of the data. This is particularly challenging in presence of high dimensional data with temporal and spatial characteristics. Consequently, this work proposes a novel deep cellular recurrent neural network (DCRNN) architecture to efficiently process complex multi-dimensional time series data with spatial information. Here, the cellular recurrent architecture in the proposed model allows for location-aware synchronous processing of time series data from spatially distributed sensor signal sources. Extensive trainable parameter sharing due to cellularity in the proposed architecture ensures efficiency in the use of recurrent processing units with high-dimensional inputs. This study also investigates the versatility of the proposed DCRNN model for classification of multi-class time series data from different application domains. Consequently, the proposed DCRNN architecture is evaluated using two time-series datasets: a multichannel scalp EEG dataset for seizure detection, and a machine fault detection dataset obtained in-house. The results suggest that the proposed architecture achieves state-of-the-art performance while utilizing substantially less trainable parameters when compared to comparable methods in the literature.

60 APPLIED LIFE SCIENCES↗