Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation datasets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

Advancing Tassel Detection and Counting: Annotation and Algorithms

Tassel counts provide valuable information related to flowering and yield prediction in maize, but are expensive and time-consuming to acquire via traditional manual approaches. High-resolution RGB imagery acquired by unmanned aerial vehicles (UAVs), coupled with advanced machine learning approaches, including deep learning (DL), provides a new capability for monitoring flowering. In this article, three state-of-the-art DL techniques, CenterNet based on point annotation, task-aware spatial disentanglement (TSD), and detecting objects with recursive feature pyramids and switchable atrous convolution (DetectoRS) based on bounding box annotation, are modified to improve their performance for this application and evaluated for tassel detection relative to Tasselnetv2+. The dataset for the experiments is comprised of RGB images of maize tassels from plant breeding experiments, which vary in size, complexity, and overlap. Results show that the point annotations are more accurate and simpler to acquire than the bounding boxes, and bounding box-based approaches are more sensitive to the size of the bounding boxes and background than point-based approaches. Overall, CenterNet has high accuracy in comparison to the other techniques, but DetectoRS can better detect early-stage tassels. The results for these experiments were more robust than Tasselnetv2+, which is sensitive to the number of tassels in the image.

54 ENVIRONMENTAL SCIENCES↗

Dataset, Code, and Models for Training Deep Learning Potentials for Low Temperature Plasma-Surface Interactions

This repository contains datasets, training scripts, and finished models, and test simulations used in the development of DeepREBO— a machine-learned interatomic potential trained to emulate the REBO2 empirical potential. The data was generated to study deep potential development for simulations of plasma-surface interactions. It uses an active learning framework, starting from a minimal dataset and iteratively expanding it. Included are those generated datasets, the trained models, and simulations used to evaluate the performance of the training process. This resource supports reproducibility and provides a reference framework for training deep potentials in plasma-surface interaction studies.

active learning↗

Variability of Surface Temperature and Melt on the Greenland Ice Sheet, 2000-2011

Enhanced melting along with surface-temperature increases measured using infrared satellite data, have been documented for the Greenland Ice Sheet. Recently we developed a climate-quality data record of ice-surface temperature (IST) of the Greenland Ice Sheet using the Moderate-Resolution Imaging Spectroradiometer (MODIS) 1ST product -- http://modis-snow-ice.gsfc.nasa.gov. Using daily and mean monthly MODIS 1ST maps from the data record we show maximum extent of melt for the ice sheet and its six major drainage basins for a 12-year period extending from March of 2000 through December of 2011. The duration of the melt season on the ice sheet varies in different drainage basins with some basins melting progressively earlier over the study period. Some (but not all) of the basins also show a progressively-longer duration of melt. The short time of the study period (approximately 12 years) precludes an evaluation of statistically-significant trends. However the dataset provides valuable information on natural variability of IST, and on the ability of the MODIS instrument to capture changes in IST and melt conditions indifferent drainage basins of the ice sheet.

Hall, Dorothy K.↗

Global and Regional Evaluation of Over-Land Spectral Aerosol Optical Depth Retrievals from SeaWiFS

This study evaluates a new spectral aerosol optical depth (AOD) dataset derived from Sea-viewing Wide Field-of-view Sensor (Sea WiFS) measurements over land. First, the data are validated against Aerosol Robotic Network (AERONET) direct-sun AOD measurements, and found to compare well on a global basis. If only data with the highest quality flag are used, the correlation is 0.86 and 72% of matchups fall within an expected absolute uncertainty of 0.05 + 20% (for the wavelength of 550 nm). The quality is similar at other wavelengths and stable over the 13-year (1997-2010) mission length. Performance tends to be better over vegetated, low-lying terrain with typical AOD of 0.3 or less, such as found over much of North America and Eurasia. Performance tends to be poorer for low-AOD conditions near backscattering geometries, where Sea WiFS overestimates AOD, or optically-thick cases of absorbing aerosol, where SeaWiFS tends to underestimate AOD. Second, the SeaWiFS data are compared with midvisible AOD derived from the Moderate Resolution Imaging Spectrometer (MODIS) and Multiangle Imaging Spectroradiometer (MISR). All instruments show similar spatial and seasonal distributions of AOD, although there are regional and seasonal offsets between them. At locations where AERONET data are available, these offsets are largely consistent with the known validation characteristics of each dataset. With the results of this study in mind, the SeaWiFS over-land AOD record should be suitable for quantitative scientific use.

Sayer, A. M.↗

Surface Temperature and Melt on the Greenland Ice Sheet, 2000 - 2011

Enhanced melting along with surface-temperature increases measured using infrared satellite data, have been documented for the Greenland Ice Sheet. Recently we developed a climate-quality data record of ice-surface temperature (IST) of the Greenland Ice Sheet using the Moderate-Resolution Imaging Spectroradiometer (MODIS) IST product -- http://modis-snow-ice.gsfc.nasa.gov.Using daily and mean-monthly MODIS IST maps from the data record we show maximum extent of melt for the ice sheet and its six major drainage basins for a 12-year period extending from March of 2000 through December of 2011. The duration of the melt season on the ice sheet varies in different drainage basins with some basins melting progressively earlier over the study period. Some (but not all) of the basins also show a progressively-longer duration of melt. The short time of the study period (approx 12 years) precludes an evaluation of statistically-significant trends. However the dataset provides valuable information on natural variability of IST, and on the ability of the MODIS instrument to capture changes in IST and melt conditions in different drainage basins of the ice sheet.

Hall, Dorothy K.↗

The Description and Validation of a Computationally-Efficient CH4-CO-OH (ECCOH) Module for 3D Model Applications

We present the Efficient CH4-CO-OH Module (ECCOH) that allows for the simulation of the methane, carbon monoxide and hydroxyl radical (CH4-CO-OH cycle, within a chemistry climate model, carbon cycle model, or earth system model. The computational efficiency of the module allows many multi-decadal, sensitivity simulations of the CH4-CO-OH cycle, which primarily determines the global tropospheric oxidizing capacity. This capability is important for capturing the nonlinear feedbacks of the CH4-CO-OH system and understanding the perturbations to relatively long-lived methane and the concomitant impacts on climate. We implemented the ECCOH module into the NASA GEOS-5 Atmospheric Global Circulation Model (AGCM), performed multiple sensitivity simulations of the CH4-CO-OH system over two decades, and evaluated the model output with surface and satellite datasets of methane and CO. The favorable comparison of output from the ECCOH module (as configured in the GEOS-5 AGCM) with observations demonstrates the fidelity of the module for use in scientific research.

Remote Sensing↗

Oxygen Depletion on the Surface of Mercury: Evidence of Silicon Smelting?

The MErcury Surface, Space ENvironment, GEochemistry, and Ranging (MESSENGER) spacecraft collected data that provided important insights into the structure, chemical makeup, and compositional diversity of Mercury. The X-Ray Spectrometer (XRS) and Gamma-Ray Spectrometer (GRS) onboard MESSENGER provided the first detailed chemical analyses of Mercury's surface. Among the many discoveries included several surprising characteristics about the surface of Mercury, including elevated S abundances (up to 4 percent by weight), low Fe abundances (less than 4 percent by weight), and relatively low O abundances (O/Si ratio of 1.40 plus or minus 0.03). The surface chemistry as determined by MESSENGER has been used to identify up to nine distinct geochemical terranes on Mercury. Numerous modeling and experimental efforts have been undertaken to infer the mineralogy and petrology of mercurian lavas and surface materials. However, all of these efforts have presumed valence states for each of the elements according to the following: Si4+, Ti4+, Al3+, Cr2+, Fe2+, Mn2+, Mg2+, Ca2+, Na+, K+, S2-, Cl-. Based on these valence assignments, cations are charged balanced with the anions O2-, S2-, and Cl- and the compositions are recast in terms of oxides, sulfides, and chlorides. Based on these assumptions, the geochemical terranes that have been identified on Mercury yield O/Si wt. ratios ranging from 1.61 to 1.84, which is substantially higher than the preliminary O/Si ratio of 1.40 plus or minus 0.03 determined by the MESSENGER GRS]. We have re-evaluated the O/Si ratio using the entire MESSENGER dataset to reassess its implications for the geochemistry of Mercury.

McCubbin, F. M.↗

Assessment of Two Stochastic Cloud Subcolumn Generators Using Observed Fields of Vertically Resolved Cloud Extinction

We evaluate two stochastic subcolumn generators used in GCMs to emulate subgrid cloud variability enabling comparisons with satellite observations and simulations of certain physical processes. Our evaluation necessitated the creation of a reference observational dataset that resolves horizontal and vertical cloud variability. The dataset combines two CloudSat cloud products that resolve two-dimensional cloud optical depth variability of liquid, ice, and mixed phase clouds when blended at ~200 m vertical and ~ 2 km horizontal scales. Upon segmenting the dataset to individual “scenes”, mean profiles of the cloud fields are passed as input to generators that produce scene-level cloud subgrid variability. The assessment of generator performance at the scale of individual scenes and in a mean sense is largely based on inferred joint histograms that partition cloud fraction within predetermined combinations of cloud top pressure –cloud optical thickness ranges. Our main finding is that both generators tend to underestimate optically thin clouds, while one of them also tends to overestimate some cloud types of moderate and high optical thickness. Associated radiative flux errors are also calculated by applying a simple transformation to the cloud fraction histogram errors, and are found to approach values almost as high as 3 Wm-2 for the cloud radiative effect in the shortwave part of the spectrum.

cloud variability↗

Assessment of Extremes in Global Precipitation Products: How Reliable Are They?

Global gridded precipitation products have proven essential for many applications ranging from hydrological modeling and climate model validation to natural hazard risk assessment. They provide a global picture of how precipitation varies across time and space, specifically in regions where ground-based observations are scarce. While the application of global precipitation products has become widespread, there is limited knowledge on how well these products represent the magnitude and frequency of extreme precipitation—the key features in triggering flood hazards. Here, five global precipitation datasets (MSWEP, CFSR, CPC, PERSIANN-CDR, and WFDEI) are compared to each other and to surface observations. The spatial variability of relatively high precipitation events (tail heaviness) and the resulting discrepancy among datasets in the predicted precipitation return levels were evaluated for the time period 1979–2017. The analysis shows that 1) these products do not provide a consistent representation of the behavior of extremes as quantified by the tail heaviness, 2) there is strong spatial variability in the tail index, 3) the spatial patterns of the tail heaviness generally match the Köppen–Geiger climate classification, and 4) the predicted return levels for 100 and 1000 years differ significantly among the gridded products. More generally, our findings reveal shortcomings of global precipitation products in representing extremes and highlight that there is no single global product that performs best for all regions and climates.

Risk assessment↗

Laser Beam Welding Benchmark Experiments Performed in Reduced Gravity and Vacuum

Laser beam welding (LBW) is affected by the extreme temperatures, reduced pressure, and reduced gravity present in space environments. Gravity and pressure especially influence its melt pool and solidification dynamics. A compact, modular vacuum chamber adaptable to flight platforms from parabolic to orbital currently hosts an experiment to investigate the combined influence of reduced gravity and pressure on LBW. A swappable cartridge contains a rotating platen on which customizable workpieces can be welded under vacuum, greatly increasing experimental throughput. Instrumentation includes weld and thermal cameras observing the process, thermocouples placed on workpieces, accelerometers, and vacuum sensors. Experimental data gathered during the welding process will be combined with post-flight nondestructive evaluation, metallography, and mechanical testing to provide validation datasets for computational modeling. Phase I of this effort involves a parabolic flight campaign in low gravity while an anticipated Phase II would proceed to in-space demonstration to access extended duration microgravity.

in-space welding↗

CANShield: Signal-based Intrusion Detection for Controller Area Networks

Modern vehicles rely on complex cyber-physical systems made up of hundreds of electronic control units (ECUs) connected through controller area network (CAN) buses. However, the CAN bus attack surface is increasing due to advanced features in automobiles, making it prone to injection attacks. The ordinary injection attacks disrupt the typical timing properties of the CAN data stream, and the rule-based intrusion detection systems (IDS) can easily detect them. However, advanced attackers can inject false data to the signal level, maintaining the regular pattern/frequency of the CAN messages. Such attacks can bypass the rule-based IDS or any anomaly-based IDS built on binary payload data. To make the vehicles robust against such intelligent attacks, we propose CANShield, a signal-based intrusion detection framework for the CAN bus that consists of three modules. A data preprocessing module handles the high-dimensional CAN data stream at the signal level and make them suitable for any machine learning model. A data analyzer module consists of multiple deep autoencoder networks, each analyzing the time series data from a different perspective. Finally, an attack detection module uses an ensemble method to make the final decision. Evaluation results on a standard signal-based dataset show the effectiveness of the CANShield in detecting five advanced attacks.

Shahriar, Md Hasan↗

Spatio-Temporal Denoising Graph Autoencoders with Data Augmentation for Missing Photovoltaic Data Imputation

The integration of the global Photovoltaic (PV) market with real time data-loggers has enabled large scale PV data analytical pipelines for power forecasting and long-term reliability assessment of PV fleets. Nevertheless, the performance of PV data analysis heavily depends on the quality of PV timeseries data. This paper proposes a novel Spatio-Temporal Denoising Graph Autoencoder (STD-GAE) framework to impute missing PV Power Data. STDGAE exploits temporal correlation, spatial coherence, and value dependencies from domain knowledge to recover missing data. It is empowered by two modules. (1) To cope with sparse yet various scenarios of missing data, STD-GAE incorporates a domain-knowledge aware data augmentation module that creates plausible variations of missing data patterns. This generalizes STD-GAE to robust imputation over different seasons and environment. (2) STD-GAE nontrivially integrates spatiotemporal graph convolution layers (to recover local missing data by observed “neighboring” PV plants) and denoising autoencoder (to recover corrupted data from augmented counterpart) to improve the accuracy of imputation accuracy at PV fleet level. We have evaluated our proposed model on two realworld PV datasets. Experimental results show that STD-GAE can achieve a gain of 43.14% in imputation accuracy and remains less sensitive to missing rate, different seasons, and missing scenarios, compared with state-of-the-art data imputation methods such as MIDA and LRTC-TNN.

Fan, Yangxin↗

Evaluating the Impact of Proprietary Oil & Gas Data on Machine Learning Model Performance Using a Quasi-Experimental Analytical Approach

This study implements a data-intensive supervised ML approach through a quasi-experimental framework with the objective of quantifying the impact of oil and gas operator-specific proprietary data on ML-based predictive model performance relative to using oil and gas datasets that may be more commonly publicly available. The models are designed to jointly predict daily oil, gas, and water production for horizontal wells as a function of bottom-hole pressure drawdown, spatial placement across the study domain, and well completion attributes. Model performance is quantified on holdout test data to evaluate how each dataset affects resulting model variant performance.

02 PETROLEUM↗

Dayflow: CONUS Daily Streamflow Reanalysis, Version 1 (V1)

Dayflow V1 is a historical streamflow reanalysis dataset reconstructed for a 36-year period (1980-2015). The dataset provides both daily and monthly scale streamflow information at about 2.7 million NHDPlusV2 stream reaches in the conterminous US (CONUS). Dayflow is the result of a nationally scalable modeling framework that integrates the simulated runoff from the Variable Infiltration Capacity (VIC) model with the Routing Application for Parallel computatIon of Discharge (RAPID) routing model. Two types of streamflow products, simulated streamflow with or without assimilation of historic US Geological Survey (USGS) streamflow observations, are provided in Dayflow V1. A comprehensive evaluation at 7,526 USGS National Water Information System (NWIS) gauges is performed for both types of streamflow products. The resulting key evaluation metrics are also included in the Dayflow V1 Dataset.

13 HYDRO ENERGY↗

Homomorphic Encryption for Machine Learning and Artificial Intelligence Applications

Third-party and expert analysis is a cost-effective solution for solving specialized problems or processing large datasets related to reactor structural health monitoring and nondestructive evaluation. However, when handling proprietary information, third-party and expert analysts pose a privacy risk. To address this challenge, Homomorphic Encryption (HE) permits arithmetic operations on encrypted data without exposing the underlying data. Implementations of Machine Learning (ML) and Artificial Intelligence (AI) algorithms using HE greatly enhances the capabilities of third-party analysts while maintaining a low security risk. This paper details current success in applying Principal Component Analysis (PCA) and Fully Connected Neural Networks (NN) using the Microsoft SEAL implementation of the popular CKKS Fully Homomorphic Encryption (FHE) algorithm. The MNIST Handwritten Dataset is analyzed as a proof-of-concept demonstration of the implementations.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Synthesis of ARM User Facility Surface Rainfall Datasets to Construct a Best Estimate Value Added Product (PrecipBE)

Surface precipitation measurements are essential for Earth system model (ESM) evaluation and understanding cloud processes. An ever-growing need for robust, temporally evolving, and easy-to-use statistical datasets provides motivation for a baseline ground-based precipitation properties data product. The U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility operates an extensive suite of precipitation instruments with various sensitivities and operating mechanisms, which render the decision of which instrument to use based on one or more fixed thresholds challenging and prone to errors and bias. Using a long-term instrument inter-comparison from a unique per-precipitation event perspective, rather than instantaneous sample comparison, we demonstrate that ARM rainfall-measuring instruments are generally consistent with each other at the statistical level. Inter-instrument deviations at the single event level can be large, especially for specific rainfall event properties such as maximum precipitation rates. A machine-learning (ML) analysis using a random forest regressor indicates that in some cases, depending on instrument, local site climatology, and/or specific deployment configuration, certain atmospheric state variables influence the measured quantities in an unpredictable manner. Thus, a-priori weighting of different instruments does not necessarily lead to more accurate and less biased synthesis of instrument data. These results motivate the design of the ARM precipitation best-estimate (PrecipBE) value-added product, which incorporates all valid precipitation data while considering data quality and other instrument limitations. PrecipBE consists of time series and tabular statistics datasets in an easy-to-use and insightful per-precipitation event format. It provides a large set of precipitation event properties supplemented with ancillary data from ARM datasets that correspond to the detected precipitation events. We describe the PrecipBE algorithm and demonstrate its use via the examination of a single-day output as well as a long-term trend analysis of precipitation events at the ARM Southern Great Plains (SGP) site, covering more than 30 years of data. The trend analysis tentatively suggests a long-term temporal tendency for mainly shorter and less intense precipitation events at the SGP site, but a long-term increase in annual rainfall by more than 36 mm (5 %) per decade. This rainfall trend is catalyzed primarily by more extreme event properties of relatively rare, intense precipitation events, with event total and 1 min maximum precipitation rate at a 1 year timeframe increasing up to 5 mm and 9 mm h −1 (several percent) per decade, respectively. While the currently available PrecipBE datasets (at https://adc.arm.gov/discovery/, last access: 8 December 2025) cover rainfall from multiple ARM deployments up to March 2025, PrecipBE is planned to be expanded to include solid-phase precipitation and will soon become an operational product with a several-day lag from real-time. We invite the ARM user community to leverage this new product and welcome user feedback to further enhance the dataset.

Silber, Israel [Pacific Northwest National Laborat↗

Machine Learning 5G Attack Detection in Programmable Logic

Machine learning-assisted network security may significantly contribute to securing 5G components. However, machine learning network security inference speeds generally require tens to hundreds of milliseconds thereby introducing significant latency in 5G operations. The inference latency can be reduced by deploying the machine learning model to programmable logic in a field programmable gate array (FPGA) at the cost of a small loss in accuracy. In order to quantify this loss, as well as to establish baseline performance inference speeds for programmable logic implementations, this work explores an autoencoder and a ß-variational autoencoder deployed on two different FPGA evaluation boards and compares accuracy and performance against an NVIDIA A100 GPU implementation. A publicly available 5G dataset containing 10 types of attacks along with normal traffic is introduced as part of the evaluation.

97 MATHEMATICS AND COMPUTING↗

Harnessing Big Data to Support the Conservation and Rehabilitation of Mangrove Forests Globally

Mangrove forests are found on sheltered coastlines in tropical, subtropical, and some warm temperate regions. These forests support unique biodiversity and provide a range of benefits to coastal communities, but as a result of large-scale conversion for aquaculture, agriculture, and urbanization, mangroves are considered increasingly threatened ecosystems. Scientific advances have led to accurate and comprehensive global datasets on mangrove extent, structure, and condition, and these can support evaluation of ecosystem services and stimulate greater conservation and rehabilitation efforts. To increase the utility and uptake of these products, in this Perspective we provide an overview of these recent and forthcoming global datasets and explore the challenges of translating these new analyses into policy action and on-the-ground conservation. We describe a new platform for visualizing and disseminating these datasets to the global science community, non-governmental organizations, government officials, and rehabilitation practitioners and highlight future directions and collaborations to increase the uptake and impact of large-scale mangrove research.

mangrove↗