Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation datasets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 991 records · Page 55
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Machine Learning-based Intrusion Detection for Smart Grid Computing: A Survey

Machine learning (ML)-based intrusion detection system (IDS) approaches have been significantly applied and advanced the state-of-the-art system security and defense mechanisms. In smart grid computing environments, security threats have been significantly increased as shared networks are commonly used, along with the associated vulnerabilities. However, compared to other network environments, ML-based IDS research in a smart grid is relatively unexplored, although the smart grid environment is facing serious security threats due to its unique environmental vulnerabilities. In this article, we conducted an extensive survey on ML-based IDS in smart grids based on the following key aspects: (1) The applications of the ML-based IDS in transmission and distribution side power components of a smart power grid by addressing its security vulnerabilities; (2) dataset generation process and its usage in applying ML-based IDSs in the smart grid; (3) a wide range of ML-based IDSs used by the surveyed papers in the smart grid environment; (4) metrics, complexity analysis, and evaluation testbeds of the IDSs applied in the smart grid; and (5) lessons learned, insights, and future research directions.

SCADA↗
DOE OSTI2024

Code Description for "Brief Communication: Monitoring snow depth using small, cheap, and easy-to-deploy ground surface temperature sensors"

Temporally continuous snow depth estimates are vital for understanding changing snow patterns and impacts on permafrost in the Arctic. We train a random forest machine learning model to predict snow depth from variability in ground surface temperature. To our knowledge, this is the first time that small ground surface temperature sensors have been used to estimate snow depth. The model performs well at sites where the model was trained and at pan-arctic evaluation sites (RMSE <= 0.15 m). Small temperature sensors are cheap and easy-to-deploy, so this technique enables spatially distributed and temporally continuous snowpack monitoring to an extent previously infeasible. The model is flexible and can be applied to datasets retroactively to retrieve snow depth estimates at additional sites. This code package includes a *.joblib file of the trained random forest model and a *.ipynb file showing how to clean input data, train the random forest model, and apply the model.

Bachand, Claire↗
DOE OSTI2024

Rapid measurement of soluble xylo-oligomers using near-infrared spectroscopy (NIRS) and multivariate statistics: calibration model development and practical approaches to model optimization

Rapid monitoring of biomass conversion processes using techniques such as near-infrared (NIR) spectroscopy can be substantially quicker and less labor-, resource-, and energy-intensive than conventional measurement techniques such as gas or liquid chromatography (GC or LC) due to the lack of solvents and preparation methods, as well as removing the need to transfer samples to an external lab for analytical evaluation. The purpose of this study was to determine the feasibility of rapid monitoring of a biomass conversion process using NIR spectroscopy combined with multivariate statistical modeling, and to examine the impact of (1) subsetting the samples in the original dataset by process location and (2) reducing the spectral range used in the calibration model on model performance. We develop multivariate calibration models for the concentrations of soluble xylo-oligosaccharides (XOS), monomeric xylose, and total solids at multiple points in a biomass conversion process which produces and then purifies XOS compounds from sugar cane bagasse. A single model using samples from multiple locations in the process stream showed acceptable performance as measured by standard statistical measures. However, compared to the single model, we show that separate models built by segregating the calibration samples according to process location show improved performance. We also show that combining an understanding of the sample spectra with simple multivariate analysis tools can result in a calibration model with a substantially smaller spectral range that provides essentially equal performance to the full-range model. We demonstrate that real-time monitoring of soluble xylo-oligosaccharides (XOS), monomeric xylose, and total solids concentration at multiple points in a process stream using NIR spectroscopy coupled with multivariate statistics is feasible. Segregation of sample populations by process location improves model performance. Models using a reduced spectral range containing the most relevant spectral signatures show very similar performance to the full-range model, reinforcing the importance of performing robust exploratory data analysis before beginning multivariate modeling.

09 BIOMASS FUELS↗
DOE OSTI2022

Building Model Calibration: Validation of GridLAB-D Thermal Dynamics Modeling

This report investigates how well GridLAB-D’s house model characterizes the thermal dynamics of buildings given the overpredicted diurnal electric load swing observed in the Distribution System Operation with Transactive (DSO+T) study. This study seeks to validate GridLAB-D’s house model by calibrating it to data from the well-instrumented Pacific Northwest National Laboratory Lab Homes in Richland, WA. The datasets chosen included multiple pre-cooling and pre-heating testing periods where the indoor air temperature was allowed to float over a multi-hour length of time to mimic diurnal behavior. The multi-season calibrations were evaluated by comparing the heating/cooling electric power, indoor air temperature, and the rise/decay time during temperature float periods with Lab Homes data. The default GridLAB-D assumptions for latent load fraction, air heat capacity, mass heat capacity, window-to-wall-ratio, overall envelope conductance (assumed as NORMAL thermal integrity level), and solar heat gain coefficient were compared with the calibrated model to confirm when the default assumptions were adequate and the impact of calibration on the accuracy of modeling the thermal dynamics of homes.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

WFIP3

The Wind Forecasting Improvement Project 3 (WFIP-3) is the first offshore-based wind resource characterization project within the WFIP construct, funded by the U.S. Department of Energy. WFIP-3 will provide a unique field study that will deliver the comprehensive suite of data needed to inform a series of modeling efforts that will develop and evaluate parameterization schemes suited to offshore environments and improved industry-targeted applications. The field study has two goals: (1) detailed sampling of the vertical structure of the Marine Atmospheric Boundary Layer (MABL) at key observational areas, creating a rich dataset that will be used to refine and validate parameterization schemes, and (2) wide-area sampling of the MABL to create a multi-scale array of observations informing and guiding models of resource characterization. We will deploy a multi-platform array of measurements that span the MABL and create a multi-scale observational array stretching south from Marth’s Vineyard across the wind energy areas.

17 WIND ENERGY↗
DOE OSTI2020

A Tool for Furthering GNSS Security Research: The Oak Ridge Spoofing and Interference Test Battery (OAKBAT)

A new global navigation satellite system (GNSS) dataset of digitized RF signals named Oak Ridge Spoofing and Interference Test Battery (OAKBAT) has been created. OAKBAT contains digitized spoofing signals that serve as both a supporting “sibling” and an advancement to the widely used Texas Spoofing Test Battery (TEXBAT) dataset [1]. OAKBAT at its core was developed to 1) allow for 100% reproducibility of the data, 2) provided more detailed metadata and contextual information about each dataset such as the precise moment that the spoofing and/or interference signals begins, positions used, constellations visible, etc., and 3) to provide datasets generated using the same key parameters as the TEXBAT ds1 through ds6 datasets. Through these “sibling” datasets it will now be possible to determine if the behavior of algorithms and designs developed using these datasets are being affected by possible intrinsic behavior and properties of the equipment used in the generation and digitization of the two datasets. The end goal of OAKBAT is to be a new resource for the community of researchers and developers working in the field of GNSS. This additional source of data provides a GNSS “playground” on which to experiment, explore, and evaluate new ideas.

Albright, Austin P.↗
DOE OSTI2021

Robust implementation of generative modeling with parametrized quantum circuits

Although the performance of hybrid quantum-classical algorithms is highly dependent on the selection of the classical optimizer and the circuit ansätze, a robust and thorough assessment on-hardware of such features has been missing to date. From the optimizer perspective, the primary challenge lies in the solver’s stochastic nature, and their significant variance over the random initialization. Therefore, a robust comparison requires one to perform several training curves for each solver before one can reach conclusions about their typical performance. Since each of the training curves requires the execution of thousands of quantum circuits in the quantum computer, such a robust study remained a steep challenge for most hybrid platforms available today. In this work, we leverage on Rigetti’s Quantum Cloud Services (QCS™) to overcome this implementation barrier, and we study the on-hardware performance of the data-driven quantum circuit learning (DDQCL) for three different state-of-the-art classical solvers, and on two-different circuit ansätze associated to different entangling connectivity graphs for the same task. Additionally, we assess the gains in performance from varying circuit depths. To evaluate the typical performance associated with each of these settings in this benchmark study, we use at least five independent runs of DDQCL towards the generation of quantum generative models capable of capturing the patterns of the canonical Bars and Stripes dataset. In this experimental benchmarking, the gradient-free optimization algorithms show an outstanding performance compared to the gradient-based solver. In particular, one of them had better performance when handling the unavoidable noisy objective function to be minimized under experimental conditions.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Array-Based Machine Learning for Functional Group Detection in Electron Ionization Mass Spectrometry

Mass spectrometry is a ubiquitous technique capable of complex chemical analysis. The fragmentation patterns that appear in mass spectrometry are an excellent target for artificial intelligence methods to automate and expedite the analysis of data to identify targets such as functional groups. To develop this approach, we trained models on electron ionization (a reproducible hard fragmentation technique) mass spectra so that not only the final model accuracies but also the reasoning behind model assignments could be evaluated. The convolutional neural network (CNN) models were trained on 2D images of the spectra using transfer learning of Inception V3, and the logistic regression models were trained using array-based data and Scikit Learn implementation in Python. Our training dataset consisted of 21,166 mass spectra from the United States’ National Institute of Standards and Technology (NIST) Webbook. The data was used to train models to identify functional groups, both specific (e.g., amines, esters) and generalized classifications (aromatics, oxygen-containing functional groups, and nitrogen-containing functional groups). We found that the highest final accuracies on identifying new data were observed using logistic regression rather than transfer learning on CNN models. It was also determined that the mass range most beneficial for functional group analysis is 0–100 m/z. We also found success in correctly identifying functional groups of example molecules selected from both the NIST database and experimental data. Beyond functional group analysis, we also have developed a methodology to identify impactful fragments for the accurate detection of the models’ targets. The results demonstrate a potential pathway for analyzing and screening substantial amounts of mass spectral data.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Training data selection for accuracy and transferability of interatomic potentials

Abstract Advances in machine learning (ML) have enabled the development of interatomic potentials that promise the accuracy of first principles methods and the low-cost, parallel efficiency of empirical potentials. However, ML-based potentials struggle to achieve transferability, i.e., provide consistent accuracy across configurations that differ from those used during training. In order to realize the promise of ML-based potentials, systematic and scalable approaches to generate diverse training sets need to be developed. This work creates a diverse training set for tungsten in an automated manner using an entropy optimization approach. Subsequently, multiple polynomial and neural network potentials are trained on the entropy-optimized dataset. A corresponding set of potentials are trained on an expert-curated dataset for tungsten for comparison. The models trained to the entropy-optimized data exhibited superior transferability compared to the expert-curated models. Furthermore, the models trained to the expert-curated set exhibited a significant decrease in performance when evaluated on out-of-sample configurations.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Data Files for Runoff Evaluation in an Earth System Land Model for Permafrost Regions

Modeling of hydrological runoff is essential for accurately capturing spatiotemporal feedbacks within the land–atmosphere system, particularly in sensitive regions such as permafrost landscapes. However, substantial uncertainties persist in the terrestrial runoff parameterization schemes used in Earth system and land surface models. This is particularly true in permafrost regions, where landscape heterogeneity is high and reliable observational data are scarce.This data set includes all files that were produced and applied in the paper Runoff Evaluation in an Earth System Land Model for Permafrost Regions [Xiang et al. in review]. The paper is in review as of July 1 2025 in Geoscientific Model Development (GMD). In this study, we evaluate the performance of runoff parameterization schemes in the Energy Exascale Earth System Model (E3SM) land model (ELM). Our proposed framework leverages simulation results from the Advanced Terrestrial Simulator (ATS), which is a physics-rich integrated surface/subsurface hydrologic model that has been successfully evaluated previously in Arctic tundra regions. We used ATS to simulate runoff from 22 representative hillslopes in the Sagavanirktok River basin, located on the North Slope of Alaska, then compared the output with ELM’s parameterized representation of total runoff. This dataset contains 2 figure image files (*.png, *jpg) that describe the study site and methods, as well as folders (Figure*.zip) that contain the associated data files (*.csv, *.dat) and python code notebooks (*.ipynb) for figures 3-7 in the paper. Jupyter notebook (*.ipynb) files that produce the figure files using the associated data files will run within a python environment configured with Jupyter Lab or Notebook packages.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Redox potential in Typha-dominated tidal brackish marsh, PIE LTER, Plum Island Sound, MA, June–December 2022

This dataset includes soil redox potential measurements collected at multiple depths within a tidal brackish wetland in the upper estuary of the Plum Island Ecosystems Long-Term Ecological Research site (PIE LTER), Plum Island Sound, Newbury, Massachusetts. Measurements were taken to evaluate temporal variation in redox potential in relation to hydrological events at three replicate locations. Data were recorded every 5 minutes using a Campbell Scientific Volt116 connected to a CR6 datalogger with SWAP instrument redox probes (ORP-30-4-B) and reference electrodes. Measurements were made at the AmeriFlux site US-PLo at four soil depths (5, 10, 15, and 30 cm). The file redox_soiltemp_2022.csv contains temperature-corrected redox values and soil temperature following Silva-Machado et al. (2024). Metadata files redox_soiltemp_dd.csv and redox_soiltemp_flmd.csv provide detailed descriptions of variables and site locations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Evaluating Neural Radiance Fields for Commercial Satellite Video

We evaluate neural radiance fields (NeRFs) as a method for reconstructing 3D volumetric scenes from low Earth orbit satellite imagery. We leverage commercial satellite data to reconstruct a scene using existing software tools. In doing so, we identify difficulties in these mapping datasets for NeRF generation. We propose potential applications in geospatial intelligence for context and improved image interpretation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

TCCSP Site Characterization and Feasibility Report

The Tulare County Carbon Storage Project (TCCSP) focused on establishing the geological and commercial viability of a 50 million metric ton (MMT) carbon storage complex located in Tulare County, California. The geologic scope of work included collecting new and existing subsurface data, such as two-dimensional (2D) seismic data, advanced geophysical logs, core and fluid samples, and specialized core-analysis datasets, to support the integration and interpretation of findings from earlier tasks. These efforts contributed to the comprehensive feasibility study for commercial carbon capture and storage (CCS) development at the TCCSP site and in the surrounding region. The TCCSP project team evaluated the feasibility of the Lower Monterey Group (Santa Margarita Sand Member or its equivalent), Temblor Formation sand members (Olcese, Jewett, Vedder), and Lodo-Martinez Zone (Domengine Sandstone, Walker Formation, Lodo Formation, and the Martinez Sand) to serve as commercial CCS reservoirs along with potential for the Upper Monterey Group (Reef Ridge, Antelope Members) and the Kreyenhagen Formation to vertically seal underlying reservoirs from shallow above-zones.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Omics-Lethal Human Viruses, Interferon-Stimulated Response Experiment IFNaCL001

The purpose of this experiment was to evaluate the host interferon-stimulated cellular response to interferon alpha (IFNα) treatment. Sample data was obtained from human lung adenocarcinoma cells (Calu-3) treated with or without IFNα for mRNA and miRNA transcriptome expression analysis. Secondary host-associated viral dataset downloads contain one or more statistically processed (normalization data transformation) quantitative dataset collections resulting in qualitative expression analyses of primary host-pathogen experimental study designs. Transcriptomics dataset download have a direct relationship to a primary sample submission corresponding to a specific interferon response to viral infection.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Omics-Lethal Human Viruses, Interferon-Stimulated Response Experiment IFNFB001

The purpose of this experiment was to evaluate the human host cellular response to interferon alpha/beta (IFNα/β) or interferon gamma (IFNγ) treatment. Sample data was obtained from primary human lung fibroblast (FB) cells inoculated with IFNα/β or IFNγ for transcriptome analysis. Secondary host-associated viral dataset downloads contain one or more statistically processed (normalization data transformation) quantitative dataset collections resulting in qualitative expression analyses of primary host-pathogen experimental study designs. Transcriptomics dataset download have a direct relationship to a primary sample submission corresponding to a specific interferon response to viral infection.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Omics-Lethal Human Viruses, Influenza A Experiment IM103

The purpose of this experiment was to evaluate the host response to wild-type Influenza A/Vietnam/1203/2004 (H5N1; "VN1203") virus infection and mock infection. Sample data was obtained for mouse lung tissue and processed for mRNA, miRNA, proteomics, lipidomics, and metabolomics expression analysis. Secondary host-associated viral dataset downloads contain one or more statistically processed (normalization data transformation) quantitative dataset collections resulting in qualitative expression analyses of primary host-pathogen experimental study designs. Leveraging unique high-resolution Omics capabilities for proteomics, metabolomics, lipidomics, and transcriptomics dataset download each have a direct relationship to a primary sample submission corresponding to a specific Influenza A virus infection.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Omics-Lethal Human Viruses, MERS-CoV Experiment MFB001

The purpose of this experiment was to evaluate the human host response to wild-type MERS-CoV (icMERS-CoV) virus infection. Sample data was obtained from primary human fibroblasts and processed for mRNA, miRNA, proteomics, metabolomics, and lipidomics expression analysis. econdary host-associated viral dataset downloads contain one or more statistically processed (normalization data transformation) quantitative dataset collections resulting in qualitative expression analyses of primary host-pathogen experimental study designs. Leveraging unique high-resolution Omics capabilities for proteomics, metabolomics, lipidomics, and transcriptomics dataset downloads each have a direct relationship to a primary sample submission corresponding to a specific MERS-CoV virus infection.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Fractal Characterization of Multimodal, Multiscale Images of Shale Rock Fracture Networks

An array of multimodal and multiscale images of fractured shale rock samples and analogs was collected with the aim of improving the numerical representation of fracture networks. 2D and 3D reconstructions of fractures and matrices span from 10 –6 to 100 m. The origin of the fracture networks ranged from natural to thermal maturation to hydraulically induced maturation. Images were segmented to improve fracture identification. Then, the fractal dimension and length distribution of the fracture networks were calculated for each image dataset. The resulting network connectivity and scaling associations are discussed at length on the basis of scale, sample and order of magnitude. Fracture network origin plays an important role in the resulting fracture systems and their scaling. Rock analogs are also evaluated using these descriptive tools and are found to be faithful depictions of maturation-induced fracture networks.

58 GEOSCIENCES↗