Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data analysis methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Clustering Analysis of Commercial Vehicles Using Automatically Extracted Features from Time Series Data

Standard of practice approaches to time series cluster analysis involve careful feature engineering, often utilizing expert input to tune and select features by hand. In many cases, expert input may not be readily available, or there may not yet exist a community consensus on the ideal features for a given application. This paper compares the results of several cluster analysis methods, using both hand selected features and those extracted automatically, when applied to large geospatial time series telematics data from commercial trucking fleets. The impacts of feature selection, dimensionality reduction, and choice of clustering algorithm on the quality of clustering results are explored. Results from this analysis confirm prior results that domain agnostic features are competitive with the hand engineered features with respect to clustering quality metrics. These results also provide new insight into the most successful strategies for identifying structure in large unstructured vehicle telematics data, and suggest that time series clustering using automatic feature extraction can be an effective approach to extract structure from large scale geospatial time series data in cases when hand selected features are not available.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2020

Super resolution convolutional neural network for feature extraction in spectroscopic data

Two dimensional (2D) peak finding is a common practice in data analysis for physics experiments, which is typically achieved by computing the local derivatives. However, this method is inherently unstable when the local landscape is complicated or the signal-to-noise ratio of the data is low. In this work, we propose a new method in which the peak tracking task is formalized as an inverse problem, which thus can be solved with a convolutional neural network (CNN). In addition, we show that the underlying physics principle of the experiments can be used to generate the training data. By generalizing the trained neural network on real experimental data, we show that the CNN method can achieve comparable or better results than traditional derivative based methods. This approach can be further generalized in different physics experiments when the physical process is known.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2023

Application of Principal Component Analysis to Electrochemical Reprocessing PM and NMAC

In this report, data from an electrorefiner (ER) for nuclear fuel reprocessing is evaluated for process monitoring (PM) conclusions. This data comes from tests performed at the Idaho National Laboratory in 2022. Multivariate approaches utilizing methods of Principal Component Analysis (PCA) is applied. This is based off established work in process monitoring for fault detection in industrial facilities. This report will discuss the background, methods, and results of the application and some of the conclusions and applications that can be drawn from them. PCA is applied to two different electrorefiner (ER) operations that occurred at Idaho National Laboratory between August and October 2022. The first operation occurred with little incident while the second had several noted faults in the equipment in operational logs. The data from the first run was used to train the data for “normal” operations and applied to both sets of data to determine when operations were in an “off-normal” condition and identify where the fault occurs through PCA. PCA was able to identify off-normal events and identify the cause for off-normal operations. These identified off-normal events matched with the events and their causes in the operational logs. However, small amounts of variance in the data led to false detection of “off-normal” events. Thus, careful selection of training data and a-posteriori conclusions based off operator assessments will both be required for application of PCA to PM applications. This work demonstrated that multivariate approaches and latent variables are applicable to pyroprocessing PM applications and can be further expanded in future work as quality variables such as salt concentration from sensors and sampling become available.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2020

Synthesis of Seismic Methods in Southern Kansas (Milestone G)

We proposed to conduct the following activities in Budget Period 2 with respect to Task 2.1 of the overall project management plan: 1) Local SWS using microseismicity catalog. 2) Continuation of VSM analysis. 3) Synthesis of seismic data and uncertainty analyses. Milestone G: Apply ANT, VSM, and SWS methods to Kansas microseismicity catalog. Calculate 3D model and moment tensor elements and meet milestone E.

58 GEOSCIENCES↗
DOE OSTI2025

River Dissolved Oxygen Prediction Using Machine Learning Models and Wireless Sensor Measurements

Simultaneous flooding&heat and droughts&heat events can potentially destabilize hydro-meteorological conditions to deteriorate the water quality of Neches River. Machine learning (ML) models utilizing wireless sensor measurements have been applied to predict water quality and optimize various water management strategies. This study aims to develop ML models to predict dissolved oxygen (DO) prediction under various hydro-meteorological conditions and enhance water management decision-making. Wireless sensor measurements of DO, water temperature, sample depth, conductivity, turbidity, and pH, along with discharge from the United States Geological Survey stations, are collected for model inputs at the Pine Island Bayou C749 station (PIB-C749) and Neches River Saltwater Barrier (SWB). Multilayer perceptron neural networks, recurrent neural networks, long short-term memory (LSTM), and bidirectional LSTM (BiLSTM) with and without attention mechanism (AT) are tested to determine the best model, which is applied the rolling forecast method to predict 14-day DO. Traditional and recurrent transfer learning (TL and RTL) methods are adopted to overcome insufficient data at the SWB. The input feature importance analysis using the integrated gradients (IG) algorithm is applied to determine dominant inputs. The results show LSTM-based models are capable handling long sequential data. AT-BiLSTM and RTL-LSTM demonstrate the best performance at the PIB-C749 (RMSE=0.054) and the SWB (RMSE=0.028), respectively. TL and RTL methods significantly improve model performance at the SWB. DO, temperature, and pH show higher importance, consistent with hydrodynamics and water chemistry. Both best models are applied to predict 14-day DO and demonstrate reasonable performance for decision-making. Hydro-meteorological conditions of 2017 flood and 2012 drought events are simulated and reveal that possible hypoxia occurs after flooding due to increasing temperature and turbidity, and DO concentration decreases significantly under heat and drought conditions. In conclusion, LSTM-based models utilizing wireless sensor data can be a timely and effective approach to make appropriate decisions on water resource management.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Investigation of the isoscalar monopole response in the proton-rich nucleus 14 O

Deuteron inelastic scattering on 14 O was measured in inverse kinematics using an active-target time projection chamber and a magnetic spectrograph. The experimental technique enabled precise measurements of deuteron recoiling particles in coincidence with beam-like fragments detected in the spectrograph focal plane. The double differential cross section was reconstructed for scattering angles of 3–6 degrees and excitation energies up to 26 MeV. The monopole strength distribution was obtained from the data using a multipole decomposition analysis. The results were compared to quasiparticle random-phase approximation (QRPA) and generator coordinate method (GCM) calculations. The QRPA calculation accurately describes experimental data in the energy range of 13 to 26 MeV. GCM calculations assuming a 12 C (g . s .) + p + p cluster configuration were used to determine the 0 + strength in 14 O below 13 MeV. The monopole transition strength of these cluster states provides a good description of the experimental distribution in the 9–11 MeV region, while the 0$^{+}_{2}$ state accounts for only a small fraction of the experimental strength around 6 MeV.

Active target↗
DOE OSTI2026

Development and implementation of high-throughput proteomic and metabolomics assays by using advanced chromatographic and mass spectrometric systems (CRADA Final Report)

The mission of this CRADA with Agilent was to couple powerful MS platforms (QQQ, IM-QTOFMS) with Agilent’s novel Ultra-High-Performance Liquid Chromatography (UHPLC) fast metabolomic workflows and perform ABF Machine Learning (ML) to generated datasets. Agilent transferred UHPLC methods to PNNL and LBNL and methods were implemented and demonstrated in both labs, achieving total acquisition times of < 10 min. Metabolites analyzed using Agilent’s shared methods included metabolites from central carbon metabolism, common across hosts, and metabolites unique to engineered strains. Standards were acquired in an UHPLC-Drift Tube Ion Mobility Mass Spectrometer (DTIMS) system for the first time within the context of ABF and methods were optimized based on Agilent’s protocols. Samples from ABF hosts Pseudomonas putida, Aspergillus pseudoterreus, Aspergillus niger and Rhodosporidium toruloides were analyzed using the UHPLC-DTIMS platform for a total of 276 runs. A data analysis workflow compatible with the Experimental Data Depot (EDD) and completely shareable was developed for the acquired UHPLC-DTIMS data. Samples were analyzed using a Data Independent Acquisition Approach (DIA), which for most of the standards provided more transitions therefore increasing detection confidence. Using the data acquired by PNNL, LBNL, and Agilent’s specifications from previous ML projects, SNL applied an ensemble ML strategy to pick the best performing model for automated LC-method selection. Finally, with the contribution of the participant labs and Agilent, SNL developed an Automated Method Selection (AMS) software tool to predict the best liquid chromatography method for analysis of any new molecules of interest. Samples with novel pathways and new metabolite targets of interest are generated at a high pace in the ABF. Overall, the project advanced rapid metabolomics by combining liquid chromatography, ion mobility spectrometry, and data-independent mass spectrometry with machine learning. This multidimensional approach uses retention time, collision cross-section, precursor mass, and fragment-ion information to distinguish chemically similar metabolites that can be difficult to resolve using conventional liquid- or gas-chromatography methods. The resulting workflow also provided automated metabolite-identification error estimates, addressing a recognized need for statistical confidence measures in metabolomics.

Petzold, Christopher [Lawrence Berkeley National L↗
DOE OSTI2025

Cluster-Graph Fingerprinting: A Framework for Quantitative Analysis of Machine-Learned Interatomic Model Training and Simulation Data

Machine-learned interatomic models represent a significant advancement in simulation methods, extending the predictive ability of first-principles methods to previously inaccessible length and time scales. However, the data-driven nature of these models can lead to difficult-to-detect errors that can compromise prediction accuracy. To address this challenge, we introduce a novel fingerprinting approach based on the Chebyshev Interaction Model for Efficient Simulation (ChIMES) ML-IAM graph-based descriptor. Our strategy enables efficient and statistically rigorous analysis of system configurations used in ML-IAM training and those generated by their application, e.g., in molecular dynamics simulations. We demonstrate that these fingerprints can effectively assess novelty of a configuration relative to an existing data set and determine dissimilarity among individual configurations, which are two key tasks in workflows for active learning-based ML-IAM training, data set curation, and on-the-fly uncertainty quantification.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Environmental Effects Assessment for Proposed Offshore Wind Farm off the Coast of Grays Harbor, Washington

Grays Harbor Wind LLC (GHW) is proposing to develop a floating offshore wind farm offshore of west Grays Harbor County, Washington (Grays Harbor). The proposed GHW Offshore Wind Project (Project) would entail construction, installation and operation of a 1,000-megawatt (MW) offshore wind farm consisting of approximately 75 floating units, each containing a floating foundation and wind turbine generator (WTG). The Project location is approximately 25 miles (21.7 nautical miles [nmi]) offshore west of Grays Harbor, at waters depths of 360 to 700 feet. The Pacific Northwest National Laboratory (PNNL) was contracted by Herrera Environmental Consultants, Inc. on behalf of GHW to carry out this preliminary scoping study to evaluate baseline conditions and potential effects on fish and marine mammals from development and operation of a floating offshore wind farm installed within a designated area off the coast of Washington1. Floating offshore wind units installed in an ocean environment as part of the Project would interact with marine wildlife. This Study report provides an initial data aggregation and analysis, using publicly available data, of the Project effects, both negative and positive, on the marine environment. The scope of this assessment is limited by the fact that the Project development is presently at the conceptual level. Data on marine organisms were aggregated and evaluated; however seabirds were evaluated by Herrera Environmental Consulting and, along with bats, were not included in the scope of this study. Significant additional work is necessary to characterize ocean, seafloor, and environmental conditions; select appropriate floating offshore wind technologies; identify construction methods and locations; and assess facility locations, including electrical interconnection. Data aggregation and analysis of seabirds and bats is also needed. Evaluation of the full range of potential environmental effects would be conducted following an award of a lease from the Bureau of Ocean Energy Management (BOEM) as part of the leasing, National Environmental Policy Act (NEPA)/State Environmental Policy Act (SEPA) environmental review and permitting processes. While this initial data aggregation and analysis uses best available public scientific information and current assumptions about the Project configuration, the effects discussed herein are based on the status of review to-date and may change as Project-specific details are developed.

17 WIND ENERGY↗
DOE OSTI2025

HexWeather: Hexagonal Spatial Data Aggregation for Weather-Driven Grid Resilience Analysis

Extreme weather accounts for over 8 0 % of major U.S. power outages since 2000, highlighting the need for spatial tools that align weather data with the irregular boundaries of electric infrastructure. This paper introduces HexWeather, a modular, resolution-aware framework for aggregating historical and forecasted weather data using Uber's H3 hexagonal spatial indexing system. Unlike traditional methods that rely on state or county-level grids, HexWeather enables weather analysis across custom geographies such as utility service areas where public datasets are often unavailable or misaligned. Using Open-Meteo data, we evaluate how H3 resolution affects anomaly detection, spatial variability, and forecast uncertainty across three scales: state, county, and utility. Results show that while coarse resolutions suffice for broad trend tracking, finer resolutions are essential for identifying localized variability and operational risks. By applying metrics like Z-score standard deviation and interquartile range, HexWeather quantifies the spatial spread of both historical anomalies and forecasted conditions, allowing users to assess resolution adequacy for each analysis. This framework supports rapid weather data reuse, reproducible anomaly detection, and predictive modeling for infrastructure resilience. By bridging spatial misalignment in traditional datasets and enabling retrospective and forward-looking analysis within the same pipeline, HexWeather lays the groundwork for better post event analysis, outage prediction, and resilience planning.

Morris, Jacob [ORNL]↗
DOE OSTI2025

eDNAjoint: An R package for interpreting paired or semi‐paired environmental DNA and traditional survey data in a Bayesian framework

Abstract Environmental DNA (eDNA) sampling is increasingly used in surveys of species distribution as a potentially sensitive and efficient monitoring method. Yet access to modelling tools designed specifically for interpreting this new data type lags behind its ubiquity. While occupancy modelling software has dominated the analytical landscape for eDNA data analysis of single species, this type of model may not always be the most appropriate. The rate of eDNA detection often corresponds to species density, rather than just occupancy, and researchers often have access to observations from non‐genetic sampling methods at the same sites. To provide users access to a modelling framework designed to maximize the use of all available data, we developed an R package, eDNAjoint . The package provides an easy‐to‐use interface for fitting a ‘joint’ model that integrates data from paired or semi‐paired eDNA and traditional surveys in a Bayesian framework. The model can be used to estimate parameters like the probability of a false positive eDNA detection and mean catch rate at a site, and the package allows access to multiple model variations and Bayesian prior customization. Additional functionality can be used for model selection, summarising posteriors and comparing the relative sensitivities of the two survey methods. We demonstrate the use of eDNAjoint by fitting a variation of the model with site‐level covariates that scale the sensitivity of eDNA sampling relative to traditional sampling. The example workflow uses binary eDNA and seine count data for the endangered tidewater goby ( Eucyclogobius newberryi ) from a study by Schmelzle and Kinziger (2016). This use case includes a prior sensitivity analysis and an evaluation of the relationship between detection rates and environmental variables. eDNAjoint has the potential to greatly increase the range of users who will be able to rigorously analyse eDNA and traditional survey data in a Bayesian framework, understand if and how eDNA can improve monitoring practices, and gain confidence in the interpretability of eDNA data.

Keller, Abigail G. [Department of Environment Scie↗
DOE OSTI2025

Applying Gaussian Process Machine Learning and Modern Probabilistic Programming to Satellite Data to Infer CO 2 Emissions

Satellite data provides essential insights into the spatiotemporal distribution of CO 2 concentrations. However, many atmospheric inverse models fail to adequately incorporate the spatial and temporal correlations inherent in satellite observations and often lack rigorous methods for estimating parameters like spatial length scales. We introduce an inference model that processes the spatiotemporal covariance in satellite data and estimates hyperparameters such as covariance length scales. Our approach uses the Gaussian process (GP) machine learning (ML) and modern probabilistic programming languages (PPLs) to perform atmospheric inversions of emissions from satellite data. We develop a GP ML inversion system based on modern PPLs and the GEOS-Chem chemical transport model, simulating atmospheric CO 2 concentrations corresponding to the Orbiting Carbon Observatory-2/3 (OCO-2/3) data for July 2020. In our supervised learning framework, we treat the GEOS-Chem simulated data set as the target, with predictors derived by scaling the target with sector-specific factors hidden from the GP machine. Our results show that the GP model, combined with GPU-enabled PPLs, effectively retrieves true emission scaling factors and infers noise levels concealed within the data. This suggests that our method could be applied over larger areas with more complex covariance structures, enabling comprehensive analysis of the spatiotemporal patterns observed in OCO-2/3 and similar satellite data sets.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Physics and chemistry from parsimonious representations: image analysis via invariant variational autoencoders

Electron, optical, and scanning probe microscopy methods are generating ever increasing volume of image data containing information on atomic and mesoscale structures and functionalities. This necessitates the development of the machine learning methods for discovery of physical and chemical phenomena from the data, such as manifestations of symmetry breaking phenomena in electron and scanning tunneling microscopy images, or variability of the nanoparticles. Variational autoencoders (VAEs) are emerging as a powerful paradigm for the unsupervised data analysis, allowing to disentangle the factors of variability and discover optimal parsimonious representation. Here, we summarize recent developments in VAEs, covering the basic principles and intuition behind the VAEs. The invariant VAEs are introduced as an approach to accommodate scale and translation invariances present in imaging data and separate known factors of variations from the ones to be discovered. We further describe the opportunities enabled by the control over VAE architecture, including conditional, semi-supervised, and joint VAEs. Several case studies of VAE applications for toy models and experimental datasets in Scanning Transmission Electron Microscopy are discussed, emphasizing the deep connection between VAE and basic physical principles. Python codes and datasets discussed in this article are available at https://github.com/saimani5/VAE-tutorials and can be used by researchers as an application guide when applying these to their own datasets.

36 MATERIALS SCIENCE↗
DOE OSTI2021

MindSynchro

This report presents the developments and results of MindSynchro project as part of DOE OE FOA 1861. DOE and Pacific Northwest National Laboratory (PNNL) have made available to FOA awardees datasets containing years of real historical data recorded from various phasor measurement units (PMUs) which are installed in three large US interconnections: Texas (IC A), Western (IC B), and Eastern (IC C). The main goal of the project, which was successfully achieved, was to develop methods for detection and identification of events which are relevant for power grid operation. Tasks performed for achieving the project goals included data exploration and pre-processing, the development and application of physics-based features, data analysis and labeling based on unsupervised learning approaches, training and testing of DSSL models for classification of events which are relevant for power grid operation, and deployment of solutions to cloud environments. The methods developed in the project can potentially provide relevant benefits to power grid asset owners/operators in general in terms of situational awareness. Two main types of outcomes can be provided by these tools: Identification of specific relevant power grid event types: Semi-supervised ML methods developed in the project can adequately employ not only the relatively scarce labeled data but also the large amount of available unlabeled data to train models for detection of specific event types. Such methods enable the application of trained models for the detection of events in a population of PMUs much larger than that associated to the labeled events. Support in data labeling / label validation: Labels are critical for training of models for identification of specific types of events. However, labeling large amounts of data is a manual and tedious process. This means that such process is error prone and is not scalable. Methods developed in the project, based on ensembles of clustering models, have been successfully employed for turning manual labeling into a scalable process. Accurate identification of specific relevant events can provide the operators with immediate situational awareness that could otherwise require hours or days of analysis from domain experts. We envision that such methods could be initially employed in support of post-mortem analysis of events and, as confidence is gained, they could be employed for online/real-time support, providing, among other benefits, insights for avoiding major events which could happen due to a combination of smaller ones. On the longer term, related methods could potentially be employed to improve protection and control.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Reply to Comment by Peterie Et Al. on “Accelerated Fill‐Up of the Arbuckle Group Aquifer and Links to U.S. Midcontinent Seismicity”

Abstract Peterie et al. question one observation in our paper: associating pressure increases to injection volumes at distances of up to 25 km from an injection well. In this reply, we show that the comment misunderstands our analysis and the evidence that led to this conclusion. We also show that gauge‐depth‐corrected pressures, used by the authors to produce statewide pressure maps, are discrepant with the static fluid level data, provided in our original compilation and analysis. The discrepancies are a result of the pressure correction method employed, which naïvely substitutes formation pressure for bottomhole pressure to calculate wellbore fluid density. Their linearly interpolated pressure maps, based on sparse data, contain interpolation and extrapolation artifacts that contradict injection trends in the state, the Theis solution, and the superposition principle. We reiterate that pressure and static fluid level increases in Class I wells existed prior to 2013, most notably in central Kansas, where recent earthquakes are cited in the comment as evidence of a pressure plume emanating from the Kansas‐Oklahoma border, 90 km away. We show that the space‐time pattern of seismicity in this area is inconsistent with a northward propagating pressure plume and, instead, seismicity appears to be centered on and near a cluster of high‐rate injection wells, two of which are among the highest rate wells in the state. These observations, along with recent M4 + earthquakes during continued decreases in wastewater injection in southern Kansas and northern Oklahoma, question the usefulness of the comment for understanding and managing societally significant earthquakes.

Ansari, Esmail↗
DOE OSTI2022

Total Mercury Analysis of Radioactive Waste Containing Multiple Mercury Species

In this work, a direct mercury analyzer (DMA) was used to analyze total mercury in radioactive waste samples containing methylmercury and other forms of mercury including Hg o (elemental) together with inorganic ionic mercury species and complexes. These samples were also analyzed using Cold Vapor Atomic Absorption Spectroscopy (CVAAS) and/or Inductively Coupled Plasma Mass Spectroscopy (ICMS). Comparative statistical evaluation of the results from spike solutions/simulants, liquid radioactive waste samples, and interlaboratory performance test samples demonstrated that the various methods generated accurate and/or equivalent total mercury data and equivalent precision (2σ ± < 20%). Triplicate total mercury analysis of an exemplar radioactive waste resulted in an average value of 54.1 mg/L (as Hg) using CVAAS, 55.1 mg/L using ICPMS and 56.0 mg/L using DMA. A primary advantage of the DMA in a radioactive environment is avoiding multi-step, labor-intensive, time-consuming and waste-producing sample preparation protocols needed for CVAAS and ICPMS. DMA was determined to be the preferred method for measuring total mercury in the Savannah River National Laboratory (SRNL) radioanalytical laboratory based on analytical performance combined with ease of use in a radiological containment unit.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
DOE OSTI2024

Numerical Investigation of Observational Flux Partitioning Methods for Water Vapor and Carbon Dioxide

Abstract While yearly budgets of CO 2 flux (F c ) and evapotranspiration (ET) above vegetation can be readily obtained from eddy‐covariance measurements, the separate quantification of their soil (respiration and evaporation) and canopy (photosynthesis and transpiration) components remains an elusive yet critical research objective. In this work, we investigate four methods to partition observed total fluxes into soil and plant sources: two new and two existing approaches that are based solely on analysis of conventional high frequency eddy‐covariance (EC) data. The physical validity of the assumptions of all four methods, as well as their performance under different scenarios, are tested with the aid of large‐eddy simulations, which are used to replicate eddy‐covariance field experiments. Our results indicate that canopies with large, exposed soil patches increase the mixing and correlation of scalars; this negatively impacts the performance of the partitioning methods, all of which require some degree of uncorrelatedness between CO 2 and water vapor. In addition, best performances for all partitioning methods were found when all four flux components are non‐negligible, and measurements are collected close to the canopy top. Methods relying on the water‐use efficiency (W) perform better whenWis known a priori, but are shown to be very sensitive to uncertainties in this input variable especially when canopy fluxes dominate. We conclude by showing how the correlation coefficient between CO 2 and water vapor can be used to infer the reliability of differentWparameterizations.

Environmental Sciences & Ecology↗