Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Planning, design and logistics of a decision analysis study: The FBI/Ames study involving forensic firearms examiners

This paper describes design and logistical aspects of a decision analysis study to assess the performance of qualified firearms examiners working in accredited laboratories in the United States in terms of accuracy (error rate), repeatability, and reproducibility of decisions involving comparisons of fired bullets and cartridge cases. The purpose of the study was to validate current practice of the forensic discipline of firearms/toolmarks (F/T) examination. It elicited error rate data by counting the number of false positive and false negative conclusions. Preceded by the experimental design, decisions, and logistics described herein, testing was ultimately administered 173 qualified, practicing F/T examiners in public and private crime laboratories. The first round of testing evaluated accuracy, while two subsequent rounds evaluated repeatability and reproducibility of examiner conclusions. This project expands on previous studies by involving many F/T examiners in challenging comparisons and by executing the study in the recommended double-blind format.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2023

Understanding Changes in Cloud Simulations from E3SM Version 1 to Version 2

This study documents clouds simulated by the Energy Exascale Earth System Model (E3SM) version 2 (E3SMv2) and attempts to understand what causes the model behavior change in clouds relative to E3SMv1. This is done by analyzing the last 30-year (1985–2014) data from the 165-year historical simulations using E3SMv1 and v2 and four sensitivity tests to isolate the impact of changes in model parameter choices in its turbulence, shallow convection, and cloud macrophysics parameterization (CLUBB), microphysical parameterization (MG2), and deep convection scheme (ZM), as well as model physics changes in convective triggering. It is shown that E3SMv2 significantly improves the simulation of subtropical coastal stratocumulus clouds (Sc) and clouds with optical depth larger than 3.6 over the stratocumulus to cumulus transition regimes, where Shortwave Cloud Radiative Effect (SWCRE) is also improved, and the Southern Ocean (SO) while seeing an overall slight degradation in low clouds over other tropical and subtropical oceans. The better performance in E3SMv1 over those regions is partially due to error compensation between its simulated optically thin and intermediate low clouds for which E3SMv2 actually improves simulation of optically intermediate low clouds. Sensitivity tests indicate that the changes in low clouds are primarily due to the tuning made in CLUBB. The impact of the ZM tuning is mainly on optically intermediate and thick high clouds, contributing to improved SWCRE and Longwave Cloud Radiative Effect (LWCRE). The impact of the MG2 tuning and the new convective trigger is primarily on the high latitudes and the Southern Ocean (SO). They have a relatively smaller impact on clouds than do the CLUBB and ZM tunings. This study offers additional insights about clouds simulated in E3SMv2 by utilizing multiple data sets and the COSP diagnostic tool as well as through sensitivity tests. The improved understanding will benefit the future E3SM developments.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Generalized Brønsted‐Evans‐Polanyi Relationships for Reactions on Metal Surfaces from Machine Learning

Abstract Brønsted‐Evans‐Polanyi (BEP) relationships, i. e., a linear scaling between reaction and activation energies, lie at the core of computational design of heterogeneous catalysts. However, BEPs are not general and often require reparameterization for each class of reactions. Here we construct generalized BEPs (gBEPs), which can predict activation energies for a diverse dataset of reactions of C, O, N and H containing molecules on metal surfaces. In a first step we develop a set of descriptors based on scaling relationships that can capture the change in chemical identity of reactants during the reaction. Subsequently, we use the reaction energy, these descriptors and a single descriptor for the surface structure to parameterize machine learning based regression approaches for the prediction of activation energies. The best approach we developed shows a Mean Absolute Error (MAE) of 0.11 eV for the training set (80 % of the data set) and 0.23 eV for the test set (20 % of the data set). The methodology presented here allows to calculate activation energies within fractions of seconds on a typical personal computer and due to its generality, accuracy and simplicity in application it might prove to be useful in transition metal catalyst design.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Deterministic incident-wave elevation prediction in intermediate water depth

Potential performance gains from optimal (non-causal) impedance-matching control of wave energy devices in irregular ocean waves are dependent on deterministic wave elevation prediction techniques that work well in practical applications. Although a number of devices are designed for operation in intermediate water depths, little work has been reported on deterministic wave prediction in such depths. Here, we investigated a deterministic wave-prediction technique based on an approximate propagation model that leads to an analytical formulation, which may be convenient to implement in practice. To improve accuracy, an approach to combine predictions based on multiple up-wave measurement points is evaluated. The overall method is tested using experimental time-series measurements recorded in the U.S. Navy MASK basin in Carderock, MD, USA. For comparison, an alternative prediction approach based on Fourier coefficients is also tested with the same data. Comparison of prediction approaches with direct measurements suggest room for improvement. Possible sources of error including tank reflections are estimated, and potential mitigation approaches are discussed.

16 TIDAL AND WAVE POWER↗
DOE OSTI2020

The Adjoint Petrov–Galerkin method for non-linear model reduction

Here, we formulate a new projection-based reduced-order modeling technique for non-linear dynamical systems. The proposed technique, which we refer to as the Adjoint Petrov–Galerkin (APG) method, is derived by decomposing the generalized coordinates of a dynamical system into a resolved coarse-scale set and an unresolved fine-scale set. A Markovian finite memory assumption within the Mori–Zwanzig formalism is then used to develop a reduced-order representation of the coarse scales. This procedure leads to a closed reduced-order model that displays commonalities with the adjoint stabilization method used in finite elements. The formulation is shown to be equivalent to a Petrov–Galerkin method with a non-linear, time-varying test basis, thus sharing some similarities with the Least-Squares Petrov–Galerkin method. Theoretical analysis examining a priori error bounds and computational cost is presented. Numerical experiments on the compressible Navier–Stokes equations demonstrate that the proposed method can lead to improvements in numerical accuracy, robustness, and computational efficiency over the Galerkin method on problems of practical interest. Improvements in numerical accuracy and computational efficiency over the Least-Squares Petrov–Galerkin method are observed in most cases.

42 ENGINEERING↗
DOE OSTI2020

A corrected method for Coulomb scattering in arbitrarily weighted particle-in-cell plasma simulations

A physically and statistically accurate method to perform binary, pairwise Coulomb collisions for arbitrarily-weighted macroparticles in particle-in-cell simulations is described. The method is shown to conserve global energy and momentum on average and to produce physically accurate scattering frequencies. This is justified using the statistically expected values of the method and through a series of numerical tests showing that the method is valid independently of macroparticle weight. This novel method is required due to an error in previous work on binary scattering, initially by Nanbu and Yonemura [J. Comp. Phys. 145, 639 (1998)] and applied to subsequent work, that causes inaccuracies in the scattering frequencies for unequally weighted simulations; a problem that occurs both for scattering within the group and between different groups.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Advancing stream temperature prediction with a generalizable large-sample framework across CONUS river reaches

Accurately predicting stream temperature in ungauged basins remains a critical challenge for water resource management, thermoelectric power plant cooling, and ecosystem conservation. Large-sample machine learning models trained on hundreds of well-monitored river basins have shown remarkable performance; however, such models have yet to be developed solely using forcing data that can be readily extracted to simulate stream temperatures anywhere in the contiguous United States (CONUS). In this study, we present a scalable, large-sample deep learning framework using Long Short-Term Memory (LSTM) networks to simulate daily stream temperatures in ungauged basins across the CONUS. The framework leverages both modeled reanalysis of meteorological and streamflow inputs as well as static attributes available for all 2.7 million CONUS river reaches in the National Hydrography Dataset Plus (NHDPlusV2). By generating dynamical inputs from predefined thermally relevant upstream contributing areas, rather than the entire upstream basin, the model also offers improvements in very large basins where full-basin averaging can dilute the most important influences on stream temperature. Evaluated across 300 basins, the model achieves a median Mean Absolute Error (MAE) of 1.1 °C and a Nash-Sutcliffe Efficiency (NSE) of 0.95 on temporally and spatially distinct test folds—comparable to models trained exclusively using meteorological and streamflow observational data. The flexible, high-performing framework generalizes to any unmonitored river reach without significant regulation or unnatural thermal input immediately upstream, substantially expanding predictive capabilities in data-scarce regions.

Hydrology↗
DOE OSTI2022

Energy and mobility impacts of connected autonomous vehicles with co-optimization of speed and powertrain on mixed vehicle platoons

Intersections are known to be traffic bottlenecks where a significant amount of energy consumption could be caused due to deceleration/acceleration in the presence of red signals. With an increased level of connectivity and automation of intelligent transportation systems, connected autonomous vehicles (CAVs) are expected to be able to proactively adjust their driving strategies subject to constraints imposed by the predicted future traffic. As a result, many potential benefits can be achieved, such as improved energy efficiency, enhanced traffic safety, among many others. Notably, the way CAVs are controlled affects the following legacy vehicles (LVs) due to complex traffic dynamics. Here, we are particularly interested in studying the energy and mobility impact of CAVs with an improved traffic prediction method on mixed vehicle platoons at various market penetration rates. Leveraging traffic prediction, CAVs are controlled with co-optimization of their speed and gear position. Specifically, a traffic prediction framework in a rolling horizon fashion is employed based upon a modified Payne–Whitham (PW) model capable of handling mixed traffic consisting of CAVs and LVs. The prediction error of the modified PW model is reduced by 53.62% compared to that of the standard PW model under test scenarios. According to the predicted traffic conditions, speed and gear position of CAVs are co-optimized with the primary goal of minimizing energy consumption when driving on a signalized arterial. The energy benefits achieved by CAVs and the impact of CAVs on LVs behind are studied comprehensively for mixed vehicle platoons. The lead LV follows a real-world speed profile collected on TH-55 in Minnesota. Numerical results show that energy benefits achieved by the vehicle platoon range from 2% to 16%, and a 1% to 5% reduction in travel time for LVs behind CAVs is also observed, at different penetration rates of CAVs in various traffic scenarios. Furthermore, it is observed that CAVs using the proposed eco-driving approach appear to have a positive impact on the LVs behind in terms of energy consumption, regardless of the driving styles of the LVs ahead.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2022

Moving closer to experimental level materials property prediction using AI

Abstract While experiments and DFT-computations have been the primary means for understanding the chemical and physical properties of crystalline materials, experiments are expensive and DFT-computations are time-consuming and have significant discrepancies against experiments. Currently, predictive modeling based on DFT-computations have provided a rapid screening method for materials candidates for further DFT-computations and experiments; however, such models inherit the large discrepancies from the DFT-based training data. Here, we demonstrate how AI can be leveraged together with DFT to compute materials properties more accurately than DFT itself by focusing on the critical materials science task of predicting “formation energy of a material given its structure and composition”. On an experimental hold-out test set containing 137 entries, AI can predict formation energy from materials structure and composition with a mean absolute error (MAE) of 0.064 eV/atom; comparing this against DFT-computations, we find that AI can significantly outperform DFT computations for the same task (discrepancies of $$>0.076$$ > 0.076 eV/atom) for the first time.

36 MATERIALS SCIENCE↗
DOE OSTI2020

AP-Net: An atomic-pairwise neural network for smooth and transferable interaction potentials

Intermolecular interactions are critical to many chemical phenomena, but their accurate computation using ab initio methods is often limited by computational cost. The recent emergence of machine learning (ML) potentials may be a promising alternative. Useful ML models should not only estimate accurate interaction energies but also predict smooth and asymptotically correct potential energy surfaces. However, existing ML models are not guaranteed to obey these constraints. Indeed, systemic deficiencies are apparent in the predictions of our previous hydrogen-bond model as well as the popular ANI-1X model, which we attribute to the use of an atomic energy partition. As a solution, we propose an alternative atomic-pairwise framework specifically for intermolecular ML potentials, and we introduce AP-Net—a neural network model for interaction energies. The AP-Net model is developed using this physically motivated atomic-pairwise paradigm and also exploits the interpretability of symmetry adapted perturbation theory (SAPT). We show that in contrast to other models, AP-Net produces smooth, physically meaningful intermolecular potentials exhibiting correct asymptotic behavior. Initially trained on only a limited number of mostly hydrogen-bonded dimers, AP-Net makes accurate predictions across the chemically diverse S66x8 dataset, demonstrating significant transferability. On a test set including experimental hydrogen-bonded dimers, AP-Net predicts total interaction energies with a mean absolute error of 0.37 kcal mol−1, reducing errors by a factor of 2–5 across SAPT components from previous neural network potentials. The pairwise interaction energies of the model are physically interpretable, and an investigation of predicted electrostatic energies suggests that the model “learns” the physics of hydrogen-bonded interactions.

Glick, Zachary L. (ORCID:0000000309002849)↗
DOE OSTI2022

Deep Learning Based Frequency Stability Assessment in Power Grid with High Renewables

Frequency stability assessment is one critical aspect of power system security assessment. Traditional N-1 screening method is based on the simulations of a few typical daily and seasonal operation scenarios. However, the increasing integration of inverter-based renewables and the retirement of conventional synchronous generators result in decreasing system inertia and growing complexity of system operating conditions. Selecting a few typical operation scenarios cannot cover all operating conditions, and the time-domain simulation of all operation conditions requires tremendous time. This paper proposes a more efficient frequency stability assessment method based on deep learning. The affinity propagation clustering algorithm is used to divide the dataset into different clusters, so the selected dataset for training can cover the diversified operating conditions as much as possible. Also, feature normalization is applied to both the training dataset and testing dataset in order to remove any unnecessary bias. Especially, trained model based on full dataset normalization has bounded error in the prediction. The case study on the reduced 240-bus WECC system demonstrates that the proposed method can predict accurate frequency nadir with limited training dataset. The deep learning model using the revised feature normalization can predict more accurate frequency nadir than that using the traditional feature normalization and has very small maximum prediction error.

affinity propagation↗
DOE OSTI2023

A Voltage Inference Framework for Real-Time Observability in Active Distribution Grids

Active distribution grids are gaining traction to meet the growing environmental, socio-economic, and sustainability targets. Various advanced smart grid technologies facilitate the integration of Distributed Energy Resources (DERs) by supporting the bi-directional power flow. The limited observability of distribution grids, primarily related to their location at the very edge of power system infrastructure, brings challenges to optimal grid management. Moreover, only a limited number of measurements at regular intervals are usually available. This paper presents a novel inference framework, referred to as “Voltage Inference”, to overcome the observability issues. The proposed framework employs a prediction step based on the Multivariate Taylor series approximation, followed by a corrector step that minimizes the estimation error to infer the otherwise unknown voltages from the available measurements. Furthermore, numerical results on the IEEE 13-bus test feeder validate the accuracy and computational performance of the proposed framework.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Neumann Series Based Voltage Sensitivity Analysis for Three Phase Distribution System

In this letter, a simplified voltage sensitivity analysis technique that can provide accurate estimates of voltage change across the network for a given change in bus power injections in a three-phase unbalanced distribution network is proposed. This technique is derived from the first-order approximation of the Neumann series, which allows maintaining the accuracy of the solution while the computational effort is reduced. Here, the proposed technique is tested on a 559-bus unbalanced distribution system with multiple distributed generation resources. The results show that the average error in the voltage estimates with the proposed method is not more than 0.3% with the execution time of similar order relative to the state-of-the-art sensitivity analysis methods.

42 ENGINEERING↗
DOE OSTI2020

Validation of finite-element models using full-field experimental data: Levelling finite-element analysis data through a digital image correlation engine

Full-field data from digital image correlation (DIC) provide rich information for finite-element analysis (FEA) validation. However, there are several inherent inconsistencies between FEA and DIC data that must be rectified before meaningful, quantitative comparisons can be made, including strain formulations, coordinate systems, data locations, strain calculation algorithms, spatial resolutions and data filtering. As such, in this paper, we investigate two full-field validation approaches: (1) the direct interpolation approach, which addresses the first three inconsistencies by interpolating the quantity of interest from one mesh to the other, and (2) the proposed DIC-levelling approach, which addresses all six inconsistencies simultaneously by processing the FEA data through a stereo-DIC simulator to ‘level’ the FEA data to the DIC data in a regularisation sense. Synthetic ‘experimental’ DIC data were generated based on a reference FEA of an exemplar test specimen. The direct interpolation approach was applied, and significant strain errorswere computed, even though therewas no model form error, because the filtering effect of theDIC enginewas neglected. In contrast, the levelling approach provided accurate validation results, with no strain error when no model form error was present. Next, model form error was purposefully introduced via a mismatch of boundary conditions. With the direct interpolation approach, the mismatch in boundary conditions was completely obfuscated, while with the levelling approach, it was clearly observed. Finally, the ‘experimental’ DIC datawere purposefully misaligned slightly fromthe FEA data. Both validation techniques suffered from the misalignment, thus motivating continued efforts to develop a robust alignment process. In conclusion, direct interpolation is insufficient, and the proposed levelling approach is required to ensure that the FEA and the DIC data have the same spatial resolution and data filtering. Only after the FEA data have been ‘levelled’ to the DIC data can meaningful, quantitative error maps be computed.

42 ENGINEERING↗
DOE OSTI2026

PIP-II LLRF Master Oscillator and Precision Reference Line- Station Level Design and Testing

The PIP-II superconducting linac at Fermilab requires a highly stable RF Reference Line to maintain phase synchronization throughout the accelerator. Temperature-induced changes in the electrical length of long coaxial cables can introduce phase drift and measurement errors. The reference-line architecture mitigates these effects by phase averaging the forward and reflected RF signals, while a phase-locked loop anchors the system to the master oscillator. This work focuses on the characterization, validation, and mechanical integration of station-level RF assemblies using CAD modeling, vector network analyzer measurements, and spectrum analyzer testing. PID-controlled thermal plates will stabilize critical RF components and further reduce temperature-dependent phase and amplitude variations. These methods support repeatable, standardized designs that can be reliably integrated across the different reference-line stations.

Mosher, Alexander [U. Illinois, Chicago; Fermilab]↗
DOE OSTI2024

Understanding changes in cloud simulations from E3SM version 1 to version 2

Abstract. This study documents clouds simulated by the Energy Exascale Earth System Model (E3SM) version 2 (E3SMv2) and attempts to understand what causes the model behavior change in clouds relative to E3SMv1. This is done by analyzing the last 30-year (1985–2014) data from the 165-year historical simulations using E3SMv1 and v2 and four sensitivity tests to isolate the impact of changes in model parameter choices in its turbulence, shallow convection, and cloud macrophysics parameterization (Cloud Layers Unified By Binormals, CLUBB); microphysical parameterization (MG2); and deep-convection scheme (ZM), as well as model physics changes in convective triggering. It is shown that E3SMv2 significantly improves the simulation of subtropical coastal stratocumulus clouds and clouds with optical depth larger than 3.6 over the stratocumulus-to-cumulus transition regimes, where the shortwave cloud radiative effect (SWCRE) is also improved, and the Southern Ocean (SO) while seeing an overall slight degradation in low clouds over other tropical and subtropical oceans. The better performance in E3SMv1 over those regions is partially due to error compensation between its simulated optically thin and intermediate low clouds for which E3SMv2 actually improves simulation of optically intermediate low clouds. Sensitivity tests indicate that the changes in low clouds are primarily due to the tuning done in CLUBB. The impact of the ZM tuning is mainly on optically intermediate and thick high clouds, contributing to an improved SWCRE and longwave cloud radiative effect (LWCRE). The impact of the MG2 tuning and the new convective trigger is primarily on the high latitudes and the SO. They have a relatively smaller impact on clouds than CLUBB tuning and ZM tuning do. This study offers additional insights into clouds simulated in E3SMv2 by utilizing multiple data sets and the Cloud Feedback Model Intercomparison Project (CFMIP) Observation Simulator Package (COSP) diagnostic tool as well as sensitivity tests. The improved understanding will benefit future E3SM developments.

58 GEOSCIENCES↗
DOE OSTI2026

PIP-II LLRF Master Oscillator and Precision Reference Line - Station Level Design and Testing

The PIP-II superconducting linac at Fermilab requires a highly stable RF Reference Line to maintain phase syn- chronization throughout the accelerator. Temperature- induced changes in the electrical length of long coaxial cables can introduce phase drift and measurement errors. The reference-line architecture mitigates these effects by phase averaging the forward and reflected RF signals, while a phase-locked loop anchors the system to the mas- ter oscillator. This work focuses on the characterization, validation, and mechanical integration of station-level RF assemblies using CAD modeling, vector network analyzer measurements, and spectrum analyzer testing. PID-controlled thermal plates will stabilize critical RF components and further reduce temperature-dependent phase and amplitude variations. These methods sup- port repeatable, standardized designs that can be reliably integrated across the different reference-line stations.

Mosher, Alexander [U. Illinois, Chicago]↗
DOE OSTI2023

Impacts of hybridization and forecast errors on the probabilistic capacity credit of batteries

Battery storage is increasingly identified as being among the least-cost mix of technologies in the evolving U.S. electricity mix. This study explores the marginal capacity credit of batteries using a probabilistic, reliability-based, effective firm capacity method, which we apply for multiple battery power ratings, durations, coupling types, deployment locations, and dispatch profiles within a test system that is based on the Texas Interconnection in the year 2024. We find that the capacity credits for all battery durations depend on their ability to predict the timing of reliability events. Even 1-2 h forecast errors - resulting in early or delayed battery discharging relative to the onset of a reliability event - lead pronounced capacity credit reductions, especially for 4-h duration batteries. Coupling batteries with solar mitigates the uncertainty associated with a shorter-duration battery's availability during reliability events, primarily due to the relatively high solar capacity credit in our test system. Coupled (or hybrid) system designs with oversized solar arrays, the ability to charge the coupled battery with grid energy, and larger batteries lead to the greatest capacity credit benefits of hybridization. We do not see evidence that the hybrid capacity credit exceeds the sum of the separate battery and solar capacity credits.

24 POWER TRANSMISSION AND DISTRIBUTION↗