Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Computational modelling and experimental tank testing of the multi float WaveSub under regular wave forcing

A submerged wave device generates energy from the relative motion of floating bodies. In WaveSub, three floats are joined to a reactor; each connected to a spring and generator. Electricity generated damps the orbital movements of the floats. The forces are non-linear and each float interacts with the others. Tuning to the wave climate is achieved by changing the line lengths, so there is a need to understand the performance trade-offs for a large number of configurations. This requires an efficient, large displacement, multidirectional, multi-body numerical scheme. Results from a 1/25 scale wave basin experiment are described. Here, we show that a time domain linear potential flow formulation (Nemoh, WEC-Sim) can match the tank testing provided that suitably tuned drag coefficients are employed. Inviscid linear potential models can match some wave device experiments; however, additional viscous terms generally provide better accuracy. Scale experiments are also prone to mechanical friction, and we estimate friction terms to improve the correlation further. The resulting error in mean power between numerical and physical models is approximately 10%. Predicted device movement shows a good match. Overall, drag terms in time domain wave energy modelling will improve simulation accuracy in wave renewable energy device design. to understand the performance trade-offs for a large number of configurations. This requires an efficient, large displacement, multidirectional, multi-body numerical scheme. Results from a 1/25 scale wave basin experiment are described. Here, we show that a time domain linear potential flow formulation (Nemoh, WEC-Sim) can match the tank testing provided that suitably tuned drag coefficients are employed. Inviscid linear potential models can match some wave device experiments; however, additional viscous terms generally provide better accuracy. Scale experiments are also prone to mechanical friction, and we estimate friction terms to improve the correlation further. The resulting error in mean power between numerical and physical models is approximately 10%. Predicted device movement shows a good match. Overall, drag terms in time domain wave energy modelling will improve simulation accuracy in wave renewable energy device design.

16 TIDAL AND WAVE POWER↗
DOE OSTI2021

A Comparison of Exact and Model Exchange–Correlation Potentials for Molecules

Accurate exchange–correlation (XC) potentials for three-dimensional systems–via solution of the inverse density functional theory (DFT) problem–are now available to test the quality of DFT approximations. Herein, the exact XC potential for seven molecules–dihydrogen at four different bond-lengths, lithium hydride, water, and ortho-benzyne–are computed from full configuration interaction reference densities. These are compared to model XC potentials from nonlocal (B3LYP, HSE06, SCAN0, and M08-HX) and semilocal/local (SCAN, PBE, and PW92) XC functionals. Whereas for most systems, relative errors in the ground-state densities are O(10 –3 –10 –2 ) , the model XC potentials have much higher errors of O(10 –1 –10 0 ) . Among the model XC functionals, SCAN0 offers the best agreement with the exact XC potential, underlining the significance of satisfying exact conditions as well as including nonlocal effects in XC functionals. This work indicates that tests against the exact XC potential will provide a promising new direction for building more accurate XC functionals for DFT.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Model independent comparison of supernova and strong lensing cosmography: Implications for the Hubble constant tension

We use supernovae measurements, calibrated by the local determination of the Hubble constant $H_0$ by SH0ES, to interpolate the distance-redshift relation using Gaussian process regression. We then predict, independent of the cosmological model, the distances that are measured with strong lensing time delays to test their mutual agreement. In this work we find excellent agreement between these predictions and the measurements. The agreement holds when we consider only the redshift dependence of the distance-redshift relation, independent of the value of $H_0$. Our results disfavor the possibility that lens mass modeling contributes a 10% bias or uncertainty in the strong lensing analysis, as suggested recently in the literature. In general our analysis strengthens the case that residual systematic errors in both measurements are below the level of the current discrepancy with the CMB determination of $H_0$, and supports the possibility of new physical phenomena on cosmological scales. With additional data our methodology can provide more stringent tests of unaccounted for systematics in the determinations of the distance-redshift relation in the late universe.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Code Coverage Status of the ARC Code PERSENT

The Argonne Reactor Code (ARC) software system supports users in their fast reactor design goals by providing neutronic, thermal-hydraulic, and structural analysis capabilities. PERSENT fulfills the role of generating reactivity coefficients for a given time point of a REBUS calculation usable in a point kinetics based safety analysis capability. PERSENT also provides a sensitivity coefficient capability on eigenvalue, reactivity worth, and several other key coefficients that are used in the follow-on safety analysis. Given a co-variance matrix, PERSENT can carry out the uncertainty quantification to indicate the amount of error in the reactivity coefficients derived from the errors in the cross section measurements. With continued improvement of computational resources, many of the geometry modeling capabilities in DIF3D that were primarily used in low order schemes are not really needed anymore. Today, the diffusion and transport capabilities of DIF3D-VARIANT are primarily used in the reactor design process with some scattered usage of DIF3D-FD and DIF3D-Nodal. PERSENT is part of the ARC code system and is built around DIF3D-VARIANT and the flux solution it provides. The purpose of the present work is to identify a set of test problems for PERSENT and assess the code coverage of PERSENT for those test problems. PERSENT treats the DIF3D executable as an external executable and thus the code coverage considerations only need to focus on the PERSENT source code and only a fraction of the connected modules in the existing ARC software library. The goal is to document what parts of the existing PERSENT code are touched by the set of test problems and which are not. Because the verification work done on PERSENT was focused on the most common uses of PERSENT for fast reactor analysis, the code coverage assessment of those capabilities is the highest priority. This will ensure that nothing is being missed by the existing verification test problems that users of PERSENT rely upon. The code coverage analysis of PERSENT was performed with the Code Coverage Tool of the Intel Fortran compiler which requires modifications to the compilation of PERSENT. The detailed coverage tables are given for each submodule of PERSENT. Most of the uncovered parts/files could be easily ignored because they are either for error message and debugging output or not needed by PERSENT today. Only a few uncovered parts of PERSENT deserve extending the verification test suite.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2020

Distribution System Segmented Model Simplification with Independent Dynamically Changing End-Use Loads

With more emerging technologies in power distribution systems, to support quasi-static time-series (QSTS) simulation over short time frames, accurately modeling the dynamic behavior of end-use load under various conditions is im- portant. However, time and cost can be a burden for the QSTS simulation of thousands of houses representing dynamic load behaviors on large distribution feeders. There are two main contributions of this paper in order to reduce the QSTS simulation complexity. First, the paper presents a method to stochasti- cally model the dynamic behavior of end-use load for QSTS simulations. Second, using the stochastically modeled load behavior as an input to a distribution sys- tem, and building on our previous QSTS simulation simplification/acceleration method that relies on uniform load behavior, this paper presents a segment substitution approach for the simplification of distribution system models with independent dynamically changing end-use loads. Our numerical results show that compared to GridLAB-D, a software tool that simulates end-use load be- havior through physical models, the proposed stochastic modeling approach achieved an 89.3% simulation time reduction for end-use loads, while accurately capturing the temporally changing total load behavior. Moreover, the QSTS simulation of a large test distribution system through OpenDSS showed that the proposed simplification method decreased the feeder simulation time by a factor of three at less than 0.3% voltage error. Compared to our previous method with independent dynamic loads, the voltage error is reduced by a factor of four.

Power distribution system modeling, stochastic pro↗
DOE OSTI2023

A high order Cartesian grid, finite volume method for elliptic interface problems

We present a higher-order finite volume method for solving elliptic PDEs with jump conditions on interfaces embedded in a 2D Cartesian grid. Second, fourth, and sixth order accuracy is demonstrated on a variety of tests including problems with high-contrast and spatially varying coefficients, large discontinuities in the source term, and complex interface geometries. We include a generalized truncation error analysis based on cell-centered Taylor series expansions, which then define stencils in terms of local discrete solution data and geometric information. In the process, we develop a simple method based on Green's theorem for computing exact geometric moments directly from an implicit function definition of the embedded interface. This approach produces stencils with a simple bilinear representation, where spatially-varying coefficients and jump conditions can be easily included and finite volume conservation can be enforced.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Long–short-term memory encoder–decoder with regularized hidden dynamics for fault detection in industrial processes

The ability of recurrent neural networks (RNN) to model nonlinear dynamics of high dimensional process data has enabled data-driven RNN-based fault detection algorithms. Previous studies have focused on detecting faults by identifying the discrepancies in data distribution between the faulty and normal data, as reflected in prediction errors generated by RNN models. However, in industrial processes, variations in data distribution can also result from changes in normal control setpoints and compensatory control adjustments in response to disturbances, making it hard to differentiate between normal and faulty conditions. This paper proposes a fault detection method utilizing a long short-term memory (LSTM) encoder–decoder structure with regularized hidden dynamics and reversible instance normalization (RevIN) to compactly represent high-dimensional measurements for effective monitoring. During training, the hidden states of the model are regularized to form a low-dimensional latent space representation of the original multivariate time series data. As a result, the prediction errors of the latent states can be used to monitor the abnormal dynamic variations, while the reconstruction errors of the measured variables are used to monitor the abnormal static variations. Furthermore, the proposed indices can reflect operating conditions, even when the distribution of test data changes, which helps distinguish faults from normal adjustments and disturbances that controllers can settle. Here, data from numerical simulation and the Tennessee Eastman process are used to illustrate the effectiveness of the proposed fault detection method.

42 ENGINEERING↗
DOE OSTI2024

A Stereo Camera Simulator for Large-Eddy Simulations of Continental Shallow Cumulus Clouds Based on Three-Dimensional Path-Tracing

The complex spatial and temporal structure of cumulus clouds complicates their representation in weather and climate models. Classic meteorological instrumentation struggles to fully capture these features. Networks of multiple high-resolution hemispheric cameras are increasingly used to fill this data gap, and provide information on this missing multi-dimensional spatial information. In this study, a path-tracing algorithm is used to generate virtual camera images of resolved clouds in large-eddy simulations (LES). These images are then used as a camera network simulator, allowing reconstructions of three-dimensional cloud edges from the model output. Because the actual LES cloud field is fully known, the combined path-tracing and reconstruction method can be statistically analyzed. The method is applied to LES realizations of summertime shallow cumulus at the Jülich Observatory for Cloud Evolution (JOYCE), Germany, which also routinely operates a camera network. We find that the path-tracing method allows accurate reconstruction of up to 70% of the visible cloud edges. Additional sensitivity tests show that the method is robust for changes in its hyperparameters. The sensitivity to cloud optical thickness is also investigated, finding a cloud boundary placement error of approximately 182 m. This error can be considered typical for cloud boundary reconstruction using real stereo camera imagery. The results provide proof of principle for future use of the method for evaluating LES clouds against camera network imagery, and for further optimizing the configuration of such camera networks.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Dynamical tuning of the chemical potential to achieve a target particle number in grand canonical Monte Carlo simulations

We present a method to facilitate Monte Carlo simulations in the grand canonical ensemble given a target mean particle number. The method imposes a fictitious dynamics on the chemical potential, to be run concurrently with the Monte Carlo sampling of the physical system. Corrections to the chemical potential are made according to time-averaged estimates of the mean and variance of the particle number, with the latter being proportional to thermodynamic compressibility. Here, we perform a variety of tests, and in all cases find rapid convergence of the chemical potential—inexactness of the tuning algorithm contributes only a minor part of the total measurement error for realistic simulations.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2020

Effective Missing Value Imputation Methods for Building Monitoring Data

To understand behaviors of natural and man-made events, such as energy consumption of buildings, which accounts for 40% of energy uses in the US, we deploy automated monitoring devices to record periodic observations. However, such experimental and observation data often contains problems and irregularities that have to be cleaned up before analyses. Due to various conditions affecting sensor operations, the communication channels, recording steps, or the recording media, the recorded data might have missing values, errors, or anomalous values. An effective way to clean up these problems is to replace these missing values, errors and anomalous values with expected values, a process generally known as imputation. In this work, we survey commonly used missing value imputation techniques and compare their performance on a set of building monitoring data. To compare the different types of sensor measurements with widely varying characteristics, we use normalized root mean squared error (NRMSE) as the key metric for the effectiveness of the imputation methods. We additionally consider periodicity and run time when considering comparing methods. Through extensive testing, we find that for small gap sizes, up to 8 consecutive missing values, linear interpolation performs the best; for larger gaps stretching up to 48 consecutive missing values, K-nearest neighbors provides the most accurate imputations; for even larger gaps, more computational intensive methods, such as matrix factorization, achieve the smallest NRMSE. Additionally, we observe that these computationally intensive algorithms not only provide accurate imputations for large gaps, but are also more robust across all types of sensors.

Cho, B↗
DOE OSTI2021

DeepDist: real-value inter-residue distance prediction with deep residual convolutional network

Abstract Background Driven by deep learning, inter-residue contact/distance prediction has been significantly improved and substantially enhanced ab initio protein structure prediction. Currently, most of the distance prediction methods classify inter-residue distances into multiple distance intervals instead of directly predicting real-value distances. The output of the former has to be converted into real-value distances to be used in tertiary structure prediction. Results To explore the potentials of predicting real-value inter-residue distances, we develop a multi-task deep learning distance predictor (DeepDist) based on new residual convolutional network architectures to simultaneously predict real-value inter-residue distances and classify them into multiple distance intervals. Tested on 43 CASP13 hard domains, DeepDist achieves comparable performance in real-value distance prediction and multi-class distance prediction. The average mean square error (MSE) of DeepDist’s real-value distance prediction is 0.896 Å 2 when filtering out the predicted distance ≥ 16 Å, which is lower than 1.003 Å 2 of DeepDist’s multi-class distance prediction. When distance predictions are converted into contact predictions at 8 Å threshold (the standard threshold in the field), the precision of top L/5 and L/2 contact predictions of DeepDist’s multi-class distance prediction is 79.3% and 66.1%, respectively, higher than 78.6% and 64.5% of its real-value distance prediction and the best results in the CASP13 experiment. Conclusions DeepDist can predict inter-residue distances well and improve binary contact prediction over the existing state-of-the-art methods. Moreover, the predicted real-value distances can be directly used to reconstruct protein tertiary structures better than multi-class distance predictions due to the lower MSE. Finally, we demonstrate that predicting the real-value distance map and multi-class distance map at the same time performs better than predicting real-value distances alone.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Uncertain of uncertainties? A comparison of uncertainty quantification metrics for chemical data sets

Abstract With the increasingly more important role of machine learning (ML) models in chemical research, the need for putting a level of confidence to the model predictions naturally arises. Several methods for obtaining uncertainty estimates have been proposed in recent years but consensus on the evaluation of these have yet to be established and different studies on uncertainties generally uses different metrics to evaluate them. We compare three of the most popular validation metrics (Spearman’s rank correlation coefficient, the negative log likelihood (NLL) and the miscalibration area) to the error-based calibration introduced by Levi et al. ( Sensors 2022 , 22 , 5540). Importantly, metrics such as the negative log likelihood (NLL) and Spearman’s rank correlation coefficient bear little information in themselves. We therefore introduce reference values obtained through errors simulated directly from the uncertainty distribution. The different metrics target different properties and we show how to interpret them, but we generally find the best overall validation to be done based on the error-based calibration plot introduced by Levi et al. Finally, we illustrate the sensitivity of ranking-based methods (e.g. Spearman’s rank correlation coefficient) towards test set design by using the same toy model ferent test sets and obtaining vastly different metrics (0.05 vs. 0.65).

Rasmussen, Maria H.↗
DOE OSTI2025

Optimizing Hydronic Heating for Comfort and Performance in Multifamily Housing

Inefficient control settings in multifamily boilers often lead to substantial energy and cost penalties. To address this, a Fault Detection and Diagnostic (FDD) tool was developed to automate data analysis and identify operational faults such as suboptimal outdoor temperature sensor placement, misconfigured outdoor air reset (OAR) curves, excess boiler cycling, and domestic hot water (DHW) setpoint errors. By comparing pre- and post-implementation periods and applying engineering models, the tool quantifies energy savings and reduces manual analysis time by over 90%. Testing on over 100 monitored sites and a targeted subset of 12 buildings showed an average 11% energy savings from remote optimization; further validation across 19 OAR curve changes confirmed the tool’s accuracy, predicting actual savings within ±5% for most cases. Simple payback can be under three years for many multifamily buildings, though rising hardware, labor, and fuel costs create uncertainties, and decarbonization goals increasingly shift focus to electrification. The FDD tool remains invaluable for optimizing existing boilers, enhancing future electrification measures, and adapting to new technologies by refining building load estimates. In doing so, it supports both near-term efficiency and long-term transitions to low-carbon alternatives, ensuring buildings achieve substantial cost and energy benefits throughout their system lifecycles.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

A Novel Dew Point Meter: Application to the Measurement of the Sulfuric Acid Dew Point for Combustion Flue Gas

Accurate knowledge of acid dew point is essential for industrial and applied combustion. Sulfur in the fuel or raw materials is converted to sulfur dioxide (SO2) during combustion, and a portion of the SO2 is oxidized to sulfur trioxide (SO3). The SO3 will react to form H2SO4 vapor when in the presence of water vapor. Even with just trace levels of H2SO4 vapor in the gas phase (1-10 ppm), the dew point can reach 100°C and higher. To avoid acid condensation and the resulting corrosion on heat recovery equipment, plant engineers must ensure that surface temperatures are above the acid dew point, but this decreases the efficiency of the thermal energy recovery. Thus, there is a trade-off between minimizing equipment corrosion and maximizing thermal energy recovery efficiency, and the acid dew point is a key parameter for this optimization. In this work, we analyze and discuss the theory of the sulfuric acid condensation process and develop a novel dew point meter based on this analysis. The meter consists of a novel optical instrument that is designed to monitor the slightest appearance of condensation on a hydrophobic window surface, and the surface temperature of the window is slowly decreased until condensation is first observed, yielding an accurate measurement of the dew point. The basis of the instrument is that a collimated beam from a diode laser generates scattered light when encountering surface condensate, and a sophisticated array detector is used to sensitively monitor the light scattering. The measurement procedures are established to rapidly find the acid dew point, while minimizing error. Further, we propose a calibration system based on a liquid bubbler, which can generate a stable gas flow with known sulfuric acid dew point, to test the dew point meter. Test results show that the dew point meter can accurately measure the acid dew point over a wide range.

Cheng, Mao↗
DOE OSTI2023

A Data-Driven Framework for Direct Local Tensile Property Prediction of Laser Powder Bed Fusion Parts

This article proposes a generalizable, data-driven framework for qualifying laser powder bed fusion additively manufactured parts using part-specific in situ data, including powder bed imaging, machine health sensors, and laser scan paths. To achieve part qualification without relying solely on statistical processes or feedstock control, a sequence of machine learning models was trained on 6299 tensile specimens to locally predict the tensile properties of stainless-steel parts based on fused multi-modal in situ sensor data and a priori information. A cyberphysical infrastructure enabled the robust spatial tracking of individual specimens, and computer vision techniques registered the ground truth tensile measurements to the in situ data. The co-registered 230 GB dataset used in this work has been publicly released and is available as a set of HDF5 files. The extensive training data requirements and wide range of size scales were addressed by combining deep learning, machine learning, and feature engineering algorithms in a relay. The trained models demonstrated a 61% error reduction in ultimate tensile strength predictions relative to estimates made without any in situ information. Lessons learned and potential improvements to the sensors and mechanical testing procedure are discussed.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Bayesian Exploration of Phenomenological EoS of Neutron/Hybrid Stars with Recent Observations

The description of the stellar interior of compact stars remains as a big challenge for the nuclear astrophysics community. The consolidated knowledge is restricted to density regions around the saturation of hadronic matter ρ 0 =2.8 × 10 14 g cm -3 , regimes where our nuclear models are successfully applied. As one moves towards higher densities and extreme conditions up to the quark/gluons deconfinement, little can be said about the microphysics of the equation of state (EoS). Here, we employ a Markov Chain Monte Carlo (MCMC) strategy to access the variability at high density regions of polytropic piecewise models for neutron star (NS) EoS or possible hybrid stars, i.e., a NS with a small quark-matter core. With a fixed description of the hadronic matter for low density, below the nuclear saturation density, we explore a variety of models for the high density regimes leading to stellar masses near to 2.5 M ⊙ , in accordance with the observations of massive pulsars. The models are constrained, including the observation of the merger of neutrons stars from VIRGO-LIGO and with the pulsar observed by NICER. In addition, we also discuss the possibility of the use of a Bayesian power regression model with heteroscedastic error. The set of EoS from the Laser Interferometer Gravitational-Wave Observatory (LIGO) was used as input and treated as the data set for the testing case.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2026

Developing a Digital Twin for SRF Cavity Assembly at Fermilab

When assembling Superconducting Radio Frequency (SRF) Cavities, maintaining an environment devoid of particulates like dust and other small particles is essential. If a single spec of dust enters the cavity a significant degradation of performance can occur. To avoid a cavity failure Fermilab assembles the SRF cavities within a ISO-4 (Class 10) environment. This environment though is still susceptible to foreign contaminants when technicians enter and new components are added to the cleanroom. To reduce the risk even more Fermilab has introduced a cobot manipulator into the cleanroom environment to speed up the assembly time which will reduce the time that the technicians operate in the cleanroom. But, this still leaves the potential of contaminants to enter the cleanroom if new components need to be tested within the cleanroom. This project aims to lay the groundwork to develop a Digital Twin environment of the cleanroom to aid in manufacturing processes and testing. In its simplest form, a digital twin is a bidirectional link between a physical system and its digital counterpart or twin. NVIDIA Isaac Sim is used as the digital twin foundation for the digital representation of the cleanroom, specifically for the UR16e assembly area. A simulated UR16e was used to validate the performance of Isaac Sim as a testing environment by comparing the tool center points (TCP) positional data between the simulated and digital representation of the UR16e. Due to a new vision based robotic assembly process being introduced to the cleanroom a digital representation of the physical camera was tested and validated to ensure that it will produce close to the same outcome as the physical environment. The TCP comparison results showed a peak translational error of approximately 0.1mm and rotational errors of up to 8 between the simulated and digital UR16es. While the camera validation performed with high repeatability across multiple runs, it still requires minor tuning before it can accurately replicate a physical camera.

Imburgia, Joseph [Northern Illinois U.]↗
DOE OSTI2023

Preservation of kinetics parameters generated by Monte Carlo calculations in two-step deterministic calculations

The generation of accurate kinetic parameters such as mean generation time Λ and effective delayed neutron fraction β eff via Monte Carlo codes is established. Employing these in downstream deterministic codes warrants another step to ensure no additional error is introduced by the low-order transport operator when computing forward and adjoint fluxes for bilinear weighting of these parameters. Another complexity stems from applying superhomogenization (SPH) equivalence in non-fundamental mode approximations, where reference and low-order calculations rely on a 3D full core model. In these cases, SPH factors can optionally be computed for only part of the geometry while preserving reaction rates and K-effective, but the impact of such approximations on kinetics parameters has not been thoroughly studied. This paper aims at studying the preservation of bilinearly-weighted quantities in the Serpent–Griffin calculation procedure. Diffusion and transport evaluations of IPEN/MB-01, Godiva, and Flattop were carried out with the Griffin reactor physics code, testing available modeling options using Serpent-generated multigroup cross sections and equivalence data. Verifying Griffin against Serpent indicates sensitivities to multigroup energy grid selection and regional application of SPH equivalence, introducing significant errors; these were demonstrated to be reduced through the use of a transport method together with a finer energy grid.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗