SEARCH · Engineering Papers

Results for “Model error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Calibration and Localization of Optically Pumped Magnetometers Using Electromagnetic Coils

In this paper, we propose a method to estimate the position, orientation, and gain of a magnetic field sensor using a set of (large) electromagnetic coils. We apply the method for calibrating an array of optically pumped magnetometers (OPMs) for magnetoencephalography (MEG). We first measure the magnetic fields of the coils at multiple known positions using a well-calibrated triaxial magnetometer, and model these discreetly sampled fields using vector spherical harmonics (VSH) functions. We then localize and calibrate an OPM by minimizing the sum of squared errors between the model signals and the OPM responses to the coil fields. We show that by using homogeneous and first-order gradient fields, the OPM sensor parameters (gain, position, and orientation) can be obtained from a set of linear equations with pseudo-inverses of two matrices. The currents that should be applied to the coils for approximating these low-order field components can be determined based on the VSH models. Computationally simple initial estimates of the OPM sensor parameters follow. As a first test of the method, we placed a fluxgate magnetometer at multiple positions and estimated the RMS position, orientation, and gain errors of the method to be 1.0 mm, 0.2°, and 0.8%, respectively. Lastly, we calibrated a 48-channel OPM array. The accuracy of the OPM calibration was tested by using the OPM array to localize magnetic dipoles in a phantom, which resulted in an average dipole position error of 3.3 mm. The results demonstrate the feasibility of using electromagnetic coils to calibrate and localize OPMs for MEG.

47 OTHER INSTRUMENTATION↗

DOE OSTI2023

Blind photovoltaic modeling intercomparison: A multidimensional data analysis and lessons learned

The Photovoltaic (PV) Performance Modeling Collaborative (PVPMC) organized a blind PV performance modeling intercomparison to allow PV modelers to blindly test their models and modeling ability against real system data. Measured weather and irradiance data were provided along with detailed descriptions of PV systems from two locations (Albuquerque, New Mexico, USA, and Roskilde, Denmark). Participants were asked to simulate the plane-of-array irradiance, module temperature, and DC power output from six systems and submit their results to Sandia for processing. The results showed overall median mean bias (i.e., the average error per participant) of 0.6% in annual irradiation and –3.3% in annual energy yield. While most PV performance modeling results seem to exhibit higher precision and accuracy as compared to an earlier blind PV modeling study in 2010, human errors, modeling skills, and derates were found to still cause significant errors in the estimates.

14 SOLAR ENERGY↗

DOE OSTI2024

Mitigative Strategies for Recovering From Large Language Model Trust Violations

In this study, we investigated strategies to address trust issues arising from errors in large language models (LLMs). The study examined the impact of confidence scores, system capability explanations, and user feedback on trust restoration post-error. 68 participants viewed the responses of an LLM to 20 general trivia questions, with an error introduced on the third trial. Each participant was presented with one mitigation strategy. Participants rated their overall trust in the model and the reliability of the answer. Results showed an immediate drop in trust after the error; however, there were no differences across the three strategies in trust recovery. All conditions had a logarithmic trend in trust recovery following error. Differences in overall trust were predicted by perceived reliability of the answer, suggesting that participants were evaluating results critically and using that to inform their trust in the model. Qualitative data supported this finding; participants expressed lasting distrust despite the LLM’s later accuracy. Results showcase the need to prioritize accuracy in LLM deployment, because early errors may irrevocably damage user trust calibration and later adoption.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

RDPM: An Extensible Tool for Resilience Design Patterns Modelling

Resilience to faults, errors, and failures in extreme-scale high-performance computing (HPC) systems is a critical challenge. Resilience design patterns offer a new, structured hardware and software design approach for improving resilience. While prior work focused on developing performance, reliability, and availability models for resilience design patterns, this paper extends it by providing a Resilience Design Patterns Modeling (RDPM) tool which allows (1) exploring performance, reliability, and availability of each resilience design pattern, (2) offering customization of parameters to optimize performance, reliability, and availability, and (3) allowing investigation of trade-off models for combining multiple patterns for practical resilience solutions.

Kumar, Mohit↗

DOE OSTI2022

Challenge Problem 1: Preliminary Model Development and Assessment of Flexible Heat Transfer Modeling Approaches

This report presents the modeling progress of a university consortium studying flexible modeling for turbulent heat transfer. In the context of advanced nuclear reactor design, where challenges include non-unity Prandtl fluids, free and mixed convection, and transitional flow, computational fluid dynamics methods are underutilized due to low confidence in modeling approaches and high computational cost. This report evaluates the performance of engineering CFD models in diabatic, buoyant turbulent flow. It finds that all turbulence models including several variants of the k-ε and k-ω models struggle to predict accurate turbulent momentum and heat transfer in such flows. The Nusselt numbers have been compared between the models and the DNS data, where calculations have been performed for each case and trends have shown a good agreement between DNS estimated Nusselt numbers and available correlations as well as experimental data. A novel DNS correlation for high Pr cases as they are transitioning from mixed convection to natural convection has been proposed. While Nusselt number errors relative to DNS range from 20% to 50%, the models capture similar trends to DNS with respect to Nusselt suppression and amplification under varying levels of buoyancy effect. This report also highlights model form error as a significant contributor to CFD predictions and proposes a framework for quantifying model error and improving confidence in CFD calculations. To improve the predictive capability of engineering CFD models, data-driven approaches for turbulence models are investigated. Theoretical frameworks based on the invariant tensor / vector basis neural networks for prediction of Reynolds stresses and turbulent heat fluxes are employed. The models are developed using direct numerical simulations data for forced convection flows of different fluids in vertical planar channel domain. The framework is implemented in spectral element solvers Nek5000 / nekRS and has shown a potential for future development and consideration of mixed convection flows.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2022

Evaluating Climate Models’ Cloud Feedbacks Against Expert Judgment

Abstract The persistent and growing spread in effective climate sensitivity (ECS) across global climate models necessitates rigorous evaluation of their cloud feedbacks. Here we evaluate several cloud feedback components simulated in 19 climate models against benchmark values determined via an expert synthesis of observational, theoretical, and high‐resolution modeling studies. We find that models with smallest feedback errors relative to these benchmark values generally have moderate total cloud feedbacks (0.4–0.6 W m −2 K −1 ) and ECS (3–4 K). Those with largest errors generally have total cloud feedback and ECS values that are too large or too small. Models tend to achieve large positive total cloud feedbacks by having several cloud feedback components that are systematically biased high rather than by having a single anomalously large component, and vice versa. In general, better simulation of mean‐state cloud properties leads to stronger but not necessarily better cloud feedbacks. The Python code base provided herein could be applied to developmental versions of models to assess cloud feedbacks and cloud errors and place them in the context of other models and of expert judgment in real‐time during model development.

58 GEOSCIENCES↗

DOE OSTI2022

Robust constrained tension control for high-precision roll-to-roll processes

Tension control is critical for maintaining good product quality in most roll-to-roll (R2R) production systems. Previous work has primarily focused on improving the disturbance rejection performance of tension controllers. Here, a robust linear parameter-varying model predictive control (LPV-MPC) scheme is designed to enhance the tension tracking performance of a pilot R2R system for deposition of materials used in flexible thin film applications. The performance of a tension controller may degrade due to disturbances associated with model uncertainties and the slowly-changing dynamics in R2R systems. We introduce a method that separately treats these two sources of disturbance. The controller utilizes an incremental model to eliminate the errors caused by the mismatch between the nominal model and the actual system. A tube-based MPC formulation combined with scheduled parameters adequately updates models and corrects for the time-varying dynamics. Constraints on the rated motor torque are incorporated in the MPC to maintain the controller reliability and avoid machine failures. We illustrate the operation of our control algorithm through simulation of an actual R2R system. The controller outperforms the benchmarks in terms of fast transient response and offset-free tension tracking. Furthermore, it also demonstrates immunity from variations due to parametric uncertainties.

42 ENGINEERING↗

DOE OSTI2025

Bias correcting regional scale Earth system model projections: novel approach using empirical mode decomposition

Bias correction is a crucial step in using Earth system model outputs for assessments, as it adjusts systematic errors by comparing the model to observations. However, standard methods – ranging from mean-based linear scaling to distribution-based quantile mapping typically treat bias correction as a single-scale process, overlooking the fact that biases can manifest differently across daily, seasonal, and annual timescales. In this study, we propose a novel, timescale-aware bias-correction approach built on Empirical Mode Decomposition. By decomposing the meteorological signal into multiple oscillatory components and aggregating them to represent distinct timescales, we apply targeted corrections to each component, thereby preserving both short- and long-term structure in the data. Experimental illustrations show that the timescale-aware EMDBC framework matches the performance of conventional quantile-delta mapping (QDM) at the native daily scale and achieves progressively larger bias reductions at bi-weekly, seasonal, and annual scales. As a result, the proposed approach offers a more robust path to accurate and reliable Earth system projections, strengthening their utility for resilience and adaptation planning.

Ganguli, Arkaprabha [Argonne National Laboratory (↗

DOE OSTI2023

A reduced order sulfuric acid decomposition model for a nuclear-powered hybrid sulfur cycle

A reduced order model of sulfuric acid decomposition within a bayonet chemical reactor was developed to support the U. S. Department of Energy Integrated Energy System program, and address the lack of knowledge in scaling and integration for joint chemical and nuclear processes. Sulfuric acid decomposition within a bayonet reactor was modeled to provide chemical and thermodynamic data relevant to advanced nuclear reactor-driven integrated energy systems based on desired operational scale and operational conditions. The temperature range required for high-temperature advanced nuclear reactor integrated energy systems, 750-850 °C, was shown to produce reasonable agreement (within a few percent relative error) with past models and experimental data, and yielded good efficiency results for bayonet reactor operations. The results of the reduced order model agreed with previous work from Savannah River National Labs within a maximum of 3.4% error on the decomposition of sulfur trioxide, and on previous Hybrid Sulfur flowsheets from Gorensek and Summers that showed operational temperature, pressure, and composition ranges for efficiency which made the Hybrid Sulfur cycle competitive with water electrolysis. Here, the agreement with previous high-fidelity models provided a framework for future Integrated Energy System grid evaluations with an advanced nuclear reactor and large-scale hydrogen production using a mathematical model to represent chemical operations.

08 HYDROGEN↗

DOE OSTI2020

Benchmark calculations of radiative forcing by greenhouse gases

Changes in concentrations of greenhouse gases lead to changes in radiative fluxes throughout the atmosphere. The value of this change, the instantaneous radiative forcing, varies across climate models, due partly to differences in the distribution of clouds, humidity, and temperature across models, and partly due to errors introduced by approximate treatments of radiative transfer. This paper describes an experiment within the Radiative Forcing Model Intercomparision Project that uses benchmark calculations made with line–by–line models to identify parameterization error in the representation of absorption and emission by greenhouse gases. Clear–sky instantaneous forcing by greenhouse gases is computed using a set of 100 profiles, selected from a re–analysis of present–day conditions, that represent the global annual mean forcing from pre–industrial times to the present–day with sampling errors of less than 0.01 W m –2 . Six contributing line–by–line models agree in their estimate of this forcing to within 0.025 W m –2 while even recently–developed parameterizations have typical errors four or more times larger, suggesting both that the samples reveal true differences among line–by–line models and that parameterization error will be readily identifiable. Agreement among line–by–line models is better in the longwave than in the shortwave where differing treatments of the water vapor vapor continuum affect estimates of forcing by carbon dioxide and methane. The impacts of clouds on instantaneous radiative forcing are estimated from climate model simulations. Here, the adjustment due to stratospheric temperature change by assuming fixed dynamical heating. Adjustments are large only for ozone and for carbon dioxide, for which stratospheric cooling introduces modest non–linearity.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

A tutorial review of machine learning-based model predictive control methods

Abstract This tutorial review provides a comprehensive overview of machine learning (ML)-based model predictive control (MPC) methods, covering both theoretical and practical aspects. It provides a theoretical analysis of closed-loop stability based on the generalization error of ML models and addresses practical challenges such as data scarcity, data quality, the curse of dimensionality, model uncertainty, computational efficiency, and safety from both modeling and control perspectives. The application of these methods is demonstrated using a nonlinear chemical process example, with open-source code available on GitHub. The paper concludes with a discussion on future research directions in ML-based MPC.

Wu, Zhe [Department of Chemical and Biomolecular E↗

DOE OSTI2023

Unraveling the 2021 Central Tennessee flood event using a hierarchical multi-model inundation modeling framework

Flood prediction systems need hierarchical atmospheric, hydrologic, and hydraulic models to predict rainfall, runoff, streamflow, and floodplain inundation. The accuracy of such systems depends on the error propagation through the modeling chain, sensitivity to input data, and choice of models. In this study, we used multiple precipitation forcings (hindcast and forecast) to drive hydrologic and hydrodynamic models to analyze the impacts of various drivers on the estimates of flood inundation depth and extent. We implement this framework to unravel the August 2021 extreme flooding event that occurred in Central Tennessee, USA. We used two radar-based quantitative precipitation estimates (STAGE4 and MRMS) as well as quantitative precipitation forecasts (QPF) from the National Weather Service Weather Prediction Center (WPC) to drive a series of models in the hierarchical framework, including the Variable Infiltration Capacity (VIC) land surface model, the Routing Application for Parallel Computation of Discharge (RAPID) river routing model, and the AutoRoute and TRITON inundation models. An evaluation with observed high-water marks demonstrates that the framework can reasonably simulate flood inundation. Despite the complex error propagation mechanism of the modeling chain, we show that inundation estimates are most sensitive to rainfall estimates. Most notably, QPF significantly underestimates flood magnitudes and inundations leading to unanticipated severe flooding for all stakeholders involved in the event. Finally, we discuss the implications of the hydrodynamic modeling framework for real-time flood forecasting.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Development of a Turbulent Liquid Spray Atomization Model for Diesel Engine Simulations (Final Technical Report)

This project addresses the systematic lack of predictive capabilities by spray models within engine CFD codes. We develop a new modeling approach to predict the breakup of diesel sprays based on recent literature showing that liquid turbulence plays a fundamental role in spray atomization. A new body of quantitative validation data is also developed as a critical element of the project, leveraging the joint capabilities of Georgia Tech’s high-pressure continuous-flow spray chamber and Argonne National Lab’s near-nozzle x-ray diagnostics at the Advanced Photon Source. This project contributes spatially-resolved measurements of drop size distribution within well-characterized diesel injectors, Spray A and D, from the Engine Combustion Network (ECN) to the engine combustion community for the first time. Utilizing this new body of measurements, we validate and demonstrate a new spray model for diesel sprays, termed the KH-Faeth model, that predicts global and local spray characteristic more accurately than the widely adopted and employed KH model. Predicted drop size distributions are seen to predict measured drops sizes both quantitatively and predictively, with accurate response in droplet size distributions over a wide range of ambient density, injection pressure, and injector nozzle size (Spray A and D) without model tuning. The KH-Faeth model can reduce error in the predicted centerline droplet size profile by up to 80% for ECN Spray D simulations when compared to use of the widely employed KH model.

33 ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2024

The Method of Finite Averages: A rigorous upscaling methodology for heterogeneous porous media

Rigorous upscaling techniques offer accurate and computationally-efficient strategies for modeling the average behaviors of multi-physical, multiscale phenomena in geological porous media. However, such techniques often rely on a variety of methodological assumptions that prohibit their rigorous application to practical systems (e.g., systems involving heterogeneous porous media, system-scale boundary conditions, and fine-scale dynamics that are not diffusion-dominant). In this work, we aim to formulate an upscaling methodology with few methodological assumptions to provide high levels of model generality and foster the utilization of rigorously-derived upscaled models in practice. In particular, we introduce the Method of Finite Averages (MoFA), a novel upscaling methodology for rigorously modeling heterogeneous porous media and system-scale boundary conditions. We then detail MoFA’s implementation for the advective–diffusive transport of a single species and compare the methodology with classic numerical techniques, as well as other rigorous upscaling techniques, to highlight MoFA’s unique combination of rigor and generality. We then validate the derived model while demonstrating its benefits in three numerical experiments. The results suggest that (1.) the applicability and a priori error guarantees of MoFA models do not directly depend on system geometry, (2.) a model’s applicability and error guarantees can be can arbitrarily expanded and reduced, respectively, with further computational expense, and (3.) downscaling with MoFA provides an efficient strategy for generating accurate pore-scale solutions from upscaled results. Ultimately, the results evidence that upscaled models can be rigorously derived for heterogeneous porous media systems and resolved in a fraction of the time it takes to perform the equivalent pore-scale simulations.

58 GEOSCIENCES↗

DOE OSTI2023

Analyzing Hardware and Software Common Cause Failures in Digital Instrumentation and Control Systems using Dual Error Propagation Method

This paper develops a methodology for quantifying software common cause failures (CCFs) in digital instrumentation and control (I&C) systems of nuclear power plants. To support the transition of analog I&C systems to digital in nuclear power plants, probabilistic risk assessment (PRA) techniques are used. The hardware components of the I&C systems have reliability databases that can be used in the PRA studies. However, the failure data for redundant software components of the systems is sparse. Failure of components constitutes a CCF, wherein two or more components or systems fail due to a single shared cause and coupling mechanism. This paper proposes a quantification approach that can simultaneously model hardware and software components, incorporate the CCFs of software systems in the models, and bridge the gap between the failure quantification of models and the development of CCF parametric databases. We demonstrate the dual error propagation method (DEPM) by developing I&C systems failure models for a representative digital reactor trip system. The DEPM models are built to simulate the control and data flows within the systems and can accommodate failure states. By expanding DEPM to software CCFs, we generated alpha factor parameter estimates for each of the modeled error propagation mechanisms.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2025

Mesh-based super-resolution of fluid flows with multiscale graph neural networks

A graph neural network (GNN) approach is introduced in this work which enables mesh-based three-dimensional super-resolution of fluid flows. In this framework, the GNN is designed to operate not on the full mesh-based field at once, but on localized meshes of elements (or cells) directly. To facilitate mesh-based GNN representations in a manner similar to spectral (or finite) element discretizations, a baseline GNN layer (termed a message passing layer, which updates local node properties) is modified to account for synchronization of coincident graph nodes, rendering compatibility with commonly used element-based mesh connectivities. Furthermore, the architecture is multiscale in nature, and is comprised of a combination of coarse-scale and fine-scale message passing layer sequences (termed processors) separated by a graph unpooling layer. The coarse-scale processor embeds a query element (alongside a set number of neighboring coarse elements) into a single latent graph representation using coarse-scale synchronized message passing over the element neighborhood, and the fine-scale processor leverages additional message passing operations on this latent graph to correct for interpolation errors. Demonstration studies are performed using hexahedral mesh-based data from Taylor–Green Vortex and backward-facing step flow simulations at Reynolds numbers of 1600 and 3200. Through analysis of both global and local errors, the results ultimately show how the GNN is able to produce accurate super-resolved fields compared to targets in both coarse-scale and multiscale model configurations. Reconstruction errors for fixed architectures were found to increase in proportion to the Reynolds number. Geometry extrapolation studies on a separate cavity flow configuration show promising cross-mesh capabilities of the super-resolution strategy.

Backward-facing step↗

DOE OSTI2024

Relating flow resistance to equivalent roughness

Describing flow resistance using the physical properties of an underlying surface is a recalcitrant problem in overland flow models. If discharge measurements are available, an equivalent roughness (e.g., Manning’s n) can be calibrated to represent the effects of surface properties within the domain with a single numerical value. Alternatively, the flow resistance can be estimated from discharge and velocity measured at a point, typically a runoff plot outlet. However, such experimental estimates are often inconsistent with the equivalent roughness determined from calibration to discharge, even if both derive from the same dataset. For example, if Manning’s equation is used to parameterize flow resistance, the Manning’s n obtained by calibrating a model to discharge differs from the value of n calculated from measured flow and velocity at the hillslope outlet. Here, this discrepancy is resolved by deriving a correction factor relating experimentally-determined flow resistance to the equivalent roughness. The derived correction factor is tested for four commonly-used resistance formulations using 129 rainfall simulator experiments. The correction factor is necessary to reproduce measured velocities, and yields minor improvements in discharge prediction. Plain Language Summary: Accurate runoff prediction is needed for land and water management in dryland regions, where sporadic and limited rainfall necessitate efficient water use and drought mitigation strategies. The skill of runoff models is known to be hindered by out ability to estimate flow resistance, which is the quantity that describes how energy is lost from flowing water to the underlying surface. Typically, models represent flow resistance with an equivalent roughness, e.g., Manning’s n, that is adjusted until the model can reproduce available discharge observations at watershed scale. However, the flow resistance measured in plot-scale experiments (1–10 m) often exceeds equivalent roughness coefficients by a factor of 10. This means that the direct use of plot-scale experimental data to parameterize runoff models could cause errors in discharge and runoff velocity predictions. Here, we resolve these differences by deriving an analytic correction factor that relates flow resistance to the equivalent roughness required for models to reproduce experimental velocity and discharge data. This correction factor is tested using rainfall simulator data from 129 experiments performed in the US Southwest covering a wide range of precipitation intensities, soil textures and vegetation types. Use of the correction factor substantially improves model prediction of flow velocity, which is needed for reproducing the timing of flood events and the estimation of erosion.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Microsecond Molecular Dynamics Simulations of Proteins Using a Quasi-Equilibrium Solvation Shell Model

In this work, we describe the development and implementation of a quasi-equilibrium hydration shell model of biomolecular solvation with adaptive boundaries. Applying the model to microsecond-long molecular dynamics simulations of several protein systems of varying complexity, we find that the model simulation results are of comparable quality to those obtained from simulations of fully solvated systems, but at a reduced computational cost. We discuss the dominant sources of error in the model and outline directions for future improvements.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗