Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model comparison”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Physics-based hybrid machine learning for critical heat flux prediction with uncertainty quantification

Critical heat flux (CHF) is a key quantity in nuclear system modeling due to its impact on heat transfer, safety margins, and reactor performance. This study develops and validates an uncertainty-aware hybrid modeling approach that combines machine learning with physics-based models to predict CHF in cases of dryout. The Biasi and Bowring empirical correlations were paired with three ML uncertainty quantification (UQ) techniques: deep neural network (DNN) ensembles, Bayesian neural networks (BNNs), and deep Gaussian processes (DGPs). A pure ML model without a base model was evaluated for comparison. Model performance was assessed under plentiful (7,350 points) and limited (9 points) training data scenarios using parity, uncertainty distributions, and calibration curves. Results show that the Biasi hybrid DNN ensemble achieved the best overall performance, with a mean absolute relative error of 1.846%, and well-calibrated uncertainty estimates. The BNN-based hybrids showed slightly higher error (2.14%) but superior uncertainty calibration. DGP models underperformed, with over 6% error and poor uncertainty calibration. All hybrid models outperformed pure machine learning configurations, demonstrating resistance against data scarcity. These findings indicate that hybrid modeling significantly improves predictive accuracy, interpretability, and resilience to data scarcity. The integration of uncertainty awareness provides actionable confidence in CHF predictions, which is vital for safety-critical decisions in nuclear applications. This hybrid approach offers a viable pathway for deploying ML models in reactor analysis tools while preserving domain knowledge and physical consistency.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Nanoparticle dynamics in the spatial afterglows of nonthermal plasma synthesis reactors

Nonthermal plasma flow tube reactors are industrially scalable systems for the production of nanocrystal (NC) based materials and coatings. One key advantage of nonthermal plasma synthesis is the ability to both synthesize NCs and deposit films in a single reactor, as at the reactor outlet, NCs can be inertially deposited onto a target substrate. The size and morphology of deposited particles can substantially influence the film structure and function. Though NCs are typically near-spherical and monodispersed as-produced in plasma synthesis reactors, NC charge and growth dynamics can be altered substantially when NCs are sampled out of the plasma and through the spatial afterglow region, affecting deposition. Experiments have demonstrated changes of NC size and charge in the spatial afterglow; however, these dynamics remain unexplored and unexplained via theory and simulation. To address this, we developed a constant number Monte Carlo (CNMC) simulation model to examine the mechanisms of NC decharging and growth in the spatial afterglow of plasma flow tube reactors. Collisions between NC and plasma species, diffusive deposition, and electron desorption from NCs are incorporated in the CNMC simulation. The simulation results are specifically compared with previous experiments on Si NCs synthesized from a low pressure Ar-SiH 4 nonthermal plasma reactor. Furthermore, the experiment-model comparison shows that CNMC models can be implemented which accurately model NC size distribution evolution in a spatial afterglow. Simultaneously, results show that improved collision models, energetic species diffusion models, and electron desorption models will be necessary to accurately depict NC dynamics in spatial afterglows.

42 ENGINEERING↗
DOE OSTI2026

A parametric study of slow dynamic nonlinear elasticity with comparisons to models

Several phenomenological models that aspire to quantitative description of anomalous nonlinear mesoscopic elasticity are reviewed and compared with laboratory measurements. This class of nonlinearity, best known perhaps for slow dynamics and aging, is seen widely in imperfectly consolidated granular solids but is not well understood. Typical slow dynamic tests show that a modest conditioning oscillatory "pump" strain depresses material stiffness, which then recovers like the logarithm of time after conditioning ceases. Several phenomenological models based on physical arguments have been proposed that predict the material stiffness response to arbitrary pump strain histories during conditioning and recovery. Approximate closed form and numerical solutions to the models are presented that predict the quantitative influence of three key pump parameters: the pump's strain amplitude, the pump's strain rate, and the pump’s duration. Laboratory measurements on Berea sandstone, concrete and a confined single aluminum bead find that slow dynamic responses are linear in pump strain and independent of pump frequency. Measurements also show that, after pump-off, stiffness recovers over times far longer than the pump duration. These observations and others are compared to model predictions. One of the considered models, based on a picture of fast brittle damage and slow healing, successfully matches all these behaviors.

36 MATERIALS SCIENCE↗
DOE OSTI2024

A comparison of model validation approaches for echo state networks using climate model replicates

As global temperatures continue to rise, climate mitigation strategies such as stratospheric aerosol injections (SAI) are increasingly discussed, but the downstream effects of these strategies are not well understood. As such, there is interest in developing statistical methods to quantify the evolution of climate variable relationships during the time period surrounding an SAI. Feature importance applied to echo state network (ESN) models has been proposed as a way to understand the effects of SAI using a data-driven model. This approach depends on the ESN fitting the data well. If not, the feature importance may place importance on features that are not representative of the underlying relationships. Typically, time series prediction models such as ESNs are assessed using out-of-sample performance metrics that divide the times series into separate training and testing sets. However, this model assessment approach is geared towards forecasting applications and not scenarios such as the motivating SAI example where the objective is using a data driven model to capture variable relationships. Here, in this paper, we demonstrate a novel use of climate model replicates to investigate the applicability of the commonly used repeated hold-out model assessment approach for the SAI application. Simulations of an SAI are generated using a simplified climate model, and different initialization conditions are used to provide independent training and testing sets containing the same SAI event. The climate model replicates enable out-of-sample measures of model performance, which are compared to the single time series hold-out validation approach. For our case study, it is found that the repeated hold-out sample performance is comparable, but conservative, to the replicate out-of-sample performance when the training set contains enough time after the aerosol injection.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Posterior comparison of model dynamics in several hybrid turbulence model forms

Hybrid turbulence models that can accurately reproduce unsteady three-dimensional flow physics across the entire range of grid scales and turbulence dynamics from Reynolds-averaged Navier–Stokes (RANS), through large-eddy simulation (LES), down to direct numerical simulations (DNS) are of increasing interest to the turbulence modeling community. However, despite decades of research and development, the basic tasks of eliminating poor-performing hybrid RANS-LES models and accelerating adoption of superior models through well-designed validation and verification have yet to occur. As a step in this direction, in this work we evaluate thirteen different hybrid RANS-LES models via systematic grid refinement of decaying homogeneous isotropic turbulence. We further derive a novel mathematical framework for assessing the energy partitioning dynamics of each Hybrid RANS-LES model, wherein model-to-model variations in energy partitioning can be interpreted as different feedback mechanisms operating on a low-dimensional nonlinear dynamical system. We found that model forms similar to the flow simulation methodology—also often termed very-large eddy simulation—are dynamically inconsistent with DNS at all resolutions. Additionally, we found a strong dynamical similarity in the feedback mechanisms of all models related to detached eddy simulation and partially averaged Navier–Stokes that is inherent to their general model forms.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Vertex finding in neutrino-nucleus interaction: a model architecture comparison

We compare different neural network architectures for machine learning algorithms designed to identify the neutrino interaction vertex position in the MINERvA detector. The architectures developed and optimized by hand are compared with the architectures developed in an automated way using the package “Multi-node Evolutionary Neural Networks for Deep Learning” (MENNDL), developed at Oak Ridge National Laboratory. While the domain-expert hand-tuned network was the best performer, the differences were negligible and the auto-generated networks performed as well. There is always a trade-off between human, and computer resources for network optimization and this work suggests that automated optimization, assuming resources are available, provides a compelling way to save significant expert time.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Comparison of Model Predictions and Performance Test Data for a Prototype Thermal Energy Storage Module

Although model predictions of thermal energy storage (TES) performance have been explored in previous investigations, relevant test data that enable experimental validation of performance models have been limited. This is particularly true for high-performance TES designs that facilitate fast input and extraction of energy. In this paper, we present a summary of experimental tests of a high-performance TES unit using lithium nitrate trihydrate phase change material as a storage medium. Performance data are presented for complete dual-mode cycles consisting of extraction (melting) followed by charging (freezing). These tests simulate the cyclic operation of a TES unit for asynchronous cooling in a variety of applications. Finally, the model analysis is found to agree reasonably well, within 10%, with the experimental data except for conditions very near the initiation of freezing, a consequence of subcooling that is required to initiate solidification.

25 ENERGY STORAGE↗
DOE OSTI2022

Evaluating Tropical Precipitation Relations in CMIP6 Models with ARM Data

Abstract A set of diagnostics based on simple, statistical relationships between precipitation and the thermodynamic environment in observations is implemented to assess phase 6 of the Coupled Model Intercomparison Project (CMIP6) model behavior with respect to precipitation. Observational data from the Atmospheric Radiation Measurement (ARM) permanent field observational sites are augmented with satellite observations of precipitation and temperature as an observational baseline. A robust relationship across observational datasets between column water vapor (CWV) and precipitation, in which conditionally averaged precipitation exhibits a sharp pickup at some critical CWV value, provides a useful convective onset diagnostic for climate model comparison. While a few models reproduce an appropriate precipitation pickup, most models begin their pickup at too low CWV and the increase in precipitation with increasing CWV is too weak. Convective transition statistics compiled in column relative humidity (CRH) partially compensate for model temperature biases—although imperfectly since the temperature dependence is more complex than that of column saturation. Significant errors remain in individual models and weak pickups are generally not improved. The conditional-average precipitation as a function of CRH can be decomposed into the product of the probability of raining and mean precipitation during raining times (conditional intensity). The pickup behavior is primarily dependent on the probability of raining near the transition and on the conditional intensity at higher CRH. Most models roughly capture the CRH dependence of these two factors. However, compensating biases often occur: model conditional intensity that is too low at a given CRH is compensated in part by excessive probability of precipitation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Koopman-Based Approach to Nonintrusive Reduced Order Modeling: Application to Aerodynamic Shape Optimization and Uncertainty Propagation

A methodology for nonintrusive projection-based nonlinear model reduction originally presented by Renganathan et al. is further extended here toward parametric systems with a focus on application to aerospace design. Specifically, the method is extended to address static systems with parametric geometry (that deforms the mesh) in addition to parametric freestream boundary conditions. The main idea is to first perform a transformation on the governing equations such that it is lifted to a higher-dimensional but linear underdetermined system. This enables one to extract the system matrices easily as compared to that of the original nonlinear system. The underdetermined system is closed with a set of model-dependent nonlinear constraints upon which the model reduction is finally performed. The methodology is validated on the subsonic and transonic inviscid flows past the NACA0012 and the RAE2822 airfoils with parametrized shapes. The utility of the approach is further demonstrated by applying it to two common problems in aerospace design, namely, derivative-free global optimization and parametric uncertainty quantification with Monte Carlo sampling. Overall, the methodology is shown to achieve accuracy up to 5% and computational speedup of two to three orders of magnitude relative to the full order model. Comparison against another nonintrusive model reduction method revealed that the proposed approach is more robust, accurate, and retains the consistency between the state variables.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Addressing deep array effects and impacts to wake steering with the cumulative-curl wake model

Abstract. Wind farm design and analysis heavily rely on computationally efficient engineering models that are evaluated many times to find an optimal solution. A recent article compared the state-of-the-art Gauss-curl hybrid (GCH) model to historical data of three offshore wind farms. Two points of model discrepancy were identified therein: poor wake predictions for turbines experiencing a lot of wakes and wake interactions between two turbines over long distances. The present article addresses those two concerns and presents the cumulative-curl (CC) model. Comparison of the CC model to high-fidelity simulation data and historical data of three offshore wind farms confirms the improved accuracy of the CC model over the GCH model in situations with large wake losses and wake recovery over large inter-turbine distances. Additionally, the CC model performs comparably to the GCH model for single- and fewer-turbine wake interactions, which were already accurately modeled. Lastly, the CC model has been implemented in a vectorized form, greatly reducing the computation time for many wind conditions. The CC model now enables reliable simulation studies for both small and large offshore wind farms at a low computational cost, thereby making it an ideal candidate for wake-steering optimization and layout optimization.

17 WIND ENERGY↗