Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,495 records · Page 83

Nitrification, denitrification, and competition for soil N : Evaluation of two Earth System Models against observations

Abstract Earth System Models (ESMs) have implemented nitrogen (N) cycles to account for N limitation on terrestrial carbon uptake. However, representing inputs, losses, and recycling of N in ESMs is challenging. Here, we use global rates and ratios of key soil N fluxes, including nitrification, denitrification, mineralization, leaching, immobilization, and plant uptake (both NH 4 + and NO 3 − ), from the literature to evaluate the N cycles in the land model components of two ESMs. The two land models evaluated here, E3SM Land Model version 1 (ELMv1)‐ECA and CLM5.0, originated from a common model but have diverged in their representation of plant–microbe competition for soil N. The models predict similar global rates of gross primary productivity (GPP) but have approximately two‐fold to three‐fold differences in their underlying global mineralization, immobilization, plant N uptake, nitrification, and denitrification fluxes. Both models dramatically underestimate the immobilization of NO 3 − by soil bacteria compared with literature values and predict dominance of plant uptake by a single form of mineral nitrogen (NO 3 − for ELM, with regional exceptions, and NH 4 + for CLM5.0). CLM5.0 strongly underestimates the global ratio of gross nitrification:gross mineralization and both models are likely to substantially underestimate the ratio of nitrification:denitrification. Few experimental data exist to evaluate this last ratio, in part because nitrification and denitrification are quantified using different techniques and because denitrification fluxes are difficult to measure at all. More observational constraints on soil nitrogen fluxes such as nitrification and denitrification, as well as greater scrutiny of the functional impact of introducing separate NH 4 + and NO 3 − pools into ESMs, could help to improve confidence in present and future simulations of N limitation on the carbon cycle.

Nevison, Cynthia↗

A modeling framework for designing and evaluating curbside traffic management policies at Dallas-Fort Worth International Airport

Emerging mobility technologies are changing the transportation system landscape. This is especially evident at airports, such as the Dallas-Fort Worth International Airport (DFW). Without careful analysis, these changes could lead to inefficient and costly airport operations. This paper presents a modeling framework that integrates travel mode encoding, demand projection, and microsimulation to enable airports to develop, simulate, and evaluate curbside traffic managements policies and measure their impact. Here, the framework is utilized to analyze several traffic scenarios and policies for DFW: a baseline scenario which represents DFW traffic pattern as observed in 2018 and projected to 2045, a transit network company (TNC) electrification policy, a TNC queuing policy, a policy that increased transit ridership, a bus-only policy which considers the use of only buses inside DFW, an autonomous vehicle (AV) policy which investigates the impact of autonomous vehicle (AV) adoption on airport operations, and an example COVID-19 scenario which models the impact of the COVID19 pandemic. The simulations’ results demonstrate that: increasing the DFW transit ridership postpones the need for airport curbside expansion the most; encouraging shared-mobility with the bus-only policy produces the most savings in curbside congestion delays; automation and electrification for all passenger vehicle trips to/from DFW generates the most saving in fuel consumption and emissions; and uncontrolled AV adoption incurs the highest increase in fuel consumption, delay, and emissions and could require immediate airport capacity extension. Without policy intervention or investment in additional infrastructure capacity, these results predict the current operations would face significant congestion on high demand days starting as early as 2028. While derived in close partnership with DFW, the methodology presented here can be generalized to any airport.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Confronting Models with Regional CO 2 Observations

This research addressed an important DOE science area: the role of natural disturbances in carbon cycling. Our project included both (a) modeling and field measurements and (b) strengthened ties between DOE national laboratories and universities which continue after the project was completed. Our focus was on understanding the consequences of drought and emissions (fire and urban) to atmospheric trace gas composition (carbon dioxide, carbon monoxide, and methane), including both concentration and stable isotope composition. Measurements of these atmospheric gases were used to infer the spatial and temporal patterns of both sources and sinks in the carbon cycle. As part of this effort, we maintained two long-term monitoring networks along a geographic gradient in Utah and Colorado that spans montane forests, urban regions, and oil/gas fields. In this research, we expanded on a well-accepted atmospheric model (STILT-WRF) as a tool to evaluate fluxes in CLM/CESM-related models. We used the STILT model to provide a strong linkage between point atmospheric measurements and the surface parameterizations/emissions that are part of the CLM/CESM models. Overall, this project benefited and supported the DOE Long Term Mission and Goals in four distinct ways: (a) testing of carbon cycle models, (b) testing and evaluating model mechanisms whereby factors in CLM influence trace gas composition in CESM, (c) acquiring high-quality, long-term data on concentrations of carbon dioxide in western USA ecosystems, and (d) by reducing uncertainties associated with the representation of climate-carbon feedbacks in Earth System models through the development of new methods for evaluating model performance. One postdoctoral associate (Henrique Duarte) and one Ph.D. student (Darek Malia) were trained with this support. Nine peer-reviewed publications and 14 poster presentations were produced with support from this project. This proposal addresses a specific science area in the RFP: the role of natural disturbances in carbon cycling. In particular, we will focus on the consequences of drought and fire at landscape to regional scales for atmospheric trace gas concentration and stable isotope composition (CO 2 , CO, and CH 4 ). We seek to expand on the well accepted atmospheric Stochastic Time-Inverted Lagrangian Transport (STILT) model coupled to the Weather Research and Forecasting (WRF) model as a tool to evaluate stable isotope fluxes in CLM/CESM-related models through existing, long-term data sets and field campaigns where high-precision trace gas concentration and isotope measurements can be made along gradients and transects. Given the confounding impacts of anthropogenic trace gas emissions on landscape-to-regional atmospheric observations, we will also measure and parameterize isotopic characteristics of CO 2 , CO, and CH 4 from anthropogenic or forest sources in order to allow us the opportunity to partition atmospheric trace gases into natural and anthropogenic sources.

54 ENVIRONMENTAL SCIENCES↗

An Evaluation of Semiempirical Models for Partitioning Photosynthetically Active Radiation Into Diffuse and Direct Beam Components

Photosynthesis is more efficient under diffuse than direct beam photosynthetically active radiation (PAR) per unit PAR, but diffuse PAR is infrequently measured at research sites. We examine four commonly used semiempirical models (Erbs et al., 1982, https://doi.org/10.1016/0038-092X(82)90302-4; Gu et al., 1999, https://doi.org/10.1029/1999JD901068; Roderick, 1999, https://doi.org/10.1016/S0168- 1923(99)00028-3; Weiss & Norman, 1985, https://doi.org/10.1016/0168-1923(85)90020-6) that partition PAR into diffuse and direct beam components based on the negative relationship between atmospheric transparency and scattering of PAR. Radiation observations at 58 sites (140 site years) from the La Thuille FLUXNET data set were used for model validation and coefficient testing. All four models did a reasonable job of predicting the diffuse fraction of PAR (Φ) at the 30 min timescale, with site median r2 values ranging between 0.85 and 0.87, model efficiency coefficients (MECs) between 0.62 and 0.69, and regression slopes within 10% of unity. Model residuals were not strongly correlated with astronomical or standard meteorological variables. We conclude that the Roderick (1999, https://doi.org/10.1016/S0168- 1923(99)00028-3) and Gu et al. (1999, https://doi.org/10.1029/1999JD901068) models performed better overall than the two older models. Using the basic form of these models, the data set was used to find both individual site and universal model coefficients that optimized predictive accuracy. A new universal form of the model is presented in section 5 that increased site median MEC to 0.73. Site-specific model coefficients increased median MEC further to 0.78, indicating usefulness of local/regional training of coefficients to capture the local distributions of aerosols and cloud types.

54 ENVIRONMENTAL SCIENCES↗

Gamma Radiation-Induced Degradation of Acetohydroxamic Acid (AHA) in Aqueous Nitrate and Nitric Acid Solutions Evaluated by Multiscale Modelling

Acetohydroxamic acid (AHA) has been proposed for inclusion in advanced, single-cycle, used nuclear fuel reprocessing solvent systems for the reduction and complexation of plutonium and neptunium ions. For this application, a detailed description of the degradation of AHA in dilute aqueous nitric acid is required. To this end, we present a comprehensive, multiscale computer model for the coupled radiolytic and hydrolytic degradation of AHA in aqueous sodium nitrate and nitric acid solutions. Rate coefficients for the reactions of AHA and HA with the oxidizing nitrate radical were measured for the first time using pulsed electron radiolysis and used as inputs in the kinetic model. The computer model results are validated by comparison to experimental data from steady state gamma irradiations, for which the agreement is excellent. Here, the presented model accurately predicts the yields of the major degradation products of AHA: acetic acid, hydroxylamine, nitrous oxide, and molecular hydrogen.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

RNA target highlights in CASP15 : Evaluation of predicted models by structure providers

Abstract The first RNA category of the Critical Assessment of Techniques for Structure Prediction competition was only made possible because of the scientists who provided experimental structures to challenge the predictors. In this article, these scientists offer a unique and valuable analysis of both the successes and areas for improvement in the predicted models. All 10 RNA‐only targets yielded predictions topologically similar to experimentally determined structures. For one target, experimentalists were able to phase their x‐ray diffraction data by molecular replacement, showing a potential application of structure predictions for RNA structural biologists. Recommended areas for improvement include: enhancing the accuracy in local interaction predictions and increased consideration of the experimental conditions such as multimerization, structure determination method, and time along folding pathways. The prediction of RNA–protein complexes remains the most significant challenge. Finally, given the intrinsic flexibility of many RNAs, we propose the consideration of ensemble models.

59 BASIC BIOLOGICAL SCIENCES↗

Bayesian Networks for Social Modeling

This paper describes a body of work developed over the past five years. The work addresses the use of Bayesian network (BN) models for representing and predicting social/organizational behaviors. The topics covered include model construction, validation, and use. These topics show the bulk of the lifetime of such model, beginning with construction, moving to validation and other aspects of model ‘critiquing’, and finally demonstrating how the modeling approach might be used to inform policy analysis. To conclude, we discuss limitations of using BN for this activity and suggest remedies to address those limitations. The primary benefits of using a well-developed computational, mathematical, and statistical modeling structure, such as BN, are 1) there are significant computational, theoretical and capability bases on which to build 2) ability to empirically critique the model, and potentially evaluate competing models for a social/behavioral phenomena.

99 GENERAL AND MISCELLANEOUS↗

Application of machine learning to evaluating and remediating models for energy and environmental engineering

Machine learning (ML) algorithms have been increasingly successful in their applications to solve energy and environmental engineering problems. ML algorithms have the advantage of being able to solve highly nonlinear issues effectively. Furthermore, considering the limited sample size of data collected in energy and environmental engineering, obtaining a ML model with reasonable accuracy is simple. Unfortunately, the vast majority of the current applications of ML algorithms lack effective screening of dominant factors and comprehensive model validation, which weakens the predictive ability of the models. The present study takes the minimum miscible pressure (MMP) of CO 2 - oil systems as an example. It establishes a systematic and robust predictive model to address this issue. Based on 147 sets of slim tube tests, the predictive models of the MMPs are investigated by application of eight ML algorithms. The paper concludes that most of the published ML models in the field of energy and environmental engineering prediction are not reliable. Furthermore, it addresses the main reasons for the poor performance of some predictive models built by ML and provides guidelines on how to make such models robust. Further, to the best of our knowledge, this is the first study to point out the defects of current ML modeling methods and propose countermeasures for their application in energy and environmental engineering problems.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Physics-based hybrid machine learning for critical heat flux prediction with uncertainty quantification

Critical heat flux (CHF) is a key quantity in nuclear system modeling due to its impact on heat transfer, safety margins, and reactor performance. This study develops and validates an uncertainty-aware hybrid modeling approach that combines machine learning with physics-based models to predict CHF in cases of dryout. The Biasi and Bowring empirical correlations were paired with three ML uncertainty quantification (UQ) techniques: deep neural network (DNN) ensembles, Bayesian neural networks (BNNs), and deep Gaussian processes (DGPs). A pure ML model without a base model was evaluated for comparison. Model performance was assessed under plentiful (7,350 points) and limited (9 points) training data scenarios using parity, uncertainty distributions, and calibration curves. Results show that the Biasi hybrid DNN ensemble achieved the best overall performance, with a mean absolute relative error of 1.846%, and well-calibrated uncertainty estimates. The BNN-based hybrids showed slightly higher error (2.14%) but superior uncertainty calibration. DGP models underperformed, with over 6% error and poor uncertainty calibration. All hybrid models outperformed pure machine learning configurations, demonstrating resistance against data scarcity. These findings indicate that hybrid modeling significantly improves predictive accuracy, interpretability, and resilience to data scarcity. The integration of uncertainty awareness provides actionable confidence in CHF predictions, which is vital for safety-critical decisions in nuclear applications. This hybrid approach offers a viable pathway for deploying ML models in reactor analysis tools while preserving domain knowledge and physical consistency.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A DNS evaluation of mixing models for transported PDF modelling of turbulent nonpremixed flames

Transported probability density function (TPDF) approaches are well suited to modelling turbulent, reacting, variable density flows. One of the main challenges to the successful deployment of TPDF methods is accurately modelling the unclosed molecular mixing term. This study examines three of the most widely used mixing models: the Interaction by Exchange with the Mean (IEM), Modified Curl (MC) and Euclidean Minimum Spanning Tree (EMST) models. Direct numerical simulation (DNS) data-sets were used to provide both initial conditions and inputs needed over the course of the runs, including the mean flow velocities, mixing frequency, and the turbulent diffusion coefficient. The same chemical mechanism and thermodynamic properties were used, allowing the study to focus on the mixing model. The simulation scenario was a one-dimensional, nonpremixed, turbulent jet flame burning either a syngas or ethylene fuel stream that featured extinction and reignition. This test scenario was selected because extinction and reignition phenomena are sensitive to the mixing model. Three DNS cases were considered for both the syngas and ethylene cases with a parametric variation of Reynolds and Damköhler numbers, respectively. Extinction events became more popular with increasing Reynolds number in the syngas cases and with decreasing Damköhler number in the ethylene cases. The model was first tested with the mixing frequency defined from the dissipation rate and variance of mixture fraction. With this definition, for the syngas cases this study finds that the TPDF method is successful at predicting flame extinction and reignition using all three mixing models for the relatively lower and intermediate Reynolds number cases, but that all models under-predict reignition in the relatively higher Reynolds number case. In the ethylene fuelled cases, only the EMST mixing model correctly predicts the reignition event for the two higher Damköhler number cases, yet, in the lowest Damköhler number case the EMST model over-predicts reignition and the IEM and MC models under-predict it. Mixing frequency was then modelled based on the turbulence frequency and a model constant $C_{\phi}$, the ratio of scalar to mechanical mixing rates. The DNS cases were reexamined with this definition and the findings suggested that the optimal value for $C_{\phi}$ is mixing model and case dependent. In particular, it was found in the ethylene case considered that reignition could be achieved with the IEM and MC models by adjusting the value of $C_{\phi}$.

42 ENGINEERING↗

Critical evaluation and thermodynamic modeling of the Pd–Sn system

The single crystalline material PdSn 4 , a homologue of the Dirac nodal arc semimetal PtSn 4 , is a promising candidate to search for new topological states with fascinating quantum physical properties. In the present work, the thermochemistry and phase diagram information of the Pd–Sn system published in the literature was collected and critically reviewed, two thermodynamic reassessments of the Pd–Sn system were carried out in the frame of the CALPHAD approach to optimize the Gibbs free energy of each phase presented in the system. The liquid phase was described using respectively the Bragg-Williams random mixing model and the associate solution model. All the reliable thermodynamic property and phase equilibria data can be generally described using the presently obtained thermodynamic descriptions of the Pd–Sn system. Issues related to the further improvement of the thermodynamic descriptions of the Pd–Sn system are discussed.

36 MATERIALS SCIENCE↗

A Kinetic Model of the Long-Term Corrosion of Glass-Ceramic Materials

Multiphase waste forms show promise for increased waste loading and for the ability to dispose of contaminated solid and particulate waste through direct densification. However, achieving predictive capability for long-term durability of multiphase waste forms, and thus assessing their possible deployment, requires expanding the current, limited knowledge base. Here, we describe the development of a corrosion model of a two-phase waste form consisting of crystals of known volume fraction embedded in a glass matrix. This model accounts for the dissolution of both the crystalline and glass phases as well as the hydration of the glass phase through an ion exchange reaction. Because of the large difference in solubility between the two phases, the reactive surface of the crystalline phase is a function of the extent of dissolution of the glass phase in this model. Model parameterization was performed using corrosion data, such as from single-pass flow-through tests, for the individual phases. The parameterized corrosion model was evaluated against static dissolution test data for a glass-ceramic multiphase waste form. This evaluation demonstrated the model’s ability to reproduce the time-dependent release of key tracers of glass and crystalline phase dissolution. Hence, the development of a kinetic model provides a pathway for long-term durability predictions and thus the use of multiphase waste forms in nuclear cleanup missions.

Kerisit, Sebastien N.↗