Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model validation and calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Development of CTF modeling of interfacial drag, wall shear, and interfacial heat transfer for bubbly and annular-mist flow regimes

This milestone report discusses improvements to CTF closure models for modeling of bubbly and annular mist two-phase flow conditions, which are important for accurate modeling and simulation for boiling water reactor (BWR) conditions. Models that were improved include the two-phase wall shear, wall boiling, and phase mass and heat transfer. A new flow regime map was implemented to improve on the prediction of transition to annular flow, which was generally largely over-predicted by the legacy CTF flow regime map. The annular mist interfacial drag models were also reviewed and new models were proposed for implementation into the code. In addition to implementing new models, an activity was performed to calibrate these new models to experimental data using a Markov Chain Monte Carlo technique, thus further improving their accuracy. Finally, new experiments were implemented into the CTF validation matrix which add more two-phase pressure drop and void measurements for the assessment of CTF for modeling of BWRs. The results show that the Chisholm model, which was implemented and then calibrated, results in significantly improved comparison against the Riso two-phase pressure drop data. Furthermore, improvements in the implicit heat transfer and wall boiling models resulted in good agreement with the void measurement data.

42 ENGINEERING↗

Comparison of temperature adaptive calibration methods for laser induced fluorescence based fuel-in-oil instrument

Fuel dilution of engine oil (or fuel-in-oil, FiO) is an important issue as multiple and late-cycle fuel injection, integral to many combustion efficiency and emissions improvements (e.g., downsized boosted gasoline engines and catalyst thermal management) increases FiO rate. In addition to causing general wear and corrosion in engine due to decreased oil viscosity and pH buffering, FiO is also believed to cause destructive low speed pre-ignition (or super knock) in boosted SI engines. To understand the effects of engine operating conditions on the FiO rate, an optical diagnostic capable of measuring transient FiO on minute timescales was recently developed and demonstrated on a modified GM Ecotech engine system (Neupane et al., Applied Spectroscopy 2021). The measurement is based on adding a dye to the fuel and monitoring for its presence in oil via laser-induced fluorescence (LIF). The measured LIF signal is related to FiO concentration via pre-determined calibration factors using a multivariate classical least square (CLS) method.Since fluorescence quantum yield is a function of temperature, measured LIF intensity not only depends on FiO concentration but also oil temperature. To expand the applicability of the FiO diagnostic to transient oil-temperature conditions (e.g., cold start in practical engines), this study develops a method to account for oil-temperature variations. The effect of oil temperature (20°C - 95°C) on the LIF spectra of eight FiO samples ranging from ~0.8-15% was investigated. LIF intensities of the FiO samples decreased linearly with increasing temperature; the reductions being more significant at dye peaks. We develop a new calibration model (T-adaptive CLS) incorporating the temperature (T) effects on LIF intensity that enables simultaneous calculation of FiO and oil temperature. The improved FiO diagnostic with T-adaptive calibration is more robust, and applicable to varying oil-temperature conditions. For example, when strategies such as multiple/late fuel injections are applied to overcome cold-start instability due to use of low vaporization bio-based fuels such as ethanol, FiO rate is expected to be very high; the improved T-adaptive FiO diagnostic is hence relevant for engine- and fuel-system calibration and optimization. The diagnostic could also provide validation data for flow-field and spray interaction CFD models, further broadening the diagnostic’s utility for advancing engine technology and efficiency.

Neupane, Sneha↗

Validation and Verification of TEDS Facility HYBRID Modeling

The HYBRID modeling repository is an in-house developed library of models for selected integrated energy systems (IES) modelling. HYBRID models have been developed since 2015 to describe the physical operation of tightly coupled thermal systems including power generators, thermal transport systems, thermal storage, thermal-to-electric conversion systems, and other thermal applications. Here, validation and verification (V&V) capabilities are demonstrated using the Thermal Energy Distribution System (TEDS) at INL. Building upon prior work, the TEDS model has been updated and verified so that it better represents the installed system configuration and the operating control system. The model control system was changed to allow replication of actual experimental procedures. Experimental operations focusing primarily on thermocline tank performance were devised and performed. Several anomalies were found in the operation data of the experiment facility. V&V activities calibrating a selected input parameter are demonstrated on a single component as well as with a single parameter within the thermocline. Calibrating is then demonstrated on multiple components and a multi-parameter metric for the entire system. The validation methodology is successfully applied to validate the model with experimental data. It is also used to confirm a hypothesis behind one of the anomalies in experimental performance.

25 ENERGY STORAGE↗

Vector-level feedforward control of LPBF melt pool area using a physics-based thermal model

Laser powder bed fusion (LPBF) is an additive manufacturing technique that has gained popularity thanks to its ability to produce geometrically complex, fully dense metal parts. However, these parts are prone to internal defects and geometric inaccuracies, stemming in part from variations in the melt pool. Here, this paper proposes a novel vector-level feedforward control framework for regulating melt pool area in LPBF. By decoupling part-scale thermal behavior from small-scale melt pool physics, the controller provides a scale-agnostic prediction of melt pool area and efficient optimization over it. This is done by operating on two coupled lightweight models: a finite-difference thermal model that efficiently captures vector-level temperature fields and a reduced-order, analytical melt pool model. Each model is calibrated separately with minimal single-track and 2D experiments, and the framework is validated on a complex 3D geometry in both Inconel 718 and 316L stainless steel. Results showed that feedforward vector-level laser power scheduling reduced geometric inaccuracy in key dimensions by 62%, overall porosity by 16.5%, and photodiode root-mean-squared deviation by 38.5% on average. Overall, this modular, data-efficient approach demonstrates that proactively compensating for known thermal effects can significantly improve part quality while remaining computationally efficient and readily extensible to other materials and machines.

Additive manufacturing↗

Spitzer IRAC Photometry of JWST Calibration Stars

We present infrared photometry of all 36 potential JWST calibrators for which there is archival Spitzer IRAC data. This photometry can then be used to inform the stellar models necessary to provide absolute calibration for all JWST instruments. We describe in detail the steps necessary to measure IRAC photometry from archive retrieval to photometric corrections. To validate our photometry, we examine the distribution of uncertainties from all detections in all four IRAC channels as well as compare the photometry and its uncertainties to those from models, ALLWISE, and the literature. Seventy-five percent of our detections have standard deviations per star of all observations within each channel of less than 3%. The median standard deviations are 1.2%, 1.3%, 1.1%, and 1.9% in [3.6]–[8.0], respectively. We find less than 8% standard deviations in differences of our photometry with ALLWISE and excellent agreement with literature values (less than 3% difference), lending credence to our measured fluxes. JWST is poised to do groundbreaking science, and accurate calibration and cross-calibration with other missions will be part of the underpinnings of that science.

47 OTHER INSTRUMENTATION↗

Speaker-targeted Synthetic Speech Detection

Text-to-speech technologies are evolving quickly towards realistic-sounding human-like voices. As this technology improves, so does the opportunity for malpractice in speaker identification (SID) via spoofing, the process of impersonating a voice biometric via synthesis. More data typically equates to a more realistic voice model, which poses an issue for well-known subjects, such as politicians and celebrities, who have vast amounts of multimedia available online. Detection of synthetic speech has relied on signal processing techniques that focus on the generation of new acoustic features and train deep learning models to detect when an audio file has been manipulated through the characterization of unnatural changes or artifacts. However, these techniques do not use any information from the speaker they are evaluating. This paper proposes to incorporate information from the speaker-of-interest (SoI) into the models to avoid specific spoofing attacks for certain vulnerable people. The wealth of data for well-known people can also be used to train a speaker-specific spoofing detector with a higher level of accuracy than a speaker-independent model. The paper proposes a new xResNet-PLDA system and compares it to three different baseline systems: a state-of-the-art speaker identification system, an xResNet system trained to discriminate between bona fide and fake speech, and a speaker identification system in which the PLDA and calibration models were trained with bona fide and fake speech. We evaluated the systems in two different scenarios — a cross-validation scenario and a hold-out scenario — with three different databases. We show how the proposed system outperforms dramatically the baseline systems in each scenario and for each database. Finally, we show how using a small amount of the SoI’s speech to adapt global calibration parameters improves the performance of the system, especially in unseen conditions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Estimation of pipe failure frequencies in the absence of operational experience data: A pilot study

Probabilistic failure metrics such as leak frequency and rupture frequency are commonly used to characterize piping reliability. The methodologies for calculating the failure metrics rely on a complex set of input parameters. Operating experience data and experimental data play an important role in informing the different input parameters. The paper describes results and conclusions of a coordinated research project to benchmark three different reliability models using a four-step procedure: reference case definition of relevance to advanced reactor designs, input parameter calibration, validation of results, and application of different methodologies upon completion of the calibration and validation steps. The reference case is a weld consisting of nickel-base alloy 152/52 and located within a primary pressure boundary of an advanced reactor. This alloy is a class of structural materials known to be highly resistant to stress corrosion cracking. Synergies between the different methods are noted and the importance of a multi-disciplinary approach to input parameter development is underscored. A key conclusion is that the three methods are equally suitable for estimating failure frequencies. In any specific application, a selection of the most practical or effective computational tool can be considered. The comparison of alternative models confirms and helps to gain confidence in the computed failure frequency estimates. The study was part of a coordinated research project organized by the International Atomic Energy Agency.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Temperature-dependent mechanical properties and crystal plasticity parameters for additively manufactured Haynes-214 alloy: Experiments and numerical modeling

Our experimental mechanical testing data demonstrated that the additively manufactured (AM) laser powder bed fusion (L-PBF) Haynes-214 alloy exhibits non-linear mechanical properties as the temperature rises from ambient to 870 °C. Crystal plasticity (CP) simulations provide an effective approach to gaining deeper insights into microstructure-property linkages under thermomechanical loading. This method can reduce the need for costly high-temperature mechanical testing while accounting for the effects of crystallographic texture and grain morphology on the mechanical behavior of AM materials. However, calibrating a CP model is time-consuming because individual simulations are computationally expensive and hundreds (or more) of iterations over parameter sets may be required. To address this issue, we have designed a machine learning-differential evolution (ML-DE) CP framework that can accurately interpolate the tensile properties of AM L-PBF Haynes-214 alloy across a wide temperature range from ambient to 870 °C, with minimal reliance on experimental data. The framework uses electron backscatter diffraction (EBSD) measurements to generate statistically equivalent microstructural volume elements to serve as inputs to the CP modeling framework. Stress–strain curves were generated from 1000 CP simulations, which serve as the training data set for the three ML regression algorithms explored: linear, extra-trees, and multi-layer perceptron. These three regression models were independently evaluated to compare their efficiency and identify the most suitable algorithm for the given problem. Results revealed that the extra-trees ML regressor outperforms the other models in both qualitative and quantitative aspects with an R 2 of 0.98. Subsequently, the differential evolution optimization approach is employed to calibrate the ML-based CP material parameters with experimental results obtained at various temperatures. Finally, temperature-dependent CP material parameters are formulated. The effectiveness and efficiency of the designed framework are validated through comparison with experimental results, demonstrating a high degree of agreement. These calibrated parametric constitutive equations enable further use of the CP model to study the deformation behavior of this alloy under a wide range of thermo-mechanical loading conditions.

36 MATERIALS SCIENCE↗

A novel peridynamics-based approach to predict pharmaceutical tablet robustness

The pharmaceutical drug product development process can be greatly accelerated through the use of modeling and simulation techniques to predict the manufacturability and performance of a given formulation. The anticipation and possible mitigation of tablet damage due to manufacturing stresses represents a specific area of interest in the pharmaceutical industry for predicting formulation and tableting performance. While the finite element method (FEM) has been extensively used for predicting the mechanical behavior of powder material in the compaction processes, a shortcoming of the approach is the inherent difficulty to predict discontinuities (e.g., damage or cracking) within a tablet as FEM is a continuum-based approach. In this work, we propose a novel method utilizing peridynamics (PD), a numerical method that can capture discontinuities such as tablet fracture, to predict the evolution of damage and breakage in pharmaceutical tablets. The approach links (1) the finite element method – to elucidate the behavior of powders during die compaction – with (2) the peridynamics modeling technique – to model the discontinuous nature of damage and predict tablet breakage during the critical stages of unloading and ejection from the compression die. This short communication presents a proof of concept including a workflow to calibrate the linked FEM-PD simulation models. Further, it demonstrates promising results from a preliminary experimental validation of the approach. Following further development, this approach could be used to guide the optimization of compression processes through targeted changes to formulation material properties, compression process conditions, and/or tooling geometries to deliver improved process efficiency and tablet robustness.

36 MATERIALS SCIENCE↗

DAKOTA (Design Analysis Kit for Optimization and Terascale) v.6.14

Sandia's Dakota software supports science and engineering transformation through advanced exploration of simulations. Specifically, Dakota manages and analyzes ensembles of simulations to provide broader and deeper perspective for analysts and decision makers. This enables them to: (1) enhance understanding of risk, (2) improve products, and (3) assess simulation credibility. In its simplest mode, Dakota can automate typical parameter variation studies through a generic interface to a computational model. Dakota also delivers advanced parametric analysis techniques enabling design exploration, optimization, model calibration, risk analysis, and quantification of margins and uncertainty with such models. It directly supports verification and validation activities. The algorithms implemented in Dakota aim to address challenges in performing these analyses with complex science and engineering models from desktop to high performance computers. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525 SAND2021-10468 O

Adams, BrianM.↗

DAKOTA (Design Analysis Kit for Optimization and Terascale) v.6.16

Sandia's Dakota software supports science and engineering transformation through advanced exploration of simulations. Specifically, Dakota manages and analyzes ensembles of simulations to provide broader and deeper perspective for analysts and decision makers. This enables them to: (1) enhance understanding of risk, (2) improve products, and (3) assess simulation credibility. In its simplest mode, Dakota can automate typical parameter variation studies through a generic interface to a computational model. Dakota also delivers advanced parametric analysis techniques enabling design exploration, optimization, model calibration, risk analysis, and quantification of margins and uncertainty with such models. It directly supports verification and validation activities. The algorithms implemented in Dakota aim to address challenges in performing these analyses with complex science and engineering models from desktop to high performance computers. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525 SAND2021-10468 O

Adams, BrianM.↗

Modeling Heat Pipes with Non-Condensable Gases

The report showcases advancements in modeling heat pipes, considering both scenarios with and without non-condensable gases. To achieve this, two distinct modeling approaches are juxtaposed. Firstly, the effective conduction model, implemented in the MOOSE-based code Sockeye, is employed. Secondly, a first-of-a-kind two-phase Euler-Euler Computational Fluid Dynamics (CFD) model is developed using the STAR-CCM+ code. Both models undergo validation against experimental data, acknowledging the inherent uncertainties associated with each modeling assumption. Interestingly, the non-tuned CFD model surpasses the performance of the calibrated conduction model for heat pipes operating under both conditions: with and without non-condensable gases. It's worth noting, however, that the CFD models entail significantly longer runtimes compared to the conduction models. Nevertheless, the insights garnered from the CFD model shed invaluable light on the intricate operational dynamics of heat pipes. Future work involves broadening the validation scope of these models and continuing their development to enhance their utility as robust tools for heat pipe design and operational support.

42 ENGINEERING↗

An assessment of Callahan's crushed salt constitutive model

This memorandum investigates the Callahan crushed salt constitutive model developed and used at Sandia National Laboratories for geomechanics applications. The formulation is reviewed, calibration against a novel long-term experiment with complex loading history is performed and validation against other experiments is attempted. Areas of improvement and deficiencies are identified that support the need for an alternative or updated constitutive model for crushed salt.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Effects of surface runoff and infiltration partition methods on hydrological modeling: A comparison of four schemes in two watersheds in the Northeastern US

The ratio according to which the precipitation/snowmelt is divided into surface and subsurface water is of primary importance to watershed scale hydrological modeling. The present study compared four different surface runoff and infiltration partition methods in the Richards-equation-based SWAT model (RSWAT), i.e., daily curve number method (DC-RSWAT), hourly curve number method (HC-RSWAT), Green-Ampt method (GA-RSWAT), and effective infiltration capacity method (EIC-RSWAT). These four versions of RSWAT and a daily-curve-number-based SWAT (DC-SWAT) were used to simulate daily flow rate (from 2001 to 2015) at the outlets of the Tuckahoe Creek Watershed (TCW) and Greensboro Watershed (GW) of the Chesapeake Bay in Maryland. Parameter sensitivity analysis, calibration, and prediction uncertainty analysis were conducted. The results indicate that surface runoff and infiltration partition methods have pronounced impacts on model performance. Comparative analysis showed that DC-RSWAT outperformed other versions of RSWAT for both calibration (from 2001 to2007) and validation (from 2008 to 2015) periods in the two test watersheds. In general, DC-RSWAT achieved more accurate deterministic flow simulation and reliable uncertainty estimation than other versions. As such, daily-curve-number method is recommended for surface runoff and infiltration partition in RSWAT for simulating stream flow.

hydrology, modeling, streamflow↗

Machine learning based approach to predict ductile damage model parameters for polycrystalline metals

Damage models for ductile materials typically need to be parameterized, often with the appropriate parameters changing for a given material depending on the loading conditions. This can make parameterizing these models computationally expensive, since an inverse problem must be solved for each loading condition. Using standard inverse modeling techniques typically requires hundreds or thousands of high-fidelity computer simulations to estimate the optimal parameters. Additionally, the time of a human expert is required to set up the inverse model. Machine learning has recently emerged as an alternative approach to inverse modeling in these settings, where the machine learning model is trained in an offline manner and new parameters can be quickly generated on the fly, after training is complete. Here, this work utilizes such a workflow to enable the rapid parameterization of a ductile damage model called TEPLA with a machine learning inverse model. The machine learning model can efficiently estimate the model parameters much faster, as compared to previously employed methods, such as Bayesian calibration. The results demonstrate good accuracy on a synthetic test dataset and is validated against experimental data.

36 MATERIALS SCIENCE↗

Implementing belowground controls on nutrient uptake in ELMv2-SPRUCE improves representation of a boreal peatland ecosystem

Boreal peatlands store 13 %–32 % of the global soil carbon (C) stock, a service dependent on plant-mycorrhizal fungi associations. In these nutrient poor systems, ectomycorrhizal and ericoid mycorrhizal fungi supply up to >80 % of the nutrient requirements of their plant hosts, partly with mined nitrogen (N) and phosphorus (P) from soil organic matter that are otherwise inaccessible to plants. Despite the ecological significance, mycorrhizal associations are only represented in a few land surface or ecosystem models. We modify the peatland branch of version 2 of the Energy Exascale Earth System Land Model (ELMv2-SPRUCE) to replace the default photosynthesis-driven inorganic N and P (NP) uptake process with a more realistic representation of the process via three pathways: (1) direct inorganic NP uptake by uncolonized fine roots, (2) indirect inorganic NP acquisition and (3) indirect NP acquisition from organic sources by mycorrhizal roots. We systematically evaluated the performance of the default and modified models with field observations from a whole ecosystem warming and carbon dioxide fertilization experimental site: Spruce and Peatland Responses Under Changing Environment (SPRUCE), in northern Minnesota, USA. The modified model reduces the underestimation of the growth response of shrubs in the default model to warming from 40 %–80 % to 17 %–35 % and reduces the overall relative absolute error on C fluxes from 1.61 to 1.54 in calibration. Improvements on modeled shrub growths and shrub-moss community net ecosystem exchanges are also seen in validation. The improved growth response of shrubs to warming is accompanied by several-fold increase in direct inorganic NP uptake and decrease in fungal colonization rate. The modified model simulates a smaller magnitude of transition of the ecosystem from C sink to C source under warming due to alleviation of plant nutrient limitation. Equifinality analysis shows the newly added parameters in the modified model can be constrained by the observed C fluxes. Sensitivity analysis shows the newly added parameters have stronger statistical interactions than the preexisting parameters in the default model. Overall, the modified model is an improvement over the default ELMv2-SPRUCE and will be a useful tool for understanding boreal peatland change.

Wang, Yaoping [Oak Ridge National Laboratory (ORNL↗

A hybrid calibration approach to Hertz-type contact parameters for discrete element models

This study aims at providing a hybrid calibration framework to estimate Hertz-type contact parameters (particle-scale shear modulus and Poisson ratio) for both two-dimensional and three-dimensional discrete element modelling (DEM). On the basis of statistically isotropic granular packings, a set of analytical formulae between macroscopic material parameters (Young modulus and Poisson ratio) and particle-scale Hertz-type contact parameters for granular systems are derived under small-strain isotropic stress conditions. However, the derived analytical solutions are only estimated values for general models. By viewing each DEM modelling as an implicit mathematical function taking the particle-level parameters as independent variables and employing the derived analytical solutions as the initial input parameters, an automatic iterative scheme is proposed to obtain the calibrated parameters with higher accuracies. Considering highly nonlinear features and discontinuities of the macro-micro relationship in Hertz-based discrete element models, the adaptive moment estimation algorithm is adopted in this study because of its capacity of dealing with noise gradients of cost functions. Here, the proposed method is validated with several numerical cases including randomly distributed monodisperse and polydisperse packings. Noticeable improvements in terms of calibration efficiency and accuracy have been made.

Constitutive law↗

Modeling injection-induced fault slip using long short-term memory networks

Stress changes due to changes in fluid pressure and temperature in a faulted formation may lead to the opening/shearing of the fault. This can be due to subsurface (geo)engineering activities such as fluid injections and geologic disposal of nuclear waste. Such activities are expected to rise in the future making it necessary to assess their short- and long-term safety. Here, a new machine learning (ML) approach to model pore pressure and fault displacements in response to high-pressure fluid injection cycles is developed. The focus is on fault behavior near the injection borehole. To capture the temporal dependencies in the data, long short-term memory (LSTM) networks are utilized. To prevent error accumulation within the forecast window, four critical measures to train a robust LSTM model for predicting fault response are highlighted: (i) setting an appropriate value of LSTM lag, (ii) calibrating the LSTM cell dimension, (iii) learning rate reduction during weight optimization, and (iv) not adopting an independent injection cycle as a validation set. Several numerical experiments were conducted, which demonstrated that the ML model can capture peaks in pressure and associated fault displacement that accompany an increase in fluid injection. The model also captured the decay in pressure and displacement during the injection shut-in period. Further, the ability of an ML model to highlight key changes in fault hydromechanical activation processes was investigated, which shows that ML can be used to monitor risk of fault activation and leakage during high pressure fluid injections.

58 GEOSCIENCES↗