Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “MODEL CALIBRATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,459 records · Page 81

Validation Metrics for Fixed Effects and Mixed-Effects Calibration

The modern scientific process often involves the development of a predictive computational model. To improve its accuracy, a computational model can be calibrated to a set of experimental data. A variety of validation metrics can be used to quantify this process. Some of these metrics have direct physical interpretations and a history of use, while others, especially those for probabilistic data, are more difficult to interpret. In this work, a variety of validation metrics are used to quantify the accuracy of different calibration methods. Frequentist and Bayesian perspectives are used with both fixed effects and mixed-effects statistical models. Through a quantitative comparison of the resulting distributions, the most accurate calibration method can be selected. Two examples are included which compare the results of various validation metrics for different calibration methods. It is quantitatively shown that, in the presence of significant laboratory biases, a fixed effects calibration is significantly less accurate than a mixed-effects calibration. This is because the mixed-effects statistical model better characterizes the underlying parameter distributions than the fixed effects model. The results suggest that validation metrics can be used to select the most accurate calibration model for a particular empirical model with corresponding experimental data.

97 MATHEMATICS AND COMPUTING↗

CALIBRATION OF SEMI-ANALYTIC MODELS OF GALAXY FORMATION USING PARTICLE SWARM OPTIMIZATION

We present a fast and accurate method to select an optimal set of parameters in semi-analytic models of galaxy formation and evolution (SAMs). Our approach compares the results of a model against a set of observables applying a stochastic technique called Particle Swarm Optimization (PSO), a self-learning algorithm for localizing regions of maximum likelihood in multidimensional spaces that outperforms traditional sampling methods in terms of computational cost. We apply the PSO technique to the SAG semi-analytic model combined with merger trees extracted from a standard Lambda Cold Dark Matter N-body simulation. The calibration is performed using a combination of observed galaxy properties as constraints, including the local stellar mass function and the black hole to bulge mass relation. We test the ability of the PSO algorithm to find the best set of free parameters of the model by comparing the results with those obtained using a MCMC exploration. Both methods find the same maximum likelihood region, however, the PSO method requires one order of magnitude fewer evaluations. This new approach allows a fast estimation of the best-fitting parameter set in multidimensional spaces, providing a practical tool to test the consequences of including other astrophysical processes in SAMs.

79 ASTRONOMY AND ASTROPHYSICS↗

Geodyn Material Library: Pseudocap models for dry porous tocks

This report describes the second edition of the Pseudocap Strength models for porous rocks implemented in GEODYN material library. The first model was developed in 2007 and calibrated for concrete. Then, the model parameters were calibrated based on triaxial tests reported for limestones and sandstones of various porosities. In these models some key parameters were chosen as functions of the reference porosity,Φ. Since then multiple modifications were implemented in the model, therefore, it has been recalibrated for some common porous materials such as limestones, sandstones, alluvium, tuffs and granite. Two types of models are described in this repot. The first type (called Pseudocap Model or PM) is for rocks from a specific location. Parameters were calibrated for several specific geologic materials. The second type (called Generic Pseudocap Model or GPM) is useful for the sites where only basic information (rock type, porosity) is available. Generic models include built-in correlations between porosities and other mechanical properties observed for certain rock types. The models of both types were validated by comparing not only to quasi-static triaxial tests for these materials but also to shock Hugoniot data and spherical explosion data for some materials. All models were derived in the frame of isotropic plasticity. They are designed to be used in explicit finite element/difference codes. Tangent stiffness tensor is not provided but can be calculated numerically for the model to be used in implicit finite element codes. For an isotropic material the stress can be decomposed into volumetric and deviatoric parts. The volumetric part is modeled using an Equation of state (EOS) which calculates the pressure and the bulk sound speed as functions of the internal specific energy and density. Here a simple, Mie-Gruneisen EOS is presented, but tabulated EOS (LEOS) provided by the library can be used as well. The stress is limited by the yield surface which depends on three invariants of the stress tensor and specific internal energy. In addition, to capture the strain-rate dependence a simple multiplier is used for the yield surface which depends on the equivalent plastic strain rate. The failure surface (the ultimate yield, Y f , defined later) is chosen in the Hoek-Brown form, commonly used in rock mechanics. It includes measurable parameters such as Unconfined Compressive Strength (UCS) as well as scale parameters characterizing the quality of the rock such as GSI (Geologic Strength Index). Thus, even though the model is calibrated for small samples it offers a way to extrapolate the strength to the field scale using geological characterization of the rock mass. The model captures effects of brittle-ductile transition in rocks by introducing a cap multiplier to the yield function. The rate of dilatancy (bulking) is proportional to the slope of the yield surface affected by the cap. Therefore, it takes place only at low confinements when the pressure is less than the brittle-ductile transition pressure, P BD . On the contrary, the porous compaction takes place at pressures higher than P BD . The cap moves as the porosity is compacted or new porosity is generated due to dilatancy. The porous compaction is modeled using an evolution equation which includes deviatoric stress so that the onset of compaction corresponds to the cap surface. The model captures effects of shear-enhanced compaction which is an important for porous rocks. Section 2 describes the modeling framework and Section 3 presents the model calibration procedure. Section 4 compares experimental data for various rocks versus model predictions. The model parameters used for this comparison are given in Appendix. The files with material constants are available with the latest GEODYN material library distribution.

58 GEOSCIENCES↗

Strain Rate Dependency of Simulated Welding Residual Stresses

In the present work, the influence of taking into consideration the strain rate-dependent nature of steel S355 during a calculation of the welding residual stresses through a finite element simulation is investigated. The Perzyna material model is calibrated using experimental values found in the literature and is introduced to a validated weld simulation model, where the strain rate dependency had not been taken into consideration before this study. The calculated profiles of the welding residual stresses, for strain rate-dependent and independent behavior, are then compared with experimentally measured profiles. The results of this first-step analysis show that taking into consideration strain rate dependency during a welding simulation of the investigated S355 has non-negligible influence on the calculated welding residual stresses.

36 MATERIALS SCIENCE↗

Continuum-Level Modeling of Li-Ion Battery SEI by Upscaling Atomistically Informed Reaction Mechanisms

Understanding and controlling solid-electrolyte interphase (SEI) formation to stabilize cell performance is a significant challenge for next-generation Li-ion battery technologies. In recent years, computational modeling has become an essential tool in providing fundamental insights into SEI properties and dynamics. However, neither atomistic nor continuum-level approaches alone can capture the complexities of SEI chemistry across all relevant length and time scales. In this work, a continuum-level model is developed that is informed by reaction mechanisms obtained from first-principle calculations. The atomistically informed continuum-level model is used to understand electrolyte degradation, including the decomposition of ethylene carbonate (EC), ethyl methyl carbonate (EMC), and fluoroethylene carbonate (FEC). The model presented here is the most chemically complex continuum-level SEI model in the literature to date. The SEI model is calibrated against experimental irreversible leakage currents and shows qualitative agreement with expected SEI growth trends. The model framework is expected to accelerate fundamental understanding of SEI formation, facilitate mechanism development feedback, and dynamically interact with experimental insights.

continuum-level model↗

Model Evaluation and Hindcasting: An Experiment with an Integrated Assessment Model

Integrated assessment models have been extensively used for analyzing long term energy and greenhouse emissions trajectories and have influenced key policies on this subject. Though admittedly these models are focused on the long term trajectories, how well these models are able to capture historical dynamics is an open question. In a first experiment of its kind, we present a framework for evaluation of such integrated assessment models. We use Global Change Assessment Model for this zero order experiment, and focus on the building sector results for USA. We calibrate the model for 1990 and run it forward up to 2095 in five year time steps. This gives us results for 1995, 2000, 2005 and 2010 which we compare to observed historical data at both fuel level and service level. We focus on bringing out the key insights for the wider process of model evaluation through our experiment with GCAM. We begin with highlighting that creation of an evaluation dataset and identification of key evaluation metric is the foremost challenge in the evaluation process. Our analysis highlights that estimation of functional form of the relationship between energy service demand, which is an unobserved variable, and its drivers is a significant challenge in the absence of adequate historical data for both the dependent and driver variables. Historical data availability for key metrics is a serious limiting factor in the process of evaluation. Interestingly, service level data against which such models need to be evaluated are itself a result of models. Thus for energy services, the best we can do is compare our model results with other model results rather than observed and measured data. We show that long term models, by the nature of their construction, will most likely underestimate the rapid growth in some services observed in a short time span. Also, we learn that modeling saturated energy services like space heating is easier than modeling unsaturated services like space cooling and understanding that how far a service is from its saturation level is a key question which we probably don’t have an answer to. Finally and most importantly, even if long term models partially miss the short term dynamics, the long term insights provides by these models is fairly robust. We conclude by highlighting that our work is the first step in the much wider process of integrated assessment model evaluation and will hence have its own limitations. Future evaluation research work should build upon this zero order experiment for improving our modeling of human and coupled earth systems.

building energy↗

Detailed assessment of diesel spray atomization models using visible and X-ray extinction measurements

The physical mechanisms characterizing the breakup of a diesel spray into droplets are still unknown. This gap in knowledge has largely been due to the challenges of directly imaging this process or quantitatively measuring the outcomes of spray breakup, such as droplet size. Recent x-ray measurements by Argonne National Laboratory, utilized in this work, provide needed information about the spatial evolution of droplet sizes in selected regions of the spray under a range of injection pressures (50–150 MPa) and ambient densities (7.6–22.8 kg/m3) relevant for diesel operating conditions. Ultra-small angle x-ray scattering (USAXS) measurements performed at the Advanced Photon Source are presented, which quantify Sauter mean diameters (SMD) within optically thick regions of the spray that are inaccessible by conventional droplet sizing measurement techniques, namely in the near-nozzle region, along the spray centerline, and within the core of the spray. To quantify droplet sizes along the periphery of the spray, a complementary technique is proposed and introduced, which leverages the ratio of path-integrated x-ray and visible laser extinction (SAMR) measurements to quantify SMD. The SAMR and USAXS measurements are then utilized to evaluate current spray models used for engine computational fluid dynamic (CFD) simulations. We explore the ability of a carefully calibrated spray model, premised on aerodynamic wave growth theory, to capture the experimentally observed trends of SMD throughout the spray. The spray structure is best predicted with an aerodynamic primary and secondary breakup process that is represented with a slower time constant and larger formed droplet size than conventionally recommended for diesel spray models. Additionally, spray model predictions suggest that droplet collisions may not influence the resultant droplet size distribution along the spray centerline in downstream regions of the spray.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Modeling Holocene Peatland Carbon Accumulation in North America

Peatlands are a large carbon reservoir. Yet the quantification of their carbon stock still has a large uncertainty due to lacking observational data and well-tested peatland biogeochemistry models. Here, a process-based peatland model was calibrated using long-term peat carbon accumulation data at multiple sites in North America. The model was then applied to quantify the peat carbon accumulation rates and stocks within North America over the last 12,000 years. We estimated that 85–174 Pg carbon was accumulated in North American peatlands over the study period including 0.37–0.76 Pg carbon in subtropical peatlands. During the period from 10,000 to 8,000 years ago, the warmer and wetter conditions might have played an important role in stimulating peat carbon accumulation by enhancing plant photosynthesis. Enhanced peat decomposition due to warming slowed the carbon accumulation through the rest of the Holocene. While recent modeling studies indicate that the northern peatlands will continue to act as a carbon sink in this century, our studies suggest that future enhanced peat decomposition accompanied by peatland areal changes induced by permafrost degradation and other disturbances shall confound the sink and source analysis.

54 ENVIRONMENTAL SCIENCES↗

Field-theoretic analysis of hadronization using soft drop jet mass

One of the greatest challenges in quantum chromodynamics is understanding the hadronization mechanism, which is also crucial for carrying out precision physics with jet substructure. In this paper, we bring together recent advancements in our understanding of nonperturbative structure of the soft drop jet mass based on field theory, with precise perturbative calculations at next-to-next-to-leading logarithmic accuracy of its multidifferential variants. This allows for a model-independent analysis of power corrections associated with hadronization in a systematic manner. We test and calibrate hadronization models and their interplay with parton showers by comparing our universality predictions with various event generators for quark and gluon initiated jets in both lepton-lepton and hadron-hadron collisions. Our findings reveal that hadronization models perform better for quark jets relative to gluon jets. Our results provide a valuable toolbox for precision studies with the soft drop jet mass and pave the way for future analyses using real-world collider data. The stringent constraints derived in our framework are useful for improving the modeling of hadronization and its interplay with parton showers in next-generation event generators.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Assessment and Improvement of Fission Product Transport Predictions of Particle Fuel in BISON

The U.S. Department of Energy’s Nuclear Energy Advanced Modeling and Simulation (NEAMS) program aims to develop predictive capabilities by applying computational methods to the analysis and design of advanced reactor and fuel cycle systems. This program has been providing engineering-scale support for the development of BISON, a high-fidelity and high-resolution fuel performance tool. This study was motivated by the need to incorporate more physics-based models in BISON in order to foster tri-structural isotropic (TRISO) applications. This document details the integration of new modeling capabilities in BISON, including (1) development of pyrolytic carbon (PyC) and silicon carbide (SiC) layer anisotropic thermal and mass transport capabilities, (2) verification of the mass diffusion solution in TRISO modeling, (3) calibration of fission product diffusivity using Advanced Gas Reactor (AGR) experiments, (4) improved fission product release modeling by developing compact diffusion modeling capabilities, and (5) documentation of accelerated failure analysis on the BISON website. Improvements made to the diffusion models and parameters were documented and validated against AGR-1 and -2 experiment data.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Development of response models for the Earth Radiation Budget Experiment (ERBE) sensors. Part 1: Dynamic models and computer simulations for the ERBE nonscanner, scanner and solar monitor sensors

Dynamic models and computer simulations were developed for the radiometric sensors utilized in the Earth Radiation Budget Experiment (ERBE). The models were developed to understand performance, improve measurement accuracy by updating model parameters and provide the constants needed for the count conversion algorithms. Model simulations were compared with the sensor's actual responses demonstrated in the ground and inflight calibrations. The models consider thermal and radiative exchange effects, surface specularity, spectral dependence of a filter, radiative interactions among an enclosure's nodes, partial specular and diffuse enclosure surface characteristics and steady-state and transient sensor responses. Relatively few sensor nodes were chosen for the models since there is an accuracy tradeoff between increasing the number of nodes and approximating parameters such as the sensor's size, material properties, geometry, and enclosure surface characteristics. Given that the temperature gradients within a node and between nodes are small enough, approximating with only a few nodes does not jeopardize the accuracy required to perform the parameter estimates and error analyses.

Halyo, Nesim↗

Quantification of uncertainties in coupled material degradation processes - High temperature, fatigue and creep

This paper describes the development of methodology that provides for quantification of uncertainties in lifetime strength of aerospace materials subjected to a number of diverse effects. A probabilistic material degradation model, in the form of a randomized multifactor interaction equation, has been postulated for lifetime strength degradation of structural components of aerospace propulsion systems. The model includes effects that typically reduce lifetime strength and may include temperature, mechanical fatigue, creep and others. The paper also includes the analysis of experimental data from the open literature for Inconel 718. These data are used to provide an initial check for model validity, as well as for calibration of the model's empirical material constants. The model validity check and calibration is carried out for three effects, namely, high temperature, mechanical fatigue and creep.

Boyce, L.↗

Disturbance Dynamics in Transitional and Turbulent Flows

In order to expand the predictive capability of single-point turbulence closure models to account for the early-stage transition regime, a methodology for the formulation and calibration of model equations for the ensemble-averaged disturbance kinetic energy and energy dissipation rate is presented. First the decay of laminar disturbances and turbulence in mean shear-free flows is studied. In laminar flows, such disturbances are linear superpositions of modes governed by the Orr-Sommerfeld equation. In turbulent flows, disturbances are described through transport equations for representative mean quantities. The link between a description based on a deterministic evolution equation and a probability based mean transport equation is established. Because an uncertainty in initial conditions exists in the laminar as well as the turbulent regime, a probability distribution must be defined even in the laminar case. Using this probability distribution, it is shown that the exponential decay of the linear modes in the laminar regime can be related to a power law decay of both the (ensemble) mean disturbance kinetic energy and the dissipation rate. The evolution of these mean disturbance quantities is then described by transport equations similar to those for the corresponding turbulent decaying flow. Second, homogeneous shear flow, where disturbances can be described by rapid distortion theory (RDT), is studied. The relationship between RDT and linear stability theory is exploited in order to obtain a closed set of modeled equations. The linear disturbance equations are solved directly so that the numerical simulation yields a database from which the closure coefficients in the ensemble-averaged disturbance equations can be determined.

Grosch, Chester E.↗

Modeling of Damage, Permeability Changes and Pressure Responses during Excavation of the TSX Tunnel in Granitic Rock at URL, Canada

This paper presents numerical modeling of excavation-induced damage, permeability changes, and fluid-pressure responses during excavation of the TSX tunnel at the underground research laboratory (URL) in Canada. Four different numerical models were applied, using a wide range of approaches to model damage and permeability changes in the excavation disturbed zone (EDZ) around the tunnel. Using in situ calibration of model parameters the modeling could reproduce observed spatial distribution of damage and permeability changes around the tunnel, as a combination of disturbance induced by stress redistribution around the tunnel and by the drill-and-blast operation. The modeling showed that stress-induced permeability increase above the tunnel is a result of micro and macrofracturing under high deviatoric (shear) stress, whereas permeability increases alongside the tunnel as a result of opening of existing microfractures under decreased mean stress. The remaining observed fracturing and permeability changes around the periphery of the tunnel were attributed to damage from the drill-and-blast operation. Moreover, a reasonably good agreement was achieved between simulated and observed excavation-induced pressure responses around the TSX tunnel for 1 year following its excavation. The simulations showed that these pressure responses are caused by poroelastic effects as a result of increasing or decreasing mean stress, with corresponding contraction or expansion of the pore volume. The simulation results for pressure evolution were consistent with previous studies, indicating that the observed pressure responses could be captured in a Biot model using a relatively low Biot-Willis coefficient, {alpha} {approx} 0.2, a porosity of n {approx} 0.007, and a relatively low permeability of k {approx} 2 x 10{sup -22} m{sup 2}, which is consistent with the very tight, unfractured granite at the site.

54 ENVIRONMENTAL SCIENCES↗

From calibration to parameter learning: Harnessing the scaling effects of big data in geoscientific modeling

Abstract The behaviors and skills of models in many geosciences (e.g., hydrology and ecosystem sciences) strongly depend on spatially-varying parameters that need calibration. A well-calibrated model can reasonably propagate information from observations to unobserved variables via model physics, but traditional calibration is highly inefficient and results in non-unique solutions. Here we propose a novel differentiable parameter learning (dPL) framework that efficiently learns a global mapping between inputs (and optionally responses) and parameters. Crucially, dPL exhibits beneficial scaling curves not previously demonstrated to geoscientists: as training data increases, dPL achieves better performance, more physical coherence, and better generalizability (across space and uncalibrated variables), all with orders-of-magnitude lower computational cost. We demonstrate examples that learned from soil moisture and streamflow, where dPL drastically outperformed existing evolutionary and regionalization methods, or required only ~12.5% of the training data to achieve similar performance. The generic scheme promotes the integration of deep learning and process-based models, without mandating reimplementation.

54 ENVIRONMENTAL SCIENCES↗

Calibration of X-Ray Observatories

Accurate calibration of x-ray observatories has proved an elusive goal. Inaccuracies and inconsistencies amongst on-ground measurements, differences between on-ground and in-space performance, in-space performance changes, and the absence of cosmic calibration standards whose physics we truly understand have precluded absolute calibration better than several percent and relative spectral calibration better than a few percent. The philosophy "the model is the calibration" relies upon a complete high-fidelity model of performance and an accurate verification and calibration of this model. As high-resolution x-ray spectroscopy begins to play a more important role in astrophysics, additional issues in accurately calibrating at high spectral resolution become more evident. Here we review the challenges of accurately calibrating the absolute and relative response of x-ray observatories. On-ground x-ray testing by itself is unlikely to achieve a high-accuracy calibration of in-space performance, especially when the performance changes with time. Nonetheless, it remains an essential tool in verifying functionality and in characterizing and verifying the performance model. In the absence of verified cosmic calibration sources, we also discuss the notion of an artificial, in-space x-ray calibration standard. 6th

Weisskopf, Martin C.↗

Simultaneous in-flight calibrations of the Galileo science platform and attitude control subsystems

This paper presents a design metholodology and simulation study results for a combined star scanner-gyro-scan platform in-flight calibration for the dual spin Galileo spacecraft. The design process involves three separate parts: the construction of an error model, development of the calibration model, and the selection of the appropriate estimation technique. The major innovative contribution lies in the development of the first two parts which are unique to the Galileo design. A unified procedure has been developed to allow simultaneous calibration of the three subsystems. However, provisions are also made in the software to calibrate each subsystem separately when the necessary a priori information is available.

Lai, J. Y.↗