Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

Model-based evaluation of school- and non-school-related measures to control the COVID-19 pandemic

The role of school-based contacts in the epidemiology of SARS-CoV-2 is incompletely understood. We use an age-structured transmission model fitted to age-specific seroprevalence and hospital admission data to assess the effects of school-based measures at different time points during the COVID-19 pandemic in the Netherlands. Our analyses suggest that the impact of measures reducing school-based contacts depends on the remaining opportunities to reduce non-school-based contacts. If opportunities to reduce the effective reproduction number (R e ) with non-school-based measures are exhausted or undesired and R e is still close to 1, the additional benefit of school-based measures may be considerable, particularly among older school children. As two examples, we demonstrate that keeping schools closed after the summer holidays in 2020, in the absence of other measures, would not have prevented the second pandemic wave in autumn 2020 but closing schools in November 2020 could have reduced R e below 1, with unchanged non-school-based contacts.

60 APPLIED LIFE SCIENCES↗

Thermo-Mechanical Modeling and Evaluation of the Cracking Response of Additively Manufactured Monolithic SiC Lattice Structures Subjected to Laser Heating

Increasing operating temperatures of solar receivers is paramount to the efficiency of concentrated solar thermal (CST) and solar power (CSP) systems. Owing to its high temperature stability combined with excellent thermal and optical properties, SiC has been the material of choice for application in high-temperature solar receivers. The state-of-the-art SiC volumetric concentrating solar air receivers such as honeycomb design have been demonstrated in field tests to achieve exit air temperatures approaching 800oC. However, successful application of CST systems for decarbonization requires significant increase in temperature capability of SiC receiver technology. Supported by an award from the Solar Technology Office (SETO), US Department of Energy (DOE), GE Research in collaboration with Heliogen Holdings Inc, is engaged in the development of ultra-High Operating Temperature SiC-matrix Solar Thermal Air Receiver (HOTSSTAR) enabled by additive manufacturing. The program objective is to design and to demonstrate a techno-economically viable SiC air receiver technology to achieve exit air temperature of 1100oC for CST applications. This report summarizes the learnings of a computational study on additively manufactured SiC lattice structures subjected to laser heating. The results from this study aim to help guide the design of a SiC receiver through a better understanding of lattice structure geometric parameters and their implications on the cracking response of the structure. In the study, a heat flux was applied to the surface of a 2”-diameter cylindrical lattice structure to simulate a 4kW CO2 laser. The resulting temperature distribution was applied to a structural model to approximate the stress distribution within the lattice structure and a Weibull analysis was performed to gain insight into the probability of failure and to evaluate the cracking response of the structure. With this approach, the influence of lattice density on temperature, stress, and probability of failure was explored for two different lattice beam spacings. A discussion on modeling assumptions, a comparison with experimental results, and an evaluation of the lattice cracking response is provided.

14 SOLAR ENERGY↗

Comparing Model Representations of Physiological Limits on Transpiration at a Semi-arid Ponderosa Pine Site

Mechanistic representations of biogeochemical processes in ecosystem models are rapidly advancing, requiring advancements in model evaluation approaches. Here we quantify multiple aspects of model functional performance to evaluate improved process representations in ecosystem models. We compare semi-empirical stomatal models with hydraulic constraints against more mechanistic representations of stomatal and hydraulic functioning at a semi-arid pine site using a suite of metrics and analytical tools. We find that models generally perform similarly under unstressed conditions, but performance diverges under atmospheric and soil drought. The more empirical models better capture synergistic information flows between soil water potential and vapor pressure deficit to transpiration, while the more mechanistic models are overly deterministic. Although models can be parameterized to yield similar functional performance, alternate parameterizations could not overcome structural model constraints that underestimate the unique information contained in soil water potential about transpiration. Additionally, both multilayer canopy and big-leaf models were unable to capture the magnitude of canopy temperature divergence from air temperature, and we demonstrate that errors in leaf temperature can propagate to considerable error in simulated transpiration. This study demonstrates the value of merging underutilized observational data streams with emerging analytical tools to characterize ecosystem function and discriminate among model process representations.

54 ENVIRONMENTAL SCIENCES↗

Advancing Models and Evaluation of Cumulus, Climate and Aerosol Interactions

This project was successfully able to meet its’ goals, but faced some serious challenges due to personnel issues. Nonetheless, it was largely successful. The Project Objectives were as follows: 1. Develop a unified representation of stratifom and cumulus cloud microphysics for NCAR/DOE global community models. 2. Examine the effects of aerosols on clouds and their impact on precipitation in stratiform and cumulus clouds. We will also explore the effects of clouds and precipitation on aerosols. 3. Test these new formulations using advanced evaluation techniques and observations and release

54 ENVIRONMENTAL SCIENCES↗

Burst pressure models and validations for thick-walled pipelines containing corrosion defects

Corrosion is one major threat to pipeline integrity. Over the past decades, many corrosion models have been developed for determining the remaining strength of corroded pipelines, including ASME B31.G, Modified B31.G, LPC, PCORRC and their modified models. All these corrosion models are applicable only to large diameter, thin-walled pipelines with a diameter to wall thickness ratio D/t ≥ 20. In practice, many pipelines have a small diameter and thick wall with a D/t ratio < 20, and thus an adequate corrosion model is needed for assessing remaining strength for corroded thick-walled pipelines. This paper briefly reviews the theoretical burst pressure models for defect-free thin and thick-walled pipelines and four representative corrosion assessment models for thin-walled corroded pipelines. On this basis, two modified corrosion models are proposed to thick-walled pipelines in terms of the average shear stress yield theory. To verify the proposed corrosion models, comprehensive validations are performed. Numerical validations include the elastic-plastic finite element analysis to determine burst pressure for pipelines without and with corrosion defects and the model evaluation using a large dataset of available FEA results of burst pressure for machined defects. Experimental validations include a set of burst pressure tests for defect-free thick-walled pipes with different thicknesses and the model evaluation using one large burst dataset for machined defects with flat bottoms and another large dataset for real corrosion defects with curved river bottom profiles. Both numerical and experimental validations show that the proposed corrosion models can more accurately predict the remaining strength for corroded thin and thick-walled pipelines.

Pipeline↗

An adaptive Gaussian process-based method for efficient Bayesian experimental design in groundwater contaminant source identification problems: ADAPTIVE GAUSSIAN PROCESS-BASED INVERSION

Surrogate models are commonly used in Bayesian approaches such as Markov Chain Monte Carlo (MCMC) to avoid repetitive CPU-demanding model evaluations. However, the approximation error of a surrogate may lead to biased estimations of the posterior distribution. This bias can be corrected by constructing a very accurate surrogate or implementing MCMC in a two-stage manner. Since the two-stage MCMC requires extra original model evaluations, the computational cost is still high. If the information of measurement is incorporated, a locally accurate approximation of the original model can be adaptively constructed with low computational cost. Based on this idea, we propose a Gaussian process (GP) surrogate-based Bayesian experimental design and parameter estimation approach for groundwater contaminant source identification problems. A major advantage of the GP surrogate is that it provides a convenient estimation of the approximation error, which can be incorporated in the Bayesian formula to avoid over-confident estimation of the posterior distribution. The proposed approach is tested with a numerical case study. Without sacrificing the estimation accuracy, the new approach achieves about 200 times of speed-up compared to our previous work using two-stage MCMC.

Zhang, Jiangjiang↗

Cloud Influence on ERA5 and AMPS Surface Downwelling Longwave Radiation Biases in West Antarctica

The surface downwelling longwave radiation component (LW?) is crucial for the determination of the surface energy budget and has significant implications for the resilience of ice surfaces in the polar regions. Accurate model evaluation of this radiation component requires knowledge about the phase, vertical distribution, and associated temperature of water in the atmosphere, all of which control the LW? signal measured at the surface. In this study, we examine the LW? model errors found in the Antarctic Mesoscale Prediction System (AMPS) operational forecast model and the ERA5 reanalysis model relative to observations from the AWARE campaign at McMurdo Station and the West Antarctic Ice Sheet (WAIS) Divide. The errors are calculated separately for observed clear sky conditions, ice cloud occurrences, and liquid-bearing cloud layer (LBCL) occurrences. The analysis results show a tendency (in both models at each site) to underestimate the LW? during clear sky conditions, high error variability (standard deviations > 20 W/m2) during any type of cloud occurrence, and negative LW? biases when LBCLs are observed (bias magnitudes > 15 W/m2 in tenuous LBCL cases; > 43 W/m2 in optically thick/opaque LBCLs instances). We suggest that a generally dry and liquid water-deficient atmosphere responsible for the identified LW? biases in both models is the result of excessive ice formation and growth, which could stem from model initial and lateral boundary conditions, microphysics scheme, aerosol representation, and/or limited vertical resolution.

Silber, Israel↗

An Enhanced Model for Evaluating Failure Propagation in Launch Vehicle Engine Sections

An important component in the assessment of launch vehicle safety is the estimation of the likelihood of large-scale explosions given the existence of failures that manifest as a localized energy release. A failure propagation model is presented for simulating cascading failures of energetic components in proximity where the primary modes of energy transfer are fragments/shrapnel and blast overpressure. The model is an extension of the model developed by Mathias and Motiwala (2015) [1] with enhancements to include the effects of fragment ricochet, fragment drag, fragment ballistic limit equation thresholds, and blast impulse thresholds. A series of sensitivity studies were conducted for a generic launch vehicle engine section and results are presented that illustrate the effects of the model modifications.

Susie Go↗

An Enhanced Model for Evaluating Failure Propagation in Launch Vehicle Engine Sections

An important component in the assessment of launch vehicle safety is the estimation of the likelihood of large-scale explosions given the existence of failures that manifest as a localized energy release. A failure propagation model is presented for simulating cascading failures of energetic components in proximity where the primary modes of energy transfer are fragments/shrapnel and blast overpressure. The model is an extension of the model developed by Mathias and Motiwala (2015) [1] with enhancements to include the effects of fragment ricochet, fragment drag, fragment ballistic limit equation thresholds, and blast impulse thresholds. A series of sensitivity studies were conducted for a generic launch vehicle engine section and results are presented that illustrate the effects of the model modifications.

Susie Go↗

R&D Plan for RISMC Industry Application #1: ECCS/LOCA Cladding Acceptance Criteria

The Nuclear Regulatory Commission (NRC) is finalizing a rulemaking change that would revise the requirements in 10 CFR 50.46. In the proposed new rulemaking, designated as 10 CFR 50.46c, the NRC proposes a fuel performance-based equivalent cladding reacted (ECR) criterion as a function of cladding hydrogen content before the accident (pre-transient) in order to include the effects of higher burnup on cladding performance as well as to address other technical issues. A loss of operational margin may result due to the more restrictive cladding embrittlement criteria. Initial and future compliance with the rule may significantly increase vendor workload and licensee costs as a spectrum of fuel rod initial burnup states may need to be analyzed to demonstrate compliance. The Idaho National Laboratory (INL) has initiated a project, as part of the DOE Light Water Reactor Sustainability Program (LWRS), to develop analytical capabilities to support the industry in the transition to the new rule. This project is called the Industry Application 1 (IA1) within the Risk-Informed Safety Margin Characterization (RISMC) Pathway of LWRS. The general idea behind the initiative is the development of an Integrated Evaluation Model (IEM). The motivation is to develop a multiphysics framework to analyze how uncertainties are propagated across the stream of physical disciplines and data involved, as well as how risks are evaluated in a LOCA safety analysis as regulated under 10 CFR 50.46c. This IEM is called LOTUS which stands for LOCA Toolkit for US, and it represents the LWRS Program’s response to the proposed new rule making. The focus of this report is to complete an R&D plan to describe the demonstration of the LOCA/ECCS RISMC Industry Application # 1 using the advanced RISMC Toolkit and methodologies. This report includes the description and development plan for a RISMC LOCA tool that fully couples advanced MOOSE tools already in development in order to characterize and optimize plant safety and operational margins. Advanced MOOSE tools that are needed to complete this integrated evaluation model are: RAVEN, RELAP-7, BISON, and MAMMOTH.

10CFR50.46C↗

Accelerating Asymptotically Exact MCMC for Computationally Intensive Models via Local Approximations

We construct a new framework for accelerating Markov chain Monte Carlo in posterior sampling problems where standard methods are limited by the computational cost of the likelihood, or of numerical models embedded therein. Our approach introduces local approximations of these models into the Metropolis–Hastings kernel, borrowing ideas from deterministic approximation theory, optimization, and experimental design. Previous efforts at integrating approximate models into inference typically sacrifice either the sampler’s exactness or efficiency; our work seeks to address these limitations by exploiting useful convergence characteristics of local approximations. We prove the ergodicity of our approximate Markov chain, showing that it samples asymptotically from the exact posterior distribution of interest. We describe variations of the algorithm that employ either local polynomial approximations or local Gaussian process regressors. Our theoretical results reinforce the key observation underlying this article: when the likelihood has some local regularity, the number of model evaluations per Markov chain Monte Carlo (MCMC) step can be greatly reduced without biasing the Monte Carlo average. Numerical experiments demonstrate multiple order-of-magnitude reductions in the number of forward model evaluations used in representative ordinary differential equation (ODE) and partial differential equation (PDE) inference problems, with both synthetic and real data. Supplementary materials for this article are available online.

97 MATHEMATICS AND COMPUTING↗

Current Applications of OMI Tropospheric NO2 Data for Air Quality and a Look to the Future

Ozone Monitoring Instrument (OMI) Tropospheric NO2 products are being used to enhance the ability to monitor changes in NO2 air quality, update emission inventories, and evaluate regional air quality models. Trends in tropospheric column NO2 have been examined over the eastern United States in relation to emissions changes mandated by regulatory actions. Decreases of 20 to 40 percent over the period 2005 to 2008 were noted, largely in response to major emission reductions at power plants. The OMI data have been used to identify regions in which the opposite trend has been found. We have also used OMI NO2 in efforts to improve emission inventories for NOx emissions from soil. Lightning NOx emissions have been added to CMAQ, the US Environmental Protection Agency's regional air quality model. Evaluation of the resulting NO2 columns in the model is being conducted using the OMI NO2 observations. Community Multiscale Air Quality (CMAQ) together with the OMI NO2 data comprise a valuable tool for monitoring and predicting air quality. Looking to the future, we expect that the combination of Global Ozone Monitoring Experiment-2 (GOME-2) (morning) and OMI (afternoon) data sets obtained through use of the same retrieval algorithms will substantially increase the possibility of successful integration of satellite information into regional air quality forecast models. Farther down the road, we anticipate the Geostationary Coastal and Air Pollution Events (GEO-CAPE) platform to supply data possibly on an hourly basis, allowing much more comprehensive analysis of air quality from space.

Pickering, Kenneth E.↗

Comparison of Projections for a Short-Term Release, CAP88 vs NARAC

The purpose of this study was to compare the projected dose using different plume models, evaluating a short duration release of tritium to the 16 compliance sectors and 4 additional points of interest using local meteorology. This report is written as guidance to the decision makers when reviewing this specific Gaussian plume model intended for radiological dose assessment and regulatory compliance, called CAP88 1 , as compared to a more-complex model designed for emergency response. The emergency response model, NARAC 2 , can be used to supplement the CAP88 compliance model evaluations, since NARAC is intended for use in situations where releases are shorter in duration and have increased complexity in terrain and meteorology.

54 ENVIRONMENTAL SCIENCES↗

Modeling and Evaluation of Miles-in-Trail Restrictions in the National Air Space

Miles-in-trail restrictions impact flights in the national air space on a daily basis and these restrictions routinely propagate between adjacent Air Route Traffic Control Centers. Since overly restrictive or ineffective miles-in-trail restrictions can reduce the overall efficiency of the national air space, decision support capabilities that model miles-in-trail restrictions should prove to be very beneficial. This paper presents both an analytical formulation and a linear programming approach for modeling the effects of miles-in-trail restrictions. A methodology for monitoring the conformance of an existing miles-in-trail restriction is also presented. These capabilities have been implemented in the Future ATM Concepts Evaluation Tool for testing purposes. To allow alternative restrictions to be evaluated in post-operations, a new mode of operation, which is referred to as the hybrid-playback mode, has been implemented in the simulation environment. To demonstrate the capabilities of these new algorithms, the miles-in-trail restrictions, which were in effect on June 27, 2002 in the New York Terminal Radar Approach Control, are examined. Results from the miles-in-trail conformance monitoring functionality are presented for the ELIOT, PARKE and WHITE departure fixes. In addition, the miles-in-trail algorithms are used to assess the impact of alternative restrictions at the PARKE departure fix.

Grabbe, Shon↗

Constraining Hamiltonians from chiral effective field theory with neutron-star data

Multi-messenger observations of neutron stars (NSs) and their mergers have placed strong constraints on the dense-matter equation of state (EOS). The EOS, in turn, depends on microscopic nuclear interactions that are described by nuclear Hamiltonians. These Hamiltonians are commonly derived within chiral effective field theory (EFT). Ideally, multi-messenger observations of NSs could be used to directly inform our understanding of EFT interactions, but such a direct inference necessitates millions of model evaluations. This is computationally prohibitive because each evaluation requires us to calculate the EOS from a Hamiltonian by solving the quantum many-body problem with methods such as auxiliary-field diffusion Monte Carlo (AFDMC), which provides very accurate and precise solutions but at a significant computational cost. Additionally, we need to solve the stellar structure equations for each EOS which further slows down each model evaluation by a few seconds. In this work, we combine emulators for AFDMC calculations of neutron matter, built using parametric matrix models, and for the stellar structure equations, built using multilayer perceptron neural networks, with the PyCBC data-analysis framework to enable a direct inference of coupling constants in an EFT Hamiltonian using multi-messenger observations of NSs. We find that astrophysical data can provide informative constraints on two-nucleon couplings despite the high densities probed in NS interiors.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Three-Stage Production Cost Modeling Approach for Evaluating the Benefits of Intra-Hour Scheduling Between Balancing Authorities

This paper introduces a production cost modeling approach for evaluating the benefits of intra-hour scheduling among Balancing Authorities (BAs). System operation is modeled in a three-stage sequential manner: day ahead (DA)-hour ahead (HA) real time (RT). In addition to contingency reserve, each BA will need to carry out 'up' and 'down' load following and regulation reserve capacity requirements in the DA and HA time frames. In the RT simulation, only contingency and regulation reserves are carried out as load following is deployed. To model current RT operation with hourly schedules, a new constraint was introduced to force each BA net exchange schedule deviation from HA schedules to be within North American Electric Reliability Corporation (NERC) area control error (ACE) limits. Case studies that investigate the benefits of moving from hourly exchange schedules between Western Electricity Coordinating Council (WECC) BAs into 10-minute exchange schedules under two different levels of wind and solar penetration (11% and 33%) are presented.

17 WIND ENERGY↗

Use of Remote Sensing and Dust Modelling to Evaluate Ecosystem Phenology and Pollen Dispersal

The impact of pollen release and downwind concentrations can be evaluated utilizing remote sensing. Previous NASA studies have addressed airborne dust prediction systems PHAiRS (Public Health Applications in Remote Sensing) which have determined that pollen forecasts and simulations are possible. By adapting the deterministic dust model (as an in-line system with the National Weather Service operational forecast model) used in PHAiRS to simulate downwind dispersal of pollen, initializing the model with pollen source regions from MODIS, assessing the results a rapid prototype concept can be produced. We will present the results of our effort to develop a deterministic model for predicting and simulating pollen emission and downwind concentration to study details or phenology and meteorology and their dependencies, and the promise of a credible real time forecast system to support public health and agricultural science and service. Previous studies have been done with PHAiRS research, the use of NASA data, the dust model and the PHAiRS potential to improve public health and environmental services long into the future.

Luvall, Jeffrey C.↗

Evaluation of models for numerical simulation of the non-neutral region of sheath plasma

Four different electron models are used to simulate the nonequilibrium plasma flow around a representative cylindrical Faraday probe geometry. Each model is implemented in a two-dimensional axisymmetric hybrid electron fluid and particle in cell method. The geometric shadowing model is derived from kinetic theory on the basis that physical obstruction of part of the velocity distribution leads to many of the expected sheath features. The Boltzmann electron fluid model relates the electron density to the plasma potential through the Boltzmann relation. The non-neutral detailed electron fluid model is derived from the electron conservation equations under the assumption of neutrality, and then modified to include non-neutral effects through the electrostatic Poisson equation. The Poisson-consistent detailed electron fluid model is also derived from the conservation equations and the electrostatic Poisson equation, but uses an alternative method that is inherently non-neutral from the outset. Simulations using the geometric shadowing and non-neutral detailed models do not yield satisfactory sheath structures, indicating that these models are not appropriate for sheath simulations. Simulations using the Boltzmann and Poisson-consistent models produce sheath structures that are in excellent agreement with the planar Bohm sheath solution near the centerline of the probe. The computational time requirement for the Poisson-consistent model is much higher than for the Boltzmann model and becomes prohibitive for larger domains.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗