Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Quantifying heavy quark transport coefficients with an improved transport model

We report that the heavy-flavor transport coefficients contain important information on the strong interaction at finite temperatures. The extraction of these numbers from experimental data requires dynamical modeling of heavy-flavor transport that is coupled to realistic medium evolution. Furthermore, meaningful extractions necessitate both a faithful implementation of the physical inputs to be tested and the quantification of model uncertainty. For these purposes, we have developed a partonic transport model LIDO. It has an improved treatment of in-medium parton bremsstrahlung, which has been calibrated to theoretical calculations in a simple medium to reduce modeling uncertainty. Regarding the interaction between heavy quark and the medium, few-body perturbative scatterings are applied to large-momentum transfer (q) processes, while a diffusion equation models the dynamics of small-q processes. Such a separation restricts the explicit use of medium quasi-particles to large-q processes only. Another advantage is that deviations from the leading-order probe-medium coupling can be parametrized as an additional contribution to the diffusion constant. The heavy quark transport coefficients are then extracted with uncertainty estimation from a Bayesian analysis including both the RHIC and the LHC data. The results are found to be consistent with earlier extraction of the light-quark transport coefficients at high momentum and be comparable with lattice calculations of the heavy-flavor diffusion constant in the static limit at low momentum.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Robustness analysis for real parametric uncertainty

Some key results in the literature in the area of robustness analysis for linear feedback systems with structured model uncertainty are reviewed. Some new results are given. Model uncertainty is described as a combination of real uncertain parameters and norm bounded unmodeled dynamics. Here the focus is on the case of parametric uncertainty. An elementary and unified derivation of the celebrated theorem of Kharitonov and the Edge Theorem is presented. Next, an algorithmic approach for robustness analysis in the cases of multilinear and polynomic parametric uncertainty (i.e., the closed loop characteristic polynomial depends multilinearly and polynomially respectively on the parameters) is given. The latter cases are most important from practical considerations. Some novel modifications in this algorithm which result in a procedure of polynomial time behavior in the number of uncertain parameters is outlined. Finally, it is shown how the more general problem of robustness analysis for combined parametric and dynamic (i.e., unmodeled dynamics) uncertainty can be reduced to the case of polynomic parametric uncertainty, and thus be solved by means of the algorithm.

Sideris, Athanasios↗

Uncertainty quantification of a deep learning fuel property prediction model

Deep learning models are being widely used in the field of combustion. Given the black-box nature of typical neural network based models, uncertainty quantification (UQ) is critical to ensure the reliability of predictions as well as the training datasets, and for a principled quantification of noise and its various sources. Deep learning surrogate models for predicting properties of chemical compounds and mixtures have been recently shown to be promising for enabling data-driven fuel design and optimization, with the ultimate goal of improving efficiency and lowering emissions from combustion engines. In this study, UQ is performed for a multi-task deep learning model that simultaneously predicts the research octane number (RON), Motor Octane Number (MON), and Yield Sooting Index (YSI) of pure components and multicomponent blends. The deep learning model is comprised of three smaller networks: Extractor 1, Extractor 2, and Predictor, and a mixing operator. The molecular fingerprints of individual components are encoded via Extractor 1 and Extractor 2, the mixing operator generates fingerprints for mixtures/blends based on linear mixing operation, and the predictor maps the fingerprint to the target properties. Two different classes of UQ methods, Monte Carlo ensemble methods and Bayesian neural networks (BNNs), are employed for quantifying the epistemic uncertainty. Combinations of Bernoulli and Gaussian distributions with DropConnect and DropOut techniques are explored as ensemble methods. All the DropConnect, DropOut and Bayesian layers are applied to the predictor network. Aleatoric uncertainty is modeled by assuming that each data point has an independent uncertainty associated with it. The results of the UQ study are further analyzed to compare the performance of BNN and ensemble methods. Although this study is confined to UQ of fuel property prediction, the methodologies are applicable to other deep learning frameworks that are being widely used in the combustion community.

33 ADVANCED PROPULSION SYSTEMS↗

Power system resilience through defender-attacker-defender models with uncertainty: an overview

Protecting and fortifying a power system to make it resilient is an important and hard problem to solve. The interaction between defenders and attackers, the availability of information and the complexity of power system require carefully selecting models and presenting the underlying assumptions. Trilevel defender-attacker-defender models have been developed to investigate the resilience of power systems. In this paper, we review trilevel models in power system application, with the aim of demonstrating the accessibility and applicability of these complex optimization formulations and discussing the underlying assumptions from these models. In particular, we highlight modeling choices, algorithmic details, and how operational and information uncertainty affects resilience versus the traditional complete-knowledge-based optimal solutions. We also describe other similar relevant models which lack such uncertainty and discuss insights on how to address operational, attacker, and defender related uncertainties in future research efforts.

multi-level optimization, defender-attacker-defend↗

Uncertainty Error Modeling for Non-Linear State Estimation With Unsynchronized SCADA and µPMU Measurements

Distribution systems of the future smart grid require enhancements to the reliability of distribution system state estimation (DSSE) in the face of low measurement redundancy, unsynchronized measurements, and dynamic load profiles. Micro phasor measurement units (µPMUs) facilitate co-synchronized measurements with high granularity, albeit at an often prohibitively expensive installation cost. Supervisory control and data acquisition (SCADA) measurements can supplement µPMU data, although they are received at a slower sampling rate. Further complicating matters is the uncertainty associated with load dynamics and unsynchronized measurements–not only are the SCADA and µPMU measurements not synchronized with each other, but the SCADA measurements themselves are received at different time intervals with respect to one another. This paper proposes a non-linear state estimation framework which models dynamic load uncertainty error by updating the variances of the unsynchronized measurements, leading to a time-varying system of weights in the weighted least squares state estimator. Case studies are performed on the 33-Bus Distribution System in MATPOWER, using Ornstein–Uhlenbeck stochastic processes to simulate dynamic load conditions.

Cooper, Austin↗

Methods for evaluating the predictive accuracy of structural dynamic models

Modeling uncertainty is defined in terms of the difference between predicted and measured eigenvalues and eigenvectors. Data compiled from 22 sets of analysis/test results was used to create statistical databases for large truss-type space structures and both pretest and posttest models of conventional satellite-type space structures. Modeling uncertainty is propagated through the model to produce intervals of uncertainty on frequency response functions, both amplitude and phase. This methodology was used successfully to evaluate the predictive accuracy of several structures, including the NASA CSI Evolutionary Structure tested at Langley Research Center. Test measurements for this structure were within + one-sigma intervals of predicted accuracy for the most part, demonstrating the validity of the methodology and computer code.

Hasselman, Timothy K.↗

Hydraulic Properties Data Package for the E-Area Soils, Cementitious Materials, and Waste Zones–Update

Hydraulic property estimates for the soils, cementitious materials, and waste zones associated with the E-Area low-level radioactive waste disposal units have been provided to support the Performance Assessments (PA) for the E-Area Low-Level Waste Facility (LLWF). Nominal or “best estimate” hydraulic property values for use in the deterministic modeling are provided along with representations of the hydraulic property value uncertainty for use in sensitivity and uncertainty modeling. The hydraulic properties provided for each of the E-Area materials include: porosity ( η ), dry bulk density ( ρ b ), particle density (ρ p ), saturated hydraulic conductivity ( K sat ), characteristic curves (suction head, saturation, and relative permeability), and effective diffusion coefficient ( D e ). A representation of the uncertainty associated with each property, except for the characteristic curves, is provided for each material, except for the E-Area waste zones. These nominal parameter values for each of the E-Area soils, cementitious materials, and waste zones, and, where indicated, parameter uncertainty representations, are based upon the following in order of priority: Site-specific field data, Site-specific laboratory data, Similarity to material with site-specific field or laboratory data, and Literature data. Additionally, a methodology to represent long-term concrete degradation is provided. Finally, because much of the nominal hydraulic property values and uncertainty representations for the E-Area soils, cementitious materials, and waste zones are based on similarity to other materials or literature data, a methodology to prioritize additional work to better define these values and representations is outlined. Prioritization should be based on the importance of the material and/or property to the results of deterministic, sensitivity, and uncertainty modeling. This prioritization should be established through a process of sensitivity modeling. This report supersedes the previous hydraulic properties data package. Revision 1 contains clarifications, updates and corrections to text, figures and tables in a number of places in the report along with some minor editing.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Apparatus and method for safety analysis evaluation with data-driven workflow

An apparatus and method for system safety analysis evaluation is provided, the apparatus including processing circuitry configured for generating a calculation matrix for a system, generating a plurality of models based on the calculation matrix, performing a benchmarking or convolution analysis of the plurality of models, identifying a design envelope based on the benchmarking or convolution analysis, deriving uncertainty models from the benchmarking or convolution analysis, deriving an assessment judgment based on the uncertainty models and acceptance criteria, defining one or more limiting scenarios based on the design envelope, and determining a safety margin in at least one figure-of-merit for the system based on the design envelope and the acceptance criteria.

Martin, Robert P.↗

Apparatus and method for safety analysis evaluation with data-driven workflow

An apparatus and method for system safety analysis evaluation is provided, the apparatus including processing circuitry configured for generating a calculation matrix for a system, generating a plurality of models based on the calculation matrix, performing a benchmarking or convolution analysis of the plurality of models, identifying a design envelope based on the benchmarking or convolution analysis, deriving uncertainty models from the benchmarking or convolution analysis, deriving an assessment judgment based on the uncertainty models and acceptance criteria, defining one or more limiting scenarios based on the design envelope, and determining a safety margin in at least one figure-of-merit for the system based on the design envelope and the acceptance criteria.

Martin, Robert P.↗

Magnetized Winds of M-type Stars and Star–Planet Magnetic Interactions: Uncertainties and Modeling Strategy

M-type stars are the most common stars in the Universe. They are ideal hosts for the search of exoplanets in the habitable zone (HZ), as their small size and low temperature make the HZ much closer-in than their solar twins. Harboring very deep convective layers, they also usually exhibit very intense magnetic fields. Understanding their environment, in particular their coronal and wind properties, is thus very important, as they might be very different from what is observed in the solar system. The mass-loss rate of M-type stars is poorly known observationally, and recent attempts to estimate it for some of them (e.g., TRAPPIST-1 and Proxima Centauri) can vary by an order of magnitude. In this work, we revisit the stellar wind properties of M dwarfs in the light of the latest estimates of $\dot{M}$ through Lyα absorption at the astropause and slingshot prominences. We outline a modeling strategy to estimate the mass-loss rate, radiative loss, and wind speed, with uncertainties, based on an Alfvén-wave-driven stellar wind model. We find that it is very likely that several TRAPPIST-1 planets lie within the Alfvén surface, which implies that these planets experience star–planet magnetic interactions (SPMIs). We also find that SPMIs between Proxima Cen b and its host star could be the reason for recently observed radio emissions.

M stars↗

Backshell Radiative Heating and Shock Layer Kinetic Measurement in NASA’s Electric Arc Shock Tube Facility

A methodology for creating incident shocks with similarity to the backshell radiative heating environment on planetary probes is presented. Two test series were carried out in the Electric Arc Shock Tube (EAST) at NASA Ames to quantify the backshell environment for planned and executed missions entering the atmospheres of Mars and Titan. The comparison of measured radiance in the shock tube to predicted post shock radiation levels is used to quantify the uncertainty in the model. This model uncertainty may then be related back to the flight condition to assess the error in the flight heating prediction. Tests for Mars entry show the shock tube measurements to be bracketed between two kinetic models by 2-7%. This suggests an 8% error in predicting the measured heating cannot be attributed to radiation. Comparisons to planned Titan entry suggest a substantial overprediction of the backshell radiation, which suggests opportunity for future refinement of radiative heating models.

radiation↗

Probabilistic data fusion and physics-informed machine learning: A new paradigm for modeling under uncertainty, and its application to accelerating the discovery of new materials

In this report we summarize the work conducted by PI Perdikaris and his group under this Early Career project DE–SC0019116 during the period of 09/01/2018 – 08/31/2023. The central aim of the work was to introduce a new paradigm for scientific data analysis that can seamlessly synthesize rigorous mathematical modeling with data of variable fidelity (e.g., measurements at multiple scales/resolutions or predictions of variable fidelity models) and multiple modalities (e.g., images, time–series, or scattered measurements). The setting we are interested in involves complex systems that are partially observed and whose dynamical behavior could be hard to model or totally unknown. The inherent uncertainty associated with this setting necessitates a departure from the classical deterministic realm of modeling and scientific computation, and, consequently, our main building blocks can no longer be crisp deterministic numbers and governing laws, but instead we must operate with probabilistic models.

97 MATHEMATICS AND COMPUTING↗

Process Interactions Can Change Process Ranking in a Coupled Complex System Under Process Model and Parametric Uncertainty

For a complex hydrologic system with multiple processes and process interactions, global sensitivity analysis is often used to identify important or influential parameters for model development and improvement. The identification is complicated by process model uncertainty, when a system process can be represented by multiple process models. This study develops a new total-effect process sensitivity index to identify influential processes under model uncertainty. This is done by extending Sobol's total-effect parameter sensitivity index for one system model to total-effect process sensitivity index for multiple system models to account for uncertainty in process models and model parameters. The total-effect process sensitivity index includes not only the first-order process sensitivity index for measuring the importance of individual processes but also higher-order indices that account for process interactions. The total-effect process sensitivity index can identify an influential process that itself and its interactions with other processes influence a model output. Here, the total-effect process sensitivity index is applied to two numerical examples: (a) Sobol's G*-functions with analytical solutions of first-order and total-effect process sensitivity indices, and (b) groundwater flow models with interactions between recharge, geology, and snowmelt processes. The second evaluation shows that, due to second-order and higher-order process interactions, the first-order and total-effect process sensitivity indices give different process ranking. It is thus necessary to estimate both first-order and total-effect process sensitivity indices to appreciate the difference between the first-order impact of a process alone and the overall total-effect impact of the process itself and its interactions with other processes on a model output.

54 ENVIRONMENTAL SCIENCES↗

A critical verification of beam and shell models of wind turbine blades

Ever-increasing wind turbine size has challenged predictive capabilities on several fronts. Here, to address part of the blade structural modeling uncertainty, a systematic model fidelity comparison study was conducted on commonly used finite elements. pyNuMAD was utilized to create beam, shell, and solid models of a 100 m long blade undergoing large static deflections. The solid model avoided the use of layered-solid elements by resolving core and facesheet layers. An unprecedented model with 73.7 million elements revealed insights that have never been possible from prior experimental and numerical studies. As compared to the solid element model, the tip deflection from the shell and beam model was found to be about 2% and 4.3% too low, respectively. The twist from the beam model was found to be about 5.6% too high, while the twist from shell model was 24% too low, though improvement was demonstrated with mesh refinement. The beam model adhesive stresses were more accurate than the shell model. Out-of-plane stresses were of great significance near geometric and material discontinuities, and neither the shell nor beam model captured these effects well. Failure predictions from beam, shell, or layered-solid models are unlikely to be reliable at trailing edges, adhesives, ply-drops, spar-cap boundaries.

17 WIND ENERGY↗

Third moments of nucleon unpolarized, polarized, and transversity parton distribution functions from physical-point lattice QCD

Using forward matrix elements of local leading-twist operators, we present a determination of the isovector third Mellin moments ⟨𝑥 2 ⟩ of nucleon unpolarized, polarized, and transversity parton distribution functions. Two lattice QCD ensembles at the physical pion mass are used, which were generated using a tree-level Symanzik-improved gauge action and 2+1 flavor tree-level improved Wilson Clover fermions coupling via 2-level HEX-smearing. Leveraging a wide set of operators, two extraction methods for the matrix elements, and the automatic inclusion of model uncertainties via bootstrapped model averages, we extract values of the third Mellin moments. Furthermore, this is the first direct calculation of these observables performed at the physical pion mass.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Regional quasigeoid determination in Northern Germany and comparison with GPS

For the northern part of the Federal Republic of Germany, new quasigeoid solutions were computed by least squares collocation and fast Fourier transformation (FFT) techniques using point and mean gravity data, a digital terrain model, and a global geopotential model. As severe accuracy limitations for precise regional quasigeoid determination come from global model uncertainties, different geopotential models were investigated by combining them with gravimetric data and comparing the quasigeoid heights with GPS and leveling. Optimum results were obtained by a global model tailored to gravity data in Europe. Collocation and FFT results based on this model agree well. The comparison with GPS and leveling yields rms discrepancies of + or - 2 cm over approximately 400 km range.

Denker, Heiner↗

The Advanced Modeling, Simulation and Analysis Capability Roadmap Vision for Engineering

This paper summarizes a subset of the Advanced Modeling Simulation and Analysis (AMSA) Capability Roadmap that was developed for NASA in 2005. The AMSA Capability Roadmap Team was chartered to "To identify what is needed to enhance NASA's capabilities to produce leading-edge exploration and science missions by improving engineering system development, operations, and science understanding through broad application of advanced modeling, simulation and analysis techniques." The AMSA roadmap stressed the need for integration, not just within the science, engineering and operations domains themselves, but also across these domains. Here we discuss the roadmap element pertaining to integration within the engineering domain, with a particular focus on implications for future observatory missions. The AMSA products supporting the system engineering function are mission information, bounds on information quality, and system validation guidance. The Engineering roadmap element contains 5 sub-elements: (1) Large-Scale Systems Models, (2) Anomalous Behavior Models, (3) advanced Uncertainty Models, (4) Virtual Testing Models, and (5) space-based Robotics Manufacture and Servicing Models.

Zang, Thomas↗

Evaluating Model Performance of an Ensemble-based Chemical Data Assimilation System During INTEX-B Field Mission

We present a global chemical data assimilation system using a global atmosphere model, the Community Atmosphere Model (CAM3) with simplified chemistry and the Data Assimilation Research Testbed (DART) assimilation package. DART is a community software facility for assimilation studies using the ensemble Kalman filter approach. Here, we apply the assimilation system to constrain global tropospheric carbon monoxide (CO) by assimilating meteorological observations of temperature and horizontal wind velocity and satellite CO retrievals from the Measurement of Pollution in the Troposphere (MOPITT) satellite instrument. We verify the system performance using independent CO observations taken on board the NSFINCAR C-130 and NASA DC-8 aircrafts during the April 2006 part of the Intercontinental Chemical Transport Experiment (INTEX-B). Our evaluations show that MOPITT data assimilation provides significant improvements in terms of capturing the observed CO variability relative to no MOPITT assimilation (i.e. the correlation improves from 0.62 to 0.71, significant at 99% confidence). The assimilation provides evidence of median CO loading of about 150 ppbv at 700 hPa over the NE Pacific during April 2006. This is marginally higher than the modeled CO with no MOPITT assimilation (-140 ppbv). Our ensemble-based estimates of model uncertainty also show model overprediction over the source region (i.e. China) and underprediction over the NE Pacific, suggesting model errors that cannot be readily explained by emissions alone. These results have important implications for improving regional chemical forecasts and for inverse modeling of CO sources and further demonstrate the utility of the assimilation system in comparing non-coincident measurements, e.g. comparing satellite retrievals of CO with in-situ aircraft measurements. The work described above also brought to light several short-comings of the data assimilation approach for CO profiles. Because of the limited vertical resolution of the measurement, the retrievals at different altitudes are correlated which can lead to problems with numerical error and overall efficiency. This has resulted in a manuscript that is about to be submitted to JGR:

Arellano, A. F., Jr.↗