SEARCH · Engineering Papers

Results for “Model uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Uncertainty Error Modeling for Non-Linear State Estimation With Unsynchronized SCADA and µPMU Measurements

Distribution systems of the future smart grid require enhancements to the reliability of distribution system state estimation (DSSE) in the face of low measurement redundancy, unsynchronized measurements, and dynamic load profiles. Micro phasor measurement units (µPMUs) facilitate co-synchronized measurements with high granularity, albeit at an often prohibitively expensive installation cost. Supervisory control and data acquisition (SCADA) measurements can supplement µPMU data, although they are received at a slower sampling rate. Further complicating matters is the uncertainty associated with load dynamics and unsynchronized measurements–not only are the SCADA and µPMU measurements not synchronized with each other, but the SCADA measurements themselves are received at different time intervals with respect to one another. This paper proposes a non-linear state estimation framework which models dynamic load uncertainty error by updating the variances of the unsynchronized measurements, leading to a time-varying system of weights in the weighted least squares state estimator. Case studies are performed on the 33-Bus Distribution System in MATPOWER, using Ornstein–Uhlenbeck stochastic processes to simulate dynamic load conditions.

Cooper, Austin↗

NASA NTRS1991

Methods for evaluating the predictive accuracy of structural dynamic models

Modeling uncertainty is defined in terms of the difference between predicted and measured eigenvalues and eigenvectors. Data compiled from 22 sets of analysis/test results was used to create statistical databases for large truss-type space structures and both pretest and posttest models of conventional satellite-type space structures. Modeling uncertainty is propagated through the model to produce intervals of uncertainty on frequency response functions, both amplitude and phase. This methodology was used successfully to evaluate the predictive accuracy of several structures, including the NASA CSI Evolutionary Structure tested at Langley Research Center. Test measurements for this structure were within + one-sigma intervals of predicted accuracy for the most part, demonstrating the validity of the methodology and computer code.

Hasselman, Timothy K.↗

DOE OSTI2020

Hydraulic Properties Data Package for the E-Area Soils, Cementitious Materials, and Waste Zones–Update

Hydraulic property estimates for the soils, cementitious materials, and waste zones associated with the E-Area low-level radioactive waste disposal units have been provided to support the Performance Assessments (PA) for the E-Area Low-Level Waste Facility (LLWF). Nominal or “best estimate” hydraulic property values for use in the deterministic modeling are provided along with representations of the hydraulic property value uncertainty for use in sensitivity and uncertainty modeling. The hydraulic properties provided for each of the E-Area materials include: porosity ( η ), dry bulk density ( ρ b ), particle density (ρ p ), saturated hydraulic conductivity ( K sat ), characteristic curves (suction head, saturation, and relative permeability), and effective diffusion coefficient ( D e ). A representation of the uncertainty associated with each property, except for the characteristic curves, is provided for each material, except for the E-Area waste zones. These nominal parameter values for each of the E-Area soils, cementitious materials, and waste zones, and, where indicated, parameter uncertainty representations, are based upon the following in order of priority: Site-specific field data, Site-specific laboratory data, Similarity to material with site-specific field or laboratory data, and Literature data. Additionally, a methodology to represent long-term concrete degradation is provided. Finally, because much of the nominal hydraulic property values and uncertainty representations for the E-Area soils, cementitious materials, and waste zones are based on similarity to other materials or literature data, a methodology to prioritize additional work to better define these values and representations is outlined. Prioritization should be based on the importance of the material and/or property to the results of deterministic, sensitivity, and uncertainty modeling. This prioritization should be established through a process of sensitivity modeling. This report supersedes the previous hydraulic properties data package. Revision 1 contains clarifications, updates and corrections to text, figures and tables in a number of places in the report along with some minor editing.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

DOE OSTI2021

Apparatus and method for safety analysis evaluation with data-driven workflow

An apparatus and method for system safety analysis evaluation is provided, the apparatus including processing circuitry configured for generating a calculation matrix for a system, generating a plurality of models based on the calculation matrix, performing a benchmarking or convolution analysis of the plurality of models, identifying a design envelope based on the benchmarking or convolution analysis, deriving uncertainty models from the benchmarking or convolution analysis, deriving an assessment judgment based on the uncertainty models and acceptance criteria, defining one or more limiting scenarios based on the design envelope, and determining a safety margin in at least one figure-of-merit for the system based on the design envelope and the acceptance criteria.

Martin, Robert P.↗

DOE OSTI2023

Apparatus and method for safety analysis evaluation with data-driven workflow

Martin, Robert P.↗

DOE OSTI2024

Magnetized Winds of M-type Stars and Star–Planet Magnetic Interactions: Uncertainties and Modeling Strategy

M-type stars are the most common stars in the Universe. They are ideal hosts for the search of exoplanets in the habitable zone (HZ), as their small size and low temperature make the HZ much closer-in than their solar twins. Harboring very deep convective layers, they also usually exhibit very intense magnetic fields. Understanding their environment, in particular their coronal and wind properties, is thus very important, as they might be very different from what is observed in the solar system. The mass-loss rate of M-type stars is poorly known observationally, and recent attempts to estimate it for some of them (e.g., TRAPPIST-1 and Proxima Centauri) can vary by an order of magnitude. In this work, we revisit the stellar wind properties of M dwarfs in the light of the latest estimates of $\dot{M}$ through Lyα absorption at the astropause and slingshot prominences. We outline a modeling strategy to estimate the mass-loss rate, radiative loss, and wind speed, with uncertainties, based on an Alfvén-wave-driven stellar wind model. We find that it is very likely that several TRAPPIST-1 planets lie within the Alfvén surface, which implies that these planets experience star–planet magnetic interactions (SPMIs). We also find that SPMIs between Proxima Cen b and its host star could be the reason for recently observed radio emissions.

M stars↗

NASA NTRSDate not supplied

Backshell Radiative Heating and Shock Layer Kinetic Measurement in NASA’s Electric Arc Shock Tube Facility

A methodology for creating incident shocks with similarity to the backshell radiative heating environment on planetary probes is presented. Two test series were carried out in the Electric Arc Shock Tube (EAST) at NASA Ames to quantify the backshell environment for planned and executed missions entering the atmospheres of Mars and Titan. The comparison of measured radiance in the shock tube to predicted post shock radiation levels is used to quantify the uncertainty in the model. This model uncertainty may then be related back to the flight condition to assess the error in the flight heating prediction. Tests for Mars entry show the shock tube measurements to be bracketed between two kinetic models by 2-7%. This suggests an 8% error in predicting the measured heating cannot be attributed to radiation. Comparisons to planned Titan entry suggest a substantial overprediction of the backshell radiation, which suggests opportunity for future refinement of radiative heating models.

radiation↗

DOE OSTI2024

Probabilistic data fusion and physics-informed machine learning: A new paradigm for modeling under uncertainty, and its application to accelerating the discovery of new materials

In this report we summarize the work conducted by PI Perdikaris and his group under this Early Career project DE–SC0019116 during the period of 09/01/2018 – 08/31/2023. The central aim of the work was to introduce a new paradigm for scientific data analysis that can seamlessly synthesize rigorous mathematical modeling with data of variable fidelity (e.g., measurements at multiple scales/resolutions or predictions of variable fidelity models) and multiple modalities (e.g., images, time–series, or scattered measurements). The setting we are interested in involves complex systems that are partially observed and whose dynamical behavior could be hard to model or totally unknown. The inherent uncertainty associated with this setting necessitates a departure from the classical deterministic realm of modeling and scientific computation, and, consequently, our main building blocks can no longer be crisp deterministic numbers and governing laws, but instead we must operate with probabilistic models.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Process Interactions Can Change Process Ranking in a Coupled Complex System Under Process Model and Parametric Uncertainty

For a complex hydrologic system with multiple processes and process interactions, global sensitivity analysis is often used to identify important or influential parameters for model development and improvement. The identification is complicated by process model uncertainty, when a system process can be represented by multiple process models. This study develops a new total-effect process sensitivity index to identify influential processes under model uncertainty. This is done by extending Sobol's total-effect parameter sensitivity index for one system model to total-effect process sensitivity index for multiple system models to account for uncertainty in process models and model parameters. The total-effect process sensitivity index includes not only the first-order process sensitivity index for measuring the importance of individual processes but also higher-order indices that account for process interactions. The total-effect process sensitivity index can identify an influential process that itself and its interactions with other processes influence a model output. Here, the total-effect process sensitivity index is applied to two numerical examples: (a) Sobol's G*-functions with analytical solutions of first-order and total-effect process sensitivity indices, and (b) groundwater flow models with interactions between recharge, geology, and snowmelt processes. The second evaluation shows that, due to second-order and higher-order process interactions, the first-order and total-effect process sensitivity indices give different process ranking. It is thus necessary to estimate both first-order and total-effect process sensitivity indices to appreciate the difference between the first-order impact of a process alone and the overall total-effect impact of the process itself and its interactions with other processes on a model output.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

A critical verification of beam and shell models of wind turbine blades

Ever-increasing wind turbine size has challenged predictive capabilities on several fronts. Here, to address part of the blade structural modeling uncertainty, a systematic model fidelity comparison study was conducted on commonly used finite elements. pyNuMAD was utilized to create beam, shell, and solid models of a 100 m long blade undergoing large static deflections. The solid model avoided the use of layered-solid elements by resolving core and facesheet layers. An unprecedented model with 73.7 million elements revealed insights that have never been possible from prior experimental and numerical studies. As compared to the solid element model, the tip deflection from the shell and beam model was found to be about 2% and 4.3% too low, respectively. The twist from the beam model was found to be about 5.6% too high, while the twist from shell model was 24% too low, though improvement was demonstrated with mesh refinement. The beam model adhesive stresses were more accurate than the shell model. Out-of-plane stresses were of great significance near geometric and material discontinuities, and neither the shell nor beam model captured these effects well. Failure predictions from beam, shell, or layered-solid models are unlikely to be reliable at trailing edges, adhesives, ply-drops, spar-cap boundaries.

17 WIND ENERGY↗

DOE OSTI2026

Third moments of nucleon unpolarized, polarized, and transversity parton distribution functions from physical-point lattice QCD

Using forward matrix elements of local leading-twist operators, we present a determination of the isovector third Mellin moments ⟨𝑥 2 ⟩ of nucleon unpolarized, polarized, and transversity parton distribution functions. Two lattice QCD ensembles at the physical pion mass are used, which were generated using a tree-level Symanzik-improved gauge action and 2+1 flavor tree-level improved Wilson Clover fermions coupling via 2-level HEX-smearing. Leveraging a wide set of operators, two extraction methods for the matrix elements, and the automatic inclusion of model uncertainties via bootstrapped model averages, we extract values of the third Mellin moments. Furthermore, this is the first direct calculation of these observables performed at the physical pion mass.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

NASA NTRS1989

Regional quasigeoid determination in Northern Germany and comparison with GPS

For the northern part of the Federal Republic of Germany, new quasigeoid solutions were computed by least squares collocation and fast Fourier transformation (FFT) techniques using point and mean gravity data, a digital terrain model, and a global geopotential model. As severe accuracy limitations for precise regional quasigeoid determination come from global model uncertainties, different geopotential models were investigated by combining them with gravimetric data and comparing the quasigeoid heights with GPS and leveling. Optimum results were obtained by a global model tailored to gravity data in Europe. Collocation and FFT results based on this model agree well. The comparison with GPS and leveling yields rms discrepancies of + or - 2 cm over approximately 400 km range.

Denker, Heiner↗

NASA NTRS2006

The Advanced Modeling, Simulation and Analysis Capability Roadmap Vision for Engineering

This paper summarizes a subset of the Advanced Modeling Simulation and Analysis (AMSA) Capability Roadmap that was developed for NASA in 2005. The AMSA Capability Roadmap Team was chartered to "To identify what is needed to enhance NASA's capabilities to produce leading-edge exploration and science missions by improving engineering system development, operations, and science understanding through broad application of advanced modeling, simulation and analysis techniques." The AMSA roadmap stressed the need for integration, not just within the science, engineering and operations domains themselves, but also across these domains. Here we discuss the roadmap element pertaining to integration within the engineering domain, with a particular focus on implications for future observatory missions. The AMSA products supporting the system engineering function are mission information, bounds on information quality, and system validation guidance. The Engineering roadmap element contains 5 sub-elements: (1) Large-Scale Systems Models, (2) Anomalous Behavior Models, (3) advanced Uncertainty Models, (4) Virtual Testing Models, and (5) space-based Robotics Manufacture and Servicing Models.

Zang, Thomas↗

NASA NTRS2007

Evaluating Model Performance of an Ensemble-based Chemical Data Assimilation System During INTEX-B Field Mission

We present a global chemical data assimilation system using a global atmosphere model, the Community Atmosphere Model (CAM3) with simplified chemistry and the Data Assimilation Research Testbed (DART) assimilation package. DART is a community software facility for assimilation studies using the ensemble Kalman filter approach. Here, we apply the assimilation system to constrain global tropospheric carbon monoxide (CO) by assimilating meteorological observations of temperature and horizontal wind velocity and satellite CO retrievals from the Measurement of Pollution in the Troposphere (MOPITT) satellite instrument. We verify the system performance using independent CO observations taken on board the NSFINCAR C-130 and NASA DC-8 aircrafts during the April 2006 part of the Intercontinental Chemical Transport Experiment (INTEX-B). Our evaluations show that MOPITT data assimilation provides significant improvements in terms of capturing the observed CO variability relative to no MOPITT assimilation (i.e. the correlation improves from 0.62 to 0.71, significant at 99% confidence). The assimilation provides evidence of median CO loading of about 150 ppbv at 700 hPa over the NE Pacific during April 2006. This is marginally higher than the modeled CO with no MOPITT assimilation (-140 ppbv). Our ensemble-based estimates of model uncertainty also show model overprediction over the source region (i.e. China) and underprediction over the NE Pacific, suggesting model errors that cannot be readily explained by emissions alone. These results have important implications for improving regional chemical forecasts and for inverse modeling of CO sources and further demonstrate the utility of the assimilation system in comparing non-coincident measurements, e.g. comparing satellite retrievals of CO with in-situ aircraft measurements. The work described above also brought to light several short-comings of the data assimilation approach for CO profiles. Because of the limited vertical resolution of the measurement, the retrievals at different altitudes are correlated which can lead to problems with numerical error and overall efficiency. This has resulted in a manuscript that is about to be submitted to JGR:

Arellano, A. F., Jr.↗

NASA NTRS2019

PACE Technical Report Series, Volume 6: Data Product Requirements and Error Budgets Consensus Document

This chapter summarizes ocean color science data product requirements for the Plankton, Aerosol, Cloud,ocean Ecosystem (PACE) mission's Ocean Color Instrument (OCI) and observatory. NASA HQ delivered Level-1 science data product requirements to the PACE Project, which encompass data products to be produced and their associated uncertainties. These products and uncertainties ultimately determine the spectral nature of OCI and the performance requirements assigned to OCI and the observatory. This chapter ultimately serves to provide context for the remainder of this volume, which describes tools developed that allocate these uncertainties into their components, including allowable OCI systematic and random uncertainties, observatory geo location uncertainties, and geophysical model uncertainties.

Cetinic, Ivona↗

NASA NTRS2024

Spectral Correlation in MODIS Water-Leaving Reflectance Retrieval Uncertainty

Spectral remote sensing reflectance, Rrs(λ) (sr−1), is the fundamental quantity used to derive a host of bio-optical and biogeochemical properties of the water column from satellite ocean color measurements. Estimation of uncertainty in those derived geophysical products is therefore dependent on knowledge of the uncertainty in satellite-retrieved R rs . Furthermore, since the associated algorithms require R rs at multiple spectral bands, the spectral (i.e., band-to-band)error covariance in R rs is needed to accurately estimate the uncertainty in those derived properties. This study establishes a derivative-based approach for propagating instrument random noise, instrument systematic uncertainty, and forward model uncertainty into R rs as retrieved using NASA’s multiple-scattering epsilon (MSEPS) atmospheric correction algorithm, to generate pixel-level error covariance in R rs . The approach is applied to measurements from Moderate Resolution Imaging Spectroradiometer (MODIS) on the Aqua satellite and verified using Monte Carlo (MC) analysis. We also make use of this full spectral error covariance in R rs to calculate uncertainty in phytoplankton pigment chlorophyll-a concentration (chl a , mg/m 3 ) and diffuse attenuation coefficient of downwelling irradiance at 490 nm (K d (490), m -1 ). Accounting for the error covariance in R rs generally reduces the estimated relative uncertainty in chl a by ∼1-2% (absolute value) in waters with chl a < 0.25 mg/m 3 where the color index (CI) algorithm is used. The reduction is ∼5-10% in waters with chl a > 0.35 mg/m 3 where the blue-green ratio (OCX) algorithm is used. Such reduction can be higher than 30% in some regions. For K d (490), the reduction by error covariance is generally ∼2%, but can be higher than 20% in some regions. The error covariance in R rs is further verified through forward-calculating chl a from MODIS-retrieved and in situ R rs and comparing estimated uncertainty with observed differences. An 8-day global composite of propagated uncertainty shows that the goal of 35% uncertainty in chl a can be achieved over deep ocean waters (chl a ≤ 0.1 mg/m3). While the derivative-based approach generates reasonable error covariance in R rs some assumptions should be updated as our knowledge improves. These include the inter-band error correlation in top-of-atmosphere reflectance, and uncertainties in the calibration of MODIS 869 nm band, in ancillary data, and in the in situ data used for system vicarious calibration.

Ocean color↗

DOE OSTI2023

Constraining neutrino oscillation and interaction parameters with the NOvA Near Detector and Far Detector data using Markov Chain Monte Carlo

This thesis reports a constraint of the neutrino oscillation parameters $\Delta m^{2}_{32}$, $\sin^2 \theta_{23}$, and $\delta_{CP}$ using the NuMI Off-Axis $\nu$ Appearance (NOvA) experiment's Near Detector (ND) data and Far Detector (FD) fake data set simultaneously. This thesis also reports a constraint on NOvA's systematic uncertainty model solely with its Near Detector data. The Hamiltonian Monte Carlo algorithm is used to estimate Bayesian Credible Intervals for the oscillation and interaction parameters. The $1\sigma$ Credible Intervals for $\sin^2 \theta_{23}$ are $(0.44, 0.512)$ $\cup$ $(0.536, 0.56)$, for $\Delta m^{2}_{32}$ $(2.41 \times 10^{-3}$ eV$^2,\ 2.52 \times 10^{-3}$ eV$^2)$, and for $\delta_{CP}$ $(0.74\pi,\ 1.1\pi)$ $\cup$ $(1.38\pi,\ 1.58\pi)$. The statistical power of the ND data constrains NOvA's interaction parameters, while the FD fake data constrains the oscillation parameters. This is the first analysis within NOvA to constrain the ND and FD prediction sim ultaneously, and to investigate the neutrino interaction modeling in the context of constraining the oscillation parameters. To constrain the ND data requires a sophisticated understanding of the neutrino interaction modeling and its uncertainties. The interested reader is advised to focus on Chapters 4 and 6, which discuss the ND selection, uncertainties, and ND-only fits to data. The reader interested in oscillation parameter constraints will find this in Chapter 7.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

NASA NTRS2013

Lessons Learned from the AIRS Pre-Flight Radiometric Calibration

The Atmospheric Infrared Sounder (AIRS) instrument flies on the NASA Aqua satellite and measures the upwelling hyperspectral earth radiance in the spectral range of 3.7-15.4 micron with a nominal ground resolution at nadir of 13.5 km. The AIRS spectra are achieved using a temperature controlled grating spectrometer and HgCdTe infrared linear arrays providing 2378 channels with a nominal spectral resolution of approximately 1200. The AIRS pre-flight tests that impact the radiometric calibration include a full system radiometric response (linearity), polarization response, and response vs scan angle (RVS). We re-derive the AIRS instrument radiometric calibration coefficients from the pre-flight polarization measurements, the response vs scan (RVS) angle tests as well as the linearity tests, and a recent lunar roll test that allowed the AIRS to view the moon. The data and method for deriving the coefficients is discussed in detail and the resulting values compared amongst the different tests. Finally, we examine the residual errors in the reconstruction of the external calibrator blackbody radiances and the efficacy of a new radiometric uncertainty model. Results show the radiometric calibration of AIRS to be excellent and the radiometric uncertainty model does a reasonable job of characterizing the errors.

Sounder↗