Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Uncertainty analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,549 records · Page 86

A Gaussian Process Enhancement to Linear Parameter Varying Models

Simulation and analysis for modern engineering systems now routinely requires the merging of multiple disciplines, physical-domains, time-scales, and data sets — all at ever increasing levels. These capabilities are especially needed in the domain of Advanced Air Mobility, where rapidly emerging vehicle designs are significantly more complex, while having to be both cost-effective and safe. To meet these engineering challenges, machine learning methods are an attractive option for merging models and data across multiple areas while providing uncertainty quantification and maintaining computational efficiency. This paper examines the use of Gaussian process machine learning to generalize and enhance the commonly used class of quasi-Linear Parameter Varying models for fast full-envelope simulation while also supporting control system design and analysis with model uncertainty. Gaussian process machine learning is selected because it: can fuse multiple data sets, enables an easy trade-off between data fitting and smoothing, provides model uncertainty quantification, scales well with increasing complexity, and does not generally require starting from a large training data set. To demonstrate the benefits of the approach, a robust stability analysis with Gaussian process uncertainty is shown for a NASA reference design of an electric quad-rotor air-taxi concept vehicle with motor parameter uncertainty.

Gaussian Process↗

Computation of LFT Uncertainty Bounds with Repeated Parametric Uncertainties

A new methodology in which linear fractional transformation uncertainty bounds are directly constructed for use in robust control design and analysis is proposed. Existence conditions for model validating solutions with or without repeated scalar uncertainty are given. The approach is based on minimax formulation to deal with multiple non-repeated structured uncertainty components subject to fixed levels of repeated scalar uncertainties. Input directional dependence and variations with different experiments are addressed by maximizing uncertainty levels over multiple experimental data sets. Preliminary results show that reasonable uncertainty bounds on structured non-repeated uncertainties can be identified directly from measurement data by assuming reasonable levels of repeated scalar uncertainties.

Lim, K. B.↗

A demonstration of improved constraints on primordial gravitational waves with delensing

We present a constraint on the tensor-to-scalar ratio, $r$, derived from measurements of cosmic microwave background (CMB) polarization $B$-modes with "delensing,'' whereby the uncertainty on $r$ contributed by the sample variance of the gravitational lensing $B$-modes is reduced by cross-correlating against a lensing $B$-mode template. This template is constructed by combining an estimate of the polarized CMB with a tracer of the projected large-scale structure. The large-scale-structure tracer used is a map of the cosmic infrared background derived from Planck satellite data, while the polarized CMB map comes from a combination of South Pole Telescope, BICEP/Keck, and Planck data. We expand the BICEP/Keck likelihood analysis framework to accept a lensing template and apply it to the BICEP/Keck data set collected through 2014 using the same parametric foreground modelling as in the previous analysis. From simulations, we find that the uncertainty on $r$ is reduced by $\sim10\%$, from $\sigma(r)$= 0.024 to 0.022, which can be compared with a $\sim26\%$ reduction obtained when using a perfect lensing template. Applying the technique to the real data, the constraint on $r$ is improved from $r_{0.05} < 0.090$ to $r_{0.05} < 0.082$ (95% C.L.). Furthermore, this is the first demonstration of improvement in an $r$ constraint through delensing.

79 ASTRONOMY AND ASTROPHYSICS↗

Propagating neutronic uncertainties for FFTF LOFWOS Test #13

The safety evaluation conducted for licensing a Sodium-cooled Fast Reactor (SFR) may require modeling transients with best-estimate calculation tools that must first be validated against real-world measurements. To provide the community with a valuable benchmarking opportunity for validating SFR analysis tools and methods, the International Atomic Energy Agency (IAEA) initiated a coordinated research project (CRP) in 2018 for the analysis of the Fast Flux Test Facility (FFTF) Loss of Flow Without Scram (LOFWOS) Test #13. The impact of nuclear data uncertainties on neutronics parameters was previously investigated based on the COMMARA-2.0 covariance matrix. Since the transient simulation results are very sensitive to certain reactivity coefficients, it was decided to employ rigorous uncertainty propagation methods to quantify the impact of nuclear data uncertainties on the best-estimate predication of FFTF LOFWOS Test #13. The DAKOTA code is used to propagate neutronic uncertainties through SAS4A/SASSYS-1 transient simulations, while taking into account spatial and reaction-wise correlations within these uncertainties. This study shows that the remaining discrepancies observed between the Argonne National Laboratory (ANL) best-estimate results and the experimental measurements can be partly explained by the uncertainty associated with Gas Expansion Module (GEM) worth, which contributes the majority of the overall nuclear data uncertainty on the output from the FFTF LOFWOS Test #13 transient simulation. This study also confirmed the importance of including spatial and reaction-wise correlations of nuclear data uncertainties on feedback coefficients in the uncertainty propagation to avoid under-estimating their impact during the transient simulations.

42 ENGINEERING↗

Probabilistic neural networks for improved analyses with phenomenological R -matrix

Here we present a method for measurement analyses based on probabilistic deep neural networks that provide several advantages over conventional analyses with phenomenological models. These include predicting physical quantities directly from data, the rapid generation of statistically robust uncertainties, and the ability to bypass some parameters that may induce ambiguities and complications in data analysis. As deep learning methods make predictions through “black boxes,” the uncertainty quantification is typically challenging. We use a probabilistic framework that provides thorough uncertainty quantification and is straightforward to follow in practice. With the network architecture based on the Transformer, we demonstrate the current method for predicting nuclear resonance parameters from scattering data using the phenomenological R-matrix model.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Gaussian Process Optimization of Sensitivity-Based Similarity Metrics between New Nuclear Applications and New/Existing Benchmarks

Confidently designing safe, new nuclear criticality experiments requires expert judgement, which could take years of experience. Sensitivity/uncertainty (S/U) analysis can be utilized by less experienced individuals to conservatively estimate uncertainties in important parameters, such as k eff , in newly proposed nuclear applications. This type of analysis relies on matching new nuclear applications with existing benchmark experiments. The Whisper-1.1 software package included in MCNP6.2 ®1 contains more than 1,100 International Criticality Safety Benchmark Evaluation Project (ICSBEP) benchmarks. These benchmarks however rarely match new nuclear applications. The number of benchmarks available to match a given set of materials or geometric configurations varies significantly. Furthermore, recently performed benchmark experiments may not have had enough time to be properly documented and published. Benchmarks are vital for determining the accuracy of nuclear data and can assist nuclear physics and evaluators in improving nuclear data libraries. Exhaustively exploring the parameter space using simulations with software such as MCNP is too computationally expensive. In this work, Gaussian process optimization was implemented to reduce the number of simulations needed for optimization over multiple parameters. This optimization scheme was designed to selectively generate new benchmarks with high sensitivity-based similarity metrics to user-defined nuclear applications. Two benchmark models of spherically nested shells containing plutonium, uranium, tantalum, and water were used in the optimization to match an application containing plutonium plates, stacked in a tantalum reflector, surrounded by water.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Subsurface Trend Analysis domains for the northern Gulf of Mexico

Geologic domains for the northern Gulf of Mexico derived using the Subsurface Trend Analysis (STA) method. The domains were postulated using geologic province, lithologic, and structural information and validated using statistical methods. Publication detailing the STA method: Rose, K., Bauer, J.R., and Mark-Moser, M. (2020) Subsurface trend analysis, a multi-variate geospatial approach for subsurface evaluation and uncertainty reduction, Interpretation, vol. 8, issue 1 https://library.seg.org/doi/abs/10.1190/int-2019-0019.1 Detailed discussion of domain formation and analysis: Mark-Moser, M., Miller, R., Bauer, J., Rose, K., and C. Disenhof. 2018, Analysis of Subsurface Reservoir Properties Using a Novel Geospatial Approach, Offshore Gulf of Mexico. NETL-TRS-2018 https://edx.netl.doe.gov/dataset/detailed-analysis-of-geospatial-trends-of-hydrocarbon-accumulations-offshore-gulf-of-mexico

geology↗

Probabilistic Structural Analysis Methods (PSAM) for select space propulsion system structural components

The objective is the development of several modular structural analysis packages capable of predicting the probabilistic response distribution for key structural variables such as maximum stress, natural frequencies, transient response, etc. The structural analysis packages are to include stochastic modeling of loads, material properties, geometry (tolerances), and boundary conditions. The solution is to be in terms of the cumulative probability of exceedance distribution (CDF) and confidence bounds. Two methods of probability modeling are to be included as well as three types of structural models - probabilistic finite-element method (PFEM); probabilistic approximate analysis methods (PAAM); and probabilistic boundary element methods (PBEM). The purpose in doing probabilistic structural analysis is to provide the designer with a more realistic ability to assess the importance of uncertainty in the response of a high performance structure. Probabilistic Structural Analysis Method (PSAM) tools will estimate structural safety and reliability, while providing the engineer with information on the confidence that should be given to the predicted behavior. Perhaps most critically, the PSAM results will directly provide information on the sensitivity of the design response to those variables which are seen to be uncertain.

Cruse, T. A.↗

Probabilistic Structural Analysis Methods for select space propulsion system structural components (PSAM)

The objective is the development of several modular structural analysis packages capable of predicting the probabilistic response distribution for key structural variables such as maximum stress, natural frequencies, transient response, etc. The structural analysis packages are to include stochastic modeling of loads, material properties, geometry (tolerances), and boundary conditions. The solution is to be in terms of the cumulative probability of exceedance distribution (CDF) and confidence bounds. Two methods of probability modeling are to be included as well as three types of structural models - probabilistic finite-element method (PFEM); probabilistic approximate analysis methods (PAAM); and probabilistic boundary element methods (PBEM). The purpose in doing probabilistic structural analysis is to provide the designer with a more realistic ability to assess the importance of uncertainty in the response of a high performance structure. Probabilistic Structural Analysis Method (PSAM) tools will estimate structural safety and reliability, while providing the engineer with information on the confidence that should be given to the predicted behavior. Perhaps most critically, the PSAM results will directly provide information on the sensitivity of the design response to those variables which are seen to be uncertain.

Cruse, T. A.↗

Reconstruction of Thermal Protection System Aeroheating using a Green’s Function Approach

Inverse heat transfer (IHT) techniques are often used to reconstruct the surface heating conditions on spacecraft thermal protection systems (TPS) during atmospheric entry. Current IHT techniques for entry spacecraft applications, however, demand substantial computational resources, and are impractical for analyses such as uncertainty quantification and real-time health monitoring. In this paper, a Green’s function sensor fusion approach is used to reconstruct the TPS surface aeroheating conditions on experimental spaceflight and ground test systems from collocated temperature and heat flux sensors embedded in the TPS. The algorithm leverages Green’s functions to model the heat conduction within the spacecraft TPS and stabilizes the recovery of the surface heating condition using the direct heat flux sensor measurement. The algorithm is validated using arc-jet ground test data and applied to the reconstruction of the Mars 2020 backshell heating during Martian atmospheric entry. The performance of the algorithm is benchmarked against a current state-of-the-art IHT framework, FIAT_Opt. The Green’s function-based reconstruction algorithm recovers the net hot-wall heat flux absorbed by the TPS and the incident heat flux from the atmospheric entry environment in close agreement with FIAT_Opt. Notably, computation of the surface heating condition is completed in three orders of magnitude less time with the Green’s function sensor fusion approach using a consumer-grade PC, versus with FIAT_Opt running on a high performance computer cluster. The efficiency of the algorithm is leveraged to compute the uncertainty contributions of input parameters to the total uncertainty in reconstructed Mars 2020 backshell heating for the full atmospheric entry heat pulse. The sensitivity analysis uncovers that, at different times throughout the entry heat pulse, uncertainties in the TPS specific heat, thermal conductivity, and emissivity are all dominant drivers of the reconstruction uncertainty. These results demonstrate Green’s functions and sensor-fusion techniques as promising IHT approaches to reconstruct atmospheric entry environments from TPS-embedded measurements, and highlight how these techniques may give access to post-flight analyses previously hindered by the prohibitive cost of current methods.

Kenneth McAfee↗

Reconstruction of Thermal Protection System Aeroheating using a Green’s Function Approach

Inverse heat transfer (IHT) techniques are often used to reconstruct the surface heating conditions on spacecraft thermal protection systems (TPS) during atmospheric entry. Current IHT techniques for entry spacecraft applications, however, demand substantial computational resources, and are impractical for analyses such as uncertainty quantification and real-time health monitoring. In this paper, a Green’s function sensor fusion approach is used to reconstruct the TPS surface aeroheating conditions on experimental spaceflight and ground test systems from collocated temperature and heat flux sensors embedded in the TPS. The algorithm leverages Green’s functions to model the heat conduction within the spacecraft TPS and stabilizes the recovery of the surface heating condition using the direct heat flux sensor measurement. The algorithm is validated using arc-jet ground test data and applied to the reconstruction of the Mars 2020 backshell heating during Martian atmospheric entry. The performance of the algorithm is benchmarked against a current state-of-the-art IHT framework, FIAT_Opt. The Green’s function-based reconstruction algorithm recovers the net hot-wall heat flux absorbed by the TPS and the incident heat flux from the atmospheric entry environment in close agreement with FIAT_Opt. Notably, computation of the surface heating condition is completed in three orders of magnitude less time with the Green’s function sensor fusion approach using a consumer-grade PC, versus with FIAT_Opt running on a high performance computer cluster. The efficiency of the algorithm is leveraged to compute the uncertainty contributions of input parameters to the total uncertainty in reconstructed Mars 2020 backshell heating for the full atmospheric entry heat pulse. The sensitivity analysis uncovers that, at different times throughout the entry heat pulse, uncertainties in the TPS specific heat, thermal conductivity, and emissivity are all dominant drivers of the reconstruction uncertainty. These results demonstrate Green’s functions and sensor-fusion techniques as promising IHT approaches to reconstruct atmospheric entry environments from TPS-embedded measurements, and highlight how these techniques may give access to post-flight analyses previously hindered by the prohibitive cost of current methods.

Kenneth McAfee↗

Gaseous abundances and methane supersaturation in Titan's troposphere

Various properties of Titan's troposphere are inferred from an analysis of Voyager I infrared spectrometer (IRIS) data between 200 and 600/ cm. Two homogeneous spectral averages acquired at widely separated emission angles are chosen for the analysis. Both data sets are associated with northern low latitudes very close to that of the radio science ingress occultation point. Solutions require simultaneous nonlinear least-squares fits to the two IRIS data sets, coupled with iteration of the radio occultation refractivity data. Values and associated 1-sigma uncertainties of several parameters are inferred from our analysis. These include mole fractions for molecular hydrogen (approx. 0.0011), argon (small), and methane near the surface ( approx. 0.057). Solutions are also obtained for the hydrogen parafraction (close to equilibrium, with considerable uncertainty), air temperature near the surface ( approx. 93 K), surface surface temperature discontinuity (approx. 1 K), and maximum degree of methane supersaturation in the upper troposphere (approx. 1.5). Actual values for the above-mentioned parameters depend on the amount of ethane cloud near the tropopause. There is no evidence for methane clouds in the upper troposphere, nor is their presence compatible with large degrees of supersaturation. A wave number dependence for the stratospheric haze opacity is inferred similar to that found for a polymeric residue created in laboratory discharge experiments. This haze appears to be uniformly distributed with latitude between altitudes of 40 and 160 km, provided those nighttime data at southern high latitudes that are discounted.

Samuelson, Robert E.↗

Data Assimilation using Non-invasive Monte Carlo Sensitivity Analysis of Reactor Kinetics Parameters [Slides]

Sensitivity coefficients of prompt neutron decay constant (α) and effective delayed neutron fraction (β eff ) to Pu-239 nuclear data were calculated using a newly available tool (ACEtk). Uncertainty calculations showed the following trends: (1) The prompt neutron decay constant can be used to reduce nuclear data-induced uncertainty in Pu-239(n,f) and (2) the effective delayed neutron fraction can be used to effectively reduce nuclear data-induced uncertainty in Pu-239 total fission $\tilde{v}$. Sensitivity/uncertainty analysis can be used to determine optimal experiment/detector setup to identify compensating errors in nuclear data. Upcoming work includes investigating other nuclide-reaction pairs and response sensitivities, such as Δ$\rho$, neutron leakage spectra, and reaction rate measurements to constrain nuclear data of interest.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Characterization of Tactical Departure Scheduling in the National Airspace System

This paper discusses and analyzes current day utilization and performance of the tactical departure scheduling process in the National Airspace System (NAS) to understand the benefits in improving this process. The analysis used operational air traffic data from over 1,082,000 flights during the month of January, 2011. Specific metrics included the frequency of tactical departure scheduling, site specific variances in the technology's utilization, departure time prediction compliance used in the tactical scheduling process and the performance with which the current system can predict the airborne slot that aircraft are being scheduled into from the airport surface. Operational data analysis described in this paper indicates significant room for improvement exists in the current system primarily in the area of reduced departure time prediction uncertainty. Results indicate that a significant number of tactically scheduled aircraft did not meet their scheduled departure slot due to departure time uncertainty. In addition to missed slots, the operational data analysis identified increased controller workload associated with tactical departures which were subject to traffic management manual re-scheduling or controller swaps. An analysis of achievable levels of departure time prediction accuracy as obtained by a new integrated surface and tactical scheduling tool is provided to assess the benefit it may provide as a solution to the identified shortfalls. A list of NAS facilities which are likely to receive the greatest benefit from the integrated surface and tactical scheduling technology are provided.

Capps, Alan↗

Mars Microprobe Entry Analysis

The Mars Microprobe mission will provide the first opportunity for subsurface measurements, including water detection, near the south pole of Mars. In this paper, performance of the Microprobe aeroshell design is evaluated through development of a six-degree-of-freedom (6-DOF) aerodynamic database and flight dynamics simulation. Numerous mission uncertainties are quantified and a Monte-Carlo analysis is performed to statistically assess mission performance. Results from this 6-DOF Monte-Carlo simulation demonstrate that, in a majority of the cases (approximately 2-sigma), the penetrator impact conditions are within current design tolerances. Several trajectories are identified in which the current set of impact requirements are not satisfied. From these cases, critical design parameters are highlighted and additional system requirements are suggested. In particular, a relatively large angle-of-attack range near peak heating is identified.

Braun, Robert D.↗

Assessment and Verification of SLS Block 1-B Exploration Upper Stage State and Stage Disposal Performance

One of the SLS Navigation System's key performance requirements is a constraint on the payload system's delta-v allocation to correct for insertion errors due to vehicle state uncertainty at payload separation. The SLS navigation team has developed a Delta-Delta-V analysis approach to assess the effect on trajectory correction maneuver (TCM) design needed to correct for navigation errors. This approach differs from traditional covariance analysis based methods and makes no assumptions with regard to the propagation of the state dynamics. This allows for consideration of non-linearity in the propagation of state uncertainties. The Delta-Delta-V analysis approach re-optimizes perturbed SLS mission trajectories by varying key mission states in accordance with an assumed state error. The state error is developed from detailed vehicle 6-DOF Monte Carlo analysis or generated using covariance analysis. These perturbed trajectories are compared to a nominal trajectory to determine necessary TCM design. To implement this analysis approach, a tool set was developed which combines the functionality of a 3-DOF trajectory optimization tool, Copernicus, and a detailed 6-DOF vehicle simulation tool, Marshall Aerospace Vehicle Representation in C (MAVERIC). In addition to delta-v allocation constraints on SLS navigation performance, SLS mission requirement dictate successful upper stage disposal. Due to engine and propellant constraints, the SLS Exploration Upper Stage (EUS) must dispose into heliocentric space by means of a lunar fly-by maneuver. As with payload delta-v allocation, upper stage disposal maneuvers must place the EUS on a trajectory that maximizes the probability of achieving a heliocentric orbit post Lunar fly-by considering all sources of vehicle state uncertainty prior to the maneuver. To ensure disposal, the SLS navigation team has developed an analysis approach to derive optimal disposal guidance targets. This approach maximizes the state error covariance prior to the maneuver to develop and re-optimize a nominal disposal maneuver (DM) target that, if achieved, would maximize the potential for successful upper stage disposal. For EUS disposal analysis, a set of two tools was developed. The first considers only the nominal pre-disposal maneuver state, vehicle constraints, and an a priori estimate of the state error covariance. In the analysis, the optimal nominal disposal target is determined. This is performed by re-formulating the trajectory optimization to consider constraints on the eigenvectors of the error ellipse applied to the nominal trajectory. A bisection search methodology is implemented in the tool to refine these dispersions resulting in the maximum dispersion feasible for successful disposal via lunar fly-by. Success is defined based on the probability that the vehicle will not impact the lunar surface and will achieve a characteristic energy (C3) relative to the Earth such that it is no longer in the Earth-Moon system. The second tool propagates post-disposal maneuver states to determine the success of disposal for provided trajectory achieved states. This is performed using the optimized nominal target within the 6-DOF vehicle simulation. This paper will discuss the application of the Delta-Delta-V analysis approach for performance evaluation as well as trajectory re-optimization so as to demonstrate the system's capability in meeting performance constraints. Additionally, further discussion of the implementation of assessing disposal analysis will be provided.

Patrick, Sean↗

Efficient Mass Estimate at the Core of Strong Lensing Galaxy Clusters Using the Einstein Radius

In the era of large surveys, yielding thousands of galaxy clusters, efficient mass proxies at all scales are necessary in order to fully utilize clusters as cosmological probes. At the cores of strong lensing clusters, the Einstein radius can be turned into a mass estimate. This efficient method has been routinely used in literature, in lieu of detailed mass models; however, its scatter, assumed to be similar to 30%, has not yet been quantified. Here, we assess this method by testing it against ray-traced images of cluster-scale halos from the Outer RimN-body cosmological simulation. We measure a scatter of 13.9% and a positive bias of 8.8% in M (<θ E ), with no systematic correlation with total cluster mass, concentration, or lens or source redshifts. We find that increased deviation from spherical symmetry increases the scatter; conversely, where the lens produces arcs that cover a large fraction of its Einstein circle, both the scatter and the bias decrease. While spectroscopic redshifts of the lensed sources are critical for accurate magnifications and time delays, we show that for the purpose of estimating the total enclosed mass, the scatter introduced by source redshift uncertainty is negligible compared to other sources of error. Finally, we derive and apply an empirical correction that eliminates the bias, and reduces the scatter to 10.1% without introducing new correlations with mass, redshifts, or concentration. Our analysis provides the first quantitative assessment of the uncertainties in M (<θ E ), and enables its effective use as a core mass estimator of strong lensing galaxy clusters.

79 ASTRONOMY AND ASTROPHYSICS↗

Self-Aware Vehicles: Mission and Performance Adaptation to System Health

Advances in sensing (miniaturization, distributed sensor networks) combined with improvements in computational power leading to significant gains in perception, real-time decision making/reasoning and dynamic planning under uncertainty as well as big data predictive analysis have set the stage for realization of autonomous system capability. These advances open the design and operating space for self-aware vehicles that are able to assess their own capabilities and adjust their behavior to either complete the assigned mission or to modify the mission to reflect their current capabilities. This paper discusses the self-aware vehicle concept and associated technologies necessary for full exploitation of the concept. A self-aware aircraft, spacecraft or system is one that is aware of its internal state, has situational awareness of its environment, can assess its capabilities currently and project them into the future, understands its mission objectives, and can make decisions under uncertainty regarding its ability to achieve its mission objectives.

Gregory, Irene M.↗