Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “process uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

A Kalman-Filter-Based Approach to Combining Independent Earth-Orientation Series

An approach. based upon the use of a Kalman filter. that is currently employed at the Jet Propulsion Laboratory (JPL) for combining independent measurements of the Earth's orientation, is presented. Since changes in the Earth's orientation can be described is a randomly excited stochastic process, the uncertainty in our knowledge of the Earth's orientation grows rapidly in the absence of measurements. The Kalman-filter methodology allows for an objective accounting of this uncertainty growth, thereby facilitating the intercomparison of measurements taken at different epochs (not necessarily uniformly spaced in time) and with different precision. As an example of this approach to combining Earth-orientation series, a description is given of a combination, SPACE95, that has been generated recently at JPL.

Gross, Richard S.↗

A Review of Hypersonics Aerodynamics, Aerothermodynamics and Plasmadynamics Activities within NASA's Fundamental Aeronautics Program

The research program of the aerodynamics, aerothermodynamics and plasmadynamics discipline of NASA's Hypersonic Project is reviewed. Details are provided for each of its three components: 1) development of physics-based models of non-equilibrium chemistry, surface catalytic effects, turbulence, transition and radiation; 2) development of advanced simulation tools to enable increased spatial and time accuracy, increased geometrical complexity, grid adaptation, increased physical-processes complexity, uncertainty quantification and error control; and 3) establishment of experimental databases from ground and flight experiments to develop better understanding of high-speed flows and to provide data to validate and guide the development of simulation tools.

Salas, Manuel D.↗

Loop Shaping Control Design for a Supersonic Propulsion System Model Using Quantitative Feedback Theory (QFT) Specifications and Bounds

This paper covers the propulsion system component modeling and controls development of an integrated mixed compression inlet and turbojet engine that will be used for an overall vehicle Aero-Propulso-Servo-Elastic (APSE) model. Using previously created nonlinear component-level propulsion system models, a linear integrated propulsion system model and loop shaping control design have been developed. The design includes both inlet normal shock position control and jet engine rotor speed control for a potential supersonic commercial transport. A preliminary investigation of the impacts of the aero-elastic effects on the incoming flow field to the propulsion system are discussed, however, the focus here is on developing a methodology for the propulsion controls design that prevents unstart in the inlet and minimizes the thrust oscillation experienced by the vehicle. Quantitative Feedback Theory (QFT) specifications and bounds, and aspects of classical loop shaping are used in the control design process. Model uncertainty is incorporated in the design to address possible error in the system identification mapping of the nonlinear component models into the integrated linear model.

Connolly, Joseph W.↗

Recommended Practices in Thrust Measurements

Accurate, direct measurement of thrust or impulse is one of the most critical elements of electric thruster characterization, and one of the most difficult measurements to make. The American Institute of Aeronautics and Astronautics has started an initiative to develop standards for many important measurement processes in electric propulsion, including thrust measurements. This paper summarizes recommended practices for the design, calibration, and operation of pendulum thrust stands, which are widely recognized as the best approach for measuring micro N- to mN-level thrust and micro Ns-level impulse bits. The fundamentals of pendulum thrust stand operation are reviewed, along with its implementation in hanging pendulum, inverted pendulum, and torsional balance configurations. Methods of calibration and recommendations for calibration processes are presented. Sources of error are identified and methods for data processing and uncertainty analysis are discussed. This review is intended to be the first step toward a recommended practices document to help the community produce high quality thrust measurements.

microthrusters↗

Quantification of the Uncertainties for the Space Launch System Liftoff/Transition and Ascent Databases

A detailed description of the uncertainty quantification process for the Space Launch System Block 1 vehicle configuration liftoff/transition and ascent 6-Degree-of-Freedom (DOF) aerodynamic databases is presented. These databases were constructed from wind tunnel test data acquired in the NASA Langley Research Center 14- by 22-Foot Subsonic Wind Tunnel and the Boeing Polysonic Wind Tunnel in St. Louis, MO, respectively. The major sources of error for these databases were experimental error and database modeling errors.

Favaregh, Amber L.↗

Seasonal Dependence of SMAP Radiometer-Based Soil Moisture Performance as Observed over Core Validation Sites

The NASA SMAP (Soil Moisture Active Passive) mission provides a global coverage of soil moisture measurements based on its L-band microwave radiometer every 2-3 days at about 40 km resolution. The soil moisture retrieval algorithms model the brightness temperature as a function of soil moisture, surface conditions and vegetation. External data sources inform the algorithms about the surface conditions and vegetation, which enable the retrieval of soil moisture. The inversion process contains uncertainties related to radiometer measurements, forward model assumptions and ancillary data sources. This study focuses on the uncertainties that depend on the seasonal evolution of the surface conditions and vegetation. This study compares the SMAP and core validation site (CVS) soil moisture values over a period of three years to extract the evolution of performance metrics over time. The analysis showed that most CVS that include managed agriculture exhibit significant time-dependent seasonal bias. This bias was linked to seasonal temperature cycle, which is a proxy to several features that can cause seasonally dependent errors in the SMAP product.

core validation site↗

Demonstration of Deployment Accuracy of the Starshade Inner Disk Subsystem

We present experimental results that demonstrate the required in-plane deployment accuracy of the starshade Inner Disk Subsystem (IDS). This effort was to address Milestone 7C of the Starshade Technology Activity S5, which requires that the in-plane deployment accuracy of the petal interfaces on the IDS be within +/-300um. A full-scale 10m-diameter IDS prototype was constructed. This prototype comprised a medium-fidelity perimeter truss, medium-fidelity spokes, and a low-fidelity optical shield (OS). The testbed also included gravity compensation systems and a laser tracker metrology system. The post-processed measurement uncertainties of the laser tracker were less than 30um at the 3 sigma level. Design, engineering and fabrication of these components was done by JPL, Tendeg, and Roccor. Testing was performed at the Tendeg facility in Louisville, Colorado. The IDS prototype was deployed 22 times and the locations of petal interfaces on the IDS were measured after each deployment. Based on this data, tolerance intervals were calculated that would contain 99.73% of future deployment accuracy errors with 90% confidence. These tolerance intervals are conservative estimates for 3 sigma bounds. The tolerance intervals for the three pertinent error components were found to be within the required allocations, with at least 19% margin.

Turse, Dana↗

Gaussian Process for Flight Delay Prediction: Learning a Stochastic Process

This paper presents a machine-learning approach to predict flight delays. Whereas neural networks are extensively studied for predictive capabilities, they involve non-intuitive design and extensive analysis, particularly in training and optimization processes. Instead, the proposed framework employs Gaussian Processes as a supervised learning technique for flight delay prediction. This data-driven approach trains the model using prior information, specifically the mean and covariance tied to existing data. The proposed Gaussian Process Regression (GPR) model employs the day of flight as a pivotal feature for delay forecasting. We analyze flights from various routes and gauge the accuracy of the presented learning technique by comparing the predicted delays with the actual ones. Given the inherent challenges in precisely forecasting delays, we predict the delays with a 95 % confidence interval. Also, an error propagation analysis in the prediction horizon is carried out to determine the optimal time frame for prediction. The proposed method for flight delay prediction is important as airlines can strategize flight operations and issue timely advisories.

stochastic↗

NRAP-Open-IAM: Open-Source Integrated Assessment Model

NRAP Open IAM is the latest evolution in a series of quantitative models developed under the U.S. Department of Energy’s National Risk Assessment Partnership (NRAP) to address risk assessment, risk management and containment assurance questions of geological carbon storage (GCS). NRAP Open IAM allows a user to define a site specific GCS scenario, characterize important site features, events, and processes (considering uncertainty), couple together reduced order models of various system components to rapidly forecast response to CO 2 injection, and perform stochastic analysis to quantify containment effectiveness, leakage risk, and impact to receptors of concern.

Vasylkivska, Veronika S.↗

Measuring the Muon Neutrino Magnetic Moment in the NOvA Near Detector

Measuring an enhanced neutrino magnetic moment would be a clear indication of physics beyond the Standard Model, shedding light on the correct beyond Standard Model theory or the potential Majorana nature of neutrinos. It would manifest in the NOvA near detector as an excess of neutrino-on-electron elastic scattering interactions at low electron recoil energies. Leveraging an intense and highly pure muon neutrino beam, along with a finely segmented liquid scintillator detector technology specifically designed for electromagnetic shower separation, enables NOvA to achieve a potentially world-leading sensitivity in probing the effective muon neutrino magnetic moment. This analysis, based on neutrino data collected between 2014 and 2021, corresponding to an exposure of $13.8\times10^{20}$ protons-on-target, yields a result consistent with the Standard Model-only hypothesis with a p-value of 0.31. An upper limit on the effective muon neutrino magnetic moment is set at $\mu_{\nu_\mu}<19.1\times 10^{-10}\mu_B$ at $90\%$ confidence level. Despite facing statistical limitations stemming from low cross section of the signal process, systematic uncertainties have a significant impact on this result. To address these challenges, the NOvA Test Beam experiment focuses on mitigating some of the largest systematic uncertainties within NOvA by investigating particle interactions and energy deposition in a small-scale replica NOvA detector. This thesis describes the calibration of the NOvA Test Beam detector, which is a crucial step in analysing the Test Beam data before they can be utilised to reduce NOvA systematic uncertainties.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Simulating Atmospheric Processes in Earth System Models and Quantifying Uncertainties With Deep Learning Multi‐Member and Stochastic Parameterizations

Abstract Deep learning is a powerful tool to represent subgrid processes in climate models, but many application cases have so far used idealized settings and deterministic approaches. Here, we develop stochastic parameterizations with calibrated uncertainty quantification to learn subgrid convective and turbulent processes and surface radiative fluxes of a superparameterization embedded in an Earth System Model (ESM). We explore three methods to construct stochastic parameterizations: (a) a single Deep Neural Network (DNN) with Monte Carlo Dropout; (b) a multi‐member parameterization; and (c) a Variational Encoder Decoder with latent space perturbation. We show that the multi‐member parameterization improves the representation of convective processes, especially in the planetary boundary layer, compared to individual DNNs. The respective uncertainty quantification illustrates that methods (b) and (c) are advantageous compared to a dropout‐based DNN parameterization regarding the spread of convective processes. Hybrid simulations with our best‐performing multi‐member parameterizations remained challenging and crash within the first days. Therefore, we develop a pragmatic partial coupling strategy relying on the superparameterization for condensate emulation. Partial coupling reduces the computational efficiency of hybrid Earth‐like simulations but enables model stability over 5 months with our multi‐member parameterizations. However, our hybrid simulations exhibit biases in thermodynamic fields and differences in precipitation patterns. Despite this, the multi‐member parameterizations enable improvements in reproducing tropical extreme precipitation compared to a traditional convection parameterization. Despite these challenges, our results indicate the potential of a new generation of multi‐member machine learning parameterizations leveraging uncertainty quantification to improve the representation of stochasticity of subgrid effects.

Behrens, Gunnar [Deutsches Zentrum für Luft‐ und R↗

Land Processes Can Substantially Impact the Mean Climate State

Terrestrial processes influence the atmosphere by controlling land-to-atmosphere fluxes of energy, water, and carbon. Prior research has demonstrated that parameter uncertainty drives uncertainty in land surface fluxes. However, the influence of land process uncertainty on the climate system remains underexplored. Here, we quantify how assumptions about land processes impact climate using a perturbed parameter ensemble for 18 land parameters in the Community Earth System Model version 2 under preindustrial conditions. We find that an observationally-informed range of land parameters generate biogeophysical feedbacks that significantly influence the mean climate state, largely by modifying evapotranspiration. Global mean land surface temperature ranges by 2.2°C across our ensemble (σ = 0.5°C) and precipitation changes were significant and spatially variable. Our analysis demonstrates that the impacts of land parameter uncertainty on surface fluxes propagate to the entire Earth system, and provides insights into where and how land process uncertainty influences climate.

54 ENVIRONMENTAL SCIENCES↗

Reducing the aerosol forcing uncertainty using observational constraints on warm rain processes

Global climate models (GCMs) disagree with other lines of evidence on the rapid adjustments of cloud cover and liquid water path to anthropogenic aerosols. Attempts to use observations to constrain the parameterizations of cloud processes in GCMs have failed to reduce the disagreement. We propose using observations sensitive to the relevant cloud processes rather than only to the atmospheric state and focusing on process realism in the absence of aerosol perturbations in addition to the process susceptibility to aerosols. We show that process-sensitive observations of precipitation can reduce the uncertainty on GCM estimates of rapid cloud adjustments to aerosols. The feasibility of an observational constraint depends on understanding the precipitation intensity spectrum in both observations and models and also on improving methods to compare the two.

54 ENVIRONMENTAL SCIENCES↗

Solar data uncertainty impacts on MCMC methods for r-process nucleosynthesis

In recent work, we developed a Markov Chain Monte Carlo (MCMC) procedure to predict the ground state masses capable of forming the observed Solar r-process rare-earth abundance peak. By applying this method to nucleosynthesis calculations which make use of distinct astrophysical conditions and comparing our results to the latest precision mass measurements, we are able to shed light on the conditions/masses capable of producing a rare-earth peak which matches Solar data. Here we examine how our mass predictions change when using a few different sets of r-process Solar abundance residuals that have been reported in the literature. We explore how the differing error estimates of these Solar evaluations propagate through the Markov Chain Monte Carlo to our mass predictions. We find that Solar data which reports the rare-earth peak to have its highest abundance at mass number A = 162 can require distinctly different mass predictions from data with the peak centered at A = 164. Nevertheless, we find that two important general conclusions from past work, regarding the inconsistency of ‘cold’ astrophysical outflows with current mass measurements and the need for local stability at N = 104 in ‘hot’ scenarios, remain robust in the face of differing Solar data evaluations. Additionally, we show that the masses our procedure finds capable of producing a peak at A < 164 are not in line with the latest precision mass measurements.

79 ASTRONOMY AND ASTROPHYSICS↗

Multi-Source Machine Learning and Thermoplastics Enhanced Aerostructure Manufacturing (mTEAM)

RTX Technology Research Center (RTRC), together with Collins Aerospace (Collins) and Oak Ridge National Laboratory (ORNL) has developed an Artificial Intelligence (AI) / Machine Learning (ML) guided solution to advance the manufacturing and assembly of high performance and lightweight thermoplastic composite (TPC) aerospace products. The solution aims to lower risk, cost and lead time for induction heating based welding and consolidation processes for TPC structure. The cost and lead time of part and material specific process development for induction welding (IW) and induction consolidation will be reduced by replacing traditional empirical methods with optimization methods that merge AI/ML and physics-based process simulations and process experiments with sensing and controls. TPC-IW process development is empirical in nature, and uncertainties in material & process behavior exist near & far from the induction coil. Physics-based simulations can be leveraged directly for process optimization but can be too computationally expensive to run in high fidelity and real time to do robust process optimization. The key impact of successful TPC induction consolidation and welding is cost & lead time reduction for part & material specific consolidation and welding recipes. This is an enabler for more rapid deployment of TPC structures via joining assembly, which can reduce energy & cost intensive usage of autoclaves & ovens. The solution aimed to advance the U.S. Department of Energy’s interests in using thermoplastics and automation in composite manufacturing for improvement of products for existing markets via increased production speeds, reduced costs, and lowered use of energy. Welded TPC structures can offer significant weight & energy savings for high-value commercial aerospace & industrial applications compared to metal & thermoset composite structures assembled by mechanical fastening and/or adhesive bonding. The project was organized into two Budget Periods. Budget Period 1 (BP1) was 15 months and its goal was to perform ML process optimization framework development & deployment on lab-coupon aerostructure components. A Go/No-Go Review was performed at the end of BP1 to verify fulfilment of key tasks & milestones to justify a Go Decision to move into the next Budget Period. Budget Period 2 (BP2) was 12 months and its goal was the deployment of the ML framework for ML process optimization of pilot industrial scale aerostructure components. The overall project aim was to develop & demonstrate ML-enhanced modeling framework that learns process-property mapping from multiple data sources at different fidelities. During BP1, the team accomplished key tasks & milestones to demonstrate the concept of multi-source ML for TPC aerostructure consolidation and assembly. First, the team completed documentation of induction based TPC heating requirements including baseline metrics to compare measured results against. Next the team completed demonstration of data generation from physics-based simulations for ML surrogate model generation and demonstrated the integration of physics-based simulation data into multi-source AI/ML algorithms. In parallel, the team established the lab-coupon scale induction welding system and completed a process to label and reduce generated data from physics-based simulation and experiments for ML surrogate models to enable multi-source ML model training & testing. To complete BP1, the team integrated physics-based simulation data and experimental data into multi-source ML algorithms. This was based on the team completing ML deployment of the induction welding on a lab system at RTRC and AI/ML deployment on existing induction welding line at Collins. ORNL visited both Collins and RTRC sites to witness the TPC induction welding process. Then, ORNL designed and constructed a new version of their vision-based sensing system better adapted to acquire process signals of the TPC induction welding process for process anomaly and defect detection. In BP2, the team accomplished key tasks & milestones to scale up multi-source ML for TPC aerostructure consolidation and assembly from the lab-coupon scale to the pilot-industrial scale. In BP2, the team demonstrated real time anomaly & defect detection via experiments performed by ORNL & RTRC. The team completed ML-optimization heating trials for TPC induction consolidation at Collins, and the team confirmed pilot industrial scale experimental data from Collins was compatible with the developed ML pipeline from RTRC. The team completed sub-element scale ML process optimization demonstration at RTRC, where the team leveraged RTRC’s robotic TPC welding setup to de-risk the ML process optimization by performing ML analysis of recorded temperatures to account for complex part features. Then, the team applied its ML-derived control strategies and ML process optimization framework at Collins to the pilot-industrial scale on a demo skin-stiffener part representative of a nacelle aerostructure fan cowl section. The key innovation is the AI/ML framework enabling effective process development of high performance, lightweight, energy efficient TPCs for composite aircraft structures.

36 MATERIALS SCIENCE↗

Uncertainty quantification for Multiphase-CFD simulations of bubbly flows: a machine learning-based Bayesian approach supported by high-resolution experiments

In this paper, we developed a machine learning-based Bayesian approach to inversely quantify and reduce the uncertainties of multiphase computational fluid dynamics (MCFD) simulations for bubbly flows. The proposed approach is supported by high-resolution two-phase flow measurements, including those by double-sensor conductivity probes, high-speed imaging, and particle image velocimetry. Local distributions of key physical quantities of interest (QoIs), including the void fraction and phasic velocities, are obtained to support the Bayesian inference. In the process, the epistemic uncertainties of the closure relations are inversely quantified while the aleatory uncertainties from stochastic fluctuations of the system are evaluated based on experimental uncertainty analysis. The combined uncertainties are then propagated through the MCFD solver to obtain uncertainties of the QoIs, based on which probability-boxes are constructed for validation. The proposed approach relies on three machine learning methods: feedforward neural networks and principal component analysis for surrogate modeling, and Gaussian processes for model form uncertainty modeling. The whole process is implemented within the framework of an open-source deep learning library PyTorch with graphics processing unit (GPU) acceleration, thus ensuring the efficiency of the computation. The results demonstrate that with the support of high-resolution data, the uncertainties of MCFD simulations can be significantly reduced. The proposed approach has the potential for other applications that involve numerical models with empirical parameters.

42 ENGINEERING↗

Uncertainty Quantification for JPL Retrievals

We define the notions of verification, validation, and uncertainty quantification (VVUQ), and place them in the context of retrievals of Earth science data. Uncertainty quantification (UQ) is the process of characterizing the uncertainty of a measurement system relative to the true, physical quantity it measures. UQ is needed when measurements are used for scientific inference, assimilated into models with other data, and used for decision-making and risk analysis. Many measurements come with measures of standard error and bias, but these uncertainty measures are often inaccurate, due to the operational need to assume crisp values for parameters which are in fact uncertain, as well as the failure of technical assumptions needed by operational error-estimation approaches. UQ provides a way to study which assumptions fail to hold, and a tool to improve the measurement. We describe a particular, broadly-applicable UQ setup that has been successful for JPL retrievals including OCO-2, and provide recommendations for furthering the UQ state of the practice at JPL.

Turmon, Michael↗