Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty propagation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

Application of High-Dimensional Fuzzy K-Means Cluster Analysis to CALIOP/CALIPSO Version 4.1 Cloud-Aerosol Discrimination

This study applies fuzzy k-means (FKM) cluster analyses to a subset of the parameters reported in the CALIPSO lidar level 2 data products in order to classify the layers detected as either clouds or aerosols. The results obtained are used to assess the reliability of the cloud–aerosol discrimination (CAD) scores reported in the version 4.1 release of the CALIPSO data products. FKM is an unsupervised learning algorithm, whereas the CALIPSO operational CAD algorithm (COCA) takes a highly supervised approach. Despite these substantial computational and architectural differences, our statistical analyses show that the FKM classifications agree with the COCA classifications for more than 94 % of the cases in the troposphere. This high degree of similarity is achieved because the lidar-measured signatures of the majority of the clouds and the aerosols are naturally distinct, and hence objective methods can independently and effectively separate the two classes in most cases. Classification differences most often occur in complex scenes (e.g., evaporating water cloud filaments embedded in dense aerosol) or when observing diffuse features that occur only intermittently (e.g., volcanic ash in the tropical tropopause layer). The two methods examined in this study establish overall classification correctness boundaries due to their differing algorithm uncertainties. In addition to comparing the outputs from the two algorithms, analysis of sampling, data training, performance measurements, fuzzy linear discriminants, defuzzification, error propagation, and key parameters in feature type discrimination with the FKM method are further discussed in order to better understand the utility and limits of the application of clustering algorithms to space lidar measurements. In general, we find that both FKM and COCA classification uncertainties are only minimally affected by noise in the CALIPSO measurements, though both algorithms can be challenged by especially complex scenes containing mixtures of discrete layer types. Our analysis results show that attenuated backscatter and color ratio are the driving factors that separate water clouds from aerosols; backscatter intensity, depolarization, and mid-layer altitude are most useful in discriminating between aerosols and ice clouds; and the joint distribution of backscatter intensity and depolarization ratio is critically important for distinguishing ice clouds from water clouds.

Zeng, Shan↗

Genetic-algorithm retrieval of the molecular alignment distribution with high-order harmonics generated from transiently aligned CO 2 molecules

Using genetic algorithm, we propose a method to retrieve the alignment distribution of transiently aligned CO 2 molecules from the high-order harmonic generation (HHG) spectra. The retrieval method is based on the quantitative rescattering (QRS) model where averaged photorecombination transition dipole can be factored out from the parallel (or perpendicular) harmonic spectra after the propagation of the harmonic fields in the gas medium. We examine how the retrieved alignment distributions are affected by uncertainty in alignment dependent ionization probability and on multiple orbital contribution to the HHG. We further confirm that alignment distribution is more accurately retrieved by using the minima in the HHG spectra driven by a long-wavelength laser. In addition, we show that earlier experimental data on the ratios between the perpendicular and the parallel HHG components of aligned CO 2 molecules are in better agreement with the QRS model if the macroscopic propagation and multiple orbital interference are included in the theoretical calculation.

74 ATOMIC AND MOLECULAR PHYSICS↗

Advanced Semi-Supervised Learning with Uncertainty Estimation for Phase Identification in Distribution Systems

The integration of advanced metering infrastructure (AMI) into power distribution networks generates valuable data for tasks such as phase identification; however, the limited and unreliable availability of labeled data in the form of customer phase connectivity presents challenges. To address this issue, we propose a semi-supervised learning (SSL) framework that effectively leverages labeled and unlabeled data. Our approach incorporates self-training, label spreading, and Bayesian neural networks (BNNs) to enhance phase identification with AMI data. Our method uses an ensemble of multilayer perceptron classifiers in a self-training setup, iteratively adding high-confidence pseudo-labels to improve robustness. We also apply label spread to propagate labels based on data similarity, which enhances generalization across diverse distributions. In addition, we employ a BNNs with uncertainty estimation, boosting confidence in predictions and reducing phase identification errors. In our case study, we achieved approximately 98% +/- 0.08 accuracy with uncertainty using minimal and unreliable labeled data from a real U.S. utility, Duquesne Light Company. Our SSL approach, combined with uncertainty estimation, provides an efficient solution for phase identification in AMI data, ultimately improving the reliability of smart grid applications.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Advanced Semi-Supervised Learning With Uncertainty Estimation for Phase Identification in Distribution Systems

The integration of advanced metering infrastructure (AMI) into power distribution networks generates valuable data for tasks such as phase identification; however, the limited and unreliable availability of labeled data in the form of customer phase connectivity presents challenges. To address this issue, we propose a semi-supervised learning (SSL) framework that effectively leverages labeled and unlabeled data. Our approach incorporates self-training, label spreading, and Bayesian neural networks (BNNs) to enhance phase identification with AMI data. Our method uses an ensemble of multilayer perceptron classifiers in a self-training setup, iteratively adding high-confidence pseudo-labels to improve robustness. We also apply label spread to propagate labels based on data similarity, which enhances generalization across diverse distributions. In addition, we employ a BNNs with uncertainty estimation, boosting confidence in predictions and reducing phase identification errors. In our case study, we achieved approximately 98% +/- 0.08 accuracy with uncertainty using minimal and unreliable labeled data from a real U.S. utility, Duquesne Light Company. Our SSL approach, combined with uncertainty estimation, provides an efficient solution for phase identification in AMI data, ultimately improving the reliability of smart grid applications.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Constraining the sources of ultra-high-energy cosmic rays across and above the ankle with the spectrum and composition data measured at the Pierre Auger Observatory

In this work we present the interpretation of the energy spectrum and mass composition data as measured by the Pierre Auger Collaboration above 6 × 10$^{17}$ eV. We use an astrophysical model with two extragalactic source populations to model the hardening of the cosmic-ray flux at around 5 × 10$^{18}$ eV (the so-called “ankle” feature) as a transition between these two components. We find our data to be well reproduced if sources above the ankle emit a mixed composition with a hard spectrum and a low rigidity cutoff. The component below the ankle is required to have a very soft spectrum and a mix of protons and intermediate-mass nuclei. The origin of this intermediate-mass component is not well constrained and it could originate from either Galactic or extragalactic sources.To the aim of evaluating our capability to constrain astrophysical models, we discuss the impact on the fit results of the main experimental systematic uncertainties and of the assumptions about quantities affecting the air shower development as well as the propagation and redshift distribution of injected ultra-high-energy cosmic rays (UHECRs).

79 ASTRONOMY AND ASTROPHYSICS↗

Evaluation of KDP Estimation Algorithm Performance in Rain Using a Known-Truth Framework

Accurate estimation of specific differential phase ( K DP ) is necessary for rain rate estimation, attenuation correction, and hydrometeor classification algorithms. There are numerous published methods to process polarimetric radar observations of propagation differential phase shift (Φ DP ) and estimate K DP , but the corresponding K DP estimate uncertainty is unquantified. This study provides guidance on how commonly used K DP estimation algorithms perform in various environments. Here, we create numerous synthetic (“true”) K DP profiles, integrate over them to obtain “smoothed” Φ DP , and then add noise typical of S-band operational weather radar measurements. Each algorithm is applied to our noisy Φ DP profiles and compared to the true K DP profile such that the errors and uncertainty are quantified. The synthetic K DP profiles are Gaussian in shape, which allows systematic variations in their magnitude and width to determine how each algorithm performs in smooth, slowly changing K DP profiles, as well as steep profiles. Results demonstrate that algorithm performance is dependent on the Φ DP field received. These results are further supported by an error analysis of each algorithm for two more complicated synthetic K DP profiles. Some K DP algorithms allow users to change various tuning parameters; a subset of these tuning parameters is tested to provide guidance on how changing these parameters impacts algorithm performance. We then provide evidence that our known-truth framework provides insight into algorithm performance in observed data through two case studies.

54 ENVIRONMENTAL SCIENCES↗

Improving SGP4 Orbit Determination with New State Estimation Algorithm

The Simplified General Perturbations 4 Model (SGP4) is a well-known tool for performing satellite orbit determination. However, uncertainties and inaccuracies in the initial state inputs (required by SGP4) degrade the performance of the propagator. We present a new state estimation algorithm that allows for independent computation of these initial inputs using Unscented Kalman Filtering and GPS data from a satellite. The algorithm is tested on real flight data and demonstrates a notable performance improvement over the standard method of orbit determination using SGP4.

97 MATHEMATICS AND COMPUTING↗

Navigation for the ACS3 Solar Sail Mission

NASA’s Advanced Composite Solar Sail System (ACS3) mission consists of a spacecraft that plans to be launched in early 2024. The spacecraft carries an 80 m2 solar sail that can produce effective thrust to alter the initial 1000 km sun-synchronous orbit. The main objective of the mission is to demonstrate the capabilities of the solar sail to effectively change various orbital parameters such as the semi-major axis and the inclination. Various composite materials were used to produce the sail, together with lightweight booms that will deploy from a 12U CubeSat bus. The astrodynamics team at NASA Ames Research Center has built a Flight Dynamics System (FDS) to provide mission navigation and to produce regular ephemeris once in orbit. The FDS can compute the trajectories that the spacecraft will perform once the sail is deployed. To achieve that, GPS data is obtained from the spacecraft telemetry and then is used with a Kalman filter and a smoother to obtain an orbit determination solution. The outcome of this process reduces the position and velocity uncertainty in a daily cadence. After that, the state vector output is used to feed a propagation model that includes the updated attitude and orbit of the spacecraft at that given moment. The trajectory model considers the updated attitude plan of the spacecraft as well as the environment conditions such as the solar weather to compute the associated drag and solar radiation pressure. This paper explains in detail the implementation of the FDS, as well as the solar sail solar radiation pressure trajectory model. We also present the results of several potential trajectory models under various assumptions of orbit parameters, attitude, environment, and material properties. In addition, we introduce a trajectory model for potential interplanetary use of an equivalent solar sail in the future. The outcome of this process will be critical to achieving the objective of determining effective altitude change produced by the solar sail.

Andres Dono Perez↗

Navigation for the ACS3 Solar Sail Mission

NASA’s Advanced Composite Solar Sail System (ACS3) mission consists of a spacecraft that plans to be launched no earlier than April 2024. The spacecraft carries an 81 m2 solar sail that can produce effective ΔV to alter the initial 1000 km sun-synchronous orbit. The main objective of the mission is to demonstrate the capabilities of the solar sail to effectively change the semi-major axis of its initial orbit. Various composite materials were used to produce the sail, together with lightweight booms that will deploy from a 12U CubeSat bus. The ACS3 navigation team at NASA Ames Research Center has built a Flight Dynamics System (FDS) to provide mission navigation and to produce regular ephemeris once in orbit. The FDS can compute the orbit transfers that the spacecraft will perform once the sail is deployed. To achieve that, GPS data is obtained from the spacecraft telemetry and then is used with a Kalman filter and a smoother to obtain an orbit determination solution. The outcome of this process reduces the position and velocity uncertainty in a daily cadence. After that, the state vector output is used to feed a propagation model that includes the updated attitude and orbit of the spacecraft at that given moment. The trajectory model considers the updated attitude plan of the spacecraft as well as the environment conditions such as the solar weather to compute the associated drag and solar radiation pressure. This paper explains in detail the implementation of the FDS, as well as the solar sail solar radiation pressure trajectory model. We also present the results of several potential trajectory models under various assumptions of orbit parameters, attitude, environment, and material properties. In addition, we introduce a trajectory model for potential interplanetary use of an equivalent solar sail in the future. The outcome of this process will be critical to achieving the objective of determining effective semi-major axis change produced by the solar sail.

Andres Dono↗

Exploring the Use of a Ground-Based Laser System to Deorbit Small Orbital Debris

In March 2023, NASA Office of Technology, Policy, and Strategy (OTPS) released its Cost and Benefit Analysis of Orbital Debris Remediation report. This analysis found that the two most efficient methods for remediating orbital debris were the removal of small (1-10 cm) debris and nudging large debris away from predicted collisions; both methods could be performed by high-energy laser systems. To further explore the concept, OTPS has been assessing a reference mission using ground-based, pulsed lasers to detect, engage, and rapidly deorbit 1- to 10-cm debris that would otherwise threaten the safety of the International Space Station and future crewed platforms in low Earth orbit. In March of 2024, OTPS convened a technical interchange meeting (TIM) of experts in detection and tracking of debris, high-energy glass and excimer lasers, laser-matter interactions, atmospheric propagation, and adaptive optics. The TIM spanned two days, covering the unclassified state of the art, uncertainties, and technical challenges for the entire concept of operations of the reference mission. In this presentation, we will summarize the reference mission analyzed, key findings from the TIM, and solicit the feedback from this community to further define “what is good enough” for debris remediation.

orbital debris↗

Efficient Parametric Uncertainty Analysis of an Earth Entry Vehicle Concept Using Least Angle Regression

The objective of this work was to outline and apply an efficient and accurate parametric un-certainty propagation approach to the analysis of convective heating on an Earth entry vehicle concept. The described approach was based on Least Angle Regression used to solve a sparse and underdetermined linear system in the point-collocation non-intrusive polynomial chaos surrogate method. This approach involved an iterative process to computing the non-zero terms of the underlying polynomial chaos model using only enough samples to converge uncertainty interval predictions and Sobol index values based global nonlinear sensitivity estimates. The Earth entry vehicle was analyzed at three points along a representative trajectory for a Mars return mission. 329 sources of uncertainty were identified in the computational fluid dynamics model used to predict the forebody convective heating. These included uncertainty in flow field chemical rates, collision integrals, heats of formation, surface finite rate char model reaction rates, wall roughness height, and the turbulent Schmidt number. Results from this study showed that convective heating uncertainty as high as 50% of the nominal was predicted with only about 50 evaluations of the computational model. This was far fewer than would be required for a sampling-based approach or a full basis polynomial chaos model, which would have required over 50,000 samples. Additionally, results showed that over 90% of the total convective heating uncertainty was due to uncertainty in the N2catalytic rate on the surface, while the remainder of the uncertainty was attributed to the turbulent Schmidt number and the wall roughness uncertainties.

Thomas K West IV↗

Direct cross section measurement of 102 Pd ⁢(𝛾,𝑝) and 102 Pd ⁢(𝛾,𝛼) for the astrophysical 𝑝 process

Background: A handful of neutron-deficient stable nuclei, known as the “p nuclei,” cannot be produced through astrophysical neutron capture processes. Instead, some of these nuclei are proposed to be produced by 𝛾-induced reactions on existing r- and s-process seeds. The specific astrophysical site or sites are not yet identified, however, with uncertainties in the cross sections of these 𝛾-induced reactions playing a role. Databases of reaction rates for astrophysical simulations often rely on theoretical statistical model calculations, such as Hauser-Feshbach, for rates where no experimental information is known. However, reasonable variations in the choice of parametrizations of various nuclear properties can create order-of-magnitude variations in the final predicted cross sections and reaction rates, which are then propagated through the models to the predicted final abundances. Purpose: To better constrain these statistical model calculations and ultimately reduce the uncertainties from the nuclear physics on our understanding of the p nuclei, a measurement of the cross sections of 𝛾-induced reactions on the p-nucleus 102 Pd was undertaken. This work represents the first measurement of its kind, using segmented silicon detectors to measure prompt charged particle emission from 𝛾-induced reactions. Methods: Quasimonoenergetic gamma beams from the High Intensity 𝛾 Source facility bombarded an enriched 102 Pd target. A segmented silicon array was arranged to detect the particles emitted from (𝛾,𝑝) and (𝛾,𝛼) reactions. Results: Reaction cross sections were deduced at multiple 𝛾-beam energies between 10 and 19 MeV, and compared to statistical model calculations using talys-1.96. The 102 Pd ⁢(𝛾,𝑝)⁢ 101 Rh reaction cross section was reasonably well reproduced by a subset of photon strength functions and level densities, though the strength to the ground state of 101 Rh was underestimated at higher incident gamma energies. The 102 Pd ⁢(𝛾,𝛼)⁢ 98 Ru was in general overpredicted by the various alpha-nucleus optical model potentials. Conclusions: While the theoretical cross sections used to model the (𝛾,𝑝) reactions for the p process may be reasonable, a more careful approach is needed in the case of (𝛾,𝛼). Further work to probe gamma-induced reaction cross sections at and near the p nuclei is warranted.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Uncertainty-based weighted least squares density integration for background-oriented schlieren

We propose an improved density integration methodology for Background-Oriented Schlieren (BOS) measurements that overcomes the noise sensitivity of the commonly used Poisson solver. Here, the method employs a weighted least-squares (WLS) optimization of the 2D integration of the density gradient field by solving an over-determined system of equations. Weights are assigned to the grid points based on density gradient uncertainties to ensure that a less reliable measurement point has less effect on the integration procedure. Synthetic image analysis with a Gaussian density field shows that WLS constrains the propagation of random error and reduces it by 80% in comparison to Poisson for the highest noise level. Using WLS with experimental BOS measurements of flow induced by a spark plasma discharge shows a 30% reduction in density uncertainty in comparison to Poisson, thereby increasing the overall precision of the BOS density measurements.

42 ENGINEERING↗

Deeply uncertain: comparing methods of uncertainty quantification in deep learning algorithms

We present a comparison of methods for uncertainty quantification (UQ) in deep learning algorithms in the context of a simple physical system. Three of the most common uncertainty quantification methods - Bayesian Neural Networks (BNN), Concrete Dropout (CD), and Deep Ensembles (DE) - are compared to the standard analytic error propagation. We discuss this comparison in terms endemic to both machine learning ("epistemic" and "aleatoric") and the physical sciences ("statistical" and "systematic"). The comparisons are presented in terms of simulated experimental measurements of a single pendulum - a prototypical physical system for studying measurement and analysis techniques. Our results highlight some pitfalls that may occur when using these UQ methods. For example, when the variation of noise in the training set is small, all methods predicted the same relative uncertainty independently of the inputs. This issue is particularly hard to avoid in BNN. On the other hand, when the test set contains samples far from the training distribution, we found that no methods sufficiently increased the uncertainties associated to their predictions. This problem was particularly clear for CD. In light of these results, we make some recommendations for usage and interpretation of UQ methods.

59 BASIC BIOLOGICAL SCIENCES↗

Towards real-time monitoring: data assimilated time-lapse full waveform inversion for seismic velocity and uncertainty estimation

SUMMARY Rapid development of time-lapse seismic monitoring instrumentations has made it possible to collect dense time-lapse data for tomographically retrieving time-lapse (even continuous) images of subsurface changes. While traditional time-lapse full waveform inversion (TLFWI) algorithms are designed for sparse time-lapse surveys, they lack of effective temporal constraint on time-lapse data, and, more importantly, lack of the uncertainty estimation of the TLFWI results that is critical for further interpretation. Here, we propose a new data assimilation TLFWI method, using hierarchical matrix powered extended Kalman filter (HiEKF) to quantify the image uncertainty. Compared to existing Kalman filter algorithms, HiEKF allows to store and update a data-sparse representation of the cross-covariance matrices and propagate model errors without expensive operations involving covariance matrices. Hence, HiEKF is computationally efficient and applicable to 3-D TLFWI problems. Then, we reformulate TLFWI in the framework of HiEKF (termed hereafter as TLFWI-HiEKF) to predict time-lapse images of subsurface spatiotemporal velocity changes and simultaneously quantify the uncertainty of the inverted velocity changes over time. We demonstrate the validity and applicability of TLFWI–HiEKF with two realistic CO2 monitoring models derived from Frio-II and Cranfield CO2 injection sites, respectively. In both 2-D and 3-D examples, the inverted high-resolution time-lapse velocity results clearly reveal a continuous velocity reduction due to the injection of CO2. Moreover, the accuracy of the model is increasing over time by assimilating more time-lapse data while the standard deviation is decreasing over lapsed time. We expect TLFWI-HiEKF to be equipped with real-time seismic monitoring systems for continuously imaging the distribution of subsurface gas and fluids in the future large-scale CO2 sequestration experiments and reservoir management.

58 GEOSCIENCES↗

Fracture Analysis of Cohesive Zone Models for Modeling Residual Stress Induced Delamination in Composite Structures

A fracture study of coupon-scale composite cylinders with embedded defects was conducted with an objective to assess and validate a modeling approach using two available cohesive material models. The study included experimental and simulation evaluations of initiation of crack growth and progression. Interrupted thermal experiments used acoustic emissions monitoring to identify the onset of crack progression during each cooling interval and ultrasonic scanning provided images of defect growth. Verification, validation, and uncertainty quantification (VVUQ) processes were performed in the assessment of the simulation predicted temperature at which crack propagation begins (quantity of interest). The Sobol sensitivity analysis identified the hoop direction elastic modulus in the carbon fiber reinforced polymer (CFRP) plies as the most influential parameter for simulations using both cohesive models, accounting for at least 70% of the variation in the temperature at crack propagation. The UQ temperature range for the Tvergaard-Hutchinson model was higher (more conservative) than the experimental acoustic measurement indicators of crack progression, while the temperature range for the Thouless-Parmigiani model enveloped the experimental data points for the primary defect size of 0.75 x 1 in. The simulations could not capture the stable crack growth indicated in the experiments. This is likely due to the models’ inability to represent anisotropic fracture toughness attributed to the structure of the orthotropic fiber weave in a woven composite laminate.

42 ENGINEERING↗

Interval Predictor Models with a Formal Characterization of Uncertainty and Reliability

This paper develops techniques for constructing empirical predictor models based on observations. By contrast to standard models, which yield a single predicted output at each value of the model's inputs, Interval Predictors Models (IPM) yield an interval into which the unobserved output is predicted to fall. The IPMs proposed prescribe the output as an interval valued function of the model's inputs, render a formal description of both the uncertainty in the model's parameters and of the spread in the predicted output. Uncertainty is prescribed as a hyper-rectangular set in the space of model's parameters. The propagation of this set through the empirical model yields a range of outputs of minimal spread containing all (or, depending on the formulation, most) of the observations. Optimization-based strategies for calculating IPMs and eliminating the effects of outliers are proposed. Outliers are identified by evaluating the extent by which they degrade the tightness of the prediction. This evaluation can be carried out while the IPM is calculated. When the data satisfies mild stochastic assumptions, and the optimization program used for calculating the IPM is convex (or, when its solution coincides with the solution to an auxiliary convex program), the model's reliability (that is, the probability that a future observation would be within the predicted range of outputs) can be bounded rigorously by a non-asymptotic formula.

Crespo, Luis G.↗

Mesoscale informed parameter estimation through machine learning: A case-study in fracture modeling

Scale bridging is a critical need in computational sciences, where the modeling community has developed accurate physics models from first principles, of processes at lower length and time scales that influence the behavior at the higher scales of interest. However, it is not computationally feasible to incorporate all of the lower length scale physics directly into upscaled models. This is an area where machine learning has shown promise in building emulators of the lower length scale models, which incur a mere fraction of the computational cost of the original higher fidelity models. We demonstrate the use of machine learning using an example in materials science estimating continuum scale parameters by emulating, with uncertainties, complicated mesoscale physics. Additionally, we describe a new framework to emulate the fine scale physics, especially in the presence of microstructures, using machine learning, and showcase its usefulness by providing an example from modeling fracture propagation. Our approach can be thought of as a data-driven dimension reduction technique that yields probabilistic emulators. Our results show well-calibrated predictions for the quantities of interests in a low-strain simulation of fracture propagation at the mesoscale level. Furthermore, on average, we achieve ~10% relative errors on time-varying quantities like total damage and maximum stresses. Successfully replicating mesoscale scale physics within the continuum models is a crucial step towards predictive capability in multi-scale problems.

36 MATERIALS SCIENCE↗