Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,333 records · Page 74
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

A Data-Driven Nonparametric Approach for Probabilistic Load-Margin Assessment Considering Wind Power Penetration

A modern power system is characterized by an increasing penetration of wind power, which results in large uncertainties in its states. These uncertainties must be quantified properly; otherwise, the system security may be threatened. Facing this challenge, here we propose a cost-effective, data-driven approach to assessing a power system's load margin probabilistically. Using actual wind data, a kernel density estimator is applied to infer the nonparametric wind speed distributions, which are further merged into the framework of a vine copula. The latter enables us to simulate complex multivariate and highly dependent model inputs with a variety of bivariate copulae that precisely represent the tail dependence in the correlated samples. Furthermore, to reduce the prohibitive computational time of traditional Monte-Carlo simulations that process a large amount of samples, we propose to use a nonparametric, Gaussian-process-emulator-based reduced-order model to replace the original complicated continuation power-flow model through a Bayesian-learning framework. To accelerate the convergence rate of this Bayesian algorithm, a truncated polynomial chaos surrogate, which serves as a highly efficient, parametric Bayesian prior, is developed. This emulator allows us to execute the time-consuming continuation power-flow solver at the sampled values with a negligible computational cost. Results of simulations that are performed on several test systems reveal the impressive performance of the proposed method in the probabilistic load-margin assessment.

17 WIND ENERGY↗
DOE OSTI2024

Climate-invariant machine learning

Projecting climate change is a generalization problem: We extrapolate the recent past using physical models across past, present, and future climates. Current climate models require representations of processes that occur at scales smaller than model grid size, which have been the main source of model projection uncertainty. Recent machine learning (ML) algorithms hold promise to improve such process representations but tend to extrapolate poorly to climate regimes that they were not trained on. To get the best of the physical and statistical worlds, we propose a framework, termed “climate-invariant” ML, incorporating knowledge of climate processes into ML algorithms, and show that it can maintain high offline accuracy across a wide range of climate conditions and configurations in three distinct atmospheric models. Our results suggest that explicitly incorporating physical knowledge into data-driven models of Earth system processes can improve their consistency, data efficiency, and generalizability across climate regimes.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1986

Flat-plate solar array project. Volume 8: Project analysis and integration

Project Analysis and Integration (PA&I) performed planning and integration activities to support management of the various Flat-Plate Solar Array (FSA) Project R&D activities. Technical and economic goals were established by PA&I for each R&D task within the project to coordinate the thrust toward the National Photovoltaic Program goals. A sophisticated computer modeling capability was developed to assess technical progress toward meeting the economic goals. These models included a manufacturing facility simulation, a photovoltaic power station simulation and a decision aid model incorporating uncertainty. This family of analysis tools was used to track the progress of the technology and to explore the effects of alternative technical paths. Numerous studies conducted by PA&I signaled the achievement of milestones or were the foundation of major FSA project and national program decisions. The most important PA&I activities during the project history are summarized. The PA&I planning function is discussed and how it relates to project direction and important analytical models developed by PA&I for its analytical and assessment activities are reviewed.

Mcguire, P.↗
NASA NTRSDate not supplied

Trajectory Planning for Mission Survivability of Autonomous Vehicles in Moderately to Extremely Uncertain Environments

Trajectory planning is a particularly challenging task for autonomous vehicles when the uncertainties in their operating environment cannot be characterized statistically. In this paper, we propose a receding horizon control strategy with novel trajectory planning policies that enable dynamic updating of the planned trajectories of autonomous vehicles operating in environments where potential conflicts are, from a statistical perspective, either partially known or completely unknown. The proposed policies utilize two metrics: (1) the number of feasible trajectories; and (2) the robustness of the feasible trajectories. We measure the effectiveness of the suggested policies in terms of mission survivability, which is defined as the probability that the primary mission is accomplished or, if that is not possible, the vehicle lands safely at an alternative site. We show that a linear combination of both metrics is an effective objective function when there is a mix of partially known and unknown uncertainties. When the operating environment is dominated by unknown disturbances, maximizing the number of feasible trajectories results in the highest mission survivability. These findings have significant implications for achieving safe aviation. autonomy.

Aviation autonomy↗
NASA NTRSDate not supplied

Trajectory Planning for Mission Survivability of Autonomous Vehicles in Moderately to Extremely Uncertain Environments

Trajectory planning is a particularly challenging task for autonomous vehicles when there are moderate to extreme uncertainties in their operating environment, i.e., where the trajectories of hazards are partially known to completely unknown. In this paper, we propose a receding horizon control strategy with novel trajectory planning policies that enable dynamic updating of the planned trajectories of autonomous vehicles. The proposed policies utilize two metrics: (1) the number of feasible trajectories; and (2) the robustness of the feasible trajectories. We measure the effectiveness of the suggested policies in terms of mission survivability, which is defined as the probability that the primary mission is accomplished or, if that is not possible, the vehicle lands safely at an alternative site. We show that a linear combination of both metrics is an effective objective function when there is a mix of partially known and unknown uncertainties. When the operating environment is dominated by unknown disturbances, maximizing the number of feasible trajectories results in the highest mission survivability. These findings have significant implications for achieving safe aviation autonomy.

aviation autonomy↗
DOE OSTI2022

Probabilistic inversion of circular phase spectra: application to two-station phase-velocity dispersion estimation in western Canada

SUMMARY Periodic directional and temporal measurements are common in seismology, and necessitate specific statistical analyses that are appropriate for circular quantities. In this work, we explore the use of a von Mises distribution as a representation of errors on circular seismological observations. Specifically, we automate the estimation of surface-wave phase-velocity dispersion for the teleseismic two-station method, which generally suffers from a 2π phase ambiguity. The use of Bayesian inverse techniques, which aim to rigorously quantify model parameter uncertainty, have become widespread throughout seismology over the last decade. Here, we apply Bayesian inversion to measurements of surface-wave phase spectra in order to estimate 1-D, path-averaged Earth structure between station pairs. The dispersion curve and associated uncertainties are additional results of the inversion, which can then be used as input for subsequent analyses (e.g. tomography). We demonstrate this technique through application to surface-wave recordings from long-running seismic stations throughout western Canada. Our results for over 10 000 station pairs reveal first-order tectonic features consistent with previous studies, which provides confidence in our approach as well as an initial step towards resolving a full 3-D seismic velocity model for the region. This work also presents a foundation for the inversion of surface-wave phase spectra to estimate 3-D Earth structure directly. Finally, the ideas presented in this work are not limited to the inversion of surface-wave phase spectra, but can also be considered for Bayesian geophysical inversion of any circular quantities.

Gosselin, Jeremy M. (ORCID:0000000203754102)↗
DOE OSTI2021

Embedded Error Bayesian Calibration of Thermal Decomposition of Organic Materials

Organic materials are an attractive choice for structural components due to their light weight and versatility. However, because they decompose at low temperatures relative to tradiational materials they pose a safety risk due to fire and loss of structural integrity. To quantify this risk, analysts use chemical kinetics models to describe the material pyrolysis and oxidation using thermogravimetric analysis. This process requires the calibration of many model parameters to closely match experimental data. Previous efforts in this field have largely been limited to finding a single best-fit set of parameters even though the experimental data may be very noisy. Furthermore the chemical kinetics models are often simplified representations of the true de- composition process. The simplification induces model-form errors that the fitting process cannot capture. In this work we propose a methodology for calibrating decomposition models to thermogravimetric analysis data that accounts for uncertainty in the model-form and experimental data simultaneously. The methodology is applied to the decomposition of a carbon fiber epoxy composite with a three-stage reaction network and Arrhenius kinetics. The results show a good overlap between the model predictions and thermogravimetric analysis data. Uncertainty bounds capture devia- tions of the model from the data. The calibrated parameter distributions are also presented. In conclusion, the distributions may be used in forward propagation of uncertainty in models that leverage this material.

36 MATERIALS SCIENCE↗
NASA NTRSDate not supplied

3D Climate Simulations of Earth-Like Planets with A Range of Atmospheric Composition, Radiative Transfer, Ocean, And Resolution Configurations, Using the New Version of ROCKE-3D

Understanding the climate of terrestrial planetary atmospheres has been increasingly the focus of research worldwide, in light of the increasing amount of rocky planet discoveries orbiting other stars in or near their habitable zone. Here we present simulations with the new version of the 3D climate model ROCKE-3D, whose version 2.0 will soon become publicly available. A wide range of configurations will be supported, compared to a handful ones in its predecessor, version 1.0 (Way et al., 2017). These include two model resolutions (4x5 and 2x2.5), two radiation schemes (GISS and SOCRATES), three atmospheric configurations (Earth-like, Earth-like without O3 and aerosols, and N2-dominated), and three ocean setups (prescribed sea-surface temperatures and ice cover, q-flux, and dynamic). Simulations of all different configuration combinations have been performed and will become available for use by the community. Key results will be presented across those configurations, together of the role of the structural uncertainty in model setup in the resulting climate calculated by the model.

climate simulations of Earth-like planets↗
DOE OSTI2024

Geothermal Uncertainty Representation in reV: the Renewable Energy Potential Model

We present a preliminary methodology for including geothermal resource uncertainty into the Renewable Energy Potential model, which estimates potential capacity and costs on a gridded surface at the national scale. The uncertainty outputs characterize the 10th, 50th and 90th percentile for geothermal resources using two energy capacity estimation equations. We then present a method and results that demonstrate how other geologic data layers, which may be indicative of permeability, can be used to inform the mean and standard deviation of the geothermal capacity. We demonstrate how the mean and standard deviation can be defined or partially informed by using collocated regression estimates and estimate errors, respectively . These regression results are from 36 observed geothermal power plants in the Great Basin region and are also used to benchmark the P10-P90 calculations.

exclusions↗
DOE OSTI2020

Koopman-Based Approach to Nonintrusive Reduced Order Modeling: Application to Aerodynamic Shape Optimization and Uncertainty Propagation

A methodology for nonintrusive projection-based nonlinear model reduction originally presented by Renganathan et al. is further extended here toward parametric systems with a focus on application to aerospace design. Specifically, the method is extended to address static systems with parametric geometry (that deforms the mesh) in addition to parametric freestream boundary conditions. The main idea is to first perform a transformation on the governing equations such that it is lifted to a higher-dimensional but linear underdetermined system. This enables one to extract the system matrices easily as compared to that of the original nonlinear system. The underdetermined system is closed with a set of model-dependent nonlinear constraints upon which the model reduction is finally performed. The methodology is validated on the subsonic and transonic inviscid flows past the NACA0012 and the RAE2822 airfoils with parametrized shapes. The utility of the approach is further demonstrated by applying it to two common problems in aerospace design, namely, derivative-free global optimization and parametric uncertainty quantification with Monte Carlo sampling. Overall, the methodology is shown to achieve accuracy up to 5% and computational speedup of two to three orders of magnitude relative to the full order model. Comparison against another nonintrusive model reduction method revealed that the proposed approach is more robust, accurate, and retains the consistency between the state variables.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1981

Time and duration of lunar highlands crust formation

Due to remaining uncertainties in model parameters and assumptions in the calculation of model ages, it is not yet possible to resolve the precise dating and duration of lunar crust-mantle differentiation phenomena. Norites 78236 and 73255,27,45 were examined utilizing the Sm-Nd radiometric system. The systematics of 78236 show post-crystallization disturbance but indicate a crystallization date 4.34 AE ago. An isochron is defined by the 73255,27,45 data, with a crystallization date of 4.23 AE. The initial Nd isotopic composition of both norites is within uncertainty limits for a 'chondritic' reference reservoir at the time of their respective crystallizations. The implications for lunar crustal formation persisting over a time span of nearly 350 million years are discussed.

Carlson, R. W.↗
DOE OSTI2023

TransformerG2G: Adaptive time-stepping for learning temporal graph embeddings using transformers

Dynamic graph embedding has emerged as a very effective technique for addressing diverse temporal graph analytic tasks (i.e., link prediction, node classification, recommender systems, anomaly detection, and graph generation) in various applications. Such temporal graphs exhibit heterogeneous transient dynamics, varying time intervals, and highly evolving node features throughout their evolution. Hence, incorporating long-range dependencies from the historical graph context plays a crucial role in accurately learning their temporal dynamics. In this paper, we develop a graph embedding model with uncertainty quantification, TransformerG2G, by exploiting the advanced transformer encoder to first learn intermediate node representations from its current state (t) and previous context (over timestamps [t–1,t–l], l is the length of context). Moreover, we employ two projection layers to generate lower-dimensional multivariate Gaussian distributions as each node's latent embedding at timestamp t. We consider diverse benchmarks with varying levels of "novelty" as measured by the TEA (Temporal Edge Appearance) plots. Here, our experiments demonstrate that the proposed TransformerG2G model outperforms conventional multi-step methods and our prior work (DynG2G) in terms of both link prediction accuracy and computational efficiency, especially for high degree of novelty. Furthermore, the learned time-dependent attention weights across multiple graph snapshots reveal the development of an automatic adaptive time stepping enabled by the transformer. Importantly, by examining the attention weights, we can uncover temporal dependencies, identify influential elements, and gain insights into the complex interactions within the graph structure. For example, we identified a strong correlation between attention weights and node degree at the various stages of the graph topology evolution.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Evaluating Probabilistic Deep Learning Methods for Uncertainty Quantification of Precipitation Bias Correction

Climate models often exhibit biases in their precipitation predictions, particularly underestimating high-intensity events and overestimating low precipitation. Deep learning approaches offer promising solutions, but their epistemic uncertainty associated with a deep learning–based bias correction method has not previously been quantified for reliable downstream climate impact studies. While methods for capturing the epistemic uncertainty in deep learning frameworks exist, there is currently no consensus on the best method. In this work, we compare three uncertainty quantification (UQ) methods—Deep Ensembles (DEns), Monte Carlo Dropout (MCD), and Flipout—by assessing the reliability of their uncertainty estimates using standard measures such as sharpness and calibration. These UQ methods are applied to an existing deep learning precipitation bias correction model known as UFNet: a coupled U-Net and fully connected neural network. The methods utilized to assess the models’ uncertainties are 1) calibration, which ensures that the expected probabilities of the model align with reality and 2) sharpness, which is a measure of the precision of the model’s probabilistic predictions. Of the three UQ methods evaluated, the DEns and MCD methods demonstrated the best-calibrated performance (expected calibration error of 0.36 and 0.35, respectively), compared to Flipout (0.58). In contrast, Flipout had the sharpest predictions and the highest metric performance in bias correcting precipitation—especially for higher-order moments such as kurtosis with a spatial correlation of 72% compared to 32% and 55% spatial correlation for DEns and MCD, respectively. Of the three UQ methods, MCD was found to be the most suitable method for UQ purposes based on its calibration, sharpness, and computational requirements.

Bayesian methods↗
NASA NTRS1978

Very Long Baseline Interferometry Applied to Polar Motion, Relativity and Geodesy

The causes and effects of diurnal polar motion are described. An algorithm is developed for modeling the effects on very long baseline interferometry observables. Five years of radio-frequency very long baseline interferometry data from stations in Massachusetts, California, and Sweden are analyzed for diurnal polar motion. It is found that the effect is larger than predicted by McClure. Corrections to the standard nutation series caused by the deformability of the earth have a significant effect on the estimated diurnal polar motion scaling factor and the post-fit residual scatter. Simulations of high precision very long baseline interferometry experiments taking into account both measurement uncertainty and modeled errors are described.

Ma, C.↗
DOE OSTI2021

New Thermonuclear Rate of 7 Li(d,n)2 4 He Relevant to the Cosmological Lithium Problem

Accurate 7 Li(d,n)2 4 He thermonuclear reaction rates are crucial for precise prediction of the primordial abundances of lithium and beryllium and to probe the mysteries beyond fundamental physics and the standard cosmological model. However, uncertainties still exist in current reaction rates of 7 Li(d,n)2 4 He widely used in big bang nucleosynthesis (BBN) simulations. In this work, we reevaluate the 7 Li(d,n)2 4 He reaction rate using the latest data on the three near-threshold 9 Be excited states from experimental measurements. We present for the first time uncertainties that are directly constrained by experiments. Additionally, we take into account for the first time the contribution from the subthreshold resonance at 16.671 MeV of 9 Be. We obtain a 7 Li(d,n)2 4 He rate that is overall smaller than the previous estimation by about a factor of 60 at the typical temperature of the onset of primordial nucleosynthesis. We implemented our new rate in BBN calculations, and we show that the new rates have a very limited impact on the final light element abundances in uniform density models. Typical abundance variations are in the order of 0.002%. For nonuniform density BBN models, the predicted 7 Li production can be increased by 10% and the primordial production of light nuclides with mass number A > 7 can be increased by about 40%. Our results confirm that the cosmological lithium problem remains a long-standing unresolved puzzle from the standpoint of nuclear physics.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Local and Global Sensitivity Analysis of a Reactive Transport Model Simulating Floodplain Redox Cycling

Reactive transport models (RTMs) are essential tools that simulate the coupling of advective, diffusive, and reactive processes in the subsurface, but their complexity makes them difficult to understand, develop and improve without accompanying statistical analyses. Although global sensitivity analysis (SA) can address these issues, the computational cost associated with most global SA techniques limits their use with RTMs. In this study, we apply distance-based generalized sensitivity analysis (DGSA), a novel and computationally efficient method of global SA, to a floodplain-scale RTM and compare DGSA results to those from local SA. Our test case focuses on the impact of 17 uncertain environmental parameters on spatially and temporally variable redox conditions within a floodplain aquifer. The input parameters considered include flow and diffusion rates, geochemical reaction rates, and the spatial distribution of sediment facies. Sensitivity was evaluated for three distinct components of the model response, encompassing both multidimensional and categorical output. Parameter rankings differ between local SA and DGSA, due to nonlinear effects of individual parameters and interaction effects between parameters. DGSA results show that fluid residence time, which is controlled by aquifer permeability, generally exerts a stronger control on redox conditions than do geochemical reaction rates. Sensitivity indices also demonstrate that sulfate reduction is key for establishing and maintaining reducing conditions throughout the aquifer. Furthermore, these results provide insights into the key drivers of heterogeneous redox processes within floodplain aquifers, as well as the main sources of uncertainty when modeling complex subsurface systems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Determining the bubble nucleation efficiency of low-energy nuclear recoils in superheated C 3 F 8 dark matter detectors

The bubble nucleation efficiency of low-energy nuclear recoils in superheated liquids plays a crucial role in interpreting results from direct searches for weakly interacting massive particle (WIMP) dark matter. Here, the PICO collaboration presents the results of the efficiencies for bubble nucleation from carbon and fluorine recoils in superheated C 3 F 8 from calibration data taken with five distinct neutron spectra at various thermodynamic thresholds ranging from 2.1 to 3.9 keV. Instead of assuming any particular functional forms for the nuclear recoil efficiency, a generalized piecewise linear model is proposed with systematic errors included as nuisance parameters to minimize model-introduced uncertainties. A Markov chain Monte Carlo routine is applied to sample the nuclear recoil efficiency for fluorine and carbon at 2.45 and 3.29 keV thermodynamic thresholds simultaneously. The nucleation efficiency for fluorine was found to be ≥ 50% for nuclear recoils of 3.3 keV (3.7 keV) at a thermodynamic Seitz threshold of 2.45 keV (3.29 keV), and for carbon the efficiency was found to be ≥ 50% for recoils of 10.6 keV (11.1 keV) at a threshold of 2.45 keV (3.29 keV). Simulated datasets are used to calculate a p value for the fit, confirming that the model used is compatible with the data. The fit paradigm is also assessed for potential systematic biases, which although small, are corrected for. Additional steps are performed to calculate the expected interaction rates of WIMPs in the PICO-60 detector, a requirement for calculating WIMP exclusion limits.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS2007

A Risk-Based Approach for Aerothermal/TPS Analysis and Testing

The current status of aerothermal and thermal protection system modeling for civilian entry missions is reviewed. For most such missions, the accuracy of our simulations is limited not by the tools and processes currently employed, but rather by reducible deficiencies in the underlying physical models. Improving the accuracy of and reducing the uncertainties in these models will enable a greater understanding of the system level impacts of a particular thermal protection system and of the system operation and risk over the operational life of the system. A strategic plan will be laid out by which key modeling deficiencies can be identified via mission-specific gap analysis. Once these gaps have been identified, the driving component uncertainties are determined via sensitivity analyses. A Monte-Carlo based methodology is presented for physics-based probabilistic uncertainty analysis of aerothermodynamics and thermal protection system material response modeling. These data are then used to advocate for and plan focused testing aimed at reducing key uncertainties. The results of these tests are used to validate or modify existing physical models. Concurrently, a testing methodology is outlined for thermal protection materials. The proposed approach is based on using the results of uncertainty/sensitivity analyses discussed above to tailor ground testing so as to best identify and quantify system performance and risk drivers. A key component of this testing is understanding the relationship between the test and flight environments. No existing ground test facility can simultaneously replicate all aspects of the flight environment, and therefore good models for traceability to flight are critical to ensure a low risk, high reliability thermal protection system design. Finally, the role of flight testing in the overall thermal protection system development strategy is discussed.

Wright, Michael J.↗