SEARCH · Engineering Papers

Results for “prediction uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

All sources NASA NTRS DOE OSTI

DOE OSTI2022

An adaptive knowledge-based data-driven approach for turbulence modeling using ensemble learning technique under complex flow configuration: 3D PWR sub-channel with DNS data

This work describes a new approach to increase the accuracy of Reynolds-averaged Navier–Stokes (RANS) in modeling turbulence flow leveraging the machine learning technique. Traditionally, different turbulence models for Reynolds stress are developed for different flow patterns based on human knowledge. Each turbulence model has a certain application domain and prediction uncertainty. In recent years, with the rapid improvements of machine learning techniques, researchers start to develop an approach to compensate for the prediction discrepancy of traditional turbulence models with statistical models and data. However, the approach has deficiencies in several aspects. For example, the amount of human knowledge introduced to the statistical model couldn’t be controlled, which makes the statistical model learn from a very naïve stage and limits its application. In this work, a new approach is developed to address those deficiencies. Here, the new approach uses the “ensemble learning” technique to control the amount of human knowledge introduced into the statistical model. Therefore, the new approach could be adaptive to the multiple application domains. In conclusion, according to the results of case study, the new approach shows higher accuracy than both traditional turbulence models and the previous machine learning approach.

42 ENGINEERING↗

DOE OSTI2024

Binary Quantum Control Optimization with Uncertain Hamiltonians

Optimizing the controls of quantum systems plays a crucial role in advancing quantum technologies. The time-varying noises in quantum systems and the widespread use of inhomogeneous quantum ensembles raise the need for high-quality quantum controls under uncertainties. In this paper, we consider a stochastic discrete optimization formulation of a discretized binary optimal quantum control problem involving Hamiltonians with predictable uncertainties. We propose a sample-based reformulation that optimizes both risk-neutral and risk-averse measurements of control policies, and solve these with two gradient-based algorithms using sum-up-rounding approaches. Furthermore, we discuss the differentiability of the objective function and prove upper bounds of the gaps between the optimal solutions to binary control problems and their continuous relaxations. We conduct numerical simulations on various sized problem instances based on two applications of quantum pulse optimization; we evaluate different strategies to mitigate the impact of uncertainties in quantum systems. In conclusion, we demonstrate that the controls of our stochastic optimization model achieve significantly higher quality and robustness compared with the controls of a deterministic model.

conditional value-at-risk (CVaR)↗

DOE OSTI2023

Uncertainty-aware photovoltaic generation estimation through fusion of physics with harmonics information using Bayesian neural networks

We develop an aggregate photovoltaic generation estimation methodology that uses diverse inputs and can reason on its current input-dependent predictive uncertainty. Named PVPHEst, for PhotoVoltaic Physics- & Harmonics-driven Estimator, the resulting tool is intelligently weighing and fusing information carried by the output of physics models, harmonics, and line sensors, using Bayesian neural networks and related techniques aimed at solving machine learning problems with intrinsic uncertainty quantification. As each of the three input classes carries heterogeneous information that only sheds light on one facet of the estimation problem but its value can diminish in the face of diverse grid phenomena, PV-PHEst with its estimation and uncertainty reasoning capabilities perform a nontrivial and potentially mission-critical task of value to grid operators.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2024

Bayesian Neural Network Variational Autoencoder Inverse Mapper (BNN-VAIM) and its application in Compton Form Factors extraction

Abstract We extend the Variational Autoencoder Inverse Mapper (VAIM) framework for the inverse problem of extracting Compton Form Factors (CFFs) from deeply virtual exclusive reactions, such as the unpolarized Deeply virtual exclusive scattering (DVCS) cross section. VAIM is an end-to-end deep learning framework to address the solution ambiguity issue in ill-posed inverse problems, which comprises of a forward mapper and a backward mapper to simulate the forward and inverse processes, respectively. In particular, we incorporate Bayesian Neural Network (BNN) into the VAIM architecture (BNN-VAIM) for uncertainty quantification. By sampling the weights and biases distributions of the BNN in the backward mapper of the VAIM, BNN-VAIM is able to estimate prediction uncertainty associated with each individual solution obtained for an ill-posed inverse problem. We first demonstrate the uncertainty quantification capability of BNN-VAIM in a toy inverse problem. Then, we apply BNN-VAIM to the inverse problem of extracting 8 CFFs from the unpolarized DVCS cross section.

Instruments & Instrumentation↗

DOE OSTI2019

Search for an Exotic S=-2, Q=-2 Baryon Resonance in Proton-Proton Interactions at $\sqrt{s_{NN}}$ = 17.3 GeV

Searches and analyses of strong gravitational lenses are challenging due to the rarity and image complexity of these astronomical objects. Next-generation surveys (both ground- and space-based) will provide more opportunities to derive science from these objects, but only if they can be analyzed on realistic time-scales. Currently, these analyses are expensive. In this work, we present a regression analysis with uncertainty estimates using deep learning models to measure four parameters of strong gravitational lenses in simulated Dark Energy Survey data. Using only $gri$-band images, we predict Einstein Radius, lens velocity dispersion, lens redshift to within $10-15\%$ of truth values and source redshift to $30\%$ of truth values, along with predictive uncertainties. This work helps to take a step along the path of faster analyses of strong lenses with deep learning frameworks.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS1980

Effects of aerodynamic heating and TPS thermal performance uncertainties on the Shuttle Orbiter

A procedure for estimating uncertainties in the aerodynamic-heating and thermal protection system (TPS) thermal-performance methodologies developed for the Shuttle Orbiter is presented. This procedure is used in predicting uncertainty bands around expected or nominal TPS thermal responses for the Orbiter during entry. Individual flowfield and TPS parameters that make major contributions to these uncertainty bands are identified and, by statistical considerations, combined in a manner suitable for making engineering estimates of the TPS thermal confidence intervals and temperature margins relative to design limits. Thus, for a fixed TPS design, entry trajectories for future Orbiter missions can be shaped subject to both the thermal-margin and confidence-interval requirements. This procedure is illustrated by assessing the thermal margins offered by selected areas of the existing Orbiter TPS design for an entry trajectory typifying early flight test missions.

Goodrich, W. D.↗

NASA NTRS1981

A statistical analysis of simulated data from potential stratospheric satellite missions

A simplified one-dimensional model is used to analyze simulated data from typical proposed satellite measurements of trace species in the stratosphere. Uncertainties are introduced in simulated species concentration measurements and applied to the basic physical and chemical model data. The results of the calculations are then used to predict uncertainties in the species concentrations computed by the model. Candidate satellite missions can be evaluated for net information acquired by applying the error analysis. An abbreviated depiction of the computational procedure is given, and sample histograms based on an accumulation of 200 calculations are shown for H2O2 and ClNO3, demonstrating that emergent species distributions are roughly Gaussian in the logarithm of number density. Calculated vertical concentration profiles for these two species are presented.

Nealy, J. E.↗

NASA NTRS1992

Attitude stability of LDEF: Refinement of results from the silver pinhole camera

A measurement was previously described of the angular offset and attitude stability of the LDEF spacecraft using a simple pinhole camera device in the UAH experiment A0114. This device uses a silver surface to record the impact zone of atmospheric atomic oxygen passing through a small pinhole on the front surface of the satellite. The shape and size of this zone are well defined if the satellite velocity and gas temperature are known. The circular symmetry of the zone would be distorted by oscillation of the LDEF about its stable attitude, or by the effect of the co-rotation of the Earth's atmosphere for cases of satellites in nonequatorial orbits. The observed ellipticity of 1.05 with the major axis in the yaw direction is equivalent to an oscillation of + or - 0.2 deg about the stable attitude. The uncertainty in that measurement was estimated at about 0.1 deg. A refined analysis based on summing distributions of flux versus incidence angle for a large number of orbital positions, and including a co-rotating atmosphere, indicates that the combined distributions produce a result consistent with the measured exposed spot. It is suggested that, within the precision of the measurements, no actual oscillation of the LDEF is required to produce the results. Thus, the LDEF may have maintained a stable attitude to better than 0.1 deg, even under conditions of maximum aerodynamic perturbation when the silver oxygen record was made. This error is some two orders of magnitude lower than the predicted uncertainty in yaw oscillation and may indicate that the predict methodologies are too conservative.

Peters, P. N.↗

DOE OSTI2023

An Ensemble of Neural Networks for Moist Physics Processes, Its Generalizability and Stable Integration

Abstract With the recent advances in data science, machine learning has been increasingly applied to convection and cloud parameterizations in global climate models (GCMs). This study extends the work of Han et al. (2020, https://doi.org/10.1029/2020MS002076 ) and uses an ensemble of 32‐layer deep convolutional residual neural networks, referred to as ResCu‐en, to emulate convection and cloud processes simulated by a superparameterized GCM, SPCAM. ResCu‐en predicts GCM grid‐scale temperature and moisture tendencies, and cloud liquid and ice water contents from moist physics processes. The surface rainfall is derived from the column‐integrated moisture tendency. The prediction uncertainty inherent in deep learning algorithms in emulating the moist physics is reduced by ensemble averaging. Results in 1‐year independent offline validation show that ResCu‐en has high prediction accuracy for all output variables, both in the current climate and in a warmer climate with +4K sea surface temperature. The analysis of different neural net configurations shows that the success to generalize in a warmer climate is attributed to convective memory and the 1‐dimensional convolution layers incorporated into ResCu‐en. We further implement a member of ResCu‐en into CAM5 with real world geography and run the neural‐network‐enabled CAM5 (NCAM) for 5 years without encountering any numerical integration instability. The simulation generally captures the global distribution of the mean precipitation, with a better simulation of precipitation intensity and diurnal cycle. However, there are large biases in temperature and moisture in high latitudes. These results highlight the importance of convective memory and demonstrate the potential for machine learning to enhance climate modeling.

Meteorology & Atmospheric Sciences↗

NASA NTRS2021

Cutting out the Middleman: Calibrating and Validating a Dynamic Vegetation Model (ED2-PROSPECT5) Using Remotely Sensed Surface Reflectance

Canopy radiative transfer is the primary mechanism by which models relate vegetation composition and state to the surface energy balance, which is important to light- and temperature-sensitive plant processes as well as understanding land–atmosphere feedbacks. In addition, certain parameters (e.g., specific leaf area, SLA) that have an outsized influence on vegetation model behavior can be constrained by observations of shortwave reflectance, thus reducing model predictive uncertainty. Importantly, calibrating against radiative transfer outputs allows models to directly use remote sensing reflectance products without relying on highly derived products (such as MODIS leaf area index) whose assumptions may be incompatible with the target vegetation model and whose uncertainties are usually not well quantified. Here, we created the EDR model by coupling the two-stream representation of canopy radiative transfer in the Ecosystem Demography model version 2 (ED2) with a leaf radiative transfer model (PROSPECT-5) and a simple soil reflectance model to predict full-range, high-spectral-resolution surface reflectance that is dependent on the underlying ED2 model state. We then calibrated this model against estimates of hemispherical reflectance (corrected for directional effects) from the NASA Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) and survey data from 54 temperate forest plots in the northeastern United States. The calibration significantly reduced uncertainty in model parameters related to leaf biochemistry and morphology and canopy structure for five plant functional types. Using a single common set of parameters across all sites, the calibrated model was able to accurately reproduce surface reflectance for sites with highly varied forest composition and structure. However, the calibrated model's predictions of leaf area index (LAI) were less robust, capturing only 46 % of the variability in the observations. Comparing the ED2 radiative transfer model with another two-stream soil–leaf–canopy radiative transfer model commonly used in remote sensing studies (PRO4SAIL) illustrated structural errors in the ED2 representation of direct radiation backscatter that resulted in systematic underestimation of reflectance. In addition, we also highlight that, to directly compare with a two-stream radiative transfer model like EDR, we had to perform an additional processing step to convert the directional reflectance estimates of AVIRIS to hemispherical reflectance (also known as “albedo”). In future work, we recommend that vegetation models add the capability to predict directional reflectance, to allow them to more directly assimilate a wide range of airborne and satellite reflectance products. We ultimately conclude that despite these challenges, using dynamic vegetation models to predict surface reflectance is a promising avenue for model calibration and validation using remote sensing data.

Alexey N Shiklomanov↗

DOE OSTI2022

Active learning of reactive Bayesian force fields applied to heterogeneous catalysis dynamics of H/Pt

Abstract Atomistic modeling of chemically reactive systems has so far relied on either expensive ab initio methods or bond-order force fields requiring arduous parametrization. Here, we describe a Bayesian active learning framework for autonomous “on-the-fly” training of fast and accurate reactive many-body force fields during molecular dynamics simulations. At each time-step, predictive uncertainties of a sparse Gaussian process are evaluated to automatically determine whether additional ab initio training data are needed. We introduce a general method for mapping trained kernel models onto equivalent polynomial models whose prediction cost is much lower and independent of the training set size. As a demonstration, we perform direct two-phase simulations of heterogeneous H 2 turnover on the Pt(111) catalyst surface at chemical accuracy. The model trains itself in three days and performs at twice the speed of a ReaxFF model, while maintaining much higher fidelity to DFT and excellent agreement with experiment.

42 ENGINEERING↗

DOE OSTI2025

The Lyman- α forest from LBGs: First 3D correlation measurement with DESI and prospects for cosmology

The Lyman-α (Lyα) forest is a key tracer of large-scale structure at redshifts z > 2, traditionally studied using the spectra of luminous but relatively rare quasars. In this work, we explore the viability of using the fainter yet significantly more abundant Lyman Break Galaxies (LBGs) as alternative background sources for Lyα forest studies. We analyze 4,151 Lyα forest skewers extracted from LBG spectra obtained in the DESI pilot surveys conducted in the COSMOS and XMM-LSS fields. From this dataset, we present the first measurement of the Lyα forest auto-correlation function derived exclusively from LBG spectra, probing comoving separations up to 48 h -1 Mpc at an effective redshift of z eff = 2.70. The measured LBG Lyα forest auto-correlation is consistent with that derived from DESI DR2 quasar Lyα forest spectra at a comparable redshift, validating the use of LBGs as reliable background sources for Lyα forest analyses. In addition, we measure the cross-correlation between the LBG Lyα forest and the positions of 13,362 galaxies, demonstrating that this observable serves as a sensitive diagnostic for assessing the precision and accuracy of galaxy redshift estimates, and for identifying and correcting systematic offsets. Finally, using both synthetic LBG spectra and Fisher matrix forecasts, we show that a future wide-area survey covering ∼5,000 deg 2 , targeting 1,000 LBGs per square degree at signal-to-noise levels comparable to our sample, could enable LBG-based Lyα forest baryon acoustic oscillation (BAO) measurements with expected uncertainties of σ α ISO = 0.4% (isotropic) and σ α AP = 1.3% (Alcock-Paczynski). This performance is further enhanced when combining the BAO analysis with a Lyα forest Full Shape (FS) approach, yielding a predicted uncertainty of σ α ISO FS = 0.6%. These results open a new avenue for precision cosmology at high redshift using the Lyα forest in dense LBG samples.

Lyman alpha forest↗

NASA NTRS2014

A Battery Health Monitoring Framework for Planetary Rovers

Batteries have seen an increased use in electric ground and air vehicles for commercial, military, and space applications as the primary energy source. An important aspect of using batteries in such contexts is battery health monitoring. Batteries must be carefully monitored such that the battery health can be determined, and end of discharge and end of usable life events may be accurately predicted. For planetary rovers, battery health estimation and prediction is critical to mission planning and decision-making. We develop a model-based approach utilizing computaitonally efficient and accurate electrochemistry models of batteries. An unscented Kalman filter yields state estimates, which are then used to predict the future behavior of the batteries and, specifically, end of discharge. The prediction algorithm accounts for possible future power demands on the rover batteries in order to provide meaningful results and an accurate representation of prediction uncertainty. The framework is demonstrated on a set of lithium-ion batteries powering a rover at NASA.

prediction↗

DOE OSTI2021

Cutting out the middleman: calibrating and validating a dynamic vegetation model (ED2-PROSPECT5) using remotely sensed surface reflectance

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2011

Characterization of Tactical Departure Scheduling in the National Airspace System

This paper discusses and analyzes current day utilization and performance of the tactical departure scheduling process in the National Airspace System (NAS) to understand the benefits in improving this process. The analysis used operational air traffic data from over 1,082,000 flights during the month of January, 2011. Specific metrics included the frequency of tactical departure scheduling, site specific variances in the technology's utilization, departure time prediction compliance used in the tactical scheduling process and the performance with which the current system can predict the airborne slot that aircraft are being scheduled into from the airport surface. Operational data analysis described in this paper indicates significant room for improvement exists in the current system primarily in the area of reduced departure time prediction uncertainty. Results indicate that a significant number of tactically scheduled aircraft did not meet their scheduled departure slot due to departure time uncertainty. In addition to missed slots, the operational data analysis identified increased controller workload associated with tactical departures which were subject to traffic management manual re-scheduling or controller swaps. An analysis of achievable levels of departure time prediction accuracy as obtained by a new integrated surface and tactical scheduling tool is provided to assess the benefit it may provide as a solution to the identified shortfalls. A list of NAS facilities which are likely to receive the greatest benefit from the integrated surface and tactical scheduling technology are provided.

Capps, Alan↗

DOE OSTI2022

Near‐Surface Hydrology and Soil Properties Drive Heterogeneity in Permafrost Distribution, Vegetation Dynamics, and Carbon Cycling in a Sub‐Arctic Watershed

Abstract Discontinuous permafrost environments exhibit strong spatial heterogeneity at scales too small to be driven by weather forcing or captured by Earth System Models. Here we analyze effects of observed spatial heterogeneity in soil and vegetation properties, hydrology, and thermal dynamics on ecosystem carbon dynamics in a watershed on the Seward Peninsula in Alaska. We apply a Morris global sensitivity analysis to a process‐rich, successfully tested terrestrial ecosystem model (TEM), ecosys , varying soil properties, boundary conditions, and weather forcing. We show that landscape heterogeneity strongly impacts soil temperatures and vegetation composition. Snow depth, O‐horizon thickness, and near‐surface water content, which vary at scales of O(m), control the soil thermal regime more than an air temperature gradient corresponding to a 140 km north–south distance. High shrub productivity is simulated only in talik (perennially unfrozen) soils with high nitrogen availability. Through these effects on plant and permafrost dynamics, landscape heterogeneity impacts ecosystem productivity. Simulations with near‐surface taliks have higher microbial respiration (by 78.0 gC m −2 yr −1 ) and higher net primary productivity (by 104.9 gC m −2 yr −1 ) compared to runs with near‐surface permafrost, and simulations with high shrub productivity have outlying values of net carbon uptake. We explored the prediction uncertainty associated with ignoring observed landscape heterogeneity, and found that watershed net carbon uptake is 60% larger when heterogeneity is accounted for. Our results highlight the complexity inherent in discontinuous permafrost environments and demonstrate that missing representation of subgrid heterogeneity in TEMs could bias predictions of high‐latitude carbon budget.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Femtosecond pulse parameter estimation from photoelectron momenta using machine learning

Abstract Deep learning models have provided huge interpretation power for image-like data. Specifically, convolutional neural networks (CNNs) have demonstrated incredible acuity for tasks such as feature extraction or parameter estimation. Here we test CNNs on strong-field ionization photoelectron spectra, training on theoretical data sets to ‘invert’ experimental data. Pulse characterization is used as a ‘testing ground’, specifically we retrieve the laser intensity, where ‘traditional’ measurements typically lead to 20% uncertainty. We report on crucial data augmentation techniques required to successfully train on theoretical data and return consistent results from experiments, including accounting for detector saturation. The same procedure can be repeated to apply CNNs in a range of scenarios for strong-field ionization. Using a predictive uncertainty estimation, reliable laser intensity uncertainties of a few percent can be extracted, which are consistently lower than those given by traditional techniques. Using interpretability methods can reveal parts of the distribution that are most sensitive to laser intensity, which can be directly associated with holographic interferences. The CNNs employed provide an accurate and convenient ways to extract parameters, and represent a novel interpretational tool for strong-field ionization spectra.

Szołdra, Tomasz (ORCID:0000000228970506)↗

DOE OSTI2022

A Framework for Inverse Prediction Using Functional Response Data

Inverse prediction models have commonly been developed to handle scalar data from physical experiments. However, it is not uncommon for data to be collected in functional form. When data are collected in functional form, it must be aggregated to fit the form of traditional methods, which often results in a loss of information. For expensive experiments, this loss of information can be costly. In this study, we introduce the functional inverse prediction (FIP) framework, a general approach which uses the full information in functional response data to provide inverse predictions with probabilistic prediction uncertainties obtained with the bootstrap. The FIP framework is a general methodology that can be modified by practitioners to accommodate many different applications and types of data. We demonstrate the framework, highlighting points of flexibility, with a simulation example and applications to weather data and to nuclear forensics. Results show how functional models can improve the accuracy and precision of predictions.

42 ENGINEERING↗