Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

The National Solar Radiation Database (NSRDB) for CSP Applications

This study examines the differences in direct normal irradiance (DNI) in two versions of the National Solar Radiation Database (NSRDB) produced by the National Renewable Energy Laboratory (NREL). NSRDB V3 of the NSRDB includes significant changes to various parts of the radiative transfer model and inputs to the model compared to NSRDB V2. The changes in NSRDB V3 resulted in lower uncertainty than NSRDB V2. The study quantified the uncertainty and the spatial and temporal variability under clear-sky conditions. The uncertainty estimation was performed using a standardized method, The Guide to the Expression of Uncertainty in Measurement (GUM). The evaluation of the accuracy of the NSRDB was conducted using high-quality ground-measurements for seven National Oceanic and Atmospheric Administration Surface Radiation Budget Network (SURFRAD) stations for 1998-2015.

14 SOLAR ENERGY↗

Flattop Benchmark CED-2 (IER-423)

The final design for the Flattop HEU Core Benchmark is presented in this report. Physical measurements will be performed on Flattop components using modern instruments and techniques to define uncertainties necessary to meet contemporary ICSBEP standards. A preliminary re-evaluation of ICSBEP HMF-0028 (Flattop HEU Core) led to the development of IER-423 CED-1, wherein total relative uncertainties in $k_{eff}$ were provided based on a new detailed model. The estimated uncertainty on the total uncertainty is +100%/-0%, given a lack of documented uncertainties on mass, dimensions, and densities of predominantly the natural uranium (NU) and highly enriched uranium (HEU) components.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Bayes goes fast: Uncertainty quantification for a covariant energy density functional emulated by the reduced basis method

A covariant energy density functional is calibrated using a principled Bayesian statistical framework informed by experimental binding energies and charge radii of several magic and semi-magic nuclei. The Bayesian sampling required for the calibration is enabled by the emulation of the high-fidelity model through the implementation of a reduced basis method (RBM)—a set of dimensionality reduction techniques that can speed up demanding calculations involving partial differential equations by several orders of magnitude. The RBM emulator we build—using only 100 evaluations of the high-fidelity model—is able to accurately reproduce the model calculations in tens of milliseconds on a personal computer, an increase in speed of nearly a factor of 3,300 when compared to the original solver. Besides the analysis of the posterior distribution of parameters, we present model calculations for masses and radii with properly estimated uncertainties. We also analyze the model correlation between the slope of the symmetry energy L and the neutron skin of 48 Ca and 208 Pb. The straightforward implementation and outstanding performance of the RBM makes it an ideal tool for assisting the nuclear theory community in providing reliable estimates with properly quantified uncertainties of physical observables. Such uncertainty quantification tools will become essential given the expected abundance of data from the recently inaugurated and future experimental and observational facilities.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A Markov chain Monte Carlo (MCMC) Bayesian inference approach to analyze apparent activation barriers and reaction orders from microreactor data

Statistical analysis of steady-state catalytic kinetic data is often limited by data sparsity due to the slow pace at which the data is collected. Data sparsity and limitations in statistical analysis make it difficult to differentiate between mechanistic models and catalytic sites. A Bayesian inference tool is reported for catalysis researchers to estimate error in the determination of reaction orders from steady state microreactor data. The benefits of a Bayesian inference approach are discussed, as an alternative to the more common frequentist approach. The approach incorporates prior knowledge of the system and the data collected to form an error estimate on reaction orders. We investigated the effects of three distinct data treatments—individual fitting of trials, pooled analysis, and constrained regression methods—on the precision and uncertainty of reaction order determinations. To assess the robustness of our findings, we conducted sensitivity analyses to evaluate the influence of Bayesian parameters on uncertainty estimation. Additionally, we utilized synthetic data to illustrate how data quality impacts the precision of uncertainty assessments. We show Bayesian analysis can obtain a more precise estimation of error with a sparse data set than a frequentist analysis. Finally, this work provides strong evidence that the adoption of Bayesian analysis of kinetic data may help researchers make more precise arguments as to the strength of their evidence for a particular mechanistic hypothesis, or in comparing across different catalysts.

42 ENGINEERING↗

A Modeling Toolkit for Comparing AC and DC Electrical Distribution Efficiency in Buildings

Recently, there has been considerable research interest in the potential for DC distribution systems in buildings instead of the traditional AC distribution systems. Due to the need for performing power conversions between DC and AC electricity, DC distribution may provide electrical efficiency advantages in some systems. To support comparative evaluations of AC-only, DC-only, and hybrid AC/DC distribution systems in buildings, a new modeling toolkit called the Building Electrical Efficiency Analysis Model (BEEAM) was developed and is described in this paper. To account for harmonics in currents or voltages arising from nonlinear devices, the toolkit implements harmonic power flow, along with nonlinear device behavioral descriptions derived from empirical measurements. This paper describes the framework, network equations, device representations, and an implementation of the toolkit in an open source software package, including a component library and graphical interface for creating circuits. Simulations of electrical behavior and device and system efficiencies using the toolkit are compared with experimental measurements of a small office environment in a variety of operating and load configurations. A detailed analysis of uncertainty estimation is also provided. Key findings were that a comparison of predicted versus measured efficiencies and power losses in the validation testbed using the initial toolkit implementation predicted device- and system-level efficiencies with reasonably good accuracy under both balanced and unbalanced AC scenarios. An uncertainty analysis also revealed that the maximum estimated error for system efficiency across all scenarios was 3%, and measured and modeled system efficiency agreed within the experimental uncertainty in approximately half of the scenarios. Based on the correspondence between simulation and measurement, the toolkit is proposed by the authors as a potentially useful tool for comparing efficiency in AC, DC, and hybrid AC/DC distribution systems in buildings.

DC distribution↗

Conserving Land–Atmosphere Synthesis Suite (CLASS)

Accurate estimates of terrestrial water and energy cycle components are needed to better understand climate processes and improve models’ ability to simulate future change. Various observational estimates are available for the individual budget terms; however, these typically show inconsistencies when combined in a budget. In this work, a Conserving Land–Atmosphere Synthesis Suite (CLASS) of estimates of simultaneously balanced surface water and energy budget components is developed. Individual CLASS variable datasets, where possible, 1) combine a range of existing variable product estimates, and hence overcome the limitations of estimates from a single source; 2) are observationally constrained with in situ measurements; 3) have uncertainty estimates that are consistent with their agreement with in situ observations; and 4) are consistent with each other by being able to solve the water and energy budgets simultaneously. First, available datasets of a budget variable are merged by implementing a weighting method that accounts both for the ability of datasets to match in situ measurements and the error covariance between datasets. Then, the budget terms are adjusted by applying an objective variational data assimilation technique (DAT) that enforces the simultaneous closure of the surface water and energy budgets linked through the equivalence of evapotranspiration and latent heat. Comparing component estimates before and after applying the DAT against in situ measurements of energy fluxes and streamflow showed that modified estimates agree better with in situ observations across various metrics, but also revealed some inconsistencies between water budget terms in June over the higher latitudes.

54 ENVIRONMENTAL SCIENCES↗

Uncertainty Analysis of the CE-12 Free-Jet Probe Calibration Facility

This paper presents methods and results of a detailed measurement uncertainty analysis thf at was performed for the Free Jet Calibration Facility (CE-12) located at the NASA Glenn Research Center. Results for systematic uncertainty estimates in a number of fluid properties of the free jet flow are presented. Systematic uncertainty captures inaccuracies due to measurement process, calibration, installation effects or other similar sources which may introduce bias. MANTUS (Measurement Analysis Tool for Uncertainty in Systems) was used to quantify instrumentation uncertainty and engineering judgment was used to quantify other systematic uncertainty sources. The Monte Carlo method was used to propagate systematic uncertainties to determine the uncertainties of various calculated variables of interest.

CE-12↗

Overview of NASA's Carbon Monitoring System Flux-Pilot Project

NASA's space-based observations of physical, chemical and biological parameters in the Earth System along with state-of-the-art modeling capabilities provide unique capabilities for analyses of the carbon cycle. The Carbon Monitoring System is developing an exploratory framework for detecting carbon in the environment and its changes, with a view towards contributing to national and international monitoring activities. The Flux-Pilot Project aims to provide a unified view of land-atmosphere and ocean-atmosphere carbon exchange, using observation-constrained models. Central to the project is the application of NASA's satellite observations (especially MODIS), the ACOS retrievals of the JAXA-GOSAT observations, and the "MERRA" meteorological reanalysis produced with GEOS-S. With a primary objective of estimating uncertainty in computed fluxes, two land- and two ocean-systems are run for 2009-2010 and compared with existing flux estimates. An transport model is used to evaluate simulated CO2 concentrations with in-situ and space-based observations, in order to assess the realism of the fluxes and how uncertainties in fluxes propagate into atmospheric concentrations that can be more readily evaluated. Finally, the atmospheric partial CO2 columns observed from space are inverted to give new estimates of surface fluxes, which are evaluated using the bottom-up estimates and independent datasets. The focus of this presentation will be on the science goals and current achievements of the pilot project, with emphasis on how policy-relevant questions help focus the scientific direction. Examples include the issue of what spatio-temporal resolution of fluxes can be detected from polar-orbiting satellites and whether it is possible to use space-based observations to separate contributions to atmospheric concentrations of (say) fossil-fuel and biological activity

Pawson, Steven↗

Boundary-Aware Adversarial Learning Domain Adaption and Active Learning for Cross-Sensor Building Extraction

The use of convolutional neural networks (CNNs) for building extraction from remote sensing images has been widely studied and many public datasets have been made available for accelerating development of these CNN models. Yet adapting pretrained models at scale in real-world scenarios remains a challenging task. The main barrier is that certain new labels are still needed to compensate for domain shifting between the labeled data and new images that potentially cover new geographic locations or that are from a different sensor. In this article, we propose to add informatively labeled samples from a new image pool under the paradigm of active learning. To select the most useful samples based on model uncertainty, we first tackle the problem of uncalibrated uncertainty estimation due to distribution shifting by adapting feature extractors with boundary-based adversarial learning. Calibrated uncertainty is used as the query criterion in the active learning process, where the most uncertain samples are selected for annotation and included for model retraining. The proposed workflow was tested with three data pairs in which each workflow represents a scenario often encountered in real-world applications, including adapting pretrained models to new images collected with different sensors or to new geographic areas where appearances and types of buildings are very different. Compared to several baselines, including random sampling, temperature scaling (a well-known uncertainty calibration technique), different query strategies, and active domain adaptation methods, the proposed workflow shows that strategically querying a smaller set of samples for labeling achieves comparable or better building extraction performance. The proposed method reduces the number of labeled samples required to achieve sufficient model accuracy, thus significantly reducing hundreds of person-hours for labeled data creation. In addition, we include a few considerations when deploying this workflow in a GPU cluster that can be easily adapted to achieve operational building extraction model retraining.

97 MATHEMATICS AND COMPUTING↗

A neural-network-enhanced parameter-varying framework for multi-objective model predictive control applied to buildings

Management of the electrical grid is becoming more complex due to the increased penetration of alternative energy generation technologies and a broadening diversity of electric loads. This complexity creates challenges in balancing demand and generation that can increase the potential for grid instabilities. One effective way to address this issue is to leverage previously unexploited demand flexibility through advanced control strategies. In this work, we propose an advanced control method, called adaptive neural parameter-varying model predictive control (ANPV-MPC), to control the temperature and energy consumption of a building via its Heating, Ventilation, and Air Conditioning system. ANPV-MPC combines key ideas in parameter-varying control, adaptive control, and online learning strategies to bridge the gap between computationally efficient linear model predictive control and more accurate nonlinear model predictive control. The novelty in ANPV-MPC is the use of a physics-inspired Bayesian neural network to estimate the coefficients of the parameter-varying linear control model. The Bayesian neural network additionally provides uncertainty estimates, triggering online training to capture evolving building system conditions. We show that ANPV-MPC can approximate the building system dynamics with a 28.39% higher accuracy than traditional linear model predictive control, resulting in 36.23% better control performance without increasing complexity of the optimal control problem. ANPV-MPC also adapts in real time to previously unseen conditions using online learning, further improving its performance.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Evaluation of CFD as a Surrogate for Wind Tunnel Testing - Experimental Uncertainty Quantification

A series of wind tunnel tests is being performed at the Unitary Plan Wind Tunnel at Langley Research Center to assess the validity of using computational fluid dynamics (CFD) as a surrogate for wind tunnel testing. In order to make proper comparisons, uncertainties in CFD results and experimental data must be well understood. The material presented will highlight the methods, assumptions, and elemental inputs used to achieve experimental uncertainty estimates for several variables of interest.The work performed to date has focused on gaining insight into random uncertainty via statistical analysis of repeat data and systematic uncertainty via Monte Carlo propagation analysis. These methods were combined using a second-order Monte Carlo propagation, resulting in a probability box (P-box) for each variable and at all conditions of interest. Figure 1 provides an example of one such P-box, showing the experimental uncertainty in a locally determined dynamic pressure (QC10) for one of many tunnel conditions evaluated during the Flow Survey experiment. This particular condition (Condition 27) has nominal set points of Mach number = 3.85, Reynolds number = 3x10(exp 6) ft(exp -1), total pressure = 5160 psfa, and total temperature = 150°F. The uncertainty in dynamic pressure at this condition is now well defined by this plot. Armed with this experimental data uncertainty, meaningful comparisons can be made with computational results, when their associated uncertainties are also considered.

Heather P Houlden↗

Isopropanol dehydration reaction rate kinetics measurement using H 2 O time histories

H 2 O formation during thermal decomposition of isopropanol was measured behind reflected shock waves at temperatures ranging from 1127 to 1621 K at an average pressure of 1.42 atm using a laser absorption technique. Of the five modern chemical kinetics models used to compare the H 2 O time histories, the model from Li et al (Combust. Flame 2019;207:171-185) showed the best overall agreement. Sensitivity and rate of production analyses using the Li et al model (as well as those from AramcoMech 3.0, CRECK, and Togbe et al (Energy Fuel. 2011;25:676-683)) showed unimolecular dehydration of isopropanol, iC 3 H 7 OH ⇌ H 2 O + C 3 H 6 (R1), is nearly the sole reaction controlling H2O production at early times, allowing for an a priori measurement of the forward rate constant k 1 . The Arrhenius expression k1 (s –1 ) = 2.60 × 10 13 exp(-31 120 K/T) was determined to represent best the data from this study. According to the models and previous experimental investigations, the pressure investigated is well within the high-pressure limit (HPL) for this reaction. Additional, higher-pressure experiments also confirmed the HPL assumption. An uncertainty analysis was performed by varying secondary reactions within their uncertainties and examining their effect on the overall prediction, establishing an uncertainty within ±20% for all but the highest temperature cases, which have a maximum uncertainty of ±40%. Experiments conducted with a radical trapper, toluene, showed little influence from radical chemistry, suggesting this estimated uncertainty is fairly conservative. Experimental data from Heyne et al (Z Phys Chem. 2015;229:881-907) were found to be in good agreement with the rate measurements from this study and, therefore, a second Arrhenius expression, k 1 (s –1 ) = 2.11 × 10 13 exp(-30 820 K/T), was found to represent both datasets well. This second expression has a larger temperature range of 976-1621 K. Here the present study provides the first high-temperature data collected for this reaction, adding to the limited data available for isopropanol in the literature.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Quantitative assessment of Distributed Acoustic Sensing at the Source Physics Experiment, Phase II

In this report, we assess the data recorded by a Distributed Acoustic Sensing (DAS) cable deployed during the Source Physics Experiment, Phase II (DAG) in comparison with the data recorded by nearby 4.5-Hz geophones. DAS is a novel recording method with unprecedented spatial resolution, but there are significant concerns around the data fidelity as the technology is ramped up to more common usage. Here we run a series of tests to quantify the similarity between DAS data and more conventional data and investigate cases where the higher spatial resolution of the DAS can provide new insights into the wavefield. These tests include 1D modeling with seismic refraction and bootstrap uncertainties, assessing the amplitude spectra with distance from the source, measuring the frequency dependent inter-station coherency, estimating time-dependent phase velocity with beamforming and semblance, and measuring the cross-correlation between the geophone and the particle velocity inferred from the DAS. In most cases, we find high similarity between the two datasets, but the higher spatial resolution of the DAS provides increased details and methods of estimating uncertainty.

47 OTHER INSTRUMENTATION↗

Quantitative assessment of Distributed Acoustic Sensing at the Source Physics Experiment (Phase II)

In this report, we assess the data recorded by a Distributed Acoustic Sensing (DAS) cable deployed during the Source Physics Experiment, Phase II (DAG) in comparison with the data recorded by nearby 4.5-Hz geophones. DAS is a novel recording method with unprecedented spatial resolution, but there are significant concerns around the data fidelity as the technology is ramped up to more common usage. Here we run a series of tests to quantify the similarity between DAS data and more conventional data and investigate cases where the higher spatial resolution of the DAS can provide new insights into the wavefield. These tests include 1D modeling with seismic refraction and bootstrap uncertainties, assessing the amplitude spectra with distance from the source, measuring the frequency dependent inter-station coherency, estimating time-dependent phase velocity with beamforming and semblance, and measuring the cross-correlation between the geophone and the particle velocity inferred from the DAS. In most cases, we find high similarity between the two datasets, but the higher spatial resolution of the DAS provides increased details and methods of estimating uncertainty.

58 GEOSCIENCES↗

Sonoluminescence Bubble Measurements using Vision-Based Algorithms

Vision-based measurement methods were used to measure bubble sizes in this sonoluminescence experiment. Bubble imaging was accomplished by placing the bubble between a bright light source and a microscope-CCD camera system. A collimated light-emitting diode was operated in a pulsed model with an adjustable time delay with respect to the piezo-electric transducer drive signal. The light-emitting diode produced a bubble shadowgraph consisting of a multiple exposure made by numerous light pulses imaged onto a charge-couple device camera. Each image was transferred from the camera to a computer-controlled machine vision system via a frame grabber. The frame grabber was equipped with on-board memory to accomodate sequential image buffering while images were transferred to the host processor and analyzed. This configuration allowed the host computer to perform diameter measurements, centroid position measurements and shape estimation in "real-time" as the next image was being acquired. Bubble size measurement accuracy with an uncertainty of 3 microns was achieved using standard lenses and machine vision algorithms. Bubble centroid position accuracy was also within the 3 micron tolerance of the vision system. This uncertainty estimation accounted for the optical spatial resolution, digitization errors and the edge detection algorithm accuracy. The vision algorithms include camera calibration, thresholding, edge detection, edge position determination, distance between two edges computations and centroid position computations.

Hall, Nancy R.↗

Spherical fitting for oscilloscope film trace reading

This report describes a spherical fitting algorithm that can be used for estimating the oscilloscope film trace coordinates. This algorithm was adopted from a least square algebraic spherical fitting algorithm developed by the author earlier for photovoltaic velocimetry applications. Preliminary assessment suggests that the algorithm may be used for optimizing the coordinates manually digitized by the user, or may be used as an uncertainty estimator for the user’s film reading uncertainties.

97 MATHEMATICS AND COMPUTING↗

Quantifying uncertainty in Pareto estimates of global lake area

Abstract Size is a critical factor determining the rate and occurrence of specific lake processes such as carbon sequestration and greenhouse gas emissions and emerging evidence suggests that small lakes in particular have particularly large CO 2 flux rates. Because we do not have a complete census of all lakes, upscaling estimates of such processes to small lakes at broad spatial scales requires the use of lake size‐abundance distributions rather than empirical measurements of area. Existing lake census efforts are incomplete such that as lakes become smaller, they are more likely to be omitted either because they are too small to be resolved from remote sensing products or because of limited ground surveying effort (i.e., “censoring” of small lakes relative to large lakes). The present study explores one potential shortcoming of prior approaches estimating global lake area using lake size‐abundance distributions. Namely, that these prior approaches rely on frequentist curve fitting techniques combined with an ad‐hoc cutoff determination strategy (visual inspection to determine a likely censoring point). This yields an over‐exact lake area estimate that is typically reported with no uncertainty bounds. I show how these shortcomings can be addressed with a Bayesian model that produces larger estimates of lake area uncertainty relative to the typical approach. When used as part of a sensitivity analysis, such an approach has the potential to enable more robust intercomparisons among studies of aquatic processes upscaling.

54 ENVIRONMENTAL SCIENCES↗

Radar-based Snow Property Profile Retrievals for NSA

The product contains estimated snow microphysical properties retrieved primarily from vertically-profiling radar observations using a priori constraints that are dependent on atmospheric state. The product provides data at 1-minute time resolution, including snowfall rate at the surface and vertical profiles at 300-meter resolution of snow particle size distribution parameters and snow water contents. Estimated uncertainties for the snowfall rates and snow water contents are also provided. The product is obtained using an optimal estimation retrieval in which radar forward model and a priori state characteristics are based on expected snow particle microphysical and radar scattering properties evaluated from field experiment data.

54 ENVIRONMENTAL SCIENCES↗