Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error quantification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Multiple Velocity Profile Measurements in Hypersonic Flows using Sequentially-Imaged Fluorescence Tagging

Nitric-oxide planar laser-induced fluorescence (NO PLIF) was used to perform velocity measurements in hypersonic flows by generating multiple tagged lines which fluoresce as they convect downstream. For each laser pulse, a single interline, progressive scan intensified CCD camera was used to obtain separate images of the initial undelayed and delayed NO molecules that had been tagged by the laser. The CCD configuration allowed for sub-microsecond acquisition of both images, resulting in sub-microsecond temporal resolution as well as sub-mm spatial resolution (0.5-mm x 0.7-mm). Determination of axial velocity was made by application of a cross-correlation analysis of the horizontal shift of individual tagged lines. Quantification of systematic errors, the contribution of gating/exposure duration errors, and influence of collision rate on fluorescence to temporal uncertainty were made. Quantification of the spatial uncertainty depended upon the analysis technique and signal-to-noise of the acquired profiles. This investigation focused on two hypersonic flow experiments: (1) a reaction control system (RCS) jet on an Orion Crew Exploration Vehicle (CEV) wind tunnel model and (2) a 10-degree half-angle wedge containing a 2-mm tall, 4-mm wide cylindrical boundary layer trip. The experiments were performed at the NASA Langley Research Center's 31-inch Mach 10 wind tunnel.

Bathel, Brett F.↗

Application of Parallel Adjoint-Based Error Estimation and Anisotropic Grid Adaptation for Three-Dimensional Aerospace Configurations

This paper demonstrates the extension of error estimation and adaptation methods to parallel computations enabling larger, more realistic aerospace applications and the quantification of discretization errors for complex 3-D solutions. Results were shown for an inviscid sonic-boom prediction about a double-cone configuration and a wing/body segmented leading edge (SLE) configuration where the output function of the adjoint was pressure integrated over a part of the cylinder in the near field. After multiple cycles of error estimation and surface/field adaptation, a significant improvement in the inviscid solution for the sonic boom signature of the double cone was observed. Although the double-cone adaptation was initiated from a very coarse mesh, the near-field pressure signature from the final adapted mesh compared very well with the wind-tunnel data which illustrates that the adjoint-based error estimation and adaptation process requires no a priori refinement of the mesh. Similarly, the near-field pressure signature for the SLE wing/body sonic boom configuration showed a significant improvement from the initial coarse mesh to the final adapted mesh in comparison with the wind tunnel results. Error estimation and field adaptation results were also presented for the viscous transonic drag prediction of the DLR-F6 wing/body configuration, and results were compared to a series of globally refined meshes. Two of these globally refined meshes were used as a starting point for the error estimation and field-adaptation process where the output function for the adjoint was the total drag. The field-adapted results showed an improvement in the prediction of the drag in comparison with the finest globally refined mesh and a reduction in the estimate of the remaining drag error. The adjoint-based adaptation parameter showed a need for increased resolution in the surface of the wing/body as well as a need for wake resolution downstream of the fuselage and wing trailing edge in order to achieve the requested drag tolerance. Although further adaptation was required to meet the requested tolerance, no further cycles were computed in order to avoid large discrepancies between the surface mesh spacing and the refined field spacing.

Lee-Rausch, E. M.↗

Calibration of reactive burn and Jones-Wilkins-Lee parameters for simulations of a detonation-driven flow experiment with uncertainty quantification

Here, uncertainties in the explosive-specific parameters of the Jones-Wilkins-Lee (JWL) equation of state (EOS) are carefully considered in hydrodynamic simulations of an explosive experiment to minimize the error in the flow prediction. Experimental data of the leading shock position in the transverse direction over time serves as the prediction metric for quantifying simulation prediction error. The uncertainty quantification technique, global sensitivity analysis, is utilized to determine the JWL parameters to which the transverse shock propagation is most sensitive. A polynomial response surface (PRS) is constructed in the space of the most influential JWL parameters, and the point of minimum error between the experimental data and the PRS yields calibrated JWL parameters for the experimental flow. The simulation results following the parameter calibration show good agreement with the experimental data. It was found that two significant parameters, the heat release per unit mass of reactant Q and JWL model exponent R 1 are strongly related, which makes it difficult to identify accurate values.

36 MATERIALS SCIENCE↗

A measurement-based model of software reliability in a production environment

In this paper, a semi-Markov model is built to describe the software error and recovery process in a large mainframe system. The model is based on low-level error data from the MVS operating system running on an IBM 3081 machine. The semi-Markov model developed provides a quantification of system error characteristics and the interaction between different types of errors. As an example, a detailed model is provided, and an analysis is made of multiple errors, which constitute approximately an 17 percent of all software errors and result in considerable recovery overhead.

Hsueh, M. C.↗

Cell G 7606A Mockup Measurement Analysis Methods and Results

The production of research isotopes at the Radiochemical Engineering Development Center (REDC) invariably leads to the accumulation of radioactive waste. Storage of this waste onsite at ORNL serves as an interim solution prior to shipment to long term storage facilities, however onsite capacity is limited. Proper characterization of the activity of waste products is essential for determining the appropriate waste stream and, ultimately, mitigating the cost of disposal. This is typically done via gamma spectrometry and use of the In-Situ Object Counting System (ISOCS), a software package from Mirion that serves as an accepted community standard. However, variability in the contents, density, and activity distribution in waste containers can introduce large errors in ISOCS quantification. A measurement campaign using a mockup of the proposed setup in Cell G seeks to quantify the magnitude and source of these systematic errors. Analysis of this data will guide the creation of ISOCS geometry templates and measurement methods designed to minimize overall uncertainty in reported activities.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Quantification of regional net CO 2 flux errors in the Orbiting Carbon Observatory-2 (OCO-2) v10 model intercomparison project (MIP) ensemble using airborne measurements

Inverse model intercomparison projects (MIPs) provide a chance to assess the uncertainties in inversion estimates arising from various sources. However, accurately quantifying ensemble CO 2 flux errors remains challenging and often relies on the ensemble spread. This study proposes a method for quantifying the errors in regional net surface–atmosphere CO 2 flux estimates from models taken from the Orbiting Carbon Observatory-2 (OCO-2) v10 MIP by using independent airborne CO 2 measurements for the period 2015–2017. We first calculate the root mean square error (RMSE) between the ensemble mean of posterior CO 2 concentrations and airborne observations and then isolate the CO 2 concentration errors caused solely by the ensemble mean of posterior net fluxes by subtracting the observation, representation, and transport errors from seven regions. Our analysis reveals that the flux errors projected onto CO 2 space account for 55 %–85 % of the regional average RMSE over the 3 years, ranging from 0.88 to 1.91 ppm. In five regions, the error estimates based on observations exceed those computed from the ensemble spread of posterior fluxes by a factor of 1.33–1.93, implying an underestimation of the actual flux errors, while their magnitudes are comparable in two regions. The adjoint sensitivity analysis identifies that the underestimation of flux errors is prominent where the magnitudes of fossil fuel emissions exceed those of terrestrial-biosphere fluxes by a factor of 3–31 over the 3 years. This suggests the presence of systematic biases in the inversion estimates associated with errors in the prescribed fossil fuel emissions common to all models. Our study emphasizes the value of airborne measurements for quantifying regional errors in ensemble net CO 2 flux estimates.

54 ENVIRONMENTAL SCIENCES↗

Benchmarking noise extrapolation with the OpenPulse control framework

Distilling precise estimates from noisy intermediate scale quantum (NISQ) data has recently attracted considerable attention Kandala et al., Nature (London) 567, 491 (2019). In order to augment digital qubit metrics, such as gate fidelity, we discuss analog error mitigability, i.e., the ability to accurately distill precise observable estimates, as a hybrid quantum classical computing benchmarking task. Specifically, using Rabi oscillations as a test program, we characterize single qubit error rates on IBM's Poughkeepsie superconducting quantum hardware, incorporate control-mediated noise dependence into a generalized rescaling protocol, and analyze how noise characteristics influence Richardson extrapolation-based error mitigation. Finally, our results identify regions in the space of Hamiltonian control fields and circuit depth which are most amenable to reliable noise extrapolation, as well as shed light on how low-level hardware characterization can be used as a predictive tool for uncertainty quantification in error-mitigated NISQ computations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Efficient flexible characterization of quantum processors with nested error models

We present a simple and powerful technique for finding a good error model for a quantum processor. The technique iteratively tests a nested sequence of models against data obtained from the processor, and keeps track of the best-fit model and its wildcard error (a metric of the amount of unmodeled error) at each step. Each best-fit model, along with a quantification of its unmodeled error, constitutes a characterization of the processor. We explain how quantum processor models can be compared with experimental data and to each other. We demonstrate the technique by using it to characterize a simulated noisy two-qubit processor.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Intelligent Electrochemical Sensors for Precise Identification of Volatile Organic Compounds Enabled by Neural Network Analysis

The volatile organic compounds (VOCs) in a wide spectrum of categories were identified as biomarkers in aquatic environments, playing an important role in marine and freshwater ecology and global atmospheric chemistry. VOCs released from biofuel have also attracted increasing attention. Although the importance has been recognized, the portable detection and analysis methods of VOC in aquatic systems have not yet been well developed and understood. Here, in this work, we innovatively proposed an intelligent electrochemical sensing approach to classify and quantify VOCs in solution. Utilizing the cyclic voltammetry (CV) method with an ionic liquid (IL)-based electrolyte, we analyzed 50 μL samples of various VOC analytes, including acetic acid (AC), acetone, dimethylformamide (DMF), dimethyl sulfoxide (DMSO), ethanol, formaldehyde, formic acid, methanol, methyl formate (MF), toluene, and a formaldehyde-methanol mixture, along with deionized water (DI water). The generated voltammograms were subsequently analyzed using our uniquely designed and optimized 1-D convolutional neural network (1D-CNN). This deep-learning algorithm achieved a 99.09% accuracy in VOC classification validated through fivefold cross-validation and demonstrated an impressive 94.4% test accuracy for methanol detection within a 10 μL error range. For quantification, the system accurately categorized methanol volumes ranging from 0 to 50 μL in 10 μL increments, achieving a 98.18% accuracy. A notable linear correlation (R2 = 95.56%) was found between max current density at the oxidation peak and methanol volume, with the limit of detection (LOD) at 9.3 μL. Such a sensing method exhibits potential for portability, high accuracy, and generalization in the classification and quantification, ultimately reshaping the realm of VOC analysis in solution.

42 ENGINEERING↗

MAGIC: M arching Cubes Isosurface Uncertainty Visualization for G auss i an Uncertain Data With Spatial C orrelation

Here, in this paper, we study the propagation of data uncertainty through the marching cubes algorithm for isosurface visualization for correlated uncertain data. Consideration of correlation has been shown paramount for avoiding errors in uncertainty quantification and visualization in multiple prior studies. Although the problem of isosurface uncertainty with spatial data correlation has been previously addressed, there are two major limitations to prior treatments. First, there are no analytical formulations for uncertainty quantification of isosurfaces when the data uncertainty is characterized by a Gaussian distribution with spatial correlation. Second, as a consequence of the lack of analytical formulations,existing techniques resort to a Monte Carlo sampling approach, which is expensive and difficult to integrate into visualization tools. To address these limitations, we present a closed-form framework to efficiently derive uncertainty in marching cubes level-sets for Gaussian uncertain data with spatial correlation (MAGIC). To derive closed-form solutions, we leverage the Hinkley's derivation on the ratio of Gaussian distributions. With our analytical framework, we achieve a significant speed-up and enhanced accuracy of uncertainty quantification over classical Monte Carlo methods. We further accelerate our analytical solutions using many-core processors to achieve speed-ups up to 585× and integrability with production visualization tools for broader impact. We demonstrate the effectiveness of our correlation-aware uncertainty framework through experiments on meteorology, urban flow, and astrophysics simulation datasets.

Gaussian↗

Impact of Pressure-Dependent Interfacial Tension and Contact Angle on Capillary Heterogeneity Trapping of CO2 in Storage Aquifers

Summary Carbon dioxide (CO2) capillary trapping increases the total amount of CO2 that can be effectively immobilized in storage aquifers. This trapping, manifesting itself as accumulated CO2 columns at a continuum scale, is because of capillary threshold effects that occur below low-permeability barriers. Considering that capillary pressure is dictated by heterogeneous pore throat size, the trapped CO2 column height and associated CO2 saturation will vary spatially within a storage aquifer. This variation will be influenced by two pressure-dependent interfacial parameters—CO2/brine interfacial tension (IFT) and CO2/brine/rock contact angle. Our objective is to understand how the pressure dependence of these two parameters affects the heterogeneity of capillary trapped CO2 at a continuum scale. Our conceptual model is a 1D two-zone system with the upper zone being a flow barrier (low permeability) and the lower zone being a flow path (high permeability). The inputs to this model include microfacies-dependent capillary pressure vs. saturation curves and permeability values. The input capillary pressure curves were collected in the literature that represents carbonate microfacies (e.g., dolograinstone) in a prevalent formation in the Permian Basin. We then used the Leverett j-function to scale the capillary pressure curve for the two zones that are assigned with the same or different microfacies. During scaling, we considered the influence of pressure on both the IFT and contact angle of CO2/brine/dolomite systems. We varied the zone permeability contrast ratio from 2 to 50. We then assumed capillary gravity equilibriums and calculated the CO2 saturation buildup corresponding to various trapped CO2 column heights. The CO2 saturation buildup is defined as the CO2 saturation in the lower layer minus that in the upper one. We found that the saturation buildup can be doubled when varying pressure in a storage aquifer, after considering pressure-dependent IFT and contact angles. Thus, assuming these two parameters to be constant across such aquifers would cause large errors in the quantification of capillary trapping of CO2. The whole study demonstrates the importance of considering pressure-dependent interfacial properties in predicting the vertical distribution of capillary trapped CO2. It has important implications in developing a better understanding of leakage risks and consequent storage safety.

Engineering↗

High-Resolution Gravity and Time-Varying Gravity Field Recovery using GRACE and CHAMP

This progress report summarizes the research work conducted under NASA's Solid Earth and Natural Hazards Program 1998 (SENH98) entitled High Resolution Gravity and Time Varying Gravity Field Recovery Using GRACE (Gravity Recovery and Climate Experiment) and CHAMP (Challenging Mini-satellite Package for Geophysical Research and Applications), which included a no-cost extension time period. The investigation has conducted pilot studies to use the simulated GRACE and CHAMP data and other in situ and space geodetic observable, satellite altimeter data, and ocean mass variation data to study the dynamic processes of the Earth which affect climate change. Results from this investigation include: (1) a new method to use the energy approach for expressing gravity mission data as in situ measurements with the possibility to enhance the spatial resolution of the gravity signal; (2) the method was tested using CHAMP and validated with the development of a mean gravity field model using CHAMP data, (3) elaborate simulation to quantify errors of tides and atmosphere and to recover hydrological and oceanic signals using GRACE, results show that there are significant aliasing effect and errors being amplified in the GRACE resonant geopotential and it is not trivial to remove these errors, and (4) quantification of oceanic and ice sheet mass changes in a geophysical constraint study to assess their contributions to global sea level change, while the results improved significant over the use of previous studies using only the SLR (Satellite Laser Ranging)-determined zonal gravity change data, the constraint could be further improved with additional information on mantle rheology, PGR (Post-Glacial Rebound) and ice loading history. A list of relevant presentations and publications is attached, along with a summary of the SENH investigation generated in 2000.

Shum, C. K.↗

Assessment of Mars Atmospheric Temperature Retrievals from the Thermal Emission Spectrometer Radiances

Motivated by the needs of Mars data assimilation. particularly quantification of measurement errors and generation of averaging kernels. we have evaluated atmospheric temperature retrievals from Mars Global Surveyor (MGS) Thermal Emission Spectrometer (TES) radiances. Multiple sets of retrievals have been considered in this study; (1) retrievals available from the Planetary Data System (PDS), (2) retrievals based on variants of the retrieval algorithm used to generate the PDS retrievals, and (3) retrievals produced using the Mars 1-Dimensional Retrieval (M1R) algorithm based on the Optimal Spectral Sampling (OSS ) forward model. The retrieved temperature profiles are compared to the MGS Radio Science (RS) temperature profiles. For the samples tested, the M1R temperature profiles can be made to agree within 2 K with the RS temperature profiles, but only after tuning the prior and error statistics. Use of a global prior that does not take into account the seasonal dependence leads errors of up 6 K. In polar samples. errors relative to the RS temperature profiles are even larger. In these samples, the PDS temperature profiles also exhibit a poor fit with RS temperatures. This fit is worse than reported in previous studies, indicating that the lack of fit is due to a bias correction to TES radiances implemented after 2004. To explain the differences between the PDS and Ml R temperatures, the algorithms are compared directly, with the OSS forward model inserted into the PDS algorithm. Factors such as the filtering parameter, the use of linear versus nonlinear constrained inversion, and the choice of the forward model, are found to contribute heavily to the differences in the temperature profiles retrieved in the polar regions, resulting in uncertainties of up to 6 K. Even outside the poles, changes in the a priori statistics result in different profile shapes which all fit the radiances within the specified error. The importance of the a priori statistics prevents reliable global retrievals based a single a priori and strongly implies that a robust science analysis must instead rely on retrievals employing localized a priori information, for example from an ensemble based data assimilation system such as the Local Ensemble Transform Kalman Filter (LETKF).

Hoffman, Matthew J.↗

Modeling-Driven Damage Tolerant Design of Graphene Nanoplatelet/Carbon Fiber/Epoxy Hybrid Composite Panels for Full-Scale Aerospace Structures

The objective of this study is to design a new nano graphenecarbon fiberpolymer hybrid composite that can be used for the NASA SLS Composite Exploration Upper Stage (CEUS) forward skirt structure. The new material will improve the resistance to open-hole compression failure of the structure relative to traditional polymer fiber composites. The material is designed rapidly and with little cost using the Integrated Computational Materials Engineering (ICME) approach. Multiscale modeling and experiments are used to synergistically optimize the material design to yield improved properties and performance by controlling key processing parameters for manufacturing nano-enhanced materials. Specifically, the nanocomposite panel showed a 22 reduction in mass relative to the traditional composite panel, while both designs are equal in terms of ease of manufacture. This potential mass savings corresponds to an estimated 45 savings in materials and manufacturing costs. The multiscale ICME workflow developed for this project can be readily applied to the development of nano-enhanced composite materials and large aerospace structures. In addition, all key aspects of ICME were employed to complete this project including multiscale modeling, experimental characterization and visualization, data management, visualization, error and uncertainty quantification, and education. The results presented herein indicate a dramatic level of success, as well as the power and potential of ICME approach and multiscale modeling for composite materials.

computational mechanics↗

The Reduction of Random Uncertainty in Differential Temperature Measurements Using Common Leg Thermocouples

The uncertainty quantification of random error is considered for common leg thermocouples (i.e., where one thermoelement is shared along the length of the TC for all other TC junctions present). The uncertainty is presented for both a common leg and individual, separate leg thermocouples. For Type K thermocouples a reduction in uncertainty by up to 3x is capable when differential temperatures, ?T, are within 150°C, and diminishes to little to no improvement above 150°C.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗

Modeling Errors in Daily Precipitation Measurements: Additive or Multiplicative?

The definition and quantification of uncertainty depend on the error model used. For uncertainties in precipitation measurements, two types of error models have been widely adopted: the additive error model and the multiplicative error model. This leads to incompatible specifications of uncertainties and impedes intercomparison and application.In this letter, we assess the suitability of both models for satellite-based daily precipitation measurements in an effort to clarify the uncertainty representation. Three criteria were employed to evaluate the applicability of either model: (1) better separation of the systematic and random errors; (2) applicability to the large range of variability in daily precipitation; and (3) better predictive skills. It is found that the multiplicative error model is a much better choice under all three criteria. It extracted the systematic errors more cleanly, was more consistent with the large variability of precipitation measurements, and produced superior predictions of the error characteristics. The additive error model had several weaknesses, such as non constant variance resulting from systematic errors leaking into random errors, and the lack of prediction capability. Therefore, the multiplicative error model is a better choice.

Modeling↗

Carbonyl Identification and Quantification Uncertainties for Oxidative Polymer Degradation

The most revealing indicator for oxidative processes or state of degraded plastics is usually carbonyl formation, a key step in materials degradation as part of the carbon cycle for man-made materials. Hence, the identification and quantification of carbonyl species with infrared spectroscopy have been the method of choice for generations, thanks to their strong absorbance and being an essential intermediate in carbon oxidation pathways. Despite their importance, precise identification and quantification can be challenging and rigorous fully traceable data are surprisingly rare in the existing literature. An overview of the complexity of carbonyl quantification is presented by the screening of reference compounds in solution with transmission and polymer films with ATR IR spectroscopy, and systematic data analyses. Significant variances in existing data and their past use have been recognized. Guidance is offered how better measurements and data reporting could be accomplished. Experimental variances depend on the combination of uncertainty in exact carbonyl species, extinction coefficient, contributions from neighboring convoluting peaks, matrix interaction phenomena and instrumental variations in primary IR spectral acquisition (refractive index and penetration depth for ATR measurements). In addition, diverging sources for relevant extinction coefficients may exist, based on original spectral acquisition. For common polymer degradation challenges, a relative comparison of carbonyl yields for a material is easily accessible, but quantification for other purposes, such as degradation rates and spatially dependent interpretation, requires thorough experimental validation. All variables featured in this overview demonstrate the significant error margins in carbonyl quantification, with exact carbonyl species and extinction coefficients already being major contributors on their own.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Combined Uncertainty and A-Posteriori Error Bound Estimates for General CFD Calculations: Theory and Software Implementation

This workshop presentation discusses the design and implementation of numerical methods for the quantification of statistical uncertainty, including a-posteriori error bounds, for output quantities computed using CFD methods. Hydrodynamic realizations often contain numerical error arising from finite-dimensional approximation (e.g. numerical methods using grids, basis functions, particles) and statistical uncertainty arising from incomplete information and/or statistical characterization of model parameters and random fields. The first task at hand is to derive formal error bounds for statistics given realizations containing finite-dimensional numerical error [1]. The error in computed output statistics contains contributions from both realization error and the error resulting from the calculation of statistics integrals using a numerical method. A second task is to devise computable a-posteriori error bounds by numerically approximating all terms arising in the error bound estimates. For the same reason that CFD calculations including error bounds but omitting uncertainty modeling are only of limited value, CFD calculations including uncertainty modeling but omitting error bounds are only of limited value. To gain maximum value from CFD calculations, a general software package for uncertainty quantification with quantified error bounds has been developed at NASA. The package provides implementations for a suite of numerical methods used in uncertainty quantification: Dense tensorization basis methods [3] and a subscale recovery variant [1] for non-smooth data, Sparse tensorization methods[2] utilizing node-nested hierarchies, Sampling methods[4] for high-dimensional random variable spaces.

CFD↗