Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error quantification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

High-Resolution Gravity and Time-Varying Gravity Field Recovery using GRACE and CHAMP

This progress report summarizes the research work conducted under NASA's Solid Earth and Natural Hazards Program 1998 (SENH98) entitled High Resolution Gravity and Time Varying Gravity Field Recovery Using GRACE (Gravity Recovery and Climate Experiment) and CHAMP (Challenging Mini-satellite Package for Geophysical Research and Applications), which included a no-cost extension time period. The investigation has conducted pilot studies to use the simulated GRACE and CHAMP data and other in situ and space geodetic observable, satellite altimeter data, and ocean mass variation data to study the dynamic processes of the Earth which affect climate change. Results from this investigation include: (1) a new method to use the energy approach for expressing gravity mission data as in situ measurements with the possibility to enhance the spatial resolution of the gravity signal; (2) the method was tested using CHAMP and validated with the development of a mean gravity field model using CHAMP data, (3) elaborate simulation to quantify errors of tides and atmosphere and to recover hydrological and oceanic signals using GRACE, results show that there are significant aliasing effect and errors being amplified in the GRACE resonant geopotential and it is not trivial to remove these errors, and (4) quantification of oceanic and ice sheet mass changes in a geophysical constraint study to assess their contributions to global sea level change, while the results improved significant over the use of previous studies using only the SLR (Satellite Laser Ranging)-determined zonal gravity change data, the constraint could be further improved with additional information on mantle rheology, PGR (Post-Glacial Rebound) and ice loading history. A list of relevant presentations and publications is attached, along with a summary of the SENH investigation generated in 2000.

Shum, C. K.↗

Assessment of Mars Atmospheric Temperature Retrievals from the Thermal Emission Spectrometer Radiances

Motivated by the needs of Mars data assimilation. particularly quantification of measurement errors and generation of averaging kernels. we have evaluated atmospheric temperature retrievals from Mars Global Surveyor (MGS) Thermal Emission Spectrometer (TES) radiances. Multiple sets of retrievals have been considered in this study; (1) retrievals available from the Planetary Data System (PDS), (2) retrievals based on variants of the retrieval algorithm used to generate the PDS retrievals, and (3) retrievals produced using the Mars 1-Dimensional Retrieval (M1R) algorithm based on the Optimal Spectral Sampling (OSS ) forward model. The retrieved temperature profiles are compared to the MGS Radio Science (RS) temperature profiles. For the samples tested, the M1R temperature profiles can be made to agree within 2 K with the RS temperature profiles, but only after tuning the prior and error statistics. Use of a global prior that does not take into account the seasonal dependence leads errors of up 6 K. In polar samples. errors relative to the RS temperature profiles are even larger. In these samples, the PDS temperature profiles also exhibit a poor fit with RS temperatures. This fit is worse than reported in previous studies, indicating that the lack of fit is due to a bias correction to TES radiances implemented after 2004. To explain the differences between the PDS and Ml R temperatures, the algorithms are compared directly, with the OSS forward model inserted into the PDS algorithm. Factors such as the filtering parameter, the use of linear versus nonlinear constrained inversion, and the choice of the forward model, are found to contribute heavily to the differences in the temperature profiles retrieved in the polar regions, resulting in uncertainties of up to 6 K. Even outside the poles, changes in the a priori statistics result in different profile shapes which all fit the radiances within the specified error. The importance of the a priori statistics prevents reliable global retrievals based a single a priori and strongly implies that a robust science analysis must instead rely on retrievals employing localized a priori information, for example from an ensemble based data assimilation system such as the Local Ensemble Transform Kalman Filter (LETKF).

Hoffman, Matthew J.↗

Modeling-Driven Damage Tolerant Design of Graphene Nanoplatelet/Carbon Fiber/Epoxy Hybrid Composite Panels for Full-Scale Aerospace Structures

The objective of this study is to design a new nano graphenecarbon fiberpolymer hybrid composite that can be used for the NASA SLS Composite Exploration Upper Stage (CEUS) forward skirt structure. The new material will improve the resistance to open-hole compression failure of the structure relative to traditional polymer fiber composites. The material is designed rapidly and with little cost using the Integrated Computational Materials Engineering (ICME) approach. Multiscale modeling and experiments are used to synergistically optimize the material design to yield improved properties and performance by controlling key processing parameters for manufacturing nano-enhanced materials. Specifically, the nanocomposite panel showed a 22 reduction in mass relative to the traditional composite panel, while both designs are equal in terms of ease of manufacture. This potential mass savings corresponds to an estimated 45 savings in materials and manufacturing costs. The multiscale ICME workflow developed for this project can be readily applied to the development of nano-enhanced composite materials and large aerospace structures. In addition, all key aspects of ICME were employed to complete this project including multiscale modeling, experimental characterization and visualization, data management, visualization, error and uncertainty quantification, and education. The results presented herein indicate a dramatic level of success, as well as the power and potential of ICME approach and multiscale modeling for composite materials.

computational mechanics↗

Modeling Errors in Daily Precipitation Measurements: Additive or Multiplicative?

The definition and quantification of uncertainty depend on the error model used. For uncertainties in precipitation measurements, two types of error models have been widely adopted: the additive error model and the multiplicative error model. This leads to incompatible specifications of uncertainties and impedes intercomparison and application.In this letter, we assess the suitability of both models for satellite-based daily precipitation measurements in an effort to clarify the uncertainty representation. Three criteria were employed to evaluate the applicability of either model: (1) better separation of the systematic and random errors; (2) applicability to the large range of variability in daily precipitation; and (3) better predictive skills. It is found that the multiplicative error model is a much better choice under all three criteria. It extracted the systematic errors more cleanly, was more consistent with the large variability of precipitation measurements, and produced superior predictions of the error characteristics. The additive error model had several weaknesses, such as non constant variance resulting from systematic errors leaking into random errors, and the lack of prediction capability. Therefore, the multiplicative error model is a better choice.

Modeling↗

Combined Uncertainty and A-Posteriori Error Bound Estimates for General CFD Calculations: Theory and Software Implementation

This workshop presentation discusses the design and implementation of numerical methods for the quantification of statistical uncertainty, including a-posteriori error bounds, for output quantities computed using CFD methods. Hydrodynamic realizations often contain numerical error arising from finite-dimensional approximation (e.g. numerical methods using grids, basis functions, particles) and statistical uncertainty arising from incomplete information and/or statistical characterization of model parameters and random fields. The first task at hand is to derive formal error bounds for statistics given realizations containing finite-dimensional numerical error [1]. The error in computed output statistics contains contributions from both realization error and the error resulting from the calculation of statistics integrals using a numerical method. A second task is to devise computable a-posteriori error bounds by numerically approximating all terms arising in the error bound estimates. For the same reason that CFD calculations including error bounds but omitting uncertainty modeling are only of limited value, CFD calculations including uncertainty modeling but omitting error bounds are only of limited value. To gain maximum value from CFD calculations, a general software package for uncertainty quantification with quantified error bounds has been developed at NASA. The package provides implementations for a suite of numerical methods used in uncertainty quantification: Dense tensorization basis methods [3] and a subscale recovery variant [1] for non-smooth data, Sparse tensorization methods[2] utilizing node-nested hierarchies, Sampling methods[4] for high-dimensional random variable spaces.

CFD↗

Statistical Error Analysis on White-Light Filter Ratio Experiments to Measure Electron Parameters

The Filter ratio technique to remotely measure electron temperature and speed using four color filters in visible light and a polarization camera was described in detail in four articles by Reginald et al., Solar physics, (2018, 2019a, 2019b, 2020). In these four articles we quantified the systematic error associated with using models of symmetric corona to interpret results from asymmetric corona. We also showed the criteria applied to select the bandwidths of filters, and the pros and cons of replacing the traditional linear polarizer with a polarization camera to measure pB. What started in 1990s as ground experiments conducted during total solar eclipses that lasted for a few minutes lead to a balloon borne experiment lasting eight hours in 2019 and will blossom into a space experiment on the International Space Station in 2023. Due to constraints on the bandwidths of the four filters, a successful mission requires quantification of the statistical error using Monte Carlo simulation to generate two feasibility profiles, which are unique to the design parameters of the coronagraph, to comprehend the feasibility to measure temperature and speed within the desired temporal and spatial resolutions. For the statistical error analysis, we use modeled K and F corona profiles, representative theoretical diffraction, scattering, and vignetting profiles, assumed efficiencies for lenses, mirrors, and polarizers, assumed detector properties on quantum efficiency, full well depth, dark noise, and read noise, and assumed instrument properties on aperture diameter, solid angle, and pixel resolution. We hope future white-light coronagraphs will exhibit capabilities to measure electron density, temperature, and speed.

Nelson Reginald↗

An autonomous Nimbus Doppler positioning system

A single-pass Doppler positioning system was developed at the GSFC in support of the Nimbus-6 mission. The system was designed to satisfy the following requirements: compatibility with the PDP 11/70 minicomputer; single-pass recovery of up to 250 positions with a two-sigma accuracy of 5 km; high reliability with a minimum of human interaction; and near real-time responsiveness. The system consists of a numerical integrator which includes only the J2 term (earth flattening) of the earth's gravity field, an editing routine, a first guess algorithm, a least squares position recovery program, and a routine for generating a 95% confidence circle based on a computer covariance matrix. An analysis and quantification of the following error sources that limit system accuracy are presented: orbit error, radial aliasing, computational difficulties with overhead passes, oscillator drift, and ambiguity problems. Results of system reliability tests and sample outputs are included.

Garza-Robles, R.↗

Geometry Modeling for Unstructured Mesh Adaptation

The quantification and control of discretization error is critical to obtaining reliable simulation results. Adaptive mesh techniques have the potential to automate discretization error control, but have made limited impact on production analysis workflow. Recent progress has matured a number of independent implementations of flow solvers, error estimation methods, and anisotropic mesh adaptation mechanics. However, the poor integration of initial mesh generation and adaptive mesh mechanics to typical sources of geometry has hindered adoption of adaptive mesh techniques, where these geometries are often created in Mechanical Computer- Aided Design (MCAD) systems. The difficulty of this coupling is compounded by two factors: the inherent complexity of the model (e.g., large range of scales, bodies in proximity, details not required for analysis) and unintended geometry construction artifacts (e.g., translation, uneven parameterization, degeneracy, self-intersection, sliver faces, gaps, large tolerances be- tween topological elements, local high curvature to enforce continuity). Manual preparation of geometry is commonly employed to enable fixed-grid and adaptive-grid workflows by reducing the severity and negative impacts of these construction artifacts, but manual process interaction inhibits workflow automation. Techniques to permit the use of complex geometry models and reduce the impact of geometry construction artifacts on unstructured grid workflows are models from the AIAA Sonic Boom and High Lift Prediction are shown to demonstrate the utility of the current approach.

Park, Michael A.↗

The Influence of Adaptive Mesh Refinement on the Prediction of Vortex Interactions about a Generic Missile Airframe

The complex interaction of forebody and wing vortices significantly impacts missile aerodynamics. The formation of these vortices involves smooth regions of the geometry or geometric discontinuities like leading edges, trailing edges, tips, and corners. Regions of supersonic flow and complex shock topologies interact with boundary layers and vortices. Smooth-body separation and 3D viscous effects strain current Reynolds-averaged Navier-Stokes (RANS) techniques. The quantification and control of discretization error is critical to obtaining reliable simulation results and often turbulence model assessments are made in the presence of unquantified (and potentially large) discretization errors. Two mesh adaptation schemes are applied to steady RANS simulations. Multiscale unstructured mesh adaptation is applied to control interpolation error estimates of the Mach field, which resolves boundary layers, vortices, and shocks. A dual-mesh approach with overset communication is applied between an expert-crafted near-body unstructured mesh and an adaptive off-body Cartesian mesh refined with Q-criterion scaled by the strain tensor magnitude. A generic missile configuration is examined in a supersonic flow field to show the interaction of mesh adaptation and turbulence model. Turbulence model modifications for rotational correction and a quadratic constitutive relationship show a strong influence on adaptive mesh refinement and predicted rolling moment.

slender body aerodynamics↗

Analysis of laser fluorosensor systems for remote algae detection and quantification

The development and performance of single- and multiple-wavelength laser fluorosensor systems for use in the remote detection and quantification of algae are discussed. The appropriate equation for the fluorescence power received by a laser fluorosensor system is derived in detail. Experimental development of a single wavelength system and a four wavelength system, which selectively excites the algae contained in the four primary algal color groups, is reviewed, and test results are presented. A comprehensive error analysis is reported which evaluates the uncertainty in the remote determination of the chlorophyll a concentration contained in algae by single- and multiple-wavelength laser fluorosensor systems. Results of the error analysis indicate that the remote quantification of chlorophyll a by a laser fluorosensor system requires optimum excitation wavelength(s), remote measurement of marine attenuation coefficients, and supplemental instrumentation to reduce uncertainties in the algal fluorescence cross sections.

Browell, E. V.↗

How Well do Multisatellite Products Capture the Space-Time Dynamics of Precipitation? Part II: Building an Error Model Through Spectral System Identification

Satellite precipitation products, as all quantitative estimates, come with some inherent degree of uncertainty. To associate a quantitative value of the uncertainty to each individual estimate, error modeling is necessary. Most of the error models proposed so far compute the uncertainty as a function of precipitation intensity only, and only at one specific spatio-temporal scale. We propose a spectral error model which accounts for the neighboring space-time dynamics of precipitation into the uncertainty quantification. Systematic distortions of the precipitation signal and random errors are characterized distinctively in every frequency-wavenumber band in the Fourier domain, to accurately characterize error across scales. The systematic distortions are represented as a deterministic space-time linear filtering term. The random errors are represented as a non-stationary additive noise. The spectral error model is applied to the IMERG multi satellite precipitation product and its parameters are estimated empirically through a system identification approach using the GV-MRMS gauge-radar measurements as reference (“truth”) over the eastern United States. The filtering term is found to be essentially low-pass. While traditional error models attribute most of the error variance to random errors, it is found here that the systematic filtering term explains 48% of the error variance at the native resolution of IMERG. This fact confirms that, at high resolution, filtering effects in satellite precipitation products cannot be ignored, and that the error cannot be represented as a purely random additive or multiplicative term. An important consequence is that precipitation estimates derived from totally different sources shall not be expected to automatically have statistically independent errors.

Precipitation↗

Voyager orbit determination at Jupiter

This paper summarizes the Voyager 1 and Voyager 2 orbit determination activity extending from encounter minus 60 days to the Jupiter encounter, and includes quantitative results and conclusions derived from mission experiences. The major topics covered include an identification and quantification of the major orbit determination error sources and a review of salient orbit determination results from encounter, with emphasis on the Jupiter approach phase orbit determination. Special attention is paid to the use of combined spacecraft-based optical observations and earth-based radiometric observations to achieve accurate orbit determination during the Jupiter encounter approach phase.

Campbell, J. K.↗

Quantification of Trace Chemicals Using Vehicle Cabin Atmosphere Monitor

A system to monitor the concentrations of trace chemicals in cabin atmosphere is one of the most critical components in long-duration human flight missions. The Vehicle Cabin Atmosphere Monitor (VCAM) is a miniature gas chromatograph mass spectrometer system to be used to detect and quantify trace chemicals in the International Space Station. We developed an autonomous computational process to quantify trace chemicals for use in VCAM. The process involves the design of a measured signal quantification scheme, the construction of concentration curves (i.e. the relationship between concentration and ion count measured by VCAM), the decision rule of applying high- or low-gain concentration curves, and the detection of saturation, low-signals, and outliers. When the developed quantification process is applied, the average errors of concentration for most of trace chemicals are found to be between 14% and 66%.

Lee, Seungwon↗

Simulation studies and the need for field reflectance studies

There is a need to calibrate satellite data obtained at large polar (i.e., off-nadir) view angles for effects caused by scanner geometry and by the atmosphere. If such effects are not corrected for, then recorded radiance data will contain systematic and random errors which will make accurate target identification and quantification difficult. Adequate calibration of digital radiance data requires both an inductive analysis of digital satellite images and a deductive analysis based upon a priori simulation studies. The inputs to a simulation model (ground reflectance, atmospheric transmission and bandscatter) and their variability are dependent upon (for example) sun-target-sensor geometry. There is a major need to make accurate ground reflectance measurements to provide calibration information on the anisotropy of ground reflectance. There is also a need to assess atmospheric transmission and backscatter from the image itself. A potential simple, inexpensive method for making ground reflectance measurements in the above context is discussed.

Duggin, M. J.↗

Supersonic Retro-Propulsion Experimental Design for Computational Fluid Dynamics Model Validation

The development of supersonic retro-propulsion, an enabling technology for heavy payload exploration missions to Mars, is the primary focus for the present paper. A new experimental model, intended to provide computational fluid dynamics model validation data, was recently designed for the Langley Research Center Unitary Plan Wind Tunnel Test Section 2. Pre-test computations were instrumental for sizing and refining the model, over the Mach number range of 2.4 to 4.6, such that tunnel blockage and internal flow separation issues would be minimized. A 5-in diameter 70-deg sphere-cone forebody, which accommodates up to four 4:1 area ratio nozzles, followed by a 10-in long cylindrical aftbody was developed for this study based on the computational results. The model was designed to allow for a large number of surface pressure measurements on the forebody and aftbody. Supplemental data included high-speed Schlieren video and internal pressures and temperatures. The run matrix was developed to allow for the quantification of various sources of experimental uncertainty, such as random errors due to run-to-run variations and bias errors due to flow field or model misalignments. Some preliminary results and observations from the test are presented, although detailed analyses of the data and uncertainties are still on going.

Berry, Scott A.↗

Supersonic Retropropulsion Experimental Results from the NASA Langley Unitary Plan Wind Tunnel

A new supersonic retropropulsion experimental effort, intended to provide code validation data, was recently completed in the Langley Research Center Unitary Plan Wind Tunnel Test Section 2 over the Mach number range from 2.4 to 4.6. The experimental model was designed using insights gained from pre-test computations, which were instrumental for sizing and refining the model to minimize tunnel wall interference and internal flow separation concerns. A 5-in diameter 70-deg sphere-cone forebody with a roughly 10-in long cylindrical aftbody was the baseline configuration selected for this study. The forebody was designed to accommodate up to four 4:1 area ratio supersonic nozzles. Primary measurements for this model were a large number of surface pressures on the forebody and aftbody. Supplemental data included high-speed Schlieren video and internal pressures and temperatures. The run matrix was developed to allow for the quantification of various sources of experimental uncertainty, such as random errors due to run-to-run variations and bias errors due to flow field or model misalignments. Preliminary results and observations from the test are presented, while detailed data and uncertainty analyses are ongoing.

Berry, Scott A.↗

Supersonic Retropropulsion Test 1853 in NASA LaRC Unitary Plan Wind Tunnel Test Section 2

A supersonic retropropulsion experiment was conducted in the Langley Research Center Unitary Plan Wind Tunnel Test Section 2 at Mach numbers of 2.4, 3.5, and 4.6. Intended as a code validation effort, this study used pretest computations to size and refine the model such that tunnel blockage and internal flow separations were minimized. A 5-in diameter 70 degree sphere-cone forebody, which can accommodate up to four 4:1 area ratio nozzles, followed by a 9.55 inches long cylindrical aft body was selected for this test after computational maturation. The primary measurements for this experiment were high spatial-density surface pressures. In addition, high speed schlieren video and internal pressures and temperatures were acquired. The test included parametric variations in the number of nozzles utilized, thrust coefficients (roughly 0 to 4), and angles of attack (-8 to 20 degrees). The run matrix was developed to also allow quantification of various sources of experimental uncertainty, such as random errors due to run-to-run variations and systematic errors due to flowfield or model misalignments. To accommodate the uncertainty assessment, many runs and replicates were conducted with the model at various locations within the tunnel and with model roll angles of 0, 60, 120, and 180 degrees. This test report provides operational details of the experiment, contains a review of trends, and provides all schlieren and pressure results within appendices.

Berry, Scott A.↗

Analysis of Wind Tunnel Polar Replicates Using the Modern Design of Experiments

The role of variance in a Modern Design of Experiments analysis of wind tunnel data is reviewed, with distinctions made between explained and unexplained variance. The partitioning of unexplained variance into systematic and random components is illustrated, with examples of the elusive systematic component provided for various types of real-world tests. The importance of detecting and defending against systematic unexplained variance in wind tunnel testing is discussed, and the random and systematic components of unexplained variance are examined for a representative wind tunnel data set acquired in a test in which a missile is used as a test article. The adverse impact of correlated (non-independent) experimental errors is described, and recommendations are offered for replication strategies that facilitate the quantification of random and systematic unexplained variance.

Deloach, Richard↗