Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error quantification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Sensor Selection for Aircraft Engine Performance Estimation and Gas Path Fault Diagnostics

This paper presents analytical techniques for aiding system designers in making aircraft engine health management sensor selection decisions. The presented techniques, which are based on linear estimation and probability theory, are tailored for gas turbine engine performance estimation and gas path fault diagnostics applications. They enable quantification of the performance estimation and diagnostic accuracy offered by different candidate sensor suites. For performance estimation, sensor selection metrics are presented for two types of estimators including a Kalman filter and a maximum a posteriori estimator. For each type of performance estimator, sensor selection is based on minimizing the theoretical sum of squared estimation errors in health parameters representing performance deterioration in the major rotating modules of the engine. For gas path fault diagnostics, the sensor selection metric is set up to maximize correct classification rate for a diagnostic strategy that performs fault classification by identifying the fault type that most closely matches the observed measurement signature in a weighted least squares sense. Results from the application of the sensor selection metrics to a linear engine model are presented and discussed. Given a baseline sensor suite and a candidate list of optional sensors, an exhaustive search is performed to determine the optimal sensor suites for performance estimation and fault diagnostics. For any given sensor suite, Monte Carlo simulation results are found to exhibit good agreement with theoretical predictions of estimation and diagnostic accuracies.

Gas Turbine Engines↗

Sensor Selection for Aircraft Engine Performance Estimation and Gas Path Fault Diagnostics

This paper presents analytical techniques for aiding system designers in making aircraft engine health management sensor selection decisions. The presented techniques, which are based on linear estimation and probability theory, are tailored for gas turbine engine performance estimation and gas path fault diagnostics applications. They enable quantification of the performance estimation and diagnostic accuracy offered by different candidate sensor suites. For performance estimation, sensor selection metrics are presented for two types of estimators including a Kalman filter and a maximum a posteriori estimator. For each type of performance estimator, sensor selection is based on minimizing the theoretical sum of squared estimation errors in health parameters representing performance deterioration in the major rotating modules of the engine. For gas path fault diagnostics, the sensor selection metric is set up to maximize correct classification rate for a diagnostic strategy that performs fault classification by identifying the fault type that most closely matches the observed measurement signature in a weighted least squares sense. Results from the application of the sensor selection metrics to a linear engine model are presented and discussed. Given a baseline sensor suite and a candidate list of optional sensors, an exhaustive search is performed to determine the optimal sensor suites for performance estimation and fault diagnostics. For any given sensor suite, Monte Carlo simulation results are found to exhibit good agreement with theoretical predictions of estimation and diagnostic accuracies.

Diagnosis↗

Transcriptomics Processing Pipelines for Space Biology: An Open Source and Consensus-Driven Approach

Transcriptomics holds significant value in elucidating the relationship between gene expression, experimental factors, biological factors, and various types of omics data. Enhancing our understanding of these connections is paramount for foundational biology, which plays a pivotal role in devising solutions for challenges pertinent to both space travel and terrestrial life. The NASA GeneLab project, part of the Open Science Data Repository (OSDR.nasa.gov), seeks to accelerate space biology research through cataloging and democratizing ‘omics data, including transcriptomics. Since raw omics data are largely inaccessible to non-bioinformaticians, GeneLab works with the scientific community via the Open Science Analysis Working Groups (AWGs) to develop standard processing pipelines to generate and publish processed data. Unlike raw data, processed data have greater immediate value to diverse users with varying technical backgrounds and computational capabilities. Standardizing processing workflows is essential to match the pace of raw data generation, ensure reproducibility, and enable standardized processed data for comparison across datasets. As of June 2023, transcriptomics studies comprise over half of GeneLab datasets hosted on the OSDR, including data from bulk RNA-seq and Affymetrix or Agilent 1-Channel DNA microarray assays. In collaboration with the AWGs, GeneLab developed consensus processing pipelines for these transcriptomics data types that includes quality control, background correction (microarray only), data normalization and quantification, culminating in the detection and annotation of differentially expressed genes. The work presented here describes Nextflow implementations of GeneLab’s consensus transcriptomics pipelines that automates and accelerates processing of these datasets. In addition to the core data processing, these workflows also include raw data staging and a robust verification and validation program to identify errors in real-time, stop additional downstream computation, and preserve computational resources. These workflows are used to generate GeneLab processed data hosted on the OSDR, and are publicly available as open source software for others to use at: https://github.com/nasa/GeneLab_Data_Processing.

Jonathan Oribello↗

Criteria for the use of regression analysis for remote sensing of sediment and pollutants

An examination of limitations, requirements, and precision of the linear multiple-regression technique for quantification of marine environmental parameters is conducted. Both environmental and optical physics conditions have been defined for which an exact solution to the signal response equations is of the same form as the multiple regression equation. Various statistical parameters are examined to define a criteria for selection of an unbiased fit when upwelled radiance values contain error and are correlated with each other. Field experimental data are examined to define data smoothing requirements in order to satisfy the criteria of Daniel and Wood (1971). Recommendations are made concerning improved selection of ground-truth locations to maximize variance and to minimize physical errors associated with the remote sensing experiment.

Whitlock, C. H.↗

Raman intensity as a probe of concentration near a crystal growing in solution

The feasibility of using Raman spectral scattering signals for measurements of concentration profiles near a crystal interface during growth or dissolution is discussed. With KH2PO4 (KDP) as a test material, optical multichannel analyzer (OMA) detection of a solute Raman vibrational band provided direct quantification of solute concentration with band intensity. The intersection of incident laser and Raman collection optics provided 3-D selective point measurements of the solution concentration field. Unlike many other techniques, the Raman band intensity is not sensitive to the typical temperature variations. Precision calibration of Raman intensity versus KDP concentration with less than 1 pct standard deviation error levels was demonstrated. A fiber optic, which sampled incident laser intensity and coupled it to the OMA, provided a fully synchronized monitor of fluctuations in laser power to correlate with observed Raman signals. With 1 W of laser power at the sample, good data statistics required eight repeated data collections at approximately 2.5 min collection. The accumulated time represents the concentration measurement time at one spatial location. Photomicroscopy documented a 30 micrometer diameter by 200 micrometer of laser Raman scattering region in the solution near the crystal surface. The laser beam was able to approach up to 25 micrometer from the crystal surface. However, a crystal surface reflected intensity contribution was weakly detectable. Nucleated microcrystals were seen in the crystal-growing solution. These microcrystals convect right up to the crystal surface and indicate no quiet diffusion region under normal gravity conditions. Translation of the solution cell with respect to the optics caused systematic intensity errors.

Wilkinson, R. Allen↗

Quantification of the Uncertainties for the Ares I A106 Ascent Aerodynamic Database

A detailed description of the quantification of uncertainties for the Ares I ascent aero 6-DOF wind tunnel database is presented. The database was constructed from wind tunnel test data and CFD results. The experimental data came from tests conducted in the Boeing Polysonic Wind Tunnel in St. Louis and the Unitary Plan Wind Tunnel at NASA Langley Research Center. The major sources of error for this database were: experimental error (repeatability), database modeling errors, and database interpolation errors.

Houlden, Heather P.↗

Application of Commercial Non-Dispersive Infrared Spectroscopy Sensors for Sub-Ambient Carbon Dioxide Detection

Monitoring carbon dioxide (CO2) concentration within a spacecraft or spacesuit is critically important to ensuring the safety of the crew. Carbon dioxide uniquely absorbs light at wavelengths of 3.95 micrometers and 4.26 micrometers. As a result, non-dispersive infrared (NDIR) spectroscopy can be employed as a reliable and inexpensive method for the quantification of CO2 within the atmosphere. A multitude of commercial off-the-shelf (COTS) NDIR sensors exist for CO2 quantification. The COTS sensors provide reasonable accuracy as long as the measurements are attained under conditions close to the calibration conditions of the sensor (typically 21.1 C (70.0 F) and 1 atmosphere). However, as pressure deviates from atmospheric to the pressures associated with a spacecraft (8.0{10.2 pounds per square inch absolute (psia)) or spacesuit (4.1{8.0 psia), the error in the measurement grows increasingly large. In addition to pressure and temperature dependencies, the infrared transmissivity through a volume of gas also depends on the composition of the gas. As the composition is not known a priori, accurate sub-ambient detection must rely on iterative sensor compensation techniques. This manuscript describes the development of recursive compensation algorithms for sub-ambient detection of CO2 with COTS NDIR sensors. In addition, the source of the exponential loss in accuracy is developed theoretically. The basis of the loss can be explained through thermal, Doppler, and Lorentz broadening effects that arise as a result of the temperature, pressure, and composition of the gas mixture under analysis. This manuscript provides an approach to employing COTS sensors at sub-ambient conditions and may also lend insight into designing future NDIR sensors for aerospace application.

Swickrath, Michael J.↗

Dynamic Adjustment of Simulation Parameters for Efficient Vehicle Prognostics

Model-based diagnostics and prognostics rely on state estimation and uncertainty management algorithms to produce useful information for system operators and maintainers. This information enables more informed operational decisions, condition-based maintenance, and overall mission safety assurance. Typically, uncertainty is associated with vehicle state-of-health estimation and prediction results because of modeling errors, internal or external sources of noise, and sensor inaccuracy. Probabilistic uncertainty management methods including Sequential Monte Carlo simulation are commonly used to reason about state-of-health estimates and predictions in the presence of these sources of uncertainty. However, such algorithms can be computationally expensive as they require a very large number of samples to obtain a sufficiently accurate quantification of the end of life probability distribution. As a result, highly mobile autonomous systems that leverage the prognostic results for mission-level replanning are often constrained in their processing capability because of these computationally expensive simulation approaches. Therefore, in this paper, we investigate algorithmic methods for dynamically adjusting simulation time step as well as number of samples to achieve highly efficient prognostic results while maintaining results accuracy. Results obtained from simulated flight experiments of an electric unmanned aerial vehicle are presented to verify the efficacy of such algorithms.

Prognostics↗

Quantification of the Uncertainties for the Space Launch System Liftoff/Transition and Ascent Databases

A detailed description of the uncertainty quantification process for the Space Launch System Block 1 vehicle configuration liftoff/transition and ascent 6-Degree-of-Freedom (DOF) aerodynamic databases is presented. These databases were constructed from wind tunnel test data acquired in the NASA Langley Research Center 14- by 22-Foot Subsonic Wind Tunnel and the Boeing Polysonic Wind Tunnel in St. Louis, MO, respectively. The major sources of error for these databases were experimental error and database modeling errors.

Favaregh, Amber L.↗

Quantification of vapor screen analysis

The traditionally qualitative method of vapor screening is applied to the task of gathering quantitative density measurements in supersonic flows. Quantitative density information for flow around a two-dimensional biconvex airfoil at Mach 2.8 is extracted from digitized images of vapor screens by assuming a linear relation between particle density and scattering intensity. Intensity readings are calibrated through known conditions in the free stream and at the airfoil bow shock. The experimental results are compared to densities generated by a Euler code and determined to have errors of less than ten percent.

Benedict, Lance H.↗

Uncertainty Quantification for Polynomial Systems via Bernstein Expansions

This paper presents a unifying framework to uncertainty quantification for systems having polynomial response metrics that depend on both aleatory and epistemic uncertainties. The approach proposed, which is based on the Bernstein expansions of polynomials, enables bounding the range of moments and failure probabilities of response metrics as well as finding supersets of the extreme epistemic realizations where the limits of such ranges occur. These bounds and supersets, whose analytical structure renders them free of approximation error, can be made arbitrarily tight with additional computational effort. Furthermore, this framework enables determining the importance of particular uncertain parameters according to the extent to which they affect the first two moments of response metrics and failure probabilities. This analysis enables determining the parameters that should be considered uncertain as well as those that can be assumed to be constants without incurring significant error. The analytical nature of the approach eliminates the numerical error that characterizes the sampling-based techniques commonly used to propagate aleatory uncertainties as well as the possibility of under predicting the range of the statistic of interest that may result from searching for the best- and worstcase epistemic values via nonlinear optimization or sampling.

Crespo, Luis G.↗

Validation of ICESat-2 ATLAS Bathymetry and Analysis of ATLAS’s Bathymetric Mapping Performance

NASA’s Ice, Cloud, and Land Elevation Satellite-2 (ICESat-2) was launched in September, 2018. The satellite carries a single instrument, ATLAS (Advanced Topographic Laser Altimeter System), a green wavelength, photon-counting lidar, enabling global measurement and monitoring of elevation with a primary focus on the cryosphere. Although bathymetric mapping was not one of the design goals for ATLAS, pre-launch work by our research team showed the potential to map bathymetry with ICESat-2, using data from MABEL (Multiple Altimeter Beam Experimental Lidar), NASA’s high-altitude airborne ATLAS emulator, and adapting the laser-radar equation for ATLAS specific parameters. However, many of the sensor variables were only approximations, which limited a full assessment of the bathymetric mapping capabilities of ICESat-2 during pre-launch studies. Following the successful launch, preliminary analyses of the geolocated photon returns have been conducted for a number of coastal sites, revealing several salient examples of seafloor detection in water depths of up to ~40 m. The geolocated seafloor photon returns cannot be taken as bathymetric measurements, however, since the algorithm used to generate them is not designed to account for the refraction that occurs at the air–water interface or the corresponding change in the speed of light in the water column. This paper presents the first early on-orbit validation of ICESat-2 bathymetry and quantification of the bathymetric mapping performance of ATLAS using data acquired over St. Thomas, U.S. Virgin Islands. A refraction correction, developed and tested in this work, is applied, after which the ICESat-2 bathymetry is compared against high-accuracy airborne topo-bathymetric lidar reference data collected by the U.S. Geological Survey (USGS) and the National Oceanic and Atmospheric Administration (NOAA). The results show agreement to within 0.43—0.60 m root mean square error (RMSE) over 1 m grid resolution for these early on-orbit data. Refraction-corrected bottom return photons are then inspected for four coastal locations around the globe in relation to Visible Infrared Imaging Radiometer Suite (VIIRS) K(d)(490) data to empirically determine the maximum depth mapping capability of ATLAS as a function of water clarity. It is demonstrated that ATLAS has a maximum depth mapping capability of nearly 1 Secchi in depth for water depths up to 38 m and K(d)(490) in the range of 0.05–0.12 per m. Collectively, these results indicate the great potential for bathymetric mapping with ICESat-2, offering a promising new tool to assist in filling the global void in nearshore bathymetry.

ICESat-2↗

Quantification of airport community noise impact in terms of noise levels, population density, and human subjective response

The Fraction Impact Method (FIM), developed by the National Research Council (NRC) for assessing the amount and physiological effect of noise, is described. Here, the number of people exposed to a given level of noise is multiplied by a weighting factor that depends on noise level. It is pointed out that the Aircraft-noise Levels and Annoyance MOdel (ALAMO), recently developed at NASA Langley Research Center, can perform the NRC fractional impact calculations for given modes of operation at any U.S. airport. The sensitivity of these calculations to errors in estimates of population, noise level, and human subjective response is discussed. It is found that a change in source noise causes a substantially smaller change in contour area than would be predicted simply on the basis of inverse square law considerations. Another finding is that the impact calculations are generally less sensitive to source noise errors than to systematic errors in population or subjective response.

Deloach, R.↗

Analogs and the BHP Risk Reduction Strategy for Future Spaceflight Missions

In preparation for future exploration missions to distant destinations (e.g., Moon, Near Earth Objects (NEO), and Mars), the NASA Human Research Program s (HRP) Behavioral Health and Performance Element (BHP) conducts and supports research to address four human health risks: Risk of Behavioral Conditions; Risk of Psychiatric Conditions; Risk of Performance Decrements Due to Inadequate Cooperation, Coordination, Communication, and Psychosocial Adaptation within a Team; and Risk of Performance Errors due to Sleep Loss, Fatigue, Circadian Desynchronization, and Work Overload (HRP Science Management Plan, 2008). BHP Research, in collaboration with internal and external research investigators, as well as subject matter experts within NASA operations including flight surgeons, astronauts, and mission planners and others within the Mission Operations Directorate (MOD), identifies knowledge and technology gaps within each Risk. BHP Research subsequently manages and conducts research tasks to address and close the gaps, either through risk assessment and quantification, or the development of countermeasures and monitoring technologies. The resulting deliverables, in many instances, also support current Medical Operations and/or Mission Operations for the International Space Station (ISS).

Whitmire, Sandra↗

A comparison of ISCCP and FIRE satellite cloud parameters

One of the goals of the First ISCCP Regional Experiment (FIRE) is the quantification of the uncertainties in the cloud parameter products derived by the International Satellite Cloud Climatology Project (ISCCP). This validation effort has many facets including sensitivity analyses and comparisons to similar data or theoretical results with known accuracies. The FIRE provides cloud-truth data at particular points or along particular lines from surface and aircraft measurement systems. Relating these data to the larger, area-averaged ISCCP results requires intermediate steps using higher resolution satellite data analyses. Errors in the cloud products derived with a particular method can be determined by performing analyses of high resolution satellite data over the area surrounding the point or line measurement. This same analysis technique may then be used to derive cloud parameters over a larger area containing similar cloud fields. It is assumed that the uncertainties found for the small scale analyses are the same for the large scale so that the method has been calibrated for the particular cloud type; i.e., its accuracy is known. Differences between the large scale results using the ISCCP technique and the calibrated method can be computed and used to determine if any significant biases or rms errors occur in the ISCCP results. Selected ISCCP results are compared to cloud parameters derived using the hybrid bispectral threshold method over the FIRE IFO and extended observation areas.

Gibson, Gary G.↗

The Impact of Soil Reflectance on the Quantification of the Green Vegetation Fraction from NDVI

The green vegetation fraction (Fg) is an important climate and hydrologic model parameter. A common method to calculate Fg is to create a simple linear mixing rnodeP between two NDVI endmembers: bare soil NDVI (NDVI(sub o)) and full vegetation NDVI (NDVI(sub infinity)). Usually it is assumed that NDVI(sub o), is close to zero (NDVI(sub o) approx.-0.05) and is generally chosen from the lowest observed NDVI values. However, the mean soil NDVI computed from 2906 samples is much larger (NDVI=0.2) and is highly variable (standard deviation=O. 1). We show that the underestimation of NDVI(sub o) yields overestimations of Fg. The largest errors occur in grassland and shrubland areas. Using parameters for NDVI(sub o) and NDVI(sub infinity) derived from global scenes yields overestimations of Fg ((Delta) Fg*) that are larger than 0.2 for the majority of U.S. land cover types when pixel NDVI values are 0.2<NDVI(sub pixel)<0.4. Figure 1 shows how the Fg overestimation varies for the most common land cover types in the conterminous U.S. for typical seasonal NDVI values. When using conterminous U.S. scenes to derive NDV(sub o) and NDVI(sub infinity), the overestimation is less (0.10-0.17 for 0.2<NDVI(sub pixel)<0.4). As a result, parts of the conterminous U.S. are affected at different times of the year depending on the local seasonal NDVI cycle. We propose using global databases of NDVI(sub o) along with information on historical NDVI(sub pixel) values to compute a statistically most-likely estimate of Fg (Fg*). Using in situ measurements made at the Sevilleta LTER, we show that this approach yields better estimates of Fg than using global invariant NDVI(sub o) values estimated from whole scenes (Figure 2). At the two studied sites, the Fg estimate was adjusted by 52% at the grassland and 86% at the shrubland. More significant advances will require information on spatial distribution of soil reflectance.

Montandon, L. M.↗

Uncertainty Quantification of CFD Data Generated for a Model Scramjet Isolator Flowfield

Computational fluid dynamics is now considered to be an indispensable tool for the design and development of scramjet engine components. Unfortunately, the quantification of uncertainties is rarely addressed with anything other than sensitivity studies, so the degree of confidence associated with the numerical results remains exclusively with the subject matter expert that generated them. This practice must be replaced with a formal uncertainty quantification process for computational fluid dynamics to play an expanded role in the system design, development, and flight certification process. Given the limitations of current hypersonic ground test facilities, this expanded role is believed to be a requirement by some in the hypersonics community if scramjet engines are to be given serious consideration as a viable propulsion system. The present effort describes a simple, relatively low cost, nonintrusive approach to uncertainty quantification that includes the basic ingredients required to handle both aleatoric (random) and epistemic (lack of knowledge) sources of uncertainty. The nonintrusive nature of the approach allows the computational fluid dynamicist to perform the uncertainty quantification with the flow solver treated as a "black box". Moreover, a large fraction of the process can be automated, allowing the uncertainty assessment to be readily adapted into the engineering design and development workflow. In the present work, the approach is applied to a model scramjet isolator problem where the desire is to validate turbulence closure models in the presence of uncertainty. In this context, the relevant uncertainty sources are determined and accounted for to allow the analyst to delineate turbulence model-form errors from other sources of uncertainty associated with the simulation of the facility flow.

Baurle, R. A.↗

Cloud cover sampling capability of various satellite combinations for ISCCP

One of the most important objectives of the International Satellite Cloud Climatology Project (ISCCP) is the quantification of cloud cover and associated radiation parameters for climate research. The time-varying nature of cloud cover requires a measurement system that obtains cloud radiance at sufficient time intervals for determining accurate values of cloudiness for the appropriate averaging period. Current plans for the ISCCP call for such day to be acquired every 3 hours during both data and night to ensure that the diurnal cycle of cloud cover is adequately sampled. The satellite system proposed is an array of geostationary and polar-orbiting satellites. The error in mean cloud cover estimates for observation systems which do not include geostationary satellites are quantified. Candidates for such a system include two NOAA Sun-synchronous satellites with daylight equatorial-crossing times of 0730 and 1430, and a USSR satellite in an 81 deg. inclination, 900-km altitude orbit.

Harrison, E. F.↗