Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Statistical error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24

Does Collection Time Bias the Ecology of Cleanroom Air Samples?

Microbial monitoring of astromaterials collections has taken on increased importance with the return of biologically sensitive samples from the asteroids Ryugu and Bennu and the initiation of the Mars Sample Return Program. Terrestrial bacteria and fungi can alter the mineralogy and organic composition of our collections causing irreversible contamination of pristine samples and increasing the risk of false positives for life detection measurements. NASA has conducted routine microbial monitoring of its existing collections since 20181. Initial monitoring focused on surface samples collected with foam swabs. Although, airborne microbiology is often decoupled from surface microbiology in the built environment2 culture-based air sampling techniques like impactors were not compliant with existing contamination control requirements. Bringing organic rich media, gelatin or liquids into curation cleanrooms presents an unacceptable risk to pristine samples. In 2022 NASA purchased a materials complaint air sampler and began collecting air samples from the cleanrooms in addition to surface samples3. The new instrument uses an electret filter to collect samples that are suitable for cultivating organisms or for direct DNA sequencing. Preliminary DNA sequencing results appeared to indicate that longer sampling times biased the microbial community in favor of hearty, spore-forming bacteria3. We present the results of a study comparing overnight sampling (17 hours) to short (1 hour) sampling of unoccupied curation cleanrooms. The results will help us optimize our monitoring protocols and develop a more detailed inventory of the ecology of astromaterials curation cleanrooms. Methods: We analyzed 72 paired air samples from six different cleanrooms including the meteorite processing lab (ISO 7 equivalent, 16 samples), the lunar lab (ISO 6 equivalent, 10 samples), the stardust lab (ISO 5 equivalent 14 samples), the OSIRIS-REx lab (ISO 5 equivalent, 12 samples), the Hayabusa2 lab (ISO 5 equivalent, 14 samples), and the Genesis lab (ISO 4 equivalent, 6 samples). All the samples were collected with an InnovaPrep Bobcat air sampler operating at a sampling rate of 200 L/min. The sampler operates for 5 minutes out of every 20 minute period. Half of the samples were collected by filtering 3,000L (15 min. of active sampling) of air across an electret filter for one hour. The rest of the samples were collected by filtering approximately 51,000 L air across the filter overnight (~17 hours, 255 min. of active sampling). Cells were eluted from the filter using 6-7 ml of pressurized 0.15% tween 20 in PBS (phosphate buffered saline). This liquid was used to cultivate bacteria according to previously published methods1,4,5 and for DNA extraction and next generation sequencing. DNA was extracted with a Qiagen MagAttract PowerMicrobiome kit6. To identify bacteria and archaea, the 16S rRNA gene was amplified using Earth Microbiome primers for the V4 region 7. The amplified DNA was sequenced on an Illumina MiSeq using a V3 reagent kit. The resulting sequences were processed using DADA2 and QIIME2 as implemented on the EDGE bioinformatics platform8–10. Results: Only two of the 72 samples had no amplifiable DNA. Amplified DNA concentrations ranged from 2.67 – 0.272 ng/µl. The median concentration of amplified DNA for the 1 hour samples was 0.770 ± 0.368 ng/µl. The median concentration of amplified DNA for the overnight samples was 0.877 ± 0.434 ng/µl. On average the overnight samples had slightly more sequences (58,960 vs. 59,456) and ASV’s (amplicon sequence variants) (60 vs 64.5) than the one hour samples, but these differences are not statistically significant. The most abundant ASV in every sample mapped to the genus Cupravidus. ASV’s mapping to the genuses Bacillus, Schlegelella, Thermus, and Staphylococcus were also common. Discussion and Future Work: Alpha diversity statistics like Shannon Entropy and Faith Phylogenetic Diversity are used to describe the diversity of organisms in a single sample. If a longer sampling time was biasing the data, we would expect to see a change in these diversity statistics vs. sample time. However, we did not observe this in our data. The median Shannon entropy was slightly higher for the overnight samples (3.773 vs 3.611) as was the Faith Phylogenetic Diversity (4.042 vs 3.596), but both values were within a standard deviation of each other for the two sampling times (Fig. 1). It is unlikely, that the longer sampling time is introducing bias into our data. We do observe a significant decrease in diversity when comparing the air samples by lab. The Genesis lab (ISO 4 equivalent) has a lower median number of ASV’s (45.5) than the other labs (62). Median values for Shannon Entropy (3.717 vs. 3.430) and Faith Phylogenetic Diversity (3.796 vs. 3.548) are also lower for Genesis, but those values are with one standard deviation of each other for the different sampling times. This is consistent with previous culture-based results suggesting that the environment in cleanrooms tends to select for a core group of organisms capable of surviving under dry, low nutrient, conditions. The presence of the ASV’s mapping to Cupravidus and Thermus in our sequencing blanks and controls suggests that several of the most common organisms in our samples represent contaminants from the reagents used to perform the DNA extractions and sequencing. Further work is needed to identify these contaminants, remove them from our data and recalculate the diversity statistics. This is a systematic error. Therefore, we do not expect removing the sequencing contaminants to change our conclusions. Longer air sample collection times appear to result in slightly higher diversity and do not bias the results towards “hardy” bacteria like spore-formers. Based on these preliminary results we conclude that sampling at least 3,000 liters of air is sufficient to capture the microbial diversity of cleanrooms, and that air samples can also be collected overnight without negatively impacting diversity. These results allow us to be flexible when designing microbial monitoring plans so that they do not interfere with routine lab activity. References: 1. Regberg, A. B. et al. 49th Lunar and Planetary Science Conference (2018). 2. The United States Pharmacopeial Convention. USP General Chapter <1116> (2013). 3. Regberg, A. B., et al. 54th Lunar and Planetary Science Conference (2023). 4. Regberg, A. B. et al. 53rd Lunar and Planetary Science Conference ( 2022). 5. Davis, R. E.,et al. 50th Lunar and Planetary Science Conference (2019). 6. Qiagen. MagAttract® PowerMicrobiome® DNA/RNA EP Kit Handbook. (2018). 7. Walters, W. et al. mSystems 1, (2015). 8. Callahan, B. J. et al. Nat. Methods 13, 581–583 (2016). 9. Hall, M. & Beiko, R. G. Microbiome Analysis: Methods and Protocols113–129 (Springer, 2018). 10. Philipson, C. et al. Bio-Protoc. 7, e2622 (2017).

A. B. Regberg↗

Summarizing Multiple Aspects of Triple Collocation Analysis in a Single Diagram

With the ongoing expansion of global observation networks, it is expected that we shall routinely analyze records of geophysical variables such as temperature from multiple collocated instruments. Validating datasets in this situation is not a trivial task because every observing system has its own bias and noise. Triple collocation is a general statistical framework to estimate the error characteristics in three or more observational-based datasets. In a triple colocation analysis, several metrics are routinely reported but traditional multiple-panel plots are not the most effective way to display information. A new formula of error variance is derived for connecting the key terms in the triple collocation theory. A diagram based on this formula is devised to facilitate triple collocation analysis of any data from observations, as illustrated using three aerosol optical depth datasets from the recent Aerosol Cloud meTeorology Interactions oVer the western ATlantic Experiment (ACTIVATE). An observational-based skill score is also derived to evaluate the quality of three datasets by taking into account both error variance and correlation coefficient. Several applications are discussed and sample plotting routines are provided.

triple collocation↗

Improving Boundary Layer Data Assimilation Using Observation Data from Multiple Observing Systems in the NASA GEOS System

The Planetary Boundary Layer (PBL) is a complex interface that mediates energy and moisture exchanges between the Earth’s surface and atmosphere. Accurate simulation and observation of PBL characteristics, such as PBL height and thermodynamic structure, have proven to be a challenge. In our latest efforts, we have focused on improving PBL thermodynamic structure using data from multiple observing systems in the Goddard Earth Observing System (GEOS), developed by the NASA Global Modeling and Assimilation Office (GMAO). We present strategies and results from assimilating PBL height data derived from radiosondes, GNSS radio occultation, space-based lidar (CALIPSO, CATS, IceSat-2), ground-based lidar (MPLNET), and radar wind profilers, including a novel global PBL height analysis dataset. We also discuss the impacts of better representing capping inversions by using PBL height data together with other observations in GEOS through adjustments to the background error covariance. Long-term statistics of the impact of assimilating and utilizing PBL height data in GEOS are presented. In addition, we explore an innovative approach to assimilate GNSS-RO refractivity data in the lower troposphere.

Eun-Gyeong Yang↗

A double-loop tracking system.

A nonlinear analysis which can be used to assess certain statistical characteristics of double-loop tracking systems is presented. It takes into account the mutual coupling effects of the loops in the system. Two approaches are taken to obtain steady-state probability density functions (pdf's) of the system phase errors. From these pdf's, important system performance statistics, e.g., the phase-error variances, can be calculated, thus illustrating the application and usefulness of the analysis. The analysis is applied to a satellite transponder as an example.

Yuen, J. H.↗

LANDSAT Scene-to-scene Registration Accuracy Assessment

Initial results obtained from the registration of LANDSAT-4 data to LANDSAT-2 MSS data are documented and compared with results obtained from a LANDSAT-2 MSS-to-LANDSAT-2 scene-to-scene registration (using the same LANDSAT-2 MSS data as the base data set in both procedures). RMS errors calculated on the control points used in the establishment of scene-to-scene mapping equations are compared to error computed from independently chosen verification points. Models developed to estimate actual scene-to-scene registration accuracy based on the use of electrostatic plots are also presented. Analysis of results indicates a statistically significant difference in the RMS errors for the element contribution. Scan line errors were not significantly different. It appears that a modification to the LANDSAT-4 MSS scan mirror coefficients is required to correct the situation.

Anderson, J. E.↗

AN-A46. LANDSAT scene-to-scene registration assessment

Initial results obtained from the registration of LANDSAT-4 MSS data to LANDSAT-2 MSS data are documented and compared with results obtained from a LANDSAT-2 MSS-to-LANDSAT-2 MSS scene-to-scene registration (using the same LANDSAT-2 MSS data as the base data set in both procedures). RMS errors calculated on the control points used in the establishment of scene-to-scene mapping equations are compared to errors computed from independently chosen verification points. Models developed to estimate actual scene-to-scene registration accuracy based on the use of electrostatic plots are also presented. Analysis or results obtained indicates a statistically significant difference in the RMS errors for the element contribution. Scan line errors were not significantly different. It appears that a modification to the LANDSAT-4 MSS scan mirror coefficients is required to correct the situation.

Anderson, J. E.↗

Five-Year Wilkinson Microwave Anisotropy Probe (WMAP)Observations: Beam Maps and Window Functions

Cosmology and other scientific results from the WMAP mission require an accurate knowledge of the beam patterns in flight. While the degree of beam knowledge for the WMAP one-year and three-year results was unprecedented for a CMB experiment, we have significantly improved the beam determination as part of the five-year data release. Physical optics fits are done on both the A and the B sides for the first time. The cutoff scale of the fitted distortions on the primary mirror is reduced by a factor of approximately 2 from previous analyses. These changes enable an improvement in the hybridization of Jupiter data with beam models, which is optimized with respect to error in the main beam solid angle. An increase in main-beam solid angle of approximately 1% is found for the V2 and W1-W4 differencing assemblies. Although the five-year results are statistically consistent with previous ones, the errors in the five-year beam transfer functions are reduced by a factor of approximately 2 as compared to the three-year analysis. We present radiometry of the planet Jupiter as a test of the beam consistency and as a calibration standard; for an individual differencing assembly. errors in the measured disk temperature are approximately 0.5%.

Hill, R.S.↗

Statistical Process Control and Capability Study on the Water Content Measurements in NASA Glenn's Icing Research Tunnel

The Icing Research Tunnel (IRT) at NASA Glenn Research Center follows the recommended practice for icing tunnel calibration outlined in SAE's ARP5905 document. The calibration team has followed the schedule of a full calibration every five years with a check calibration done every six months following. The liquid water content of the IRT has maintained stability within in the specifications presented to customers that the variation is within +/- 10% of the calibrated, target measurement. With recent measurements and instrumentation errors, a more thorough assessment of error source was desired. By constructing statistical process control charts, the ability to determine how the instrument varies in the short term, mid term, and long term was gained. The control charts offer a view of instrument error, facility error, or installation changes. It was discovered that there was a shift from target to mean baseline thus leading to the study of the overall capability indices of the liquid water content measuring instrument to perform within specifications defined in the IRT. This presentation describes data processing procedures for the Multi-Element Sensor in the IRT, including collision efficiency corrections, canonical correlation analysis, Chauvenet's Criterion for rejection of data, distribution check of data, and mean, median and mode for construction of control charts. Further data is presented to describe the repeatability of the IRT with the Multi-Element Sensor and the ability to maintain a stable process for the defined calibration schedule.

Timko, Emily N.↗

New Approaches to Quantifying Transport Model Error in Atmospheric CO2 Simulations

In recent years, much progress has been made in observing CO2 distributions from space. However, the use of these observations to infer source/sink distributions in inversion studies continues to be complicated by difficulty in quantifying atmospheric transport model errors. We will present results from several different experiments designed to quantify different aspects of transport error using the Goddard Earth Observing System, Version 5 (GEOS-5) Atmospheric General Circulation Model (AGCM). In the first set of experiments, an ensemble of simulations is constructed using perturbations to parameters in the model s moist physics and turbulence parameterizations that control sub-grid scale transport of trace gases. Analysis of the ensemble spread and scales of temporal and spatial variability among the simulations allows insight into how parameterized, small-scale transport processes influence simulated CO2 distributions. In the second set of experiments, atmospheric tracers representing model error are constructed using observation minus analysis statistics from NASA's Modern-Era Retrospective Analysis for Research and Applications (MERRA). The goal of these simulations is to understand how errors in large scale dynamics are distributed, and how they propagate in space and time, affecting trace gas distributions. These simulations will also be compared to results from NASA's Carbon Monitoring System Flux Pilot Project that quantified the impact of uncertainty in satellite constrained CO2 flux estimates on atmospheric mixing ratios to assess the major factors governing uncertainty in global and regional trace gas distributions.

Ott, L.↗

Design study for future satellite microwave scatterometers, part 3

A computerized simulation analysis for a number of scatterometer antenna configuration and polarization modes including the Seasat scatterometer (SASS) is presented. The results of the simulations were expressed in terms of performance statistics. These statistics relate to the wind direction alias removal capability and to the rms sensing errors for friction velocity and wind direction X. The statistics are analyzed, and optimum scatterometer configurations are recommended. The accuracy of the SASS in measuring U* and X, and its capability to resolve wind direction aliases are assessed.

Wentz, F. J.↗

Inversion of data from diffraction-limited multiwavelength remote sensors. I - Linear case

The remote sensing inverse problem is considered in which the sensor does not necessarily view the same area on the earth at each wavelength, and spatial correlations of the geophysical parameters may be present. Under the conditions of linearity and stationary statistics, the minimum mean-square error solution to the problem of inverting such data is a spatial filter of the Wiener-Kolmogorov class. The resulting remote-sensing system can be characterized by an impulse response matrix in ordinary space or by a transfer matrix in frequency space. A signal-to-noise matrix for the geophysical parameters to be sensed is also defined; this matrix depends on the postulated a priori statistics and on the characteristics of the remote-sensing instrument. The system transfer matrix and the signal-to-noise matrix are simultaneously diagonalizable. The optimum transfer matrix filters out of the estimate vector those eigenparameters for which eigenvalues of the signal-to-noise matrix are less than unity.

Rosenkranz, P. W.↗

The effects of long delay and transmission errors on the performance of TP-4 implementations

A set of tools that allows us to measure and examine the effects of transmission delay and errors on the performance of TP-4 implementations has been developed. The tools give insight into both the large- and small-scale behaviors of an implementation. These tools have been systematically applied to a commercial implementation of TP-4. Measurements show, among other things, that a 2-second one-way transmission delay and an effective bit-error rate of 1 error per 100,000 bits can result in a 95 percent reduction in TP-4 throughput. The detailed statistics give insight into why transmission delay and errors affect this implementations so significantly and support a number of 'lessons learned' that could be applied to TP-4 implementations that operate more robustly across networks with long transmission delays and transmission errors.

Durst, Robert C.↗

Land cover analysis of James City County, Virginia

The approach used to obtain reliable countywide forest resource data, including statistics and a forest cover distribution map from LANDSAT data is described. Comparison of results of the LANDSAT anlysis and U.S. Forestry Survey data is presented in a table. Pine, oak/pine, and oak/hickory accounted for 22.3%, 32.6% and 45.2% respectively of the total forest area in the LANDSAT analysis, compared to 22.8%, 30.1%. and 47.1% in the Forest Survey. The corresponding figures for each forest type differ at most 2.5% for the mixed forest. The total county area in forest land measured using LANDSAT was underestimated by 1,409 acres, a 2.2% error based on the Forest Survey statistics. However, the estimate of 61,242 acres fell well within the known 4% uncertainty of the estimate for the Forest Survey figures (62,651 acres + or - 2,544 acres).

Copony, J. A.↗

Cosmology with EMSS Clusters of Galaxies

We use ASCA observations of the Extended Medium Sensitivity Survey sample of clusters of galaxies to construct the first z = 0.5 - 0.8 cluster temperature function. This distant cluster temperature function, when compared to local z approximately 0 and to a similar moderate redshift (z = 0.3 - 0.4) temperature function strongly constrains the matter density of the universe. Best fits to the distributions of temperatures and redshifts of these cluster samples results in Omega(sub M) = 0.45 +/- 0.1 if Lambda = 0 and Omega = 0.27 +/- 0.1 if Lambda + Omega(sub M) = 1. The uncertainties are 1sigma statistical. We examine the systematics of our approach and find that systematics, stemming mainly from model assumptions and not measurement errors, are about the same size as the statistical uncertainty +/- 0.1. In this poster proceedings, we clarify the issue of a8 as reported in our paper Donahue & Voit (1999), since this was a matter of discussion at the meeting.

Donahue, Megan↗

Implementation of an experimental program to investigate the performance characteristics of OMEGA navigation

A theoretical formulation of differential and composite OMEGA error is presented to establish hypotheses about the functional relationships between various parameters and OMEGA navigational errors. Computer software developed to provide for extensive statistical analysis of the phase data is described. Results from the regression analysis used to conduct parameter sensitivity studies on differential OMEGA error tend to validate the theoretically based hypothesis concerning the relationship between uncorrected differential OMEGA error and receiver separation range and azimuth. Limited results of measurement of receiver repeatability error and line of position measurement error are also presented.

Baxa, E. G., Jr.↗

A technique for evaluating the influence of spatial sampling on the determination of global mean total columnar ozone

A technique is described for providing a means of evaluating the influence of spatial sampling on the determination of global mean total columnar ozone. A finite number of coefficients in the expansion are determined, and the truncated part of the expansion is shown to contribute an error to the estimate, which depends strongly on the spatial sampling and is relatively insensitive to data noise. First and second order statistics are derived for each term in a spherical harmonic expansion which represents the ozone field, and the statistics are used to estimate systematic and random errors in the estimates of total ozone.

Tolson, R. H.↗

Psychophysical rating of image compression techniques

Image compression schemes abound with little work which compares their bit-rate performance based on subjective fidelity measures. Statistical measures of image fidelity, such as squared error measures, do not necessarily correspond to subjective measures of image fidelity. Most previous comparisons of compression techniques have been based on these statistical measures. A psychophysical method has been used to estimate, for a number of compression techniques, a threshold bit-rate yielding a criterion level of performance in discriminating original and compressed images. The compression techniques studied include block truncation, Laplacian pyramid, block discrete cosine transform, with and without a human visual system scaling, and cortex transform coders.

Stein, Charles S.↗