Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data quality analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Efforts to enhance reproducibility in a human performance research project

Background: Ensuring the validity of results from funded programs is a critical concern for agencies that sponsor biological research. In recent years, the open science movement has sought to promote reproducibility by encouraging sharing not only of finished manuscripts but also of data and code supporting their findings. While these innovations have lent support to third-party efforts to replicate calculations underlying key results in the scientific literature, fields of inquiry where privacy considerations or other sensitivities preclude the broad distribution of raw data or analysis may require a more targeted approach to promote the quality of research output. Methods: We describe efforts oriented toward this goal that were implemented in one human performance research program, Measuring Biological Aptitude, organized by the Defense Advanced Research Project Agency's Biological Technologies Office. Our team implemented a four-pronged independent verification and validation (IV&V) strategy including 1) a centralized data storage and exchange platform, 2) quality assurance and quality control (QA/QC) of data collection, 3) test and evaluation of performer models, and 4) an archival software and data repository. Results: Our IV&V plan was carried out with assistance from both the funding agency and participating teams of researchers. QA/QC of data acquisition aided in process improvement and the flagging of experimental errors. Holdout validation set tests provided an independent gauge of model performance. Conclusions: In circumstances that do not support a fully open approach to scientific criticism, standing up independent teams to cross-check and validate the results generated by primary investigators can be an important tool to promote reproducibility of results.

59 BASIC BIOLOGICAL SCIENCES↗

Quantitative Risk Analysis of High Safety Significant Safety-related Digital Instrumentation and Control Systems in Nuclear Power Plants using IRADIC Technology

This report documents the activities performed by Idaho National Laboratory (INL) during fiscal year (FY) 2021 for the U.S. Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) Program, Risk Informed Systems Analysis (RISA) Pathway, digital instrumentation and control (DI&C) Risk Assessment project. In FY-2019, the RISA Pathway initiated a project to develop a risk assessment strategy for delivering a strong technical basis to support effective, licensable, and secure DI&C technologies for digital upgrades/designs. An integrated risk assessment technology for the DI&C systems (IRADIC technology) was proposed for this strategy, which aims to (1) provide a best-estimate risk-informed capability to quantitatively and accurately estimate the safety margin obtained from plant modernization, especially for the High Safety Significant Safety-related (HSSSR) DI&C systems, (2) develop an advanced risk assessment technology to support transition from analog to DI&C technologies for nuclear industry, (3) assure the long-term safety and reliability of vital HSSSR DI&C systems, (4) reduce uncertainty in costs and support integration of DI&C systems in the plant. To achieve these technical goals and deal with the expensive licensing justifications from regulatory insights, the IRADIC technology is instructive for nuclear vendors and utilities to effectively lower the costs associated with digital compliance and speed industry advances by: (1) defining an integrated risk-informed analysis process for DI&C upgrade, including hazard analysis, reliability analysis, and consequence analysis, (2) applying systematic and risk-informed tools to address common cause failures (CCFs) and quantify responding failure probabilities for DI&C technologies, particularly software CCFs, (3) evaluating the impact of digital failures at the individual level, system level, and plant level, (4) providing insights and suggestions on designs to manage the risks; thus, to support the development, licensing, and deployment of advanced DI&C technologies on nuclear power plant (NPPs). In this report, an approach for performing software CCF analysis, given limited data, is developed and demonstrated using a case study of a highly redundant digital reactor trip system. Consequence analysis is also performed based on different accident scenarios. Results indicate that plant modernization including the improvement of HSSSR DI&C systems will make great benefits to plant safety by providing more safety margins to accident management. In addition, a novel approach is proposed in this report for the quantification of software hazards when sufficient operational and testing data available. The method incorporates software development quality as well as strong analysis techniques to identify and link software defects to potential failure modes. The approach includes both semantic and test-based analysis to detect failures that can exist in different stages of the software development life cycle. This method is applied to an advanced human system interface relevant to reactor trip safety developed from the APR 1400 design.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Data-Informed Synthetic Networks of Water Distribution Systems for Resilience Analysis in Puerto Rico

The increasing potential of infrastructure disruptions calls for high-quality infrastructure models to be used in resilience analysis and decision making. Unfortunately, many utilities and communities do not have access to accurate and detailed models due to a lack of data and resources. Furthermore, security restrictions on sharing infrastructure models present roadblocks to research, analysis, and decision making. Recent advances in the development of synthetic water distribution models provide a potential solution to this problem. There is an opportunity to improve these methods by leveraging incomplete pipe datasets to aid synthetic network generation. To address this gap, we developed a methodology for synthetic network generation that incorporates partial pipe data using a modification of the minimum cost flow algorithm for network generation and pipe sizing. This methodology demonstrates how partial pipe data can be leveraged to improve site-specific synthetic network generation. For the study area of Mayagüez, Puerto Rico, a synthetic model generated using 50% of real pipe data matches the pressure of the validation system with an average error of 23.5 m of head, which improves upon the average error of 31.6 m of head produced by a synthetic model generated using no data of the real pipes. Additionally, synthetic networks are shown to replicate the pressure response under a disruption scenario of the validation network, suggesting potential use in resilience analysis.

resilience analysis↗

Australian topography from Seasat overland altimetry

Retracking of overland returns from the Seasat altimeter using algorithms originally developed for recovering elevations over ice has led to the successful recovery of high quality continental topography over Australia and other continents. Cross-over analysis both before and after orbit adjustment shows the altimetric data over land to have a 2-3 m quality. Direct comparison of gridded Seasat data with surface data re-averaged in the same way shows excellent agreement except where Seasat data are sparse, due either to poor track spacing or to dropouts caused by loss of tracker lock over steeply sloping ground. These results suggest that useful topographic data can be derived from Seasat and the more recent Geosat altimeters for parts of the world where surface data are few or of poor quality.

Frey, Herbert↗

First observations from the Kr multi-monochromatic x-ray imager for time and spatially resolved diagnosis of hot implosion cores

This paper presents initial findings from the recently deployed Kr multi-monochromatic x-ray imager (Kr MMI) at the Omega laser facility. The experiment focuses on exploring implosion dynamics in exploding pusher capsules at three distinct initial gas fill densities. Utilizing time-gated and spatially integrated measurements, core size, electron temperature (Te), and electron densities (ne) are extracted through the analysis of the spectral region encompassing the Kr He α and its satellite lines. A comprehensive spectral database, incorporating atomic kinetics, spectroscopic-quality radiation transport, and Stark broadened line shapes, has been developed for rigorous data analysis. These measurements underscore the utility of the new Kr MMI instrument, which, combined with sophisticated analysis techniques, enables the diagnosis of plasma conditions at Te>2000 eV, thereby extending the capabilities beyond the prior Ar MMI design. This is an important stepping stone for achieving time-gated and space-resolved diagnostics of electron temperature, electron density, and heat transport in high temperature implosion cores.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A first-look machine analysis of ERTS-1 data

There are no author-identified significant results in this report. The preliminary analysis of a black and white image of channel 5 data together with tapes from the multispectral scanner is discussed. Four sub-projects based on the initial analysis are discussed. The sub-projects are the analysis by multispectral pattern recognition techniques of the full frame and two particular subframes and a study of the data quality. The procedures for conducting the study and the limitations in analyzing the data are examined. Methods for improving the analysis of the frames by first and second iteration are presented.

Landgrebe, D. A.↗

Flying Qualities Research Challenges

Traditional flying qualities requirements for airplane dynamics are based on airplane modal response characteristics derived from linear small-perturbation analysis. These requirements are supported by a large experimental data base. The challenge to the flying qualities community is to demonstrate how flying qualities, the control system and aircraft configuration are still closely linked. This is evident in the definition of flying qualities and, as far as pilots are concerned, that flying qualities are still the measure of overall design success.

Steven M Sliwa↗

Quality Control Methods of Tower Data at Kennedy Space Center’s Launch Complex 39-B and the USAF Cape Canaveral 500 Foot Tower

The National Aeronautics and Space Administration (NASA) has long used meteorological data from weather towers located at Kennedy Space Center (KSC) and the United States Air Force’s Eastern Range(ER) in support of their various launch vehicles and climate studies. Some of the most valuable data is gathered at the Launch Complex 39-B (LC39-B) and the 500 foot tower located approximately two miles west of LC39-B and three miles north of the Vehicle Assembly Building (VAB). The data from LC39-B gives NASA Space Launch System (SLS) engineers valuable insight into the weather the vehicle can expect at the pad, while the 500 foot tower has a longer period of record and has been used by the Shuttle and SLS programs. However, numerous data quality (DQ) control issues have arisen when utilizing this data for analysis. In addition, instrumentation tends to deteriorate faster than normal due to the corrosive nature of the high salt content in the air. NASA’s Natural Environments branch has developed several QC databases of these towers, but these studies were for fixed periods of records. EV44 identified a need for a continually updated and QC’ed database of tower data not only to provide along term QC’ed database for vehicle and climate analyses, but also to provide the capability to investigate recent weather events such as downbursts and other high wind events. This study follows the methods developed in prior Natural Environment QC tower databases, which includes variable specific QC thresholds and checks used to generate QC flags. However, this study developed new techniques such as the development and design of the graphical user interface (GUI) for manual verification, and the creation of the final monthly QC files.

Quality Control↗

Continental Scale Aerosol Optical Properties Over East Asia as Measured by Aeronet and Comparison to Satellite and Modeled Results

The AERONET program has operated in E. Asia since 1995 providing time continuous and time averaged ground-based column-integrated aerosol optical properties in a variety of aerosol regimes In the last four years the distribution has greatly increased in Siberia, China, SE Asia and India in particular. Commensurate with that, significant improvement in data processing algorithms (Version 2.0) and access to ancillary data products through the WWW have become available to the scientific community. At this writing the following distribution represents E and S. Asia: 5 sites operate in Siberia (2 years), 1 in Mongolia (9 years), 3 in Korea (3 to 6 years), 3 in Japan (2 to 7 years), China 11 (6 to 0 years), Taiwan 4 (7 to 2 yrs), Viet Nam 2 (4 years), Thailand 2 to 5 (4 years), and Singapore 1 (4 months), India 1 to 3 (7 to 1 years), Pakistan 2 (1 year), and UAE 3 (3 years). An analysis of the aerosol optical depth at 500 nm using annual average quality assured AERONET data (pre 2006) was used to estimate the mean annual aerosol loading by continent, sub continent and ocean. The individual site data were assumed representative of regional aerosol loading and aggregated to the sub-continental, continental and oceanic areas and presented. This analysis will be updated with more recent data with particular emphasis on seasonal results for Asia and the addition of single scattering albedo retrievals. The ground based results will be compared to MODIS collection 5 results and model estimates for E. Asia using the AERONET Synergy Tool.

Holben, B. N.↗

Electrical Energy Storage Data Submission Guidelines

Energy storage technologies are positioned to play a substantial role in power delivery systems. They are being touted as an effective new resource to maintain reliability and allow for increased penetration of renewable energy. However, due to their relative infancy, there is a lack of knowledge on how these resources truly operate over time. Data analysis can help ascertain the operational and performance characteristics of these emerging technologies. Rigorous testing and data analysis are important for all stakeholders to ensure a safe, reliable system that performs predictably on a macro level. Standardizing testing and analysis approaches to verifying the performance of energy storage devices, equipment, and systems when integrating them into the grid will improve the understanding and benefit of energy storage over time from technical and economic vantage points. Demonstrating the life-cycle value and capabilities of energy storage systems begins with the data the provider supplies for analysis. After review of energy storage data received from several providers, it has become clear that some of these data are inconsistent and incomplete, raising the question of their efficacy for robust analysis. This report reviews and proposes general guidelines such as sampling rates and data points that providers must supply for robust data analysis to take place. Consistent guidelines are the basis of the proper protocol and ensuing standards to (a) reduce the time it takes data to reach those who are providing analysis; (b) allow them to better understand the energy storage installations; and (c) enable them to provide high-quality analysis of the installations. This report is intended to serve as a starting point for what data points should be provided when monitoring. As battery technologies continue to advance and the industry expands, this report will be updated to remain current.

25 ENERGY STORAGE↗

Selection of a map grid for data analysis and archival

Arguments for selection of a map grid are reiterated by illustrating the quantitative effects on data quality caused by using different grids. It is shown that the use of the rectangular latitude-longitude grid actually degrades data quality, increases stored data volume, and increases the complexity of data manipulation. Use of an equal-area grid is shown to be a proper way to aggregate data, but such grids are thought to be inconvenient. A solution to this dilemma is proposed by showing that the analysis and archival map grids need not be the same. The results of a proper analysis of the data on an equal-area grid can be remapped to the more 'convenient' rectangular latitude-longitude grid without loss of quality.

Rossow, W. B.↗

Temporal RNA Integrity Analysis of Archived Spaceflight Biological Samples from ALSDA from 1991 to 2016

The purpose of this study is to assess the quality of spaceflight tissues stored in Ames Life Science Data Archive (ALSDA) freezers. Garnering information for downstream functional analysis such as generation of omics datasets from tissues is, in part, dependent on the state of sample preservation. To assess the viability of a select group of tissues, RNA integrity number (RIN) values were calculated for RNA extracted from rodent livers. Rat livers from Spacelab Life Sciences 1 (SLS-1) and mouse livers from Commercial Biomedical Test Module 3 (CBTM-3), Rodent Research 1 (RR1), and Rodent Research 3 (RR3) were tested. It was found that mean RIN values from CBTM3, RR1, and RR3 were suitable for downstream functional analysis (RIN greater than 5) while the mean RIN value for SLS-1 was not (RIN equal to 2.5 plus or minus 0.1). Information from this study could lay the foundation for future efforts in determining the types of assays that are most appropriate for different tissues in ALSDA freezers, which would maximize the scientific return on rare spaceflight samples.

ALSDA↗

Gaussian maximum likelihood and contextual classification algorithms for multicrop classification experiments using thematic mapper and multispectral scanner sensor data

The paper presents the results of a four-factor two-level analysis of a variance experiment designed to evaluate the combined effect of the improved quality of remote-sensor data and the use of context by the classifier on classification accuracy. The improvement achievable by using the context via relaxation techniques is significantly smaller than that provided by an increase of the radiometric resolution of the sensor from 6 to 8 bits per sample (the relative increase in radiometric resolution of TM relative to MSS). It is almost equal to that achievable by an increase in the spectral coverage as provided by TM relative to MSS.

Di Zenzo, Silvano↗

Material Properties Analysis of Structural Members in Pumpkin Balloons

The efficient design, service-life qualification, and reliability predictions for lightweight aerospace structures require careful mechanical properties analysis of candidate structural materials. The demand for high-quality laboratory data is particularly acute when the candidate material or the structural design has little history. The pumpkin-shaped super-pressure balloon presents both challenges. Its design utilizes load members (tendons) extending from apex to base around the gas envelope to achieve a lightweight structure. The candidate tendon material is highly weight-efficient braided HM cord. Previous mechanical properties studies of Zylon have focused on fiber and yarn, and industrial use of the material in tensile applications is limited. For high-performance polymers, a carefully plamed and executed properties analysis scheme is required to ensure the data are relevant to the desired application. Because no directly-applicable testing standard was available, a protocol was developed based on guidelines fiom professional and industry organizations. Due to the liquid-crystalline nature of the polymer, the cord is very stiff, creeps very little, and does not yield. Therefore, the key material property for this application is the breaking strength. The pretension load and gauge length were found to have negligible effect on the measured breaking strength over the ranges investigated. Strain rate was found to have no effect on breaking strength, within the range of rates suggested by the standards organizations. However, at the lower rate more similar to ULDB operations, the strength was reduced. The breaking strength increased when the experiment temperature was decreased from ambient to 183K which is the lowest temperature ULDB is expected to experience. The measured strength under all test conditions was well below that resulting from direct scale-up of fiber strength based on the manufacturers data. This expected result is due to the effects of the braiding process and material ageing.

Sterling, W. J.↗

Data compression for data archival, browse or quick-look

Soon after space and Earth science data is collected, it is stored in one or more archival facilities for later retrieval and analysis. Since the purpose of the archival process is to keep an accurate and complete record of data, any data compression used in an archival system must be lossless, and protect against propagation of error in the storage media. A browse capability for space and Earth science data is needed to enable scientists to check the appropriateness and quality of particular data sets before obtaining the full data set(s) for detailed analysis. Browse data produced for these purposes could be used to facilitate the retrieval of data from an archival facility. Quick-look data is data obtained directly from the sensor for either previewing the data or for an application that requires very timely analysis of the space or Earth science data. Two main differences between data compression techniques appropriate to browse and quick-look cases, are that quick-look can be more specifically tailored, and it must be limited in complexity by the relatively limited computational power available on space platforms.

Dozier, Jeff↗

A Bayesian approach to evaluation of soil biogeochemical models

Abstract. To make predictions about the carbon cycling consequences of rising global surface temperatures, Earth system scientists rely on mathematical soil biogeochemical models (SBMs). However, it is not clear which models have better predictive accuracy, and a rigorous quantitative approach for comparing and validating the predictions has yet to be established. In this study, we present a Bayesian approach to SBM comparison that can be incorporated into a statistical model selection framework. We compared the fits of linear and nonlinear SBMs to soil respiration data compiled in a recent meta-analysis of soil warming field experiments. Fit quality was quantified using Bayesian goodness-of-fit metrics, including the widely applicable information criterion (WAIC) and leave-one-out cross validation (LOO). We found that the linear model generally outperformed the nonlinear model at fitting the meta-analysis data set. Both WAIC and LOO computed higher overfitting risk and effective numbers of parameters for the nonlinear model compared to the linear model, conditional on the data set. Goodness of fit for both models generally improved when they were initialized with lower and more realistic steady-state soil organic carbon densities. Still, testing whether linear models offer definitively superior predictive performance over nonlinear models on a global scale will require comparisons with additional site-specific data sets of suitable size and dimensionality. Such comparisons can build upon the approach defined in this study to make more rigorous statistical determinations about model accuracy while leveraging emerging data sets, such as those from long-term ecological research experiments.

54 ENVIRONMENTAL SCIENCES↗

Floating Potential Measurement Unit (FPMU) Data Processing Algorithm Development and Analysis Assessment

The NASA Engineering and Safety Center (NESC) was requested to provide space plasma instrumentation data analysis expertise in support of Floating Potential Measurement Unit (FPMU) data analysis and data processing algorithm development. Subject matter expertise was requested to support modification of FPMU data processing algorithms to account for aging of the FPMU instrument suite, improve the science quality of the FPMU data sets that are made available to the science community, and provide analysis of FPMU data for complex spacecraft orientation and geophysical situations. This document contains the results of the NESC assessment.

Floating Potential Measurement Unit↗

Design, execution, and interpretation of plant RNA-seq analyses

Genomics has transformed our understanding of the genetic architecture of traits and the genetic variation present in plants. Here, we present a review of how RNA-seq can be performed to tackle research challenges addressed by plant sciences. We discuss the importance of experimental design in RNA-seq, including considerations for sampling and replication, to avoid pitfalls and wasted resources. Approaches for processing RNA-seq data include quality control and counting features, and we describe common approaches and variations. Though differential gene expression analysis is the most common analysis of RNA-seq data, we review multiple methods for assessing gene expression, including detecting allele-specific gene expression and building co-expression networks. With the production of more RNA-seq data, strategies for integrating these data into genetic mapping pipelines is of increased interest. Finally, special considerations for RNA-seq analysis and interpretation in plants are needed, due to the high genome complexity common across plants. By incorporating informed decisions throughout an RNA-seq experiment, we can increase the knowledge gained.

59 BASIC BIOLOGICAL SCIENCES↗