Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Missing data problem”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Human factors in aviation operations: The hearback problem

This report covers a study of ASRS reports wherein ATC controllers failed to monitor adequately (hearback) incorrect readbacks of ATC clearances. A total of 417 reports received over a period of 29 months from April 1981 through July 1983 comprised the study data set. Factors examined were: the reasons for a flight crew's getting clearances incorrectly, the operating factors that caused controllers to mishear or not hear the correct readbacks, and consequences of the various types of hearback misses. The principle conclusion of the study takes the form of a precaution to flight crews that a controller's not challenging a readback does not necessariliy mean the readback is correct and that flight crews must explicitly question any doubtful or unusual aspects of clearances rather than depending on controllers to detect readback errors.

Monan, William P.↗

Earth Radiation Imbalance from a Constellation of 66 Iridium Satellites: Climate Science Aspects

The "global warming hiatus" since the 1998 El Nino, highlighted by Meehl et al., and the resulting "missing energy" problem highlighted by Trenberth et al., has opened the door to a more fundamental view of climate change than mere surface air temperature. That new view is based on two variables which are strongly correlated: the rate of change of ocean heat content d(OHC)/dt; and Earth Radiation Imbalance (ERI) at the top of the atmosphere, whose guesstimated range is 0.4 to 0.9 Watts per square meters (this imbalance being mainly due to increasing CO2). The Argo float array is making better and better measurements of OHC. But existing satellite systems cannot measure ERI to even one significant digit. So, climate model predictions of ERI are used in place of real measurements of it, and the satellite data are tuned to the climate model predictions. Some oceanographers say "just depend on Argo for understanding the global warming hiatus and the missing energy", but we don't think this is a good idea because d(OHC)/dt and ERI have different time scales and are never perfectly correlated. We think the ERB community needs to step up to measuring ERI correctly, just as oceanographers have deployed Argo to measure OHC correctly. This talk will overview a proposed constellation of 66 Earth radiation budget instruments, hosted on Iridium satellites, that will actually be able to measure ERI to at least one significant digit, thus enabling a crucial test of climate models. This constellation will also be able to provide ERI at two-hourly time scales and 500-km spatial scales without extrapolations from uncalibrated narrowband geostationary instruments, using the highly successful methods of GRACE to obtain spatial resolution. This high time resolution would make ERI a synoptic variable like temperature, and allow studies of ERI's response to fast-evolving phenomena like dust storms and hurricanes and even brief excursions of Total Solar Irradiance. Time permitting, we will also discuss the emerging view of clear vs. cloudy and its implications for the traditional ERB approach.

Wiscombe, W.↗

Covariance Realism Is Not Enough

A great deal of effort has been put into improving the practice of space situational awareness such that covariance data associated with predicted close approaches is more “realistic.” However, “realistic” usually has meant “larger” and this presents a problem. In many cases, there exist multiple sources for predictive ephemerides, which may be fused to produce predictive states with smaller associated covariances. Ancillary to the fusion computation is the capability to assess consistency of the estimates. If actionable covariance information becomes available, interval estimates for the miss distance provide a more informative alternative to collision probability for risk assessment.

Carpenter, J. Russell↗

Paradigm Shift in Data Content and Informatics Infrastructure Required for Generalized Constitutive Modeling of Materials Behavior

Materials property information such as composition and thermophysical/mechanical properties abound in the literature. Oftentimes, however, the corresponding response curves from which these data are determined are missing or at the very least difficult to retrieve. Further, the paradigm for collecting materials property information has historically centered on (1) properties for materials comparison/selection purposes and (2) input requirements for conventional design/analysis methods. However, just as not all materials are alike or equal, neither are all constitutive models (and thus design/ analysis methods) equal; each model typically has its own specific and often unique required materials parameters, some directly measurable and others indirectly measurable. Therefore, the type and extent of materials information routinely collected is not always sufficient to meet the current, much less future, needs of the materials modeling community. Informatics has been defined as the science concerned with gathering, manipulating, storing, retrieving, and classifying recorded information. A key aspect of informatics is its focus on understanding problems and applying information technology as needed to address those problems. The primary objective of this article is to highlight the need for a paradigm shift in materials data collection, analysis, and dissemination so as to maximize the impact on both practitioners and researchers. Our hope is to identify and articulate what constitutes "sufficient" data content (i.e., quality and quantity) for developing, characterizing, and validating sophisticated nonlinear time- and history-dependent (hereditary) constitutive models. Likewise, the informatics infrastructure required for handling the potentially massive amounts of materials data will be discussed.

Arnold, S. M.↗

Full Life-Cycle Defect Management Assessment: Initial Inspection Data Collection Results and Research Questions for Further Study

It is often the case in software projects that when schedule and budget resources are limited, the Verification and Validation (V&V) activities suffer. Fewer V&V activities can be afforded and moreover, short-term challenges can result in V&V activities being scaled back or dropped altogether. As a result, too often the default solution is to save activities for improving software quality until too late in the life-cycle, relying on late-term code inspections followed by thorough testing activities to reduce defect counts to acceptable levels. As many project managers realize, however, this is a resource-intensive way of achieving the required quality for software. The Full Life-cycle Defect Management Assessment Initiative, funded by NASA s Office of Safety and Mission Assurance under the Software Assurance Research Program, aims to address these problems by: Improving the effectiveness of early life-cycle V&V activities to make their benefits more attractive to team leads. Specifically, we focus on software inspection, a proven method that can be applied to any software work product, long before executable code has been developed; Better communicating this effectiveness to software development teams, along with suggestions for parameters to improve in the future to increase effectiveness; Analyzing the impact of early life-cycle V&V on the effectiveness and cost required for late life-cycle V&V activities, such as testing, in order to make the tradeoffs more apparent. This white paper reports on an initial milestone in this work, the development of a preliminary model of inspection effectiveness across multiple NASA Centers. This model contributes toward reaching our project goals by: Allowing an examination of inspection parameters, across different types of projects and different work products, for an analysis of factors that impact defect detection effectiveness. Allowing a comparison of this NASA-specific model to existing recommendations in the literature regarding how to plan effective inspections. Forming a baseline model which can be extended to incorporate factors describing: the numbers and types of defects that are missed by inspections; how such defects flow downstream through software development phases; how effectively they can be caught by testing activities in the late stages of development. The model has been implemented in a prototype web-enabled decision-support tool which allows developers to enter their inspection data and receive feedback based on a comparison against the model. The tool also allows users to access reusable materials (such as checklists) from projects included in the baseline. Both the tool itself and the model underlying it will continue to be extended throughout the remainder of this initiative. As results of analyzing inspection effectiveness for defect containment are determined, they can be shared via the tool and also via updates to existing training courses on metrics and software inspections. Moreover, the tool will help satisfy key CMMI requirements for the NASA Centers, as it will enable NASA to take a global view across peer review results for various types of projects to identify systemic problems. This analysis can result in continuous improvements to the approach to verification.

Shull, Forrest↗

Design for Vibration Monitoring: A Methodology for Reliable and Cost-Effective Vibration Monitoring

The purpose of health monitoring systems is to detect failures or defects for increased safety and performance and to provide on-condition maintenance with reduced costs. The problems associated with health monitoring systems include high rates of false alarms and missed failures, which make monitoring an unreliable and costly task. The reason for this is that unaccounted variations invalidate signal modeling assumptions. Our approach was to focus on vibration monitoring of rotating components. We analyzed baseline signals to determine statistical variations, identify and model factors that influence vibrations (pre-production vs. post-production variations), determine hit and false alarm rates with baseline flight data, model and predict effects of defects and variations on vibrations, and develop algorithms and metrics for failure and anomaly detection in the presence of variations.

Tumer, Irem Y.↗

MLtool: Universal Supervised Machine Learning Tool to Model Tabulated Data

Machine Learning (ML) is a subfield of Artificial Intelligence that gives computers the ability to learn from past data without being explicitly programmed. The predictive capabilities of ML models have already been used to facilitate several scientific breakthroughs. However, the practical application of ML is often limited due to the gaps in technical knowledge of its users. The common issue faced by many scientific researchers is the inability to choose the appropriate ML pipelines that are needed to treat real-world data, which is often sparse and noisy. To solve this problem, we have developed an automated Machine Learning tool (MLtool) that includes a set of ML algorithms and approaches to aid scientific researchers. The current version of MLtool is implemented as an object-oriented Python code that is easily extensible. It includes 44 different regression algorithms used to model data. MLtool helps users select the best model for their data, based on the scoring metrics used. Besides regression algorithms, MLtool also includes a suite of pre- and post-processing techniques such as missing value imputation, categorical variable encoding, input feature normalization, uncertainty quantification, exploratory data analysis (EDA), etc. MLtool was tested on several publicly available multi-dimensional data sets and was found capable of making accurate predictions.

Machine learning↗

MLtool Python Code

Machine Learning (ML) is a subfield of Artificial Intelligence that gives computers the ability to learn from past data without being explicitly programmed. The predictive capabilities of ML models have already been used to facilitate several scientific breakthroughs. However, the practical application of ML is often limited due to the gaps in technical knowledge of its users. The common issue faced by many scientific researchers is the inability to choose the appropriate ML pipelines that are needed to treat real-world data, which is often sparse and noisy. To solve this problem, we have developed an automated Machine Learning tool (MLtool) that includes a set of ML algorithms and approaches to aid scientific researchers. The current version of MLtool is implemented as an object-oriented Python code that is easily extensible. It includes 44 different regression algorithms used to model data. MLtool helps users select the best model for their data, based on the scoring metrics used. Besides regression algorithms, MLtool also includes a suite of pre- and post-processing techniques such as missing value imputation, categorical variable encoding, input feature normalization, uncertainty quantification, exploratory data analysis (EDA), etc. MLtool was tested on several publicly available multi-dimensional data sets and was found capable of making accurate predictions.

Machine Learning↗

Tuning a variational autoencoder for data accountability problem in the Mars Science Laboratory ground data system

The Mars Curiosity rover is frequently sending back engineering and science data that goes through a pipeline of systems before reaching its final destination at the mission operations center making it prone to volume loss and data corruption. A ground data system analysis (GDSA) team is charged with the monitoring of this flow of information and the detection of anomalies in that data in order to request a re-transmission when necessary. This work presents ∆-MADS, a derivative-free optimization method applied for tuning the architecture and hyperparameters of a variational autoencoder trained to detect the data with missing patches in order to assist the GDSA team in their mission.

Lakhmiri, Dounia↗

Reference Images from Thin Sections of Lunar Regolith

The specialist literature about the lunar regolith is massive. It is also highly focused on specific topics and effectively impenetrable to most non-geologists. Both characteristics of the literature present substantial hurdles to scientists and engineers interested in the regolith In the author's experience it neither surprising or unusual to find serious misconceptions about lunar-type materials outside of the lunar research community. Education of professionals who are non-geologists but interested in the regolith is impeded by a lack of some basic resources. One asset that has been missing is simply detailed images of the regolith "soil". While a few websites offer imagery of specific features, these are of course selected to illustrate specific features. It is almost impossible for a non-specialist to reason from these what "normal" or "typical" regolith looks like. Further, access to lunar material is highly restricted. And as publications rarely do not provide other than highly focused and narrowly tailored data, there is little potential for workers without personal access to sample to do any work with lunar material. To address both problems the authors have begun to make high resolution optical micrographs of entire thin sections of lunar regolith.

Rickman Doug↗

Synthetic Foveal Imaging Technology

Synthetic Foveal imaging Technology (SyFT) is an emerging discipline of image capture and image-data processing that offers the prospect of greatly increased capabilities for real-time processing of large, high-resolution images (including mosaic images) for such purposes as automated recognition and tracking of moving objects of interest. SyFT offers a solution to the image-data processing problem arising from the proposed development of gigapixel mosaic focal-plane image-detector assemblies for very wide field-of-view imaging with high resolution for detecting and tracking sparse objects or events within narrow subfields of view. In order to identify and track the objects or events without the means of dynamic adaptation to be afforded by SyFT, it would be necessary to post-process data from an image-data space consisting of terabytes of data. Such post-processing would be time-consuming and, as a consequence, could result in missing significant events that could not be observed at all due to the time evolution of such events or could not be observed at required levels of fidelity without such real-time adaptations as adjusting focal-plane operating conditions or aiming of the focal plane in different directions to track such events. The basic concept of foveal imaging is straightforward: In imitation of a natural eye, a foveal-vision image sensor is designed to offer higher resolution in a small region of interest (ROI) within its field of view. Foveal vision reduces the amount of unwanted information that must be transferred from the image sensor to external image-data-processing circuitry. The aforementioned basic concept is not new in itself: indeed, image sensors based on these concepts have been described in several previous NASA Tech Briefs articles. Active-pixel integrated-circuit image sensors that can be programmed in real time to effect foveal artificial vision on demand are one such example. What is new in SyFT is a synergistic combination of recent advances in foveal imaging, computing, and related fields, along with a generalization of the basic foveal-vision concept to admit a synthetic fovea that is not restricted to one contiguous region of an image.

Hoenk, Michael↗

Aerosol Direct Radiative Effect at the Top of the Atmosphere Over Cloud Free Ocean Derived from Four Years of MODIS Data

A four year record of MODIS spaceborne data provides a new measurement tool to assess the aerosol direct radiative effect at the top of the atmosphere. MODIS derives the aerosol optical thickness and microphysical properties from the scattered sunlight at 0.55-2.1 microns. The monthly MODIS data used here are accumulated measurements across a wide range of view and scattering angles and represent the aerosol s spectrally resolved angular properties. We use these data consistently to compute with estimated accuracy of +/-0.6W/sq m the reflected sunlight by the aerosol over global oceans in cloud free conditions. The MODIS high spatial resolution (0.5 km) allows observation of the aerosol impact between clouds that can be missed by other sensors with larger footprints. We found that over the clear-sky global ocean the aerosol reflected 5.3+/-0.6W/sq m with an average radiative efficiency of 49+/-2W/sq m per unit optical thickness. The seasonal and regional distribution of the aerosol radiative effects are discussed. The analysis adds a new measurement perspective to a climate change problem dominated so far by models.

Remer, L. A.↗

Optical Coatings and Surfaces in Space: MISSE

The space environment presents some unique problems for optics. Components must be designed to survive variations in temperature, exposure to ultraviolet, particle radiation, atomic oxygen and contamination from the immediate environment. To determine the importance of these phenomena, a series of passive exposure experiments have been conducted which included, among others, the Long Duration Exposure Facility (LDEF, 1985- 1990), the Passive Optical Sample Assembly (POSA, 1996- 1997) and most recently, the Materials on the International Space Station Experiment (MISSE, 2001 - 2005). The MISSE program benefited greatly from past experience so that at the conclusion of this 4 year mission, samples which remained intact were in remarkable condition. This study will review data from different aspects of this experiment with emphasis on optical properties and performance.

Stewart, Alan F.↗

Computational Bayesian Methods Applied to Complex Problems in Bio and Astro Statistics

In this dissertation we apply computational Bayesian methods to three distinct problems. In the first chapter, we address the issue of unrealistic covariance matrices used to estimate collision probabilities. We model covariance matrices with a Bayesian Normal-Inverse-Wishart model, which we fit with Gibbs sampling. In the second chapter, we are interested in determining the sample sizes necessary to achieve a particular interval width and establish non-inferiority in the analysis of prevalences using two fallible tests. To this end, we use a third order asymptotic approximation. In the third chapter, we wish to synthesize evidence across multiple domains in measurements taken longitudinally across time, featuring a substantial amount of structurally missing data, and fit the model with Hamiltonian Monte Carlo in a simulation to analyze how estimates of a parameter of interest change across sample sizes.

Elrod, Chris↗

Method for Identifying Probable Archaeological Sites from Remotely Sensed Data

Archaeological sites are being compromised or destroyed at a catastrophic rate in most regions of the world. The best solution to this problem is for archaeologists to find and study these sites before they are compromised or destroyed. One way to facilitate the necessary rapid, wide area surveys needed to find these archaeological sites is through the generation of maps of probable archaeological sites from remotely sensed data. We describe an approach for identifying probable locations of archaeological sites over a wide area based on detecting subtle anomalies in vegetative cover through a statistically based analysis of remotely sensed data from multiple sources. We further developed this approach under a recent NASA ROSES Space Archaeology Program project. Under this project we refined and elaborated this statistical analysis to compensate for potential slight miss-registrations between the remote sensing data sources and the archaeological site location data. We also explored data quantization approaches (required by the statistical analysis approach), and we identified a superior data quantization approached based on a unique image segmentation approach. In our presentation we will summarize our refined approach and demonstrate the effectiveness of the overall approach with test data from Santa Catalina Island off the southern California coast. Finally, we discuss our future plans for further improving our approach.

Tilton, James C.↗

GMI-IPS: Processing & Visualization Software Used in ATom DC-8 Aircraft Studies

NASA's Atmospheric Tomography Mission (ATom) deployed in each of the four seasons during 2016-2018, the DC-8 aircraft in order to establish global-scale datasets intended to improve the representation of chemically reactive gases in global atmospheric chemistry models (ACMs). The Global Modeling Initiative (GMI) executed simulations for each ATom flight using the GMI Chemistry Transport Model (GMI-CTM) to provide species concentrations of chemical gases along the DC-8 flight transects. To solve the problem of translating the GMI-CTM simulation data to the unique spatial resolutions of each ATom flight, the GMI ICARTT Processing Software (GMI-IPS) was developed.The GMI-IPS is written in Python and provides data processing, flight extraction, and visualization support for aircraft research projects using ICARTT format, which is a standard format for airborne instrument data. Additionally, the GMI-IPS interpolates global gridded model data from Hierarchical Data Format (HDF) to ICARTT compatible flight transects. Software classes for instruments and collections provided by the ATom DC-8 aircraft such as MER10, MMS, etc. are derived from a common base class. Other functionality provided by the GMI-IPS are: deriving missing flight entries along a transect, reading ICARTT entries from file, and providing Python data structures for storing flight and model information, and more.The GMI-IPS is GIT source controlled, has approximately 30,000 lines of code, and supports parallelization across data collections. It delivered GMI-CTM data for more than forty distinct DC-8 aircraft flights that took place under ATom. The output ICARTT files adhere to format standard V1.1, and pass the scan utility provided by NASA LaRC Airborne Science Data for Atmospheric Composition. This presentation will include a software and methods overview, and results from ATom, including assessments using the GMI-CTM showing how well observations from ATom flight transects represent a broader region.

Damon, M. R.↗

Learning from Automation Surprises and "Going Sour" Accidents: Progress on Human-Centered Automation

Advances in technology and new levels of automation on commercial jet transports has had many effects. There have been positive effects from both an economic and a safety point of view. The technology changes on the flight deck also have had reverberating effects on many other aspects of the aviation system and different aspects of human performance. Operational experience, research investigations, incidents, and occasionally accidents have shown that new and sometimes surprising problems have arisen as well. What are these problems with cockpit automation, and what should we learn from them? Do they represent over-automation or human error? Or instead perhaps there is a third possibility - they represent coordination breakdowns between operators and the automation? Are the problems just a series of small independent glitches revealed by specific accidents or near misses? Do these glitches represent a few small areas where there are cracks to be patched in what is otherwise a record of outstanding designs and systems? Or do these problems provide us with evidence about deeper factors that we need to address if we are to maintain and improve aviation safety in a changing world? How do the reverberations of technology change on the flight deck provide insight into generic issues about developing human-centered technologies and systems (Winograd and Woods, 1997)? Based on a series of investigations of pilot interaction with cockpit automation (Sarter and Woods, 1992; 1994; 1995; 1997a, 1997 b), supplemented by surveys, operational experience and incident data from other studies (e.g., Degani et al., 1995; Eldredge et al., 1991; Tenney et al., 1995; Wiener, 1989), we too have found that the problems that surround crew interaction with automation are more than a series of individual glitches. These difficulties are symptoms that indicate deeper patterns and phenomena concerning human-machine cooperation and paths towards disaster. In addition, we find the same kinds of patterns behind results from studies of physician interaction with computer-based systems in critical care medicine (e.g., Moll van Charante et al., 1993; Obradovich and Woods, 1996; Cook and Woods, 1996). Many of the results and implications of this kind of research are synthesized and discussed in two comprehensive volumes, Billings (1996) and Woods et al. (1994). This paper summarizes the pattern that has emerged from our research, related research, incident reports, and accident investigations. It uses this new understanding of why problems arise to point to new investment strategies that can help us deal with the perceived "human error" problem, make automation more of a team player, and maintain and improve safety.

Woods, David D.↗

Astro - Science in the fast lane

The Space Shuttle mission devoted to astronomy (Astro) is described and data obtained during the nine-day flight are briefly reviewed. The Wisconsin Ultraviolet Photo-Polarimeter Experiment reveals a trough at 2200 A in the spectrum of Alpha Camelopardalis. It is suggested that the 2200-A feature is caused by absorption by graphite-rich interstellar dust. The Broad Band X-ray Telescope made it possible to study the NGC 1399 X-ray spectrum, the spectrum of the BL Lacertae object PKS 2155-304, and a cooling flow in a cluster of galaxies. The Astro mission's search for the missing mass in the form of neutrinos is discussed. Attention is also given to the effect of delays on the Astro activity, and to equipment problems and how they were solved.

Maran, Stephen P.↗