Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Real Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,585 records · Page 88

Verification, Validation, and Calibration Through a Causal Lens

While typical validation and verification approaches focus on identifying the associations between data elements using statistical and machine learning methods, the novel methods in this paper focus instead on identifying causal relationships between data elements. Statistical and machine-learning-based approaches are strictly data-driven, meaning that they provide quantitative comparison measures between data sets without explicitly considering the hypotheses behind them. This can lead to the erroneous conclusion that, if two data sets are close enough, the models that generated them are similar. In addition, when experimental and simulated data differ to an extent that fails to meet the acceptance criteria, calibration techniques are used to tweak simulation model parameters to reduce the gap between the two types of data. This produces the false expectation that a simulation model will match reality. The methods presented in this paper move away from these strictly data-driven methods for validation and calibration toward more robust, model-driven methods based on causal inference. Causal inference aims to identify the possible mechanisms that might have generated data. Thus, this analysis targets the prediction of the effects when one (or more) of the identified mechanisms are altered. There are many approaches to identify, quantify, and illustrate causal relationships. For the scope of this paper, directed graphs are employed as causal models. If the directed graph lacks cycles, it is known as a directed acyclic graph. A node in such a graph represents an observed data element while a directed edge connecting two nodes represents a causal relationship between two variables. The developed causal methods are designed to extract causal models from simulation models and experimental data. Causal models capture the causal relationships between data elements (e.g., simulated and experimental data). In this context, validation and verification are performed by comparing causal models. The proposed approach does not only inform system analysts on how a simulation model matches real-world data, but also identifies elements of the simulation model that should be revised when discrepancies between simulation and experimental data are observed. Through these causal methods, analysts can identify the portion of the model equation(s) that are behind an edge connecting two variables. Hence, once the structural differences between causal models have been determined, model calibration can occur by changing only those model parameters that impact the identified causal relationships.

97 MATHEMATICS AND COMPUTING↗

VALIDATION, VERIFICATION, AND CALIBRATION THROUGH A CAUSAL LENS

This paper presents an alternative method based on causal inference to perform validation, verification, and calibration of simulation models. While classical validation and verification approaches focus on the identification of the associations between data elements using statistical and machine learning methods, the novel methods in this paper focus instead on the identification of causal relationships between data elements. Statistical and machine learning-based approaches are strictly data-driven, meaning that they provide quantitative comparison measures between datasets without explicitly considering the hypotheses behind them. This can lead to the erroneous conclusion that, if two data sets are close enough, then the models that generated them are similar. In addition, when experimental and simulated data differ to an extent that fails to meet the acceptance criteria, calibration techniques are used to tweak simulation model parameters to reduce the gap between the two types of data. This produces the false expectation that a simulation model will match reality. The methods presented in this paper move away from these strictly data-driven methods for validation and calibration toward more robust, model-driven methods based on causal inference. Causal inference aims to identify the possible mechanisms that might have generated data. Thus, this analysis targets the prediction of the effects when one (or more) of the identified mechanisms are altered. There are many approaches to identify, quantify and illustrate causal relationships. For the scope of this paper, directed graphs are employed as causal models. If the directed graph lacks cycles it is known as a directed acyclic graph (DAG). A node in such a graph represents an observed data element while a directed edge connecting two nodes represents a causal relationship between two variables. The developed causal methods are designed to extract causal models from simulation models and from experimental data. Causal models capture the causal relationships between data elements (e.g., simulated and experimental data). In this context, validation and verification are performed by comparing causal models. The proposed approach does not only inform system analysts on how a simulation model matches real-world data, but also identifies elements of the simulation model that should be revised when discrepancies between simulation and experimental data are observed. Through these causal methods, analysts have a means to identify the portion of the model equation(s) that are behind an edge connecting two variables. Hence, once the structural differences between causal models have been determined, model calibration can occur by changing only those model parameters that impact the identified causal relationships.

97 MATHEMATICS AND COMPUTING↗

The compressed state Kalman filter for nonlinear state estimation: Application to large-scale reservoir monitoring

Reservoir monitoring aims to provide snapshots of reservoir conditions and their uncertainties to assist operation management and risk analysis. These snapshots may contain millions of state variables, e.g., pressures and saturations, which can be estimated by assimilating data in real time using the Kalman filter (KF). However, the KF has a computational cost that scales quadratically with the number of unknowns, m, due to the cost of computing and storing the covariance and Jacobian matrices, along with their prod-ucts. The compressed state Kalman filter (CSKF) adapts the KF for solving large-scale monitoring problems. The CSKF uses N preselected orthogonal bases to compute an accurate rank-N approximation of the covari-ance that is close to the optimal spectral approximation given by SVD. The CSKF has a computational cost that scales linearly in m and uses an efficient matrix-free approach that propagates uncertainties using N + 1 forward model evaluations, where N << m. Here in this paper we present a generalized CSKF algorithm for nonlin-ear state estimation problems such as CO 2 monitoring. For simultaneous estimation of multiple types of state variables, the algorithm allows selecting bases that represent the variability of each state type. Through synthetic numerical experiments of CO 2 monitoring, we show that the CSKF can reproduce the Kal-man gain accurately even for large compression ratios (m/N). For a given computational cost, the CSKF uses a robust and flexible compression scheme that gives more reliable uncertainty estimates than the ensemble Kalman filter, which may display loss of ensemble variability leading to suboptimal uncertainty estimates.

97 MATHEMATICS AND COMPUTING↗

Online real-time learning of dynamical systems from noisy streaming data

Abstract Recent advancements in sensing and communication facilitate obtaining high-frequency real-time data from various physical systems like power networks, climate systems, biological networks, etc. However, since the data are recorded by physical sensors, it is natural that the obtained data is corrupted by measurement noise. In this paper, we present a novel algorithm for online real-time learning of dynamical systems from noisy time-series data, which employs the Robust Koopman operator framework to mitigate the effect of measurement noise. The proposed algorithm has three main advantages: (a) it allows for online real-time monitoring of a dynamical system; (b) it obtains a linear representation of the underlying dynamical system, thus enabling the user to use linear systems theory for analysis and control of the system; (c) it is computationally fast and less intensive than the popular extended dynamic mode decomposition (EDMD) algorithm. We illustrate the efficiency of the proposed algorithm by applying it to identify the Van der Pol oscillator, the chaotic attractor of the Henon map, the IEEE 68 bus system, and a ring network of Van der Pol oscillators.

97 MATHEMATICS AND COMPUTING↗

Research requirements for a real-time flight measurements and data analysis system for subsonic transport high-lift research

A multiphased research program to obtain detailed flow characteristics on a multielement high-lift flap system is being conducted on the Transport Systems Research Vehicle (B737-100 aircraft) at NASA Langley Research Center. Upcoming flight tests have required the development of a highly capable and flexible flight measurement and data analysis instrumentation system. This instrumentation system will be more comprehensive than any of the systems used on previous high-lift flight experiment at NASA Langley. The system will provide the researcher near-real-time information for decision making needed to modify a flight test in order to further examine unexpected flow conditions. This paper presents the research requirements and instrumentation design concept for an upcoming flight experiment for the subsonic transport high-lift research program. The flight experiment objectives, the measurement requirements, the data acquisition system, and the onboard data analysis and display capabilities are described.

Whitehead, Julia H.↗

PhenoCurve: capturing dynamic phenotype-environment relationships using phenomics data

MOTIVATION: Phenomics is significant for understanding the mechanisms that regulate or influence growth, fitness, and development. Techniques have been developed to conduct high-throughput large-scale phenotyping on animals, plants and humans, aiming to bridge the gap between genomics, gene functions and traits. Although new developments in phenotyping techniques are exciting, we are limited by the tools to analyze fully the massive phenotype data, especially the dynamic relationships between phenotypes and environments. RESULTS: We present a new algorithm called PhenoCurve, a knowledge-based curve fitting algorithm, aiming to identify the complex relationships between phenotypes and environments, thus studying both values and trends of phenomics data. The findings on both real and simulated data showed that PhenoCurve has the best performance among all the six tested methods. Its application to photosynthesis hysteresis pattern identification reveals new functions of core genes that control photosynthetic efficiency in response to varying environmental conditions, which are critical for understanding plant energy storage and improving crop productivity.

Yang, Yifan↗

STUDIES ON PIPELINE POLYETHYLENES IN HYDROGEN GAS ENVIRONMENTS USING IN-SITU AND EX-SITU CHARACTERIZATION METHODS

Polymeric materials are commonplace in the natural gas infrastructure as distribution pipes, coatings, seals, and gaskets. Under the auspices of the U.S. Department of Energy HyBlend program, one of the means to reduce greenhouse gas emissions is with replacing natural gas, either partially or completely, with hydrogen. This approach makes it imperative that we conduct near-term and long-term materials compatibility research in these relevant environments. Insights into the effects of hydrogen and hydrogen gas blends on polymer integrity can be gained through both ex-situ and in-situ analytical methods. Our work represented here highlights a study of the behavior of pipeline polyethylene (PE) materials, including HDPE (Dow 2490 and GDB50) and MDPE (Ineos and legacy Dupont Aldyl A), when exposed to hydrogen by means of in-situ X-ray scattering and ex-situ Raman spectroscopy techniques. Samples were tested in ex-situ hydrogen and argon gas environments and in-situ hydrogen environments to identify differences due to permeation and solubility of these gases. These methods complemented each other because Raman spectroscopy could capture permanent effects after materials were removed from gaseous environments, and in-situ X-ray scattering analysis collected real-time data to elucidate the impact of the gas environment on polymer microstructure. Data collected revealed that the aforementioned polymers did not show significant changes in crystallinity and microstructure under the exposure conditions tested. Our findings from these studies will help establish real-time effects caused by hydrogen gas transport through pipeline polyethylenes by way of its influence on polymer structure and chemistry, which is directly related to pipeline mechanical strength and longevity of service.

Hydrogen materials compatibility, Natural gas pipe↗

Directional Laplacian Centrality for Cyber Situational Awareness

Cyber operations is drowning in diverse, high-volume, multi-source data. To get a full picture of current operations and identify malicious events and actors, analysts must see through data generated by a mix of human activity and benign automated processes. Although many monitoring and alert systems exist, they typically use signature-based detection methods. We introduce a general method rooted in spectral graph theory to discover patterns and anomalies without a priori knowledge of signatures. We derive and propose a new graph-theoretic centrality measure based on the derivative of the graph Laplacian matrix in the direction of a vertex. To build intuition about our measure, we show how it identifies the most central vertices in standard network datasets and compare to other graph centrality measures. Finally, we focus our attention on studying its effectiveness in identifying important IP addresses in network flow data. Using both real and synthetic network flow data, we conduct several experiments to test our measure’s sensitivity to two types of injected attack profiles and show that vertices participating in injected attack profiles exhibit noticeable changes in our centrality measures, even when the injected anomalies are relatively small, and in the presence of simulated network dynamics.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Joint reconstruction of x-ray fluorescence and transmission tomography

X-ray fluorescence tomography is based on the detection of fluorescence x-ray photons produced following x-ray absorption while a specimen is rotated; it provides information on the 3D distribution of selected elements within a sample. One limitation in the quality of sample recovery is the separation of elemental signals due to the finite energy resolution of the detector. Another limitation is the effect of self-absorption, which can lead to inaccurate results with dense samples. To recover a higher quality elemental map, we combine x-ray fluorescence detection with a second data modality: conventional x-ray transmission tomography using absorption. By using these combined signals in a nonlinear optimization-based approach, we demonstrate the benefit of our algorithm on real experimental data and obtain an improved quantitative reconstruction of the spatial distribution of dominant elements in the sample. Furthermore, compared with single-modality inversion based on x-ray fluorescence alone, this joint inversion approach reduces ill-posedness and should result in improved elemental quantification and better correction of self-absorption.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

FRIEDA: Flexible Robust Intelligent Elastic Data Management Framework

Scientific applications are increasingly using cloud resources for their data analysis workflows. However, managing data effectively and efficiently over these cloud resources is challenging due to the myriad storage choices with different performance, cost trade-offs, complex application choices and complexity associated with elasticity, failure rates in these environments. The different data access patterns for data-intensive scientific applications require a more flexible and robust data management solution than the ones currently in existence. FRIEDA is a Flexible Robust Intelligent Elastic Data Management framework that employs a range of data management strategies in cloud environments. FRIEDA can manage storage and data lifecycle of applications in cloud environments. There are four different stages in the data management lifecycle of FRIEDA – (i) storage planning, (ii) provisioning and preparation, (iii) data placement, and (iv) execution. FRIEDA defines a data control plane and an execution plane. The data control plane defines the data partition and distribution strategy, whereas the execution plane manages the execution of the application using a master-worker paradigm. FRIEDA also provides different data management strategies, either to partition the data in real-time, or predetermine the data partitions prior to application execution.

97 MATHEMATICS AND COMPUTING↗

Automated System-wide Event Detection and Classification Using Machine Learning on Synchrophasor Data

As the number of phasor measurement units (PMUs) deployed in a power system increases, and their data volume streamed to the control canter intensifies, operators are facing challenges related to the analysis of such data, which need to be observed and responded to as the measurements are displayed in the Control Room. Humans are generally unable to process such large amount of data efficiently and rapidly. There is an apparent need for automated ways to analyze the data, extract actionable information about occurrence of specific events, and characterize the events quickly and cost effectively. This paper discusses the use of machine learning (ML) to facilitate such tasks by providing automated, highly computationally efficient, and cost-effective ways of extracting actionable information from synchrophasor big data in real-time. We developed Big Data Smart (BDSmart) ML-based prototype tool for the Control Room use that automatically analyses data properties from synchrophasor system measurements taken across the three grid Interconnections in the USA (Western, Eastern and ERCOT). The data collected from several hundreds of PMUs located across the Interconnections over a period of two years have been made available for our extensive study. As a result, we were able to identify a number of big data properties that influence how ML methodology is applied to select, develop, train and test the data models that can eventually be used for the tool implementation. The resulting set of candidate algorithms spans unsupervised, supervised, semi-supervised and transfer-learning approaches. Many ML techniques, such as decision trees, multinomial logistic regression, feed-forward neural networks, K-nearest neighbor, multiclass support vector machine, and single and multi-channel convolutional neural networks, are implemented, and their performance is examined. We offer the results from testing the data models. The novelty of our study is in the approaches for bad data detection and mitigation, selection of a simplified feature for event detection, and data label improvements. As a result, we came up with a list of recommendations for the utilities on how to improve the PMU recording practices to cater to the future ML applications aimed at automating the analysis of synchrophasor data.

Synchrophasors, Machine Learning, System-wide Even↗

Classification Algorithm for Dark Matter Search using Skipper-CCD

In this project, I used ROOT framework with C++ for data analysis and Geant4 for simulating different particles’ interaction with the detector to study the characteristic of their tracks. I prepared the tagged dataset for machine learning training both the real experiment data taken in MINOS and simulation data from Geant4.

Chen, Meng-Wei↗

The application of large numbers of pleasure boats to collect synoptic sea-truth for ERTS-1 overpasses

The author has identified the following significant results. In order to interpret and annotate current circulation and suspended sediment concentration maps derived from ERTS-1 digital tapes, the University of Delaware has been collecting water samples and other data from boats and helicopters. In order to increase the number of samples at the exact time of the ERTS-1 pass over Delaware Bay, pleasure craft were organized to obtain samples of the entire test site. On the ERTS-1 pass of July second, scientists were stationed at three public boat launches along the Bay to hand out sampling packets to interested boaters. The packets contained two litre sampling bottles, a map, data card, and a pen. The boaters were asked to fill the two bottles between 11 and 11:15 a.m., mark their location on the map, and fill out the data card. Forty-nine packets were handed out of which 40 were returned (82%). Only four of the 40 were not in the alloted time range. This gave 36 real time data points covering approximately 30 nautical miles. The samples are being analyzed for sediment concentration, particle size, and salinity. Participating boaters will receive a copy of an ERTS image of the Delaware Bay and a summary report of the project. Because of the success of the project, future use of pleasure boaters is being planned.

Klemas, V.↗

Space Shuttle data acquisition and processing

The techniques of minimizing the amount of Space Shuttle data processed by using real-time ground data and on board computer to prescreen the data are presented. With the advent of long duration space flight and the large amounts of data generated, it became necessary to limit the amount of data to be processed and also to present data in a manner that highlights the most important data. The Shuttle operational data system with output of 128 kilobits/sec, the developmental flight instrumentation system, and screening of data by the analysts, flight crew, or onboard computers is described, noting that by using these monitoring methods the mission evaluation team can rapidly determine time periods for which postflight data processing is required. Postflight processing systems, batch system output products, data compression techniques, the interactive computer system, and the special telemetry conversion system are discussed, and it is concluded that the combination of Shuttle on board and ground data processing systems enhances the ability to perform a functional evaluation of the Space Shuttle vehicle.

Foster, G. B., Jr.↗

Using XML and Java Technologies for Astronomical Instrument Control

Traditionally, instrument command and control systems have been highly specialized, consisting mostly of custom code that is difficult to develop, maintain, and extend. Such solutions are initially very costly and are inflexible to subsequent engineering change requests, increasing software maintenance costs. Instrument description is too tightly coupled with details of implementation. NASA Goddard Space Flight Center, under the Instrument Remote Control (IRC) project, is developing a general and highly extensible framework that applies to any kind of instrument that can be controlled by a computer. The software architecture combines the platform independent processing capabilities of Java with the power of the Extensible Markup Language (XML), a human readable and machine understandable way to describe structured data. A key aspect of the object-oriented architecture is that the software is driven by an instrument description, written using the Instrument Markup Language (IML), a dialect of XML. IML is used to describe the command sets and command formats of the instrument, communication mechanisms, format of the data coming from the instrument, and characteristics of the graphical user interface to control and monitor the instrument. The IRC framework allows the users to define a data analysis pipeline which converts data coming out of the instrument. The data can be used in visualizations in order for the user to assess the data in real-time, if necessary. The data analysis pipeline algorithms can be supplied by the user in a variety of forms or programming languages. Although the current integration effort is targeted for the High-resolution Airborne Wideband Camera (HAWC) and the Submillimeter and Far Infrared Experiment (SAFIRE), first-light instruments of the Stratospheric Observatory for Infrared Astronomy (SOFIA), the framework is designed to be generic and extensible so that it can be applied to any instrument. Plans are underway to test the framework with other types of instruments, such as remote sensing earth science instruments.

Ames, Troy↗

GEOS Instrument of Opportunity (IoO)

NOAA's three-axis stabilized series of GOES satellites have a place reserved on the Earth-facing side for an Instrument of Opportunity (IoO). The IoO slot is a location for new technologies that provide space-time-spectral resolution of the environment not possible with the preconceived Imager and Sounder. For example, candidate IoO's have usually proposed to use large-format staring arrays of detectors. The size, weight, power, data rate, and interface allocations for the IoO are modest in comparison to the Imager and Sounder, but the resources are large enough to allow for the collection of useful real time data. Because, the geosynchronous location is ideal for monitoring rapidly changing unpredictable events, IoO's have been suggested to detect lightning, volcanism, ozone and sulfur dioxide, ocean color, vegetation, special weather events, and even broadcast color TV. To become an IoO on GOES, the proposed instrument must: 1) have potential benefit to NOAA, 2) fit within the allocation constraints, 3) be independently funded, including pre-launch test equipment and the spacecraft accommodation costs, 4) be delivered two years before launch for integration and testing, and 5) not interfere with the existing launch schedule or the operational instruments.

Chesters, Dennis↗

Tropospheric Airborne Meteorological Data Reporting (TAMDAR) Sensor Development

One of the recommendations of the National Aviation Weather Program Council was to expand and institutionalize the generation, dissemination, and use of automated pilot reports (PIREPS) to the full spectrum of the aviation community, including general aviation. In response to this and other similar recommendations, NASA initiated cooperative research into the development of an electronic pilot reporting capability (Daniels 2002). The ultimate goal is to develop a small low-cost sensor, collect useful meteorological observations below 25,000 ft., downlink the data in near real time, and use the data to improve weather forecasts. Primary users of the data include pilots, who are one targeted audience for the improved weather information that will result from the TAMDAR data. The weather data will be disseminated and used to improve aviation safety by providing pilots with enhanced weather situational awareness. In addition, the data will be used to improve the accuracy and timeliness of weather forecasts. Other users include air traffic controllers, flight service stations, and airline weather centers. Additionally, the meteorological data collected by TAMDAR is expected to have a significant positive impact on forecast accuracy for ground based applications.

Daniels, Taumi S.↗

Learning User Preferences for Sets of Objects

Most work on preference learning has focused on pairwise preferences or rankings over individual items. In this paper, we present a method for learning preferences over sets of items. Our learning method takes as input a collection of positive examples--that is, one or more sets that have been identified by a user as desirable. Kernel density estimation is used to estimate the value function for individual items, and the desired set diversity is estimated from the average set diversity observed in the collection. Since this is a new learning problem, we introduce a new evaluation methodology and evaluate the learning method on two data collections: synthetic blocks-world data and a new real-world music data collection that we have gathered.

preferences↗