Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “methods: data analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Rapid and flexible segmentation of electron microscopy data using few-shot machine learning

Abstract Automatic segmentation of key microstructural features in atomic-scale electron microscope images is critical to improved understanding of structure–property relationships in many important materials and chemical systems. However, the present paradigm involves time-intensive manual analysis that is inherently biased, error-prone, and unable to accommodate the large volumes of data produced by modern instrumentation. While more automated approaches have been proposed, many are not robust to a high variety of data, and do not generalize well to diverse microstructural features and material systems. Here, we present a flexible, semi-supervised few-shot machine learning approach for segmentation of scanning transmission electron microscopy images of three oxide material systems: (1) epitaxial heterostructures of SrTiO 3 /Ge, (2) La 0.8 Sr 0.2 FeO 3 thin films, and (3) MoO 3 nanoparticles. We demonstrate that the few-shot learning method is more robust against noise, more reconfigurable, and requires less data than conventional image analysis methods. This approach can enable rapid image classification and microstructural feature mapping needed for emerging high-throughput characterization and autonomous microscope platforms.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Common Column Identification for Table Similarity Detection in Electrified Transportation Data Lakes

Electrified transportation often requires researchers and operators to interact with datasets from a wide range of sources and disciplines, such as transportation, power systems, public health, policies, and regulations. These datasets vary in quality and format, making it difficult to understand, preprocess, and identify key columns representing real-world entities or values for indexing and joining, which can negatively impact downstream analysis and operation. Existing solutions are limited, requiring extensive manual customization or data expertise to utilize. In this article, we propose a multi-layered approach to automatically identify key columns to expedite preprocessing and aid in analysis of electrified transportation data. Our method leverages a dynamic ontology to identify common fields and an information theory-based strategy for edge cases that are difficult to generalize. Evaluations on a number of datasets from data.gov and kaggle.com show improved performance of our methods over several baseline techniques, and our ablation analyses illustrate the efficacy of individual components of our method. Our case studies also demonstrate that our methods have the potential to improve analysis of electrified transportation data and aid in automatic integration of such datasets.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2022

Investigation of Molecular Diffusion at Block Copolymer Thin Films Using Maximum Entropy Method-Based Fluorescence Correlation Spectroscopy and Single Molecule Tracking

Fluorescence correlation spectroscopy (FCS) has been widely used to investigate molecular diffusion behavior in various samples. The use of the maximum entropy method (MEM) for FCS data analysis provides a unique means to determine multiple distinct diffusion coefficients without a priori assumption of their number. Comparison of the MEM-based FCS method (MEM-FCS) with another method will reveal its utility and advantage as an analytical tool to investigate diffusion dynamics. Herein, we measured diffusion of fluorescent probes doped into nanostructured thin films using MEM-FCS, and validated the results with single molecule tracking (SMT) data. The efficacy of the MEM code employed was first demonstrated by analyzing simulated FCS data for systems incorporating one and two diffusion modes with broadly distributed diffusion coefficients. The MEM analysis accurately afforded the number of distinct diffusion modes and their mean diffusion coefficients. These results contrasted with those obtained by fitting the simulated data to conventional two-component and anomalous diffusion models, which yielded inaccurate estimates of the diffusion coefficients. Subsequently, the MEM analysis was applied to FCS data acquired from hydrophilic dye molecules incorporated into microphase-separated polystyrene-block-poly(ethylene oxide) (PS-b-PEO) thin films characterized under a water-saturated nitrogen atmosphere. The MEM analysis revealed distinct fast and slow diffusion components attributable to molecules diffusing on the film surface and inside the film, respectively. SMT studies of the same materials yielded trajectories for mobile molecules that appear to follow the curved PEO microdomains. Diffusion coefficients obtained from the SMT data were consistent with those obtained for the slow diffusion component detected by MEM-FCS. Furthermore, these results highlight the utility of MEM-FCS and SMT for gaining complementary information on molecular diffusion processes in heterogeneous material systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS1986

Test versus analysis: A discussion of methods

Some techniques for comparing structural vibration data determined from test and analysis are discussed. Orthogonality is a general category of one group, correlation is a second, synthesis is a third and matrix improvement is a fourth. Advantages and short-comings of the methods are explored with suggestions as to how they can complement one another. The purpose for comparing vibration data from test and analysis for a given structure is to find out whether each is representing the dynamic properties of the structure in the same way. Specifically, whether: mode shapes are alike; the frequencies of the modes are alike; modes appear in the same frequency sequence; and if they are not alike, how to judge which to believe.

Butler, T. G.↗
DOE OSTI2022

A mathematical assessment of the isolation random forest method for anomaly detection in big data

We present the mathematical analysis of the Isolation Random Forest Method (IRF Method) for anomaly detection, proposed by Liu F.T., Ting K.M. and Zhou Z. H. in their seminal work as a heuristic method for anomaly detection in Big Data. We prove that the IRF space can be endowed with a probability induced by the Isolation Tree algorithm (iTree). In this setting, the convergence of the IRF method is proved, using the Law of Large Numbers. Here, a couple of counterexamples are presented to show that the method is inconclusive and no certificate of quality can be given, when using it as a means to detect anomalies. Hence, an alternative version of the method is proposed whose mathematical foundation is fully justified. Furthermore, a criterion for choosing the number of sampled trees needed to guarantee confidence intervals of the numerical results is presented. Finally, numerical experiments are presented to compare the performance of the classic method with the proposed one.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Assessing pore network heterogeneity across multiple scales to inform CO2 injection models

Geologic heterogeneity is a key feature that must be considered when translations of scaled data are performed. This paper presents the assessment of geologic heterogeneity using a multiscale workflow that includes image analysis-based methods coupled with well log analysis to provide data in which fractals and machine learning methods estimate the carbon dioxide (CO 2 ) storage resource potential of a reservoir. The heterogeneity of rock properties of the complex Bell Creek reservoir in Montana, USA, was explored at the pore scale (~nm to mm), core scale (~mm to m), and well scale (~cm to m). The data used in this study included advanced image analysis of micro-CT (computed tomography) images (pore scale), thin sections (pore scale), plugs and core images (core scale) and well logs (well scale). The micro-CT images were segmented using a U-net segmentation approach into objects of pores and grains. Further, the segmented images were reconstructed into subvolumes of different sizes. Physical properties (porosity and permeability) and fractal dimensions were calculated for the various subvolumes, and Lorenz coefficient (Lc) values, a single parameter to describe the degree of heterogeneity within a pay zone section, were calculated from thin-section images and well logs. Porosity and fractal dimension values were used to estimate the 188-µm threshold of representative elementary volume (REV) in this study. Both the Lc and fractal dimension values were found to be negatively correlated. When these two parameters are combined, it is possible to discern differences in the complex porous networks of the samples analyzed in this study.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Developing Data-Driven Synthetic Infrastructure Models for Resilience Analysis

Research on infrastructure resilience has produced promising methods to simulate and optimize complex networks to improve performance. However, restrictions on sharing infrastructure models and the steep cost of developing and maintaining infrastructure models presents a roadblock to adoption. To overcome this limitation, this research focuses on methods to create data-driven infrastructure models that will help improve infrastructure resilience and security. The analysis couples incomplete utility data, geospatial data, machine learning, and synthetic network generation methods to rapidly develop and update infrastructure models. The methods are validated using realistic utility models and site-specific data, with a focus on Puerto Rico due to its unique infrastructure challenges and available data. This research highlights promising opportunities for the use of synthetic network generation and machine learning to create infrastructure models when very little data is available. Results demonstrate that hybrid methods, which combine sparse utility data with synthetic models, can enhance model accuracy, and machine learning can predict model attributes using training data from other models. However, the complexity of infrastructure systems means that even minor changes in network connectivity can significantly impact simulation results. Resilience analysis using synthetic infrastructure models shows that while some system behaviors are preserved, the magnitude of disruptions may not be accurately represented, indicating the need for more research and validation before using synthetic models for critical infrastructure investment decisions. The framework outlined in this report represents a significant advance to infrastructure model development and could be applied to additional domains and sites. Future research will continue to streamline and validate methods to help reduce roadblocks to resilience analysis.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS2010

Affordability Engineering: Bridging the Gap Between Design and Cost

Affordability is a commonly used term that takes on numerous meanings depending on the context used. Within conceptual design of complex systems, the term generally implies comparisons between expected costs and expected resources. This characterization is largely correct, but does not convey the many nuances and considerations that are frequently misunderstood and underappreciated. In the most fundamental sense, affordability and cost directly relate to engineering and programmatic decisions made throughout development programs. Systems engineering texts point out that there is a temporal aspect to this relationship, for decisions made earlier in a program dictate design implications much more so than those made during latter phases. This paper explores affordability engineering and its many sub-disciplines by discussing how it can be considered an additional engineering discipline to be balanced throughout the systems engineering and systems analysis processes. Example methods of multidisciplinary design analysis with affordability as a key driver will be discussed, as will example methods of data visualization, probabilistic analysis, and other ways of relating design decisions to affordability results.

Reeves, J. D.↗
NASA NTRS2021

Probabilistic Machine Learning Estimation of Ocean Mixed Layer Depth from Dense Satellite and Sparse In-Situ Observations

The ocean mixed layer plays an important role in the coupling between the upper ocean and atmosphere across a wide range of time scales. Estimation of the variability of the ocean mixed layer is therefore important for atmosphere-ocean prediction and analysis. The increasing coverage of in situ Argo profile data allows for an increasingly accurate analysis of the mixed layer depth (MLD) variability associated with deviations from the seasonal climatology. However, sampling rates are not sufficient to fully resolve subseasonal (<90 day) MLD variability. Yet, many multivariate observations-based analyses include implicit modeled subseasonal MLD variability. One analysis method is optimal interpolation of in situ data, but the interior analysis can be improved by leveraging surface data with regression or variational approaches. Here, we demonstrate how machine learning methods and satellite sea surface temperature, salinity, and height facilitate MLD estimation in a pilot study of two regions: the mid-latitude southern Indian and the eastern equatorial Pacific Oceans. We construct multiple machine learning architectures to produce weekly 1/2° gridded MLD anomaly fields (relative to a monthly climatology) with uncertainty estimates. We test multiple traditional and probabilistic machine learning techniques to compare both accuracy and probabilistic calibration. We validate our methodology by applying it to ocean model simulations. We find that incorporating sea surface data through a machine learning model improves the performance of spatiotemporal MLD variability estimation compared to optimal interpolation of Argo observations alone. These preliminary results are a promising first step for the application of machine learning to MLD prediction.

Machine Learning↗
NASA NTRS1985

Analysis/forecast experiments with a multivariate statistical analysis scheme using FGGE data

A three-dimensional, multivariate, statistical analysis method, optimal interpolation (OI) is described for modeling meteorological data from widely dispersed sites. The model was developed to analyze FGGE data at the NASA-Goddard Laboratory of Atmospherics. The model features a multivariate surface analysis over the oceans, including maintenance of the Ekman balance and a geographically dependent correlation function. Preliminary comparisons are made between the OI model and similar schemes employed at the European Center for Medium Range Weather Forecasts and the National Meteorological Center. The OI scheme is used to provide input to a GCM, and model error correlations are calculated for forecasts of 500 mb vertical water mixing ratios and the wind profiles. Comparisons are made between the predictions and measured data. The model is shown to be as accurate as a successive corrections model out to 4.5 days.

Baker, W. E.↗
NASA NTRS1998

In-Flight System Identification

A method is proposed and studied whereby the system identification cycle consisting of experiment design and data analysis can be repeatedly implemented aboard a test aircraft in real time. This adaptive in-flight system identification scheme has many advantages, including increased flight test efficiency, adaptability to dynamic characteristics that are imperfectly known a priori, in-flight improvement of data quality through iterative input design, and immediate feedback of the quality of flight test results. The technique uses equation error in the frequency domain with a recursive Fourier transform for the real time data analysis, and simple design methods employing square wave input forms to design the test inputs in flight. Simulation examples are used to demonstrate that the technique produces increasingly accurate model parameter estimates resulting from sequentially designed and implemented flight test maneuvers. The method has reasonable computational requirements, and could be implemented aboard an aircraft in real time.

Morelli, Eugene A.↗
DOE OSTI2021

Critical analysis of velocimetry methods for particulate flows from synthetic data

Particle tracking methods that extract high-fidelity particle velocity data from high speed video of particle laden flows is a common experimental technique applied to chemical processes. These measurements are used to better understand the motion of particles and fluids in complex systems and create data against which computational models are validated. However, the methods, codes, and experimental setups all have limitations. It is imperative that practitioners verify the methods and their implementation as well as understand the limitations of experimental setups. This work focuses on quantifying the visible depth of field in a high particle concentration fluidized bed. Following a precedent set by the particle imaging velocimetry community, a particle velocity field is manufactured using a computational fluid dynamics and discrete element method simulation. Photo realistic high-speed videos are rendered based on the simulated data using the three-dimensional creation software Blender. Particle velocities are extracted from the synthetic high-speed videos using three variants of Particle Tracking Velocimetry and Optical Flow Velocimetry methodologies. Here, the tracked results are then compared to the known solution, quantifying the error associated with the assumed visible depth. The results indicate that at depth of one particle diameter, all three particle tracking codes give accurate measurements, largely within 5%. However, the error increases when the full bed video measurements are compared to the known solution at one particle diameter, i.e., mimicking a validation study. Finally, for some statistics the constant depth assumption only increases the error slightly, for others significantly.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS1989

Correlation of theory to wind-tunnel data at Reynolds numbers below 500,000

This paper presents results obtained from two airfoil analysis methods compared with previously published wind tunnel test data at chord Reynolds numbers below 500,000. The analysis methods are from the Eppler-Somers airfoil design/analysis code and from ISES, the Drela-Giles Airfoil design/analysis code. The experimental data are from recent tests of the Eppler 387 airfoil in the NASA Langley Low Turbulence Pressure Tunnel. For R not less than 200,000, lift and pitching moment predictions from both theories compare well with experiment. Drag predictions from both theories also agree with experiment, although to different degrees. However, most of the drag predictions from the Eppler-Somers code are accompanied with separation bubble warnings which indicate that the drag predictions are too low. With the Drela-Giles code, there is a large discrepancy between the computed and experimental pressure distributions in cases with laminar separation bubbles, although the drag polar predictions are similar in trend to experiment.

Evangelista, Raquel↗
NASA NTRS2008

High throughput reconfigurable data analysis system

The present invention relates to a system and method for performing rapid and programmable analysis of data. The present invention relates to a reconfigurable detector comprising at least one array of a plurality of pixels, where each of the plurality of pixels can be selected to receive and read-out an input. The pixel array is divided into at least one pixel group for conducting a common predefined analysis. Each of the pixels has a programmable circuitry programmed with a dynamically configurable user-defined function to modify the input. The present detector also comprises a summing circuit designed to sum the modified input.

Bearman, Greg↗
DOE OSTI2021

A Short-Term Solar Forecasting Platform Using a Physics-Based Smart Persistence Model and Data Imputation Method

Electrical energy plays vital role in our socio-economic activity and therefore ensuring the reliability of the electric grid, from the generation, transmission and distribution level is critical. In order to maintain the power system parameter viz., frequency, voltage, etc., optimally, balancing of generation and consumption is very much essential. However, solar energy is infirm power by nature this is due to cloud cover / other local phenomena. Hence, Photovoltaic (PV) power generation brings a significant challenge to the grid operator due to the variability of the solar energy. The complexity of this challenge in terms of planning and dispatch ability of PV resources, aggravates with the high penetration of solar energy into the electric grid. In this setting, reliable solar radiation forecasting models based on accurate and quality input data become essential. In order to develop a suitable model for predicting solar radiation, quality historical / real time measurement is also needed. Under this study NIWE and NREL jointly developed / tested short-term solar forecasting frameworks using a smart persistence and physics-based smart persistence models for intra-hour forecasting of solar radiation (PSPI) and benchmarked 9 different data imputation techniques in 15 Solar Radiation Resource Assessment (SRRA) stations, located at different parts of India. During any measurement campaign, due to various technical reasons, we may miss few observations. However, the missing observation often reduce the performance of any forecasting model. Therefore, suitable data imputation method would assist us to obtain continuous observation of solar radiation. A station-by-station and method-by-method analysis was carried out to understand the performance of each model. Based on our analysis, among all the data imputation methods, the Kalman data imputation method is better for Indian Weather condition. In addition, Kalman StructTS, Linear, Stine and Arima methods yield slightly inferior accuracy compared to Kalman, but outperform the other methods. The extended solar radiation data are used by solar forecasting models to provide the prediction of solar radiation at 15 SRRA stations. As far as short term forecasting model is concerned, the PSPI model outperforms the Smart Persistence model. However, the forecast error is increases with the forecasting horizon.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
NASA NTRS1975

A method of using cluster analysis to study statistical dependence in multivariate data

A technique is presented that uses both cluster analysis and a Monte Carlo significance test of clusters to discover associations between variables in multidimensional data. The method is applied to an example of a noisy function in three-dimensional space, to a sample from a mixture of three bivariate normal distributions, and to the well-known Fisher's Iris data.

Borucki, W. J.↗