Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data driven”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Beyond Visual Analytics: Human-Machine Teaming for AI-Driven Data Sensemaking

"Detect the expected, discover the unexpected" was the founding principle of the field of visual analytics. This mantra implies that human stakeholders, like a domain expert or data analyst, could leverage visual analytics techniques to seek answers to known unknowns and discover unknown unknowns in the course of the data sensemaking process. We argue that in the era of AI-driven automation, we need to recalibrate the roles of humans and machines (e.g., a machine learning model) as teammates. We posit that by realizing human-machine teams as a stakeholder unit, we can better achieve the best of both worlds: automation transparency and human reasoning efficacy. However, this also increases the burden on analysts and domain experts towards performing more cognitively demanding tasks than what they are used to. In this paper, we reflect on the complementary roles in a human-machine team through the lens of cognitive psychology and map them to existing and emerging research in the visual analytics community. We discuss open questions and challenges around the nature of human agency and analyze the shared responsibilities in human-machine teams.

Sensemaking, human-machine teaming, agency, artifi↗
DOE OSTI2024

MDLoader: A Hybrid Model-Driven Data Loader for Distributed Graph Neural Network Training

Scalable data management is essential for processing large scientific dataset on HPC platforms for distributed deep learning. In-memory distributed storage is preferred for its speed, enabling rapid, random, and frequent data access required by stochastic optimizers. Processes use one-sided or collective communication to fetch remote data, with optimal performance depending on (i) dataset characteristics, (ii) training scale, and (iii) interconnection network. Empirical analysis shows collective communication excels with larger mini-batch sizes and/or fewer processes, whereas one-sided communication outperforms at larger scales. We propose MDLoader, a hybrid in-memory data loader for distributed graph neural network training. MDLoader features a model-driven performance estimator that dynamically selects between one-sided and collective communication at the beginning of training using Tree of Parzen Estimators (TPE). Evaluations on NERSC Perlmutter and OLCF Summit show MDLoader outperforms single-backend loaders by up to 2.83 × and predicts the suitable communication method with 96.3% (Perlmutter) and 94.3% (Summit) success rate.

Bae, Jonghyun↗
DOE OSTI2019

A nonlinear data-driven reduced order model for computational homogenization with physics/pattern-guided sampling

Developing an accurate nonlinear reduced order model from simulation data has been an outstanding research topic for many years. For many physical systems, data collection is very expensive and the optimal data distribution is not known in advance. Thus, maximizing the information gain remains a grand challenge. In a recent paper, Bhattacharjee and Matouš (2016) proposed a manifold-based nonlinear reduced order model for multiscale problems in mechanics of materials. Expanding this work here, we develop a novel sampling strategy based on the physics/pattern-guided data distribution. Our adaptive sampling strategy relies on enrichment of sub-manifolds based on the principal stretches and rotational sensitivity analysis. This novel sampling strategy substantially decreases the number of snapshots needed for accurate reduced order model construction (i.e., ~5 x reduction of snapshots over Bhattacharjee and Matouš (2016)). Moreover, we build the nonlinear manifold using the displacement rather than deformation gradient data. We provide rigorous verification and error assessment. We demonstrate both localization and homogenization of the multiscale solution on a large particulate composite unit cell.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Automating the interpretation of PM 2.5 time–resolved measurements using a data–driven approach

The rapid development of automated measurement equipment enables researchers to collect greater quantities of time-resolved data from indoor and outdoor environments. While significant, the interpretation of the resulting data can be a time-consuming effort. This paper introduces an automated process of interpreting PM 2.5 time-resolved data and differentiating PM 2.5 emissions resulting from indoor and outdoor sources. Here, we use Random Forest (RF), a machine learning approach, to study a dataset of 836 indoor emission events that occurred over a 2-week period in 18 apartments in California. In this paper, we show model development and evaluate its performance as the sample size and source vary. We discuss the characteristics of the dataset that tended to help the source identification and why. For example, we show that data from many events and from different apartments are essential for the model to be suitable for analyzing a new separate dataset. We also show that longitudinal data appear to be more helpful than the time frequency of measurements within a given apartment. We use the resulting RF model to analyze PM 2.5 data of an entirely separate dataset collected from 65 new homes in California. The RF model identifies 442 indoor emission events, with only a few misidentifications.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Integrative data-driven approaches for characterization & prediction of aerosol-cloud processes

Focal Area: Advanced methods to glean insights from complex data (Focal Area 3). Science Challenge: Fusing and interpreting the vast amount of data from disjoint sources for the purpose of elevating our understanding of aerosol-cloud interaction presents an enormous challenge and opportunity and is necessary to improve uncertainty quantification and predictions, especially for extreme events.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Data-Driven Co-optimization of Energy Efficiency and Indoor Environmental Quality in Commercial Buildings

In this paper, we use publicly available data of a highly instrumented building to estimate how zonal temperature and carbon dioxide (CO2) concentration are related to some key operational and environmental measurements. Subsequently, we have developed, simulated, and evaluated an optimization framework for minimizing the energy consumption of the central heating, ventilation and air conditioning (HVAC) unit while meeting zonal temperature and indoor air quality (IAQ) standards. Finally, we have evaluated the achievable energy savings for our proposed approach as compared to a baseline approach and reported significant savings potential.

Naqvi, Syed Ahsan Raza↗
DOE OSTI2021

Data-driven delta-generalized labeled multi-bernoulli tracker

A system and method for tracking a plurality of objects. Unlabeled measurement data identifying a plurality of targets corresponding to the plurality of objects is received. A multi-target likelihood function is generated using a persistent target density, a birth target density, and a clutter density. The multi-target likelihood function is used to associate persistent targets with the unlabeled measurement data to update persistent tracks and to initiate a new track for each target in the plurality of targets in the measurement data that is not associated with a persistent target.

LeGrand, Keith Allen↗
DOE OSTI2019

Data-Driven Day-Ahead PV Estimation Using Hybrid Deep Learning

Ongoing smart grid activities and associated automation resulted in rich set of data. Here, these data can be utilized for monitoring and estimation of real time photovoltaic (PV) generation. Inherent variability in PV and related impact on power systems is a challenging problem. Improving the accuracy of PV generation estimation is beneficial for both the PV owners and the grid operators. Recently, deep learning algorithms possible by the availability of data have shown its advantages for time series estimation; however, its application on PV generation estimation is still in the early stage. In this paper, a hybrid estimation model with a combination of long-short-term-memory network (LSTM) and persistence model (PM) is developed to provide day-ahead PV estimation at 15-minute time interval with high accuracy and robustness. Simulation results show the superior performance of the proposed method over existing methods for most of the test cases.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2012

Photovoltaics Informatics: Harnessing Energy Science via Data-Driven Approaches

We discuss our current research focus on photovoltaic (PV) informatics, which is dedicated to functionality enhancement of solar materials through data management and data mining-aided, integrated computational materials engineering (ICME) for rapid screening and identification of multi-scale processing/structure/property/performance relationships. Our current PV informatics research ranges from transparent conducting oxides (TCO) to solar absorber materials. As a test bed, we report on examples of our current data management system for PV research and advanced data mining to improve the performance of solar cells such as CuInxGa1-xSe2 (CIGS) aiming at low-cost and high-rate processes. For the PV data management, we show recent developments of a strategy for data modeling, collection and aggregation methods, and construction of data interfaces, which enable proper archiving and data handling for data mining. For scientific data mining, the value of high-dimensional visualizations and non-linear dimensionality reduction is demonstrated to quantitatively assess how process conditions or properties are interconnected in the context of the development of Al-doped ZnO (AZO) thin films as the TCO layers for CIGS devices. Such relationships between processing and property of TCOs lead to optimal process design toward enhanced performance of CIGS cells/devices.

CONSTRUCTION↗
DOE OSTI2024

Data driven discovery and quantification of hyperspectral leaf reflectance phenotypes across a maize diversity panel

Abstract Estimates of plant traits derived from hyperspectral reflectance data have the potential to efficiently substitute for traits, which are time or labor intensive to manually score. Typical workflows for estimating plant traits from hyperspectral reflectance data employ supervised classification models that can require substantial ground truth datasets for training. We explore the potential of an unsupervised approach, autoencoders, to extract meaningful traits from plant hyperspectral reflectance data using measurements of the reflectance of 2151 individual wavelengths of light from the leaves of maize ( Zea mays ) plants harvested from 1658 field plots in a replicated field trial. A subset of autoencoder‐derived variables exhibited significant repeatability, indicating that a substantial proportion of the total variance in these variables was explained by difference between maize genotypes, while other autoencoder variables appear to capture variation resulting from changes in leaf reflectance between different batches of data collection. Several of the repeatable latent variables were significantly correlated with other traits scored from the same maize field experiment, including one autoencoder‐derived latent variable (LV8) that predicted plant chlorophyll content modestly better than a supervised model trained on the same data. In at least one case, genome‐wide association study hits for variation in autoencoder‐derived variables were proximal to genes with known or plausible links to leaf phenotypes expected to alter hyperspectral reflectance. In aggregate, these results suggest that an unsupervised, autoencoder‐based approach can identify meaningful and genetically controlled variation in high‐dimensional, high‐throughput phenotyping data and link identified variables back to known plant traits of interest.

Tross, Michael C.↗
DOE OSTI2023

A Data-Driven Passive Islanding Detection Scheme

This paper proposes a simple yet effective statistical parameters based passive islanding scheme. The proposed scheme relies only the voltage data, measured at the point of common coupling (PCC), and is comprised of three stages. The Stage-1 quickly computes what is termed as mean based coarse islanding detection (MID), Stage-2 computes the decaying DC detector (DDCD), and 3) finally, MID is used in conjunction with DDCD as per the statistical digital relay logic (SRDL) is devised in Stage-3 to distinguish between islanding events from non islanding events. Various tests are investigated on the Banshee's industrial Microgrid (MG), modelled in the Real Time Digital Simulator (RTDS), on the basis of the IEEE-1547, UL 1741 standards. The validation of the proposed islanding detection methodology (PIDM) in RTDS platform ensures the viability of the proposed scheme in practical systems. The test results reveal that the PIDM can detect islanding within 2 cycles, and results in a very small non detection zone (NDZ). Moreover, the scheme can very well be used for single-phase MG too as it relies only on the single phase voltage information.

anti-islanding protection↗
DOE OSTI2022

Optimizing aircraft flows at airports using data driven predicted capabilities

A method for safe and efficient use of airport runway capacity includes receiving, at an air traffic control system at an airport, airport data related to movement areas of the airport, time data related to a time period, aircraft data related to a plurality of aircraft expected to operate into and out of the airport during the time period, and environmental data related to environmental conditions predicted for the airport during the time period. The method further includes computing a probability distribution for inter-aircraft spacing by applying the airport data, the time data, the aircraft data, and the environmental data to a trained Bayesian network, producing the probability distribution for the inter-aircraft spacing as an output observation of the trained Bayesian network, and, using the probability distribution and a confidence value, identifying an inter-aircraft spacing value for the plurality of aircraft expected to operate into and out of the airport during the time period.

Sweet, Douglas↗
DOE OSTI2022

Data-Driven Dynamic Modeling in Power Systems: A Fresh Look on Inverter-Based Resource Modeling

Here, this article introduces ways to identify dynamic system models using measurement data. In power system analysis, a static model represents the time-invariant input-output relationship of a system, while a dynamic model describes the behavior of the system over time. For example, how will a system transit from one steady-state operation point to another?

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Data-Driven Understanding of Low-to-Moderate Income Customers’ Adoption and Financial Qualification in Community Solar

Through this project, we sought to gather a body of customer data that either proved or disproved our assumption that metrics other than FICO can and should be used to qualify customers for community solar. Using customer data on income, FICO scores, and utility/rent/cell phone repayment history, we developed an alternative metric in order to test in the market at a small scale whether new qualifying metrics could open the shared solar market up to millions of additional households. We demonstrate that the EnergyScore is both more accurate in qualifying customers that will not default, and more inclusive in qualifying low to moderate income households. We are now in the process of utilizing the EnergyScore in a number of pilot projects, building a robust dataset of customer churn and default, and subsequently disseminating this data to more traditional and larger scale financiers and solar developer partners to change the way potential customers are qualified.

14 SOLAR ENERGY↗
DOE OSTI2021

Data-driven Distributed Learning of Multi-agent Systems: A Koopman Operator Approach

Koopman operator theory provides a model-free technique for studying nonlinear dynamical systems purely from data. Since the Koopman operator is infinite-dimensional, researchers have developed several methods that provide a finite-dimensional approximation of the Koopman operator so that it can be applied for practical use cases. One common thing with most of the methods is that their solutions are obtained by solving a centralized minimization problem. In this work, we treat the dynamical system to be a multi-agent system and propose an algorithm to compute the finite-dimensional approximation of the Koopman operator in a distributed manner using the knowledge of the topology of the underlying multi-agent system. The proposed distributed approach is shown to be equivalent to the centralized learning problem and results in a sparse Koopman whose block structure mimics the Laplacian of the multi-agent system. Extensive simulation studies illustrate the proposed framework on the network of oscillators and the IEEE 68 bus system.

Nandanoori, Sai Pushpak↗
DOE OSTI2026

Data-Driven Atomic Physics: Harnessing Machine Learning and High-Repetition-Rate Experiments for Laser-driven HED

High-energy-density plasma experiments are central to progress in atomic physics, fusion energy, and national security science, but they have traditionally been constrained by slow data collection and manual, time-intensive analysis. This project targeted that bottleneck by enabling high-repetition-rate experiments to produce and interpret much larger volumes of data quickly enough to guide experiments while they run.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗