Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data driven”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Data-Driven Generic Turbines for Distributed Wind Modeling, Optimization, and Economic Studies

As distributed energy resources (DER) become less expensive and more popular, utilities, project developers, and customers have an increasing need to model the performance of existing and proposed DER systems. Distributed wind has been shown to have widespread economic potential but is often represented by a simplified model in - or excluded from - DER modeling tools and studies. There is often no economic imperative to extend models and studies to give full consideration to distributed wind. We present a set of data-driven generic turbines derived from 16 years of annual distributed wind market survey data. The proposed methodology can be used to derive generic turbines from separate or updated data sets. Finally, a mixed-integer linear programming approach to optimal distributed wind project sizing is used to demonstrate the generic turbine models. Combined, these models and methods can reduce barriers to considering distributed wind in modeling tools and studies.

Reiman, Andrew P.↗
DOE OSTI2021

Wide-Scale Clinical Implementation of Knowledge-Based Planning: An Investigation of Workforce Efficiency, Need for Post-automation Refinement, and Data-Driven Model Maintenance

Our purpose was to investigate the effect of automated knowledge-based planning (KBP) on real-world clinical workflow efficiency, assess whether manual refinement of KBP plans improves plan quality across multiple disease sites, and develop a data-driven method to periodically improve KBP automated planning routines.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2026

Data Driven Correlated Noise Simulation for the ICEBERG LArTPC

Accurate electronic-noise simulation is essential for low-energy physics in liquid-argon TPCs. More realistic noise modeling allows us to better tune reconstruction algorithms and more reliably assess and optimize signal-detection thresholds. We present a data-driven noise simulation framework developed for the ICEBERG test stand for DUNE that generates synthetic noise waveforms that reproduce both (i) the measured per-channel magnitude of the Fast Fourier Transform (FFT) and (ii) frequency-dependent channel-to-channel correlations observed in ICEBERG noise data. Using a dedicated noise-only dataset, we build a compact noise model containing per-channel FFT-magnitude targets together with a small set of band-wise cross-wire color matrices. White noise is generated in the frequency domain by drawing circular-symmetric complex Gaussian coefficients with random phases and scaling them to match the measured FFT-magnitude targets, and cross-wire correlations are subsequently imposed using the stored color matrices. The model and algorithm were integrated into the LArSoft + Wire-Cell Toolkit simulation chain and validated by comparing waveform structure, frequency-domain spectra, and band-limited correlation matrices from simulated noise and ICEBERG data. This approach can be extended to other LArTPC operating conditions.

Ghosh, Avik [Iowa State U.]↗
DOE OSTI2020

Probabilistic Data-Driven Sampling via Multi-Criteria Importance Analysis

Although supercomputers are becoming increasingly powerful, their components have thus far not scaled proportionately. Compute power is growing enormously and is enabling finely resolved simulations that produce never-before-seen features. However, I/O capabilities lag by orders of magnitude, which means only a fraction of the simulation data can be stored for post hoc analysis. Prespecified plans for saving features and quantities of interest do not work for features that have not been seen before. Data-driven intelligent sampling schemes are needed to detect and save important parts of the simulation while it is running. Here, we propose a novel sampling scheme that reduces the size of the data by orders-of-magnitude while still preserving important regions. The approach we develop selects points with unusual data values and high gradients. Finally, we demonstrate that our approach outperforms traditional sampling schemes on a number of tasks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Cutting force estimation from machine learning and physics-inspired data-driven models utilizing accelerometer measurements

Monitoring cutting forces for process control may be challenging because force measurements typically require invasive instrumentation. To remedy this situation, two new methods were recently developed to estimate cutting forces in real time based on the use of on-machine accelerometer measurements. One method uses machine learning, while another uses a physics-inspired data-driven approach, to generate a model that estimates cutting forces from on-machine accelerations. The estimated forces from both approaches were compared against cutting force data collected during various milling operations on several machine tools. The results reveal the advantages and disadvantages of each model to estimate real-time cutting forces.

Vogl, Greg↗
NASA NTRS2003

The Distribution and Abundance of Bird Species: Towards a Satellite, Data Driven Avian Energetics and Species Richness Model

This paper addresses the fundamental question of why birds occur where and when they do, i.e., what are the causative factors that determine the spatio-temporal distributions, abundance, or richness of bird species? In this paper we outline the first steps toward building a satellite, data-driven model of avian energetics and species richness based on individual bird physiology, morphology, and interaction with the spatio-temporal habitat. To evaluate our model, we will use the North American Breeding Bird Survey and Christmas Bird Count data for species richness, wintering and breeding range. Long term and current satellite data series include AVHRR, Landsat, and MODIS.

Smith, James A.↗
DOE OSTI2022

Lockdown impacts on residential electricity demand in India: A data-driven and non-intrusive load monitoring study using Gaussian mixture models

This study evaluates the effect of complete nationwide lockdown in 2020 on residential electricity demand across 13 Indian cities and the role of digitalisation using a public smart meter dataset. We undertake a data-driven approach to explore the energy impacts of work-from-home norms across five dwelling typologies. Our methodology includes climate correction, dimensionality reduction and machine learning-based clustering using Gaussian Mixture Models of daily load curves. Results show that during the lockdown, maximum daily peak demand increased by 150-200% as compared to 2018 and 2019 levels for one room-units (RM1), one bedroom-units (BR1) and two bedroom-units (BR2) which are typical for low- and middle-income families. While the upper-middle- and higher-income dwelling units (i.e., three (3BR) and more-than-three bedroom-units (M3BR)) saw night-time demand rise by almost 44% in 2020, as compared to 2018 and 2019 levels. Our results also showed that new peak demand emerged for the lockdown period for RM1, BR1 and BR2 dwelling typologies. We found that the lack of supporting socioeconomic and climatic data can restrict a comprehensive analysis of demand shocks using similar public datasets, which informed policy implications for India's digitalisation. We further emphasised improving the data quality and reliability for effective data-centric policymaking.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Transmission Data-Driven User-Defined Model for Inverter-based and Conventional Power Plants

Recent events in Odessa [1], [2] have shed light on the complexities of integrating large Inverter-Based Resource (IBR) plants with the transmission system, prompting NERC to stress continuous performance monitoring by transmission operators. Challenges such as plant control updates, IBR model revisions, Phase-locked loop loss of synchronism, and protection events have been identified, underscoring the need for enhanced monitoring protocols by regulatory bodies. The recent FERC 901 order underscores the importance of accurate data exchange regarding IBRs for reliability studies. However, limited access to IBR plant-related data hampers effective decision-making for transmission operators (TOP). This paper proposes a method for constructing data-driven User-Defined dynamic Models (UDM) for power plants for validating multiple-event data using field measurements from interconnection bus locations. The problem is formulated as a power plant model identification problem and a multi-task learning approach under partial input observability assumptions is proposed in this work. This approach aims to predict aggregated responses of conventional and IBR power plants during various dynamic physical events which is useful for planning studies under diverse disturbance conditions. Ultimately, this methodology emphasizes the importance of plant visibility to operators in addressing power system challenges, facilitating improved planning and operational studies.

Mahapatra, Kaveri [BATTELLE (PACIFIC NW LAB)]↗
DOE OSTI2018

Dynamic Data-Driven SAR Image Reconstruction Using Multiple GPUs

According to the article, the reconstruction of nxn-pixel synthetic aperture radar (SAR) imagery using a backprojection algorithm incurs O(n 2 · m) cost, where m is the number of pulses. This paper presents dynamic data-driven multiresolution algorithms to speed up SAR backprojection on multiple graphics processing units (GPUs). A critical part of this spatially variant reconstruction process is load balancing, which circumvents asymmetric work assignment. Fine-tuned algorithms for GPUs are presented as a part of improving running time. Communication between processors is overlapped with GPU calculation to reduce communication time.

Engineering↗
DOE OSTI2022

Generation of Data-Driven Expected Energy Models for Photovoltaic Systems

Although unique expected energy models can be generated for a given photovoltaic (PV) site, a standardized model is also needed to facilitate performance comparisons across fleets. Current standardized expected energy models for PV work well with sparse data, but they have demonstrated significant over-estimations, which impacts accurate diagnoses of field operations and maintenance issues. This research addresses this issue by using machine learning to develop a data-driven expected energy model that can more accurately generate inferences for energy production of PV systems. Irradiance and system capacity information was used from 172 sites across the United States to train a series of models using Lasso linear regression. The trained models generally perform better than the commonly used expected energy model from international standard (IEC 61724-1), with the two highest performing models ranging in model complexity from a third-order polynomial with 10 parameters (Radj2 = 0.994) to a simpler, second-order polynomial with 4 parameters (Radj2=0.993), the latter of which is subject to further evaluation. Subsequently, the trained models provide a more robust basis for identifying potential energy anomalies for operations and maintenance activities as well as informing planning-related financial assessments. We conclude with directions for future research, such as using splines to improve model continuity and better capture systems with low (≤1000 kW DC) capacity.

14 SOLAR ENERGY↗
DOE OSTI2017

A Data-Driven Methodology for Probabilistic Wind Power Ramp Forecasting

With increasing wind penetration, wind power ramps (WPRs) are currently drawing great attention to balancing authorities, since these wind ramps largely affect power system operations. To help better manage and dispatch the wind power, this paper develops a data-driven probabilistic WPR forecasting (p-WPRF) method based on a large number of simulated scenarios. A machine learning technique is first adopted to forecast the basic wind power forecasting scenario and produce the historical forecasting errors. To accurately model the distribution of wind power forecasting errors, a generalized Gaussian mixture model is developed and the cumulative distribution function (CDF) is also analytically deduced. The inverse transform method based on the CDF is used to generate a large number of forecasting error scenarios. An optimized swinging door algorithm is adopted to extract all the WPRs from the complete set of wind power forecasting scenarios. The p-WPRF is generated based on all generated scenarios under different weather and time conditions. Numerical simulations on publicly available wind power data show that the developed p-WPRF method can predict WPRs with a high level of reliability and accuracy.

17 WIND ENERGY↗
NASA NTRS2016

Data-Driven Radiative Hydrodynamic Modeling of the 2014 March 29 X1.0 Solar Flare

Spectroscopic observations of solar flares provide critical diagnostics of the physical conditions in the flaring atmosphere. Some key features in observed spectra have not yet been accounted for in existing flare models. Here we report a data-driven simulation of the well-observed X1.0 flare on 2014 March 29 that can reconcile some well-known spectral discrepancies. We analyzed spectra of the flaring region from the Interface Region Imaging Spectrograph (IRIS) in Mg II hk, the Interferometric BIdimensional Spectropolarimeter at the Dunn Solar Telescope (DSTIBIS) in H(alpha) 6563A and Ca II 8542A, and the Reuven Ramaty High Energy Solar Spectroscope Imager (RHESSI) in hard X-rays. We constructed a multithreaded flare loop model and used the electron flux inferred from RHESSI data as the input to the radiative hydrodynamic code RADYN to simulate the atmospheric response. We then synthesized various chromospheric emission lines and compared them with the IRIS and IBIS observations. In general, the synthetic intensities agree with the observed ones, especially near the northern footpoint of the flare. The simulated Mg II line profile has narrower wings than the observed one. This discrepancy can be reduced by using a higher microturbulent velocity (27 km/s) in a narrow chromospheric layer. In addition, we found that an increase of electron density in the upper chromosphere within a narrow height range of approx. 800 km below the transition region can turn the simulated Mg II line core into emission and thus reproduce the single peaked profile, which is a common feature in all IRIS flares.

Da Costa, Fatima Rubio↗
DOE OSTI2016

DATA-DRIVEN RADIATIVE HYDRODYNAMIC MODELING OF THE 2014 MARCH 29 X1.0 SOLAR FLARE

Spectroscopic observations of solar flares provide critical diagnostics of the physical conditions in the flaring atmosphere. Some key features in observed spectra have not yet been accounted for in existing flare models. Here we report a data-driven simulation of the well-observed X1.0 flare on 2014 March 29 that can reconcile some well-known spectral discrepancies. We analyzed spectra of the flaring region from the Interface Region Imaging Spectrograph ( IRIS ) in Mg ii h and k, the Interferometric BIdimensional Spectropolarimeter at the Dunn Solar Telescope (DST/IBIS) in H α 6563 Å and Ca ii 8542 Å, and the Reuven Ramaty High Energy Solar Spectroscope Imager ( RHESSI ) in hard X-rays. We constructed a multithreaded flare loop model and used the electron flux inferred from RHESSI data as the input to the radiative hydrodynamic code RADYN to simulate the atmospheric response. We then synthesized various chromospheric emission lines and compared them with the IRIS and IBIS observations. In general, the synthetic intensities agree with the observed ones, especially near the northern footpoint of the flare. The simulated Mg ii line profile has narrower wings than the observed one. This discrepancy can be reduced by using a higher microturbulent velocity (27 km s{sup −1}) in a narrow chromospheric layer. In addition, we found that an increase of electron density in the upper chromosphere within a narrow height range of ≈800 km below the transition region can turn the simulated Mg ii line core into emission and thus reproduce the single peaked profile, which is a common feature in all IRIS flares.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

A data-driven linear formulation of the optimal demand response scheduling problem for an industrial air separation unit

Demand response (DR) has become a key element in balancing the power grid as the contribution of time-varying renewable power generation increases. Chemical plants are appealing candidates for DR programs as they offer large, concentrated and flexible loads. DR participation calls for frequent production rate changes over time scales that overlap with the dominant dynamics of the plant. Production scheduling should therefore consider the process dynamics explicitly. Here we present a data-driven approach for modelling the scheduling-relevant dynamics based on historical closed-loop operating data using autoregressive with extra inputs (ARX) models. We introduce a new, linear scheduling problem formulation based on the ARX representation, and demonstrate its implementation on an industrial air separation unit.

42 ENGINEERING↗
DOE OSTI2023

Continental Scale Hydrostratigraphy: Basin‐Scale Testing of Alternative Data‐Driven Approaches

Abstract Integrated hydrological modeling is an effective method for understanding interactions between parts of the hydrologic cycle, quantifying water resources, and furthering knowledge of hydrologic processes. However, these models are dependent on robust and accurate datasets that physically represent spatial characteristics as model inputs. This study evaluates multiple data‐driven approaches for estimating hydraulic conductivity and subsurface properties at the continental‐scale, constructed from existing subsurface dataset components. Each subsurface configuration represents upper (unconfined) hydrogeology, lower (confined) hydrogeology, and the presence of a vertical flow barrier. Configurations are tested in two large‐scale U.S. watersheds using an integrated model. Model results are compared to observed streamflow and steady state water table depth (WTD). We provide model results for a range of configurations and show that both WTD and surface water partitioning are important indicators of performance. We also show that geology data source, total subsurface depth, anisotropy, and inclusion of a vertical flow barrier are the most important considerations for subsurface configurations. While a range of configurations proved viable, we provide a recommended Selected National Configuration 1 km resolution subsurface dataset for use in distributed large‐and continental‐scale hydrologic modeling.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Data-Driven Analysis of Multipactor Dynamics via Dynamic Mode Decomposition

Multipactor effect is a performance-limiting kinetic plasma effect that can occur in high-power microwave and radio frequency (RF) devices. Multipactor effect is of special concern in vacuum or near-vacuum conditions such as those in particle accelerators and spaceborne devices. In this work, we present a data-driven reduced-order model (ROM) based on dynamic mode decomposition (DMD) for modeling of multipactor effects. We study multipactor effects and the resulting nonlinear harmonic generation by processing high-fidelity data generated from electromagnetic particle-in-cell (EMPIC) simulations using the DMD algorithm. We also investigate time-delay embedding extensions of DMD with improved generalizability and accuracy for modeling the electron plasma current density behavior. Here, the results show that DMD provides valuable insights into multipactor phenomena by extracting relevant modal spatiotemporal patterns and frequencies. In addition, DMD offers the potential to time extrapolate EMPIC simulations at a minimal cost, thereby reducing overall simulation time.

43 PARTICLE ACCELERATORS↗
NASA NTRS2023

A Data-driven, Physics-based Transport Model of Solar Energetic Particles Accelerated by Coronal Mass Ejection Shocks Propagating through the Solar Coronal and Heliospheric Magnetic Fields

In an effort to develop computational tools for predicting radiation hazards from solar energetic particles (SEPs), we have created a data-driven physics-based particle transport model to calculate the injection, acceleration, and propagation of SEPs from coronal mass ejection (CME) shocks traversing through the solar corona and interplanetary magnetic fields. The model runs on an input of corona and heliospheric plasma and magnetic field configuration from a magnetohydrodynamic model driven by solar photospheric magnetic field measurements superposed with observed CME shocks determined from coronagraph images. SEP source particles are injected at the shock using the result of diffusive shock acceleration formulation from a characteristic obliquity-dependent injection from a heated solar wind thermal tail population. With several advanced computation techniques involving stochastic simulation and integration, the model obtains the particle intensity at any location in interplanetary space through the rigorous solution to the time-dependent 5D focus transport equation in the phase space that includes perpendicular diffusion. We apply the model to the 2011 November 3 CME event. The calculation results reproduce multispacecraft SEP observations at Earth and STEREO-B reasonably well without normalization of particle flux. The observations at STEREO-A can be reproduced by rescaling particle energy or modified energy dependence of particle diffusion coefficients. This circumsolar SEP event seen by spacecraft at Earth, STEREO-A, and STEREO-B at widely separated longitudes can be explained by diffusive shock acceleration by a single CME shock with a moderate speed.

Solar energetic particles↗
DOE OSTI2017

Data-driven optimal charging decision making for connected and automated electric vehicles: A personal usage scenario

This study introduces an optimal charging decision making framework for connected and automated electric vehicles under a personal usage scenario. This framework aims to provide charging strategies, i.e. the choice of charging station and the amount of charged energy, by considering constraints from personal daily itineraries and existing charging infrastructure. A data-driven method is introduced to establish a stochastic energy consumption prediction model with consideration of realistic uncertainties. This is performed by analyzing a large scale electric vehicle data set. A real-time updating method is designed to construct this prediction model from new consecutive data points in an adaptive way for real-world applications. Based on this energy cost prediction framework from real electric vehicle data, multistage optimal charging decision making models are introduced, including a deterministic model for average outcome decision making and a robust model for safest charging strategies. A dynamic programming algorithm is proposed to find the optimal charging strategies. Detailed simulations and case studies demonstrate the performance of the proposed algorithms to find optimal charging strategies. They also show the potential capability of connected and automated electric vehicles to reduce the range anxiety and charging infrastructure dependency.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗