Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data driven model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

LLNL Automized Surface Titration Model

The LLNL Automized Surface Titration Model (L-ASTM) is a community data-driven surface complexation modeling workflow for simulating potentiometric titration of mineral surfaces. The model accepts raw experimental potentiometric titration data formatted in a findable, accessible, interoperable, and reusable (FAIR) structure. The workflow was coded in Python and coupled to PHREEQC for surface complexation modeling and PEST for data fitting and parameter estimation.

Solchan, Han↗

Physics-Infused AI/ML Based Digital-Twin Framework for Flow-Induced-Vibration Damage Prediction in a Nuclear Reactor Heat Exchanger

This report summarizes some of the ongoing work related to the development of an expert-elicitation-digital-twin framework for real time damage state prediction in heat exchanger components of a nuclear reactor. The framework is targeted towards predicting damage associated with coupled low cycle fatigue (associated with regular heat-up, cool-down and power operation transients) and high cycle fatigue (associated with flow induced vibration transients). The overall framework will be based on a NoSQL based database, physics-infused-geometry-dependent virtual-sensor data, different AI/ML techniques-based data-driven-predictive-model applications (Apps) and real-time plant sensor measurements available through few existing sensors. Towards this overall goal, this report updates some of the ongoing work, such as on implementation of a NoSQL Database (such as MongoDB), FE based heat transfer analysis of a heat exchanger (e.g. of a PWR steam generator) for generating geometry-dependent virtual sensor data and evaluation of various AI/ML models such as based on multivariate linear regression, ensembled decision-tree based Random-Forest and Gradient-Boosting regression and high-dimensional-kernel-function-transformation based Support-Vector-Machine regression models. The AI/ML models were evaluated for predicting multi-time-series thermal states at thousands of 3D point-clouds

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Asymptotic consistency of the WSINDy algorithm in the limit of continuum data

In this work we study the asymptotic consistency of the weak-form sparse identification of nonlinear dynamics algorithm (WSINDy) in the identification of differential equations from noisy samples of solutions. We prove that the WSINDy estimator is unconditionally asymptotically consistent for a wide class of models that includes the Navier–Stokes, Kuramoto–Sivashinsky and Sine–Gordon equations. We thus provide a mathematically rigorous explanation for the observed robustness to noise of weak-form equation learning. Conversely, we also show that, in general, the WSINDy estimator is only conditionally asymptotically consistent, yielding discovery of spurious terms with probability one if the noise level exceeds a critical threshold σ c . We provide explicit bounds on σ c in the case of Gaussian white noise and we explicitly characterize the spurious terms that arise in the case of trigonometric and/or polynomial libraries. Furthermore, we show that, if the data is suitably denoised (a simple moving average filter is sufficient), then asymptotic consistency is recovered for models with locally-Lipschitz, polynomial-growth nonlinearities. Our results reveal important aspects of weak-form equation learning, which may be used to improve future algorithms. We demonstrate our findings numerically using the Lorenz system, the cubic oscillator, a viscous Burgers-growth model and a Kuramoto–Sivashinsky-type high-order PDE.

asymptotic consistency↗

Adaptive Online Model Update Algorithm for Predictive Control in Networked Systems

In this article, we introduce an adaptive on-line model update algorithm designed for predictive control applications in networked systems, particularly focusing on power distribution systems. Unlike traditional methods that depend on historical data for offline model identification, our approach utilizes real-time data for continuous model updates. This method integrates seamlessly with existing online control and optimization algorithms and provides timely updates in response to real-time changes. This methodology offers significant advantages, including a reduction in the communication network bandwidth requirements by minimizing the data exchanged at each iteration and enabling the model to adapt after disturbances. Furthermore, our algorithm is tailored for non-linear convex models, enhancing its applicability to practical scenarios. The efficacy of the proposed method is validated through a numerical study, demonstrating improved control performance using a synthetic IEEE test case.

data-driven model predictive control↗

Real-Time MENTAT programming language and architecture

Real-time MENTAT, a programming environment designed to simplify the task of programming real-time applications in distributed and parallel environments, is described. It is based on the same data-driven computation model and object-oriented programming paradigm as MENTAT. It provides an easy-to-use mechanism to exploit parallelism, language constructs for the expression and enforcement of timing constraints, and run-time support for scheduling and exciting real-time programs. The real-time MENTAT programming language is an extended C++. The extensions are added to facilitate automatic detection of data flow and generation of data flow graphs, to express the timing constraints of individual granules of computation, and to provide scheduling directives for the runtime system. A high-level view of the real-time MENTAT system architecture and programming language constructs is provided.

Grimshaw, Andrew S.↗

Uncertainty Quantification for Capacity Expansion Planning

This report quantifies the uncertainty in output decisions from a Capacity Expansion Planning (CEP) model. The need to understand how uncertainties within CEP models and modeling assumptions affect Quantities of Interest (QoIs) such as expansion and operating costs, as well as expansion decisions remains an ongoing challenge in scientific research and industrial operations. This area of research is particularly important for models which seek to capture how large networks will evolve and operate under increased sources of variable generation, i.e., higher penetration of renewable technologies such as solar and wind generators. Uncertainty quantification (UQ) of CEP models which estimate expansion costs and decisions, and production cost models which estimate operating costs and dispatch decisions, is a key focus of research at NREL. The Regional Energy Deployment System (ReEDS) represents a state-of-the-art CEP model and considers a range of possible grid evolutions in an attempt to identify key drivers, ramifications, and decisions which contribute to better informed investment and policy decisions. However, research to quantify how uncertainties and model assumptions, such as unit commitment (UC), within ReEDS may be affecting its outputs remains challenging due to to size and complexity of the model

24 POWER TRANSMISSION AND DISTRIBUTION↗

Creep and Creep Fracture Modeling with Surrogate Creep Models and the Extended Finite Element Method

Alloy components in advanced nuclear reactors will be subjected to environmental conditions that could include high temperatures, irradiation, and exposure to corrosive salts. These conditions could lead to the formation of crack-like defects, which could grow over time in a mechanism known as creep crack growth (CCG). Predicting growth rates of these defects is important for assessing the safe operating life of advanced reactors. This project documents progress toward developing and testing next-generation data-driven constitutive models for deformation creep. It also documents the application of the extended finite element method in conjunction with surrogate creep models to predict CCG parameters under a variety of conditions. These important incremental developments contribute to the longer-term objective of developing microstructure-aware constitutive models that can be used for predicting creep deformation and CCG at the component scale with improved accuracy.

36 MATERIALS SCIENCE↗

Building thermal dynamics modeling with deep transfer learning using a large residential smart thermostat dataset

Understanding thermal dynamics and obtaining the computational model of residential buildings enable its scaled application in energy retrofits, control optimization and decarbonization. In this paper, we present a deep learning approach to model building thermal dynamics with smart thermostat data collected from residential buildings, with the goal to investigate model generalizability. In the first stage, we developed and compared different Deep Learning architectures including Convolutional Neural Networks (CNN), Long Short-Term Memory (LSTM) models and CNN-LSTM to predict indoor air temperature in a multi-step time horizon. In the second stage, we implemented a Transfer Learning (TL) process, which aims to improve the prediction performance on a new set of buildings (targets), exploiting the knowledge of related or similar buildings (sources). Different TL strategies and source model identification methods were investigated. The study showed that the CNN-LSTM performed the best among the architectures compared, with an average Mean Absolute Error (MAE) of 0.26 °C for one-hour-ahead (twelve 5-min future steps) predictions. Furthermore, the results showed that freezing the LSTM layer and fine-tuning the other layers of the CNN-LSTM achieved the best performance among four TL strategies, which further improved the performance with respect to a machine learning approach by 10%, and proving the effectiveness and generalizability of the proposed approach. A comparison of three different source model identification methods showed that randomly selecting source models constrained by similar building characteristics can provide good TL performance while retaining simplicity comparing with other quantitative source identification methods.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Formation and retrieval of cell assemblies in a biologically realistic spiking neural network model of area CA3 in the mouse hippocampus

The hippocampal formation is critical for episodic memory, with area Cornu Ammonis 3 (CA3) a necessary substrate for auto-associative pattern completion. Recent theoretical and experimental evidence suggests that the formation and retrieval of cell assemblies enable these functions. Yet, how cell assemblies are formed and retrieved in a full-scale spiking neural network (SNN) of CA3 that incorporates the observed diversity of neurons and connections within this circuit is not well understood. Here, we demonstrate that a data-driven SNN model quantitatively reflecting the neuron type-specific population sizes, intrinsic electrophysiology, connectivity statistics, synaptic signaling, and long-term plasticity of the mouse CA3 is capable of robust auto-association and pattern completion via cell assemblies. Our results show that a broad range of assembly sizes could successfully and systematically retrieve patterns from heavily incomplete or corrupted cues after a limited number of presentations. Furthermore, performance was robust with respect to partial overlap of assemblies through shared cells, substantially enhancing memory capacity. These novel findings provide computational evidence that the specific biological properties of the CA3 circuit produce an effective neural substrate for associative learning in the mammalian brain.

hetero-association↗

Spatiotemporal Modeling of Real World Backsheets Field Survey Data: Hierarchical (Multilevel) Generalized Additive Models: Preprint

Assessing photovoltaic module backsheet durability is critical to increasing module lifetime. Lab based accelerating testing has recently failed to predict large scale failures of widely adopted polymeric materials. Field surveyed data is critical to assess the performance of component lifetime. Using a documented field survey protocol, 13 field surveys where conducted. Each measurement is encoded with it's spatial location in respect to the other modules. By combining field survey data on degradation predictors with real time satellite weather data, data-driven predictive models of backsheet degradation were trained. LOESS models were constructed to investigate the spatial dependence of measurements. It was found that micro-climatic effects like treelines, ground surface changes, and elevation changes effected the magnitude and variance of the measurements. A GAM model was created to predict the value of degradation based on measured predictors. The model includes variables on the climate of the system and the location of each measurement in the PV mounting structure. The model performed well with an adj:R2 of 0:95 for yellowness index prediction. The model was cross-validated using k-folds.

backsheet↗

Satellite Monitoring of Global Surface Soil Organic Carbon Dynamics Using the SMAP Level 4 Carbon Product

Soil organic carbon (SOC) is an important metric of soil health and the terrestrial carbon balance. Short‐term climate variations affect SOC through changes in temperature and moisture, which control vegetation growth and soil decomposition. We evaluated a satellite data‐driven carbon model, operating under the NASA Soil Moisture Active‐Passive (SMAP) mission, as a means of monitoring global surface SOC dynamics. The SMAP Level 4 Carbon (L4C) product estimates a daily global carbon budget including surface (0‐ to 5‐cm depth) SOC. We found that the L4C mean latitudinal SOC distribution is generally consistent with alternative assessments from static soil inventory records and dynamic global vegetation models (r ≥ 0.89). Within forest systems, based on inventory data, L4C SOC is most similar in magnitude to litterfall but is correlated with coarse woody debris ( urn:x-wiley:jgrg:media:jgrg21790:jgrg21790-math-0001) and total SOC ( urn:x-wiley:jgrg:media:jgrg21790:jgrg21790-math-0002). L4C SOC is sensitive to seasonal and annual climate variability, with mean residence times that range from 1.5 years in the wet tropics to 17 years in the cold tundra. Incorporating soil moisture retrievals from the SMAP L‐band (1.4 GHz) microwave radiometer within the L4C algorithm provides enhanced soil moisture sensitivity under low‐to‐moderate vegetation cover (<5 kg/sq.m vegetation water content). The L‐band soil moisture had the greatest impact on the L4C carbon budget in semiarid regions, which span almost 60% of the globe and account for substantial variability in the terrestrial carbon sink. The L4C operational product enables prognostic investigations into effects of recent climate trends and anomalies (e.g., droughts and pluvials) on shallow soil carbon dynamics.

K. Arthur Endsley↗

Data-Driven Generic Turbines for Distributed Wind Modeling, Optimization, and Economic Studies

As distributed energy resources (DER) become less expensive and more popular, utilities, project developers, and customers have an increasing need to model the performance of existing and proposed DER systems. Distributed wind has been shown to have widespread economic potential but is often represented by a simplified model in - or excluded from - DER modeling tools and studies. There is often no economic imperative to extend models and studies to give full consideration to distributed wind. We present a set of data-driven generic turbines derived from 16 years of annual distributed wind market survey data. The proposed methodology can be used to derive generic turbines from separate or updated data sets. Finally, a mixed-integer linear programming approach to optimal distributed wind project sizing is used to demonstrate the generic turbine models. Combined, these models and methods can reduce barriers to considering distributed wind in modeling tools and studies.

Reiman, Andrew P.↗

Spatio-Temporal Modeling of Field Surveyed Backsheet Degradation

Assessing photovoltaic module backsheet durability is critical to increasing module lifetime. Lab based accelerating testing has recently failed to predict large scale failures of widely adopted polymeric materials. Field surveyed data is critical to assess the performance of component lifetime. Using a documented field survey protocol, 13 field surveys where conducted. Each measurement is encoded with it's spatial location in respect to the other modules. By combining field survey data on degradation predictors with real time satellite weather data, data-driven predictive models of backsheet degradation were trained. LOESS models were constructed to investigate the spatial dependence of measurements. It was found that micro-climatic effects like tree-lines, ground surface changes, and elevation changes effected the magnitude and variance of the measurements. A GAM model was created to predict the value of degradation based on measured predictors. The model includes variables on the climate of the system and the location of each measurement in the PV mounting structure. The model performed well with an adj.R 2 of 0.95 for yellowness index prediction. The model was cross-validated using k-folds.

backsheet↗

An Algebra of Machine Learners with Applications

Machine learning (ML) methods are increasingly being applied to solve complex, data-driven problems in diverse areas, by exploiting the physical laws derived from first principles such as thermal hydraulics and the abstract laws developed recently for data and computing infrastructures. These physical and abstract laws encapsulate, typically in compact algebraic forms, the critical knowledge that complements data-driven ML models. We present a unified perspective of these laws and ML methods using an abstract algebra (A;⊕,Ⓧ), wherein the performance estimation and classification tasks are characterized by the additive ⊕ operations, and the diagnosis, reconstruction, and optimization tasks are characterized by the difference Ⓧ operations. This abstraction provides ML codes and their performance characterizations that are transferable across different areas. We describe practical applications of these abstract operations using examples of throughput profile estimation tasks in data transport infrastructures, and power-level and sensor error estimation tasks in nuclear reactor systems.

Rao, Nageswara↗

Deep Reinforcement Learning Enabled Physical-Model-Free Two-Timescale Voltage Control Method for Active Distribution Systems

Active distribution networks are being challenged by frequent and rapid voltage violations due to renewable energy integration. Conventional model-based voltage control methods rely on accurate parameters of the distribution networks, which are difficult to achieve in practice. This paper proposes a novel physical-model-free two-timescale voltage control framework for active distribution systems. To achieve fast control of PV inverters, the whole network is first partitioned into several subnetworks using voltage-reactive power sensitivity. Then, the scheduling of PV inverters in the multiple sub-networks is formulated as Markov games and solved by a multi-agent soft actor-critic (MASAC) algorithm, where each subnetwork is modeled as an intelligent agent. All agents are trained in a centralized manner to learn a coordinated strategy while being executed based on only local information for fast response. For the slower time-scale control, OLTCs and switched capacitors are coordinated by a single agent-based SAC algorithm using the global information with considering control behaviors of the inverters. Particularly, the two-level agents are trained concurrently with information exchange according to the reward signal calculated from the data-driven surrogate model. Comparative tests with different benchmark methods on IEEE 33-and 123-bus systems and 342-node low voltage distribution system demonstrate that the proposed method can effectively mitigate the fast voltage violations and achieve systematical coordination of different voltage regulation assets without the knowledge of accurate system model.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Predictive Skill of Deep Learning Models Trained on Limited Sequence Data

In this report we investigate the utility of one-dimensional convolutional neural network (CNN) models in epidemiological forecasting. Deep learning models, especially variants of recurrent neural networks (RNNs) have been studied for influenza forecasting, and have achieved higher forecasting skill compared to conventional models such as ARIMA models. In this study, we adapt two neural networks that employ one-dimensional temporal convolutional layers as a primary building block temporal convolutional networks and simple neural attentive meta-learner for epidemiological forecasting and test them with influenza data from the US collected over 2010-2019. We find that epidemiological forecasting with CNNs is feasible, and their forecasting skill is comparable to, and at times, superior to, RNNs. Thus CNNs and RNNs bring the power of nonlinear transformations to purely data-driven epidemiological models, a capability that heretofore has been limited to more elaborate mechanistic/compartmental disease models.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

The predictive skill of convolutional neural networks models for disease forecasting

In this paper we investigate the utility of one-dimensional convolutional neural network (CNN) models in epidemiological forecasting. Deep learning models, in particular variants of recurrent neural networks (RNNs) have been studied for ILI (Influenza-Like Illness) forecasting, and have achieved a higher forecasting skill compared to conventional models such as ARIMA. In this study, we adapt two neural networks that employ one-dimensional temporal convolutional layers as a primary building block—temporal convolutional networks and simple neural attentive meta-learners—for epidemiological forecasting. We then test them with influenza data from the US collected over 2010-2019. We find that epidemiological forecasting with CNNs is feasible, and their forecasting skill is comparable to, and at times, superior to, plain RNNs. Thus CNNs and RNNs bring the power of nonlinear transformations to purely data-driven epidemiological models, a capability that heretofore has been limited to more elaborate mechanistic/compartmental disease models.

59 BASIC BIOLOGICAL SCIENCES↗

Virtual sensing of wind turbine hub loads and drivetrain fatigue damage, Virtuelle Sensoren für die Messung von Hauptwellenlasten und Ermüdungsschäden im Antriebstrang von Windenergieanlagen

Abstract: This paper presents a Digital Twin for virtual sensing of wind turbine aerodynamic hub loads, as well as monitoring the accumulated fatigue damage and remaining useful life in drivetrain bearings based on measurements of the Supervisory Control and Data Acquisition (SCADA) and the drivetrain condition monitoring system (CMS). The aerodynamic load estimation is realized with data-driven regression models, while the estimation of local bearing loads and damage is conducted with physics-based, analytical models. Field measurements of the DOE 1.5 research turbine are used for model training and validation. The results show low errors of 6.4% and 1.1% in the predicted damage at the main and the generator side high-speed bearing respectively. Zusammenfassung: In diesem Aufsatz wird ein digitaler Zwilling für Windenergieanlagen vorgestellt, welcher die virtuelle Erfassung der Hauptwellenlasten und die Zustandsüberwachung von Ermüdungschäden und der verbleibende Nutzungsdauer der Antriebsstranglager ermöglicht. Der digital Zwilling nutzt Messdaten des Supervisory Control and Data Acquisition (SCADA) Systems und des Zustandsüberwachungssystems des Antriebsstranges (CMS). Die Berechnung der Hauptwellenlasten ist mit datenbasierten Regressionsmodellen umgesetzt, während die Berechnung der Lagerkräfte und der Ermüdungsschaden mit physikbasierten Modelle durchgeführt wird. Für die Modellentwicklung und -validierung werden Feldmessdaten der DOE 1.5MW Turbine eingesetzt. Die Abweichungen in den Ermüdungsschäden am Hauptwellenlager und am Generatorwellenlager betragen lediglich 6,4% beziehungsweise 1,1%.

17 WIND ENERGY↗