SEARCH · Engineering Papers

Results for “network dynamics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,243 records · Page 69

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Predictive scale-bridging simulations through active learning

Throughout computational science, there is a growing need to utilize the continual improvements in raw computational horsepower to achieve greater physical fidelity through scale-bridging over brute-force increases in the number of mesh elements. For instance, quantitative predictions of transport in nanoporous media, critical to hydrocarbon extraction from tight shale formations, are impossible without accounting for molecular-level interactions. Similarly, inertial confinement fusion simulations rely on numerical diffusion to simulate molecular effects such as non-local transport and mixing without truly accounting for molecular interactions. With these two disparate applications in mind, we develop a novel capability which uses an active learning approach to optimize the use of local fine-scale simulations for informing coarse-scale hydrodynamics. Our approach addresses three challenges: forecasting continuum coarse-scale trajectory to speculatively execute new fine-scale molecular dynamics calculations, dynamically updating coarse-scale from fine-scale calculations, and quantifying uncertainty in neural network models.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Active learning of neural network potentials for rare events

Developing an automated active learning framework for Neural Network Potentials, focusing on accurately simulating bond-breaking in hexane chains through steered molecular dynamics sampling and assessing model transferability.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Controlling swelling in mixed transport polymers through alkyl side-chain physical cross-linking

Semiconducting conjugated polymers bearing glycol side chains can simultaneously transport both electronic and ionic charges with high charge mobilities, making them ideal electrode materials for a range of bioelectronic devices. However, heavily glycolated conjugated polymer films have been observed to swell irreversibly when subjected to an electrochemical bias in an aqueous electrolyte. The excessive swelling can lead to the degradation of their microstructure, and subsequently reduced device performance. An effective strategy to control polymer film swelling is to copolymerize glycolated repeat units with a fraction of monomers bearing alkyl side chains, although the microscopic mechanism that constrains swelling is unknown. Here we investigate, experimentally and computationally, a series of archetypal mixed transporting copolymers with varying ratios of glycolated and alkylated repeat units. Experimentally we observe that exchanging 10% of the glycol side chains for alkyl leads to significantly reduced film swelling and an increase in electrochemical stability. Through molecular dynamics simulation of the amorphous phase of the materials, we observe the formation of polymer networks mediated by alkyl side-chain interactions. When in the presence of water, the network becomes increasingly connected, counteracting the volumetric expansion of the polymer film.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2023

Overview of Liquid-Metal PFC R&D at the University of Illinois Urbana-Champaign

The design and implementation of future flowing liquid-lithium plasma-facing components (LLPFCs) will be dependent on several factors. Of course, one of the most important is the need to be able to deal with high heat fluxes incident on the surface of the LLPFCs, but there are also several other important liquid-metal behaviors that have been identified for their critical impact on the feasibility of a LLPFC. One of these is the ability to constantly wet 100% of the plasma-facing component area and the best way to achieve that. Another key point is knowing and understanding the erosion and corrosion of the surfaces subject to a flowing liquid-lithium system and the ability for hydrogen and helium uptake by the system. The Center for Plasma Material Interactions (CPMI) has been tasked with looking at these various issues. The Mock-up Entry module for EAST device was used to investigate wetting and erosion effects and to design a suitable distribution and collection system with a liquid-lithium loop. The vapor shielding effects of lithium on the surface were also modeled and studied. A model coupling CRANE, an open-source global reaction network solver, and Zapdos, a plasma transport solver, is being developed to better understand the dynamics of the vapor cloud. Experiments on the Magnum-PSI at the Dutch Institute for Fundamental Energy Research have been carried out to study the vapor shielding effect and obtain experimental benchmarks to verify the model. Also, initial experiments using the Hybrid Illinois Device for Research and Applications have been performed to understand the pumping effects of lithium on helium. Experiments with a drop of liquid lithium (~100 mg) into a helium plasma have shown the ability of lithium to take out the cold recycling helium gas as well as hydrogen and oxygen impurity gases. The improvement in plasma performance was significant, and further understanding of this effect will have impacts on how future LLPFCs will be designed. Further investigation into the exact mechanism for helium pumping by lithium needs to be performed in the future. Finally, this paper presents a summary of the results obtained at the CPMI.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2021

EdgeAI: How to Use AI to Collect Reliable and Relevant Watershed Data

Focal Area(s): Focal areas are on data acquisition and assimilation enabled by AI, advanced methods including experimental/network design/optimization, unsupervised learning (including deep learning), and hardware-related efforts involving AI (e.g., edge computing). Science Challenge: The transformational science challenge that we address is the following: – Ensuring, in near real-time, that the data collected from distributed sensor networks is accurate and contains useful information to identify, quantify, and predict watershed and ecosystem dynamic responses to short- and long-term perturbations.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Robust Real-Time Modeling of Distribution Systems with Data-Driven Grid-Wise Observability (Final Technical Report)

The overall objective of this project is to leverage existing and emerging sensor measurements to develop data-driven observability enhancement algorithms as well as robust state estimation and parameter identification techniques to enable real-time grid-wise monitoring and modeling of loads and distributed energy resources (DERs). The project resulted in a holistic framework with the following key components: 1) data-driven and machine learning-based grid-edge visibility enhancement, 2) robust branch-current-based state estimation (BCSE), and 3) robust real-time steady-state and dynamic-state modeling of loads and DERs. The research outcomes have provided utility companies better network visibility, higher-fidelity load/DER models, and more accurate assessment of DERs’ impacts, thus, facilitating the integration of renewable energy sources. The synergistic collaborative project among Iowa State University (ISU), Argonne National Laboratory (ANL), Electric Power Research Center (EPRC), SIEMENS Industry, Alliant Energy, Cedar Falls Utilities (CFU), and Maquoketa Valley Electric Cooperative (MVEC) to leverage the team’s extensive expertise and experience in power distribution systems, state estimation, online modeling and identification, and DER integrations. The proposed frameworks have been verified with industry adopted software and attempted integrated with existing tool wherever possible

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2022

Optimizing radar scan strategies for tracking isolated deep convection using observing system simulation experiments

Abstract. Optimizing radar observation strategies is one of the most important considerations in pre-field campaign periods. This is especially true for isolated convective clouds that typically evolve faster than the observations captured by operational radar networks. This study investigates uncertainties in radar observations of the evolution of the microphysical and dynamical properties of isolated deep convective clouds developing in clean and polluted environments. It aims to optimize the radar observation strategy for deep convection through the use of high-spatiotemporal cloud-resolving model simulations, which resolve the evolution of individual convective cells every 1 min, coupled with a radar simulator and a cell tracking algorithm. The radar simulation settings are based on the Tracking Aerosol Convection Interactions ExpeRiment (TRACER) and Experiment of Sea Breeze Convection, Aerosols, Precipitation and Environment (ESCAPE) field campaigns held in the Houston, TX, area but are generalizable to other field campaigns focusing on isolated deep convection. Our analysis produces the following four outcomes. First, a 5–7 m s−1 median difference in maximum updrafts of tracked cells is shown between the clean and polluted simulations in the early stages of the cloud lifetimes. This demonstrates the importance of obtaining accurate estimates of vertical velocity from observations if aerosol impacts are to be properly resolved. Second, tracking of individual cells and using vertical cross section scanning every minute capture the evolution of precipitation particle number concentration and size represented by polarimetric observables better than the operational radar observations that update the volume scan every 5 min. This approach also improves multi-Doppler radar updraft retrievals above 5 km above ground level for regions with updraft velocities greater than 10 m s−1. Third, we propose an optimized strategy composed of cell tracking by quick (1–2 min) vertical cross section scans from more than one radar in addition to the operational volume scans. We also propose the use of a single-RHI (range height indicator) updraft retrieval technique for cells close to the radars, for which multi-Doppler radar retrievals are still challenging. Finally, increasing the number of deep convective cells sampled by such observations better represents the median maximum updraft evolution with sample sizes of more than 10 deep cells, which decreases the error associated with sampling the true population to less than 3 m s−1.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Completion design improvement using a deep convolutional network

Maximizing stimulated natural and hydraulic fracture network is one of the primary hydraulic fracturing concerns for economic production from a horizontal shale gas well. Geomechanical facies and preexisting fractures in each stage are identified based on similarities in formation characteristics to optimize the locations of perforation clusters. This often requires analyzing large volumes of drilling, Logging While Drilling (LWD) and Measurement While Drilling (MWD) data. In this paper, we develop a methodology that calculates the mechanical specific energy (MSE) using real-time drill string acceleration signals directly from its definition. High resolution vibration signals have been collected using a tri-axial accerlometer, which was an auxiliary tool included in acoustic borehole imager. This technique provides a cost-efficient solution for engineered completion design. Furthermore, we adopt deep Convolutional Neural Network (CNN) with signal processing to build a data pipeline that effectively extracts patterns from dynamic acceleration signals for rock lateral MSE classification. First, we apply discrete wavelet transform and Short-Time Fourier Transform (STFT) for signal denoising and pattern recognition. Then we construct an image dataset using multi-scale image fusion at pixel level from 3 sensor channels, including axial, lateral acceleration spectrograms and zero-padded revolutions per minute (RPM). The resulted RGB image dataset includes 4,000 images of 5 MSE ranges with various rock strength conditions. Our results demonstrate that the proposed deep learning model can achieve more than 90% classification accuracy. The deep learning results, as a reference source, were applied in selected Marcellus Shale Energy and Environmental Lab (MSEEL) wells engineered completion located in the Marcellus shale gas site.

03 NATURAL GAS↗

DOE OSTI2021

On the Stochastic Stability of Deep Markov Models

Deep Markov models (DMM) are generative models which are scalable and expressive generalization of Markov models for representation, learning, and inference problems. However, the fundamental stochastic stability guarantees of such models have not been thoroughly investigated. In this paper, we present a novel stability analysis method and provide sufficient conditions of DMM's stochastic stability. The proposed stability analysis is based on the contraction of probabilistic maps modeled by deep neural networks. We make connections between the spectral properties of neural network's weights and different types of used activation function on the stability and overall dynamic behavior of DMMs with Gaussian distributions. Based on the theory, we propose a few practical methods for designing constrained DMMs with guaranteed stability. We empirically substantiate our theoretical results via intuitive numerical experiments using the proposed stability constraints.

Drgona, Jan↗

DOE OSTI2024

Wind turbine power phase control with DC collection bus for onshore/offshore windfarms

A DC bus collection system for a wind farm reduces the overall required number of converters and minimizes the energy storage system requirements. The DC bus collection system implements a power phasing control method between wind turbines that filters the variations and improves power quality. The phasing control method takes advantage of a novel power packet network concept with nonlinear power flow control design techniques that guarantees both stable and enhanced dynamic performance.

Weaver, Wayne W.↗

DOE OSTI2023

Dynamic Model Agnostic Reliability Evaluation of Machine-Learning Models Integrated in Instrumentation & Control Systems

In recent years, the field of machine learning (ML), specifically neural networks, has grown significantly and has spurred research in its applicability to digital instrumentation and control systems (DI&C). While ML models have shown promise in operational contexts, the trustworthiness of using such algorithms has not been adequately assessed. Failures of ML integrated systems are not well understood, and the lack of comprehensive risk modeling can degrade the trustworthiness in these systems. In recent reports by the National Institute for Standards and Technology (NIST) [1] and the Nuclear Regulatory Commission (NRC) [2], they indicate that trustworthiness in ML is a critical barrier and will play a vital role in the safe, accountable, and secure operation of intelligent systems. Thus, in this work, we demonstrate a dynamic model-agnostic method to quantify the relative reliability of AI/ML predictions by incorporating out-of-distribution (OOD) detection on the training dataset. It is well documented that most ML algorithms excel at interpolation (or near-interpolation) tasks but experience significant performance degradation at extrapolation. The method, referenced as the Laplacian distributed decay for reliability (LADDR), determines the difference between the operational and training datasets which can used to the relative reliability of AI/ML predictions. LADDR is then demonstrated on a feedforward neural network based digital twin used for the prediction of safety significant factors during a loss-of-flow transient. LADDR is used to demonstrate how training data can be used as evidence to support the relative reliability of ML/AI predictions enhancing the overall trustworthiness of the system.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2024

Integrating multi-modal remote sensing, deep learning, and attention mechanisms for yield prediction in plant breeding experiments

In both plant breeding and crop management, interpretability plays a crucial role in instilling trust in AI-driven approaches and enabling the provision of actionable insights. The primary objective of this research is to explore and evaluate the potential contributions of deep learning network architectures that employ stacked LSTM for end-of-season maize grain yield prediction. A secondary aim is to expand the capabilities of these networks by adapting them to better accommodate and leverage the multi-modality properties of remote sensing data. In this study, a multi-modal deep learning architecture that assimilates inputs from heterogeneous data streams, including high-resolution hyperspectral imagery, LiDAR point clouds, and environmental data, is proposed to forecast maize crop yields. The architecture includes attention mechanisms that assign varying levels of importance to different modalities and temporal features that, reflect the dynamics of plant growth and environmental interactions. The interpretability of the attention weights is investigated in multi-modal networks that seek to both improve predictions and attribute crop yield outcomes to genetic and environmental variables. This approach also contributes to increased interpretability of the model's predictions. The temporal attention weight distributions highlighted relevant factors and critical growth stages that contribute to the predictions. The results of this study affirm that the attention weights are consistent with recognized biological growth stages, thereby substantiating the network's capability to learn biologically interpretable features. Accuracies of the model's predictions of yield ranged from 0.82-0.93 R 2 ref in this genetics-focused study, further highlighting the potential of attention-based models. Further, this research facilitates understanding of how multi-modality remote sensing aligns with the physiological stages of maize. The proposed architecture shows promise in improving predictions and offering interpretable insights into the factors affecting maize crop yields, while demonstrating the impact of data collection by different modalities through the growing season. By identifying relevant factors and critical growth stages, the model's attention weights provide valuable information that can be used in both plant breeding and crop management. The consistency of attention weights with biological growth stages reinforces the potential of deep learning networks in agricultural applications, particularly in leveraging remote sensing data for yield prediction. To the best of our knowledge, this is the first study that investigates the use of hyperspectral and LiDAR UAV time series data for explaining/interpreting plant growth stages within deep learning networks and forecasting plot-level maize grain yield using late fusion modalities with attention mechanisms.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2020

Insights into the Nanostructure, Solvation, and Dynamics of Liquid Electrolytes through Small-Angle X-Ray Scattering

The fundamental understanding of nanostructures of liquid electrolytes is expected to enable transformative gains in electrochemical energy storage capacities. However, the solvation structures and molecular dynamics in electrolytes are hard to probe, which limits further performance improvements in macroscopic properties such as ionic conductivity, viscosity, and stability. Small-angle X-ray scattering (SAXS), a non-destructive method for nanostructures characterization in liquids, offers a unique perspective on molecular clusters, anion-cation pairs, solvation sheath, percolating network, aggregates, and domain sizes of electrolytes. Notably, the SAXS method has excellent time-resolution, enabling the study of molecular dynamics by operando characterization. This review focuses on the microscopic understanding of liquid electrolytes by SAXS and operando SAXS. The unique capabilities of X-ray scattering for intra- and inter-molecular relationship and nanostructure characterization of electrolytes are highlighted.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2025

Rapid Event Detection via Synchro-Waveform Based Temporal Attention Network in Distributed Grid

Compared with the information collected from phasor measurement units, synchro-waveforms contain high-fidelity disturbances of the grid, which can be a granular and authentic representation of measurements in the modern power system. However, the dynamic changing morphology makes it challenging to effectively capture various disturbance information from the synchro-waveforms. To tackle this issue, this paper proposes a Synchro-waveform based Temporal Attention (STA) network to achieve rapid event detection. First, a multi-scenario distributed model with renewable integration is established to generate synchro-waveforms under various uncertainties. Then, three typical temporal features are extracted directly from the synchro-waveform measurements. Additionally, the lightweight STA network is deployed to identify the most common event types in renewable energy systems via the self-attention based vision transformer module. The results from simulated experiments demonstrate that the proposed approach can achieve rapid and real-time detection within 0.81 ms and over 96.27 % accuracy.

Dong, Yuqing [University of Tennessee (UT)]↗

DOE OSTI2023

Deep neural operators can predict the real-time response of floating offshore structures under irregular waves

The use of neural operators in a digital twin model of an offshore floating structure holds the potential for a significant shift in the prediction of structural responses and health monitoring, offering valuable real-time control insights. In this work, we investigate the effectiveness of three neural operators, namely the deep operator network (DeepONet), the Fourier neural operator (FNO), and the Wavelet neural operator (WNO), to accurately capture the responses of a floating structure under six different sea state codes (3 − 8) based on the wave characteristics described by the World Meteorological Organization (WMO). To further enhance the accuracy of the vanilla architecture of the neural operators, novel extensions, such as wavelet-DeepONet and self-adaptive WNO, are proposed in this paper. The results demonstrate that these high-precision neural operators can deliver structural responses more efficiently, up to two orders of magnitude faster than a dynamic analysis using conventional numerical solvers. Additionally, compared to gated recurrent units (GRUs), a commonly used recurrent neural network for time-series estimation, neural operators are both more accurate and efficient, especially in situations with limited data availability. Taken together, our study shows that FNO outperforms all other operators for approximating the mapping of one input functional space to the output space as well as for responses that have small bandwidth of the frequency spectrum. Conversely, DeepONet, with historical states, proves most accurate in learning the mapping of multiple input functions to the output space and capturing responses within a broad frequency spectrum.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Neural network for 3D inertial confinement fusion shell reconstruction from single radiographs

In inertial confinement fusion (ICF), x-ray radiography is a critical diagnostic for measuring implosion dynamics, which contain rich three-dimensional (3D) information. Traditional methods for reconstructing 3D volumes from 2D radiographs, such as filtered backprojection, require radiographs from at least two different angles or lines of sight (LOS). In ICF experiments, the space for diagnostics is limited, and cameras that can operate on fast timescales are expensive to implement, limiting the number of projections that can be acquired. To improve the imaging quality as a result of this limitation, convolutional neural networks (CNNs) have recently been shown to be capable of producing 3D models from visible light images or medical x-ray images rendered by volumetric computed tomography. Here, we propose a CNN to reconstruct 3D ICF spherical shells from single radiographs. We also examine the sensitivity of the 3D reconstruction to different illumination models using preprocessing techniques such as pseudo-flatfielding. To resolve the issue of the lack of 3D supervision, we show that training the CNN utilizing synthetic radiographs produced by known simulation methods allows for reconstruction of experimental data as long as the experimental data are similar to the synthetic data. We also show that the CNN allows for 3D reconstruction of shells that possess low mode asymmetries. Further comparisons of the 3D reconstructions with direct multiple LOS measurements are justified.

3D Reconstruction↗

DOE OSTI2022

All-Electric Nonassociative Learning in Nickel Oxide

Habituation and sensitization represent nonassociative learning mechanisms in both non-neural and neural organisms. They are essential for a range of functions from survival to adaptation in dynamic environments. Design of hardware for neuroinspired computing strives to emulate such features driven by electric bias and can also be incorporated into neural network algorithms. Herein, cellular-like learning in oxygen-deficient NiO x devices is demonstrated. Both habituation learning and sensitization response can be achieved in a single device by simply controlling the magnitude of the electric field. Spontaneous memory relaxations and dynamic redistribution of oxygen vacancies under electric bias enable such learning behavior of NiO x under sequential training. These characteristics in simple device arrays are implemented to learn alphabets as well as demonstrate simulated algorithmic use cases in digit recognition. Transition metal oxides with carefully prepared defect concentrations can be highly sensitive to electronic structure perturbations under moderate electrical stimulus and serve as building blocks for next-generation neuroinspired computing hardware.

36 MATERIALS SCIENCE↗

DOE OSTI2024

Stochastic representation and conditioning of process-based geological model by deep generative and recognition networks

Accurate and realistic geological modeling is the core of oil and gas development and production. In recent years, process-based methods are developed to produce highly realistic geological models by simulating the physical processes that reproduce the sedimentary events and develop the geometry. However, the complex dynamic processes are extremely expensive to simulate, making process-based models difficult to be conditioned to field data. In this work, we propose a comprehensive generative adversarial network framework as a machine-learning-assisted approach for mimicking the outputs of process-based geological models with fast generation. The main objective of our work is to obtain a continuous parametrization of the highly realistic process-based geological models which enables us to calibrate the models and condition the models to data. Numerical results are presented to illustrate the capability of our proposed methodology.

58 GEOSCIENCES↗