Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “recurrence”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

A generative artificial intelligence framework for long-time plasma turbulence simulations

Generative deep learning techniques are employed in a novel framework for the construction of surrogate models capturing the spatiotemporal dynamics of 2D plasma turbulence. The proposed Generative Artificial Intelligence Turbulence (GAIT) framework enables the acceleration of turbulence simulations for long-time transport studies. GAIT leverages a convolutional variational auto-encoder and a recurrent neural network to generate new turbulence data from existing simulations, extending the time horizon of transport studies with minimal computational cost. The application of the GAIT framework to plasma turbulence using the Hasegawa–Wakatani (HW) model is presented, evaluating its performance via various analyses. Very good agreement is found between the GAIT and the HW models in the spatiotemporal Fourier and Proper Orthogonal Decomposition spectra, the flow topology characterized by the Okubo–Weiss parameter, and the time autocorrelation function of turbulent fluctuations. Excellent agreement has also been obtained in the probability distribution function of particle displacements and the effective turbulent diffusivity. In-depth analyses of the latent space of turbulent states, choice of hyperparameters and alternative deep learning models for the time prediction are presented. Our results highlight the potential of Artificial Intelligence-based surrogate models to overcome the computational challenges in turbulence simulation, which can be extended to other situations such as geophysical fluid dynamics.

Artificial intelligence↗
DOE OSTI2025

Understanding plasma turbulence through exact coherent structures

Plasma turbulence is a key challenge in understanding transport phenomena in magnetically confined plasmas. This work presents a generalized framework to analyze plasma turbulence that utilizes periodic orbit theory. In periodic orbit theory, doubly periodic solutions (coherent structures) of the governing equation(s) serve as building blocks of the considered turbulent dynamics. To illustrate the concept and method, the particularly simple Kuramoto–Sivashinsky (referred to here as LMRT for the original authors: LaQuey, Mahajan, Rutherford, and Tang) trapped-ion mode toy model is used. By applying numerical optimization techniques to the LMRT equation, we extract coherent spacetime patterns that represent the library of allowable fundamental structures of the equation. These structures provide a framework to systematically describe turbulence as a composition of recurrent solutions, revealing an underlying order within chaotic plasma motion. Although illustrated here using the simplified LMRT model for clarity, this framework provides a general strategy that can be extended to more complex and realistic models of plasma turbulence, including gyrokinetic systems. This offers a new method for predicting and potentially controlling transport processes in fusion plasmas by providing a bridge between nonlinear dynamical systems theory and plasma physics in the form of a generalized framework with which to analyze and understand spatially extended nonlinear partial differential equations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Analytical integration of the tractions induced by non-singular dislocations on an arbitrary shaped triangular quadratic element

Here, an analytical model is proposed to evaluate the nodal force induced by a segment of dislocation upon an arbitrary shaped triangular element. This calculation is required in hybrid methods that associate dislocation dynamics to boundary or finite element to solve simultaneously the evolution of large ensembles of dislocations with complex boundary conditions. Nodal forces are defined as the triple integration of the unbalanced traction field induced by a straight dislocation upon the surface of the element. Following our previous approach (Queyreau et al 2014 Modelling Simul. Mater. Sci. Eng. 22 035004) on a simpler geometry and in the case of linear isotropic elasticity, triple integrals are solved by sequences of integration by parts that exhibit recurrence relations. The traction field is defined and finite everywhere even at the core of dislocations, thanks to the use of the non-singular stress expression formulated by Cai et al (2006 J. Mech. Phys. Solids 54 561–587). The nodal force expressions can be used when considering both a single convolution or double convolution of the Green's function with the core distribution. A solution is also proposed for the case of a semi-infinite segment through the study of the asymptotic behavior of the analytical expressions. The proposed approach is exact and very computationally efficient. The choice of an arbitrary shaped triangular element and quadratic shape functions allow the consideration of complex geometries and comply with automatic meshing procedures. These analytical expressions could also be employed to estimate dislocation interactions with interfaces.

42 ENGINEERING↗
DOE OSTI2021

Characterizing the acceleration time of laser-driven ion acceleration with data-informed neural networks

Peak ion energy is an important figure-of-merit in short-pulse, laser-driven ion acceleration and is dependent on an associated acceleration time. Standard metrics for these quantities depend on analytical results such as the self-similar fluid model or empirical models based on relatively small experimental and simulation datasets. In this work we attempt to use a data-informed neural network (NN) as a surrogate model for a large ensemble of PIC simulations to investigate an effective acceleration time. We explore the application of a stacked convolutional and recurrent NN architecture for improved regression by incorporating the time dependencies of the data into the training process. Of particular note is how pretraining a network on lower fidelity data, e.g. 1D analytical results, greatly improves the network's ability to learn more complex, higher fidelity data. Finally, the dependency of the acceleration time on various laser and plasma parameters is explored.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Comparison of machine learning systems trained to detect Alfvén eigenmodes using the CO 2 interferometer on DIII-D

Abstract A Machine-Learning (ML) based detection scheme that automatically detects Alfvén Eigenmodes (AE) in a labelled DIII-D database is presented here. Controlling AEs is important for the success of planned burning plasma devices such as ITER, since resonant fast ions can drive AEs unstable and degrade the performance of the plasma or damage the first walls of the machine vessel. Artificial Intelligence could be useful for real-time detection and control of AEs in steady-state plasma scenarios by implementing ML-based models into control algorithms that drive actuators for mitigation of AE impacts. Thus, the objective is to compare differences in performance between using two different recurrent neural network systems (Reservoir Computing Network and Long Short Term Memory Network) and two different representations of the C O 2 phase data (simple and crosspower spectrograms). All C O 2 interferometer chords are used to train both models, but only one is processed during each training step. The results from the model and data comparison show higher performance for the RCN model (True Positive Rate = 90% and False Positive Rate = 14%), and that using simple magnitude spectrograms is sufficient to detect AEs. Also, the vertical C O 2 interferometer chord passing near the center is better for ML-based detection of AEs.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Development of a data-driven neural network model for electron thermal transport in NSTX

A data-driven electron thermal transport neural network (ETT-NN) model, trained on TRANSP interpretative analysis results of National Spherical Torus Experiment (NSTX), was developed to enable faster and more accurate ETT computation for spherical tokamaks (STs). The model incorporates both convolutional NNs and recurrent NNs, allowing it to simultaneously account for the spatial and temporal non-localities and multi-scale features of turbulent transport, which have been considered only in a limited manner in conventional models. The model was validated through interpretative analysis and predictive simulations using Tokamak Reactor Integrated Automated Suite for Simulation and Computation, demonstrating relatively high accuracy. Additionally, parameter scans were performed on test discharges known to exhibit specific turbulent modes, such as microtearing mode, trapped electron mode, kinetic ballooning mode, and electron temperature gradient mode. The scanning results revealed that the ETT-NN model exhibits the same trends as those observed in conventional gyrokinetic simulations or theories, while also capturing the global nature of turbulent transport, indicating that the data-driven model accurately reflects the underlying physical characteristics. Furthermore, due to the dimensionless nature of the model, we can feasibly expand its applicability by incorporating data from other devices and uncovering the characteristics of ETT in STs in the future.

NSTX↗
DOE OSTI2020

Enhancement of Unsteady and 3D Aerodynamics Models using Machine Learning

Unsteady aerodynamics will be an important part of the floating wind turbines of the future operating under high shear across the rotor disk coupled with platform motion and atmospheric turbulence. We develop an unsteady aerodynamics and dynamic stall model using a long short-term memory variant of recurrent neural networks. The neural network model is trained using the oscillating airfoil data set from Ohio State University. The predictions from our machine learning (ML)-based model show good agreement with the experimental data and other state-of-the-art dynamic stall models for a wide range of airfoils, Reynolds numbers and reduced frequencies. In some cases the predictions are better than the Beddoes-Leishman model implementation in OpenFAST, when using the default coefficients. The ML-based model is also able to capture the key physics associated with dynamic stall, such as the precedence of moment stall before lift stall and cycle-to-cycle variations in the aerodynamic response. The new unsteady aerodynamics model is expected to improve prediction of fatigue loads for yaw-based wake-steering control scenarios in actuator-line and actuator-disc simulations of wind farms. Our methodology for training the ML-model provides a pathway for improving design level tools using high-fidelity computational fluid dynamics (CFD) simulations in the future.

17 WIND ENERGY↗
DOE OSTI2020

A DNN surrogate unsteady aerodynamic model for wind turbine loads calculations

A recurrent deep-neural network (DNN) surrogate model capable of modeling the unsteady aerodynamic response and dynamic stall behavior of wind turbine blades has been developed and validated for use in engineering design codes. The model is trained using a subset of the oscillating airfoil experiments conducted at the Ohio State University wind tunnel. The predictions from our DNN model show excellent agreement with the measured data and, in all cases, a marked improvement over the state-of-the-art unsteady aerodynamic models. The DNN-based unsteady aerodynamics model was integrated with OpenFAST to perform full-turbine load computations for the NREL-5MW rotor. The largest differences are observed for the inboard stations, particularly in the pitching moment response, when using the new surrogate model compared to the other models available in OpenFAST.

17 WIND ENERGY↗
DOE OSTI2024

On Building Predictive Digital Twin Incorporating Wave Predicting Capabilities: Case Study on UMaine Experimental Campaign - FOCAL

The response of floating wind turbines (FWT) are susceptible to stochastic wave variations. For the optimal operation of FWT, a comprehensive understanding of the phaseresolved wave dynamics and the consequential system response is crucial for real-time monitoring and control. A multi-variate, multi-step, long short term memory (MLSTM), a type of recurrent neural network (RNN) is used to capture complex system dynamics for real-time application. Results indicate that the integration of a wave prediction-reconstruction (WRP) model substantially enhances prediction accuracy by 50% on average relative to the baseline model. The improvement is consistent across various wave extremity and prediction horizons, thereby significantly broadening the scope for timely and precise predictive capabilities.

17 WIND ENERGY↗
DOE OSTI2021

Deep-Learning based Reconstruction of the Shower Maximum $X_{\mathrm{max}}$ using the Water-Cherenkov Detectors of the Pierre Auger Observatory

The atmospheric depth of the air shower maximum X max is an observable commonly used for the determination of the nuclear mass composition of ultra-high energy cosmic rays. Direct measurements of X max are performed using observations of the longitudinal shower development with fluorescence telescopes. At the same time, several methods have been proposed for an indirect estimation of X max from the characteristics of the shower particles registered with surface detector arrays. In this paper, we present a deep neural network (DNN) for the estimation of X max . The reconstruction relies on the signals induced by shower particles in the ground based water-Cherenkov detectors of the Pierre Auger Observatory. The network architecture features recurrent long short-term memory layers to process the temporal structure of signals and hexagonal convolutions to exploit the symmetry of the surface detector array. We evaluate the performance of the network using air showers simulated with three different hadronic interaction models. Thereafter, we account for long-term detector effects and calibrate the reconstructed X max using fluorescence measurements. Finally, we show that the event-by-event resolution in the reconstruction of the shower maximum improves with increasing shower energy and reaches less than 25 g/cm 2 at energies above 2 × 10 19 eV.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Overcoming persistent challenges in putting environmental flow policy into practice: a systematic review and bibliometric analysis

The implementation of environmental flows (e-flows) aims to reduce the negative impacts of hydrological alteration on freshwater ecosystems. Despite the growing attention to the importance of e-flows since the 1970s, actual implementation has lagged. Therefore, we explore the limitations in e-flows implementation, their systemic reasons, and solutions. We conducted a systematic review and a bibliometric analysis to identify peer-reviewed articles published on the topic of e-flows implementation research in the last two decades, resulting in 68 research and review papers. Co-occurrence of terms, and geographic and temporal trends were analyzed to identify the gaps in environmental water management and propose recommendations to address limitations on e-flows implementation. We identify the underlying causes and potential solutions to such challenges in environmental water management. The limitations to e-flow implementation identified were categorized into 21 classes. The most recognized limitation was the competing priorities of human uses of water (n = 29). Many secondary limitations, generally co-occurring in co-causation, were identified as limiting factors, especially for implementing more nuanced and sophisticated e-flows. The lack of adequate hydrological data (n = 24) and ecological data (n = 28) were among the most mentioned, and ultimately lead to difficulties in starting or continuing monitoring/adaptive management (n = 28) efforts. The lack of resource/capacity (n = 21), experimentation (n = 19), regulatory enforcement (n = 17), and differing authorities involved (n = 18) were also recurrent problems, driven by the deficiencies in the relative importance given to e-flows when facing other human priorities. In order to provide a clearer path for successful e-flow implementation, system mapping can be used as a starting point and general-purpose resource for understanding the sociohydrological problems, interactions, and inherited complexity of river systems. Secondly, we recommend a system analysis approach to address competing demands, especially with the use of coupled water-energy modeling tools to support decision-making when hydropower generation is involved. Such approaches can better assess the complex interactions among the hydrologic, ecological, socioeconomic, and engineering dimensions of water resource systems and their effective management. Lastly, given the complexities in environmental water allocation, implementation requires both scientific rigor and proven utility. Consequently, and where possible, we recommend a move from simplistic flow allocations to a more holistic approach informed by hydroecological principles. To ease conflicts between competing water demands, water managers can realize more 'pop per drop' by supporting key components of a flow regime that include functional attributes and processes that enhance biogeochemical cycling, structural habitat formation, and ecosystem maintenance.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Investigating permafrost carbon dynamics in Alaska with artificial intelligence

Abstract Positive feedbacks between permafrost degradation and the release of soil carbon into the atmosphere impact land–atmosphere interactions, disrupt the global carbon cycle, and accelerate climate change. The widespread distribution of thawing permafrost is causing a cascade of geophysical and biochemical disturbances with global impacts. Currently, few earth system models account for permafrost carbon feedback (PCF) mechanisms. This research study integrates artificial intelligence (AI) tools and information derived from field-scale surveys across the tundra and boreal landscapes in Alaska. We identify and interpret the permafrost carbon cycling links and feedback sensitivities with GeoCryoAI, a hybridized multimodal deep learning (DL) architecture of stacked convolutionally layered, memory-encoded recurrent neural networks (NN). This framework integratesin-situmeasurements and flux tower observations for teacher forcing and model training. Preliminary experiments to quantify, validate, and forecast permafrost degradation and carbon efflux across Alaska demonstrate the fidelity of this data-driven architecture. More specifically, GeoCryoAI logs the ecological memory and effectively learns covariate dynamics while demonstrating an aptitude to simulate and forecast PCF dynamics—active layer thickness (ALT), carbon dioxide flux (CO 2 ), and methane flux (CH 4 )—with high precision and minimal loss (i.e. ALT RMSE : 1.327 cm [1969–2022]; CO 2 RMSE : 0.697µmolCO 2 m −2 s −1 [2003–2021]; CH 4 RMSE : 0.715 nmolCH 4 m −2 s −1 [2011–2022]). ALT variability is a sensitive harbinger of change, a unique signal characterizing the PCF, and our model is the first characterization of these dynamics across space and time.

Environmental Sciences & Ecology↗
DOE OSTI2021

Watch and learn—a generalized approach for transferrable learning in deep neural networks via physical principles

Transfer learning refers to the use of knowledge gained while solving a machine learning task and applying it to the solution of a closely related problem. Such an approach has enabled scientific breakthroughs in computer vision and natural language processing where the weights learned in state-of-the-art models can be used to initialize models for other tasks which dramatically improve their performance and save computational time. Here we demonstrate an unsupervised learning approach augmented with basic physical principles that achieves fully transferrable learning for problems in statistical physics across different physical regimes. By coupling a sequence model based on a recurrent neural network to an extensive deep neural network, we are able to learn the equilibrium probability distributions and inter-particle interaction models of classical statistical mechanical systems. Our approach, distribution-consistent learning, DCL, is a general strategy that works for a variety of canonical statistical mechanical models (Ising and Potts) as well as disordered interaction potentials. Using data collected from a single set of observation conditions, DCL successfully extrapolates across all temperatures, thermodynamic phases, and can be applied to different length-scales. This constitutes a fully transferrable physics-based learning in a generalizable approach.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Training neural networks using Metropolis Monte Carlo and an adaptive variant

Abstract We examine the zero-temperature Metropolis Monte Carlo (MC) algorithm as a tool for training a neural network by minimizing a loss function. We find that, as expected on theoretical grounds and shown empirically by other authors, Metropolis MC can train a neural net with an accuracy comparable to that of gradient descent (GD), if not necessarily as quickly. The Metropolis algorithm does not fail automatically when the number of parameters of a neural network is large. It can fail when a neural network’s structure or neuron activations are strongly heterogenous, and we introduce an adaptive Monte Carlo algorithm (aMC) to overcome these limitations. The intrinsic stochasticity and numerical stability of the MC method allow aMC to train deep neural networks and recurrent neural networks in which the gradient is too small or too large to allow training by GD. MC methods offer a complement to gradient-based methods for training neural networks, allowing access to a distinct set of network architectures and principles.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Predicting nonequilibrium Green’s function dynamics and photoemission spectra via nonlinear integral operator learning

Understanding the dynamics of nonequilibrium quantum many-body systems is an important research topic in a wide range of fields across condensed matter physics, quantum optics, and high-energy physics. However, numerical studies of large-scale nonequilibrium phenomena in realistic materials face serious challenges due to intrinsic high-dimensionality of quantum many-body problems and the absence of time-invariance. The nonequilibrium properties of many-body systems can be described by the dynamics of the correlator, or the Green's function of the system, whose time evolution is given by a high-dimensional system of integro-differential equations, known as the Kadanoff–Baym equations (KBEs). The time-convolution term in KBEs, which needs to be recalculated at each time step, makes it difficult to perform long-time numerical simulation. In this paper, we develop an operator-learning framework based on recurrent neural networks (RNNs) to address this challenge. We utilize RNNs to learn the nonlinear mapping between Green's functions and convolution integrals in KBEs. By using the learned operators as a surrogate model in the KBE solver, we obtain a general machine-learning scheme for predicting the dynamics of nonequilibrium Green's functions. Besides significant savings per each time step, the new methodology reduces the temporal computational complexity from $O(N_t^3)$ to $O(N_t)$ where N t is the number of steps taken in a simulation, thereby making it possible to study large many-body problems which are currently infeasible with conventional KBE solvers. Through various numerical examples, we demonstrate the effectiveness of the operator-learning based approach in providing accurate predictions of physical observables such as the reduced density matrix and time-resolved photoemission spectra. Moreover, our framework exhibits clear numerical convergence and can be easily parallelized, thereby facilitating many possible further developments and applications.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Artificial intelligence-empowered cellular morphometric risk score improves prognostic stratification of cutaneous squamous cell carcinoma

Abstract Background Risk stratification of cutaneous squamous cell carcinoma (cSCC) is essential for managing patients. Objectives To determine if artificial intelligence and machine learning might help to stratify patients with cSCC by risk using more than solely clinical and histopathological factors. Methods We retrieved a retrospective cohort of 104 patients whose cSCCs had been excised with clear margins. Clinical and histopathological risk factors were evaluated. Haematoxylin and eosin-stained slides were scanned and analysed by an algorithm based on the stacked predictive sparse decomposition technique. Cellular morphometric biomarkers (CMBs) were identified via machine learning and used to derive a cellular morphometric risk score (CMRS) that classified cSCCs into clusters of differential prognoses. Concordance analysis, sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV) and accuracy were calculated and compared with results obtained with the Brigham and Women’s Hospital (BWH) staging system. The performance of the combination of the BWH staging system and the CMBs was also analysed. Results There were no differences among the CMRS groups in terms of clinical and histopathological risk factors and T-stage assignment, but there were significant differences in prognosis. Combining the CMRS with BWH staging systems increased distinctiveness and improved prognostic performance. C-indices were 0.91 local recurrence and 0.91 for nodal metastasis when combining the two approaches. The NPV was 94.41% and 96.00%, the PPV was 36.36% and 41.67%, and accuracy reached 86.75% and 89.16%, respectively, with the combined approach. Conclusions CMRS is helpful for cSCC risk stratification beyond classic clinical and histopathological risk features. Combining the information from the CMRS and the BWH staging system offers outstanding prognostic performance for patients with high-risk cSCC.

Pérez-Baena, Manuel J.↗
DOE OSTI2021

DCT4 —A New Member of the Dicarboxylate Transporter Family in C 4 Grasses

Malate transport shuttles atmospheric carbon into the Calvin–Benson cycle during NADP-ME C 4 photosynthesis. Previous characterizations of several plant dicarboxylate transporters (DCT) showed that they efficiently exchange malate across membranes. Here, we identify and characterize a previously unknown member of the DCT family, DCT4, in Sorghum bicolor. We show that SbDCT4 exchanges malate across membranes and its expression pattern is consistent with a role in malate transport during C 4 photosynthesis. SbDCT4 is not syntenic to the characterized photosynthetic gene ZmDCT2, and an ortholog is not detectable in the maize reference genome. We found that the expression patterns of DCT family genes in the leaves of Zea mays, and S. bicolor varied by cell type. Our results suggest that subfunctionalization, of members of the DCT family, for the transport of malate into the bundle sheath plastids, occurred during the process of independent recurrent evolution of C 4 photosynthesis in grasses of the PACMAD clade. We also show that this subfunctionalization is lineage independent. Our results challenge the dogma that key C 4 genes must be orthologues of one another among C 4 species, and shed new light on the evolution of C 4 photosynthesis.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

The effect of shear strain and shear localization on fault healing

The seismic cycle of repeated earthquake failure requires that faults regain frictional strength during the interseismic phase, when the fault is locked or undergoing quasi-static creep. Fault healing plays a central role in determining earthquake stress drop, recurrence interval, elastic radiation frequency and other source parameters. In particular, the longer a fault remains quasi-stationary, the stronger it becomes and the larger the potential stress drop can be for the next event. Here, we address the role of shear strain and strain localization on fault healing and healing rate. We performed slide-hold-slide friction experiments on quartz gouge in the double-direct shear configuration for shear strain up to 25 and hold times from 10 to 1000 s. The results show that both healing and healing rate increase nonlinearly with increasing shear strain. Frictional healing scales with volumetric strain within the laboratory fault zone. Using the volumetric strain upon reshear as a proxy for strain localization, we demonstrate that the capacity of a fault to heal is directly proportional to shear bandwidth and degree of strain localization. The more the deformation is localized, the higher are the healing and healing rate, and thus, the fault strength. Our data provide a framework for understanding variations in fault strength over the seismic cycle and the role of brecciation and strain localization on spatiotemporal variations in fault strength.

58 GEOSCIENCES↗