Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “adaptive learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,675 records · Page 93

On the influence of over-parameterization in manifold based surrogates and deep neural operators

Constructing accurate and generalizable approximators (surrogate models) for complex physico-chemical processes exhibiting highly non-smooth dynamics is challenging. The main question is what type of surrogate models we should construct and should these models be under-parameterized or over-parameterized. In this work, we propose new developments and perform comparisons for two promising approaches: manifold-based polynomial chaos expansion (m-PCE) and the deep neural operator (DeepONet), and we examine the effect of over-parameterization on generalization. While m-PCE enables the construction of a mapping by first identifying low-dimensional embeddings of the input functions, parameters, and quantities of interest (QoIs), a neural operator learns the nonlinear mapping via the use of deep neural networks. Here, we demonstrate the performance of these methods in terms of generalization accuracy by solving the 2D time-dependent Brusselator reaction-diffusion system with uncertainty sources, modeling an autocatalytic chemical reaction between two species. We first propose an extension of the m-PCE by constructing a mapping between latent spaces formed by two separate embeddings of the input functions and the output QoIs. To further enhance the accuracy of the DeepONet, we introduce weight self-adaptivity in the loss function. We demonstrate that the performance of m-PCE and DeepONet is comparable for cases of relatively smooth input-output mappings. However, when highly non-smooth dynamics is considered, DeepONet shows higher approximation accuracy. We also find that for m-PCE, modest over-parameterization leads to better generalization, both within and outside of distribution, whereas aggressive over-parameterization leads to over-fitting. In contrast, an even highly over-parameterized DeepONet leads to better generalization for both smooth and non-smooth dynamics. Furthermore, we compare the performance of the above models with another recently proposed operator learning model, the Fourier Neural Operator, and show that its over-parameterization also leads to better generalization. Taken together, our studies show that m-PCE can provide very good accuracy at very low training cost, whereas a highly over-parameterized DeepONet can provide better accuracy and robustness to noise but at higher training cost. In both methods, the inference cost is negligible.

97 MATHEMATICS AND COMPUTING↗

Privacy-Preserving Real-Time Action Detection in Intelligent Vehicles Using Federated Learning-Based Temporal Recurrent Network

This study introduces a privacy-preserving approach for the real-time action detection in intelligent vehicles using a federated learning (FL)-based temporal recurrent network (TRN). This approach enables edge devices to independently train models, enhancing data privacy and scalability by eliminating central data consolidation. Our FL-based TRN effectively captures temporal dependencies, anticipating future actions with high precision. Extensive testing on the Honda HDD and TVSeries datasets demonstrated robust performance in centralized and decentralized settings, with competitive mean average precision (mAP) scores. The experimental results highlighted that our FL-based TRN achieved an mAP of 40.0% in decentralized settings, closely matching the 40.1% in centralized configurations. Notably, the model excelled in detecting complex driving maneuvers, with mAPs of 80.7% for intersection passing and 78.1% for right turns. These outcomes affirm the model’s accuracy in action localization and identification. The system showed significant scalability and adaptability, maintaining robust performance across increased client device counts. The integration of a temporal decoder enabled predictions of future actions up to 2 s ahead, enhancing the responsiveness. Our research advances intelligent vehicle technology, promoting safety and efficiency while maintaining strict privacy standards.

33 ADVANCED PROPULSION SYSTEMS↗

The DEAL.II finite element library: Design, features, and insights

DEAL.II is a state-of-the-art finite element library focused on generality, dimension-independent programming, parallelism, and extensibility. In this paper, we outline its primary design considerations and its sophisticated features such as distributed meshes, h p -adaptivity, support for complex geometries, and matrix-free algorithms. But DEAL.II is more than just a software library: It is also a diverse and worldwide community of developers and users, as well as an educational platform. We therefore also discuss some of the technical and social challenges and lessons learned in running a large community software project over the course of two decades.

97 MATHEMATICS AND COMPUTING↗

Towards Geospatial Knowledge Graph Infused Neuro-Symbolic AI for Remote Sensing Scene Understanding

Deep learning has proven its effectiveness in numerous tasks for remote sensing scene understanding. However there is an increasing interest to explore fusion of domain-specific background information to the deep neural network to further improve its performance. Remote sensing researchers are also working towards developing models that generalize and adapt to multiple applications. Generalization challenges coupled with the scarcity of large corpora of high-quality noise-free labelled data, have together fueled an interest for leveraging background information. Knowledge graphs serve as excellent choice to represent domain-specific information in a structured, standardized and extensible manner. Integrating symbolic knowledge representations in the form of Knowledge Graph Embedding (KGE) to perform neuro-symbolic reasoning is an emerging research direction promising significant impacts. This vision paper seeks to position ideas and provoke early thoughts toward advancing neuro-symbolic artificial intelligence in the context of geospatial challenges. Specifically, it conceptualizes and elaborates on an architecture for infusing geospatial knowledge from knowledge graph in a deep neural network pipeline. As guiding case studies - land-use land-cover classification, object detection and instance segmentation can benefit from infusing spatio-contextual information with remote sensing imagery. The discussion further reflects on and articulates the challenges and explainable AI opportunities anticipated when scaling and maintaining large-scale geospatial knowledge graphs.

Potnis, Abhishek↗

Semantic Regression for Disentangling Beam Losses in the Fermilab Main Injector and Recycler

Fermilab’s Main Injector enclosure houses two accelerators: the Main Injector (MI) and the Recycler (RR). In periods of joint operation, when both machines contain high intensity beam, radiative beam losses from MI and RR overlap on the enclosure’s beam loss monitoring (BLM) system, making it difficult to attribute those losses to a single machine. Incorrect diagnoses result in unnecessary downtime that incurs both financial and experimental cost. In this work, we introduce a novel neural approach for automatically disentangling each machine’s contributions to those measured losses. Using a continuous adaptation of the popular UNet architecture in conjunction with a novel data augmentation scheme, our model accurately infers the machine of origin on a per-BLM basis in periods of joint and independent operation. Crucially, by extracting beam loss information at varying receptive fields, the method is capable of learning both local and global machine signatures and producing high quality inferences using only raw BLM loss measurements.

43 PARTICLE ACCELERATORS↗

Multi-objective automatic discovery of optimized metamaterials for varying velocity impact protection

Mechanical metamaterials have demonstrated exceptional impact performance while remaining lightweight. Impact resistance has traditionally been investigated using quasi-static simulations, often with the assumption that performance will translate to high-velocity impact scenarios. However, critical crash protection parameters—such as peak stress and absorbed energy—are highly sensitive to impact velocity, leading to inconsistent performance under dynamic loading. To address this, we introduce a strain-rate-aware, active deep learning framework that enables multi-objective optimization of impact protection metrics across a wide range of impact velocities. Our framework captures the strain-rate sensitivity of architected lattices by learning to control spatial gradation in cellular metamaterials, resulting in over 200 % enhancement in impact protection relative to state-of-the-art designs such as Voronoi and re-entrant lattices. We demonstrate its practical utility by designing next-generation lattice structures for automotive bumper systems that satisfy multiple, velocity-specific safety criteria—capabilities beyond those of conventional designs. More than just a predictive tool, this framework marks the first step towards enabling adaptable impact-resistant structures across dynamic regimes.

Deep learning↗

iSTEM Summer Institute: An Integrated Approach to Teacher Professional Development inSTEM

The importance of STEM education to our national prosperity and global competitiveness was recently reinforced by the Obama administration support for Change the Equation. Change the Equation is a multi-entity initiative formed in response to the rapidly increasing demand for STEM related careers and the potential lack of preparation by many Americans to be employed in these positions. To address the issue many are calling for increased emphasis on K-12 STEM education, as early preparation in STEM provides the foundation essential for further learning and competencies (National Research Council, 2007). Achieving and sustaining depth and breadth of K-12 STEM education is inextricably linked to ongoing professional development of K-12 educators. The need for teacher continuing education in STEM education and the link between teacher effectiveness and student preparation in STEM was the impetus behind our i- STEM professional development summer institute. The i-STEM initiative is a collaborative effort between business, industry, government, K-12, and higher education. Although the organization is working on a number of projects, including policy, research, communication, and collaborations, the i-STEM group has directed significant resources toward K-12 educator professional development opportunities in STEM. Our report focuses on the structure and impact of the intensive four-day i-STEM residential professional development institute which we designed to increase the capacity of grade 4-9 teachers to teach STEM content. We structured the summer institute using the outcome of a survey we conducted of grade 4-9 teachers’ to assess their STEM professional development needs, the extant literature on teacher development, the increasing need for a STEM informed society, and our desire to use evidence based practices to enhance teacher capacity to teach STEM content. We developed this investigation to determine if our summer institute influenced the participating teachers comfort with teaching STEM, efficacy for teaching STEM, content knowledge of STEM, inquiry implementation in STEM, and perceptions of STEM education. These parameters in-part have been gathered previously for specific areas of math or science education, but we are not aware of any study in which these variables have been attended to and assessed in the context of enhancing inservice teacher preparation to teach STEM. Therefore, our project provides a unique contribution to the literature because of our focus on STEM education and our adaptation and use of an array of assessment tools to measure the impact on our participants’ perceptions of teaching STEM, affective perspectives, and knowledge of the related content. Further, we are responding to the position of Putnam and Borko (2000) who contend there has been a dearth of attention paid toward creating teacher professional development experiences consistent with the teacher learning and investigations of the impact of the experience on the participating educators. Before we present our research and results, we discuss the relevant literature establishing the justification for our study. Following the presentation of our study results we discuss the related implications and directions for future research. We conclude with a discussion of study limitations and some closing remarks of our study contributions to the field of teacher professional development in STEM education.

99 GENERAL AND MISCELLANEOUS↗

A Multiagent Deep Reinforcement Learning-Enabled Dual-Branch Damping Controller for Multimode Oscillation

Here, this study develops a multiagent deep reinforcement learning (MADRL)-enabled framework for the decentralized cooperative control of a novel dual-branch (DB) damping controller for both low-frequency oscillation (LFO) and ultralow-frequency oscillation (ULFO). It has two branches, each of which consists of a proportional resonance (PR) and a second-order polynomial that is designed to handle target oscillation modes. To improve the robustness of the controller to system uncertainties, MADRL is developed, where multiagents are centrally trained to obtain the coordinated adaptive control policy while being executed in a decentralized manner to provide the optimal parameter setting for each controller with only local states. Comparisons with the IEEE 10-machine 39-bus system demonstrate that the proposed method achieves better robustness to uncertainties, lower communication delay, and single-point failure, as well as damping control performances for both LFO and ULFO.

97 MATHEMATICS AND COMPUTING↗

A Reinforcement Learning Approach to Augment Conventional PID Control in Nuclear Power Plant Transient Operation

The ability of nuclear reactors to operate their power conversion cycles more flexibly will enhance their value to energy grids with variable pricing. Current nuclear control systems are typically classical controllers that are often based on proportional-integral-derivative (PID) control. This paper presents a method of augmenting the existing PID control for difficult transient operations in nuclear power plants using a reinforcement learning–derived feedforward signal applied in real time. The agents, which are trained on a test thermal load-following problem, are designed to improve steam generator outlet temperature control for a range of fast load-following scenarios covering ramp rates from 9%/min to 15%/min. Several reinforcement learning algorithms were initially investigated for the training of the feedforward agents with deep Q-learning (DQN) and proximal policy optimization (PPO) networks, which were found to be the most promising. The DQN controllers utilize discrete actions, giving them a better disturbance rejection at steady state but inconsistent response to initial temperature deviations. In contrast, PPO-trained agents, which take continuous actions except for a dead zone around zero, were shown to have the best combination of high disturbance rejection at steady state and good tracking of the desired temperature value. The ability of the PPO agent was also examined, with the average time of decision making found to be on the order of 1 ms. The fault properties of the controller under the loss of the reinforcement learning agent feedforward signal were also examined. The controller showed strong performance in situations of “no-signal” faults. but was less good at handling “stuck-at” faults, where the feedforward signal remains at a set value. In both cases, however, the PID was able to successfully maintain stability, eventually returning the system to a steady state. It is hoped that this work will allow for the proposed control architecture to be examined for more difficult control problems such that it may eventually be used to adapt existing nuclear plants for more aggressive load-following on grids of the future.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Manifold projection image segmentation for nano-XANES imaging

As spectral imaging techniques are becoming more prominent in science, advanced image segmentation algorithms are required to identify appropriate domains in these images. We present a version of image segmentation called manifold projection image segmentation (MPIS) that is generally applicable to a broad range of systems without the need for training because MPIS uses unsupervised machine learning with a few physically motivated hyperparameters. We apply MPIS to nanoscale x-ray absorption near edge structure (XANES) imaging, where XANES spectra are collected with nanometer spatial resolution. We show the superiority of manifold projection over linear transformations, such as the commonly used principal component analysis (PCA). Moreover, MPIS maintains accuracy while reducing computation time and sensitivity to noise compared to the standard nano-XANES imaging analysis procedure. Finally, we demonstrate how multimodal information, such as x-ray fluorescence data and spatial location of pixels, can be incorporated into the MPIS framework. We propose that MPIS is adaptable for any spectral imaging technique, including scanning transmission x-ray microscopy, where the length scale of domains is larger than the resolution of the experiment.

36 MATERIALS SCIENCE↗

Design of Digital Twin Sensing Strategies Via Predictive Modeling and Interpretable Machine Learning

This work develops a methodology for sensor placement and dynamic sensor scheduling decisions for digital twins. The digital twin data assimilation is posed as a classification problem, and predictive models are used to train optimal classification trees that represent the map from observed data to estimated digital twin states. In addition to providing a rapid digital twin updating capability, the resulting classification trees yield an interpretable mathematical representation that can be queried to inform sensor placement and sensor scheduling decisions. The proposed approach is demonstrated for a structural digital twin of a 12 ft wingspan unmanned aerial vehicle. Offline, training data are generated by simulating scenarios using predictive reduced-order models of the vehicle in a range of structural states. Furthermore, these training data can be further augmented using experimental or other historical data. In operation, the trained classifier is applied to observational data from the physical vehicle, enabling rapid adaptation of the digital twin in response to changes in structural health. Within this context, we study the performance of the optimal tree classifiers and demonstrate how they enable explainable structural assessments from sparse sensor measurements and also inform optimal sensor placement.

47 OTHER INSTRUMENTATION↗

ELM‐MOSART‐DOC: A Large‐Scale Riverine Dissolved Organic Carbon Model and Its Application Over the United States

Riverine dissolved organic carbon (DOC), primarily sourced from soil organic carbon (SOC), plays a crucial role in regional and global carbon cycles. However, the complexities of the underlying mechanisms and limited observations present significant challenges for predictive understanding of DOC at regional or larger scales. Recently, we developed a machine learning‐based (ML) map of DOC transformation rates, bridging the gap between SOC and DOC leaching flux and simplifying terrestrial DOC representation. Building on this advancement, we introduce ELM‐MOSART‐DOC, a DOC module integrated into the riverine component of the Energy Exascale Earth System Model (E3SM)—the Model for Scale Adaptive River Transport (MOSART). ELM‐MOSART‐DOC simulates DOC transport and transformation across both headwater streams and river networks, including those managed. Model validation demonstrates the ability of ELM‐MOSART‐DOC to accurately capture long‐term average DOC concentrations, with Kling‐Gupta Efficiency (KGE) scores of 0.58 and 0.76 at large and local stations, respectively. We further assess the impact of reservoirs through different simulation schemes, revealing that reservoirs significantly alter DOC fluxes by regulating streamflow patterns and promoting DOC mineralization. Model simulations indicate that reservoirs reduce total DOC flux from the Mississippi River into the ocean by 7.5%, with the long‐term average annual export decreasing from 3.34 to 3.14 teragrams (Tg) per year. ELM‐MOSART‐DOC integrates process‐based modeling with ML parameterization to enhance the predictive understanding of riverine biogeochemical processes. This approach reduces uncertainties in modeling regional and global carbon cycle ESMs and provides new insights into carbon cycling and its implications for global environmental change.

Li, Lingbo [Univ. of Houston, TX (United States); ↗

Extended Kalman Filter Based Neural Networks Controller For Hot Strip Rolling mill

The present paper deals with the application of an Extended Kalman filter based adaptive Neural-Network control scheme to improve the performance of a hot strip rolling mill. The suggested Neural Network model was implemented using Bayesian Evidence based training algorithm. The control input was estimated iteratively by an on-line extended Kalman filter updating scheme basing on the inversion of the learned neural networks model. The performance of the controller is evaluated using an accurate model estimated from real rolling mill input/output data, and the usefulness of the suggested method is proved.

42 ENGINEERING↗

Data-Driven Voltage Regulation of Distribution Grid Using Nonlinear Autoregressive Model with Exogenous Inputs (NARX)

This article proposes data-driven control via a nonlinear autoregressive model with exogenous inputs (NARX) for real-time voltage regulation of a modified feeder using reactive power sources. Traditional voltage control strategies rely on rule-based heuristics or optimization techniques, which often require detailed system models and extensive computational resources. The NARX-based controller learns system dynamics from historical data and predicts optimal reactive power dispatch in real-time for voltage correction. The proposed approach is evaluated on a power system feeder model under varying load and network conditions. Simulation results demonstrate that the NARX-based controller achieves improved voltage regulation, offering higher adaptability to system fluctuations. This study highlights the potential of data-driven control for enhancing the reliability of power distribution networks.

Donge, Vrushabh [ORNL] (ORCID:0000000306062803)↗

A high-throughput experimentation platform for data-driven discovery in electrochemistry

Automating electrochemical analyses combined with artificial intelligence is poised to accelerate discoveries in renewable energy sciences and technologies. This study presents an automated high-throughput electrochemical characterization (AHTech) platform as a cost-effective and versatile tool for rapidly assessing liquid analytes. The Python-controlled platform combines a liquid handling robot, potentiostat, and customizable microelectrode bundles for diverse, reproducible electrochemical measurements in microtiter plates, minimizing chemical consumption and manual effort. To showcase the capability of AHTech, we screened a library of 180 small molecules as electrolyte additives for aqueous zinc metal batteries, generating data for training machine learning models to predict Coulombic efficiencies. Key molecular features governing additive performance were elucidated using Shapley Additive exPlanations and Spearman’s correlation, pinpointing high-performance candidates like cis-4-hydroxy-d-proline, which achieved an average Coulombic efficiency of 99.52% over 200 cycles. The workflow established herein is highly adaptable, offering a powerful framework for accelerating the exploration and optimization of extensive chemical spaces across diverse energy storage and conversion fields.

Lin, Dian-Zhao [Johns Hopkins University, Baltimor↗

Plateau Phenomenon in Gradient Descent Training of RELU Networks: Explanation, Quantification, and Avoidance

The ability of neural networks to provide ‘best in class’ approximation across a wide range of applications is well-documented. Nevertheless, the powerful expressivity of neural networks comes to naught if one is unable to effectively train (choose) the parameters defining the network. In general, neural networks are trained by gradient descent type optimization methods,a stochastic variant thereof. In practice, such methods result in the loss function decreases rapidly at the beginning of training but then, after a relatively small number of steps, significantly slow down. The loss may even appear to stagnate over the period of a large number of epochs, only to then suddenly start to decrease fast again for no apparent reason. This so-called plateau phenomenon manifests itself in many learning tasks. The present work aims to identify and quantify the root causes of plateau phenomenon.analysis is carried out in the setting of univariate ReLU networks. No assumptions are made on the number of neurons relative to the number of training data, and our results hold for both the lazy and adaptive regimes. Here, the main findings are: plateaux correspond to periods during which activation patterns remain constant, where activation pattern refers to the number of data points that activate a given neuron; quantification of convergence of the gradient flow dynamics; and, characterization stationary points in terms solutions of local least squares regression lines over subsets of the training data. Based on these conclusions, we propose a new iterative training method, the Active Neuron Least Squares (ANLS), characterised by the explicit adjustment of the activation pattern at each step, which is designed to enable a quick exit from a plateau. Illustrative numerical examples are included throughout.

97 MATHEMATICS AND COMPUTING↗

Local models for scatter estimation and descattering in polyenergetic X-ray tomography

We propose a new modeling approach for scatter estimation and descattering in polyenergetic X-ray computed tomography (CT) based on fitting models to local neighborhoods of a training set. X-ray CT is widely used in medical and industrial applications. X-ray scatter, if not accounted for during reconstruction, creates a loss of contrast in CT reconstructions and introduces severe artifacts including cupping, shading, and streaks. Even when these qualitative artifacts are not apparent, scatter can pose a major obstacle in obtaining quantitatively accurate reconstructions. Our approach to estimating scatter is, first, to generate a training set of 2D radiographs with and without scatter using particle transport simulation software. To estimate scatter for a new radiograph, we adaptively fit a scatter model to a small subset of the training data containing the radiographs most similar to it. We compared local and global (fit on full data sets) versions of several X-ray scatter models, including two from the recent literature, as well as a recent deep learning-based scatter model, in the context of descattering and quantitative density reconstruction of simulated, spherically symmetrical, single-material objects comprising shells of various densities. Our results show that, when applied locally, even simple models provide state-of-the-art descattering, reducing the error in density reconstruction due to scatter by more than half.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Best Practices for Modeling and Simulation of CO 2 Storage

The purpose of this best practices manual (BPM) is to describe lessons learned and best practices for modeling and simulation of carbon dioxide (CO 2 ) geologic storage (herein “storage”) projects. Information presented here is derived from laboratory and field storage project activities conducted by the Plains CO 2 Reduction (PCOR) Partnership. Modeling and simulation collectively comprise one of four technical elements of the adaptive management approach (AMA) formalized by the PCOR Partnership for storage project development. The other technical elements are site characterization; risk assessment; and monitoring, verification, and accounting (MVA) of injected CO 2 .

54 ENVIRONMENTAL SCIENCES↗