Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “feedforward”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Machine Learning-Based Model Predictive Control of Two-Time-Scale Systems

In this study, we present a general form of nonlinear two-time-scale systems, where singular perturbation analysis is used to separate the dynamics of the slow and fast subsystems. Machine learning techniques are utilized to approximate the dynamics of both subsystems. Specifically, a recurrent neural network (RNN) and a feedforward neural network (FNN) are used to predict the slow and fast state vectors, respectively. Moreover, we investigate the generalization error bounds for these machine learning models approximating the dynamics of two-time-scale systems. Next, under the assumption that the fast states are asymptotically stable, our focus shifts toward designing a Lyapunov-based model predictive control (LMPC) scheme that exclusively employs the RNN to predict the dynamics of the slow states. Additionally, we derive sufficient conditions to guarantee the closed-loop stability of the system under the sample-and-hold implementation of the controller. A nonlinear chemical process example is used to demonstrate the theory. In particular, two RNN models are constructed: one to model the full two-time-scale system and the other to predict solely the slow state vector. Both models are integrated within the LMPC scheme, and we compare their closed-loop performance while assessing the computational time required to execute the LMPC optimization problem.

97 MATHEMATICS AND COMPUTING↗

Source-sink relationships

Life on earth depends on the growth and survival of plants. In order for plants to grow and develop effectively, coordination between sources and sinks is required. Source organs provide a net uptake of resources whilst sink organs have a net drawdown of resources. Molecular mechanisms regulate the relationship between sources and sinks. These molecular mechanisms include carbon- and nitrogen-containing metabolites, plant hormones, and genes. Sources and sinks for both carbon and nitrogen are key contributors to plant growth, and these regulate themselves and one another via feedback, feedforward, and crosstalk mechanisms. Our understanding of the relationships between sources and sinks is increased by experimental manipulations of the source-sink balance. To bring about increases in crop growth and yield, a holistic view of sources and sinks must be developed, including the molecular mechanisms underpinning the relationships between them. Mathematical modelling can be an effective tool for providing this unified perspective.

54 ENVIRONMENTAL SCIENCES↗

A machine learning approach for clinker quality prediction and nonlinear model predictive control design for a rotary cement kiln

Abstract Cement manufacturing is energy‐intensive (5Gj/t) and comprises a significant portion of the energy footprint of concrete systems. Incorporating modern monitoring, simulation and control systems will allow lower energy use, lower environmental impact, and lower costs of this widely used construction material. One of the goals of the CESMII roadmap project on the Smart Manufacturing of Cement included developing an analytical process model for clinker quality that includes the chemistry of the kiln feed and accounts for critical process variables. This predictive model will be used in nonlinear model predictive control system designed to significantly reduce process energy use while maintaining or improving product quality. In the cement manufacturing plant used in this study, the kiln feed (meal) is tested every 12 h and used to estimate the mineral composition of the cement kiln output (clinker) using the stoichiometry‐based Bogue's model and the expertise of the plant operators. During kiln operation, kiln output (clinker) is sampled and tested every 2 h to measure its chemical and mineral composition. The predicted and measured values of the clinker composition are used by the plant operators to adjust the kiln input stream and the production process characteristics to maintain stable operation and uniform product quality. However, the time delay between prediction and testing, along with inaccuracies inherent in the Bogue's model have made any process changes designed to minimize energy use problematic, especially in‐light of potential clinker quality issues that process changes often pose. A new analytical model that integrates quality information and process operation information has been developed from data collected from 2 years of production from an operating cement facility. To make the model fuel‐type‐independent, consumed heat energy was computed in the model instead of fuel type and amount. A Feedforward Network was trained and tailored from collected data. Many data‐based simulations were conducted to quantitatively evaluate the proposed model and the 5‐fold cross‐validation procedure was used to test the models. The resulting predictive model was shown to have a low root mean square error (MSE) with respect to the estimated clinker mineral composition compared to that using the industry standard “Bogue’ model”. The end goal of this work was to develop a single machine learning tool that allows the use of quality control data and process control variables to improve energy efficiency of the process in a continuous fashion. The proposed nonlinear model predictive control system (NMPC) can generate predicted kiln production characteristics based on manipulated variables in manner that accurately follows the target product quality values. Simulation results also show that the proposed model produced accurate predictions of kiln outputs that fell within the required constraints, while manipulating control variables within typical operational ranges.

Ali, Asem M.↗

Predictive analytics of selections of russet potatoes

We explore the application of machine learning algorithms specifically to enhance the selection process of Russet potato (Solanum tuberosum L.) clones in breeding trials by predicting their suitability for advancement. This study addresses the challenge of efficiently identifying high-yield, disease-resistant, and climate-resilient potato varieties that meet processing industry standards. Leveraging manually collected data from trials in the state of Oregon, we investigate the potential of a wide variety of state-of-the-art binary classification models. The dataset includes 1086 clones, with data on 38 attributes recorded for each clone, focusing on yield, size, appearance, and frying characteristics, with several control varieties planted consistently across four Oregon regions from 2013 to 2021. We conduct a comprehensive analysis of the dataset that includes preprocessing, feature engineering, and imputation to address missing values. We focus on several key metrics such as accuracy, F1-score, and Matthews correlation coefficient (MCC) for model evaluation. The top-performing models, namely a feedforward neural network classifier (Neural Net), a histogram-based gradient boosting classifier (HGBC), and a support vector machine classifier (SVM), demonstrate consistent and significant results. To further validate our findings, we conducted a simulation study using the aims, data-generating mechanisms, estimands, methods, and performance measures (ADEMP) framework, simulating different data-generating scenarios to assess model robustness and performance through true positive, true negative, false positive, and false negative distributions, area under the receiver operating characteristic curve (AUC-ROC) and MCC. The simulation results highlight that non-linear models like SVM and HGBC consistently show higher AUC-ROC and MCC than logistic regression, thus outperforming the traditional linear model across various distributions, and emphasizing the importance of model selection and tuning in agricultural trials. Variable selection further enhances model performance and identifies influential features in predicting trial outcomes. The findings emphasize the potential of machine learning in streamlining the selection process for potato varieties, offering benefits such as increased efficiency, substantial cost savings, and judicious resource utilization. Our study contributes insights into precision agriculture and showcases the relevance of advanced technologies for informed decision-making in breeding programs.

60 APPLIED LIFE SCIENCES↗

Determining the twist angle of stacked MoS 2 layers using machine learning-assisted low-frequency interlayer Raman fingerprints

The investigation of twisted stacked few-layer MoS 2 has revealed novel electronic, optical, and vibrational properties over an extended period. For the successful integration of twisted stacked few-layer MoS 2 into a wide range of applications, it is crucial to employ a noninvasive, versatile technique for characterizing the layered architecture of these complex structures. Here, in this work, we introduce a machine learning-assisted low-frequency Raman spectroscopy method to characterize the twist angle of few-layer stacked MoS 2 samples. A feedforward neural network (FNN) is utilized to analyze the low-frequency breathing mode as a function of the twist angle. Moreover, using finite difference method (FDM) and density functional theory (DFT) calculations, we show that the low-frequency Raman spectra of MoS 2 are mainly influenced by the effect of the nearest and second nearest layers. A new improved linear chain model (TA-LCM) with taking the twist angle into the consideration is developed to understand the interlayer breathing modes of stacked few-layer MoS 2 . This approach can be extended to other 2D materials systems and provides an intelligent way to investigate naturally stacked and twisted interlayer interactions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Filtering adaptive output feedback control for multivariable nonlinear systems with mismatched uncertainties and unmodeled dynamics

This article synthesizes a filtering adaptive output feedback controller for multivariable nonlinear systems with mismatched uncertainties and unmodeled dynamics. The multivariable nonlinear systems under consideration have both matched and mismatched uncertainties, which satisfy the semiglobal Lipschitz condition. The unmodeled dynamics are bounded-input bounded-output stable. By adopting an estimation/cancellation strategy, a piecewise constant adaptive law drives the estimation error to zero at every time instant, which yields the adaptive parameters; a disturbance rejection control law is designed to compensate the nonlinear uncertainties within the bandwidth of low-pass filters. The matched uncertainties are cancelled directly by adopting their opposite in the control signal, while a dynamic inversion of the system is required to eliminate the effect of the mismatched uncertainties on the output. A feedforward control law is designed to track a given command. Since the virtual reference system defines the best performance that can be achieved by the closed-loop system, the uniform performance bounds are derived for the states and control signals via comparison. Both numerical and practical examples are provided to illustrate the effectiveness of the proposed filtering adaptive output feedback control architecture, comparisons with the model reference adaptive control demonstrates the superiority of the proposed control method.

filtering adaptive control, mismatched uncertainit↗

Fast and Accurate Predictions of Total Energy for Solid Solution Alloys with Graph Convolutional Neural Networks

We use graph convolutional neural networks (GCNNs) to produce fast and accurate predictions of the total energy of solid solution binary alloys. GCNNs allow us to abstract the lattice structure of a solid material as a graph, whereby atoms are modeled as nodes and metallic bonds as edges. This representation naturally incorporates information about the structure of the material, thereby eliminating the need for computationally expensive data pre-processing which would be required with standard neural network (NN) approaches. We train GCNNs on ab-initio density functional theory (DFT) for copper-gold (CuAu) and iron-platinum (FePt) data that has been generated by running the LSMS-3 code, which implements a locally self-consistent multiple scattering method, on OLCF supercomputers Titan and Summit. GCNN outperforms the ab-initio DFT simulation by orders of magnitude in terms of computational time to produce the estimate of the total energy for a given atomic configuration of the lattice structure. We compare the predictive performance of GCNN models against a standard NN such as dense feedforward multi-layer perceptron (MLP) by using the root-mean-squared errors to quantify the predictive quality of the deep learning (DL) models. We find that the attainable accuracy of GCNNs is at least an order of magnitude better than that of the MLP.

Lupo Pasini, Massimiliano↗

A priori analysis on deep learning of subgrid-scale parameterizations for Kraichnan turbulence

In the present study, we investigate different data-driven parameterizations for large eddy simulation of two-dimensional turbulence in the a priori settings. These models utilize resolved flow field variables on the coarser grid to estimate the subgrid-scale stresses. We use data-driven closure models based on localized learning that employs a multilayer feedforward artificial neural network with point-to-point mapping and neighboring stencil data mapping, and convolutional neural network fed by data snapshots of the whole domain. The performance of these data-driven closure models is measured through a probability density function and is compared with the dynamic Smagorinksy model (DSM). The quantitative performance is evaluated using the cross-correlation coefficient between the true and predicted stresses. We analyze different frameworks in terms of the amount of training data, selection of input and output features, their characteristics in modeling with accuracy, and training and deployment computational time. We also demonstrate computational gain that can be achieved using the intelligent eddy viscosity model that learns eddy viscosity computed by the DSM instead of subgrid-scale stresses. Here, we detail the hyperparameters optimization of these models using the grid search algorithm.

42 ENGINEERING↗

Modeling design and control problems involving neural network surrogates

Here, we consider nonlinear optimization problems that involve surrogate models represented by neural networks. We demonstrate first how to directly embed neural network evaluation into optimization models, highlight a difficulty with this approach that can prevent convergence, and then characterize stationarity of such models. We then present two alternative formulations of these problems in the specific case of feedforward neural networks with ReLU activation: as a mixed-integer optimization problem and as a mathematical program with complementarity constraints. For the latter formulation we prove that stationarity at a point for this problem corresponds to stationarity of the embedded formulation. Each of these formulations may be solved with state-of-the-art optimization methods, and we show how to obtain good initial feasible solutions for these methods. We compare our formulations on three practical applications arising in the design and control of combustion engines, in the generation of adversarial attacks on classifier networks, and in the determination of optimal flows in an oil well network.

97 MATHEMATICS AND COMPUTING↗

Thermal Response of a Lithium Vapor Divertor to Cyclical Operation

The lithium vapor divertor concept is being developed as a method to achieve detached divertor conditions in a tokamak while minimizing impurity radiation losses from the core plasma. SOLPS-ITER modeling has previously been used to identify some of the geometric constraints and required lithium evaporation rate of a lithium vapor divertor in a medium-sized tokamak during steady-state operation. Here an updated conceptual design based on these operating requirements is introduced and the thermal response of the system is modeled during cyclical operation, consistent with operation in a short-pulse tokamak. Controllability of the temperature of the lithium capillary porous system (CPS) is achieved by adopting a design where there is no line-of-sight for radiation from the plasma to reach the heated CPS surface. Operational strategies to minimize the amount of lithium evaporated between plasma discharges while achieving steady evaporation rates during plasma discharges are discussed and modeled here. The optimal feedforward control strategy demonstrated in this work is to ramp up the temperature of the evaporator as quickly as possible immediately before a plasma discharge and then reduce the heating to match the desired steady-state net evaporation rate just before the plasma discharge begins, allowing the thermal inertia of the system to stabilize the evaporation rate during the first second of the plasma discharge.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

SLAC Microresonator Radio Frequency (SMuRF) Electronics for Read Out of Frequency-Division-Multiplexed Cryogenic Sensors

Large arrays of cryogenic sensors for various imaging applications ranging across x-ray, gamma-ray, cosmic microwave background, mm/sub-mm, as well as particle detection increasingly rely on superconducting microresonators for high multiplexing factors. These microresonators take the form of microwave SQUIDs that couple to transition-edge sensors or microwave kinetic inductance detectors. In principle, such arrays can be read out with vastly scalable software-defined radio using suitable FPGAs, ADCs and DACs. In this work, we share plans and show initial results for SLAC Microresonator Radio Frequency (SMuRF) electronics, a next-generation control and readout system for superconducting microresonators. SMuRF electronics are unique in their implementation of specialized algorithms for closed-loop tone tracking, which consists of fast feedback and feedforward to each resonator’s excitation parameters based on transmission measurements. Closed-loop tone tracking enables improved system linearity, a significant increase in sensor count per readout line, and the possibility of overcoupled resonator designs for enhanced dynamic range. Low-bandwidth prototype electronics were used to demonstrate closed-loop tone tracking on twelve 300-kHz-wide microwave SQUID resonators, spaced at ~ 6 MHz with center frequencies ~ 5–6 GHz. We achieve multi-kHz tracking bandwidth and demonstrate that the noise floor of the electronics is subdominant to the noise intrinsic in the multiplexer.

47 OTHER INSTRUMENTATION↗

Data coverage assessment on neural network based digital twins for autonomous control system

We report in a recently developed Nearly Autonomous Management and Control (NAMAC) system, neural networks (NNs) are used to develop digital twins for diagnosis (DT-Ds). However, NNs are not usually considered extrapolation models and may result in large errors if they are applied to unseen data outside the training data (uncovered). In this study, we propose a data coverage assessment (DCA) to determine if the NN-based DT-Ds are extrapolated based on their epistemic uncertainty. The uncertainty quantification algorithms and uncertainty thresholds are selected based on the confusion matrix of classifying evaluation data into covered or uncovered data. To demonstrate the adaptability of the proposed framework, we applied it to a basic feedforward neural network and a more advanced recurrent neural network based on a more nonlinear database. Case studies show that the proposed framework can distinguish unseen data for both basic and advanced applications with proper uncertainty quantification algorithms and thresholds.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Direct NeTS sampling of nuclear graphite $S(α, β, T)$ in Serpent

For advanced reactor applications, Neural Thermal Scattering (NeTS) modules were developed to predict the thermal scattering law (TSL or $S(α, β, T)$) of a nuclear graphite neutron moderator. NeTS are multi-layer, feedforward artificial neural networks, which act as universal function approximators designed for TSL datasets. In this case, a 4-layer neural network with 164 neurons per layer is trained using FLASSH evaluated data in PyTorch and serialized as a torchscript dictionary to predict $S(α, β, T)$ on-the-fly. Relative, absolute and maximum percent deviations of NeTS from File 7 data generated using the FLASSH code are on the order of 0.01%, 0.1% and 1%, respectively, with low inference latencies of 0.000172 s per $S(α, β, T)$ at a given temperature. Capturing the full dimensionality of possible inelastic neutron-lattice interactions, NeTS functionality is embedded in the Serpent Monte Carlo code, where $S(α, β, T)_{NeTS}$ sampling is conducted on-the-fly and compared to ACE look-up-tables for predicting TREAT criticality. k-eff differences between sampling algorithms of 6 pcm are observed and are within the order of Monte Carlo uncertainty. Compared to discrete and continuous-energy ACE files (30 MB and 131 MB per temperature), the NeTS format is on the order of 200–300 kB for a continuous-temperature, interpolation-free representation of $S(α, β, T)$ and cross sections. NeTS-in-Serpent runtimes comparable with ACE look-up tables are achieved by scaling NeTS for high performance computing architectures with hybrid OpenMP + MPI parallelization. This work validates a novel, self-contained reactor physics framework for predictive cross sections, and demonstrates a general methodology for embedding modern machine learning libraries within existing neutronic analysis frameworks.

Nuclear Criticality Safety Program (NCSP)↗

Differential Etv2 threshold requirement for endothelial and erythropoietic development

Endothelial and erythropoietic lineages arise from a common developmental progenitor. Etv2 is a master transcriptional regulator required for the development of both lineages. However, the mechanisms through which Etv2 initiates the gene-regulatory networks (GRNs) for endothelial and erythropoietic specification and how the two GRNs diverge downstream of Etv2 remain incompletely understood. Here, by analyzing a hypomorphic Etv2 mutant, we demonstrate different threshold requirements for initiation of the downstream GRNs for endothelial and erythropoietic development. We show that Etv2 functions directly in a coherent feedforward transcriptional network for vascular endothelial development, and a low level of Etv2 expression is sufficient to induce and sustain the endothelial GRN. In contrast, Etv2 induces the erythropoietic GRN indirectly via activation of Tal1, which requires a significantly higher threshold of Etv2 to initiate and sustain erythropoietic development. These results provide important mechanistic insight into the divergence of the endothelial and erythropoietic lineages.

59 BASIC BIOLOGICAL SCIENCES↗

Multiscale topology optimization using neural network surrogate models

In this study, we are concerned with optimization of macroscale elastic structures that are designed utilizing spatially varying microscale metamaterials. The macroscale optimization is accomplished using gradient-based nonlinear topological optimization. But instead of using density as the optimization decision variable, the decision variables are the multiple parameters that define the local microscale metamaterial. This is accomplished using single layer feedforward Gaussian basis function networks as a surrogate models of the elastic response of the microscale metamaterial. The surrogate models are trained using highly resolved continuum finite element simulations of the microscale metamaterials and hence are significantly more accurate than analytical models e.g. classical beam theory. Because the derivative of the surrogate model is important for sensitivity analysis of the macroscale topology optimization, a neural network training procedure based on the Sobolev norm is described. Since the SIMP method is not appropriate for spatially varying lattices, an alternative method is developed to enable creation of void regions. Lastly, the efficacy of this approach is demonstrated via several examples in which the optimal graded metamaterial outperforms a traditional solid structure.

42 ENGINEERING↗

Comprehensive assessment of deep reinforcement learning approaches for economic dispatch in nuclear-driven microgrids

As the electrical grid integrates more variable renewable energy sources such as wind and solar, the demand for distributed and flexible systems to address this increased variability becomes critical. Nuclear-driven microgrids provide a promising solution by offering stable generation to complement intermittent renewables, ensuring grid reliability and operating efficiency. This paper proposes a recurrent deep reinforcement learning framework for optimal economic dispatch in a nuclear-powered microgrid integrating renewable energy sources, small modular reactors, battery storage systems, and balance-of-plant dynamics. A three-agent control architecture is developed, where demand and renewable energy agents act as forecasters, and a reinforcement learning-based dispatch agent performs real-time energy allocation. A nonlinear programming formulation is first used to generate an optimal baseline for benchmarking. The proposed dispatch controller, based on Proximal Policy Optimization enhanced with Long Short-Term Memory networks, exploits temporal correlations in system dynamics by taking advantage of the time series used as inputs to improve policy robustness under uncertainty. Comparative analysis against established deep reinforcement learning methods, including Proximal Policy Optimization with a feedforward architecture, Soft Actor-Critic, and Twin Delayed Deep Deterministic Policy Gradient, demonstrates superior performance. Numerical results indicate that the proposed controller achieves a 0.39% cost reduction relative to the nonlinear programming benchmark and outperforms other learning-based methods by generating additional revenue of up to 0.35%. All reinforcement learning controllers compute dispatch actions in less than 0.3 s, resulting in a computational speedup of more than three orders of magnitude over the nonlinear programming baseline. The findings of this paper highlight their applicability for real-time operation and control in nuclear-integrated microgrids under volatile operating conditions.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A signal compensation based cascaded PI control for an industrial heat exchange system

Since the characteristics of the industrial heat exchange system (HES) are drastically affected by variations of the steam pressure, ambient temperature and water quality, it is difficult for the classical cascade PI control system to meet the desirable control objectives. Therefore, in this paper, a deterministic linear model with unmodeled dynamics is used to describe the dynamic characteristics of the HES. It should be noted that the unmodeled dynamics at the previously sampled instant can be calculated using actual measurements and that the tracking error, which includes effects of the rate of changes of unmodeled dynamics on the controlled model, can be accurately determined. An additional compensating signal is obtained with the feedforward control together with a one-step optimal control law. Consequently, the cascade PI control strategy with the signal compensation is established. Furthermore, the simulation and industrial application show that the proposed method can effectively improve the performance of the cascade PI control system, especially when the unmodeled dynamics is subjected to unknown variations.

42 ENGINEERING↗

An adaptive model-free robotic force control strategy for hydrodynamic real-time hybrid simulation of floating offshore wind turbines

Real-time hybrid simulation (RTHS) - a cyber-physical testing approach - promises to enhance the simulation fidelity of the model-scale experiments used to prototype floating offshore wind turbines (FOWTs). In hydrodynamic RTHS (hydro-RTHS), actuators emulate aerodynamic forces on model-scale FOWT specimens subjected to physical waves in a hydrodynamic laboratory. Robotic arms are promising candidates for actuation in hydro-RTHS due to their compact multi-degree-of-freedom (DOF) capabilities. Unlike classical RTHS for seismic applications, which typically relies on displacement control, hydro-RTHS requires 6-DOF force control on newly designed floating prototypes in a model-scale setting, which presents significant challenges, including modeling uncertainties, directional asymmetry, configuration drift, bandwidth limitations, and time-varying delays. To mitigate these constraints without extensive pre-test calibration, this study proposes an adaptive model-free robotic force control strategy that combines task-space explicit force control with a secondary joint-space pose-keeping task. The Adaptive Feedforward Compensator (AFC) is integrated into the force control loop to compensate for time-varying delay. Experimental testing was conducted using a Franka Emika Panda robotic arm with a 1:50 scale FOWT specimen under operational wind and wave conditions. Results demonstrate stable and consistent 6-DOF force tracking. Effective delay compensation was observed, with low-frequency delay reductions ranging from 71.4% to 91.8% and improvements in low-frequency surge force tracking of 25.0% to 52.1%. This study enhances robotic actuation performance in hydro-RTHS and introduces a force control strategy that supports reliable robotic operation in uncertain floating environments. Future work will explore disturbance-observer mechanisms to further enhance wave rejection capabilities under extreme wind and wave conditions.

17 WIND ENERGY↗