Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Nonlinear optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Uncertainty quantification of a physics-informed model based on sparse identification of a Thermal Energy Distribution System

Integrated energy systems (IES)s are crucial for enhancing the economy and efficiency of power generation sources (e.g., nuclear energy) necessary to unleash American energy dominance. These systems can be integrated with thermal energy storage (TES) and intermittent renewable energies to optimize overall energy use, peak-load regulation, and demand-side responses. However, the stabilization of energy generation, transport, and utilization introduces operational complexities that exceed the challenges of managing each sub-component individually. Currently, though IESs rely on human operators for efficiency and stability, reducing human error risk and enhancing performance through automation is highly desirable. Recent advances at Idaho National Laboratory have demonstrated successful control of the Thermal Energy Distributed System (TEDS). However, the automatic control system depends on a deterministic Sparse Identification of Nonlinear Dynamics with Control (SINDyC) model, which are trained based on simulation data from physics-based simulations. Because of uncertainties in physics-based simulation, SINDyC model results in large discrepancies against experimental data and cannot be reliably used in automatic control. In this paper, we present an innovative approach to address these discrepancies by quantifying uncertainties and developing a more robust model. We first generated trajectories by using first-principles physics codes to encapsulate the experiment. Next, we trained thousands of models by randomly sampling these trajectories. We then collapsed all those models into one probabilistic SINDyC by fitting a multivariate Gaussian distribution onto the resulting coefficient’s distribution. Despite its simplicity, our approach successfully produced 95% confidence intervals that captured the experimental trajectories. It even did so with a higher probability and better U-pooling score across six of the seven relevant quantities of interest (QoIs), as compared to other classical approaches. In conclusion, ongoing research is focusing on generating new experimental trajectories to validate this approach, and on employing Bayesian calibration to refine parametric uncertainties and guide future model development efforts.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Demonstration of Decentralized Physics-Driven Learning

In typical artificial neural networks, neurons adjust according to global calculations of a central processor, but in the brain, neurons and synapses self-adjust based on local information. Contrastive learning algorithms have recently been proposed to train physical systems, such as fluidic, mechanical, or electrical networks, to perform machine-learning tasks from local evolution rules. However, to date, such systems have only been implemented in silico due to the engineering challenge of creating elements that autonomously evolve based on their own response to two sets of global boundary conditions. Here, we introduce and implement a physics-driven contrastive learning scheme for a network of variable resistors, using circuitry to locally compare the response of two identical networks subjected to the two different sets of boundary conditions. Using this method, our system effectively trains itself, optimizing its resistance values without the use of a central processor or external information storage. Once the system is trained for a specified allostery, regression, or classification task, the task is subsequently performed rapidly and automatically by the physical imperative to minimize power dissipation in response to the given voltage inputs. Here, we demonstrate that, unlike typical computers, such learning systems are robust to extreme damage (and thus manufacturing defects) due to their decentralized learning. Our twin-network approach is therefore readily scalable to extremely large or nonlinear networks, where its distributed nature will be an enormous advantage; a laboratory network of only 500 edges will already outpace its in silico counterpart.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2021

Utilizing ensemble learning for performance and power modeling and improvement of parallel cancer deep learning CANDLE benchmarks

Abstract Machine learning (ML) continues to grow in importance across nearly all domains in modeling to learn from data. Often a tradeoff exists between a model's ability to minimize bias and variance. In this article, we utilize ensemble learning to combine linear, nonlinear, and tree‐/rule‐based ML methods to cope with the bias‐variance tradeoff and result in more accurate models. We use the datasets collected for two parallel cancer deep learning CANDLE benchmarks, NT3 and P1B2, to build performance and power models based on hardware performance counters using single‐object and multiple‐objects ensemble learning to identify the most important counters for improvement on the Cray XC40 Theta at Argonne National Laboratory. Based on the insights from these models, we improve the performance and energy of P1B2 and NT3 by optimizing the deep learning environments TensorFlow, Keras, Horovod, and Python under the huge page size of 8 MB. Experimental results show that ensemble learning not only produces more accurate models but also provides more robust performance counter ranking. We achieve up to 61.15% performance improvement and up to 62.58% energy saving for P1B2 and up to 55.81% performance improvement and up to 52.60% energy saving for NT3 on up to 24,576 cores.

Wu, Xingfu↗
DOE OSTI2024

Analysis of Power-Maximizing Region 2 Controllers for Wind and Marine Turbines

Wind and marine energy are rapidly growing and complementary technologies that share some techniques for simplified modeling and control, particularly in below-rated flow speeds. A turbine operator has several choices of controller for maximizing power in Region 2. The simple and ubiquitous KΩ 2 control law is often effective but limited in its flexibility. Alternative controllers use reference tracking to split the control objectives into a low-bandwidth optimal tip-speed ratio tracking loop to maximize steady-state power and a higher-bandwidth proportional-integral control loop to reject inflow turbulence. Several options exist for identifying the slowly varying optimal set point during operation, based on estimating the inflow velocity or filtering the power or torque signals. This study compares the trade-offs between performance and other design priorities for a few choices of reference-tracking controller in the literature for reference wind and marine turbines. Analysis is performed in the frequency domain using the linearization of each controller, and the impact of turbulent disturbances on the closed-loop system is described. The controllers are simulated in OpenFAST to analyze their performance with higher-order nonlinear turbine dynamics.

17 WIND ENERGY↗
DOE OSTI2024

Space Charge Dominated Momentum Spread and Compensation Strategies in the Post-Linac Section of Proton Improvement Plan-II at Fermilab

The upcoming Proton Improvement Plan-II (PIP-II), designated for enhancements to the Fermilab accelerator complex, features a Beam Transfer Line (BTL) that channels the beam from the linac exit to the booster. In the absence of longitudinal focusing beyond the superconducting linac, the beam experiences an elevated momentum spread, primarily due to nonlinear space-charge forces, surpassing the allowable limit of 2.1e-4. This study presents a detailed examination of the space-charge-induced momentum spread and outlines mitigative strategies. The investigation includes the fine-tuning of a de-buncher cavity, analyzed in terms of operating frequency, longitudinal location, and gap voltage, under both standard and perturbed beam conditions—specifically accounting for momentum jitter and energy variation. The impact of buncher cavity misalignments on the beam's longitudinal phase space is also assessed. The paper concludes by recommending an optimized cavity configuration to effectively mitigate the observed increase in momentum spread along the BTL.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Multi-scale, Multi-disciplinary, and Multi-agent Explainable AI with Koopman-Undergirded Learning, Prediction, and Analysis (M3EA KULPA) (Project Closeout Report)

The goal of this project was to develop and use domain-aware machine learning formulations, based on the Koopman Operator (KO), for modelling multi-scale, multi-disciplinary (e.g., multi-physics), and/or multi-agent systems. The project developed these formulations for the following cases: • Systems with dynamics at two separate time scales, • Systems with a bi-level hierarchical control structure, • Systems with bi-level hierarchical control and dynamics at two separate time scales (the lower level controls operating at the faster time scale), and • Systems with n separate but interacting agents/disciplines (with/without control, respectively); the controls for each agent could include bi-level hierarchical control and dynamics at two separate time scales as described above. The project then defined a set of dynamical systems consisting of different nonlinear oscillators that could be used to test these different formulations and then subsequently learned the KO models for those systems. With the KO models, we were able to do the following: • Quantify system stability, including both long-term and transient behavior, • Quantify the effects of feedbacks between the different time scales and agents/disciplines in terms of those feedbacks’ effects on system stability, • Replace a standard Proportional-Integral (PI) control in the hierarchical control structure with a KO-based Linear-Quadratic Regular (LQR), a form of optimal control, • Calculate optimal supervisory control policies a) with and without time scale separated dynamics at the lower level control levels and b) with both PI and KO-based LQR lower level control policies, and • Calculate dynamic Nash equilibria for multi-agent systems where each agent makes its own control decisions.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Bayesian, Multifidelity Operator Learning for Complex Engineering Systems–A Position Paper

Abstract Deep learning has significantly improved the state-of-the-art in computer vision and natural language processing, and holds great potential to design effective tools for predicting and simulating complex engineering systems. In particular, scientific machine learning seeks to apply the power of deep learning to scientific and engineering tasks, with operator learning (OL) emerging as a particularly effective tool. OL can approximate nonlinear operators arising in complex engineering systems, making it useful for simulating, designing, and controlling those systems. In this position paper, we provide a comprehensive overview of OL, including its potential applications to complex engineering domains. We cover three variations of OL approaches: deterministic OL for modeling nonautonomous systems, OL with uncertainty quantification (UQ) capabilities, and multifidelity OL. For each variation, we discuss drawbacks and potential applications to engineering, in addition to providing a detailed explanation. We also highlight how multifidelity OL approaches with UQ capabilities can be used to design, optimize, and control engineering systems. Finally, we outline some potential challenges for OL within the engineering domain.

Computer Science↗
DOE OSTI2020

Solving Eco-Driving Problems Using Indirect Collocation Method and Smooth Representation

Here, we discuss the eco-driving problem, considering both electric and conventional powertrains, and presents a pathway to solving it numerically using an indirect collocation method. Despite the low-order system dynamics, the piecewise fuel/efficiency map, gear shifting, and real-world traffic/road situations bring system discontinuities/switchings and pure state constraints into the problem formulation, which make the problem highly nonlinear and nontrivial to solve. This letter introduces smooth approximations to convert the original problem to an unconstrained (and penalized) smooth boundary-value problem. This approach eliminates the discussion of the switching structure and leads to a lightweight Newton-method-based solution procedure.

42 ENGINEERING↗
DOE OSTI2020

Bayesian inference in band excitation scanning probe microscopy for optimal dynamic model selection in imaging

The universal tendency in scanning probe microscopy (SPM) over the last two decades is to transition from simple 2D imaging to complex detection and spectroscopic imaging modes. The emergence of complex SPM engines brings forth the challenge of reliable data interpretation, i.e., conversion from detected signals to descriptors specific to tip–surface interactions and subsequently to material’s properties. In this work, we implemented a Bayesian inference approach for the analysis of the image formation mechanisms in band excitation SPM. Compared to the point estimates in classical functional fit approaches, Bayesian inference allows for the incorporation of extant knowledge of materials and probe behavior in the form of corresponding prior distribution and return the information on the material functionality in the form of readily interpretable posterior distributions. We explore the nonlinear mechanical behaviors spatially in a classical ferroelectric material, PbTiO 3 . We observe the non-trivial evolution of the Duffing stiffness term and the nonlinearity of the sample surface, determine spatial clustering of the nonlinear response, and perform a Landau analysis on predicting the nonlinear coefficient, which indicates that ferroelectric behavior can be a cause of the observed results. These observations suggest that the spectrum of anomalous behaviors at the ferroelectric domain walls may be broader than previously believed and can extend to non-conventional mechanical properties in addition to static and microwave conductance.

36 MATERIALS SCIENCE↗
DOE OSTI2022

A modified model parametrization algorithm for solving a special type of heat and mass transfer systems

A new method for solving nonlinear heat and mass transfer design tasks was considered. Systems using the Number of Transfer Units (NTU) method are a special type of mathematical model of heat and mass exchangers. It was observed, that the NTU models in a form of differential-algebraic equations (DAEs) cannot be directly solved with higher values of NTU. The requirements for consistent initial conditions, as well as numerical limitations of DAEs solvers, result, that the solution to the considered design problems that cannot be obtained by a classical direct shooting procedure. To overcome the presented difficulties, the αDAE model optimization algorithm was adjusted for solving NTU-based models. The new approach consists of 3 main steps: 1) task discretization by a multiple-shooting approach, 2) design an appropriate function $f_{NTU}$(α) to effectively influence the variability of the state variables described by dynamical relations, 3) the iterative numerical optimization algorithm for the new parametrized system. Moreover, computations can be performed by a chosen numerical optimization approach, which can be communicated with an available outer procedure for solving differential-algebraic equations. The presented algorithm was implemented and applied to solve the design task with the NTU model of a counter-flow exchanger. Here, the new approach was used to modify the system dynamics to influence the difficulty of the considered problem. Finally, the presented method enabled failure-free numerical computations for the higher values of the NTU parameter.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Insights into the Growth Orientation and Phase Stability of Chemical-Vapor-Deposited Two-Dimensional Hybrid Halide Perovskite Films

Chemical vapor deposition (CVD) offers a large-area, scalable, and conformal growth of perovskite thin films without the use of solvents. Low-dimensional organic–inorganic halide perovskites, with alternating layers of organic spacer groups and inorganic perovskite layers, are promising for enhancing the stability of optoelectronic devices. Moreover, their multiple quantum-well structures provide a powerful platform for tuning excitonic physics. Here, in this work, we show that the CVD process is conducive to the growth of 2D hybrid halide perovskite films. Using butylammonium (BA) and phenylethylammonium (PEA) cations, the growth parameters of BA 2 PbI 4 and PEA 2 PbI 4 and mixed halide perovskite films were first optimized. These films are characterized by well-defined grain boundaries and display characteristic absorption and emission features of the 2D quantum wells. X-ray diffraction (XRD) and a noninteger dimensionality model of the absorption spectrum provide insights into the orientation of the crystalline planes. Unlike BA 2 PbI 4 , temperature-dependent photoluminescence measurements from PEA 2 PbI 4 show a single excitonic peak throughout the temperature range from 20 to 350 K, highlighting the lack of defect states. These results further corroborate the temperature-dependent synchrotron-based XRD results. Furthermore, the nonlinear optical properties of the CVD-grown perovskite films are investigated, and a high third harmonic generation efficiency is observed.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Deployment and validation of predictive 6-dimensional beam diagnostics through generative reconstruction with standard accelerator elements

Understanding the 6-dimensional phase space distribution of particle beams is essential for optimizing accelerator performance. Conventional diagnostics such as use of transverse deflecting cavities offer detailed characterization but require dedicated hardware and space. Generative phase space reconstruction (GPSR) methods have shown promise in beam diagnostics, yet prior implementations still rely on such components. Here we present the first experimental implementation and validation of the GPSR methodology, realized by the use of standard accelerator elements including accelerating cavities and dipole magnets, to achieve complete 6-dimensional phase space reconstruction. Through simulations and experiments at the Pohang Accelerator Laboratory X-ray Free Electron Laser facility, we successfully reconstruct complex, nonlinear beam structures. Furthermore, we validate the methodology by predicting independent downstream measurements excluded from training, revealing the reconstruction closely resembling ground truth. This advancement establishes a pathway for predictive diagnostics across beamline segments while reducing hardware requirements and expanding applicability to various accelerator facilities.

Kim, Seongyeol [Pohang Univ. of Science and Techno↗
DOE OSTI2025

Understanding plasma turbulence through exact coherent structures

Plasma turbulence is a key challenge in understanding transport phenomena in magnetically confined plasmas. This work presents a generalized framework to analyze plasma turbulence that utilizes periodic orbit theory. In periodic orbit theory, doubly periodic solutions (coherent structures) of the governing equation(s) serve as building blocks of the considered turbulent dynamics. To illustrate the concept and method, the particularly simple Kuramoto–Sivashinsky (referred to here as LMRT for the original authors: LaQuey, Mahajan, Rutherford, and Tang) trapped-ion mode toy model is used. By applying numerical optimization techniques to the LMRT equation, we extract coherent spacetime patterns that represent the library of allowable fundamental structures of the equation. These structures provide a framework to systematically describe turbulence as a composition of recurrent solutions, revealing an underlying order within chaotic plasma motion. Although illustrated here using the simplified LMRT model for clarity, this framework provides a general strategy that can be extended to more complex and realistic models of plasma turbulence, including gyrokinetic systems. This offers a new method for predicting and potentially controlling transport processes in fusion plasmas by providing a bridge between nonlinear dynamical systems theory and plasma physics in the form of a generalized framework with which to analyze and understand spatially extended nonlinear partial differential equations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Hybrid learning techniques for scientific data reduction with performance guarantees

The research initiatives supported by the U.S. Department of Energy (DOE) Grant DE-SC0022265 are fundamentally aimed at pioneering advanced machine learning (ML) techniques for scientific data compression within high-performance computing (HPC) environments. This comprehensive body of work addresses the critical challenge posed by the exponential growth of data generated by scientific simulations in domains such as fusion energy, climate modeling, and computational fluid dynamics (CFD). A core objective is to develop compression algorithms that achieve substantial data reduction—often by orders of magnitude—while rigorously ensuring the fidelity of both the primary data (PD) and scientifically crucial derived quantities of interest (QoI). The methodologies deployed under this grant integrate sophisticated deep learning architectures, prominently featuring autoencoders, advanced generative models like conditional diffusion, and hybrid learning techniques. Key innovations include the development of Guaranteed Autoencoders (GAE) and the Guaranteed Conditional Diffusion with Tensor Correction (GCDTC) framework, which provide explicit, instance-level error bounds on reconstructed data. Furthermore, specialized strategies such as nonlinear constraint satisfaction are employed to preserve the integrity of QoI, a vital requirement for the trustworthiness of downstream scientific analyses. This research also focuses on the design and implementation of scalable, GPU-accelerated software pipelines that seamlessly integrate into existing HPC workflows, ensuring both computational efficiency and practical applicability. The CAESAR framework, for example, unifies foundation and generative models to create an adaptive and efficient compression solution for spatio-temporal scientific data. Collectively, these efforts represent a significant advancement in mitigating the scientific data deluge, enabling more effective data management, accelerated scientific discovery, and optimized utilization of HPC resources.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Final report- UFL - RAPIDS2: A SciDAC Institute for Computer Science, Data, and Artificial Intelligence

The research initiatives supported by the U.S. Department of Energy (DOE) Grant DE-SC0022265 are fundamentally aimed at pioneering advanced machine learning (ML) techniques for scientific data compression within high-performance computing (HPC) environments. This comprehensive body of work addresses the critical challenge posed by the exponential growth of data generated by scientific simulations in domains such as fusion energy, climate modeling, and computational fluid dynamics (CFD). A core objective is to develop compression algorithms that achieve substantial data reduction—often by orders of magnitude—while rigorously ensuring the fidelity of both the primary data (PD) and scientifically crucial derived quantities of interest (QoI). The methodologies deployed under this grant integrate sophisticated deep learning architectures, prominently featuring autoencoders, advanced generative models like conditional diffusion, and hybrid learning techniques. Key innovations include the development of Guaranteed Autoencoders (GAE) and the Guaranteed Conditional Diffusion with Tensor Correction (GCDTC) framework, which provide explicit, instance-level error bounds on reconstructed data. Furthermore, specialized strategies such as nonlinear constraint satisfaction are employed to preserve the integrity of QoI, a vital requirement for the trustworthiness of downstream scientific analyses. This research also focuses on the design and implementation of scalable, GPU-accelerated software pipelines that seamlessly integrate into existing HPC workflows, ensuring both computational efficiency and practical applicability. The CAESAR framework, for example, unifies foundation and generative models to create an adaptive and efficient compression solution for spatio-temporal scientific data. Collectively, these efforts represent a significant advancement in mitigating the scientific data deluge, enabling more effective data management, accelerated scientific discovery, and optimized utilization of HPC resources.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Anisotropic Characterizations of Electrospun PAN Nanofiber Mats Using Design of Experiments

This paper deals with the dielectric and mechanical characterizations of polyacrylonitrile (PAN)-aligned electrospun nanofiber mats. A two factor three level full factorial experiment is conducted to understand the effect of various parameters on dielectric and mechanical responses. These responses are recorded against randomly oriented and aligned nanofiber mats. Improved properties of electrospun mats have applications in the field of energy storage and nanocomposite reinforcement. Dielectric and mechanical characterizations of PAN mats are vital, as the aligned electrospun mats were found to be useful in advanced energy and mechanical reinforcement applications. Therefore, it is paramount to understand the effects of system parameters to these properties. The design of experiment (DoE) includes two factors and three level full factorial experiments with concentrations of PAN solutions at 8 wt.%, 9 wt.%, and 10 wt.%, and speed of the rotating mandrel (collector) at 3 volt (V), 4 V, and 5 V inputs. The electric field intensity used in the experiment is 1 kV/cm. DoE is conducted to understand the nonlinear interactions of parameters to these responses. The dielectric and mechanical characterizations of 8 wt.%, 9 wt.%, and 10 wt.% with different speeds for the original and improved systems are discussed. It was observed that at 9 wt.% and at all mandrel speeds, the dielectric and tensile properties are optimum.

42 ENGINEERING↗
DOE OSTI2024

Advances in laser-based bremsstrahlung x-ray sources. I. Optimizing laser-accelerated electrons

In this work, we have performed a suite of kinetic simulations of relativistic laser–plasma interaction under settings relevant to recent and planned experiments on a variety of laser systems. The goal of the study is to illuminate the physics of laser–target coupling and to provide guidance for how to optimize these sources for applications. It is shown that the production of relativistic electrons is maximized when conditions of relativistic induced transparency (RIT) in dense plasmas can be achieved over a large interaction volume at the time of arrival of most intense part of the laser pulse. RIT is shown to enhance both the numbers of relativistic electrons and the energies of the electrons, leading to an increased x-ray dose. A variety of approaches to enhancing laser–target coupling are considered. These include optimizing the effects of low-density pre-plasma (arising either from finite laser pedestal or from the use of foam coatings) and of modifying the laser focusing geometry to reduce effects of filamentation and self-focusing. Evidence of a novel approach to achieving stable laser propagation over distances of tens of micrometers in a plasma gradient is also presented. These conditions coincide with plasma and laser conditions explored in recent experiments on the Omega EP laser system and compare favorably with an analytic criterion for stable laser propagation in relativistically underdense plasma obtained from a nonlinear Wentzel–Kramers–Brillouin analysis.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗