Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “machine learning optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Random coordinate descent: A simple alternative for optimizing parameterized quantum circuits

Variational quantum algorithms rely on the optimization of parameterized quantum circuits in noisy settings. The commonly used back-propagation procedure in classical machine learning is not directly applicable in this setting due to the collapse of quantum states after measurements. Thus, gradient estimations constitute a significant overhead in a gradient-based optimization of such quantum circuits. This paper introduces a random coordinate descent algorithm as a practical and easy-to-implement alternative to the full gradient descent algorithm. This algorithm only requires one partial derivative at each iteration. Motivated by the behavior of measurement noise in the practical optimization of parameterized quantum circuits, this paper presents an optimization problem setting that is amenable to analysis. Under this setting, the random coordinate descent algorithm exhibits the same level of stochastic stability as the full gradient approach, making it as resilient to noise. The complexity of the random coordinate descent method is generally no worse than that of the gradient descent and can be much better for various quantum optimization problems with anisotropic Lipschitz constants. Theoretical analysis and extensive numerical experiments validate our findings. Published by the American Physical Society 2024

Ding, Zhiyan (ORCID:000000018863403X)↗
DOE OSTI2020

Learning to Solve Large-Scale Security-Constrained Unit Commitment Problems

Security-constrained unit commitment (SCUC) is a fundamental problem in power systems and electricity markets. In practical settings, SCUC is repeatedly solved via mixed-integer linear programming (MIP), sometimes multiple times per day, with only minor changes in input data. In this work, we propose a number of machine learning techniques to effectively extract information from previously solved instances in order to significantly improve the computational performance of MIP solvers when solving similar instances in the future. Based on statistical data, we predict redundant constraints in the formulation, good initial feasible solutions, and affine subspaces where the optimal solution is likely to lie, leading to a significant reduction in problem size. Computational results on a diverse set of realistic and large-scale instances show that using the proposed techniques, SCUC can be solved on average 4.3 times faster with optimality guarantees and 10.2 times faster without optimality guarantees, with no observed reduction in solution quality. Out-of-distribution experiments provide evidence that the method is somewhat robust against data-set shift. Summary of Contribution. The paper describes a novel computational method, based on a combination of mixed-integer linear programming (MILP) and machine learning (ML), to solve a challenging and fundamental optimization problem in the energy sector. The method advances the state-of-the-art, not only for this particular problem, but also, more generally, in solving discrete optimization problems via ML. We expect that the techniques presented can be readily used by practitioners in the energy sector and adapted, by researchers in other fields, to other challenging operations research problems that are solved routinely.

Machine Learning↗
DOE OSTI2022

Revisiting Theoretical Tools and Approaches for the Valorization of Recalcitrant Lignocellulosic Biomass to Value-Added Chemicals

Biorefinery processes for converting lignocellulosic biomass to fuels and chemicals proceed via an integrated series of steps. Biomass is first pretreated and deconstructed using chemical catalysts and/or enzymes to liberate sugar monomers and lignin fragments. Deconstruction is followed by a conversion step in which engineered host organisms assimilate the released sugar monomers and lignin fragments, and produce value-added fuels and chemicals. Over the past couple of decades, a significant amount of work has been done to develop innovative biomass deconstruction and conversion processes that efficiently solubilize biomass, separate lignin from the biomass, maximize yields of bioavailable sugars and lignin fragments and convert the majority of these carbon sources into fuels, commodity chemicals, and materials. Herein, we advocate that advanced in silico approaches provide a theoretical framework for developing efficient processes for lignocellulosic biomass valorization and maximizing yields of sugars and lignin fragments during deconstruction and fuel and chemical titers during conversion. This manuscript surveys the latest developments in lignocellulosic biomass valorization with special attention given to highlighting computational approaches used in process optimization for lignocellulose pretreatment; enzyme engineering for enhanced saccharification and delignification; and prediction of the genome modification necessary for desired pathway fine-tuning to upgrade products from biomass deconstruction into value-added products. Physics-based modeling approaches such as density functional theory calculations and molecular dynamics simulations have been most impactful in studies aimed at exploring the molecular level details of solvent-biomass interactions, reaction mechanisms occurring in biomass-solvent systems, and the catalytic mechanisms and engineering of enzymes involved in biomass degradation. More recently, with ever increasing amounts of data from, for example, advanced mutli-omics experiments, machine learning approaches have begun to make important contributions in synthetic biology and optimization of metabolic pathways for production of biofuels and chemicals.

09 BIOMASS FUELS↗
DOE OSTI2023

Optimizing chemistry for designing oxidation resistant FeCrAl alloys

Abstract Traditionally, FeCrAl alloys played an important role in high-temperature applications due to their ability to form a passive Al oxide film at temperatures above ~ 800 °C. Recently, FeCrAl alloys became of interest for the application of accident tolerant nuclear fuel cladding. This study covers work done at GE Research for better understanding the role of Al, Cr, and Mo in oxidation kinetics and thermodynamics. Several models and commercial prototype alloys have been tested in hydrothermal corrosion autoclave loops, at low temperature steam exposure (~ 400 °C), high temperature steam exposure (~ 1000 °C or higher), and high temperature air exposures. The results provide insights on how chromium and aluminum play a significant role in both high temperature and low temperature oxidation of FeCrAl. Additionally, machine learning tools are used to gain further insights on both predicting future optimized chemistries for balancing the properties of hydrothermal corrosion, low and high temperature steam oxidation, and thermal aging (which is exacerbated due to radiation in a nuclear reactor environment). GE plans to use this framework to further optimize the FeCrAl alloy system for use in nuclear reactor environments. Graphical abstract

Roy, Indranil (ORCID:0000000336124323)↗
DOE OSTI2021

Machine Learning Tools Set for Natural Gas Fuel Cell System Design

This study is focusing on leveraging the system design tools set for the next-generation solid oxide fuel cell (SOFC) based natural gas fuel cell (NGFC) system. Conventionally, system design and optimization of NGFC systems rely heavily on traditional reduced order model (ROM) techniques and designers’ experience level. For overcoming the technical barriers of system design, multiple multi-physics models and machine learning (ML) tools have been utilized to automate the conceptual design process and enhance the reliability of solutions for the NGFC system. The proposed tools set includes a physics-informed ML tool for automated ROM construction that leverages advances in deep neural networks to significantly reduce ROM prediction error for the NGFC power island compared to traditional approaches. The constructed physics-informed ML ROM can be used in system design, and optimization tools set Institute for the Design of Advanced Energy Systems (IDAES) Process Systems Engineering (PSE) framework. The tools set also provides a user-friendly graphic user interface built within Jupyter Notebooks, and the complete tools set is open-source public available.

Wang, Dewei↗
DOE OSTI2020

Learning to Optimize Variational Quantum Circuits to Solve Combinatorial Problems

Quantum computing is a computational paradigm with the potential to outperform classical methods for a variety of problems. Proposed recently, the Quantum Approximate Optimization Algorithm (QAOA) is considered as one of the leading candidates for demonstrating quantum advantage in the near term. QAOA is a variational hybrid quantum-classical algorithm for approximately solving combinatorial optimization problems. The quality of the solution obtained by QAOA for a given problem instance depends on the performance of the classical optimizer used to optimize the variational parameters. In this paper, we formulate the problem of finding optimal QAOA parameters as a learning task in which the knowledge gained from solving training instances can be leveraged to find high-quality solutions for unseen test instances. To this end, we develop two machine-learning-based approaches. Our first approach adopts a reinforcement learning (RL) framework to learn a policy network to optimize QAOA circuits. Our second approach adopts a kernel density estimation (KDE) technique to learn a generative model of optimal QAOA parameters. In both approaches, the training procedure is performed on small-sized problem instances that can be simulated on a classical computer; yet the learned RL policy and the generative model can be used to efficiently solve larger problems. Furthermore, extensive simulations using the IBM Qiskit Aer quantum circuit simulator demonstrate that our proposed RL- and KDE-based approaches reduce the optimality gap by factors up to 30.15 when compared with other commonly used off-the-shelf optimizers.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Advances in in situ/operando techniques for catalysis research: enhancing insights and discoveries

Abstract Catalysis research has witnessed remarkable progress with the advent of in situ and operando techniques. These methods enable the study of catalysts under actual operating conditions, providing unprecedented insights into catalytic mechanisms and dynamic catalyst behavior. This review discusses key in situ techniques and their applications in catalysis research. Advances in in situ electron microscopy allow direct visualization of catalysts at the atomic scale under reaction conditions. In situ spectroscopy techniques like X-ray absorption spectroscopy and nuclear magnetic resonance spectroscopy can track chemical states and reveal transient intermediates. Synchrotron-based techniques offer enhanced capabilities for in situ studies. The integration of in situ methods with machine learning and computational modeling provides a powerful approach to accelerate catalyst optimization. However, challenges remain regarding radiation damage, instrumentation limitations, and data interpretation. Overall, continued development of multi-modal in situ techniques is pivotal for addressing emerging challenges and opportunities in catalysis research and technology.

Chen, Linfeng↗
DOE OSTI2026

Machine-Learning-Driven Discovery of Water Splitting BaFe 2 O 4 and Human-in-the-Loop Improvement via Al-Substitution for Increased Thermal Stability

Thermochemical hydrogen (TCH) production offers a promising method for converting thermal energy into hydrogen fuel through heat-driven redox cycles of metal oxides. Here, in this work a defect graph neural network (dGNN) was used to predict oxygen vacancy formation energies ΔH V O combined with Materials Project predictions of oxygen chemical potential stability to screen candidate oxides via high-throughput database analysis. BaFe 2 O 4 was identified as a promising material for experimental validation based on its predicted ΔH V O , oxygen chemical potential stability range, and potential for tunable substitutions to improve thermal properties. Experimental validation using thermogravimetric analysis (TGA), stagnation flow reactor (SFR), X-ray diffraction (XRD), and electron microscopy confirmed positive water-splitting behavior but also revealed limitations in thermal stability under aggressive reduction conditions. To address this, a human-in-the-loop modification strategy was employed introducing Al substitution in BaFe 2–x Al x O 4 ; this modification improves thermal stability, alters the crystal structure and enhances overall performance. These results demonstrate a combined computational and experimental workflow in which machine learning accelerates identification of promising candidates, while targeted experimental design enables optimization of functional performance. This approach advances the development of robust, cost-effective TCH materials and highlights the importance of integrating data-driven discovery with human-guided materials design in paving the way for scalable hydrogen production technologies.

organic↗
DOE OSTI2023

MArVD2: a machine learning enhanced tool to discriminate between archaeal and bacterial viruses in viral datasets

Abstract Our knowledge of viral sequence space has exploded with advancing sequencing technologies and large-scale sampling and analytical efforts. Though archaea are important and abundant prokaryotes in many systems, our knowledge of archaeal viruses outside of extreme environments is limited. This largely stems from the lack of a robust, high-throughput, and systematic way to distinguish between bacterial and archaeal viruses in datasets of curated viruses. Here we upgrade our prior text-based tool (MArVD) via training and testing a random forest machine learning algorithm against a newly curated dataset of archaeal viruses. After optimization, MArVD2 presented a significant improvement over its predecessor in terms of scalability, usability, and flexibility, and will allow user-defined custom training datasets as archaeal virus discovery progresses. Benchmarking showed that a model trained with viral sequences from the hypersaline, marine, and hot spring environments correctly classified 85% of the archaeal viruses with a false detection rate below 2% using a random forest prediction threshold of 80% in a separate benchmarking dataset from the same habitats.

Vik, Dean (ORCID:000000027546899X)↗
DOE OSTI2020

DNA Sequencing Optimizer v0.1

This is a software utility used to maximize next-generation sequencing data output without compromising quality values. The DNA Sequencing Optimizer is used to determine the optimal amount of library to load. To do this a supervised machine learning model predicts cluster density, a measure of how much DNA is bound to the sequence, from the concentration of DNA loaded. The output is a plot that is used by experimentalists to determine the best DNA library concentration to load onto the sequencer.

Costello, Zachary↗
DOE OSTI2022

SRF Cavity Fault Classification and Prediction at Jefferson Lab

Over the last few years several machine learning projects at Jefferson Lab have had a common focus to optimize operation of superconducting RF (SRF) cavities in the Continuous Electron Beam Accelerator Facility (CEBAF). In this talk we highlight work to identify and classify types of faults from C100-type cavities and then to extend those capabilities to provide real-time fault prediction. Early prediction may enable mitigation strategies to prevent some types of faults. In our approach we apply a two-step fault prediction pipeline. In the first step, a model distinguishes between faulty and normal signals. In the second step, signals flagged as faulty by the first model are classified into one of seven fault types based on learned signatures in the data. Initial results show that our model can successfully predict most fault types 200 ms before onset. In additional to model performance, we also highlight challenges in working with real-world data and challenges for deploying models.

Tennant, C.↗
DOE OSTI2025

Applying deep learning methods to develop new models of molecular charge transfer, nonadiabatic dynamics, and nonlinear spectroscopy in the condensed phase

Photon- and field-induced charge transfer has central importance in the generation and storage of electricity, the novel properties of materials, photo-induced catalysis, and electro-optic activity (e.g., photovoltaic cells, fuel cells, and organic chromophores for use in optical fibers and light-emission diodes). These non-equilibrium electronic and chemical transformations are probed by ultrafast, nonlinear spectroscopies. Accurate simulations play a crucial role in our ability to understand, optimize, and control these transformations. This project applies modern deep learning and machine learning (ML) methods to dramatically improve models of electronic dynamics, electronic-nuclear dynamics, and spectroscopic measurements for improved simulations of chemistry in complex environments, far from equilibrium phenomena, and processes in extreme environments, such as materials exposed to strong or resonant fields. This project develops accurate neural net models that go beyond predictive capability to also provide new insight into the fundamental physics underlying electron and nuclear dynamics. To achieve its objectives, this project explores and develops customized versions of high-capacity deep learning algorithms/models. These techniques are developed with an emphasis on fundamental chemical insight, not just predictive accuracy, to assist the development of the next generation of quantum simulation methods.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Modernizing Accelerator Responsiveness and Controls in Operations

Accelerators increasingly use artificial intelligence (AI) and machine learning (ML) software and workflows for a variety of tasks, from optimization to fault detection and recovery. Efficient and sustainable application of these technologies necessitates specialized and facility-specific infrastructure commitments. Accelerator facilities also introduce unique radiation and security hazards, placing additional demands on operational infrastructure. These needs further escalate the prioritization of effective collaboration models and associated funding mechanisms and legal frameworks.

43 PARTICLE ACCELERATORS↗
DOE OSTI2022

Deep Learning and Natural Language Processing for Accelerated Inverse Design of Optical Metamaterials

Optical metamaterial device design has enjoyed a long track of success over the past 50 years leading to the manipulation of light over a wide range of wavelengths spanning the ultraviolet to the far infrared. The manipulation of light over such wavelengths has already led to many technological advancements such as the design of selective radiative absorbers for solar energy, daytime passive cooling using deep space, and optical invisibility cloaks for defense applications. Further disruptive advancements in energy, defense, computing, and biomedical fields could be enabled or enhanced by future optical metamaterial devices. These technologies could lead to increased energy efficiency and hence reduced national primary energy consumption, cheap long duration energy storage, and next generation solid-state heat engines. But historically the methods to invent and develop all of these devices have been time- consuming and based mostly on intuition and iteration. Finding an optimal design can take years. In this project we developed a machine learning-based algorithm capable of automatically generating device designs to produce desired optical properties, reducing the design cycle life in certain situations to be almost instantaneous.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Structure-aware Initialization via Numerical Continuation and Informed Priors

Scientific machine learning (SciML) often operates in ill-conditioned, weakly identifiable regimes due to limited data or indirect observations. In such settings, optimization and inference are highly sensitive to the starting point, making initialization--often under-reported--a consequential degree of freedom. Random initialization is not a neutral default as it induces an implicit prior over candidate solutions and can systematically bias the result, producing large run-to-run variability. Here, we formalize this view by treating initialization as a hidden confounder in SciML and develop a unifying theory for structure-aware initialization via numerical continuation, constructing warm starts from related problem instances. Across representative tasks, including physics-informed neural networks, maximum likelihood estimation, and variational inference, warm starts have been shown to consistently reduce optimization effort and improve reliability.

Data integrity↗
DOE OSTI2024

Utilization of Synthetic Near-Infrared Spectra via Generative Adversarial Network to Improve Wood Stiffness Prediction

Near-infrared (NIR) spectroscopy is widely used as a nondestructive evaluation (NDE) tool for predicting wood properties. When deploying NIR models, one faces challenges in ensuring representative training data, which large datasets can mitigate but often at a significant cost. Machine learning and deep learning NIR models are at an even greater disadvantage because they typically require higher sample sizes for training. In this study, NIR spectra were collected to predict the modulus of elasticity (MOE) of southern pine lumber (training set = 573 samples, testing set = 145 samples). To account for the limited size of the training data, this study employed a generative adversarial network (GAN) to generate synthetic NIR spectra. The training dataset was fed into a GAN to generate 313, 573, and 1000 synthetic spectra. The original and enhanced datasets were used to train artificial neural networks (ANNs), convolutional neural networks (CNNs), and light gradient boosting machines (LGBMs) for MOE prediction. Overall, results showed that data augmentation using GAN improved the coefficient of determination (R 2 ) by up to 7.02% and reduced the error of predictions by up to 4.29%. ANNs and CNNs benefited more from synthetic spectra than LGBMs, which only yielded slight improvement. All models showed optimal performance when 313 synthetic spectra were added to the original training data; further additions did not improve model performance because the quality of the datapoints generated by GAN beyond a certain threshold is poor, and one of the main reasons for this can be the size of the initial training data fed into the GAN. LGBMs showed superior performances than ANNs and CNNs on both the original and enhanced training datasets, which highlights the significance of selecting an appropriate machine learning or deep learning model for NIR spectral-data analysis. The results highlighted the positive impact of GAN on the predictive performance of models utilizing NIR spectroscopy as an NDE technique and monitoring tool for wood mechanical-property evaluation. Further studies should investigate the impact of the initial size of training data, the optimal number of generated synthetic spectra, and machine learning or deep learning models that could benefit more from data augmentation using GANs.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Uncovering acoustic signatures of pore formation in laser powder bed fusion

Abstract We present a machine learning workflow to discover signatures in acoustic measurements that can be utilized to create a low-dimensional model to accurately predict the location of keyhole pores formed during additive manufacturing processes. Acoustic measurements were sampled at 100 kHz during single-layer laser powder bed fusion (LPBF) experiments, and spatio-temporal registration of pore locations was obtained from post-build radiography. Power spectral density (PSD) estimates of the acoustic data were then decomposed using non-negative matrix factorization with custom $$\varvec{k}$$ k -means clustering (NMF $$\varvec{k}$$ k ) to learn the underlying spectral patterns associated with pore formation. NMF $$\varvec{k}$$ k returned a library of basis signals and matching coefficients to blindly construct a feature space based on the PSD estimates in an optimized fashion. Moreover, the NMF $$\varvec{k}$$ k decomposition led to the development of computationally inexpensive machine learning models which are capable of quickly and accurately identifying pore formation with classification accuracy of supervised and unsupervised label learning greater than 95% and 90%, respectively. The intrinsic data compression of NMF k , the relatively light computational cost of the machine learning workflow, and the high classification accuracy makes the proposed workflow an attractive candidate for edge computing toward in-situ keyhole pore prediction in LPBF.

36 MATERIALS SCIENCE↗
DOE OSTI2024

A portable application framework for energy management and information systems (EMIS) solutions using Brick semantic schema

This paper introduces a portable framework for developing, scaling and maintaining energy management and information systems (EMIS) applications using an ontology-based approach. Key contributions include an interoperable layer based on Brick schema, the formalization of application constraints pertaining metadata and data requirements, and a field demonstration. The framework allows for querying metadata models, fetching data, preprocessing, and analyzing data, thereby offering a modular and flexible workflow for application development. Its effectiveness is demonstrated through a case study involving the development and implementation of a data-driven anomaly detection tool for the photovoltaic systems installed at the Politecnico di Torino, Italy. During eight months of testing, the framework was used to tackle practical challenges including: (i) developing a machine learning-based anomaly detection pipeline, (ii) replacing data-driven models during operation, (iii) optimizing model deployment and retraining, (iv) handling critical changes in variable naming conventions and sensor availability (v) extending the pipeline from one system to additional ones.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗