Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “machine learning optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Machine learning-based ethylene and carbon monoxide estimation, real-time optimization, and multivariable feedback control of an experimental electrochemical reactor

Electrochemical reduction of CO 2 gas is a novel CO 2 utilization technique that has the potential to mitigate the global climate crisis caused by anthropogenic CO 2 emissions, and enable the large-scale storage of energy generated from renewable sources in the form of carbon-based chemicals and fuels. However, due to the complexity of the electrochemical reactions, the explicit first-principles models for CO2 reduction are not available yet, and there has been a limited effort to develop process modeling, optimization and control of CO 2 electrochemical reactors. To this end, a rotating cylinder electrode (RCE) reactor has been constructed at UCLA to understand the mass transfer and reaction kinetics effects separately on the productivity. In the RCE reactor, the applied potential strongly influences the reaction energetics and the electrode rotation speed affects the hydrodynamic boundary layer and modifies the film mass transfer coefficient, which involves convective and diffusive transport. Further, the present work aims to develop a multi-input multi-output (MIMO) control scheme for the RCE reactor that integrates techniques from artificial and recurrent neural network modeling, nonlinear optimization, and process controller design. Specifically, production rates of two products from the experimental reactor, ethylene and carbon monoxide, are controlled by manipulating two inputs, applied potential and catalyst rotation speed. Process dynamics and controllability are analyzed, a feedback control strategy is designed and the controllers are tuned accordingly. The experimental electrochemical cell is employed to gather data for process modeling and implement the multivariable control system. Finally, the experimental results are presented which demonstrate excellent closed-loop performance by the control system and regulation of the outputs at three different set-points including an economically-optimal set-point.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

A Workflow for Accelerating Multimodal Data Collection for Electrodeposited Films

Abstract Future machine learning strategies for materials process optimization will likely replace human capital-intensive artisan research with autonomous and/or accelerated approaches. Such automation enables accelerated multimodal characterization that simultaneously minimizes human errors, lowers costs, enhances statistical sampling, and allows scientists to allocate their time to critical thinking instead of repetitive manual tasks. Previous acceleration efforts to synthesize and evaluate materials have often employed elaborate robotic self-driving laboratories or used specialized strategies that are difficult to generalize. Herein we describe an implemented workflow for accelerating the multimodal characterization of a combinatorial set of 915 electroplated Ni and Ni–Fe thin films resulting in a data cube with over 160,000 individual data files. Our acceleration strategies do not require manufacturing-scale resources and are thus amenable to typical materials research facilities in academic, government, or commercial laboratories. The workflow demonstrated the acceleration of six characterization modalities: optical microscopy, laser profilometry, X-ray diffraction, X-ray fluorescence, nanoindentation, and tribological (friction and wear) testing, each with speedup factors ranging from 13–46x. In addition, automated data upload to a repository using FAIR data principles was accelerated by 64x.

36 MATERIALS SCIENCE↗
DOE OSTI2020

AI Denoising to Accelerate Detector Simulation

Detector simulation is critical to experimental HEP; however this simulation (commonly done through toolkits such as Geant4) is computationally intensive. Performance can be improved somewhat through technical optimization, but more is needed. Using machine learning (ML) to accelerate simulation is a promising field, however efforts to use generative adversarial networks (GANs) or optimized autoencoders have faced issues. Using convolutional neural networks (CNNs) for denoising has been successful in non-HEP applications such as image processing. This poster investigates the efficacy of using CNNs to denoise Geant4 simulations. This could increase the accuracy of simulations performed under settings designed to increase computational efficiency.

Franklin, Lena↗
DOE OSTI2020

Building thermal load prediction through shallow machine learning and deep learning

Building thermal load prediction informs the optimization of cooling plant and thermal energy storage. Physics-based prediction models of building thermal load are constrained by the model and input complexity. In this study, we developed 12 data-driven models (7 shallow learning, 2 deep learning, and 3 heuristic methods) to predict building thermal load and compared shallow machine learning and deep learning. The 12 prediction models were compared with the measured cooling demand. It was found XGBoost (Extreme Gradient Boost) and LSTM (Long Short Term Memory) provided the most accurate load prediction in the shallow and deep learning category, and both outperformed the best baseline model, which uses the previous day's data for prediction. Then, we discussed how the prediction horizon and input uncertainty would influence the load prediction accuracy. Major conclusions are twofold: first, LSTM performs well in short-term prediction (1 h ahead) but not in long term prediction (24 h ahead), because the sequential information becomes less relevant and accordingly not so useful when the prediction horizon is long. Second, the presence of weather forecast uncertainty deteriorates XGBoost's accuracy and favors LSTM, because the sequential information makes the model more robust to input uncertainty. Training the model with the uncertain rather than accurate weather data could enhance the model's robustness. Finally, our findings have two implications for practice. First, LSTM is recommended for short-term load prediction given that weather forecast uncertainty is unavoidable. Second, XGBoost is recommended for long term prediction, and the model should be trained with the presence of input uncertainty.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Learning Optimal Power Flow Solutions using Linearized Models in Power Distribution Systems

Solving nonlinear optimal power flow (OPF) problem is computationally expensive, and poses scalability challenges for power distribution networks. An alternative to solving the original nonlinear OPF is the linear approximated OPF models. Although, these linear approximated OPF models are fast, the resulting solutions may result in significant optimality gap. Lately, the application of machine learning (ML) methods in successfully solving the nonlinear OPF has been reported. These methods learn and estimate the nonlinear control policies using a purely data-driven approach. In this paper, we propose an approach to complements the ML based approach to solving OPF using solutions from known linearized OPF model. Specifically, we use supervised learning to map the solutions of linear OPF to nonlinear control variables. Unlike, the traditional ML based methods for OPF that approximate the full distribution feeder model using function approximation, our approach uses a two-node approximation of radial networks. The proposed approach is validated using IEEE 123 bus test system for OPF solutions obtained using the nonlinear OPF models.

optimal power flow, power distribution systems, su↗
DOE OSTI2024

Opportunities and Challenges for Machine Learning-Assisted Enzyme Engineering

Enzymes can be engineered at the level of their amino acid sequences to optimize key properties such as expression, stability, substrate range, and catalytic efficiency or even to unlock new catalytic activities not found in nature. Because the search space of possible proteins is vast, enzyme engineering usually involves discovering an enzyme starting point that has some level of the desired activity followed by directed evolution to improve its “fitness” for a desired application. Recently, machine learning (ML) has emerged as a powerful tool to complement this empirical process. ML models can contribute to (1) starting point discovery by functional annotation of known protein sequences or generating novel protein sequences with desired functions and (2) navigating protein fitness landscapes for fitness optimization by learning mappings between protein sequences and their associated fitness values. In this Outlook, we explain how ML complements enzyme engineering and discuss its future potential to unlock improved engineering outcomes.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

ExaAM: Metal additive manufacturing simulation at the fidelity of the microstructure

Additive manufacturing (AM), or 3D printing, of metals is transforming the fabrication of components, in part by dramatically expanding the design space, allowing optimization of shape and topology. However, although the physical processes involved in AM are similar to those of welding, a field with decades of experimental, modeling, simulation, and characterization experience, qualification of AM parts remains a challenge. The availability of exascale computational systems, particularly when combined with data-driven approaches such as machine learning, enables topology and shape optimization as well as accelerated qualification by providing process-aware, locally accurate microstructure and mechanical property models. We describe the physics components comprising the Exascale Additive Manufacturing simulation environment and report progress using highly resolved melt pool simulations to inform part-scale finite element thermomechanics simulations, drive microstructure evolution, and determine constitutive mechanical property relationships based on those microstructures using polycrystal plasticity. We report on implementation of these components for exascale computing architectures, as well as the multi-stage simulation workflow that provides a unique high-fidelity model of process–structure–property relationships for AM parts. In addition, we discuss verification and validation through collaboration with efforts such as AM-Bench, a set of benchmark test problems under development by a team led by the National Institute of Standards and Technology.

3D printing↗
DOE OSTI2022

Machine learning and atomic layer deposition: Predicting saturation times from reactor growth profiles using artificial neural networks

In this work, we explore the application of deep neural networks to the optimization of atomic layer deposition (ALD) processes. In particular, we focus on a one-shot optimization problem, where we try to predict the optimal dose time that leads to saturation everywhere in the reactor based on thickness values measured at different points of an ALD reactor after a single trial growth. In order to tackle this problem, we introduce a dataset designed to train neural networks to predict saturation times based on these inputs for a cross-flow ALD reactor. Here, we then explore the predictive ability of artificial neural networks of different depths and sizes using a separate testing dataset to evaluate their accuracies. The results obtained show that networks trained using stochastic gradient descent methods can accurately predict saturation times without requiring any additional information on the surface kinetics. This provides a viable approach to minimize the number of experiments required to optimize new ALD processes in a known reactor, and it highlights the way machine learning can be leveraged for thin film growth and manufacturing. While the datasets and training procedure depend on the reactor geometry, the trained neural networks provide a general surrogate model connecting thickness values and trial dose times with optimal saturation times that can be reused for different ALD processes within the same reactor.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Combustion Performance and Emissions Optimization Through Integration of a Miniaturized High-Temperature Multi Process Monitoring System

The main objective of this research program is to design, manufacture, and demonstrate a miniaturized, multi-process, monitoring system (mMPMS) for boiler condition management and easy system deployment to obtain a higher spatial resolution. This system will facilitate a Condition-Based Maintenance (CBM) philosophy that actively monitors the health of assets to predict and prevent failures and maximize availability and generating capacity at a reduced cost. CBM systems can provide boiler data that the advanced process control (APC) system can utilize for plant performance optimization, which is increasingly relevant as coal power plants shift from predominantly base-load operation to predominantly transient operation involving large load swings. The mMPMS is based on an electrochemical sensor that provides a real-time indication of the risk of damage to key locations in the radiant or convective section of a coal-fired boiler such as metal loss rates, heat flux, metal surface temperature, and deposit thickness. These indications can be utilized to optimize boiler performance as well as improve boiler availability in conjunction with corresponding operating conditions. This monitoring system was developed and tested in the high-temperature regions of coal-fired utility boilers in this project but can be applied to many other industries and applications as well. This project leveraged the existing electrochemical noise-based monitoring system and the new sensor design is small enough to be installed through the webbing of the waterwalls without the need for long shut-downs to bend tubes and to make it feasible to obtain high spatial resolution in the boiler. Data is transferred to the plant distributed control system (DCS) and any other control system. The sensor body that houses the sensor assembly was designed to ensure good conductive contact with boiler tubes to ensure the sensor is held at an identical temperature to the tube surface temperature. The data acquisition and signal conditioning modules were redesigned into a small footprint with optimized cooling of the module. System software was developed specifically for the new signal conditioning module and is compatible with plant PLCs. After the preliminary testing at a pilot-scale facility, five mMPMS were installed at a full-scale pulverized coal-fired plant, Basin Electric Power Cooperative’s Leland Olds Unit 1. The systems were demonstrated over a 6-week period during typical operation. Sensor measurements of deposit thickness were validated during the demonstration and subsequently leveraged to determine sensor-based boiler cleaning strategies. These strategies have the benefit of reduced thermal stresses on boiler tubes from over-cleaning and improved boiler water management. At the end of the project, continued development of the sensor technology was carried out at PacifiCorp’s Hunter Station. REI leveraged the permanent installation of the mMPMS in Unit 3 made possible by DOE funding on a separate program. The work at Hunter Plant focused on application of machine learning and artificial intelligence-based models for integration of sensor signals into control and optimization of Hunter Unit 3 processes.

Advanced Sensors, Corrosion, Ash Deposition, Optim↗
DOE OSTI2025

Two-level overlapping additive Schwarz preconditioner for training scientific machine learning applications

In this work we introduce a novel two-level overlapping additive Schwarz preconditioner for accelerating the training of scientific machine learning applications. The design of the proposed preconditioner is motivated by the nonlinear two-level overlapping additive Schwarz preconditioner. The neural network parameters are decomposed into groups (subdomains) with overlapping regions. In addition, the network’s feed-forward structure is indirectly imposed through a novel subdomain-wise synchronization strategy and a coarse-level training step. Through a series of numerical experiments, which consider physicsinformed neural networks and operator learning approaches, we demonstrate that the proposed two-level preconditioner significantly speeds up the convergence of the standard (LBFGS) optimizer while also yielding more accurate machine learning models. Moreover, the devised preconditioner is designed to take advantage of model-parallel computations, which can further reduce the training time.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Combustion Performance and Emissions Optimization Through Integration of a Miniaturized High-Temperature Multi Process Monitoring System

The main objective of this research program is to design, manufacture, and demonstrate a miniaturized, multi-process, monitoring system (mMPMS) for boiler condition management and easy system deployment to obtain a higher spatial resolution of wall conditions in utility boilers. This system will facilitate a Condition-Based Maintenance (CBM) philosophy that actively monitors the health of assets to predict and prevent failures and maximize availability and generating capacity at a reduced cost. CBM systems can provide boiler data that the advanced process control (APC) system can utilize for plant performance optimization, which is increasingly relevant as coal power plants shift from predominantly base-load operation to predominantly transient operation involving large load swings. The mMPMS is based on an electrochemical sensor that provides a real-time indication of the risk of damage to key locations in the radiant or convective section of a coal-fired boiler such as metal loss rates, heat flux, metal surface temperature, and deposit thickness. These indications can be utilized to optimize boiler performance as well as improve boiler availability in conjunction with corresponding operating conditions. This monitoring system was developed and tested in the high-temperature regions of a coal-fired utility boiler in this project but can be applied to many other industries and applications as well. The new sensor design, leveraging the existing electrochemical noise-based monitoring system, is small enough to be installed through the webbing of the waterwalls without the need for long shut-downs to bend tubes and to make it feasible to obtain high spatial resolution in the boiler. Data can be transferred to the plant distributed control system (DCS) and any other control system. The sensor body that houses the sensor assembly was designed to ensure good conductive contact with boiler tubes to ensure the sensor is held at an identical temperature to the tube surface temperature. The data acquisition and signal conditioning modules were redesigned into a small footprint with optimized cooling of the module. System software was developed specifically for the new signal conditioning module and is compatible with plant PLCs. After the preliminary testing at a pilot-scale facility, five mMPMS were installed at a full-scale pulverized coal-fired plant, Basin Electric Power Cooperative’s Leland Olds Unit 1. The systems were demonstrated over a 6-week period during typical operation. Sensor measurements of deposit thickness were validated during the demonstration and subsequently leveraged to determine sensor-based boiler cleaning strategies. These strategies have the benefit of reduced thermal stresses on boiler tubes from over-cleaning and improved boiler water management. At the end of the project, continued development of the sensor technology was carried out at PacifiCorp’s Hunter Station. REI leveraged the permanent installation of the mMPMS in Unit 3 made possible by DOE funding on a separate program. The work at Hunter Plant focused on application of machine learning and artificial intelligence-based models for integration of sensor signals into control and optimization of Hunter Unit 3 processes.

42 ENGINEERING↗
DOE OSTI2022

Combustion Performance and Emissions Optimization Through Integration of a Miniaturized High-Temperature Multi Process Monitoring System

The main objective of this research program is to design, manufacture, and demonstrate a miniaturized, multi-process, monitoring system (mMPMS) for boiler condition management and easy system deployment to obtain a higher spatial resolution. This system will facilitate a Condition-Based Maintenance (CBM) philosophy that actively monitors the health of assets to predict and prevent failures and maximize availability and generating capacity at a reduced cost. CBM systems can provide boiler data that the advanced process control (APC) system can utilize for plant performance optimization, which is increasingly relevant as coal power plants shift from predominantly base-load operation to predominantly transient operation involving large load swings. The mMPMS is based on an electrochemical sensor that provides a real-time indication of the risk of damage to key locations in the radiant or convective section of a coal-fired boiler such as metal loss rates, heat flux, metal surface temperature, and deposit thickness. These indications can be utilized to optimize boiler performance as well as improve boiler availability in conjunction with corresponding operating conditions. This monitoring system was developed and tested in the high-temperature regions of coal-fired utility boilers in this project but can be applied to many other industries and applications as well. The new sensor design, leveraging the existing electrochemical noise-based monitoring system, is small enough to be installed through the webbing of the waterwalls without the need for long shut-downs to bend tubes and to make it feasible to obtain high spatial resolution in the boiler. Data can be transferred to the plant distributed control system (DCS) and any other control system. The sensor body that houses the sensor assembly was designed to ensure good conductive contact with boiler tubes to ensure the sensor is held at an identical temperature to the tube surface temperature. The data acquisition and signal conditioning modules were redesigned into a small footprint with optimized cooling of the module. System software was developed specifically for the new signal conditioning module and is compatible with plant PLCs. After the preliminary testing at a pilot-scale facility, five mMPMS were installed at a full-scale pulverized coal-fired plant, Basin Electric Power Cooperative’s Leland Olds Unit 1. The systems were demonstrated over a 6-week period during typical operation. Sensor measurements of deposit thickness were validated during the demonstration and subsequently leveraged to determine sensor-based boiler cleaning strategies. These strategies have the benefit of reduced thermal stresses on boiler tubes from over-cleaning and improved boiler water management. At the end of the project, continued development of the sensor technology was carried out at PacifiCorp’s Hunter Station. REI leveraged the permanent installation of the mMPMS in Unit 3 made possible by DOE funding on a separate program. The work at Hunter Plant focused on application of machine learning and artificial intelligence-based models for integration of sensor signals into control and optimization of Hunter Unit 3 processes.

Advanced Sensors, Corrosion, Ash Deposition, Optim↗
DOE OSTI2022

Generalizability analysis of tool condition monitoring ensemble machine learning models

Tool condition monitoring (TCM) is an essential research area for the optimization and automation of metal machining processes, and could help manufacturers reduce costs, production time, machine downtime, energy use, and part scrappage. However, TCM systems developed in prior studies have struggled to reach the high level of generalizability which is necessary for industrial applications. This study addresses TCM system generalizability to new machining conditions, how variations in machining and environmental conditions may be used to improve model generalizability, and ensemble machine learning techniques for TCM. Further, milling tool life experiments were conducted using various machining conditions, and the processes' sound, spindle power, and axial load signals were collected. Different machine learning models were evaluated for the prediction of tool wear levels, including four individual models and five ensemble models. Changes in cutting speed were found to display a large effect on model performance, while the chip load showed some effect, and the feed rate had little effect. A simulated noise data augmentation technique for model improvement is applied within TCM for the first time, and resulted in increased model generalizability and reduced overfitting. Across several performance metrics the extremely randomized trees ensemble machine learning model generally performed the best for this application, achieving a leave-one-group-out cross validation accuracy score of 92.4 %, a 10-fold cross validation score of 98.9 %, and an averaged accuracy across 11 generalizability tests of 87.3 %.

42 ENGINEERING↗
DOE OSTI2023

Adaptive learning-driven high-throughput synthesis of oxygen reduction reaction Fe–N–C electrocatalysts

Reducing human reliance on inefficient energy systems and fossil fuels has become more urgent due to the consequences of global climate change. However, traditional trial-and-error approaches have hampered our ability to accelerate the discovery and implementation of functional materials for efficient energy conversion devices, such as polymer electrolyte fuel cells (PEFCs). To address this, we develop an adaptive learning framework that integrates machine learning and state-of-the-art capabilities in high-throughput synthesis to achieve expedited optimization of iron-nitrogen-carbon PEFC oxygen reduction reaction (ORR) electrocatalysts. We use statistical inference, uncertainty quantification, and global optimization to build a computational design-of-experiment tool that identifies the optimum compositions to be investigated next to reduce the demands placed on experimental materials discovery. We benchmark the ability of the proposed strategy to discover optimum catalyst synthesis conditions in a six-dimensional search space when starting with a thirty-six-sample database. By following the adaptive learning strategy, we synthesize fourteen new catalysts from approximately ten billion unique compositions and discover four catalysts that outperform all original samples. The best machine learning-optimized catalyst is 33% more active than the highest-performing one in the initial database, showing an ORR activity seven times larger than those typically reported for the same class of materials.

36 MATERIALS SCIENCE↗
DOE OSTI2025

A Computational Framework to design 3D stiffness gradient acoustic metamaterials for impedance matching

Acoustic waves play a crucial role in various applications, including medical imaging, non-destructive testing, and sonar systems. One of the significant challenges in these applications is impedance matching, which is essential for minimizing reflections and maximizing the transfer of acoustic energy between different media. Acoustic metamaterials offer a promising solution to this challenge. In addition to impedance control, gradient stiffness can enhance structural efficiency and enable spatial control of wave propagation, making it a valuable feature in acoustic metamaterial design. In this pa- per, we present our developed computational method to design 3D stiffness gradient acoustic metamaterials for impedance matching. The key steps in our approach include generating initial designs using a periodic covariance function to provide unit cells that are both periodic on the boundaries and randomly formed inside the unit cell. Furthermore, we integrated manufacturing constraints into the design process, ensuring that the structures are interconnected for fabrication. We propose two computational optimization algorithms: GenUnit, based on a non-dominated sorting genetic algorithm (NSGA-II), and MLMatch, which leverages differentiable machine learning. The two approaches are not separate contributions but complementary com- ponents of a unified framework. GenUnit requires no training data and directly interfaces with physics-based simulations, making it highly accurate but slower for large-scale exploration. In contrast, MLMatch is data-hungry during training but, once trained, enables near-instantaneous inference and broad design-space coverage. Together, they form a hybrid strategy: ML- Match rapidly explores the global design space, and GenUnit provides local refinement with high-fidelity accuracy. This balance between training cost, inference time, and precision is the motivation for including both methods in the same study. We applied this dual-algorithm framework to generate two metallic-based metamaterial designs that match the acoustic impedance of water while exhibiting a controlled gradient in stiffness (from stiff to soft). The stiffness gradient is particularly advantageous in applications where one side of the structure must interface with soft or sensitive surfaces, such as human tissue or delicate components. Here, this work paves the way for improved materials in various acoustic applications, particularly in ultrasound devices, by providing better impedance.

Metamaterial↗
DOE OSTI2021

QUBO formulations for training machine learning models

Abstract Training machine learning models on classical computers is usually a time and compute intensive process. With Moore’s law nearing its inevitable end and an ever-increasing demand for large-scale data analysis using machine learning, we must leverage non-conventional computing paradigms like quantum computing to train machine learning models efficiently. Adiabatic quantum computers can approximately solve NP-hard problems, such as the quadratic unconstrained binary optimization (QUBO), faster than classical computers. Since many machine learning problems are also NP-hard, we believe adiabatic quantum computers might be instrumental in training machine learning models efficiently in the post Moore’s law era. In order to solve problems on adiabatic quantum computers, they must be formulated as QUBO problems, which is very challenging. In this paper, we formulate the training problems of three machine learning models—linear regression, support vector machine (SVM) and balanced k-means clustering—as QUBO problems, making them conducive to be trained on adiabatic quantum computers. We also analyze the computational complexities of our formulations and compare them to corresponding state-of-the-art classical approaches. We show that the time and space complexities of our formulations are better (in case of SVM and balanced k-means clustering) or equivalent (in case of linear regression) to their classical counterparts.

97 MATHEMATICS AND COMPUTING↗