Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “machining”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,387 records · Page 77

Predicting Catalyst Surface Stability Under Reaction Conditions Using Deep Reinforcement Learning and Machine Learning Potentials

Catalysts are critical for most large-scale energy intensive chemical transformation processes, such as energy storage, liquid fuel production, and the formation of chemical building blocks. The catalyst composition, structure, and morphology impact the performance under reaction conditions and influences properties like activity and selectivity. Many industrial catalysts offer imperfect activity/selectivity, or contain expensive metals. Further, catalysts can deactivate over time as the morphology changes or harsh reactive environments alter the surface structure. Methods to automatically model and predict the kinetics of how catalyst surfaces will restructure would enable engineers to design around these challenges, improve performance, increase longevity. This project investigated a specific type of machine learning model, deep reinforcement learning, machine learning models to act as surrogates for the physical system, and compared the results of these approaches with a specialized high-throughput experimental synthesis and measurement platform.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Report on Pure Mathematics of Machine Learning

We report on the findings conducted by the Pure Mathematics in Machine Learning (PMML) Project under the umbrella of the Mathematics in Artificial Reasoning in Sciences (MARS) Laboratory Initiative at the Pacific Northwest National Laboratory. The findings contained in this report spans three years of research from the project team. The objectives of the PMML project are two-fold: 1. To gain understanding of modern machine learners through empirical research via structured and sound experimental design, and 2. To prove mathematical theories based upon these empirical findings. We present both empirical results along with mathematical theories in this document.

97 MATHEMATICS AND COMPUTING↗

Machine learning assisted prediction of tungsten heavy alloy plasma facing component performance for fusion energy applications

Tungsten and tungsten heavy alloys (WHAs), known for their remarkably high hardness, durability, and corrosion resistance, play a critical role in the thriving development of nuclear fusion reactors in recent years. However, the exploration in tungsten alloys for the nuclear-related applications has been limited by the difficulty of manufacturing and the complexity of experiments to reproduce the environment of nuclear reaction. Therefore, this project aims to utilize nanoscale simulation methods such as density functional theory (DFT) and molecular dynamics (MD) with the help of machine learning techniques to not only understand the mechanisms of tungsten alloys but also allow us to computationally predict their mechanical behaviors under extreme environments. One critical problem of the application of WHAs in nuclear reactors is the surface melting. In the current design of the SPARC reactor, the WHA, W97Ni2.1Fe0.9 or W97NiFe, is chosen to be the first wall components to confine the plasma where the particles are fiercely moving and colliding into each other to create nuclear fusion reaction. This process will generate extremely high heat flux onto these WHA tiles, leaving high surface temperature that could possibly melt the surface of the WHA tiles, As illustrated in Fig. 1(a). a laser experiment previously done illustrates that a rough surface damage would be made after the surface melting where the matrix area mainly composed of nickel and iron as shown in Fig. 1(b), will first melt and then leave vacancies between these tungsten grains. Unfortunately, these kinds of roughness on the first-wall components could be deadly to the plasma inside a Tokmak reactor because the heat that is supposed to dissipate at a designed ratio through the tiles may in turn be excessively absorbed and accumulated on any uneven area of the surface, which will eventually make the whole nuclear reaction fail. In this project, we will introduce a machine learning potential, Allegro, based on DFT calculation and then build a MD model for W-Ni-Fe alloys.

36 MATERIALS SCIENCE↗

Parametric and Sensitivity Analysis of a Steam Generator Model Using Python and Machine-Learning Tools

For this study, we used Python and machine-learning tools to perform a comprehensive parametric and sensitivity analysis on a steam generator (SG) model. (The Python model was based on a previously completed MATLAB framework for the Holtec SMR-160 SG.) We investigated the influence of various input parameters (e.g., heat transfer coefficient [HTC], Nusselt number, and heat exchanger effectiveness) on the system’s output. With machine-learning tools such as the Risk Analysis Virtual Environment (RAVEN), which was developed at Idaho National Laboratory, we were then able to perform an automated analysis of the SG inputs’ effect on the HTC. The analysis results give valuable insights into the performance and optimization of SG systems. We found the inlet mass flow rate (MFR) to have the greatest impact on the HTC, followed closely by the inlet temperature, and then pressure. Shifting of the input parameters causes the location of the maximum HTC along the SG length to change incrementally. The cold leg (CL) MFR was also found to impact the HTC magnitude as well as the location of the maximum HTC. At between 0.4–0.9 of the total SG length, the input parameters experience maximum impact on the HTC, leading us to suggest that sensors be efficiently placed on the SG so as to closely and effectively monitor thermal-hydraulic properties during reactor operation. We also found that the sensitivity data calculated manually agrees with the RAVEN – based data, confirming the same range of maximum sensitivity. However, the RAVEN-based analysis showed that cold leg pressure and hot leg temperature have a greater impact on the heat transfer coefficient than the mass flow rate, implying that a manual sensitivity study taking only two samples is not accurate.

20 FOSSIL-FUELED POWER PLANTS↗

Machine-Learned Force Field Modeling of Metal Organic Frameworks for CO2 Direct Air Capture

To cope with legacy greenhouse gas emissions and to achieve net-zero emissions by 2050, the U.S. Department of Energy (DOE) is funding efforts to develop direct air capture (DAC), a method for removing CO2 directly from air. Metal organic frameworks (MOFs) have been well studied as DAC sorbent materials due to their tunable structural and compositional properties. Thermodynamic simulations using force fields are often used to provide predictions of a material’s performance in many separations. However, these force fields often make assumptions about bonds and the physics of the adsorption process. A new class of force fields called machine-learned force fields (MLFFs) use machine learning to form quantitative relationships between a material’s chemical structure and the forces and energies predicted by more accurate quantum mechanical calculations, such as dispersion-corrected density functional theory (DFT). In this work, models were developed to achieve DFT-level accuracy for the forces and energies associated with MOF flexibility and CO2 adsorption using MLFFs. These methods were parametrized based on thousands of DFT calculations of CO2 in flexible MOFs and used to predict MOF structural properties as well as CO2 adsorption in several MOFs.

Findley, John↗

Linac_Gen: Integrating Machine Learning and Particle-in-Cell Methods for Enhanced Beam Dynamics at Fermilab

Here, we introduce Linac_Gen, a tool developed at Fermilab, which combines machine learning algorithms with Particle-in-Cell methods to advance beam dynamics in linacs. Linac_Gen employs techniques such as Random Forest, Genetic Algorithms, Support Vector Machines, and Neural Networks, achieving a tenfold increase in speed for phase-space matching in Linacs over traditional methods, through the use of genetic algorithms. Crucially, Linac_Gen's adept handling of 3D field maps elevates the precision and realism in simulating beam instabilities and resonances, marking a key advancement in the field. Benchmarked against established codes, Linac_Gen demonstrates not only improved efficiency and precision in beam dynamics studies but also in the design and optimization of Linac systems, as evidenced in its application to Fermilab's PIP-II Linac project. This work represents a notable advancement in accelerator physics, marrying ML with PIC methods to set new standards for efficiency and accuracy in accelerator design and research. Linac_Gen exemplifies a novel approach in accelerator technology, offering substantial improvements in both theoretical and practical aspects of beam dynamics.

43 PARTICLE ACCELERATORS↗

Machine-Learned Force Field Modeling of Metal Organic Frameworks for CO2 Direct Air Capture

To cope with legacy greenhouse gas emissions and to achieve net-zero emissions by 2050, the U.S. Department of Energy (DOE) is funding efforts to develop direct air capture (DAC), a method for removing CO2 directly from air. Metal organic frameworks (MOFs) have been studied as DAC sorbent materials because of their structural and chemical diversity. Thermodynamic calculations using classical force fields are often used to screen MOFs for their performance in separations such as CO2 capture. Machine-learned force fields (MLFFs) can use machine learning to form quantitative relationships between a material’s chemical structure and the forces and energies predicted by more accurate quantum mechanical calculations, such as dispersion-corrected density functional theory (DFT). These descriptions of forces and energies can be used to improve the accuracy of adsorption calculations. In this work, MLFF models were developed for MOFs to achieve DFT-level accuracy for the forces and energies associated with MOF flexibility and CO2 adsorption. These methods were parametrized based on thousands of DFT calculations of CO2 in flexible MOFs and used to predict MOF structural properties as well as CO2 adsorption properties.

Findley, John↗

Machine Learned Force Field Modeling of Metal Organic Frameworks for CO2 Direct Air Capture

Direct air capture (DAC) is a method for removing CO2 directly from air. Metal organic frameworks (MOFs) have been studied as DAC sorbent materials because of their structural and chemical diversity. Thermodynamic calculations using classical force fields are often used to evaluate MOFs for their performance in separations such as CO2 capture. Machine-learned force fields (MLFFs) can use machine learning to form quantitative relationships between a material’s chemical structure and the forces and energies predicted by more accurate quantum mechanical calculations, such as dispersion-corrected density functional theory (DFT). These descriptions of forces and energies can be used to improve the accuracy of adsorption calculations. In this work, classical models were used to pre-screen MOFs for CO2 capture. DFT calculations were then used to examine the adsorption mechanism. Next, MLFF models were developed for MOFs to achieve DFT-level accuracy for the forces and energies associated with MOF flexibility and CO2 adsorption. These methods were parametrized based on thousands of DFT calculations of CO2 in flexible MOFs and used to predict MOF structural properties as well as CO2 adsorption properties.

Findley, John↗

Deep Deception: Exemplars of Adversarial Machine Learning and Countermeasures Applicable to International Safeguards

As a follow-up to our more comprehensive report on Adversarial Machine Learning (AML), here we provide demonstrations of AML attacks against the Limbo image database of UF6 cylinders in a variety of orientations and amongst a variety of distractor images. We demonstrate the Carlini & Wagner AML attack against a subset of Limbo images, with 100% attack success rate; meaning all attacked images were misclassified by a highly accurate trained model, yet the image changes were imperceptible to the human eye. We also demonstrate successful attacks against segmented images (images with more than one targeted object). Finally, we demonstrated the Fast Fourier Transform countermeasure that can be used to detect AML attacks on images. The intent of this and our previous report is to inform the IAEA and stakeholders of both the promise of machine learning, which could greatly improve the efficiency of surveillance monitoring, but also of the real threat of AML and potential defenses.

97 MATHEMATICS AND COMPUTING↗

Crustal Scale Travel Time Prediction with the SALSA3D Framework and Machine Learning

The SALSA3D project aims to improve our models used in travel time prediction. The current version uses tomographic modeling for propagation through the Earth’s mantle because of the large number (order of millions) of observations of seismic phases which primarily traverse the Earth’s mantle and the ability to pose the travel time problem as a set of linear equations. However, all seismic rays traverse the crust to reach receivers at the surface and therefore models of propagation through the crust are required. Therefore, the primary motivation for this study is to explore how to increase the scope of the SALSA3D project to phases which travel primarily through the crust. In this report, we evaluate new, machine learning based and physics-based methods to model these travel times for integration into the SALSA3D framework. Our results suggest that using our existing physics-based travel time tomography method is a viable approach for the regional to global scale, but better predictive capabilities can be achieved through a neural network trained on the region of interest for near-regional offsets. We suggest future iterations of SALSA3D should incorporate machine learning tools such as Physics-Informed Neural Networks or Bayesian Neural Networks.

58 GEOSCIENCES↗

IMS Rapid Response 2024 Summary Report: A Machine Learning Potential for the Periodic Table

Stockpile stewardship and nuclear waste remediation are inherently chemically complex, involving practically the full diversity of the periodic table, but existing methods are too expensive or not functional for a large diversity of atom types. Overall, the field of machine learning interatomic potentials (MLIPs) has advanced dramatically in 2024 with large high-accuracy datasets existing for bulk, surface, and organic chemical systems and new online leaderboards for diverse chemistry. To participate in, and bring LANL interests into this ecosystem, here, we have built upon existing technologies created by LANL to create a framework capable of creating machine learning interatomic potentials (MLIPs) for over 90 atom types. Our results have created a massively diverse coordination complex training dataset more than 3 times the size of existing datasets, parallelized MLIP training over multiple GPUs, enabling the training of an MLIP spanning the periodic table at 20 times the speed of prior training on 32 GPUs. These advances are substantial towards creation on foundational MLIPs for LANL-specific application areas.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Shorter function summaries for finite state machine-based high consequence systems using logic synthesis and tautologies (Final Report LDRD 24-1302)

Computer programs are often viewed as collections of functions – each function has parameters (inputs) and computes a return value, and each has potential side effects that modify program state (outputs). In this research, a Sandia symbolic execution tool designed to support “human-in-the-loop” analysis was modified to automatically create “function summaries,” and a new tool, “diaboolical,” was created to support enhancing readability of the summary using a novel approach to bit-vector simplification that leverages logic synthesis and tautologies. For this effort, students at Auburn University created several finite state machines (FSMs) to serve as exemplars for high-consequence systems. Function summaries for each of the machines were obtained, and then portions of the summaries were simplified using both diaboolical and the simplification procedure of a popular SMT solver. A comparison of the results shows that diaboolical can often produce smaller function summaries, with expression length improvements over the unsimplified function summaries ranging from 0% to 90% for diaboolical and 0% to 65% for the SMT solver, though diaboolical had a significantly greater cost in time. Diaboolical was evaluated against a collection of “arbitrary” C-code as well as FSM exemplars, and for both datasets it achieved an approximately 10% improvement in expression length compared to simplifications that could be obtained using existing techniques. Function summaries can assist assurance efforts that evaluate existing systems and their executable code. A smaller function summary is likely easier for humans to understand and could thus increase the ability and efficacy of assurance practices centered around the analysis of executable artifacts.

97 MATHEMATICS AND COMPUTING↗

Machine Learning meets Algebraic Combinatorics: A Suite of Benchmark Datasets to Accelerate AI for Mathematics Research

The use of benchmark datasets has become an important engine of progress in machine learning (ML) over the past 15 years. Recently there has been growing interest in utilizing machine learning to drive advances in research-level mathematics. However, off-the-shelf solutions often fail to deliver the types of insights required by mathematicians. This suggests the need for new ML methods specifically designed with mathematics in mind. The question then is: what benchmarks should the community use to evaluate these? On the one hand, toy problems such as learning the multiplicative structure of small finite groups have become popular in the mechanistic interpretability community whose perspective on explainability aligns well with the needs of mathematicians. While toy datasets are a useful benchmark for initial work, they lack the scale, complexity, and sophistication of many of the principal objects of study in modern mathematics. To address this, we introduce a new collection of benchmark datasets, Algebraic Combinatorics Benchmarks (ACBench), representing either classic or open problems in algebraic combinatorics, a subfield of mathematics that studies discrete structures arising from abstract algebra. After describing the datasets, we discuss the challenges involved in constructing “good” mathematics benchmarks, describe baseline model performance, and discuss some of the insights these datasets can provide that may be of interest even to those who are not interested in mathematics research itself.

97 MATHEMATICS AND COMPUTING↗

Geometric Measures of Trustworthiness for Machine Learning Predictions

his report details the findings from the research and investigation of Geometric Measures of Trustworthiness for Machine Learning Predictions. We explored the trustworthiness of machine learning (ML) models’ predictions using geometric measures to quantify the similarity of a query point with the training data. Predictive uncertainty in ML can originate from at least three sources: (1) Model uncertainty, which represents the uncertainty in model form (e.g. decision tree, vs neural network) and estimating the model parameters from the training data, (2) Data uncertainty, which represents the natural complexities of the data such as class overlap and inherent noise, and (3) Distributional uncertainty, which represents the mismatch between the training and operational distributions. The proposed measures focus on measuring and explaining the data and distributional uncertainties by measuring the relationships of operational data with the training data.

97 MATHEMATICS AND COMPUTING↗

Unifying Quantum Materials Modeling and Experiments: The Role of Machine Learning Interatomic Potentials

Computational experiments have emerged as a powerful complement to traditional experiments in the design of new materials. The development of machine learning (ML) and deep learning techniques, combined with database construction and data mining, has significantly enhanced traditional quantum mechanical methods. This synergy enables the rapid development of structure-property relationships. In this talk, I will discuss our recent efforts in applying Machine Learning Interatomic Potentials (MLIAPs) to accelerate materials modeling across various material classes and challenging applications where traditional methods fall short. First, I will highlight the success of MLIAPs in accurately modeling the melting behavior of complex materials. Our results demonstrate high fidelity with experimental observations and also with calculated reference melting temperatures. In the second application, I will discuss how MLIAPs are trained and applied to elucidate the interplay between segregation tendencies and surface reconstructions in CuNi alloys under oxidizing conditions. A key factor in the success of these MLIAP applications is the design of minimalistic yet flexible datasets along with a computational framework for training MLIAPs.

Saidi, Wissam↗

Applying Corrective Machine Learning in the E3SM Atmosphere Model in C++ (EAMxx)

The Simplified Cloud-Resolving E3SM Atmosphere Model (SCREAM) is the newest addition to the family of Earth System Models capable of explicitly resolving convective systems. SCREAM is a kilometer-scale configuration of the advanced E3SM Atmosphere Model (EAMxx), designed for heterogeneous systems. While the enhanced accuracy of kilometer-scale modeling offers significant benefits, it comes with a substantial computational cost, limiting feasible simulation durations to only a few years, even on the fastest supercomputers. Machine learning presents an opportunity for scientists to achieve the high accuracy of storm-resolving models at a significantly reduced cost. Building on the previous success of applying corrective machine learning (ML) to the FV3 model, this study explores the effects of implementing corrective ML in EAMxx-SCREAM. We also address the computational challenges of integrating the corrective ML, which is written in Python, with the C++/Kokkos EAMxx driver, as well as the potential pitfalls of generalizing an approach that was effective with one atmosphere model to another.

54 ENVIRONMENTAL SCIENCES↗

An Efficient Storage-Driven Machine Learning Model for Performance in the Era of Multimodal Scientific Data

Scientific workflows are increasingly relying on machine learning (ML), simulation, and hybrid techniques to predict, understand, and optimize the behavior of complex experiments. High-performance computing has greatly improved researchers’ ability to acquire diverse data modalities in these workflows. Recent studies suggest that the performance of machine learning models can be improved by integrating data from various sources. Unfortunately, these workloads pose unprecedent pressure on the network storage to meet the demands associated with accessing these multimodal data. To mitigate the impact of intensive IO, we propose a solution that utilizes a multi-tier High-Performance Computing (HPC) distributed storage and data processing framework, placing computation where the data resides for better performance. By adopting this project, the scientific community will gain new opportunities to explore multimodal storage-driven possibilities, integrating multiple scientific data sources with advanced streaming frameworks. Additionally, our framework effectively utilizes computing resources and bridges the gaps identified by HPC experts. Our proposed approach tackles scalability and persistence challenges by leveraging native persistency, which has posed difficulties in traditional approaches. Furthermore, we seek to enhance fault-tolerance and load-balance of computations by leveraging real-time streaming in diverse scientific computing environments, thereby propelling advanced scientific computing research into the next generation.

97 MATHEMATICS AND COMPUTING↗

Machine Learning Vacancy Formation Energy in Nickel-Based Superalloys

Creep performance plays a key role in nickel-based superalloys for high temeprature applications. Creep behavior depends on many parameters such as strength, dislocations, diffusivity, and microstructural stability in addition to temeprature, applied stress, and oxidation. This work focuses on predicting vacancy formation energy in nickel-based superalloys using machine learning approach. High-throughput density functional theory (DFT) calculations are performed on Ni-based alloys with the addition of various alloying elements to predict the vacancy formation energy and vacancy concentration. Machine learning is performed using various models including graph neural networks.

creep performance↗