Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “machining processes”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

CASTELO: clustered atom subtypes aided lead optimization—a combined machine learning and molecular modeling method

Background: Drug discovery is a multi-stage process that comprises two costly major steps: pre-clinical research and clinical trials. Among its stages, lead optimization easily consumes more than half of the pre-clinical budget. We propose a combined machine learning and molecular modeling approach that partially automates lead optimization workflow in silico, providing suggestions for modification hot spots. Results: The initial data collection is achieved with physics-based molecular dynamics simulation. Contact matrices are calculated as the preliminary features extracted from the simulations. To take advantage of the temporal information from the simulations, we enhanced contact matrices data with temporal dynamism representation, which are then modeled with unsupervised convolutional variational autoencoder (CVAE). Finally, conventional and CVAE-based clustering methods are compared with metrics to rank the submolecular structures and propose potential candidates for lead optimization. Conclusion: With no need for extensive structure-activity data, our method provides new hints for drug modification hotspots which can be used to improve drug potency and reduce the lead optimization time. It can potentially become a valuable tool for medicinal chemists.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Exploring the energy landscape of RBMs: reciprocal space insights into bosons, hierarchical learning and symmetry breaking

Deep generative models have become ubiquitous due to their ability to learn and sample from complex distributions. Despite the proliferation of various frameworks, the relationships among these models remain largely unexplored, a gap that hinders the development of a unified theory of AI learning. In this work, we address two central challenges: clarifying the connections between different deep generative models and deepening our understanding of their learning mechanisms. We focus on Restricted Boltzmann Machines (RBMs), a class of generative models known for their universal approximation capabilities for discrete distributions. By introducing a reciprocal space formulation for RBMs, we reveal a connection between these models, diffusion processes, and systems of coupled bosons. Our analysis shows that at initialization, the RBM operates at a saddle point, where the local curvature is determined by the singular values of the weight matrix, whose distribution follows the Marc̆enko-Pastur law and exhibits rotational symmetry. During training, this rotational symmetry is broken due to hierarchical learning, where different degrees of freedom progressively capture features at multiple levels of abstraction. This leads to a symmetry breaking in the energy landscape, reminiscent of Landau’s theory. This symmetry breaking in the energy landscape is characterized by the singular values and the weight matrix eigenvector matrix. We derive the corresponding free energy in a mean-field approximation. We show that in the limit of infinite size RBM, the reciprocal variables are Gaussian distributed. Our findings indicate that in this regime, there will be some modes for which the diffusion process will not converge to the Boltzmann distribution. To illustrate our results, we trained replicas of RBMs with different hidden layer sizes using the MNIST dataset. Our findings not only bridge the gap between disparate generative frameworks but also shed light on the fundamental processes underpinning learning in deep generative models.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Towards fast and accurate predictions of radio frequency power deposition and current profile via data-driven modelling: applications to lower hybrid current drive

Three machine learning techniques (multilayer perceptron, random forest and Gaussian process) provide fast surrogate models for lower hybrid current drive (LHCD) simulations. A single GENRAY/CQL3D simulation without radial diffusion of fast electrons requires several minutes of wall-clock time to complete, which is acceptable for many purposes, but too slow for integrated modelling and real-time control applications. The machine learning models use a database of more than 16 000 GENRAY/CQL3D simulations for training, validation and testing. Latin hypercube sampling methods ensure that the database covers the range of nine input parameters ( $n_{e0}$ , $T_{e0}$ , $I_p$ , $B_t$ , $R_0$ , $n_{\|}$ , $Z_{{\rm eff}}$ , $V_{{\rm loop}}$ and $P_{{\rm LHCD}}$ ) with sufficient density in all regions of parameter space. The surrogate models reduce the inference time from minutes to $\sim$ ms with high accuracy across the input parameter space.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Towards Fast and Accurate Predictions of Radio Frequency Power Deposition and Current Profile via Data-driven Modeling

Three machine learning techniques (multilayer perceptron, random forest, and Gaussian process) provide fast surrogate models for lower hybrid current drive (LHCD) simulations. A single GENRAY/CQL3D simulation without radial diffusion of fast electrons requires several minutes of wall-clock time to complete, which is acceptable for many purposes, but too slow for integrated modeling and real-time control applications. The machine learning models use a database of 16,000+ GENRAY/CQL3D simulations for training, validation, and testing. Latin hypercube sampling methods ensure that the database covers the range of 9 input parameters ($n_{e0}$, $T_{e0}$, $I_p$, $B_t$, $R_0$, $n_{||}$, $Z_{eff}$, $V_{loop}$, $P_{LHCD}$) with sufficient density in all regions of parameter space. The surrogate models reduce the inference time from minutes to ~ms with high accuracy across the input parameter space.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Using machine learning with optical profilometry for GaN wafer screening

Abstract To improve the manufacturing process of GaN wafers, inexpensive wafer screening techniques are required to both provide feedback to the manufacturing process and prevent fabrication on low quality or defective wafers, thus reducing costs resulting from wasted processing effort. Many of the wafer scale characterization techniques—including optical profilometry—produce difficult to interpret results, while models using classical programming techniques require laborious translation of the human-generated data interpretation methodology. Alternatively, machine learning techniques are effective at producing such models if sufficient data is available. For this research project, we fabricated over 6000 vertical PiN GaN diodes across 10 wafers. Using low resolution wafer scale optical profilometry data taken before fabrication, we successfully trained four different machine learning models. All models predict device pass and fail with 70–75% accuracy, and the wafer yield can be predicted within 15% error on the majority of wafers.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Toward Urban Water Security: Broadening the Use of Machine Learning Methods for Mitigating Urban Water Hazards

Due to the complex interactions of human activity and the hydrological cycle, achieving urban water security requires comprehensive planning processes that address urban water hazards using a holistic approach. However, the effective implementation of such an approach requires the collection and curation of large amounts of disparate data, and reliable methods for modeling processes that may be co-evolutionary yet traditionally represented in non-integrable ways. In recent decades, many hydrological studies have utilized advanced machine learning and information technologies to approximate and predict physical processes, yet none have synthesized these methods into a comprehensive urban water security plan. In this paper, we review ways in which advanced machine learning techniques have been applied to specific aspects of the hydrological cycle and discuss their potential applications for addressing challenges in mitigating multiple water hazards over urban areas. We also describe a vision that integrates these machine learning applications into a comprehensive watershed-to-community planning workflow for smart-cities management of urban water resources.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Comparing quantile regression forest and mixture density long short-term memory models for probabilistic post-processing of satellite precipitation-driven streamflow simulations

Abstract. Deep learning (DL) and machine learning (ML) are widely used in hydrological modelling, which plays a critical role in improving the accuracy of hydrological predictions. However, the trade-off between model performance and computational cost has always been a challenge for hydrologists when selecting a suitable model, particularly for probabilistic post-processing with large ensemble members. This study aims to systematically compare the quantile regression forest (QRF) model and countable mixtures of asymmetric Laplacians long short-term memory (CMAL-LSTM) model as hydrological probabilistic post-processors. Specifically, we evaluate their ability in dealing with biased streamflow simulations driven by three satellite precipitation products across 522 nested sub-basins of the Yalong River basin in China. Model performance is comprehensively assessed using a series of scoring metrics from both probabilistic and deterministic perspectives. Our results show that the QRF model and the CMAL-LSTM model are comparable in terms of probabilistic prediction, and their performances are closely related to the flow accumulation area (FAA) of the sub-basin. The QRF model outperforms the CMAL-LSTM model in most sub-basins with smaller FAA, while the CMAL-LSTM model has an undebatable advantage in sub-basins with FAA larger than 60 000 km2 in the Yalong River basin. In terms of deterministic predictions, the CMAL-LSTM model is preferred, especially when the raw streamflow is poorly simulated and used as input. However, setting aside the differences in model performance, the QRF model with 100-member quantiles demonstrates a noteworthy advantage by exhibiting a 50 % reduction in computation time compared to the CMAL-LSTM model with the same ensemble members in all experiments. As a result, this study provides insights into model selection in hydrological post-processing and the trade-offs between model performance and computational efficiency. The findings highlight the importance of considering the specific application scenario, such as the catchment size and the required accuracy level, when selecting a suitable model for hydrological post-processing.

Geology↗
DOE OSTI2022

Ultrafast Early Warning of Heart Attacks through Plasmon‐Enhanced Raman Spectroscopy using Collapsible Nanofingers and Machine Learning

Abstract As the leading cause of death, heart attacks result in millions of deaths annually, with no end in sight. Early intervention is the only strategy for rescuing lives threatened by heart disease. However, the detection time of the fastest heart‐attack detection system is >15 min, which is too long considering the rapid passage of life. In this study, a machine learning (ML)‐driven system with a simple process, low‐cost, short detection time (only 10 s), and high precision is developed. By utilizing a functionalized nanofinger structure, even a trace amount of biomarker leaked before a heart attack can be captured. Additionally, enhanced Raman profiles are constructed for predictive analytics. Five ML models are developed to harness the useful characteristics of each Raman spectrum and provide early warnings of heart attacks with >98% accuracy. Through the strategic combination of nanofingers and ML algorithms, the proposed warning system accurately provides alerts on silent heart‐attack attempts seconds ahead of actual attacks.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

Machine Learning to Select Experiments Driven by Fundamental Science and Applications for Targeted Nuclear Data Improvement

This work describes a blueprint for a process that accelerates progress in science by quantitatively answering the following question: What is the optimal combination of fundamental-science and application-driven experiments to maximally reduce pertinent data uncertainties? Answering this question entails solving a high-dimensional and complex optimization problem that is best solved with advanced statistic techniques often classified as machine learning. We apply this process within the framework of nuclear data with the aim to select an experiment combination that will reduce uncertainties in 239 Pu nuclear data for neutron energies between 1 and 600 keV. In this field, fundamental-physics driven data, called differential, look at one nuclear physics observable at a time. They are contrasted to application-driven, integral, data where one or few resulting values inform a broad set of nuclear data across several nuclides and energies. The candidates for integral experiments are criticality measurements that were refined by a genetic algorithm to be maximally sensitive to 239 Pu fission cross sections in the desired energy range. Twenty-three candidate differential experiments were investigated and span multiple nuclear physics observables (e.g., total, capture cross sections) for isotopes appearing in the integral experiments. The optimal combination among these candidate experiments was investigated via generalized least squares fitting, augmented with Gaussian processes to ameliorate statistical irregularities in data, and the D-optimality criterion. The latter evaluates for each pair of candidates the joint reduction in uncertainties of all 12200 nuclear data appearing in the integral experiments compared to the knowledge we have from 168 past experiments, theory, and nuclear data. We chose as differential measurements those that investigate 63 Cu and 239 Pu total cross sections, based on D-optimality rank and feasibility constraints. Two integral (criticality) experiments were selected: An experiment with Al 2 ⁢O 3 and graphite interleaved with Pu and a thick Cu reflector explores 1–30 keV, while we target the 30–600 keV range with an experiment that swaps boron in place of graphite with a different geometry.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Identifying quenched jets in heavy ion collisions with machine learning

Measurements of jet substructure in ultra-relativistic heavy ion collisions suggest that the jet showering process is modified by the interaction with the quark-gluon plasma. Modifications of the hard substructure of jets can be explored with modern data-driven techniques. In this study, a machine learning approach to the identification of quenched jets is designed. Jet showering processes are simulated with a jet quenching model JEWEL and a non-quenching model PYTHIA 8. Sequential substructure variables are extracted from the jet clustering history following an angular-ordered sequence and are used in the training of a neural network built on top of a long short-term memory network. We show that this approach successfully identifies the quenching effect in the presence of the large uncorrelated background of soft particles created in heavy-ion collisions.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Electrochemical Degradation of Pt 3 Co Nanoparticles Investigated by Off-Lattice Kinetic Monte Carlo Simulations with Machine-Learned Potentials

In fuel cell applications, the durability of catalysts is critical for large-scale industrial implementation. However, limited synthesis controllability and spectroscopic resolution impede a comprehensive understanding of degradation mechanisms at the atomic level. In this study, we develop a machine-learned potential (MLP) to simulate the degradation processes for Pt3Co nanoparticles. The precision of MLP is determined to be comparable to that of density functional theory calculations. Using off-lattice kinetic Monte Carlo simulations with MLP, we successfully replicate established experimental trends and offer a logical resolution to ongoing debates regarding atomic orderings. Based on the simulation results, we suggest design principles for Pt3Co nanoparticles that combine high activity and durability. Finally, we validate the wide applicability of our method by successfully applying it to Pt3Ni and Pt3Co0.5Ni0.5 nanoparticles. The research serves as a guideline for developing MLPs for alloy electrochemical catalysts and lays the foundation for designing more durable and active fuel-cell catalysts.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Optimization of WAAM Process to Produce AUSC Components with Increased Service Life

Additive manufacturing has the potential to revolutionize industrial hardware and unlock efficiency gains through the fabrication of geometries and architectures not possible by conventional processing. Wire Arc Additive manufacturing (WAAM) process is a class of directed energy deposition process enabling higher build rate and allowing custom wire feedstock allowing spatial variation of microstructure. The larger spot size and lower speed creates a larger melt pool, reducing residual stress and often time creating directional/columnar microstructure for Ni-superalloy. The use of flexible platform provides freedom in deposition strategy, which can accommodate complex substrates, including feature addition onto existing structures, non-flat layers, and repair methods. However, the certification of the final component needs to match the strength requirement. Hence, the quality of the component produced is stringently monitored to avoid buildup of residual stress, cracks, porosity and to reduce detrimental segregated phases commonly observed during alloy solidification. Simulation plays a huge role in predicting the melt pool dimension and can be used to optimize the process parameter. Similar development is also required to perform physics-based modeling of microstructural development in WAAM that can predict the microstructural features during solidification and can be used to optimize the process more effectively. To move toward this goal, Raytheon Technologies Research Center together with Siemens worked to create a set of computational tools to control the process parameters, enable on-line measurements and acquisition with feedback to the optimized process parameters, and eventually track material evolution through each step of the additive process. Computational fluid dynamics is used for accurate prediction and calibration of the thermal field during WAAM process. and phase field models for microstructure evolution as a function of processing parameters to establish a connection between additive parameters and the final microstructure. Here we report cellular automata (CA) model development to predict the dendritic microstructure evolution with surface and bulk nuclei for single track and multiple layers. The CA model was developed to account for secondary element addition and predict segregation, local melting, and latent heat release as well as prediction of Euler angles from orientation information and validated against experiments. This framework was utilized to tailor spatially-varying composition in a part by appropriately controlling the microstructure evolution during the additive process. Functionally graded Haynes 282 alloy with high Cr content at the surface was tested for oxidation and mechanical properties. An advanced physics-based reaction-diffusion model predicting the simultaneous creation of chromium oxide and alumina is developed and validated to extend life expectancy of the WAAM manufactured high temperature part. A machine-learning data-driven framework establishing the process-structure relationship from a dataset of real microstructure images and corresponding process history data has been developed and implemented in the NX Siemens design system. The digital twin configuration along with the tool path generation enabled prediction of WAAM component buildup time and the techno-economic analysis provided a favorable option for all 4 cases with 15-40% cost reduction.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2024

Scientific machine learning for closure models in multiscale problems: A review

Here, closure problems are omnipresent when simulating multiscale systems, where some quantities and processes cannot be fully prescribed despite their effects on the simulation's accuracy. Recently, scientific machine learning approaches have been proposed as a way to tackle the closure problem, combining traditional (physics-based) modeling with data-driven (machine-learned) techniques, typically through enriching differential equations with neural networks. This paper reviews the different reduced model forms, distinguished by the degree to which they include known physics, and the different objectives of a priori and a posteriori learning. The importance of adhering to physical laws (such as symmetries and conservation laws) in choosing the reduced model form and choosing the learning method is discussed. The effect of spatial and temporal discretization and recent trends toward discretization-invariant models are reviewed. In addition, we make the connections between closure problems and several other research disciplines: inverse problems, Mori-Zwanzig theory, and multi-fidelity methods. In conclusion, much progress has been made with scientific machine learning approaches for solving closure problems, but many challenges remain. In particular, the generalizability and interpretability of learned models is a major issue that needs to be addressed further.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Elucidating Abnormal Grain Growth in Thermomagnetic Processed Materials with Transfer Learning and Reinforcement Learning

The goal of this research program is to establish the mechanism governing local grain boundary motion, which is needed to design and process desirable microstructures for better performance, by identifying the relative contributions of grain boundary (GB) energy and mobility to grain growth. Classical models for grain growth assume that the primary mechanism for reducing the total interfacial energy is area reduction and that GB restructuring is not significant. This assumption implies that grain growth is locally driven by curvature. However, recent experimental observations using new non-destructive 3D x-ray diffraction microscopy techniques (3D-XRM) reveal that classic descriptors (i.e., curvature, number of neighbors, grain size) do not predict real grain growth. Instead, local GB motion appears to be governed by its energy relative to its neighbors such that low-energy boundaries replace those of higher energy. However, simulations that incorporate GB energy anisotropy still fail to reproduce these observations. These discrepancies suggest that the common assumption for grain growth theory must be re-examined to predict and, thus, control microstructure evolution in real polycrystals. A significant challenge to testing this assumption is due to anisotropic GB mobility. Mobility may cause abnormal grain growth or affect the final grain shapes or growth rate but its true contributions are unknown because it is difficult to measure. For example, observations in Fe have found that grains associated with high energy and high mobility boundaries tend to experience abnormal grain growth, whereas abnormal grain growth is associated with low energy and high mobility boundaries in alumina. As mobility and energy both control GB motion, it is challenging to isolate the local driving forces necessary to test the common assumption that the primary mechanism is area reduction. The novelty of this work is the use of machine learning tools to capture GB mobility and energy from 3D-XRM measurements in polycrystals to test the common assumption used in grain growth models. Machine learning can capture high-order correlations in dynamic systems like those found in the evolving GB topology. The PIs have developed a physics-regularized interpretable machine learning microstructure evolution (PRIMME) model that accurately replicates the grain growth behavior of its trained data set.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Accelerating Scientific Computing in the Post-Moore’s Era

Novel uses of graphical processing units for accelerated computation revolutionized the field of high-performance scientific computing by providing specialized workflows tailored to algorithmic requirements. As the era of Moore’s law draws to a close, many new non–von Neumann processors are emerging as potential computational accelerators, including those based on the principles of neuromorphic computing, tensor algebra, and quantum information. While development of these new processors is continuing to mature, the potential impact on accelerated computing is anticipated to be profound. We discuss how different processing models can advance computing in key scientific paradigms: machine learning and constraint satisfaction. Significantly, each of these new processor types utilizes a fundamentally different model of computation, and this raises questions about how to best use such processors in the design and implementation of applications. While many processors are being developed with a specific domain target, the ubiquity of spin-glass models and neural networks provides an avenue for multi-functional applications. Furthermore, this also hints at the infrastructure needed to integrate next-generation processing units into future high-performance computing systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Effect of Blown Powder Directed Energy Deposition Angle On Overspray Contamination

Abstract Blown powder directed energy deposition (DED) hybrid machine tools are particularly beneficial when the net shape of a component is to be manufactured in an additive and machined interleaved fashion. This investigation seeks to analyze the effect of the additive head lean angle relative to the part on blown powder DED surface contamination due to overspray. These hybrid DED platforms are commonly installed on multi-axis machining systems where the lean of the deposition head relative to the component surface can be controlled by tilting the component. The blown powder DED process has a 10–50% lower catchment efficiency as compared to wire fed DED systems. This excess powder is still fed towards the deposition location where the particles are heated by the laser and rebound off the melt pool. Some of these heated particles impact the previously machined thin-wall surface. While the deposition process and tool path planning process has been evaluated, the effect of the overspray due to lean angle of the deposition head on the previously thin-wall machined surface is not yet fully understood. This investigation found that minimum lean angle coincides with minimal overspray effect with nearly no contamination. If a lean angle is required, the maximum lean angle possible should be implemented for the smallest effected overspray area on the machined surface which was found to decrease the affect zone by half compared to intermediate lean angles. A diameter divergence was also noticed as the deposition angle was increased. In this study, a thorough analysis of the surface and geometric effects when depositing thin-walled components at varying angles is completed. It has been shown that part quality can be significantly affected by lean angle and thus must be incorporated as an additional design consideration in the manufacturing process.

Heinrich, Lauren↗
DOE OSTI2024

Quantification of the Crack Evolution Process by Extracting Relevant Signal Components from Wave Propagation and Diffusive Transport Front Measurements

Wave propagation and diffusive transport phenomena in a geological rock sample undergoing crack evolution process are expected to interact with the mechanical discontinuities in the medium. The measurements of the signals associated with these phenomena can be used to assess and monitor the crack-driven micromechanical alterations in the rock. Different wave/diffusion phenomena, such as sonic propagation, pressure diffusion, and acoustic emission (AE), are sensitive to different elements of the mechanical discontinuities generated during the evolution of the crack clusters from initiation to coalescence. Sonic propagation, AE, and pressure diffusion monitoring have the potential to map the crack evolution because the transmitter-receiver arrays can be designed, arranged and tuned to (1) achieve maximum recovery of the scattered waveforms and travel times, (2) capture the later arrivals and multiple reflections, and (3) illuminate large rock volume. However, the structural/topological complexities of the mechanical discontinuities, complex distribution of the stress fields, complex mechanical alterations in media, and fluid redistribution in the crack system pose serious challenges for the detection and modeling of the crack evolution process (from here on, we will use the term ‘crack evolution process’ to mean that the crack evolution occurred under shallow crustal conditions). For purposes of accurately accounting such complexities and heterogeneities in the absence of reliable physical laws, simulation methods, and signal processing techniques, my early-career research proposal will develop and apply novel data-driven machine learning methods to: (1) extract signal components relevant to the various phases of crack evolution and (2) generate a 2D visual map of the crack evolution process.

58 GEOSCIENCES↗
DOE OSTI2021

Toward Hybrid Physics-Machine Learning to improve Land Surface Model predictions

A critical challenge for Land Surface Models (LSMs) is to simulate processes at the surface and the subsurface and their feedbacks to the atmosphere. Even using the same climate forcings, different LSMs predict different surface fluxes and soil moisture conditions due to differences in the formulations of individual processes, parameterizations, and representation of spatial heterogeneity. Ultimately, these differences contribute to the LSM prediction errors and uncertainty. This research seeks to address this challenge by coupling physics-based modeling with state-of-the-art machine learning (ML) techniques to describe complex physical and biogeochemical processes and narrow the gap between model predictions and observations.

58 GEOSCIENCES↗