Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “network acceleration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

A generative artificial intelligence framework based on a molecular diffusion model for the design of metal-organic frameworks for carbon capture

Metal-organic frameworks (MOFs) exhibit great promise for CO 2 capture. However, finding the best performing materials poses computational and experimental grand challenges in view of the vast chemical space of potential building blocks. Here, we introduce GHP-MOFassemble, a generative artificial intelligence (AI), high performance framework for the rational and accelerated design of MOFs with high CO 2 adsorption capacity and synthesizable linkers. GHP-MOFassemble generates novel linkers, assembled with one of three pre-selected metal nodes (Cu paddlewheel, Zn paddlewheel, Zn tetramer) into MOFs in a primitive cubic topology. GHP-MOFassemble screens and validates AI-generated MOFs for uniqueness, synthesizability, structural validity, uses molecular dynamics simulations to study their stability and chemical consistency, and crystal graph neural networks and Grand Canonical Monte Carlo simulations to quantify their CO 2 adsorption capacities. We present the top six AI-generated MOFs with CO 2 capacities greater than 2m mol g -1 , i.e., higher than 96.9% of structures in the hypothetical MOF dataset.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Linking microstructure to creep behavior in vertically and horizontally built LPBF Haynes 282 compared with wrought material via θ -projection

Laser Powder Bed Fusion (LPBF) has emerged as a promising route for fabricating intricate geometries in high-performance alloys. Haynes 282 (H282) is a strong candidate for applications such as heat exchangers or engines due to its excellent creep strength and thermal stability; however, the long-term creep behavior of LPBF-processed H282 remains poorly understood. In this study, the θ -projection method is used to analyze and extrapolate the creep behavior of vertically built LPBF, horizontally built LPBF, compared to wrought H282 tested at 816 °C. Vertically built LPBF H282 exhibits the lowest minimum creep rate (MCR), while the horizontally built condition shows a higher MCR comparable to that of wrought H282. Despite these differences, both LPBF conditions exhibit significantly shorter rupture life and reduced rupture strain than the wrought material, with the most severe degradation observed in the horizontal builds, consistent with an earlier onset of tertiary creep and accelerated strain-rate evolution. Microstructural characterization reveals that both LPBF and wrought H282 exhibit abundant twin-related boundary character; however, their grain boundary topologies differ markedly. The wrought alloy contains a higher fraction of low-angle grain boundaries and continuous twin lamellae, whereas the LPBF microstructure is characterized by a suppressed low-angle boundary population and fragmented twin-related boundaries embedded within irregular high-angle grain boundary networks. Fractographic analysis further reveals predominantly intergranular cracking in LPBF H282, accompanied by grain-boundary-decorated carbides, Al 2 O 3 inclusions, and high-aspect-ratio pores. These results demonstrate that grain boundary topology, rather than minimum creep rate alone, plays a critical role in governing creep damage accumulation and rupture behavior in LPBF and wrought H282.

Creep↗
DOE OSTI2024

Structural evolution of liquid silicates under conditions in Super-Earth interiors

Molten silicates at depth are crucial for planetary evolution, yet their local structure and physical properties under extreme conditions remain elusive due to experimental challenges. In this study, we utilize in situ X-ray diffraction (XRD) at the Matter in Extreme Conditions (MEC) end-station of the Linear Coherent Linac Source (LCLS) at SLAC National Accelerator Laboratory to investigate liquid silicates. Using an ultrabright X-ray source and a high-power optical laser, we probed the local atomic arrangement of shock-compressed liquid (Mg,Fe)SiO 3 with varying Fe content, at pressures from 81(9) to 385(40) GPa. We compared these findings to ab initio molecular dynamics simulations under similar conditions. Results indicate continuous densification of theO-O and Mg-Si networks beyond Earth’s interior pressure range, potentially altering melt properties at extreme conditions. This could have significant implications for early planetary evolution, leading to notable differences in differentiation processes between smaller rocky planets, such as Earth and Venus, and super-Earths, which are exoplanets withmasses nearly three times that of Earth.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

A Length Adaptive Algorithm-Hardware Co-design of Transformer on FPGA Through Sparse Attention and Dynamic Pipelining

Transformers are considered one of the most important deep learning models since 2018, in part because it establishes state-of-the-art (SOTA) records and could potentially replace existing Deep Neural Networks (DNNs). Despite the remarkable triumphs, the prolonged turnaround time of Transformer models is a widely recognized roadblock. The variety of sequence lengths imposes additional computing overhead where inputs need to be zero-padded to the maximum sentence length in the batch to accommodate the parallel computing platforms. This paper targets the field-programmable gate array (FPGA) and proposes a coherent sequence length adaptive algorithm–hardware co-design for Transformer acceleration. Particularly, we develop a hardware-friendly sparse attention operator and a length-aware hardware resource scheduling algorithm. The proposed sparse attention operator brings the complexity of attention-based models down to linear complexity and alleviates the off-chip memory traffic. The proposed length-aware resource hardware scheduling algorithm dynamically allocates the hardware resources to fill up the pipeline slots and eliminates bubbles for NLP tasks. Experiments show that our design has very small accuracy loss and has 80.2 × and 2.6 × speedup compared to CPU and GPU implementation, and 4 × higher energy efficiency than state-of-the-art GPU accelerator optimized via CUBLAS GEMM.

Peng, Hongwu↗
DOE OSTI2022

Hypothesis testing via AI: Generating physically interpretable models of scientific data with machine learning (Full Technical Report)

Deep learning has demonstrated an exceptional ability to solve complex tasks (an engineering success); however, it has done so at the expense of the ability to generate new knowledge (a scientific failure). We propose an alternative framework—entitled Deep Symbolic Regression (DSR)—in which artificial neural networks (NNs) rapidly generate hypotheses about physical relationships among inputs. This framework bypasses the need to interpret an NN altogether, while still leveraging the representational power of deep learning. The resulting models are tractable mathematical expressions, which are inherently and readily human interpretable and can provide insights into underlying physical phenomena. Further, we fold this methodology into the scientific process by allowing the scientist to directly integrate a priori knowledge and beliefs to accelerate learning. We demonstrate this methodology on symbolic regression—the problem of rediscovering underlying expressions describing a dataset—and achieve state-of-the-art performance across a wide variety of symbolic regression problems. Further, we generalize our DSR framework to apply to the more general class of symbolic optimization problems, in which one seeks to optimize a sequence of symbols or “tokens” under a black-box reward function. Examples of other symbolic optimization problems include neural architecture search and computational antibody design. Our generalized tool, Deep Symbolic Optimization (DSO), has been demonstrated on the task of learning symbolic control policies for reinforcement learning environments, and has been adopted as an enabling capability for computational antibody design.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

wa-hls4ml: A GNN Surrogate Model for hls4ml

Recent advancements in use of machine learning techniques on field-programmable gate arrays (FPGAs) have allowed for implementation of embedded neural networks with extremely low latency. This is invaluable for particle detectors at the Large Hadron Collider, where latency and used area must be strictly bounded. The hls4ml framework is a procedure for converting from trained machine learning model software, to a synthesis result that can be used on an FPGA. However, running the pipeline is a time-consuming procedure, and there is a strong risk of failure. In particular, it is possible that the model is unable to be converted into a synthesis result, or that the resource consumption of the model will exceed the resources of the target FPGA. To aid with this development, we introduce wa-hls4ml, a surrogate model which uses a graph neural network to emulate the structure of the source models. The goal is to estimate the chance of success and resource consumption of an arbitrary model when passed through the hls4ml procedure, without the time consumption of actually running the pipeline.

43 PARTICLE ACCELERATORS↗
DOE OSTI2024

Electromagnetic shower separation in LArTPCs: study of the calorimetric method at LArIAT

This thesis reports a study of the prospects of using calorimetry for separating photon- from electron-initiated electromagnetic (EM) showers in liquid argon time projection chambers (LArTPCs), a prevalent need for neutrino oscillation experiments based on the LArTPC technology as $\gamma$-initiated showers are a significant background to electron neutrino ($\nu_e$) events, whose signature is electron showers. From events simulated in the LArIAT (Liquid Argon In A Testbeam) experiment's detector, we quantitatively evaluated the dependence of the calorimetric separation on the initial momentum and position (along the beamline) of the primary particle. We could conclude that the separation is more efficient if the primary particle is created inside the chamber, whereas the impact of the momentum is not as significant. Furthermore, a first step was taken towards applying the calorimetric method to the showers measured in LArIAT. A convolutional neural network (CNN) trained on simulation was deployed to find EM showers among the events collected by the experiment. The charge deposition at the beginning of the showers found is centered at a plausible value, although the width of the distribution demands further inquiry.

43 PARTICLE ACCELERATORS↗
DOE OSTI2025

A percolating path to green iron

About 1.9 gigatons of steel is produced every year, emitting 8% (3.6 gigatons) of global CO 2 in the process. More than 50% of the CO 2 emissions come from a single step of steel production, known as ironmaking. Hydrogen- based direct reduction (HyDR) of iron oxide to iron has emerged as an emission-free ironmaking alternative. However, multiple physical and chemical phenomena ranging from nanometers to meters inside HyDR reactors alter the microstructure and pore networks in iron oxide pellets, in ways that resist gaseous transport of H 2 /H 2 O, slow reaction rates, and disrupt continuous reactor operation. Using synchrotron nano X-ray computed tomography and percolation theory, we quantify the evolution of pores in iron oxide pellets and demonstrate how nanoscale pore connectivity influences micro- and macroscale flow properties such as permeability, diffusivity, and tortuosity. Our modeling framework connects disparate scales and offers opportunities to accelerate HyDR.

hydrogen↗
DOE OSTI2022

Machine learning for design principles for single atom catalysts towards electrochemical reactions

Machine learning (ML) integrated density functional theory (DFT) calculations have recently been used to accelerate the design and discovery of heterogeneous catalysts such as single atom catalysts (SACs) through the establishment of deep structure–activity relationships. Here, this review provides recent progress in the ML-aided rational design of heterogeneous catalysts with the focus on SACs in terms of structure–activity relationships, feature importance analysis, high-throughput screening, stability, and metal–support interactions for electrochemistry. Support vector machine (SVM), random forest regression (RFR), and deep neural networks (DNN) along with atomic properties are mainly used for the design of SACs. The ML results have shown that the number of electrons in the d orbital, oxide formation enthalpy, ionization energy, Bader charge, d-band center, and enthalpy of vaporization are mainly the most important parameters for the defining of the structure–activity relationships for electrochemistry. However, the black-box nature of ML techniques occasionally makes a physical interpretation of descriptors, such as the Bader charge, d-band center, and enthalpy of vaporization, non-trivial. At the current stage, ML application is limited by the lack of a large and high-quality database. Future prospects for the development of a large database and a generalized ML algorithm for SAC design are discussed to give insights for further studies in this field.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Enhanced Ionization Charge Identification in the Short-Baseline Neutrino Program Neutrino Detectors with Deep Neural Networks

We present a deep neural net-based region of interest detection method (DNN ROI) for signal processing in the liquid argon time projection chambers of the Short-Baseline Neutrino (SBN) Program, SBND and ICARUS. DNN ROI addresses limitations of the traditional wire-by-wire thresholding algorithm by leveraging the full two-dimensional detector readout and cross-plane matching information. To account for detector performance variations, we explore training with augmented samples. We find that DNN ROI outperforms the traditional method in both low-level ROI identification performance and high-level reconstruction metrics for high-energy cosmic and accelerator neutrino interaction products, while also being more robust against detector variations, with or without sample augmentation.

Abratenko, P. [Tufts U.]↗
DOE OSTI2022

Multi-variance replica exchange SGMCMC for inverse and forward problems via Bayesian PINN

Physics-informed neural network (PINN) has been successfully applied in solving a variety of nonlinear non-convex forward and inverse problems. However, the training is challenging because of the non-convex loss functions and the multiple optima in the Bayesian inverse problem. In this work, we propose a multi-variance replica exchange stochastic gradient Langevin dynamics method to tackle the challenge of the multiple local optima in the optimization and the challenge of the multiple modal posterior distribution in the inverse problem. Replica exchange methods are capable of escaping from the local traps and accelerating the convergence; two chains with different temperatures are designed where the low temperature chain aims for the local convergence, and the target of the high temperature chain is to travel globally and explore the whole loss function entropy landscape. However, it may not be efficient to solve mathematical inversion problems by using the vanilla replica method directly since the method doubles the computational cost in evaluating the forward solvers (likelihood functions) in the two chains. To address this issue, we propose to make different assumptions on the energy function estimation and this facilities one to use solvers of different fidelities in the likelihood function evaluation. More precisely, one can use a solver with low fidelity in the high temperature chain while using a solver with high fidelity in the low temperature chain. Our proposed method significantly lowers the computational cost in the high temperature chain, meanwhile preserving the accuracy and converging very fast. Here we give an unbiased estimate of the swapping rate and give an estimation of the discretization error of the scheme. To verify our idea, we design and solve four inverse problems which have multiple modes. The proposed method is also employed to train the Bayesian PINN to solve the forward and inverse problems; faster and more accurate convergence has been observed when compared to the stochastic gradient Langevin dynamics (SGLD) method and vanilla replica exchange methods.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Hierarchical Optimal Power Flow with Improved Gradient Evaluation

Existing algorithms to solve alternating-current optimal power flow (AC-OPF) often exploit linear approximations to simplify system models and accelerate computations. In this paper, we improve a recent hierarchical OPF algorithm, which rested on primal-dual gradients evaluated in a linearized distribution power flow model. Specifically, we identify a risk of voltage violation arising from the model linearization, and propose a more accurate gradient evaluation method to eliminate that risk. We further develop a hierarchical primal-dual algorithm to solve OPF based on the proposed gradient evaluation method. Numerical results on IEEE networks show that our algorithm can enhance voltage safety with satisfactory computational efficiency.

distributed algorithm↗
DOE OSTI2025

Hong-Ou-Mandel interference with a coexisting clock using transceivers for synchronization over deployed fiber

Interference between independently generated photons is a key step towards distributing entanglement over long distances, but it requires synchronization between the distantly-located photon sources. Synchronizing the clocks of such photon sources using coexisting two-way classical optical communications over the same fiber that transports the quantum photonic signals is a promising approach for achieving photon-photon interference over long distances, enabling entanglement distribution for quantum networking using the deployed fiber infrastructure. Here, we demonstrate photon-photon interference by observing the Hong-Ou-Mandel dip between two distantly-located sources: a weak coherent-state source obtained by attenuating the output of a laser and a heralded single-photon source. We achieve a maximum dip visibility of 0.58 +/- 0.04 when the two sources are connected via 4.3 km of deployed fiber. Dip visibilities > 0.5 are nonclassical and a first step towards achieving teleportation over the deployed fiber infrastructure. In our experiment, the classical optical communication is achieved with - 21 dBm of optical signal launch power, which is used to synchronize the clocks in the two independent, distantly-located photon sources. The impact of spontaneous Raman scattering from the classical optical signals is mitigated by appropriate choice of the quantum- and classical-channel wavelengths. All equipment used in our experiment (the photon sources and the synchronization setup) is commercially available. Finally, our experiment represents a scalable approach to enabling practical quantum networking with commercial equipment and coexistence with classical communications in optical fiber.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Sensitivity of Simulations of Double-detonation Type Ia Supernovae to Integration Methodology

Abstract We study the coupling of hydrodynamics and reactions in simulations of the double-detonation model for Type Ia supernovae. When assessing the convergence of simulations, the focus is usually on spatial resolution; however, the method of coupling the physics together as well as the tolerances used in integrating a reaction network also play an important role. In this paper, we explore how the choices made in both coupling and integrating the reaction portion of a simulation (operator/Strang splitting versus the simplified spectral deferred corrections method we introduced previously) influences the accuracy, efficiency, and nucleosynthesis of simulations of double detonations. We find no need to limit reaction rates or reduce the simulation time step to the reaction timescale. The entire simulation methodology used here is GPU-accelerated and made freely available as part of the Castro simulation code.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Simurgh: A Framework for Cad-Driven Deep Learning Based X-Ray CT Reconstruction

High-resolution X-ray computed tomography (XCT) is an important technique for the inspection of additively manufactured (AM) parts. While XCT is typically used off-line to inspect a subset of manufactured parts, significantly accelerating measurement speed while retaining accuracy would enable use of XCT for in-line inspection to rapidly identify defects in each part as it is manufactured. Here, we propose a deep learning (DL) based approach that uses computer aided design (CAD) models of the AM parts and physics-based information to rapidly produce high-quality reconstructions from sparse XCT measurements without high quality ground truth data. Our approach uses a generative adversarial neural network (GAN) to produced realistic training data from the CAD-based simulations and a deep neural network that is trained using data from the first stage to produce accurate 3D reconstructions. Using experimental XCT data of metal parts, we demonstrate enhanced defect detection capabilities while dramatically reducing the scan time.

Ziabari, Amir↗
DOE OSTI2026

Multitask graph neural networks for elastoplastic response prediction in dual-phase polycrystals

Microstructure-sensitive prediction of elastoplastic response remains a recurring bottleneck in multiscale damage and fatigue modeling, where large ensembles of statistically distinct polycrystals are required to quantify variability and extreme-value behavior. In this work, we develop a multitask graph neural network (GNN) surrogate that maps dual-phase ferrite–martensite polycrystal microstructures to Statistical Volume Element (SVE)-level elastoplastic Quantities of Interest (QoIs). Each SVE is represented as a grain-adjacency graph, with node features encoding phase, geometry, and crystallographic orientation, and edge features encoding relative misorientation. A message-passing graph convolution generates node embeddings, which are pooled into a graph representation and passed to a multitask regression head that jointly predicts 10 scalar QoIs and vector-valued stress–strain responses in orthogonal loading directions across multiple martensite volume fractions and SVE sizes. Results show high accuracy for scalar QoIs and strong agreement for full stress–strain trajectories, with population envelopes reproducing both median behavior and finite-SVE variability across compositions and partition scales. A unified model trained on pooled volume-fraction data preserves most within-regime accuracy relative to regime-specific models while also capturing the broader cross-regime variation reflected in the pooled test set. Distributional comparisons further demonstrate that the surrogate preserves heterogeneity under SVE partitioning, enabling statistically consistent block-wise random-field construction for mesoscale analyses. Overall, the proposed grain-graph surrogate provides a practical pathway to accelerate ensemble-based studies of SVE-level constitutive variability in dual-phase polycrystals.

Crystal plasticity↗
DOE OSTI2026

Supramolecular Arene‐Perfluoroarene Assembly Enhances Photoiniferter Polymerization Kinetics

Ultra-high-molecular-weight (UHMW, >106 Da) polymers have unique thermomechanical properties due to their large number of physical entanglements. Producing UHMW styrenic polymers is challenging because of their prohibitively slow homopolymerization kinetics. In this report, we show that alternating photoiniferter copolymerization between methoxy-functionalized styrenic monomers and pentafluorostyrene can circumvent this limitation under conditions where arene–perfluoroarene (AP) interactions contribute to favorable monomer association and accelerate copolymerization. Increasing methoxy substitution on the styrene arene ring leads to pronounced rate enhancements that correlate with electronic complementarity between the styrenic comonomers. Density functional theory calculations reveal increasingly favorable AP interaction energies across the series, consistent with monomer association contributing to faster propagation. The result is up to 2000% enhancement in propagation rate in copolymerizations compared to styrene homopolymerization. Despite these rate enhancements, the resulting materials retain broadly similar glass-transition temperatures and network-like thermomechanical behavior, with only modest softening across the series. Here, we then leverage the approach to produce UHMW trialkoxystyrene copolymers bearing sterically encumbered pendants, which are ultrasoft (Young's modulus of 8 kPa) and highly extensible (560%). These results establish that designed supramolecular association between styrenics is a powerful tool for controlling reactivity in radical polymerization and generating otherwise difficult-to-obtain materials.

Marquez, Joshua D. [University of Florida, Gainesv↗
DOE OSTI2024

Machine learning-guided design, synthesis, and characterization of atomically dispersed electrocatalysts

The recent integration of machine learning into materials design has revolutionized the understanding of structure–property relationships and optimization of material properties beyond the trial-and-error paradigm. On one hand, machine learning has significantly accelerated the development of atomically dispersed metal-nitrogen-carbon (M-N-C) electrocatalysts, which traditionally heavily relied on heuristic approaches. On the other hand, the primary challenge of leveraging machine learning to expedite M-N-C materials discovery lies in the cost associated with data collection. Here, we review recent machine learning integration strategies for M-N-C catalyst development, including discussions on the typical algorithms such as symbolic regression and convolutional neural networks employed for the theoretical design, synthesis optimization via active learning, and advanced microscopy characterization. Subsequently, we provide our perspective on potential near-future directions for furthering machine learning-assisted development of new M-N-C catalysts and elucidating the complex physicochemical mechanisms governing the selectivity, activity, and durability in this class of materials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗