Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “network acceleration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45

Navigating Transition-Metal Chemical Space: Artificial Intelligence for First-Principles Design

Conspectus The variability of chemical bonding in open-shell transition-metal complexes not only motivates their study as functional materials and catalysts but also challenges conventional computational modeling tools. Here, tailoring ligand chemistry can alter preferred spin or oxidation states as well as electronic structure properties and reactivity, creating vast regions of chemical space to explore when designing new materials atom by atom. Although first-principles density functional theory (DFT) remains the workhorse of computational chemistry in mechanism deduction and property prediction, it is of limited use here. DFT is both far too computationally costly for widespread exploration of transition-metal chemical space and also prone to inaccuracies that limit its predictive performance for localized d electrons in transition-metal complexes. These challenges starkly contrast with the well-trodden regions of small-organic-molecule chemical space, where the analytical forms of molecular mechanics force fields and semiempirical theories have for decades accelerated the discovery of new molecules, accurate DFT functional performance has been demonstrated, and gold-standard methods from correlated wavefunction theory can predict experimental results to chemical accuracy. The combined promise of transition-metal chemical space exploration and lack of established tools has mandated a distinct approach. In this Account, we outline the path we charted in exploration of transition-metal chemical space starting from the first machine learning (ML) models (i.e., artificial neural network and kernel ridge regression) and representations for the prediction of open-shell transition-metal complex properties. The distinct importance of the immediate coordination environment of the metal center as well as the lack of low-level methods to accurately predict structural properties in this coordination environment first motivated and then benefited from these ML models and representations. Once developed, the recipe for prediction of geometric, spin state, and redox potential properties was straightforwardly extended to a diverse range of other properties, including in catalysis, computational “feasibility”, and the gas separation properties of periodic metal–organic frameworks. Interpretation of selected features most important for model prediction revealed new ways to encapsulate design rules and confirmed that models were robustly mapping essential structure–property relationships. Encountering the special challenge of ensuring that good model performance could generalize to new discovery targets motivated investigation of how to best carry out model uncertainty quantification. Distance-based approaches, whether in model latent space or in carefully engineered feature space, provided intuitive measures of the domain of applicability. With all of these pieces together, ML can be harnessed as an engine to tackle the large-scale exploration of transition-metal chemical space needed to satisfy multiple objectives using efficient global optimization methods. In practical terms, bringing these artificial intelligence tools to bear on the problems of transition-metal chemical space exploration has resulted in ML-model assessments of large, multimillion compound spaces in minutes and validated new design leads in weeks instead of decades.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Anomalous temperature dependence of the experimental x-ray structure factor of supercooled water

The structural changes of water upon deep supercooling were studied through wide-angle x-ray scattering at SwissFEL. The experimental setup had a momentum transfer range of 4.5 Å-1, which covered the principal doublet of the x-ray structure factor of water. The oxygen–oxygen structure factor was obtained for temperatures down to 228.5 ± 0.6 K. Similar to previous studies, the second diffraction peak increased strongly in amplitude as the structural change accelerated toward a local tetrahedral structure upon deep supercooling. We also observed an anomalous trend for the second peak position of the oxygen–oxygen structure factor (q 2 ). We found that q 2 exhibits an unprecedented positive partial derivative with respect to temperature for temperatures below 236 K. Based on Fourier inversion of our experimental data combined with reference data, we propose that the anomalous q 2 shift originates from that a repeat spacing in the tetrahedral network, associated with all peaks in the oxygen–oxygen pair-correlation function, gives rise to a less dense local ordering that resembles that of low-density amorphous ice. The findings are consistent with that liquid water consists of a pentamer-based hydrogen-bonded network with low density upon deep supercooling.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A Brief Survey of Data Streaming Technologies

Streaming data is data that is emitted at variable volumes in a continuous, incremental manner with the goal of low-latency processing often at a different physical location. Network infrastructure is used to facilitate the connection between data sources and sinks, and must be robust to handle the requirements of the workflow. The U.S. Department of Energy Office of Science (DOE SC) a federal agency supporting fundamental scientific research for energy and the Nation’s largest supporter of basic research in the physical sciences. DOE SC has the responsibility for operating $\mathbf{1 0}$ National Laboratories, and 28 scientific user facilities supporting advanced supercomputers, particle accelerators, large x-ray light sources, neutron scattering sources, and other specialized facilities for nanoscience and genomics. This paper investigates the state of streaming data workfows, and details some of the approaches to this challenging problem.

Kissel, Ezra↗

Accelerating Scientific Computing in the Post-Moore’s Era

Novel uses of graphical processing units for accelerated computation revolutionized the field of high-performance scientific computing by providing specialized workflows tailored to algorithmic requirements. As the era of Moore’s law draws to a close, many new non–von Neumann processors are emerging as potential computational accelerators, including those based on the principles of neuromorphic computing, tensor algebra, and quantum information. While development of these new processors is continuing to mature, the potential impact on accelerated computing is anticipated to be profound. We discuss how different processing models can advance computing in key scientific paradigms: machine learning and constraint satisfaction. Significantly, each of these new processor types utilizes a fundamentally different model of computation, and this raises questions about how to best use such processors in the design and implementation of applications. While many processors are being developed with a specific domain target, the ubiquity of spin-glass models and neural networks provides an avenue for multi-functional applications. Furthermore, this also hints at the infrastructure needed to integrate next-generation processing units into future high-performance computing systems.

97 MATHEMATICS AND COMPUTING↗

Attack-resilient algorithms and testbed federation for wide-area protection and control in smart grid

Today’s energy infrastructure is undergoing a massive transformation across all generation, transmission, and distribution systems to provide reliability, efficiency, and sustainability to the power system network. During the past 10 years, there has been a remarkable enhancement in developing close-loop wide-area protection and control (WAPAC) applications, such as automatic generation control (AGC), wide-area protection scheme (WAPS), synchrophasor-based wide-area voltage control system (WAVCS), etc., in the energy management system (EMS) to provide an adequate situational awareness to control center operators during physical disturbances and natural events. The rapid digitalization, unencrypted communication, and numerous data-sharing devices have increased digital access points that have exposed the grid network to countless cyberattacks pertinent to the WAPAC cybersecurity. Given the amount of complex grid network coupled with legacy infrastructures, it is untrustworthy to completely rely on information technology (IT)-based conventional security measures to defend against evolving cyberattacks. Hence, there is a compelling need to go beyond the traditional paradigm of ‘security by obscurity’ and ‘bolt-on’ security measures, and develop a suite of innovative security solutions at multiple layers to transform the current “fault-resilient” grid into “fault and attack-resilient” grid of the future. This dissertation specifically focuses on developing application-specific attack-resilient solutions for critical WAPAC applications in the smart grid. The first part of the study, Attack-Resilient Wide-Area Protection Scheme, presents a cyber-physical attack-resilient system (CPARS) for WAPS, where two anomaly detection methods are proposed to detect multi-level cyberattacks followed by the rules-based intrusion mitigation system (RIMS) to initiate effective mitigation strategies, tailored to these attacks, to restore the normal grid operation after disturbances. The first anomaly detection component, Machine learning-based Anomaly Detection for Centralized WAPS, discusses a novel architecture and methodology for developing a machine-learning-based anomaly detection system (ADS) for the centralized wide-area protection system (CWAPS) by applying the variational mode decomposition (VMD) technique and decision tree (DT) algorithms using cyber logs and synchrophasor measurements. The second component, Multi-Agent-based Anomaly Detection for Decentralized WAPS, presents a two-level hierarchical multi-agent-based decentralized WAPS against the system-aware stealthy cyber-attacks. Finally, for the RIMS, the state transition diagram-based mitigation measures are defined based on the grid operation states and experimental testing and evaluation are presented in a cyber-physical testbed environment. The second part of the study, Attack-Resilient Wide-Area Voltage Control System, addresses the existing vulnerabilities in the wide-area voltage control system (WAVCS), presents the methodology for performing an impact analysis during data integrity attacks, and proposes a data-driven attackresilient system (DARS) by incorporating machine learning-based ADS and rules-based anomaly mitigation system (RAMS) to detect these attacks and provide necessary mitigation actions to maintain the transient voltage stability after disturbances. Finally, the third part, Networked Federation Testbed (NEFTSec) for Smart Grid Cybersecurity, focuses on developing an interconnected federated testbed through a common network like the internet, describes its conceptual architectures, and also presents its design components for experimental testing, validation, and evaluation. Further, it presents the co-simulation interface algorithm (CIA) to facilitate the geographically-dispersed real-time distributed simulation (GD-RTDS) during the cyber-physical federation. In general, this dissertation presents innovative attack-resilient solutions for WAPAC applications that are experimentally tested and evaluated using the PowerCyber testbed and NEFTSec platform to accelerate the transition of state-of-the-art research works to the real-field deployments.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Structure-aware graph neural network based deep transfer learning framework for enhanced predictive analytics on diverse materials datasets

Abstract Modern data mining methods have demonstrated effectiveness in comprehending and predicting materials properties. An essential component in the process of materials discovery is to know which material(s) will possess desirable properties. For many materials properties, performing experiments and density functional theory computations are costly and time-consuming. Hence, it is challenging to build accurate predictive models for such properties using conventional data mining methods due to the small amount of available data. Here we present a framework for materials property prediction tasks using structure information that leverages graph neural network-based architecture along with deep-transfer-learning techniques to drastically improve the model’s predictive ability on diverse materials (3D/2D, inorganic/organic, computational/experimental) data. We evaluated the proposed framework in cross-property and cross-materials class scenarios using 115 datasets to find that transfer learning models outperform the models trained from scratch in 104 cases, i.e., ≈90%, with additional benefits in performance for extrapolation problems. We believe the proposed framework can be widely useful in accelerating materials discovery in materials science.

Chemistry↗

Resimulation-based self-supervised learning for pretraining physics foundation models

Self-supervised learning (SSL) is at the core of training modern large machine learning models, providing a scheme for learning powerful representations that can be used in a variety of downstream tasks. However, SSL strategies must be adapted to the type of training data and downstream tasks required. We propose resimulation-based self-supervised representation learning (RS3L), a novel simulation-based SSL strategy that employs a method of resimulation to drive data augmentation for contrastive learning in the physical sciences, particularly, in fields that rely on stochastic simulators. By intervening in the middle of the simulation process and rerunning simulation components downstream of the intervention, we generate multiple realizations of an event, thus producing a set of augmentations covering all physics-driven variations available in the simulator. Using experiments from high-energy physics, we explore how this strategy may enable the development of a foundation model; we show how RS3L pretraining enables powerful performance in downstream tasks such as discrimination of a variety of objects and uncertainty mitigation. In addition to our results, we make the RS3L dataset publicly available for further studies on how to improve SSL strategies.

97 MATHEMATICS AND COMPUTING↗

Dynamic, Adaptive, Systems and Materials: Complex, Simple and Emergent Behaviors

This program has been funded by DoE/BES for twenty years. It has moved into and out of various subjects as it has developed, but it has retained its focus on complexity and complex systems. The project has evolved in the following way: Self-Assembly and Biomimetic Self-Assembly: All self-assembling systems depend upon a minimum of two types of interaction: a repulsion and an attraction. For the familiar molecular systems, attractive interactions are typically hydrogen bonds and electrostatic interactions. Repulsive interactions include steric effects, hydrophobic effects (in biological systems), and charge-charge repulsion. We have expanded this repertoire to include surface interactions, magnetic interactions, and others. I list these systems in the order in which we have explored them: i) A key emphasis in current work is in understanding how the movement of ions in a magnetic field (the Lorentz effect) interacts with catalytic systems. We have demonstrated that an acceleration in rate of reduction of CO 2 to CO can be accomplished by applying an external magnetic field. This acceleration is largely due to the application of the Lorentz effect on mass transport at the catalyst’s surface. ii) We have also extensively explored the influence of electrostatics, as exhibited in self-assembling systems, by tribocharging. iii) Another key system involves surface tension effects; examples include interactions between heavy particles floating at a liquid-air interface, and interacting by changes in surface area; interactions of bubbles and bubble rafts, behaviors of bubble trains in microfluidic networks, and behaviors of microorganisms in constraining environments. iv) This work has intentionally de-emphasized biological systems; but it does include some work on protein-ligand interactions and interactions among microorganisms. v) We have also explored applications of some of these effects, these explorations include bubble rafts as diffraction gratings, exploration of the structures that can be obtained by tribocharging and uses of these structures in exploring nucleation and melting of crystals. vi) Although not a major focus of this work, several other topics have emerged and offer opportunities for future work. These include the behavior of bubble trains and bubble rafts in microfluidic systems. A particularly interesting example is the formation of bubble trains that repeat in the alteration of large and small bubbles according to rules we do not presently understand, but are uniquely large-period oscillating systems. These systems offer a new route into understanding the instabilities of the type represented by oscillations. vii) We have also begun exploratory projects on magnetic levitation (especially to determine molecular density), and information storage (in molecules). Magnetic Levitation: Self-assembling and biomimetic systems require both attraction and repulsion. We have used electrostatics (tribocharging), interfacial free-energies (surface tension and related forces) and others. Potential uses include reconfigurable diffraction gratings and liquid lenses; exploration of mechanisms in tribocharging; tunneling in EGaIn junctions; and bubble trains (especially in micro-fluidic systems). Examples of systems representing these topics is included in the following papers: Complexity: Disks rotating at a water-air interface; Benard-Marangoni effects; Vortex-Crystals from spinning magnetic disks (Marangoni effects); EGaIn Electrode to study quantum tunneling; Self-Assembly of electrostatically-charged metallic spheres (electrets); Dynamically reconfigurable lens; Using computational designs of ligands for enzymes; Electrostatic self-assembly by tribocharging; Monodisperse bubble trains in microchannel systems; Inverted dripping faucet; Flames; Printing of micro-organisms to regenerate the “ink” of printing device; Using micro-organisms to move loads (“microoxen”); Motion of bacterial swarms near surfaces; Making monodisperse particles in microfluidic systems; Coding/decoding of information stored in droplet trains in microfluidic networks; Magnetic levitation; and Information storage. i) Tribocharging. The change in focus of this work on electrets from the fundamentals of charging to applications of these materials in studying self-assembly using electrostatic interactions. ii) Bubbles in Microchannels. The realization that systems of bubbles in microchannels represented a major opportunity to study complexity in a very tractable system, and the development of a semi-quantitative theory of this subject. iii) Flames. The growth of “flames” remains an exploratory subject for the research, although their currently relatively little active work involving it ongoing. iv) Systems with Microorganisms. The removal of work in biological systems from this project. Based on work supported in this program, we now have a significant project on the development of microfluidic tools for studying C. elegans (a nematode), but this work was not appropriate for a program focused on complexity, and we developed separate support for it. (It is, however, an example of successful seeding of a new area by BES.) The work on electrets has gone through a period in which a part of the program was the subject of a MURI; the focus of this work was to develop materials that did not charge electrostatically on friction or contact. The MURI is now over, and the work on dynamic self-assembly (supported by BES) is the major focus. “Flames” has also enjoyed synergistic support, in terms of a project supported by DARPA on flame suppression (in the absence of extinguishing agents, using acoustic and electrostatic interactions). This work was helpful in understanding some of the basics of flames, but is entirely distinct from the BES focus in complexity. A growing interest is in the Lorentz effect. The Lorentz effect is the force exerted on charged particles (electrons, ions, charged molecules) when they move through a perpendicular magnetic field. The Lorentz effect is almost ubiquitous in modern technology: examples of applications include electric motors, dynamos, cathode ray tubes, many batteries, and most systems that control electrical currents with magnetic forces. We have begun to explore the Lorentz effect in electrochemical systems and heterogeneous catalytic systems involving charged organic species and inorganic ions. This work is still at an early stage, but initial studies that Lorentz effects can be large when ions move through magnetic fields, or magnetic fields move in the presence of ions.

36 MATERIALS SCIENCE↗

Undergraduate Women in STEM Internship Program

In collaboration with the Universities Research Association, Inc. (URA), establishment of the Undergraduate Women in STEM Internship pilot program assists Fermi Research Alliance, LLC (FRA) with honoring its commitment to increasing gender, racial and ethnic workforce diversity. This focused initiative is intended to invite, support and yield a qualified pipeline of alumnae underrepresented in FRA’s science and technology management and technical staff positions. Interns in this program spend 10-12 weeks at Fermilab working under the direct leadership, guidance and supervision of scientists, engineers, computing professionals, technicians and staff across all directorates performing hands-on research. In addition, the intern cohort meets with mentors and advisors to grow their professional networks, to take part in engaging and inclusive intellectual discussions, to directly benefit from workplace resources, and to participate in professional development and social engagement opportunities. The design of each research project and the supervision, mentorship and evaluation is conducted by a scientific, engineering, computing professional at Fermilab.

99 GENERAL AND MISCELLANEOUS↗

Science of Scale-Up: Accelerating chemical manufacturing technology development workshop report

The Science of Scale-Up: Accelerating chemical manufacturing technology development workshop report outlines key insights and actionable recommendations for accelerating the scale-up of disruptive chemical manufacturing technologies. Convened in October 2024, the workshop brought together approximately fifty experts from academia, industry, national laboratories, and government agencies to address the barriers and solutions for maturing technologies from proof-of-concept to commercialization. The report identifies seven critical themes for enabling faster scale-up. These themes were explored through general discussions and breakout sessions focused on three specific chemical manufacturing technologies—electrochemical, thermochemical, and biological conversion processes. The findings emphasize the importance of interdisciplinary collaboration, robust funding mechanisms, and shared resources to overcome technical barriers and accelerate technology deployment. The report also highlights technology-specific challenges and opportunities, including the need for advanced materials, scalable manufacturing processes, and integrated testing environments. For electrochemical manufacturing processes, durability and material optimization are key priorities, while thermochemical processes require novel reactor designs and better supply chain integration. Biological conversion processes face hurdles in strain engineering, reactor design, and process integration. Across all technologies, the workshop emphasized the importance of leveraging computational tools, standardized protocols, and collaborative networks to address knowledge gaps and technical barriers. By acting on these insights, stakeholders can reduce the timeline for scaling up critical chemical manufacturing technologies, ensuring their timely impact on manufacturing competitiveness, and environmental sustainability.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Performance Evaluation of Distributed Energy Resource Management Algorithm in Large Distribution Networks

This paper presents performance evaluation of hierarchical optimization and control for distributed energy resource management system (DERMS) in large distribution networks via an advanced hardware-in-the-loop (HIL) platform. The HIL platform provides realistic testing in a laboratory envi-ronment, including the accurate modeling of a full-scale dis-tribution system of 11,000 nodes, the DERMS software con-troller, and 90 power hardware photovoltaics (PVs) and bat-tery inverters. The applied DERMS algorithm is designed based on a real-time optimal power flow algorithm and im-plemented with acceleration design that performs fast dis-patch of simulated PVs and real physical hardware DER devices every 4 seconds.

distributed energy management system (DERMS)↗

A Survey of Open-Source Tools for Transmission and Distribution Systems Research

This work presents a review of open-source electric power transmission and distribution systems analysis tools suitable for use by industry professionals and academic researchers. Due to the high complexity of the electric grid, there exist numerous tools and extensive research pertaining to nearly every aspect of the design, operation, and control of transmission and distribution networks. In addition to the commercial tools, a wide range of free, open-source tools, models, and data usable by the scientific community for related research have been developed by different organizations, including both international and US universities and national laboratories. However, due to the absence of a catalog of available tools, models and data, researchers often lack a knowledge of existing capabilities and may develop duplicative software and tools. Increasing awareness of these available resources seeks to accelerate their broader use, leading to more efficient and standardized grid analysis. This review paper (which is part of a larger survey effort that studied over 400 tools in the transmission, distribution, buildings, and electric vehicles space) outlines selected open-source resources that have been developed in power transmission and distribution systems research. It is anticipated that this work can serve as a guide for industry and academic researchers alike, ensuring that research efforts are well-channeled.

24 POWER TRANSMISSION AND DISTRIBUTION↗

FAST Irradiations, Postirradiation Examinations, and Modeling of U-Mo for Light Water Reactor Applications

Many next generation light water reactor (LWR) concepts, such as mobile small modular reactors, are seeking to use smaller core dimensions than conventional reactor types. Smaller reactor cores require an increase in fissile material to maintain reactivity. For non-proliferation purposes, enrichment increases are limited to less than 20% (high assay low enriched uranium, [HALEU]) and so higher uranium density fuels than UO 2 must be considered. To this end, uranium-molybdenum alloys were tested using the Fission Accelerated Steady-state Test (FAST) approach. The experiment test matrix is focused on identifying the temperature transition between low swelling and high fission gas retention to break away swelling and low fission gas retention. This paper documents the results of irradiation tests and post-irradiation examinations (PIE) including neutron radiography, rodlet profilometry, fission gas collection analysis, and optical metallography. The results of these tests showed that unconstrained U-Mo fuels (solid, Na-bonded rodlets) have a swelling threshold between 400-450°C with minimal fission gas release below this point. Higher temperature solid fuel showed microstructural zoning with small pore networks while lower temperature solid fuels have a uniform microstructure with large pore networks. U-Annular Mo fuels where swelling had some self-constraint imposed upon it, were shown to have much reduced swelling compared to their solid counterparts as well as very low fission gas release for irradiation temperatures up to 500°C. These initial results show that the use of U-Mo in constrained fuel geometries could be used as a high uranium density HALEU fuel for LWRs.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Defect-Mediated Diffusion Pathways in Spodumene Accelerate Lithium Transport

Lithium extraction from naturally occurring α-spodumene is hindered by poor lithium diffusivity, necessitating high-temperature phase transformation to a low-density β polymorph. Although β spodumene exhibits up to 5 orders of magnitude higher lithium-ion diffusivity, both phases have diffusion activation energies between 0.8 and 1 eV, indicating that polymorph density is not the controlling factor over diffusivity. We show that aluminum vacancies facilitate lithium-ion diffusion in α-spodumene by reducing the migration barrier from 2.4 to 0.9 eV. Bond valence site energy and nudged elastic band calculations show a new lithium local minimum site which promotes a one-dimensional percolation network by reducing the lithium intersite distance from 4.5 Å to 2.9 Å. However, aluminum vacancies are energetically unfavorable to percolate through the whole structure, resulting in very low net lithium diffusivity and highlighting the critical role of nonstoichiometric defects in facilitating lithium transport in rigid aluminosilicate structures.

Chemical structure↗

Nonlinear manifold reduced order model

Traditional linear subspace reduced order models (LS-ROMs) are able to accelerate physical simulations in which the intrinsic solution space falls into a subspace with a small dimension, i.e., the solution space has a small Kolmogorov n-width. However, for physical phenomena not of this type, e.g., any advection-dominated flow phenomena such as in traffic flow, atmospheric flows, and air flow over vehicles, a lowdimensional linear subspace poorly approximates the solution. To address cases such as these, we have developed a fast and accurate physics-informed neural network ROM, namely nonlinear manifold ROM (NM-ROM), which can better approximate high-fidelity model solutions with a smaller latent space dimension than the LS-ROMs. Our software takes advantage of the existing numerical methods that are used to solve the corresponding full order models. The efficiency is achieved by developing a hyper-reduction technique in the context of the NM-ROM. Numerical results show that neural networks can learn a more efficient latent space representation on advection-dominated data from 1D and 2D Burgers' equations. A speedup of up to 2.6 for 1D Burgers' and a speedup of 11.7 for 2D Burgers' equations are achieved with an appropriate treatment of the nonlinear terms through a hyper-reduction technique.

Choi, Youngsoo↗

Nonlinear manifold-based reduced order model

Traditional linear subspace reduced order models (LS-ROMs) are able to accelerate physical simulations, in which the intrinsic solution space falls into a subspace with a small dimension, i.e., the solution space has a small Kolmogorov n-width. However, for physical phenomena not of this type, e.g., any advection-dominated flow phenomena such as in traffic flow, atmospheric flows, and air flow over vehicles, a low-dimensional linear subspace poorly approximates the solution. To address cases such as these, we have developed a fast and accurate physicsinformed neural network ROM, namely nonlinear manifold ROM (NM-ROM), which can better approximate high-fidelity model solutions with a smaller latent space dimension than the LSROMs. Our method takes advantage of the existing numerical methods that are used to solve the corresponding full order models. The efficiency is achieved by developing a hyper-reduction technique in the context of the NM-ROM. Numerical results show that neural networks can learn a more efficient latent space representation on advection-dominated data from 1D and 2D Burgers’ equations. A speedup of up to 2.6 for 1D Burgers’ and a speedup of 11.7 for 2D Burgers’ equations are achieved with an appropriate treatment of the nonlinear terms through a hyper-reduction technique. Finally, a posteriori error bounds for the NM-ROMs are derived that take account of the hyper-reduced operators.

97 MATHEMATICS AND COMPUTING↗

SA-GAT-SR: self-adaptable graph attention networks with symbolic regression for high-fidelity material property prediction

Recent advances in machine learning have demonstrated an enormous utility of deep learning approaches, particularly Graph Neural Networks (GNNs) for materials science. These methods have emerged as powerful tools for high-throughput prediction of material properties, offering a compelling enhancement and alternative to traditional first-principles calculations. While the community has predominantly focused on developing increasingly complex and universal models to enhance predictive accuracy, such approaches often lack physical interpretability and insights into materials behavior. Here, we introduce a novel computational paradigm—Self-Adaptable Graph Attention Networks integrated with Symbolic Regression (SA-GAT-SR)—that synergistically combines the predictive capability of GNNs with the interpretative power of symbolic regression. Our framework employs a self-adaptable encoding algorithm that automatically identifies and adjust attention weights so as to screen critical features from an expansive 180-dimensional feature space while maintaining O(n) computational scaling. The integrated SR module subsequently distills these features into compact analytical expressions that explicitly reveal quantum-mechanically meaningful relationships, achieving 23 × acceleration compared to conventional SR implementations that heavily rely on first-principle calculations-derived features as input. This work suggests a new framework in computational materials science, bridging the gap between predictive accuracy and physical interpretability, offering valuable physical insights into material behavior.

36 MATERIALS SCIENCE↗

Axion Mass Prediction from Adaptive Mesh Refinement Cosmological Lattice Simulations

The quantum chromodynamics (QCD) axion arises as the pseudo-Goldstone mode of a spontaneously broken Abelian Peccei-Quinn (PQ) symmetry. If the scale of PQ symmetry breaking occurs below the inflationary reheat temperature and the domain wall number is unity, then there is a unique axion mass that gives the observed dark matter (DM) abundance. Computing this mass has been the subject of intensive numerical simulations for decades since the mass prediction informs laboratory experiments. Axion strings develop below the PQ symmetry-breaking temperature, and as the string network evolves, it emits axions that go on to become the DM. A key ingredient in the axion mass prediction is the spectral index of axion radiation emitted by the axion strings. We compute this index in this Letter using the most precise and accurate large-scale simulations to date of the axion-string network leveraging adaptive mesh refinement to achieve the precision that would, otherwise, require a static lattice with 262,144 3 lattice sites. We find a scale-invariant axion radiation spectrum to within 1% precision and find no evidence that the spectral index of radiation evolves with time. Accounting for axion production from strings prior to the QCD phase transition leads us to predict that the axion mass should be approximately 𝑚 𝑎 ∈ (45, 65) μ ⁢eV. However, we provide preliminary evidence that axions are produced in greater quantities from the string-domain-wall network collapse during the QCD phase transition, potentially increasing the mass prediction to as much as 300 μ ⁢eV.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗