Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “inference accelerators”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Machine-Learning Accelerated Studies of Materials with High Performance and Edge Computing

In the studies of materials, experimental measurements often serve as the reference to verify physics theory and modeling; while theory and modeling provide a fundamental understanding of the physics and principles behind. However, the interactions and cross validation between them have long been a challenge even to-date. Not only that inferring a physics model from experimental data is itself a difficult inverse problem, another major challenge is the orders-of-magnitude longer wall-clock time required to carry out high-fidelity computer modeling to match the timescale of experiments. We envisage that by combining high performance computing, data science, and edge computing technology, the current predicament can be alleviated, and a new paradigm of data-driven physics research will open up. For example, we can accelerate computer simulations by first performing the large-scale modeling on high performance computers and train a machine-learned surrogate model. This computationally inexpensive surrogate model can then be transferred to the computing units residing closely to the experimental facilities to perform high-fidelity simulations at a much higher throughout. The model will also be more amenable to analyzing and validating experimental observations in comparable time scales at a much lower computational cost. Further integration of these accelerated computer simulations with an outer machine learning loop can also inform and direct future experiments, while making the inverse problem of physics model inference more tractable. We will demonstrate a proof-of-concept by using a quantum Monte Carlo application, Dynamical Cluster Approximation (DCA++), to machine-learn a surrogate model and accelerate the study of quantum correlated materials.

Li, Ying Wai↗

Surrogates for Valve-Controlled Pipe Flow: Accelerating Nuclear Reactor Design

Neural surrogate models are developed to replace expensive steady-state RANS CFD simulations for valve-controlled pipe flow in nuclear reactor design. Using parametric CFD data generated with MOOSE Pronghorn across a range of valve geometry and flow conditions, three approaches are compared: a POD-based reduced-order model, a structured UNet on a cylindrical grid, and unstructured models (DeepONet and BiStride MeshGraphNet) on nondimensionalized point clouds. POD achieves the highest accuracy (99%) with fast inference but requires storing all solution snapshots, while the DeepONet and BSMS-GNN both achieve ~89% accuracy at sub-second inference, with the BSMS-GNN offering superior geometric generalizability. These surrogates enable rapid ranking of candidate valve designs and can warm-start CFD solvers to accelerate convergence, supporting agentic design iteration on the Prometheus platform.

42 - ENGINEERING↗

ATLAS Data Analysis using a Parallel Workflow on Distributed Cloud-based Services with GPUs

A new type of parallel workflow is developed for the ATLAS experiment at the Large Hadron Collider, that makes use of distributed computing combined with a cloud-based infrastructure. This has been developed for a specific type of analysis using ATLAS data, one popularly referred to as Simulation-Based Inference (SBI). The JAX library is used for the parts of the workflow to compute gradients as well as accelerate program execution using just-in-time compilation, which becomes essential in a full SBI analysis and can also offer significant speed-ups in more traditional types of analysis.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Milgrom's revision of Newton's laws - Dynamical and cosmological consequences

Milgrom's (1983) recent revision of Newtonian dynamics was introduced to eliminate the inference that large quantities of invisible mass exist in galaxies. It is shown by simple examples that a Milgrom acceleration, in the form presented so far, implies other far-reaching changes in dynamics. The momentum of an isolated system is not conserved, and the usual theorem for center-of-mass motion of any system does not hold. Naive applications require extreme caution. The model fails to provide a complete description of particle dynamics and should be thought of as a revision of Kepler's laws rather than Newton's. The Milgrom acceleration also implies fundamental changes in cosmology. A quasi-Newtonian calculation adapted from Newtonian cosmology suggests that a 'Milgrom universe' will recollapse even if the classical closure parameter Omega is much less than unity. The solution, however, fails to satisfy the cosmological principle. Reasons for the breakdown of this calculation are examined. A new theory of gravitation will be needed before the behavior of a Milgrom universe can be predicted.

Felten, J. E.↗

The radiative deceleration of ultrarelativistic jets in active galactic nuclei

A detailed study of the dynamical interaction between a highly relativistic jet and the thermal radiation field from an AGN accretion disk is reported, and the Comptonized spectrum arising from this interaction is self-consistently determined. A simple model that captures the essential radiative and geometrical features of realistic disk configurations is presented, and the disk radiation field is calculated. The results confirm Phinney's (1987) suggestion that the thermal radiation field produced by accretion in an AGN could be very effective in decelerating ultrarelativistic jets that are accreted by electromagnetic or hydromagnetic forces closer to the central black hole. Terminal Lorentz factors are consistent with the values inferred in superluminal radio sources are readily produced in this model for plausible disk and jet parameters without additional acceleration in the interaction zone. A new interpretation of the hard X-ray component detected in BL Lac spectra is proposed.

Melia, Fulvio↗

CosmoLensNRE

Cosmology Inference from Strong Gravitational Lensing using Neural Ratio Estimation

Jarugula, Sreevani [Fermi National Accelerator Lab↗

DiHydrogen

DiHydrogen is the second version of the Hydrogen fork of the well-known distributed linear algebra library, Elemental. DiHydrogen is a GPU-accelerated distributed multilinear algebra interface with a particular emphasis on the needs of the scalable distributed deep learning training and inference. DiHydrogen is part of the Livermore Big Artificial Neural Network (LBANN) software stack.

Maruyama, Naoya↗

Interpreting and Accelerating Transformers for Jet Tagging

Attention-based transformers are ubiquitous in machine learning applications from natural language processing to computer vision. In high energy physics, one central application is to classify collimated particle showers in colliders based on the particle of origin, known as jet tagging. In this work, we study the interpretatbility and prospects for acceleration of Particle Transformer (ParT), a state-of-the-art model, leverages particle-level attention to improve jet-tagging performance. We analyzing ParT's attention maps and particle-pair correlations in the eta-phi plane, revealing intriguing features, such as a binary attention pattern that identifies critical substructure in jets. These insights enhance our understanding of the model's internal workings and learning process and hint at ways to improve its efficiency. Along these lines, we also explore low-rank attention, attention alternatives, and dynamic quantization to accelerate transformers for jet tagging. With quantization, we achieve a 50% reduction in model size and a 10% increase in inference speed without compromising accuracy. These combined efforts enhance both the performance and the interpretability of transformers in high-energy physics, opening avenues for more efficient and physics-driven model designs.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

3-D Euler calculations for aft-propfan integration

The problem of reducing engine-airframe installation drag for a transport aircraft with an aft-mounted propfan or turboprop engine is investigated. A three-dimensional Euler code is used for the analysis. Installation drag effects are inferred from a qualitative analysis of the computed velocity and pressure distributions. The basic design philosophy is to alleviate flow acceleration near the strut/nacelle junction by aerodynamic means. This involves minor reshaping and relocation of the propulsion system.

Naik, Dinesh A.↗

Simultaneous Extreme-Ultraviolet Explorer and Optical Observations of Ad Leonis: Evidence for Large Coronal Loops and the Neupert Effect in Stellar Flares

We report on the first simultaneous Extreme-Ultraviolet Explorer (EUVE) and optical observations of flares on the dMe flare star AD Leonis. The data show the following features: (1) Two flares (one large and one of moderate size) of several hours duration were observed in the EUV wavelength range; (2) Flare emission observed in the optical precedes the emission seen with EUVE; and (3) Several diminutions (DIMs) in the optical continuum were observed during the period of optical flare activity. To interpret these data, we develop a technique for deriving the coronal loop length from the observed rise and decay behavior of the EUV flare. The technique is generally applicable to existing and future coronal observations of stellar flares. We also determine the pressure, column depth, emission measure, loop cross-sectional area, and peak thermal energy during the two EUV flares, and the temperature, area coverage, and energy of the optical continuum emission. When the optical and coronal data are combined, we find convincing evidence of a stellar 'Neupert effect' which is a strong signature of chromospheric evaporation models. We then argue that the known spatial correlation of white-light emission with hard X-ray emission in solar flares, and the identification of the hard X-ray emission with nonthermal bremsstrahlung produced by accelerated electrons, provides evidence that flare heating on dMe stars is produced by the same electron precipitation mechanism that is inferred to occur on the Sun. We provide a thorough picture of the physical processes that are operative during the largest EUV flare, compare and contrast this picture with the canonical solar flare model, and conclude that the coronal loop length may be the most important factor in determining the flare rise time and energetics.

Hawley, Suzanne L.↗

The First Widespread Solar Energetic Particle Event Observed By Solar Orbiter on 2020 November 29

Context. On 2020 November 29, the first widespread solar energetic particle (SEP) event of solar cycle 25 was observed at four widely separated locations in the inner (. 1AU) heliosphere. Relativistic electrons as well as protons with energies > 50MeV were observed by Solar Orbiter (SolO), Parker Solar Probe (PSP), the Solar Terrestrial Relations Observatory (STEREO)-A and multiple near-Earth spacecraft. The SEP event was associated with an M4.4 class X-ray flare and accompanied by a coronal mass ejection (CME) and an extreme ultraviolet (EUV) wave as well as a type II radio burst and multiple type III radio bursts. Aims. We present multi-spacecraft particle observations and place them in context with source observations from remote sensing instruments and discuss how such observations may further our understanding of particle acceleration and transport in this widespread event. Methods. Velocity dispersion analysis (VDA) and time shift analysis (TSA) were used to infer the particle release times at the Sun. Solar wind plasma and magnetic field measurements were examined to identify structures that influence the properties of the energetic particles such as their intensity. Pitch angle distributions and first-order anisotropies were analyzed in order to characterize the particle propagation in the interplanetary medium. Results. We find that during the 2020 November 29 SEP event, particles spread over more than 230° in longitude close to 1AU. The particle onset delays observed at the different spacecraft are larger as the flare–footpoint angle increases and are consistent with those from previous STEREO observations. Comparing the timing when the EUV wave intersects the estimated magnetic footpoints of each spacecraft with particle release times from TSA and VDA, we conclude that a simple scenario where the particle release is only determined by the EUV wave propagation is unlikely for this event. Observations of anisotropic particle distributions at SolO, Wind, and STEREO-A do not rule out that particles are injected over a wide longitudinal range close to the Sun. However, the low values of the first-order anisotropy observed by near-Earth spacecraft suggest that diffusive propagation processes are likely involved.

A Kollhoff↗

Origin of High-Energy Protons Responsible for Late-Phase Pion-Decay Gamma-Ray Continuum from the Sun

Gamma-ray emission from solar eruptions can last far beyond the impulsive phase of the associated flares, and hence termed as sustained gamma-ray emission (SGRE). These gamma-rays result from the decay of neutral pions produced when >300 MeV protons collide with hydrogen and heavier elements in the solar photosphere. The source of protons producing SGRE has two possible origins: (i) particles accelerated in the associated flare are somehow trapped in magnetic structures and diffuse slowly to the chromosphere, and (ii) particles accelerated at the shock front that diffuse back to the Sun. In this presentation, we compile currently available observations and inferences that support these two possibilities. We use the gamma-ray data from the Fermi Large Area Telescope (Fermi/LAT) in conjunction with coronal mass ejection (CME) data from the Solar and Heliospheric Observatory (SOHO) and type II radio burst information from the Wind spacecraft. We also use the GOES soft X-ray flare information.

Nat Gopalswamy↗

Differentiable Neural Architecture, Mixed Precision and Accelerator Co-Search

Quantization, effective Neural Network architecture, and efficient accelerator hardware are three important design paradigms to maximize accuracy and efficiency. Mixed Precision Quantization is a process of assigning different precision to different Neural Network layers for optimized inference. Neural Architecture Search (NAS) is a process of automatically designing the neural network for a task and can also be extended to search for the precision of each weight and activation matrix. In this paper, we develop the following three methods: (i) Fast Differentiable Hardware-aware Mixed Precision Quantization Search method to find optimal precision, (ii) Joint Differentiable hardware-aware Architecture and Mixed Precision Quantization Co-search, (iii) Joint Accelerator, Architecture, and Precision triple co-search to find best possibilities in all the three worlds. We demonstrate the effectiveness of our proposed methods targeting Bitfusion accelerator by searching mixed precision models on MobilenetV2. We achieve better accuracy-latency trade-off models than the manually designed and previously proposed search methods.

97 MATHEMATICS AND COMPUTING↗

Thermal Experiments for Fractured Rock Characterization: Theoretical Analysis and Inverse Modeling

Abstract Field‐scale properties of fractured rocks play a crucial role in many subsurface applications, yet methodologies for identification of the statistical parameters of a discrete fracture network (DFN) are scarce. We present an inversion technique to infer two such parameters, fracture density and fractal dimension, from cross‐borehole thermal experiments data. It is based on a particle‐based heat‐transfer model, whose evaluation is accelerated with a deep neural network (DNN) surrogate that is integrated into a grid search. The DNN is trained on a small number of the heat‐transfer model runs and predicts the cumulative density function of the thermal field. The latter is used to compute fine posterior distributions of the (to be estimated) parameters. Our synthetic experiments reveal that fracture density is well constrained by data, while fractal dimension is harder to determine. Adding nonuniform prior information related to the DFN connectivity improves the inference of this parameter.

Zhou, Zitong↗

Random forest prediction of crystal structure from electron diffraction patterns incorporating multiple scattering

Diffraction is the most common method to solve for unknown or partially known crystal structures. However, it remains a challenge to determine the crystal structure of a new material that may have nanoscale size or heterogeneities. Here, in this study, we train an architecture of hierarchical random forest models capable of predicting the crystal system, space group, and lattice parameters from one or more unknown two-dimensional electron diffraction patterns. Our initial model correctly identifies the crystal system of a simulated electron diffraction pattern from a 20-nm-thick specimen of arbitrary orientation 67% of the time. We achieve a topline accuracy of 79% when aggregating predictions from ten patterns of the same material but different zone axes. The space group and lattice predictions range from 70% to 90% accuracy and median errors of 0.01-0.5Å, respectively, for cubic, hexagonal, trigonal, and tetragonal crystal systems while being less reliable on orthorhombic and monoclinic systems. We apply this architecture to a four-dimensional scanning transmission electron microscopy scan of gold nanoparticles, where it accurately predicts the crystal structure and lattice constants. These random forest models can be used to significantly accelerate the analysis of electron diffraction patterns, particularly in the case of unknown crystal structures. Additionally, due to the speed of inference, these models could be integrated into live transmission electron microscopy experiments, allowing real-Time labeling of a specimen.

36 MATERIALS SCIENCE↗

Ion Signatures of Reconnection

Magnetic reconnection during periods of northward interplanetary magnetic field results in complex field line behavior. It has been shown that the velocity distribution of ions can be used as a diagnostic to determine the location of the reconnection site as well as the resulting field line topology. Ion observations in the high altitude (6-9Re) cusp region from Polar/TIDE reveal a mix of distinct ion populations (including cold ionospheric ions and magnetosheath ions) which can be attributed to different sources. In addition, the phase-space distributions of these ions reveal features which are attributed to reconnection and interactions with the magnetopause current layer (e.g. acceleration, counterstreaming, mixing of magnetosheath and ionospheric ions, and "D"-shaped distributions). These signatures has been used in several cases to infer the location of the reconnection site, the topology of the resulting field lines, and the location of the observation point relative to the magnetopause.

Chandler, Michael O.↗

Fast Particle-based Anomaly Detection Algorithm with Variational Autoencoder

Model-agnostic anomaly detection is one of the promising approaches in the search for new beyond the standard model physics. In this paper, we present Set-VAE, a particle-based variational autoencoder (VAE) anomaly detection algorithm. We demonstrate a 2x signal efficiency gain compared with traditional subjettiness-based jet selection. Furthermore, with an eye to the future deployment to trigger systems, we propose the CLIP-VAE, which reduces the inference-time cost of anomaly detection by using the KL-divergence loss as the anomaly score, resulting in a 2x acceleration in latency and reducing the caching requirement.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Portable Acceleration of CMS Computing Workflows with Coprocessors as a Service

Computing demands for large scientific experiments, such as the CMS experiment at the CERN LHC, will increase dramatically in the next decades. To complement the future performance increases of software running on central processing units (CPUs), explorations of coprocessor usage in data processing hold great potential and interest. Coprocessors are a class of computer processors that supplement CPUs, often improving the execution of certain functions due to architectural design choices. We explore the approach of Services for Optimized Network Inference on Coprocessors (SONIC) and study the deployment of this as-a-service approach in large-scale data processing. In the studies, we take a data processing workflow of the CMS experiment and run the main workflow on CPUs, while offloading several machine learning (ML) inference tasks onto either remote or local coprocessors, specifically graphics processing units (GPUs). With experiments performed at Google Cloud, the Purdue Tier-2 computing center, and combinations of the two, we demonstrate the acceleration of these ML algorithms individually on coprocessors and the corresponding throughput improvement for the entire workflow. This approach can be easily generalized to different types of coprocessors and deployed on local CPUs without decreasing the throughput performance. We emphasize that the SONIC approach enables high coprocessor usage and enables the portability to run workflows on different types of coprocessors.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗