Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “inference accelerators”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

Deep Learning Based Superconducting Radio-Frequency Cavity Fault Classification at Jefferson Laboratory

This work investigates the efficacy of deep learning (DL) for classifying C100 superconducting radio-frequency (SRF) cavity faults in the Continuous Electron Beam Accelerator Facility (CEBAF) at Jefferson Lab. CEBAF is a large, high-power continuous wave recirculating linac that utilizes 418 SRF cavities to accelerate electrons up to 12 GeV. Recent upgrades to CEBAF include installation of 11 new cryomodules (88 cavities) equipped with a low-level RF system that records RF time-series data from each cavity at the onset of an RF failure. Typically, subject matter experts (SME) analyze this data to determine the fault type and identify the cavity of origin. This information is subsequently utilized to identify failure trends and to implement corrective measures on the offending cavity. Manual inspection of large-scale, time-series data, generated by frequent system failures is tedious and time consuming, and thereby motivates the use of machine learning (ML) to automate the task. This study extends work on a previously developed system based on traditional ML methods (Tennant and Carpenter and Powers and Shabalina Solopova and Vidyaratne and Iftekharuddin, Phys. Rev. Accel. Beams, 2020, 23, 114601), and investigates the effectiveness of deep learning approaches. The transition to a DL model is driven by the goal of developing a system with sufficiently fast inference that it could be used to predict a fault event and take actionable information before the onset (on the order of a few hundred milliseconds). Because features are learned, rather than explicitly computed, DL offers a potential advantage over traditional ML. Specifically, two seminal DL architecture types are explored: deep recurrent neural networks (RNN) and deep convolutional neural networks (CNN). We provide a detailed analysis on the performance of individual models using an RF waveform dataset built from past operational runs of CEBAF. In particular, the performance of RNN models incorporating long short-term memory (LSTM) are analyzed along with the CNN performance. Furthermore, comparing these DL models with a state-of-the-art fault ML model shows that DL architectures obtain similar performance for cavity identification, do not perform quite as well for fault classification, but provide an advantage in inference speed.

97 MATHEMATICS AND COMPUTING↗

Computational tools and data integration to accelerate vaccine development: challenges, opportunities, and future directions

The development of effective vaccines is crucial for combating current and emerging pathogens. Despite significant advances in the field of vaccine development there remain numerous challenges including the lack of standardized data reporting and curation practices, making it difficult to determine correlates of protection from experimental and clinical studies. Significant gaps in data and knowledge integration can hinder vaccine development which relies on a comprehensive understanding of the interplay between pathogens and the host immune system. In this review, we explore the current landscape of vaccine development, highlighting the computational challenges, limitations, and opportunities associated with integrating diverse data types for leveraging artificial intelligence (AI) and machine learning (ML) techniques in vaccine design. We discuss the role of natural language processing, semantic integration, and causal inference in extracting valuable insights from published literature and unstructured data sources, as well as the computational modeling of immune responses. Furthermore, we highlight specific challenges associated with uncertainty quantification in vaccine development and emphasize the importance of establishing standardized data formats and ontologies to facilitate the integration and analysis of heterogeneous data. Through data harmonization and integration, the development of safe and effective vaccines can be accelerated to improve public health outcomes. Looking to the future, we highlight the need for collaborative efforts among researchers, data scientists, and public health experts to realize the full potential of AI-assisted vaccine design and streamline the vaccine development process.

60 APPLIED LIFE SCIENCES↗

A survey of techniques for optimizing transformer inference

Recent years have seen a phenomenal rise in the performance and applications of transformer neural networks. The family of transformer networks, including Bidirectional Encoder Representations from Transformer (BERT), Generative Pretrained Transformer (GPT) and Vision Transformer (ViT), have shown their effectiveness across Natural Language Processing (NLP) and Computer Vision (CV) domains. Transformer-based networks such as ChatGPT have impacted the lives of common men. However, the quest for high predictive performance has led to an exponential increase in transformers' memory and compute footprint. Researchers have proposed techniques to optimize transformer inference at all levels of abstraction. Further, this paper presents a comprehensive survey of techniques for optimizing the inference phase of transformer networks. We survey techniques such as knowledge distillation, pruning, quantization, neural architecture search and lightweight network design at the algorithmic level. We further review hardware-level optimization techniques and the design of novel hardware accelerators for transformers. We summarize the quantitative results on the number of parameters/FLOPs and the accuracy of several models/techniques to showcase the tradeoff exercised by them. We also outline future directions in this rapidly evolving field of research. We believe that this survey will educate both novice and seasoned researchers and also spark a plethora of research efforts in this field.

97 MATHEMATICS AND COMPUTING↗

Characterization of Self-Magnetic Pinch (SMP) radiographic diode performance on RITS-6 at Sandia National Laboratories: 1) Diode Dynamics, DC Heating to extend Radiation Pulse

Radiographic diodes focus an intense electron beam to a small spot size to minimize the source area of energetic photons for radiographic interrogation. The self-magnetic pinch (SMP) diode has been developed as such a source and operated as a load for the RITS-6 Inductive Voltage Adder (IVA) driver. While experiments support the generally accepted conclusion that a 1:1 aspect diode (cathode diameter equals anode-cathode gap) delivers optimum SMP performance, such experiments also show that reducing the cathode diameter, while reducing spot size, also results in reduced radiation dose, by as much as 50%, and degraded shot reproducibility. Analyzation of the effective electron impingement angle on the anode converter with time made possible by a newly developed dose-rate array diagnostic indicates that fast-developing oscillations of the angle are correlated with early termination of the radiation pulse on many of the smaller-diameter SMP shots. This behavior as a function of relative cathode size persists through experiments with output voltages and currents up to 11.5 MV and 225 kA, respectively, and with spot sizes below ~ few mm. Since simulations to date have not predicted such oscillatory behavior, considerable discussion of the angle-behavior of SMP shots is made to lend credence to the inference. There is clear anecdotal evidence that DC heating of the SMP diode region leads to stabilization of this oscillatory behavior. This is the first of two papers on the performance of the SMP diode on the RITS-6 accelerator.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Spallation processes and nuclear interaction products of cosmic rays

Most cosmic-ray nuclei heavier than helium have suffered nuclear collisions in the interstellar gas, with transformation of nuclear composition. The isotopic and elemental composition at the sources has to be inferred from the observed composition near the Earth. The source composition permits tests of current ideas on sites of origin, nucleosynthesis in stars, evolution of stars, the mixing and composition of the interstellar medium and injection processes prior to acceleration. The effects of nuclear spallation, production of radioactive nuclides and the time dependence of their decay provide valuable information on the acceleration and propagation of cosmic rays, their nuclear transformations, and their confinement time in the Galaxy. The formation of spallation products that only decay by electron capture and are relatively long-lived permits an investigation of the nature and density fluctuations (like clouds) of the interstellar medium. Since nuclear collisions yield positrons, antiprotons, gamma rays and neutrinos, we shall discuss these topics briefly.

Non-NASA Center↗

Real-Time Edge AI for Distributed Systems (READS): Progress on Beam Loss De-Blending for the Fermilab Main Injector and Recycler

The Fermilab Main Injector enclosure houses two accelerators, the Main Injector and Recycler. During normal operation, high intensity proton beams exist simultaneously in both. The two accelerators share the same beam loss monitors (BLM) and monitoring system. Beam losses in the Main Injector enclosure are monitored for tuning the accelerators and machine protection. Losses are currently attributed to a specific machine based on timing. However, this method alone is insufficient and often inaccurate, resulting in more difficult machine tuning and unnecessary machine downtime. Machine experts can often distinguish the correct source of beam loss. This suggests a machine learning (ML) model may be producible to help de-blend losses between machines. Work is underway as part of the Fermilab Real-time Edge AI for Distributed Systems Project (READS) to develop a ML empowered system that collects streamed BLM data and additional machine readings to infer in real-time, which machine generated beam loss.

43 PARTICLE ACCELERATORS↗

Comprehensive characterization of irradiation induced defects in ceria: Impact of point defects on vibrational and optical properties

Validation of multiscale microstructure evolution models can be improved when standard microstructure characterization tools are coupled with methods sensitive to individual point defects. We demonstrate how electronic and vibrational properties of defects revealed by optical absorption and Raman spectroscopies can be used to compliment transmission electron microscopy (TEM) and x-ray diffraction (XRD) in the characterization of microstructure evolution in ceria under non-equilibrium conditions. Experimental manifestation of non-equilibrium conditions was realized by exposing cerium dioxide (CeO2) to energetic protons at elevated temperature. Two sintered polycrystalline CeO2 samples were bombarded with protons accelerated to a few MeVs. These irradiation conditions produced a microstructure with resolvable extended defects and a significant concentration of point defects. A rate theory (RT) model was parametrized using the results of TEM, XRD, and thermal conductivity measurements to infer point defect concentrations. An abundance of cerium sublattice defects suggested by the RT model is supported by Raman spectroscopy measurements, which show peak shift and broadening of the intrinsic T2g peak and emergence of new defect peaks. Additionally, spectroscopic ellipsometry measurements performed in lieu of optical absorption reveals the presence of Ce3+ ions associated with oxygen vacancies. This work lays the foundation for a coupled approach that considers a multimodal characterization of microstructures to guide and validate complex defect evolution models.

Chauhan, Vinay S.↗

Human otolith-ocular reflexes during off-vertical axis rotation: effect of frequency on tilt-translation ambiguity and motion sickness

The purpose of this study was to examine how the modulation of tilt and translation otolith-ocular responses during constant velocity off-vertical axis rotation varies as a function of stimulus frequency. Eighteen human subjects were rotated in darkness about their longitudinal axis 30 degrees off-vertical at stimulus frequencies between 0.05 and 0.8 Hz. The modulation of torsion decreased while the modulation of horizontal slow phase velocity (SPV) increased with increasing frequency. It is inferred that the ambiguity of otolith afferent information is greatest in the frequency region where tilt (torsion) and translational (horizontal SPV) otolith-ocular responses crossover. It is postulated that the previously demonstrated peak in motion sickness susceptibility during linear accelerations around 0.3 Hz is the result of frequency segregation of ambiguous otolith information being inadequate to distinguish between tilt and translation.

NASA Discipline Neuroscience↗

A Rocket-Base Study of Auroral Electrodynamics Within the Current Closure Ionosphere

The Auroral Current and Electrodynamics Structure (ACES) mission consisted of two sounding rockets launched nearly simultaneously from Poker Flat Research Range, AK on January 29, 2009 into a dynamic multiple-arc aurora. The ACES rocket mission, in conjunction with the PFISR Radar, was designed to observe the three-dimensional current system of a stable auroral arc system. ACES utilized two well instrumented payloads flown along very similar magnetic field footprints, at various altitudes with small temporal separation between both payloads. ACES High, the higher altitude payload (apogee 360 km), took in-situ measurements of the plasma parameters above the current closure region to provide the input signature into the lower ionosphere. ACES Low, the low-altitude payload (apogee 130 km), took similar observations within the current closure region, where cross-field currents can flow. We present results comparing observations of the electric fields, magnetic fields, electron flux, and the electron temperature at similar magnetic footpoints between both payloads. We further present data from all-sky imagers and PFISR detailing the evolution of the auroral event as the payloads traversed regions connected by similar magnetic footpoints. Current measurements derived from the magnetometers on both payloads are further compared. We examine data from both PFISR and observations on the high-altitude payload which we interpreted as a signature of electron acceleration by means of Alfv n waves. We further examine all measurements to understand ionospheric conductivity and how energy is being deposited into the ionosphere through Joule heating. Data from ACES is compared against models of Joule heating to make inferences regarding the effect of collisions at various altitudes.

Kaeppler, Stephen R.↗

Measurement of off-shell Higgs boson production in the $H^*\rightarrow ZZ\rightarrow 4\ell$ decay channel using a neural simulation-based inference technique in 13 TeV pp collisions with the ATLAS detector

A measurement of off-shell Higgs boson production in the $H^*\to ZZ\to 4\ell$ decay channel is presented. The measurement uses 140 fb −1 of proton–proton collisions at $\sqrt{s} = 13$ TeV collected by the ATLAS detector at the Large Hadron Collider and supersedes the previous result in this decay channel using the same dataset. The data analysis is performed using a neural simulation-based inference method, which builds per-event likelihood ratios using neural networks. The observed (expected) off-shell Higgs boson production signal strength in the $ZZ\to 4\ell$ decay channel at 68% CL is $0.87^{+0.75}_{-0.54}$ ($1.00^{+1.04}_{-0.95}$ ). The evidence for off-shell Higgs boson production using the $ZZ\to 4\ell$ decay channel has an observed (expected) significance of 2.5σ (1.3σ). The expected result represents a significant improvement relative to that of the previous analysis of the same dataset, which obtained an expected significance of 0.5σ. When combined with the most recent ATLAS measurement in the $ZZ\to 2\ell 2\nu$ decay channel, the evidence for off-shell Higgs boson production has an observed (expected) significance of 3.7σ (2.4σ). The off-shell measurements are combined with the measurement of on-shell Higgs boson production to obtain constraints on the Higgs boson total width. The observed (expected) value of the Higgs boson width at 68% CL is $4.3^{+2.7}_{-1.9}$ ($4.1^{+3.5}_{-3.4}$ ) MeV.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

A comparison between residential relocation timing of Sydney and Chicago residents: A Bayesian survival analysis

We report that understanding households' behaviour in residential relocation timing is of great importance in the field of transport engineering and economics. This research aims to develop a residential relocation model by considering the potential dynamic impacts of other households' decisions and variables, including economic and demographic attributes, housing features, intra-household decision-making structures, travel mode choice, and other life-course attributes. A multivariate parametric survival model with both fixed and time-varying covariates is developed. To the best of the authors' knowledge, this study is the first paper in the literature of residential relocation timing to propose the use of a Bayesian model in contrast to the widely used classic frequentist approach and have conducted a discussion on its advantages. An emerging residential relocation dataset collected for two cities in Australia and the USA (Sydney and Chicago cities) has been used, which covers residence, vehicle ownership, occupation, education, economic and demographic attributes of respondents. A comprehensive comparison between the results of two cities and a comparison between two Bayesian and frequentist approaches are made. This study confirms the impact of life-course variables, intra-household decision-making behaviours, and sociodemographic attributes on home mobility. According to the model outputs, the accelerating or decelerating impact of explanatory variables on the relocation timing has been almost the same in the two cities. The Bayesian model was confirmed to have some advantages over the frequentist model, including being straightforward to interpret, availability of making inferences on the results, and ease of handling complex models, and optimisation convergence complexities.

99 GENERAL AND MISCELLANEOUS↗

Characterization of self-magnetic pinch (SMP) radiographic diode performance on RITS-6 at Sandia National Laboratories. I. Diode dynamics, DC heating to extend radiation pulse

Radiographic diodes focus on an intense electron beam to a small spot size to minimize the source area of energetic photons for radiographic interrogation. The self-magnetic pinch (SMP) diode has been developed as such a source and operated as a load for the six-cavity radiographic integrated test stand (RITS-6) inductive voltage adder driver. While experiments support the generally accepted conclusion that a 1:1 aspect diode (cathode diameter equals anode–cathode gap) delivers optimum SMP performance, such experiments also show that reducing the cathode diameter, while reducing spot size, also results in reduced radiation dose, by as much as 50%, and degraded shot reproducibility. Analysis of the effective electron impingement angle on the anode converter with time made possible by a newly developed dose-rate array diagnostic indicates that fast-developing oscillations of the angle are correlated with early termination of the radiation pulse on many of the smaller-diameter SMP shots. This behavior as a function of relative cathode size persists through experiments with output voltages and currents up to 11.5 MV and 225 kA, respectively, and with spot sizes below approximately few millimeters. Since simulations to date have not predicted such oscillatory behavior, considerable discussion of the angle behavior of SMP shots is made to lend credence to the inference. We report there is clear anecdotal evidence that DC heating of the SMP diode region leads to stabilization of this oscillatory behavior. This is the first of two papers on the performance of the SMP diode on the RITS-6 accelerator.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Particle motion on Mars inferred from the Viking lander cameras

Data from Viking lander cameras indicate fine particle mobility on the surface of Mars such as: probable ventifacts, rock-associated raised streaks, and particulate drifts. Peak wind directions inferred from Chryse and Utopia are roughly equal, and are consistant with those inferred by orbiter photography. A 24 deg systematic offset between: (1) the direction of rock-associated streaks in the Viking I landing site, and (2) Mariner 9 and Viking observations of crater-associated streaks is consistant with a Coriolis acceleration of particles entrained by high-velocity winds during the production of crater-associated streaks. It is suggested that if a large fraction of collision impact energy goes into deformation, strain, and rupture, a preferential destruction of the most easily saltated grains and a depletion of 15-micron diameter grains will be observed. Investigations of particulates dumped on the landing grid suggest that major saltation events took place between sols 96 and 207, caused by winds of greater than 50 meters/sec normalized to the top of the boundary layer.

Sagan, C.↗

Vertical constituent transport in the mesosphere

Ground-based microwave spectroscopy measurements of mesospheric CO and H2O vertical mixing ratio profiles are used to infer vertical mixing rates in the upper mesosphere. The CO and H2O data consistently imply vertical eddy diffusion coefficients in the 70- to 85-km region of 100,000-200,000 sq cm/s during spring through summer at midlatidues. Although chemical acceleration of vertical transport is substantial for O and O3, below the mesopause, the divergences of their associated fluxes are modest, with at most a factor of 2 effect on the concentrations of O and O3 for measured variability in gravity wave activity. Comparison of Solar Mesosphere Explorer (SME) O3 data with model results reinforces the conclusions of slow vertical mixing in the upper mesosphere as a consequence of the reduced HO(x) catalytic loss of odd oxygen. The changes in chemical rate constants recommended by Rusch and Eckman (1985), in conjunction with slow vertical mixing, yield good agreement with SME O3 data. The slow vertical mixing deduced in this study is consistent with upper limits obtained from studies of the mesospheric heat budget and could be construed as evidence for an advectively controlled mesosphere. A comparison of the vertical eddy diffusion coefficients for momentum stresses, constituent transport, and heat transport suggests that the eddy Prandtl number must be of order 10.

Strobel, Darrell F.↗

Plasma Pressure in the Topside Ionosphere

A previous three year NASA-funded project resulted in the first 2-D maps of magnetotail pressure, density and temperature. A proposal to continue the work was declined, but modest funding was provided for one year to ramp down of the work. During the phase-out year, we used a time when 5 DMSP satellites were simultaneously active to produce the first instantaneous partial image of the magnetotail. The results have been submitted to the proceedings of the 1998 Huntsville Meeting on "The New Millennium Magnetosphere: Integrating Imaging, Discrete Observations and Global Simulations". A method of inferring central plasma sheet (CPS) temperature, density, and pressure from ionospheric observations was developed under a previous 3-year grant. These particles properties are calculated from data taken by particle instruments on DMSP satellites. Ion spectra occurring in conjunction with electron acceleration events are excluded. Because of the variability of magnetotail stretching, mapping to the plasma sheet was done using a modified Tsyganenko 1989 magnetic field model adjusted to agree with the actual magnetotail stretch. On May 25, 1997, five DMSP satellites (F10-F14) passed through the southern hemisphere nightside oval within a 19 minute period. Attached is the first magnetotail image, which results from applying our technique to that data set.

Newell, Patrick T.↗

Variability of the Reconnection Guide Field in Solar Flares

Solar flares may be the best-known examples of the explosive conversion of magnetic energy into bulk motion, plasma heating, and particle acceleration via magnetic re-connection. The energy source for all flares is the highly sheared magnetic field of a filament channel above a polarity inversion line (PIL). During the flare, this shear field becomes the so-called reconnection guide field (i.e., the non-reconnecting component), which has been shown to play a major role in determining key properties of the recon-nection including the efficiency of particle acceleration. We present new high-resolution, three-dimensional, magnetohydrodynamics simulations that reveal the detailed evolution of the magnetic shear/guide field throughout an eruptive flare. The magnetic shear evolves in three distinct phases: shear first builds up in a narrow region about the PIL, then expands outward to form a thin vertical current sheet, and finally is transferred by flare reconnection into an arcade of sheared flare loops and an erupting flux rope. We demonstrate how the guide field may be inferred from observations of the sheared flare loops. Our results indicate that initially the guide field is larger by about a factor of 5 than the reconnecting component, but it weakens by more than an order of magnitude over the course of the flare. Instantaneously, the guide field also varies spatially over a similar range along the three-dimensional current sheet. We discuss the implications of the remarkable variability of the guide field for the timing and localization of efficient particle acceleration in flares.

Solar magnetic reconnection↗

Semantic Regression for Disentangling Beam Losses in the Fermilab Main Injector and Recycler

Fermilab’s Main Injector enclosure houses two accelerators: the Main Injector (MI) and the Recycler (RR). In periods of joint operation, when both machines contain high intensity beam, radiative beam losses from MI and RR overlap on the enclosure’s beam loss monitoring (BLM) system, making it difficult to attribute those losses to a single machine. Incorrect diagnoses result in unnecessary downtime that incurs both financial and experimental cost. In this work, we introduce a novel neural approach for automatically disentangling each machine’s contributions to those measured losses. Using a continuous adaptation of the popular UNet architecture in conjunction with a novel data augmentation scheme, our model accurately infers the machine of origin on a per-BLM basis in periods of joint and independent operation. Crucially, by extracting beam loss information at varying receptive fields, the method is capable of learning both local and global machine signatures and producing high quality inferences using only raw BLM loss measurements.

43 PARTICLE ACCELERATORS↗

Spatially resolved polarization swings in the supermassive binary black hole candidate OJ 287 with first Event Horizon Telescope observations

We present the first Event Horizon Telescope 1.3 mm observations of the supermassive binary black hole candidate OJ 287. The observations achieved an unprecedented angular resolution of 18 μas and reveal significant structural and polarization variability over just five days, marking the shortest timescale on which such changes have been directly imaged in this source. The inner jet exhibits a twisted ridgeline structure, with features displaying apparent superluminal motions up to about 22 c. The linear polarization maps reveal three main polarized features whose electric-vector position angles (EVPAs) change substantially over the time span of our observations, including a component with a radial polarization consistent with being produced by a recollimation shock. Most notably, we directly resolved two innermost jet components whose EVPAs rotate in opposite directions. The faster component, moving at 2.4 ± 0.9 μas/day (17.4 ± 6.5 c), exhibits counterclockwise EVPA swings of roughly 3.7° per day, while the slower component, with a proper motion of 1.4 ± 0.3 μas/day (10.2 ± 2.2 c), rotates clockwise at approximately 2.5° per day. Previous studies inferred helical magnetic fields in AGN jets from time-resolved or integrated polarization variability but lacked the angular resolution to directly image this effect. Our results provide spatially resolved evidence that a helical magnetic field threads the jet’s collimation and acceleration zone, ruling out models based on the superposition of unresolved components. Our analysis suggests that propagating shocks interact with a Kelvin–Helmholtz plasma instability, illuminating different phases of the helical magnetic field and producing the observed polarization spatial and temporal variability. Moreover, our model naturally accounts for the more rapid polarization rotation observed in the faster moving component. Our model predicts even more rapid swings in polarization, which could be tested with future observations featuring a more densely sampled time coverage.

OJ 287↗