Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “network acceleration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51

Performance of a geometric deep learning pipeline for HL-LHC particle tracking

The Exa.TrkX project has applied geometric learning concepts such as metric learning and graph neural networks to HEP particle tracking. Exa.TrkX’s tracking pipeline groups detector measurements to form track candidates and filters them. The pipeline, originally developed using the TrackML dataset (a simulation of an LHC-inspired tracking detector), has been demonstrated on other detectors, including DUNE Liquid Argon TPC and CMS High-Granularity Calorimeter. This paper documents new developments needed to study the physics and computing performance of the Exa.TrkX pipeline on the full TrackML dataset, a first step towards validating the pipeline using ATLAS and CMS data. The pipeline achieves tracking efficiency and purity similar to production tracking algorithms. Crucially for future HEP applications, the pipeline benefits significantly from GPU acceleration, and its computational requirements scale close to linearly with the number of particles in the event.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

A Measurement of the Pion-Energy Dependence of Muon Neutrino Charged-Current Scattering to Final States With One Charged Pion in NOvA

The study of neutrino oscillations is a main priority for particle physics as the most immediately tractable lever on physics beyond the Standard Model. In particular, more insight into violation of the combined symmetry of charge-conjugation plus parity could yield clues to the origin of matter-antimatter asymmetry, and in some theoretical frameworks the neutrino mass could give insights into dark matter. NOvA is a long-baseline accelerator neutrino experiment with both a near and far detector that seeks to measure several of the parameters of the neutrino mixing matrix, as well as carry out a broad program of additional physics. NOvA has innovated and developed a variety of techniques in the space of neutrino physics, including expanding the use of machine learning techniques in reconstruction. NOvA has also set the stage for the next generation US-based long baseline experiment, DUNE. This dissertation details the creation of a new neutrino interaction vertex reconstruction package for NOvA, which offers enormous improvements in accuracy above the previous vertexer it replaces. This is accomplished using a Convolutional Visual Network trained on large datasets of simulated events. The vertexer is validated thoroughly against data. This dissertation also presents a cross-section measurement for $\nu_\mu + N \rightarrow \mu^- + 1\pi^\pm + X$ (where X does not include additional charged pions) binned in pion kinetic energy, a challenging measurement in general and for NOvA in particular. Measurements like this provide crucial inputs for neutrino interaction models utilized by neutrino oscillation experiments. This measurement in particular is important to the energy ranges relevant for DUNE in a band not well-covered by any other experiment.

Ewart, Erin [Indiana U., Bloomington (main)]↗

A Performant, Scalable Processing Pipeline for High‐Quality and FAIR Environmental Sensor Data

High-resolution environmental monitoring is necessary to record, understand, and predict biogeochemical and ecological changes particularly in coastal systems but brings significant challenges in processing and making rapidly available the resulting data. The COMPASS-FME project established a network of coastal observational sites across the Chesapeake Bay and western Lake Erie regions extensively instrumented with soil, vegetation, and weather sensors logging data every 15 min. Our data processing framework, written in R and completely open source, prioritizes rapid model-experiment iteration and makes biogeochemical data rapidly available for quality assurance/quality control, analysis, and model ingestion. This pipeline is distinguished by a standardized and modular approach to data curation, extensive metadata and documentation, and its high performance. These attributes combine to make biogeochemical data rapidly accessible across COMPASS-FME and the broader community. Flexible, powerful, and reproducible approaches to handling high-volume environmental data are crucial for accelerating biogeosciences research.

Pennington, Stephanie C. [Pacific Northwest Nation↗

AI-driven Neutrino Beam Diagnostics for Next-Generation Neutrino Experiments

The accelerator-driven beam uncertainty limits oscillation measurements in long-baseline neutrino experiments. Spill-resolved beam diagnostics and real-time inference are necessary to address these neutrino flux systematics. As such, we present a machine-learning-based beam monitoring framework developed and validated using data from the T2K experiment. Our approach uses downstream, spill-by-spill muon monitor observables to predict upstream parameters such as proton beam position and width. We achieve high predictive accuracy on nominal runs, demonstrating robust baseline performance whether the model is trained on stable runs or systematically varied conditions. The framework is designed to be robust against domain shifts, allowing the neural network architectures and inference strategies developed with T2K data to be retrained and validated using LBNF simulations, with the goal of eventual deployment under real LBNF/DUNE operating conditions. This scalable approach to real-time beam inference offers a pathway toward reducing flux systematics for next-generation neutrino experiments such as DUNE.

Aney, Noah [Fermilab; U. Chicago (main)]↗

Multi-task Parallelism for Robust Pre-training of Graph Foundation Models on Multi-source, Multi-fidelity Atomistic Modeling Data

Graph foundation models using graph neural networks promise sustainable, efficient atomistic modeling. To tackle challenges of processing multi-source, multi-fidelity data during pre-training, recent studies employ multi-task learning, in which shared message passing layers initially process input atomistic structures regardless of source, then route them to multiple decoding heads that predict data-specific outputs. This approach stabilizes pre-training and enhances a model’s transferability to unexplored chemical regions. Preliminary results on approximately four million structures are encouraging, yet questions remain about generalizability to larger, more diverse datasets and scalability on supercomputers. We propose a multi-task parallelism method that distributes each head across computing resources with GPU acceleration. Implemented in the open-source HydraGNN architecture, our method was trained on over 24 million structures from five datasets and tested on the Perlmutter, Aurora, and Frontier supercomputers, demonstrating efficient scaling on all three highly heterogeneous super-computing architectures.

Lupo Pasini, Massimiliano [ORNL] (ORCID:0000000249↗

Detailed analysis of the D-galactose catabolic pathways in Aspergillus niger reveals complexity at both metabolic and regulatory level

The current impetus towards a sustainable bio-based economy has accelerated research to better understand the mechanisms through which filamentous fungi convert plant biomass, a valuable feedstock for biotechnological applications. Several transcription factors have been reported to control the polysaccharide degradation and metabolism of the resulting sugars in fungi. However, little is known about their individual contributions, interactions and crosstalk. D-galactose is a hexose sugar present mainly in hemicellulose and pectin in plant biomass. Here, we study D-galactose conversion by Aspergillus niger and describe the involvement of the arabinanolytic and xylanolytic activators AraR and XlnR, in addition to the D-galactose-responsive regulator GalX. Our results deepen the understanding of the complexity of the filamentous fungal regulatory network for plant biomass degradation and sugar catabolism, and facilitate the generation of more efficient plant biomass-degrading strains for biotechnological applications.

59 BASIC BIOLOGICAL SCIENCES↗

Atomic-Level Features for Kinetic Monte Carlo Models of Complex Chemistry from Molecular Dynamics Simulations

The high computational cost of evaluating atomic interactions recently motivated the development of computationally inexpensive kinetic models, which can be parametrized from MD simulations of complex chemistry of thousands of species or other processes and accelerate the prediction of the chemical evolution by up to four order of magnitude. Such models go beyond the commonly employed potential energy surface fitting methods in that they are aimed purely at describing kinetic effects. So far, such kinetic models utilize molecular descriptions of reactions and have been constrained to only reproduce molecules previously observed in MD simulations. Therefore, these descriptions fail to predict the reactivity of unobserved molecules, for example in the case of large molecules or solids. In this work, we propose a new approach for the extraction of reaction mechanisms and reaction rates from MD simulations, namely the use of atomic-level features. Using the complex chemical network of hydrocarbon pyrolysis as example, it is demonstrated that kinetic models built using atomic features are able to explore chemical reaction pathways never observed in the MD simulations used to parametrize them, a critical feature to describe rare events. Atomic-level features are shown to construct reaction mechanisms and estimate reaction rates of unknown molecular species from elementary atomic events. Through comparisons of the model ability to extrapolate to longer simulation timescales and different chemical compositions than the ones used for parameterization, it is demonstrated that kinetic models employing atomic features retain the same level of accuracy and transferability as the use of features based on molecular species, while being more compact and parametrized with less data. We also find that atomic features can better describe the formation of large molecules enabling the simultaneous description of small molecules and condensed phases.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Abstract for CRADA among NETL, Mälardalen University, University College Cork (acting through its Tyndall National Institute), and Micro Electricity Generation Association

GeoCoHorT aims to accelerate the transition to 4 th generation district heating and cooling (4GDHC) in Europe and globally, by assessing, optimizing, and demonstrating the integration of shallow geothermal heat extraction with other renewable sources and smart buildings. The target geo-source is ground water from River Shannon (Limerick, Ireland), which will provide both an efficiency and noise-reduction benefit to the micro-district and a method of combatting climate-change-warming of the Shannon Estuary. The heat from this low-temperature source will be recycled and supplied to a smart district located in Limerick, Ireland, through heat pumps powered by renewable electricity and by means of a suitable DH network design. The mandate is to find solutions that work for entire communities in a fair and sustainable manner, with the involvement of the communities themselves to highlight their needs. The project brings together four partners from Ireland, Sweden, and the U.S.A. with strong multi-disciplinary competencies. The Tyndall Institute at University of Cork (UCC) and Mälardalen University (MDU) will design and optimize the 4GDH micro-district system, and the Micro Electricity Generation Association (MEGA) will work with the community to build a sense of ownership of the Climate Challenge and ensure close community involvement. The National Energy Technology Laboratory of the U.S. Department of Energy (NETL) will design the prospective geo-fluid loop to optimize heat-extraction effectiveness with ecological safety and assess the environmental benefits of the proposed solutions. Industrial advisors (Eskilstuna Strängnäs Energi och Miljö (ESEM) and Mimer in Sweden, and Smart MPOWER in Ireland) will steer the technology development to meet the needs of public utilities and consumers. Current infrastructure in the smart district in Limerick (demonstration site of an EU Lighthouse project) will be exploited and modified with support of MEGA, UCC, and MPOWER to integrate micro-DH from low-temperature heat sources, such as the river heat, and to allow increasing penetration of prosumers in the grid. Additional case studies will be developed with the help of industrial advisors to extend the results to other regions (e.g., Sweden and USA) and provide valuable insights for the development of 4GDH worldwide.

15 GEOTHERMAL ENERGY↗

Exponential acceleration of macroscopic quantum tunneling in a Floquet Ising model

The exponential suppression of macroscopic quantum tunneling (MQT) in the number of elements to be reconfigured is an essential element of broken symmetry phases. This suppression is also a core bottleneck in quantum algorithms, such as traversing an energy landscape in optimization, and adiabatic state preparation more generally. In this work, we demonstrate exponential acceleration of MQT through Floquet engineering with the application of a uniform, high frequency transverse drive field. Using the ferromagnetic phase of the transverse field Ising model in one and two dimensions as a prototypical example, we identify three phenomenological regimes as a function of drive strength. For weak drives, the system exhibits exponentially decaying tunneling rates but robust magnetic order; in the crossover regime at intermediate drive strength, we find polynomial decay of tunnelling alongside vanishing magnetic order; and at very strong drive strengths both the Rabi frequency and time-averaged magnetic order are approximately constant with increasing system size. We support these claims with extensive full wavefunction and tensor network numerical simulations, and theoretical analysis. An experimental test of these results presents a technologically important and novel scientific question accessible on NISQ-era quantum computers.

Grattan, George↗

Agile Acceleration of LLVM Flang Support for Fortran 2018 Parallel Programming

The LLVM Flang compiler ("Flang") is currently Fortran 95 compliant, and the frontend can parse Fortran 2018. However, Flang does not have a comprehensive 2018 test suite and does not fully implement the static semantics of the 2018 standard. We are investigating whether agile software development techniques, such as pair programming and test-driven development (TDD), can help Flang to rapidly progress to Fortran 2018 compliance. Because of the paramount importance of parallelism in high-performance computing, we are focusing on Fortran’s parallel features, commonly denoted “Coarray Fortran.” We are developing what we believe are the first exhaustive, open-source tests for the static semantics of Fortran 2018 parallel features, and contributing them to the LLVM project. A related effort involves writing runtime tests for parallel 2018 features and supporting those tests by developing a new parallel runtime library: the CoArray Fortran Framework of Efficient Interfaces to Network Environments (Caffeine).

Rasmussen, Katherine↗

Towards accurate prediction of configurational disorder properties in materials using graph neural networks

Abstract The prediction of configurational disorder properties, such as configurational entropy and order-disorder phase transition temperature, of compound materials relies on efficient and accurate evaluations of configurational energies. Previous cluster expansion methods are not applicable to configurationally-complex material systems, including those with atomic distortions and long-range orders. In this work, we propose to leverage the versatile expressive capabilities of graph neural networks (GNNs) for efficient evaluations of configurational energies and present a workflow combining attention-based GNNs and Monte Carlo simulations to calculate the disorder properties. Using the dataset of face-centered tetragonal gold copper without and with local atomic distortions as an example, we demonstrate that the proposed data-driven framework enables the prediction of phase transition temperatures close to experimental values. We also elucidate that the variance of the energy deviations among configurations controls the prediction accuracy of disorder properties and can be used as the target loss function when training and selecting the GNN models. The work serves as a fundamental step toward a data-driven paradigm for the accelerated design of configurationally-complex functional material systems.

Chemistry↗

A deep learning-accelerated data assimilation and forecasting workflow for commercial-scale geologic carbon storage

Fast assimilation of monitoring data to update forecasts of pressure buildup and carbon dioxide (CO 2 ) plume migration under geologic uncertainties is a challenging problem in geologic carbon storage. The high computational cost of data assimilation with a high-dimensional parameter space impedes fast decision-making for commercial-scale reservoir management. We propose to leverage physical understandings of porous medium flow behavior with deep learning techniques to develop a fast data assimilation-reservoir response forecasting workflow. Applying an Ensemble Smoother Multiple Data Assimilation (ES-MDA) framework, the workflow updates geologic properties and predicts reservoir performance with quantified uncertainty from pressure history and CO 2 plumes interpreted through seismic inversion. As the most computationally expensive component in such a workflow is reservoir simulation, we developed surrogate models to predict dynamic pressure and CO 2 plume extents under multi-well injection. The surrogate models employ deep convolutional neural networks, specifically, a wide residual network and a residual U-Net. The workflow is validated against a flat threedimensional reservoir model representative of a clastic shelf depositional environment. Intelligent treatments are applied to bridge between quantities in a true-3D reservoir model and those in a single-layer reservoir model. The workflow can complete history matching and reservoir forecasting with uncertainty quantification in less than one hour on a mainstream personal workstation.

25 ENERGY STORAGE↗

Graph Analytics for CEBAF Operations

We report on the progress achieved during a 2-year Laboratory Directed Research and Development (LDRD) project titled “Graph Analytics for CEBAF Operations”. The objective of this project is to leverage deep learning on graph representations of CEBAF’s injector beamline in order to create a tool for improving the efficiency of beam tuning tasks. Specifically, we use graphs to represent the injector beamline at any arbitrary date and time and invoke a graph neural network (GNN) to extract a low-dimensional, informative representation that can be visualized in two-dimensions. By analyzing years of operational data from the CEBAF archiver, good and bad regions of parameter space can be identified. The goal is to exercise this framework as a real-time tool to aid beam tuning, which represents the dominant source of machine downtime.

43 PARTICLE ACCELERATORS↗

Prediction of vacancy defect diffusion paths in high entropy alloys via machine learning on molecular dynamics data

Identifying the diffusion path of point defects is a critical step in understanding their evolution and the mechanisms of related phenomena. Defect diffusion occurs at small length and time scales, with impacts on material properties that may continue to evolve over ns to μs, ms, and the continuum scale (s, min, etc., and cm, m, etc.). The time scale accessible to molecular dynamics (MD) simulations is limited by small step sizes, typically in the fs range. Thus, surrogate models of MD simulations through machine learning (ML)-based algorithms are of great interest, especially for complex systems such as high entropy alloys (HEAs). In this work, dynamics governing vacancy migration in HEA were approximated with graph convolutional network (GCN) models as ansatzes for kinetic Monte Carlo (KMC) rate catalogs. Network design considered that diffusion in crystalline solids generally depends on interactions between defects and their immediate neighbor atoms. Graphs represented the vacancy surroundings, MD-generated trajectories provided training and comparison datasets, and unsupervised GCN models approximated interatomic dynamics governing vacancy migration in HEAs as ansatzes for KMC. A proof-of-concept model trained on MD data for the Fe, Ni, Cr, Co, and Cu HEA environment was used with two different neighbor interactions to assess the feasibility of training a GCN to predict vacancy defect transition rates in the HEA environment. The resulting setup rapidly generated MD-formatted synthetic trajectories based on dynamics learned from the MD training set, with a time acceleration of roughly two orders of magnitude and a similar diffusion coefficient to MD observations. Additionally, Nudged Elastic Band (NEB) calculations were performed on randomly generated FeNiCrCoCu HEA structures to determine vacancy migration barriers across nearest-neighbor sites. Transition probabilities for each jump, categorized by atomic type, were extracted from these calculations. NEB-based and GCN-based approaches led to similar outcomes.

Reimer, C↗

A Modified Network Alteration Model to Predict Quasi-Static Behavior of the Cross-Linked Polymers During Hydrolytic Aging

Abstract The network alteration theory is utilized to capture the effects of hydrolytic aging on the mechanical integrity of the polymer matrix. Hydrolytic degradation generally considered as a result of two simultaneous chemical phenomena; (i) reduction of the cross-links, and (ii) active chain loss. Assuming the alteration of the chain density is identical to the change of the number average molecular weight along the aging trajectory, the strain energy of polymer matrix can be rewritten as a function of deformation, deformation history, storage time, and aging temperature. The proposed model includes only five physically inspired material parameters. Thus, while it is computationally efficient, it shows good agreement with own experimental data, which performed on various range of accelerated aging temperatures and times. With respect to its computational efficiency, simplicity, accuracy, and interpret-ability, the model is a good choice for advanced implementations in FE programs.

Bahrololoumi, Amir↗

Status of the Muon Neutrino Charged-Current Mesonless Cross Section Measurement in the NOvA Near Detector

NOvA is a long-baseline accelerator neutrino experiment at Fermilab whose physics goals include precision neutrino oscillation as well as cross-section measurements. We present the status of the measurement of a muon neutrino charged-current cross section with zero mesons in the final state at the NOvA near detector. This measurement is being made with respect to the kinematics of the final state muon. The chosen interaction channel is especially sensitive to quasielastic and meson exchange current interactions and aims to provide experimental constraints for the development of models of neutrino interactions. It will also provide a handle for constraining cross section systematic uncertainties in oscillation analyses in current and future experiments. For particle identification, we use a convolutional neural network (CNN) trained on individual particles simulated in the NOvA near detector that allows us to select the desired signal while reducing the potential bias from neutrino interaction modeling. Charged pion background constraining is further improved via Michel electron tagging.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Status of the Muon Neutrino Charged-Current Zero Mesons Cross Section at the NOvA Near Detector

NOvA is a long-baseline accelerator neutrino experiment at Fermilab whose physics goals include precision neutrino oscillation as well as cross-section measurements. We present the status of the measurement of a muon neutrino charged-current cross section with zero mesons in the final state at the NOvA near detector. This measurement is being made with respect to the kinematics of the final state muon. The chosen interaction channel is especially sensitive to quasielastic and meson exchange current interactions and aims to provide experimental constraints for the development of models of neutrino interactions. It will also provide a handle for constraining cross section systematic uncertainties in oscillation analyses in current and future experiments. For particle identification, we use a convolutional neural network (CNN) trained on individual particles simulated in the NOvA near detector that allows us to select the desired signal while reducing the potential bias from neutrino interaction modeling. Charged pion background constraining is further improved via Michel electron tagging.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Neutrino interaction vertex reconstruction in DUNE with Pandora deep learning

The Pandora Software Development Kit and algorithm libraries perform reconstruction of neutrino interactions in liquid argon time projection chamber detectors. Pandora is the primary event reconstruction software used at the Deep Underground Neutrino Experiment, which will operate four large-scale liquid argon time projection chambers at the far detector site in South Dakota, producing high-resolution images of charged particles emerging from neutrino interactions. While these high-resolution images provide excellent opportunities for physics, the complex topologies require sophisticated pattern recognition capabilities to interpret signals from the detectors as physically meaningful objects that form the inputs to physics analyses. A critical component is the identification of the neutrino interaction vertex. Subsequent reconstruction algorithms use this location to identify the individual primary particles and ensure they each result in a separate reconstructed particle. A new vertex-finding procedure described in this article integrates a U-ResNet neural network performing hit-level classification into the multi-algorithm approach used by Pandora to identify the neutrino interaction vertex. The machine learning solution is seamlessly integrated into a chain of pattern-recognition algorithms. The technique substantially outperforms the previous BDT-based solution, with a more than 20% increase in the efficiency of sub-1 cm vertex reconstruction across all neutrino flavours.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗