Uncertainty-aware predictions of molecular x-ray absorption spectra using neural network ensembles
Not Available
97 MATHEMATICS AND COMPUTING↗
SEARCH · Engineering Papers
Results for “Edge Computing”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Self-Supervised and Interpretable Anomaly Detection Using Network Transformers
Machine learning and deep neural networks (DNNs) have been proposed as a tool to identify anomalies in computer network communications. However, due the obfuscated nature of off-the-shelf machine learning models, their output often does not provide enough information to isolate the source of the anomaly to take corrective measures. In this article, we introduce the network transformer (NeT), a DNN model for anomaly detection that incorporates the graph structure of the communication network in order to improve interpretability. Further, the presented approach has the following advantages: first, enhanced interpretability by incorporating the graph structure of computer networks; second, provides a hierarchical set of features that enables analysis at different levels of granularity; second, self-supervised training that does not require labeled data. The NeT model was evaluated on a set of anomalous scenarios executed in a real industrial control system. The presented approach successfully identified the anomalies, the devices affected, and the specific connections causing the anomalies, providing a data-driven hierarchical approach to analyze the behavior of a cyber network.
97 MATHEMATICS AND COMPUTING↗
A Comparison between Invariant and Equivariant Classical and Quantum Graph Neural Networks
Machine learning algorithms are heavily relied on to understand the vast amounts of data from high-energy particle collisions at the CERN Large Hadron Collider (LHC). The data from such collision events can naturally be represented with graph structures. Therefore, deep geometric methods, such as graph neural networks (GNNs), have been leveraged for various data analysis tasks in high-energy physics. One typical task is jet tagging, where jets are viewed as point clouds with distinct features and edge connections between their constituent particles. The increasing size and complexity of the LHC particle datasets, as well as the computational models used for their analysis, have greatly motivated the development of alternative fast and efficient computational paradigms such as quantum computation. In addition, to enhance the validity and robustness of deep networks, we can leverage the fundamental symmetries present in the data through the use of invariant inputs and equivariant layers. In this paper, we provide a fair and comprehensive comparison of classical graph neural networks (GNNs) and equivariant graph neural networks (EGNNs) and their quantum counterparts: quantum graph neural networks (QGNNs) and equivariant quantum graph neural networks (EQGNN). The four architectures were benchmarked on a binary classification task to classify the parton-level particle initiating the jet. Based on their area under the curve (AUC) scores, the quantum networks were found to outperform the classical networks. However, seeing the computational advantage of quantum networks in practice may have to wait for the further development of quantum technology and its associated application programming interfaces (APIs).
Forestano, Roy T. (ORCID:0000000203552076)↗
AXEAP (ARGONNE X-RAY EMISSION PACKAGE)
Argonne X-ray Emission Package (AXEAP), a singular purpose software package for processing X-ray emission (XES) images collected with a 2-dimensional position sensitive pixel array detector, has been developed. AXEAP can rapidly convert XES image files into a spectral form by applying parallel computation and unsupervised machine learning to compute vast amount of image data. Special focus has been placed on designing user-friendly-interface for processing multiple edges, non-resonant and resonant x-ray emission image analysis, in order to make data processing quick and easy. AXEAP is free software and is written in MATLAB, armed with powerful libraries and toolboxes. The software runs on all common operating systems such as Linux, Window, and Mac.
SUN, CHENGJUN↗
Contactless Position Measurement System for Remote Alignment of Highly Reflective Objects
The Contactless Position Measurement System (CPMS) permits automatic alignment of highly-reflecting components that cannot or should not be touched by human hands, such as those used in SRF cavities. CPMS also has application during maintenance of fusion reactors, when the components in the reactor are radioactive. The length of time for which humans can handle the components in order to carry out maintenance or repairs is limited. We would like to measure the relative positions of such objects so we can bring them into alignment with motorized stages, thus eliminating the need for human contact. The CPMS is a computer vision system that measures the location of highly reflective components to within a fraction of a millimeter by finding the edges of silhouette images. This is done by placing a uniform, infrared backlight behind the components, and viewing each component with two low-aberration, infrared cameras. Each of these stereoscopic cameras are located within a coordinate system we set up with reference platforms, light sources, and survey cameras distributed around the perimeter of the string assembly room, or fusion reactor. We obtain stereoscopic silhouette images of each component, and we use these to determine the position of the component within our string assembly coordinate system. The CPMS combines the silhouette images with knowledge of the dimensions of the objects to obtain the relative positions of components in its field of view. These position measurements then allow us to mechanically maneuver the components into contact. Once we know where they are, we can move the components to where they are supposed to be with motorized stages or other mechanical means, check they are in the right place, and bolt them together. In Phase I, we built a prototype infrared backlights and cameras, tested it, wrote an analysis program to fit the images. At a range of 50 cm, we are able to measure the relative positions of two stainless steel flanges with an accuracy of 150 μm rms. The next steps are to test the analysis program with motorized stages, build a full-size prototype, and implement it in an cleanroom with SRF cavity assembly. This can be done in a cost effective way given the materials with which the system is designed. As Open Source Instruments achieved more in Phase I than anticipated, despite not receiving a Phase II SBIR grant, we hope to move forward with product development and sales with a testing partner.
43 PARTICLE ACCELERATORS↗
The impact of G-quadruplex dynamics on inter-tetrad electronic couplings: a hybrid computational study
The G-quadruplex is a fascinating nucleic acid motif with implications in biology, medicine, and nanotechnologies. G-quadruplexes can form in the telomeres at the edges of chromosomes and in other guanine-rich regions of the genome. They can also be engineered for exploitation as biological materials for nanodevices. Their higher stiffness and higher charge transfer rates make them better candidates in nanodevices than duplex DNA. For the development of molecular nanowires, it is important to optimize electron transport along the wire axis. One powerful basis to do so is by manipulating the structure, based on known effects that structural changes have on electron transport. Here, for this work, we investigate such effects, by a combination of classical simulations of the structure and dynamics and quantum calculations of electronic couplings. We find that this structure–function relationship is complex. A single helix shape parameter alone does not embody such complexity, but rather a combination of distances and angles between stacked bases influences charge transfer efficiency. By analyzing linear combinations of shape descriptors for different topologies, we identify the structural features that most affect charge transfer efficiency. We discuss the transferability of the proposed model and the limiting effects of inherent flexibility.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Bridging the Gap between the X-ray Absorption Spectroscopy and the Computational Catalysis Communities in Heterogeneous Catalysis: A Perspective on the Current and Future Research Directions
X-ray absorption spectroscopy (XAS) [extended X-ray absorption fine structure (EXAFS) and X-ray absorption near-edge structure (XANES)] is a key technique within the heterogeneous catalysis community to probe the structure and properties of the active site(s) for a diverse range of catalytic materials. Furthermore, the interpretation of the raw experimental data to derive an atomistic picture of the catalyst requires modeling and analysis; the EXAFS data are compared to a model, and a goodness of fit parameter is used to judge the best fit. This EXAFS modeling can often be nontrivial and time-consuming; overcoming or improving these limitations remains a central challenge for the community. Considering these limitations, this Perspective highlights how recent developments in analysis software, increased availability of reliable computational models, and application of data science tools can be used to improve the speed, accuracy, and reliability of EXAFS interpretation. In particular, we emphasize the advantages of combining theory and EXAFS as a unified technique that should be treated as a standard (when applicable) to identify catalytic sites and not two separate complementary methods. Building on the recent trends in the computational catalysis community, we also present a community-driven approach to adopt FAIR Guiding Principles for the collection, analysis, dissemination, and storage of XAS data. Written with both the experimental and theory audience in mind, we provide a unified roadmap to foster collaborations between the two communities.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
A Machine Learning Framework to Predict Images of Edge-on Protoplanetary Disks
The physical structure and properties of protoplanetary disks are typically derived from spatially resolved disk images. Edge-on disks in particular provide an important view point on the vertical structure and degree of settling of disks. Such analyses rely on radiative transfer (RT) calculations that are generally computationally intensive due to the high optical depth of disks. Here we present a machine learning framework that has the potential to dramatically speed up the forward modeling process by approximating the results of RT calculations. This framework, trained on an initial set of RT calculations, utilizes an autoencoder neural network to enable the generation of synthetic scattered light images of edge-on disks directly from a set of physical parameters. We demonstrate that this framework generates synthetic images 2–3 orders of magnitude faster than using RT calculations. These machine learning-generated images appear to approximate the RT images well, in particular preserving their size and shape. We also find a strong correlation between the latent space representations of the generated disk images and several of their associated physical parameters. Finally, we discuss potential changes to the framework, such as methods to further improve the image quality, extending the framework to multiple wavelengths, and inverting the process to infer physical parameters from observed images. Overall, these new tools have the potential to enable a more efficient and uniform analysis of edge-on disk properties and the initial conditions of planet formation.
79 ASTRONOMY AND ASTROPHYSICS↗
Experimental Study on the Effect of Localized Blockages on the Friction Factor of a 61-Pin Wire-Wrapped Bundle
Abstract The thermal-hydraulic behavior of the flow in rod bundles has motivated numerous experimental and computational investigations. Previous studies have identified potential for accumulation of debris within the small subchannels of typical wire-wrapped assemblies with subsequent total or partial blockage of subchannel coolant flow. A test campaign was conducted to study the effects of localized blockages on the bundle averaged friction factor of a tightly packed wire-wrapped rod bundle. Blockages were installed within the bundle, and fluid pressure drop was measured across one wire pitch for a Reynolds number range of 500–17,200. The Darcy–Weisbach friction factor of the perturbed rod bundle geometry was compared with that of the unblocked bundle, as well as with the predictions of a well-established friction factor correlation. Differing effects based on blockage size and location for various flow regimes were studied. A number of conclusions can be made about the effects of the blockages on the friction factor, such as an increasing effect of the blockage on friction factor with an increase in Reynolds number, a change in flow behavior in the turbulent transition flow regime near Reynolds number 3000, differences in effect on friction factor for different types of subchannel blockage, and a nonlinear trend in friction factor variation with flow area impeded for edge subchannels. To this end, all data and quantified uncertainty produced in this study are made available for comparison and validation of advanced computational tools.
Engineering↗
High-performance computing leadership to enable advances in artificial intelligence and a thriving compute ecosystem
The past three decades have witnessed the widespread adoption of high-performance computing (HPC) as an essential tool in the advancement of science. From accelerating critical research in the wake of a global pandemic to climate modelling and national security, HPC has become integral to the most cutting-edge scientific research around the world and across application domains. The global competition to debut the next fastest supercomputer keeps pushing the field forward. Meanwhile, increasing capabilities are bringing hallmarks of science fiction, such as artificial intelligence (AI), into daily life. However, the tremendous power of new computing systems comes with an increased concern about equitable access to these resources and their impact on supporting a thriving workforce.
Tourassi, Georgia↗
Band gap renormalization, carrier mobilities, and the electron-phonon self-energy in crystalline naphthalene
Organic molecular crystals are expected to feature appreciable electron-phonon interactions that influence their electronic properties at zero and finite temperature. Here, we report first-principles calculations and an analysis of the electron-phonon self-energy in naphthalene crystals. We compute the zero-point renormalization and temperature dependence of the fundamental band gap, and the resulting scattering lifetimes of electronic states near the valence- and conduction-band edges employing density functional theory. Further, our calculated phonon renormalization of the GW-corrected quasiparticle band structure predicts a fundamental band gap of 5 eV for naphthalene at room temperature, in good agreement with experiments. From our calculated phonon-induced electron lifetimes, we obtain the temperature-dependent mobilities of electrons and holes in good agreement with experimental measurements at room temperature. Finally, we show that an approximate energy self-consistent computational scheme for the electron-phonon self-energy leads to the prediction of strong satellite bands in the electronic band structure. We find that a single calculation of the self-energy can reproduce the self-consistent results of the band gap renormalization and electrical mobilities for naphthalene, provided that the on-the-mass-shell approximation is used, i.e., if the self-energy is evaluated at the bare eigenvalues.
75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
Large eddy simulation of atmospheric boundary layer flow over complex terrain in comparison with RANS simulation and on-site measurements under neutral stability condition
Large eddy simulation (LES) of the atmospheric boundary layer (ABL) flow over complex terrain is presented with a validation using meteorological tower (met-tower) data through an improved neutral stability sampling approach. The proposed stability sampling procedure includes a condition based on the most-likely occurrence time-periods of the neutral ABL and reduces the variabilities of the conditional wind statistics calculated at the met-towers in comparison to our previous work. The ABL flow simulations are carried out over a potential wind site with a prominent hill based using the OpenFOAM-based simulator for on/off-shore wind farm applications by applying the Lagrangian-averaged scale-invariant dynamic sub-grid scale turbulence model. A low-dissipative scale-selective discretization scheme for the non-linear convection term in the LES governing equation is adopted implicitly to ensure both the second-order accuracy and bounded solution. The LES inflow is generated through a precursor method with a “tiling” approach based on the flow driving parameters obtained from a corresponding Reynolds-averaged Navier–Stokes (RANS) simulation. Overall, the averaged wind velocity profiles predicted by the LES approach at all met-tower locations show a similar tendency as the RANS results, which are also in reasonable agreement with the met-tower data. An obvious difference in wind speed standard deviation profiles is seen between LES and RANS, especially at regions downstream of the hill edge, where the LES shows under-predicted results at the highest measurement levels in comparison to the tower data. The computational costs of the LES are found to be about 20 times higher than the RANS simulations.
Energy & Fuels↗
Artificial intelligence-based predictive modeling for imaging neutral particle analyzers on the DIII-D tokamak
The Imaging Neutral Particle Analyzer (INPA) at DIII-D is a diagnostic system used to accurately resolve the energy and spatial distributions of fast ions in fusion plasmas. A novel artificial intelligence (AI) technique named INPA-net is based on Reservoir Computing Networks and developed here to predict active and passive signals produced by charge-exchange reactions from injected and edge-cold neutrals, respectively, in magnetically confined fusion plasmas. This model is trained using a set of 21 time domain signals between 0 s to 3.35 s that includes injected beam and thermal plasma information, and 6444 real 2D experimental images of the INPA in 12 plasma discharges at DIII-D. The trained neural network is able to forecast experimental images in real-time. The model achieves an R-squared value of 0.91, which is higher than the 0.83 value achieved by a simple linear regression model. This improvement highlights the model's enhanced predictive accuracy for measured images from the validation set. This AI approach is valuable due to its rapid response times and potential for integration into real-time plasma control systems. A version of this model capable of generating syntehic images would be useful for the real-time monitoring of fast-ion transport. A comprehensive sensitivity study reveals that INPA-net maintains high performance even with variations in the input parameters, indicating the model's robustness and reliability. While developed for the INPA, the underlying architecture is adaptable and may be applied to various 2D imaging diagnostics in fusion research.
70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
Two-loop MHV form factors from the periodic Wilson loop
We discuss how to compute maximal-helicity-violating (MHV) form factors for the chiral part of the stress-tensor supermultiplet from periodic light-like polygon Wilson loops in planar $\mathcal{N}$ = 4 super Yang-Mills theory beyond the one-loop level. We show that the periodicity imposes path ordering on points on different edges, which explains the appearance of square roots coming from non-planar Feynman diagrams. Taking such diagrams into account, we provide the integrand of the two-loop n-particle MHV form factor, compute all diagrams, prove the cancellation of divergences and finally compute the two-loop 5-particle and 6-particle form factors as examples.
72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
Monte Carlo Explicitly Correlated Second-Order Many-Body Green’s Function Calculations of Semiconductor Band Gaps
A systematically converging series of ab initio, post-density-functional, size-consistent, electron-correlated approximations is desired for predictive computing of felectronic band structures of insulating, semiconducting, and metallic solids. A series that meets all of these desiderata (except the applicability to metals) is ab initio many-body Green's function theory based on Gaussian-type-orbital (GTO) basis sets. Here, its leading-order approximation, the second-order Green's function (GF2) method in the diagonal and frequency-independent approximations with the aug-cc-pVDZ basis set, is applied to the fundamental band gaps of three semiconductors (diamond, silicon, and silicon carbide in the zincblende structure) using cluster models. Corrections are made to the basis-set-incompleteness errors by the explicit-correlation (F12) ansatz (GF2-F12) for the valence band edges. The crystals are modeled as surface-passivated clusters of increasing sizes, whose wave functions are expanded by up to 2709 GTO basis functions. Immense computational costs of these calculations are overcome by the highly scalable stochastic algorithm of the Monte Carlo GF2-F12 method, whose operation cost per state increases only as a cubic power of system size, which has a tiny memory footprint and easily achieves near-perfect parallel efficiency on thousands of CPUs or on hundreds of GPUs. The correlated, F12-corrected highest-occupied and lowest-unoccupied molecular-orbital energy (HOMO-LUMO) gap is 5.78 ± 0.07 eV for C 87 H 76 as compared with the experimental value of the fundamental (indirect) band gap of bulk diamond at 5.48 eV. The correlated, F12-corrected HOMO-LUMO gaps for Si 75 H 76 and Si 32 C 43 H 76 are 2.56 ± 0.15 eV and 3.50 ± 0.12 eV, respectively, which are expected to decrease further with increasing cluster sizes. As a result, the experimental fundamental (indirect) band gaps of bulk silicon and silicon carbide are 1.17 eV and 2.42 eV, respectively.
75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
Demonstration of Decentralized Physics-Driven Learning
In typical artificial neural networks, neurons adjust according to global calculations of a central processor, but in the brain, neurons and synapses self-adjust based on local information. Contrastive learning algorithms have recently been proposed to train physical systems, such as fluidic, mechanical, or electrical networks, to perform machine-learning tasks from local evolution rules. However, to date, such systems have only been implemented in silico due to the engineering challenge of creating elements that autonomously evolve based on their own response to two sets of global boundary conditions. Here, we introduce and implement a physics-driven contrastive learning scheme for a network of variable resistors, using circuitry to locally compare the response of two identical networks subjected to the two different sets of boundary conditions. Using this method, our system effectively trains itself, optimizing its resistance values without the use of a central processor or external information storage. Once the system is trained for a specified allostery, regression, or classification task, the task is subsequently performed rapidly and automatically by the physical imperative to minimize power dissipation in response to the given voltage inputs. Here, we demonstrate that, unlike typical computers, such learning systems are robust to extreme damage (and thus manufacturing defects) due to their decentralized learning. Our twin-network approach is therefore readily scalable to extremely large or nonlinear networks, where its distributed nature will be an enormous advantage; a laboratory network of only 500 edges will already outpace its in silico counterpart.
75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
Annual IC Progress Report
The goal of this project is to computationally investigate the progenitors of astrophysical gamma-ray bursts (GRB), the most extreme explosions in the universe across length and time scales. We have developed a cutting-edge, code-bridging approach to exploring the physics behind these luminous events to test the hypothesis that GRBs with electromagnetic radio emission originate from massive star (MS) and black hole (BH) binary systems. Our multi-scale, multi-physics theoretical framework for GRBs is based on solving well-defined and testable hydrodynamics problems associated with the dynamical evolution of the system. We solve stages of the evolution in a tractable way with a suite of well-developed state-of-the-art computational tools that include the stellar evolution code MESA, the general relativistic magnetohydrodynamics (GRMHD) code Athena++, and the binary black hole (BBH) population synthesis code COSMIC, as well as a number of self-written python post-processing tools.
79 ASTRONOMY AND ASTROPHYSICS↗
Low Power, Radiation Resilient Synchronous Edge Processing for Remote Monitoring
Next-generation space remote sensing systems may be equipped with imaging arrays that sense data at a rate that outstrips the processing capability of any computing hardware that can operate within a satellite’s power budget. This project developed novel convolutional and recurrent neural networks to detect and estimate point-like events amid clutter, and investigated their efficient and accurate implementation on analog in-memory computing systems that are 10-1000× more energy-efficient than digital processors. This project leveraged two memory devices at different levels of technological maturity: a large-scale analog computing prototype using commercial SONOS charge-trap memory, and electrochemical memory (ECRAM) with intrinsic radiation hardness. We experimentally demonstrated end-to-end analog processing of our neural networks on SONOS and characterized the radiation response of both SONOS and ECRAM. We advanced the state-of-the-art in ECRAM precision and reliability, and developed co-design methods to enable accurate long-term operation of SONOS analog accelerators in space radiation environments.
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗