Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “network design”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Geometry-complete perceptron networks for 3D molecular graphs

Abstract Motivation The field of geometric deep learning has recently had a profound impact on several scientific domains such as protein structure prediction and design, leading to methodological advancements within and outside of the realm of traditional machine learning. Within this spirit, in this work, we introduce GCPNet, a new chirality-aware SE(3)-equivariant graph neural network designed for representation learning of 3D biomolecular graphs. We show that GCPNet, unlike previous representation learning methods for 3D biomolecules, is widely applicable to a variety of invariant or equivariant node-level, edge-level, and graph-level tasks on biomolecular structures while being able to (1) learn important chiral properties of 3D molecules and (2) detect external force fields. Results Across four distinct molecular-geometric tasks, we demonstrate that GCPNet’s predictions (1) for protein–ligand binding affinity achieve a statistically significant correlation of 0.608, more than 5%, greater than current state-of-the-art methods; (2) for protein structure ranking achieve statistically significant target-local and dataset-global correlations of 0.616 and 0.871, respectively; (3) for Newtownian many-body systems modeling achieve a task-averaged mean squared error less than 0.01, more than 15% better than current methods; and (4) for molecular chirality recognition achieve a state-of-the-art prediction accuracy of 98.7%, better than any other machine learning method to date. Availability and implementation The source code, data, and instructions to train new models or reproduce our results are freely available at https://github.com/BioinfoMachineLearning/GCPNet.

59 BASIC BIOLOGICAL SCIENCES↗

SNL Fugu to IBM's TrueNorth Corelet Programming Environment Transcompiler

This code is written in python and will take a defined network x graph and return a MATLAB file that defines a Truenorth Corelet of the network x graph. The network x graph is designed to be based on the FUGU specification (an internally developed Sandia spiking network definition). SAND2020-12195 M Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Hill, Aaron↗

Low-temperature emergent neuromorphic networks with correlated oxide devices

Significance Designing neuromorphic hardware for cryoelectronics is an important area of research as the field of computing paradigms beyond complementary metal-oxide-semiconductor (CMOS) progresses. Superconductivity and metal−insulator transitions are two of the most celebrated emergent, collective properties found in quantum materials such as strongly correlated oxides. Here, we present simulations of artificial neural networks that can be designed by combining superconducting devices (e.g. Josephson junctions) with Mott metal−insulator transition−based tunable resistor devices. Our simulations show that 1) neurons and synapses can be seamlessly created, 2) their functions can be tuned via learning, and 3) controlling disorder by incorporating light ions enables exponential multiplicity of states. The results open up directions for incorporating emergent behavior seen in condensed matter into hardware design for artificial intelligence.

97 MATHEMATICS AND COMPUTING↗

Exploring the benefits of using co-packaged optics in data center and AI supercomputer networks: a simulation-based analysis [Invited]

We investigate the advantages of using co-packaged optics in next-generation data center and AI supercomputer networks. The increased escape bandwidth offered by co-packaged optics provides multiple possibilities for building 50T switches and beyond, expanding the opportunities in both the data center and supercomputing domains. Furthermore, this provides network architects with the opportunity to expand their design space and develop simplified networks with enhanced network locality properties. Co-packaging at the switch and server points enables networks with double capacity while reducing the switch count by 64% compared to state-of-the-art systems. We evaluate these concepts through discrete-event simulations using all-to-all and all-reduce traffic patterns that simulate collective communications commonly found in network-bound applications. Initially, we investigate the all-to-all overhead involved in distributing the virtual machines of the applications across multiple leaf switches and compare it to the scenario in which all VMs are placed under a single switch. Subsequently, we evaluate the performance of an AI supercomputing cluster by simulating both patterns for different message sizes, while also varying the number of participating nodes. The results suggest that networks with improved locality properties become increasingly important as the network stack operates at higher speeds; for a stack latency of 1.25 µs, placing the applications under multiple switches can result in up to 68% higher completion times than placing them under a single switch. For AI supercomputers, significant improvements are observed in the mean server throughput, reaching more than 90% for configurations involving 256 nodes and message sizes of at least 128 KiB.

99 GENERAL AND MISCELLANEOUS↗

Influence of the vertex region on spin dynamics in artificial Kagome spin ice.

We present experimental and theoretical studies of spin-wave mode dynamics in artificial kagome spin ice vertices made of three identical 15-nm thick elongated Ni80Fe20 nanoislands (macrospins). We consider several possible configurations, from completely disjointed macrospins (full dipolar interelement interac-tions) to fully jointed macrospins (full dipolar-exchange interactions). Using angular-resolved magnetic field dependent broadband ferromagnetic resonance (FMR), we demonstrate the occurrence of a mode localized in the vertex region as indicated by the distinct behavior of the FMR spectra at different angles and configurations. Theoretical calculations using micromagnetic simulations support the existence, ori-gin, and behavior of this mode by interpreting it as a localized, quasi-uniform Kittel mode. Our findings pave the way for designing the most appropriate network consisting of ferromagnetic nanomagnets for specific application purposes in magnonics.

Bang, Wonbae↗

Neural architecture search via similarity adaptive guidance

Evolutionary neural network architecture search (ENAS) has attracted the attention of many experts due to its global optimization capabilities to automatically search for convolutional neural network architectures based on the target task. The current search space for ENAS is not to design a fully structured network, but to search for smaller cell architectures to reduce search costs. However, blind search strategies do not effectively utilize the potential experience of the population. In order to utilize the potential experience learned by the current population to guide the evolutionary search of the population, we propose a similarity guided neural network architecture search algorithm based on cell architecture, which utilizes the similarity between pairwise architectures in the population as empirical knowledge learned by the population. Our proposed algorithm provides a novel method for calculating architecture similarity, which calculates architecture similarity separately from the cell and macro-structure. Then we decouple the connections and operations in the cell and calculate connection and operation similarity separately. In addition, we propose adaptive similarity selection and binary tournament selection strategies to enhance the algorithm’s global and local search capabilities and effectively explore the search space. Finally, we design an improved single-point crossover operator to enhance the local search ability of the evolutionary operator. The experimental results show that SAGNAS is a competitive algorithm that achieves 97.44% and 81.60% in CIFAR10 and CIFAR100 with only 1.9 GPU-days spent.

97 MATHEMATICS AND COMPUTING↗

Extraction of Drell-Yan Angular Parameters in $pp$ Collisions with a 120 GeV Beam Energy Using a Deep-Learning Unfolding Algorithm

Dilepton production in pp collisions through the Drell-Yan process provides a crucial tool for studying the internal quark-gluon structure of the nucleon. By precisely measuring the $\cos2\phi$ asymmetry, where $\phi$ represents the azimuthal angle of the $l^{+}l^{-}$ pair in the Collins-Soper frame, we can gain valuable insights into the proton’s structure and the transverse momentum ($q_{T}$) dependence of the $\cos2\phi$ asymmetry. SeaQuest, a fixed-target Drell-Yan experiment at Fermilab, involved an unpolarized proton beam colliding with unpolarized LH$_{2}$ and LD$_{2}$ targets. Measurements obtained from experiments typically require corrections for detector inefficiencies, smearing, and acceptance. Traditionally, these corrections involve “unfolding” the detector-level measurements through matrix operations. However, in higher-dimensional phase space, these conventional methods fail to scale effectively. To overcome these limitations, we employ an unbinned unfolding method that utilizes deep neural networks for unfolding higher-dimensional phase space. In this presentation, we will explain the design of the neural network architecture, our training strategies, and outline our plans to achieve conclusive results.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

An End-to-End Framework for Verifying and Validating Manufacturing Design Integrity

Cyber attacks on networked automated manufacturing systems can severely impact part quality. In fact, malicious modifications may be introduced at any point during the manufacturing lifecycle. Therefore, it is vital to verify and validate that manufactured parts conform to their designs. This chapter describes a formal, end-to-end framework that verifies and validates the design integrity of manufactured parts by considering all potential points of alteration during precision manufacturing processes. The framework prevents unauthorized changes to computer-aided designs, verifies the correctness of translations from CAD models to G-code, maintains the integrity of G-code transferred to manufacturing machines, verifies the runtime execution of G-code and part geometry, and considers the contexts of manufacturing machine operations and how manufactured parts could be altered.

Jablonski, Matthew [Cybersecurity Manufacturing In↗

3D printable silicone compositions exhibiting high toughness and low durometer

3D printable silicones can be designed with varying crosslink density, network structures, and types of reinforcing additives. Within this design space, one may tailor the uncured material’s rheology and mechanical response to access a wide range of potential applications. However, printable, low modulus silicones, particularly those applicable to direct ink write, are underreported in published literature. To address the need for higher performance, low modulus silicones with demonstrated printability, a new set of ca. 20–50 Shore A hardness silicone elastomers exhibiting ca. 7 MPa ultimate tensile strength and ca. 400–1200% elongation at break is presented. Mechanical properties were analyzed, providing insight to the effects of formulation constituents on mechanical properties. Cyclic mechanical testing of the silicone formulations was also performed, and the energy loss and permanent set throughout cycling were determined. In conclusion, printed structures demonstrate the feasibility of these new silicones as durable frameworks for novel soft device applications.

36 MATERIALS SCIENCE↗

Spin dynamics in permalloy nano-ellipses for honeycomb and square lattices

We report experimental and theoretical studies of spin dynamics in lattice structures of permalloy (Ni 80 Fe 20 ) nano-ellipses, with four different types of networks including honeycomb and square lattices. The lattices are patterned at the center line of the co-planar wave guide and consist of non-contacting or contacting ellipses. Micromagnetic simulations show excellent agreement with the broadband ferromagnetic resonance (FMR) experimental results. We find the existence of a spin-wave mode localized in the vertex region of the contacting nano-ellipse network. Our finding has important implications when designing an artificial spin ice (ASI) network for functional magnonics.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Catalytic DNA Polymerization Can Be Expedited by Active Product Release**

Abstract The sequence‐specific hybridization of DNA facilitates its use as a building block for designer nanoscale structures and reaction networks that perform computations. However, the strong binding energy of Watson–Crick base pairing that underlies this specificity also causes the DNA dehybridization rate to depend sensitively on sequence length and temperature. This strong dependency imposes stringent constraints on the design of multi‐step DNA reactions. Here we show how an ATP‐dependent helicase, Rep‐X, can drive specific dehybridization reactions at rates independent of sequence length, removing the constraints of equilibrium on DNA hybridization and dehybridization. To illustrate how this new capacity can speed up designed DNA reaction networks, we show that Rep‐X extends the range of conditions where the primer exchange reaction, which catalytically adds a domain provided by a hairpin template to a DNA substrate, proceeds rapidly.

Moerman, Pepijn G.↗

Catalytic DNA Polymerization Can Be Expedited by Active Product Release**

Abstract The sequence‐specific hybridization of DNA facilitates its use as a building block for designer nanoscale structures and reaction networks that perform computations. However, the strong binding energy of Watson–Crick base pairing that underlies this specificity also causes the DNA dehybridization rate to depend sensitively on sequence length and temperature. This strong dependency imposes stringent constraints on the design of multi‐step DNA reactions. Here we show how an ATP‐dependent helicase, Rep‐X, can drive specific dehybridization reactions at rates independent of sequence length, removing the constraints of equilibrium on DNA hybridization and dehybridization. To illustrate how this new capacity can speed up designed DNA reaction networks, we show that Rep‐X extends the range of conditions where the primer exchange reaction, which catalytically adds a domain provided by a hairpin template to a DNA substrate, proceeds rapidly.

59 BASIC BIOLOGICAL SCIENCES↗

Hylia: Time-Series Library for Network Operations (Hylia) v1

The ability to analyze time-series data in network operations is critical to ensure optimal operations and management in wide area networks, sensor networks, and cloud networks. Hylia is a collection of multiple time-series prediction algorithms designed specifically to work with network monitoring data sets such as SNMP, NETFLOW and other monitoring data. It is designed to recognize these features and perform the extrapolation of the data.

Kiran, Mariam↗

Day-ahead continuous double auction-based peer-to-peer energy trading platform incorporating trading losses and network utilisation fee

Integration of distributed energy resources, such as photovoltaic solar (PV), introduces new opportunities to establish local energy market frameworks to improve renewable energy utilisation in residential sectors. Such peer-to-peer (P2P) energy trading refers to a local market structure where customers (and prosumers) interact to share excess PV generation to enhance the individual and community social welfare. In this work, a day-ahead continuous double auction (CDA)-based P2P market structure considering network losses and network utilisation fees was designed. Day-ahead PV energy is modelled using fractional integral polynomials and the output is forecasted using an autoregressive integrated moving average model for each market interval. Based on the customer load and excess PV energy, the CDA market is cleared using a bid/ask matching mechanism. The performance of the P2P market was evaluated by computing different welfare metrics while analysing the effect of network constraints. The results show that the designed CDA-based P2P market structure increases the social welfare of all participants by an average of 17.75% compared to the baseline for the presented cases. Moreover, the impact of the forecasting error between the day-ahead and real-time market was also quantified.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A Convolutional Neural Network Model for Battery Capacity Fade Curve Prediction using Early Life Data

Herein, early prediction of battery performance degradation trends can facilitate research of new materials and cell designs, rapid deployment of batteries in real-world applications, timely replacement of batteries in critical applications, and even the secondary use market. In this study, we design a convolutional neural network model to predict the entire battery capacity fade curve - a critical indicator of battery performance degradation - using first 100 cycles of data (~ three weeks of testing). We use the discharge voltage-capacity curves as input to the model and automate the feature extraction process through the convolutional layers of the network. Our approach can predict the per cycle capacity fade rate and rollover cycle (knee point) in the capacity fade curve, which indicate the onset of rapid capacity decay. On the publicly available graphite/LiFePO 4 battery dataset, optimized networks predict the capacity fade curves, rollover cycle, and end of life with 3.7% (worst-case), 19%, and 17% mean absolute percentage errors, respectively.

25 ENERGY STORAGE↗

Quantum-Based Molecular Dynamics Simulations Using Tensor Cores

Tensor cores, along with tensor processing units, represent a new form of hardware acceleration specifically designed for deep neural network calculations in artificial intelligence applications. Tensor cores provide extraordinary computational speed and energy efficiency but with the caveat that they were designed for tensor contractions (matrix–matrix multiplications) using only low-precision floating-point operations. Despite this perceived limitation, we demonstrate how tensor cores can be applied with high efficiency to the challenging and numerically sensitive problem of quantum-based Born–Oppenheimer molecular dynamics, which requires highly accurate electronic structure optimizations and conservative force evaluations. The interatomic forces are calculated on-the-fly from an electronic structure that is obtained from a generalized deep neural network, where the computational structure naturally takes advantage of the exceptional processing power of the tensor cores and allows for high performance in excess of 100 Tflops on a single Nvidia A100 GPU. Stable molecular dynamics trajectories are generated using the framework of extended Lagrangian Born–Oppenheimer molecular dynamics, which combines computational efficiency with long-term stability, even when using approximate charge relaxations and force evaluations that are limited in accuracy by the numerically noisy conditions caused by the low-precision tensor core floating-point operations. A canonical ensemble simulation scheme is also presented, where the additional numerical noise in the calculated forces is absorbed into a Langevin-like dynamics.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Multi-Scale Microfluidics for Transport in Shale Fabric

We develop a microfluidic experimental platform to study solute transport in multi-scale fracture networks with a disparity of spatial scales ranging between two and five orders of magnitude. Using the experimental scaling relationship observed in Marcellus shales between fracture aperture and frequency, the microfluidic design of the fracture network spans all length scales from the micron (1 μ) to the dm (10 dm). This intentional `tyranny of scales’ in the design, a determining feature of shale fabric, introduces unique complexities during microchip fabrication, microfluidic flow-through experiments, imaging, data acquisition and interpretation. Here, we establish best practices to achieve a reliable experimental protocol, critical for reproducible studies involving multi-scale physical micromodels spanning from the Darcy- to the pore-scale (dm to μm). With this protocol, two fracture networks are created: a macrofracture network with fracture apertures between 5 and 500 μm and a microfracture network with fracture apertures between 1 and 500 μm. The latter includes the addition of 1 μm ‘microfractures’, at a bearing of 55°, to the backbone of the former. Comparative analysis of the breakthrough curves measured at corresponding locations along primary, secondary and tertiary fractures in both models allows one to assess the scale and the conditions at which microfractures may impact passive transport.

58 GEOSCIENCES↗