Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “network design”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

GFINNs: GENERIC formalism informed neural networks for deterministic and stochastic dynamical systems

Here we propose the GENERIC formalism informed neural networks (GFINNs) that obey the symmetric degeneracy conditions of the GENERIC formalism. GFINNs comprise two modules, each of which contains two components. We model each component using a neural network whose architecture is designed to satisfy the required conditions. The component-wise architecture design provides flexible ways of leveraging available physics information into neural networks. We prove theoretically that GFINNs are sufficiently expressive to learn the underlying equations, hence establishing the universal approximation theorem. We demonstrate the performance of GFINNs in three simulation problems: gas containers exchanging heat and volume, thermoelastic double pendulum and the Langevin dynamics. In all the examples, GFINNs outperform existing methods, hence demonstrating good accuracy in predictions for both deterministic and stochastic systems.

97 MATHEMATICS AND COMPUTING↗

Exploring the Use of Novel Spatial Accelerators in Scientific Applications

Driven by the need to find alternative accelerators which can viably replace GPUs in next-generation Supercomputing systems, this paper proposes a methodology to enable agile application/hardware co-design. The application-first methodology provides the ability to come up with design of accelerators while working with real-world workloads, available accelerators, and system software. The iterative design process targets a set of kernels in a workload for performance estimates that can prune the design space for later phases of detailed architectural evaluations. To this effect, in this paper, a novel data-parallel device model is introduced that simulates the latency of performance-sensitive operations in an accelerator including data transfers and kernel computation using multi-core CPUs. The use of off-the-shelf simulators, such as pre-RTL simulator Aladdin or multiple tools available for exploring the design of deep neural network accelerators (e.g., Timeloop) is demonstrated for evaluation of various accelerator designs using applications with realistic inputs. Examples of multiple device configurations that are instantiable in a system are explored to evaluate the performance benefit of deploying novel accelerators. The proposed device is integrated with a programming model and system software to potentially explore the impacts of high-level programming languages/compilers and low-level effects such as task scheduling on multiple accelerators. We analyze our methodology for a set of applications that represent high-performance computing (HPC) and graph analytics. The applications include a computational chemistry kernel realized using tensor contractions, triangle counting, GraphSAGE and Breadth-first Search. These applications include kernels such as dense matrix-dense matrix multiplication, sparse matrix-spare matrix multiplication, and sparse matrix-dense vector multiplication. Our results indicate potential performance benefits and insights for system design by including accelerators that realize these kernels along-side general purpose accelerators.

AI, codesign, Accelerated Computing, Modeling and ↗

pnnl/FLOWER

Network FLOW analyzER - Network bi-directional deep packet header inspection. This software is designed to generate custom network flow records by monitoring bi-directional traffic from a span port, tap or other source. This function is independent of proprietary hardware or software solutions. This tool solves the problem of existing COTS solutions being either too complex or too slow.

Curtis, Darren↗

Complex Oxides for Brain–Inspired Computing: A Review

The fields of brain-inspired computing, robotics, and, more broadly, artificial intelligence (AI) seek to implement knowledge gleaned from the natural world into human-designed electronics and machines. In this review, the opportunities presented by complex oxides, a class of electronic ceramic materials whose properties can be elegantly tuned by doping, electron interactions, and a variety of external stimuli near room temperature, are discussed. The review begins with a discussion of natural intelligence at the elementary level in the nervous system, followed by collective intelligence and learning at the animal colony level mediated by social interactions. An important aspect highlighted is the vast spatial and temporal scales involved in learning and memory. The focus then turns to collective phenomena, such as metal-to-insulator transitions (MITs), ferroelectricity, and related examples, to highlight recent demonstrations of artificial neurons, synapses, and circuits and their learning. First-principles theoretical treatments of the electronic structure, and in situ synchrotron spectroscopy of operating devices are then discussed. The implementation of the experimental characteristics into neural networks and algorithm design is then revewed. Finally, outstanding materials challenges that require a microscopic understanding of the physical mechanisms, which will be essential for advancing the frontiers of neuromorphic computing, are highlighted.

36 MATERIALS SCIENCE↗

Enabling Innovation in Wind Turbine Design Using Artificial Intelligence

The Inverse Network Transformations for Efficient Generation of Robust Airfoil and Turbine Enhancements (INTEGRATE) project is developing a new inverse-design capability for wind turbine rotors using invertible neural networks. This artificial intelligence (AI)-based technology can capture complex nonlinear aerodynamic effects 100 times faster than alternative design approaches.

aerodynamics↗

Enabling Innovation in Wind Turbine Design Using Artificial Intelligence

The Inverse Network Transformations for Efficient Generation of Robust Airfoil and Turbine Enhancements (INTEGRATE) project is developing a new inverse-design capability for wind turbine rotors using invertible neural networks. This artificial intelligence (AI)-based technology can capture complex nonlinear aerodynamic effects 100 times faster than alternative design approaches.

aerodynamics↗

Efficient training of physics-informed neural networks

Open-source software package designed for the efficient training of Physics-Informed Neural Networks (PINNs) and their variants, integrating advanced methodologies such as adaptive weighting and adaptive sampling

Chen, Wenqian [Pacific Northwest National Laborato↗

SQMS Quantum R&D in Machine Learning, Optimization and Sensing beyond Fundamental Physics Applications

This newly formed team at SQMS under the Ecosystem Thrust is looking to develop capabilities impacting societal advances outside the core domain of HEP and condensed matter physics. We explicitly leverage the experimental and algorithmic innovations developed across all groups as well as connect to broad-scope external projects of the diverse team of PIs. As the inaugural set of projects, we are studying numerically quantum machine learning models inspired by efficiently trainable echo-state and orthogonal neural networks and developing designs for related experiments to be performed on quantum processors based on SQMS SRF cQED technology and Rigetti s transmon arrays. Investigated models exploit ideas and lessons learned from multiple prior work by SQMS team members in a variety of internal and external activities [R1]. Target initial applications include noisy signal processing, potentially captured by quantum sensors or noisy QPUs, as well as simulation and classification of healthcare data. For instance, image reconstruction of the brain s electrical properties by solving the inverse Maxwell equation problem with uncertainty [R2] through a hybrid quantum-classical physics-informed architecture for time-dependent processes [R3]. The group is also investigating the application and development of novel quantum sensors based on magnetic levitation of a superconducting sphere coupled to a superconducting qubit. This coupling enables high-precision measurements of the position of the sphere, which can be used for sensitive detection of forces, enabling practical applications such as gravimetry for geophysics analysis, or accelerometry for GPS-denied navigation [R4] [R1] Rieffel, Eleanor G., Ata Akbari Asanjan, M. Sohaib Alam, Namit Anand, David E. Bernal Neira, Sophie Block, Lucas T. Brady et al. "Assessing and advancing the potential of quantum computing: A NASA case study." Future Generation Computer Systems (2024). [R2] Yu, X., Serrall s, J.E., Giannakopoulos, I.I., Liu, Z., Daniel, L., Lattanzi, R. and Zhang, Z., 2023. Pifon-ept: Mr-based electrical property tomography using physics-informed fourier networks. IEEE Journal on Multiscale and Multiphysics Computational Techniques. [R3] Wudarski, Filip, Daniel OConnor, Shaun Geaney, Ata Akbari Asanjan, Max Wilson, Elena Strbac, P. Aaron Lott, and Davide Venturelli. "Hybrid quantum-classical reservoir computing for simulating chaotic systems." arXiv preprint arXiv:2311.14105 (2023). [R4] Higgins, Gerard, Saarik Kalia, and Zhen Liu. "Maglev for dark matter: Dark-photon and axion dark matter sensing with levitated superconductors." Physical Review D 109.5 (2024): 055024.

Venturelli, Davide↗

A technique to make an enterprise network a Darknet on the Internet, while providing required services to authorized users

In a well-designed and secure enterprise network, the hosts inside the network are not directly accessible from the Internet. The enterprise firewall blocks direct access to hosts inside the enterprise network and also blocks any attempts to probe or discover information about those hosts from the Internet. However, access to the enterprise network from the Internet is a must in today’s day and age. Hence, specialized mechanisms to allow secure access are implemented.

97 MATHEMATICS AND COMPUTING↗

The Transient Covalent Bond in Abiotic Nonequilibrium Systems

Abstract Biochemical systems accomplish many critical functions with by operating out‐of‐equilibrium using the energy of chemical fuels. The formation of a transient covalent bond is a simple but very effective tool in designing analogous reaction networks. This Minireview focuses on the fuel chemistries that have been used to generate transient bonds in recent demonstrations of abiotic nonequilibrium systems (i.e., systems that do not make use of biological components). Fuel reactions are divided into two fundamental classifications depending on whether the fuel contributes structural elements to the activated state, a distinction that dictates how they can be used. Reported systems are further categorized by overall fuel reaction (e.g., hydrolysis of alkylating agents, carbodiimide hydration) and illustrate how similar chemistry can be used to effect a wide range of nonequilibrium behavior, ranging from self‐assembly to the operation of molecular machines.

Kariyawasam, Lasith S.↗

The Transient Covalent Bond in Abiotic Nonequilibrium Systems

Biochemical systems accomplish many critical functions with by operating out-of-equilibrium using the energy of chemical fuels. The formation of a transient covalent bond is a simple but very effective tool in designing analogous reaction networks. This Minireview focuses on the fuel chemistries that have been used to generate transient bonds in recent demonstrations of abiotic nonequilibrium systems (i.e., systems that do not make use of biological components). Here, fuel reactions are divided into two fundamental classifications depending on whether the fuel contributes structural elements to the activated state, a distinction that dictates how they can be used. Reported systems are further categorized by overall fuel reaction (e.g., hydrolysis of alkylating agents, carbodiimide hydration) and illustrate how similar chemistry can be used to effect a wide range of nonequilibrium behavior, ranging from self-assembly to the operation of molecular machines.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Machine Learning‐Guided Discovery of High‐Entropy Perovskite Oxide Electrocatalysts via Oxygen Vacancy Engineering

Abstract High‐entropy perovskite oxides (HEPOs) have recently emerged as multifunctional catalysts. However, the HEPOs’ structural and compositional complexity hinders the easy and accurate extrapolation of activity indicators, which are essential for establishing structure‐property correlations. Here, OxiGraphX, is introduced as a novel graph neural network (GNN) model designed to capture the complex relationships among structure, composition, and atomic chemical environments for accurate prediction of oxygen vacancy formation energies (OVFEs) in HEPOs. By integrating machine learning (ML), density functional theory (DFT), and experimental validation, this work demonstrates an efficient framework for rapidly and accurately screening HEPO electrocatalysts for oxygen evolution reaction (OER). The OxiGraphX predicts OVFEs with a precision exceeding existing data, enabling the identification of compositions of higher oxygen vacancy content (OVC) and, thus, higher catalytic activity. Furthermore, the model explores latent spaces that translate effectively into experimental domains, bridging computational predictions with real‐world applications. This approach accelerates the discovery of high‐performance HEPO catalysts while providing deeper insights into their catalytic mechanisms.

Chemistry↗

Privacy-preserving federated learning: Application to behind-the-meter solar photovoltaic generation forecasting

Here, the growing usage of decentralized renewable energy sources has made accurate estimation of their aggregated generation crucial for maintaining grid flexibility and reliability. However, the majority of distributed photovoltaic (PV) systems are behind-the-meter (BTM) and invisible to utilities, leading to three challenges in obtaining an accurate forecast of their aggregated output. Firstly, traditional centralized prediction algorithms used in previous studies may not be appropriate due to privacy concerns. There is therefore a need for decentralized forecasting methods, such as federated learning (FL), to protect privacy. Secondly, there has been no comparison between localized, centralized, and decentralized forecasting methods for BTM PV production, and the trade-off between prediction accuracy and privacy has not been explored. Lastly, the computational time of data-driven prediction algorithms has not been examined. This article presents a FL power forecasting method for PVs, which uses federated learning as a decentralized collaborative modeling approach to train a single model on data from multiple BTM sites. The machine learning network used to design this FL-based BTM PV forecasting model is a multi-layered perceptron, which ensures privacy and security of the data. Comparing the suggested FL forecasting model to non-private centralized and entirely private localized models revealed that it has a high level of accuracy, with an RMSE that is 18.17% lower than localized models and 9.9% higher than centralized models.

14 SOLAR ENERGY↗

Synergistic foam stabilization and transport improvement in simulated fractures with polyelectrolyte complex nanoparticles: Microscale observation using laser etched glass micromodels

Inaccessibility to direct pore scale observation in hydrocarbon recovery of tight shale formations poses a great challenge to water-energy nexus initiatives and necessitates the use of high throughput technologies to emulate environmentally friendly processes. Herein, we employ a precise glass micromodel fabrication and visualization method to isolate the supercritical CO 2 bubbles surrounded by CO 2 -water lamella prepared in saline produced water stabilized with molecular complexation of zwitterionic surfactants (ZS) and polyelectrolyte complex nanoparticles (PECNP). The Selective Laser Enhanced Etching (SLE) technique was selected for micromodel simulation of high-pressure flow. Two representative designs, (1) fracture/micro-crack network 28 and (2) fracture/matrix were etched on fused silica glass with a laser printing machine and scCO 2 foam was injected to study the foamability, propagation, stability, and fluid loss properties. The highly monodispersed and uniformly distributed array of scCO 2 bubbles were detected in flow of scCO 2 foam in highly saline brine containing ionic complexes of positively charged PECNPs and ZS, whereas foam flow with the lamella containing ZS in fractures offered a noticeably large and polydisperse array of scCO 2 bubbles. scCO 2 bubble motion and deformation were traced, and local description of foam flow was visually examined. The confined array of scCO 2 bubbles stabilized by ZS in microcracks was affected by bubble growth and coalescence, whereas the super-populated array of monodispersed scC O2 bubbles with lamella containing complexes of PECNP and ZS were able to fill the channels with stable configurations within the timeframe of comparative stability measurements. The ability of complex fluid to prevent the formation damage was evaluated through fluid loss visualization in micromodels. Probing scCO 2 foam transport in homogenous porous media revealed smaller volume leak-off for scCO 2 foam containing PECNP-ZS ionic complexes.

04 OIL SHALES AND TAR SANDS↗

Multi-frequency progressive refinement for learned inverse scattering

Interpreting scattered acoustic and electromagnetic wave patterns is a computational task that enables remote imaging in a number of important applications, including medical imaging, geophysical exploration, sonar and radar detection, and nondestructive testing of materials. However, accurately and stably recovering an inhomogeneous medium from far-field scattered wave measurements is a computationally difficult problem, due to the nonlinear and non-local nature of the forward scattering process. We design a neural network, called Multi-Frequency Inverse Scattering Network (MFISNet), and a training method to approximate the inverse map from far-field scattered wave measurements at multiple frequencies. We consider three variants of MFISNet, with the strongest performing variant inspired by the recursive linearization method — a commonly used technique for stably inverting scattered wavefield data — that progressively refines the estimate with higher frequency content. MFISNet outperforms past methods in regimes with high-contrast, heterogeneous large objects, and inhomogeneous unknown backgrounds.

97 MATHEMATICS AND COMPUTING↗

YOLO2U-Net: Detection-guided 3D instance segmentation for microscopy

Microscopy imaging techniques are instrumental for characterization and analysis of biological structures. As these techniques typically render 3D visualization of cells by stacking 2D projections, issues such as out-of-plane excitation and low resolution in the z-axis may pose challenges (even for human experts) to detect individual cells in 3D volumes as these non-overlapping cells may appear as overlapping. In this paper a comprehensive method for accurate 3D instance segmentation of cells in the brain tissue is introduced. The proposed method combines the 2D YOLO detection method with a multi-view fusion algorithm to construct a 3D localization of the cells. Next, the 3D bounding boxes along with the data volume are input to a 3D U-Net network that is designed to segment the primary cell in each 3D bounding box, and in turn, to carry out instance segmentation of cells in the entire volume. The promising performance of the proposed method is shown in comparison with current deep learning-based 3D instance segmentation methods.

3D instance segmentation↗

A Generalized Approach to Photon Avalanche Upconversion in Luminescent Nanocrystals

Photon avalanching nanoparticles (ANPs) exhibit extremely nonlinear upconverted emission valuable for subdiffraction imaging, nanoscale sensing, and optical computing. Avalanching has been demonstrated with Tm 3+ -, Pr 3+ -, or Nd 3+ -doped nanocrystals, but their emission is limited to a few wavelengths and materials. Here, we utilize Gd 3+ -assisted energy migration to tune the emission wavelengths of Tm 3+ -sensitized ANPs and generate highly nonlinear emission from Eu 3+ , Tb 3+ , Ho 3+ , and Er 3+ ions. The upconversion intensities of these spectrally discrete ANPs scale with nonlinearity factor s = 10-17 under 1064 nm excitation at power densities as low as 7 kW cm -2 . This strategy for imprinting avalanche behavior on remote emitters can be extended to fluorophores adjacent to ANPs, as here we demonstrate with CdS/CdSe/CdS core/shell/shell quantum dots. ANPs with rationally designed energy transfer networks provide the means to transform conventional linear emitters into a highly nonlinear ones, expanding the use of photon avalanching in biological, chemical, and photonic applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Imaging supermoiré relaxation in helical trilayer graphene

In twisted van der Waals materials, local atomic relaxation can alter the underlying electronic structure. Characterizing lattice reconstruction and its susceptibility to strain is essential for understanding emergent electronic states, especially in multilayers in which interference between moiré lattices yields larger supermoiré patterns whose energy is highly sensitive to local stacking. Here, in this study, we image spatial modulations in the electronic character of helical trilayer graphene, which indicate relaxation into a superstructure of large domains with uniform moiré periodicity. We show that the supermoiré domain size is increased by strain and can be altered in the same device while preserving the local properties within each domain. Finally, we observe a higher conductance at the domain boundaries, consistent with predictions that they host counterpropagating edge modes. Our work provides a real-space visualization of moiré-periodic domains, reveals two independently tunable length scales and demonstrates strain engineering as a route towards designing correlated topological networks at the supermoiré scale.

36 MATERIALS SCIENCE↗