Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “network design”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

STSR-INR: Spatiotemporal super-resolution for multivariate time-varying volumetric data via implicit neural representation

Implicit neural representation (INR) has surfaced as a promising direction for solving different scientific visualization tasks due to its continuous representation and flexible input and output settings. We present STSR-INR, an INR solution for generating simultaneous spatiotemporal super-resolution for multivariate time-varying volumetric data. Inheriting the benefits of the INR-based approach, STSR-INR supports unsupervised learning and permits data upscaling with arbitrary spatial and temporal scale factors. Unlike existing GAN- or INR-based super-resolution methods, STSR-INR focuses on tackling variables or ensembles and enabling joint training across datasets of various spatiotemporal resolutions. Here we achieve this capability via a variable embedding scheme that learns latent vectors for different variables. In conjunction with a modulated structure in the network design, we employ a variational auto-decoder to optimize the learnable latent vectors to enable latent-space interpolation. To combat the slow training of INR, we leverage a multi-head strategy to improve training and inference speed with significant speedup. We demonstrate the effectiveness of STSR-INR with multiple scalar field datasets and compare it with conventional tricubic+linear interpolation and state-of-the-art deep-learning-based solutions (STNet and CoordNet).

97 MATHEMATICS AND COMPUTING↗

Integrating risk assessment methods for carbon storage: A case study for the quest carbon capture and storage facility

This paper documents how tools developed by the National Risk Assessment Partnership (NRAP) complement the Bowtie risk assessment approach through the demonstration of a risk-based Area of Review (AoR) determination for the Quest Carbon Capture and Storage (CCS) facility near Edmonton, Alberta with the NRAP Open-Source Integrated Assessment Model (NRAP Open-IAM). The Bowtie risk assessment for the Quest CCS site was developed by Shell Canada Ltd., who operates the asset on behalf of the Athabasca Oil Sand Project — a joint venture, owned by Canadian Natural Resources Ltd, Chevron Canada and Shell Canada Ltd. The Quest Bowtie treats site risk comprehensively – considering a large set of technical and project risks (e.g., operational risks, above ground infrastructure, public perception, etc.). NRAP tools, methods, and analyses are focused on quantitative assessment of subsurface technical risks. NRAP-Open-IAM was used to evaluate potential groundwater impacts at the Quest site, i.e., a sufficient change above background groundwater quality levels to be measurable, should CO 2 and/or brine leak from the reservoir via a faulty and/or compromised wellbore. Our results show there is a low potential for groundwater impact and support a further reduction (from ~460 to 100 km 2 ) to the established AoR for the Quest site. Integrating both approaches early in the site characterization period could significantly benefit commercial-scale projects by drastically reducing the region over which leakage risks (e.g., legacy wells) need to be evaluated, i.e., the AoR. This is especially true for brownfield sites, which could contain hundreds to thousands of legacy wells. Further, basing monitoring network design on those regions where impacts are most likely to occur has the potential to facilitate more efficient deployment of monitoring technologies and improve the likelihood of detecting a leak should one occur.

58 GEOSCIENCES↗

A survey of techniques for optimizing transformer inference

Recent years have seen a phenomenal rise in the performance and applications of transformer neural networks. The family of transformer networks, including Bidirectional Encoder Representations from Transformer (BERT), Generative Pretrained Transformer (GPT) and Vision Transformer (ViT), have shown their effectiveness across Natural Language Processing (NLP) and Computer Vision (CV) domains. Transformer-based networks such as ChatGPT have impacted the lives of common men. However, the quest for high predictive performance has led to an exponential increase in transformers' memory and compute footprint. Researchers have proposed techniques to optimize transformer inference at all levels of abstraction. Further, this paper presents a comprehensive survey of techniques for optimizing the inference phase of transformer networks. We survey techniques such as knowledge distillation, pruning, quantization, neural architecture search and lightweight network design at the algorithmic level. We further review hardware-level optimization techniques and the design of novel hardware accelerators for transformers. We summarize the quantitative results on the number of parameters/FLOPs and the accuracy of several models/techniques to showcase the tradeoff exercised by them. We also outline future directions in this rapidly evolving field of research. We believe that this survey will educate both novice and seasoned researchers and also spark a plethora of research efforts in this field.

97 MATHEMATICS AND COMPUTING↗

Cross-Linker Selection Controls Glass Transition Elevation or Reduction in Dynamic Covalently Bonded Polymer Networks

Introducing cross-links is a powerful approach to improve polymeric material performance relevant to controlling viscoelasticity, thermal and creep resistance, degradability, and efficient membrane separations. The chemically specific glass transition temperature T g is of fundamental importance in determining the time scales of key dynamical processes and physical state of the material in such applications. Here, we study experimentally how the introduction of relatively large cross-linking molecules in slowly exchanging dynamic bond-forming polymers (vitrimers) impacts vitrification for diverse polymer chemistries and a wide range of cross-link fractions. We find T g can increase, decrease, or even remain essentially unchanged, in qualitative contrast to the generic elevation of T g in traditional permanent polymer networks. We formulate an effective terpolymer network model to understand this rich behavior, which emerges as a consequence of a competition between pure cross-linking and generalized plasticization effects. The latter is associated with the tunable cross-linker size and intrinsic dynamic mobility that can offset slowing down due to traditional permanent cross-linking constraints. Here, a new strategy for functional polymer network design is suggested based on adjusting the relative importance of the two competing physical effects, which potentially can significantly enhance energy savings in applications while retaining other intrinsic properties germane to advanced materials performance.

Copolymers↗

DONUT: physics-aware machine learning for real-time X-ray nanodiffraction analysis

Coherent X-ray scattering techniques are critical for investigating the fundamental structural properties of materials at the nanoscale. While advancements have made these experiments more accessible, real-time analysis remains a significant bottleneck, often hindered by artifacts and computational demands. In scanning X-ray nanodiffraction microscopy, which is widely used to spatially resolve structural heterogeneities, this challenge is compounded by the convolution of the divergent beam with the sample’s local structure. To address this, we introduce DONUT (Diffraction with Optics for Nanobeam by Unsupervised Training), a physics-aware neural network designed for the rapid and automated analysis of nanobeam diffraction data. By incorporating a differentiable geometric diffraction model directly into its architecture, DONUT learns to predict crystal lattice strain and orientation in real-time. Crucially, this is achieved without reliance on labeled datasets or pre-training, overcoming a fundamental limitation for supervised machine learning in X-ray science. We demonstrate experimentally that DONUT accurately extracts all features within the data over 200 times more efficiently than conventional fitting methods.

Materials science↗

Prediction of vacancy defect diffusion paths in high entropy alloys via machine learning on molecular dynamics data

Identifying the diffusion path of point defects is a critical step in understanding their evolution and the mechanisms of related phenomena. Defect diffusion occurs at small length and time scales, with impacts on material properties that may continue to evolve over ns to μs, ms, and the continuum scale (s, min, etc., and cm, m, etc.). The time scale accessible to molecular dynamics (MD) simulations is limited by small step sizes, typically in the fs range. Thus, surrogate models of MD simulations through machine learning (ML)-based algorithms are of great interest, especially for complex systems such as high entropy alloys (HEAs). In this work, dynamics governing vacancy migration in HEA were approximated with graph convolutional network (GCN) models as ansatzes for kinetic Monte Carlo (KMC) rate catalogs. Network design considered that diffusion in crystalline solids generally depends on interactions between defects and their immediate neighbor atoms. Graphs represented the vacancy surroundings, MD-generated trajectories provided training and comparison datasets, and unsupervised GCN models approximated interatomic dynamics governing vacancy migration in HEAs as ansatzes for KMC. A proof-of-concept model trained on MD data for the Fe, Ni, Cr, Co, and Cu HEA environment was used with two different neighbor interactions to assess the feasibility of training a GCN to predict vacancy defect transition rates in the HEA environment. The resulting setup rapidly generated MD-formatted synthetic trajectories based on dynamics learned from the MD training set, with a time acceleration of roughly two orders of magnitude and a similar diffusion coefficient to MD observations. Additionally, Nudged Elastic Band (NEB) calculations were performed on randomly generated FeNiCrCoCu HEA structures to determine vacancy migration barriers across nearest-neighbor sites. Transition probabilities for each jump, categorized by atomic type, were extracted from these calculations. NEB-based and GCN-based approaches led to similar outcomes.

Reimer, C↗

An Efficient Power Flexibility Aggregation Framework via Coordinate Transformation and Chebyshev Centering Optimization

The large-scale integration of distributed energy resources (DERs) converts the role of a distribution system from a customer to a prosumer. In this context, the controllable DERs are expected to provide capacity support for the transmission system, which can be considered as power flexibility aggregation. Specifically, it is a process of controlling the power output of DERs to fulfill the desired capacity or flexibility. However, the power output of DERs as control variables is redundant. That is, a power flexibility command can be realized by multiple dispatch alternatives, which may hinder efficient design of control rules and flexibility evaluation schemes. Therefore, this paper introduces a conception of the artificial power flexibility controller to avoid the redundancy issue, which is a converted control variable after reconstructing the DER power region. Through this reconstruction, the DERs can be indirectly controlled by the proposed artificial power flexibility controller. In addition, a Chebyshev centering optimization model is developed to approximate the power flexibility region. At last, the proposed method is verified on an artificially-designed network with multiple DERs.

Chebyshev centering optimization↗

Development of HELICS-Based High-Performance Cyber-Physical Co-Simulation Framework for Distributed Energy Resources Applications

The rapid growth of distributed energy resources (DERs) has prompted increasing interest in the monitoring and control of DERs through hybrid smart grid communications resulting in the typical smart grid cyber-physical system. To fully understand the interdependency between them, we propose to integrate the Network Simulator 3 (NS3) into the High Engine for Large-Scale Infrastructure Co-Simulation (HELICS), a new open-source, cyber-physical-energy co-simulation platform. This paper aims to the development and case study of the HELICS-based high performance distribution-communication co-simulation framework for the DER coordination. The novel co-simulation framework for the NS3 integrating into the HELICS is developed. The DER monitoring application about hybrid smart grid communication network design is simulated and validated on this proposed HELICS-based cyber-physical co-simulation platform.

41 EE - Solar Energy Technologies Office (EE-4S)↗

Quantifying Load Uncertainty Using Real Smart Meter Data

As we get closer to customers in distribution systems, load stochasticity increases. In the past, due to lack of real-time data, the comprehensive knowledge of load behavior was limited, and simplistic assumptions had to be made for distribution system modeling and analysis, especially in the processes of network design and expansion. With the deployment of Advanced Metering Infrastructure (AMI), ample real-time smart meter data has become available to utilities. In this paper, using real hourly smart meter data, we have quantified load uncertainty in terms of average, maximum and maximum noncoincident demands on a daily basis, as well as load factor and diversity factor. These uncertainty metrics are examined for individual residential, commercial and industrial customers, as well as distribution transformers serving residential customers. This paper provides a benchmark on load uncertainty quantification for practicing engineers and researchers.

Bu, Fankun↗

Robust Decentralized Learning Using ADMM With Unreliable Agents

Many signal processing and machine learning problems can be formulated as consensus optimization problems which can be solved efficiently via a cooperative multi-agent system. However, the agents in the system can be unreliable due to a variety of reasons: noise, faults and attacks. Providing erroneous updates leads the optimization process in a wrong direction, and degrades the performance of distributed machine learning algorithms. This paper considers the problem of decentralized learning using ADMM in the presence of unreliable agents. First, we rigorously analyze the effect of erroneous updates (in ADMM learning iterations) on the convergence behavior of the multi-agent system. We show that the algorithm linearly converges to a neighborhood of the optimal solution under certain conditions and characterize the neighborhood size analytically. Next, we provide guidelines for network design to achieve a faster convergence to the neighborhood. Here, we also provide conditions on the erroneous updates for exact convergence to the optimal solution. Finally, to mitigate the influence of unreliable agents, we propose ROAD , a robust variant of ADMM, and show its resilience to unreliable agents with an exact convergence to the optimum.

97 MATHEMATICS AND COMPUTING↗

Elephants Sharing the Highway: Studying TCP Fairness in Large Transfers over High Throughput Links

Escalating bandwidth demand strains high-performance data networks, posing potential performance risks. TCP congestion control algorithms enhance reliability and optimize bandwidth usage. Network performance is influenced by factors such as AQM algorithms and router buffer size. In the context of constrained network resources, understanding how TCP flows share networks and the resulting performance impact is essential. This paper introduces insights into TCP fairness and performance involving a comparison of TCP CUBIC, Reno, Hamilton, and BBR versions 1 and 2 across real-world networks supporting high bandwidths of up to 25 Gbps. The research explores TCP behaviors with AQM algorithms like FIFO, FQ_CODEL, and RED, alongside diverse buffer sizes. Notably, findings reveal that manipulating buffers and queuing methods yields contrasting outcomes based on bandwidth. BBRv2 emerges as a superior fair algorithm, pivotal for swift transfers, particularly in scientific data scenarios. These results provide crucial guidance for future network design, ensuring equitable performance optimization.

Kiran, Mariam↗

Charging-management And Infrastructure-planning (cmip) Model

CMIP model explores various charging infrastructure network designs to serve a free-floating car-sharing fleet and determine the charging downtime experienced by the fleet for each design. Development of the CMIP model had two major steps: (1) describing modeling assumptions and (2) developing an integer program (IP) that jointly optimizes decisions about locations to install DC fast chargers and EV-to-charger assignments. The CMIP model integrates an EV charging model, EV energy consumption model, and heterogeneous, real-world vehicle use data with an integer programming optimization model to identify optimal location of new charging stations and calculate vehicle downtime for charging. The CMIP model can be applied to understand: (a) the reduction of EV fleet downtime if an additional fast-charging station is added to the current infrastructure and (b) to what extent total vehicle downtime would be sensitive to additional charging infrastructure.

Roni, MohammadS↗

EVI-RoadTrip™: Electric Vehicle Infrastructure for Road Trips [SWR-22-17]

The EVI-RoadTrip™ tool offers high-resolution refueling network design and analysis to inform electric vehicle (EV) charging infrastructure development for road trips or long-distance travels. EVI-RoadTrip helps infrastructure planners, analysts, and decision makers evaluate EV energy consumption and corresponding charging demands along the routes-between origin and destination. It considers the projected location and characteristics of charging stations, potential electric grid impacts, and required infrastructure improvements. Strategically located charging stations for long-distance travel are critical to enabling the widespread adoption of EVs by allowing them to travel further beyond city or town boundaries. Sophisticated analysis and planning can identify the points (e.g., corridors) that may require increased availability of EV charging stations to support electrified road trips.

Wood, Eric↗

DONUT: Physics-aware Machine Learning for Real-time X-ray Nanodiffraction Analysis

SF-25-088 Coherent X-ray scattering techniques are critical for investigating the fundamental structural properties of materials at the nanoscale. While advancements have made these experiments more accessible, real-time analysis remains a significant bottleneck, often hindered by artifacts and computational demands. In scanning X-ray nanodiffraction microscopy, which is widely used to spatially resolve structural heterogeneities, this challenge is compounded by the convolution of the divergent beam with the sample’s local structure. To address this, we introduce DONUT (Diffraction with Optics for Nanobeam by Unsupervised Training), a physics-aware neural network designed for the rapid and automated analysis of nanobeam diffraction data. By incorporating a differentiable geometric diffraction model directly into its architecture, DONUT learns to predict crystal lattice strain and orientation in real-time. Crucially, this is achieved without reliance on labeled datasets or pre-training, overcoming a fundamental limitation for supervised machine learning in X-ray science. We demonstrate experimentally that DONUT accurately extracts all features within the data over 200 times more efficiently than conventional fitting methods.

Zhou, Tao [Argonne National Laboratory (ANL), Argo↗

BLEECAM™ (Benchmarking Life Cycle Environmental, Economic, and Social Metrics for Critical and Advanced Minerals and Materials) [SWR-25-125]

The National Laboratory of the Rockies' (NLR) Benchmarking Life Cycle Environmental, Economic, and Social Metrics for Critical and Advanced Minerals and Materials (BLEECAM™) is an open-source, integrated decision-support tool for evaluating the impacts, risks, and trade-offs across U.S. and global materials supply chains. Funded by the U.S. Department of Energy, BLEECAM supports supply chain and market analysis. The tool integrates multi-objective supply chain optimization, system dynamics, network design, lifecycle assessment, techno-economic modeling, and social impact assessment methods to evaluate how supply chains evolve over time, geography, and deployment scenarios. BLEECAM also supports analysis related to energy infrastructure, data centers and digital infrastructure, advanced manufacturing, and other sectors that depend on critical materials.

Khalifa, SherifA. [National Laboratory of the Rock↗

Benders Cut Classification via Support Vector Machines for Solving Two-Stage Stochastic Programs

In this work, we consider Benders decomposition for solving two-stage stochastic programs with complete recourse based on finite samples of the uncertain parameters. We define the Benders cuts binding at the final optimal solution or the ones significantly improving bounds over iterations as valuable cuts. We propose a learning-enhanced Benders decomposition (LearnBD) algorithm, which adds a cut classification step in each iteration to selectively generate cuts that are more likely to be valuable cuts. The LearnBD algorithm includes two phases: (i) sampling cuts and collecting information from training problems and (ii) solving testing problems with a support vector machine (SVM) cut classifier. We run the LearnBD algorithm on instances of capacitated facility location and multicommodity network design under uncertain demand. Our results show that SVM cut classifier works effectively for identifying valuable cuts, and the LearnBD algorithm reduces the total solving time of all instances for different problems with various sizes and complexities.

97 MATHEMATICS AND COMPUTING↗

A Mitigation Strategy for the Prediction Inconsistency of Neural Phase Pickers

Neural phase pickers—neural networks designed and trained to pick seismic phase arrivals—have proven to be a powerful tool for developing earthquake catalogs. However, these pickers suffer from prediction inconsistency in which the results they produce change, sometimes substantially, even under a small perturbation to the input waveform. This problem has not been addressed by the developers and users of these pickers. In this study, we show how prediction inconsistency can negatively affect the completeness of earthquake catalogs developed using neural phase pickers. Further, we show that simply using a small step size for the sliding window when processing continuous waveform data and aggregating the results significantly mitigates this problem. We also highlight the importance of training datasets for increasing the consistency and other performance metrics.

58 GEOSCIENCES↗

Development of a Smart Alarm System for the CEBAF Injector

RadiaSoft and Jefferson Laboratory are working together to develop a machine-learning-based smart alarm system for the CEBAF injector. Because of the injector’s large number of parameters and possible fault scenarios, it is highly desirable to have an autonomous alarm system that can quickly identify and diagnose unusual machine states. We present our work on artificial neural networks designed to identify such undesirable machine states. In particular, we test both auto-encoders and inverse models as possible tools for differentiating between normal and abnormal states. These models are being developed using both supervised and unsupervised learning techniques, and are being trained using CEBAF injector data collected during dedicated machine studies as well as during regular operations. Lastly, we discuss tradeoffs between the two types of models.

Abell, D. T.↗