Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Network convergence”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Massive νs through the CNN lens: interpreting the field-level neutrino mass information in weak lensing

Modern cosmological surveys probe the Universe deep into the nonlinear regime, where massive neutrinos suppress cosmic structure. Traditional cosmological analyses, which use the 2-point correlation function to extract information, are no longer optimal in the nonlinear regime, and there is thus much interest in extracting beyond-2-point information to improve constraints on neutrino mass. Quantifying and interpreting the beyond-2-point information is thus a pressing task. We study the field-level information in weak lensing convergence maps using convolution neural networks. We find that the network performance increases as higher source redshifts and smaller scales are considered — investigating up to a source redshift of 2.5 and ℓ max ≃ 10 4 — verifying that massive neutrinos leave a distinct effect on weak lensing. However, the performance of the network significantly drops after scaling out the 2-point information from the maps, implying that most of the field-level information can be found in the 2-point correlation function alone. We quantify these findings in terms of the likelihood ratio and also use Integrated Gradient saliency maps to interpret which parts of the map the network is learning the most from. We find that, in the absence of noise, the network extracts a similar amount of information from the most overdense and underdense regions. However, upon adding noise, the information in underdense regions is distorted as noise disproportionately washes out void-like structures.

Golshan, Malika [University of California, Berkele↗

Bioimaging Science Program Principal Investigator Meetings Proceedings (2021)

As part of the 2021 Biological Systems Science Division (BSSD) Principal Investigator (PI) Meeting, the Bioimaging Science program (BSP), within BSSD's Biomolecular Characterization and Imaging Science portfolio, held its annual PI meeting virtually February 22–23. BSP's mission is to understand the translation of genomic information into the mechanisms that power living cells, communities of cells, and whole organisms. The goal of BSP is to develop new imaging and measurement technologies to visualize the spatial and temporal relationships of key metabolic processes governing phenotypic expression in plants and microbes. BSP convenes annual PI meetings to bring together its contributing investigators to review progress and current state-of-the-art bioimaging research. Holding the BSP meeting as part of the broader BSSD PI meeting allowed researchers to interact with the extended Genomic Science program community. This convergence provided a platform for networking and exchange of ideas, helping to forge new multidisciplinary collaborations among investigators from the two sister programs. An important highlight of the BSP meeting was the keynote presentation “Enhancing Fluorescence Microscopy with Computation” by Dr. Hari Shroff of the NIH National Institute of Biomedical Imaging and Bioengineering. All the BSP PIs made presentations describing their research focus and progress, and these were followed by roundtable discussions of each project. The meeting’s proceedings provide an outline of the program’s current state and potential future directions and opportunities.

59 BASIC BIOLOGICAL SCIENCES↗

Bioimaging Science Program: 2022 Principal Investigator Meetings Proceedings

The mission of the U.S. Department of Energy’s (DOE) Biological and Environmental Research (BER) program’s Bioimaging Science Program (BSP) is to understand the translation of genomic information into the mechanisms that power living cells, communities of cells, and whole organisms. The goal of BSP is to develop new imaging and measurement technologies to visualize the spatial and temporal relationships of key metabolic processes governing phenotypic expression in plants and microbes. The extended goal of dynamic imaging is to functionally connect cellular components and interdependent organisms. Information about the time and place of chemical reactions in situ can identify causal relationships between biological activators and downstream effectors. BSP held its annual PI meeting virtually February 28–March 1. Contributing investigators are convened to review progress and current state-of-the-art bioimaging research. Holding the 2022 BSP meeting as part of the broader Genomic Science Program (GSP) PI meeting allowed researchers to interact with the extended GSP community. This convergence provided a platform for networking and exchange of ideas with experts in other technologies and in target BSP application areas, helping to forge new multidisciplinary collaborations among investigators from the sister programmatic areas within BER’s Biological Systems Science Division. An important highlight of the BSP meeting was the keynote presentation by Nobel Laureate Dr. Joachim Frank on Time-Resolved Macromolecular Imaging using Cryo-EM. He discussed microfluidic mixing and fast freezing to capture nonequilibrium intermediate states during molecular binding and conformational changes. The action of molecular machines can be captured at nanometer resolution and millisecond discrimination. BSP PIs made presentations describing their research focus and progress in plenary sessions on bioimaging science and on quantum-enabled bioimaging science research projects. BSP research at universities and DOE laboratories is presented in this report. A final discussion of the BSP was organized by meeting plenary session chairs, who prepared the following Executive Summary of current BSP research, research challenges, future opportunities, and potential ideas for expanding the BSP’s impact and interactions.

59 BASIC BIOLOGICAL SCIENCES↗

Surface wind convergence as a short-term predictor of cloud-to-ground lightning at Kennedy Space Center

Cloud-to-ground lightning is a significant forecast problem at the Kennedy Space Center (KSC) in Florida. In this study, cloud-to-ground lightning is related in time and space to surface convergence for 244 days during the convective seasons of 1985 and 1986 over a 790 sq-km network at KSC. The method uses surface convergence, particularly the average over the area, to identify the potential for new, local thunderstorm growth, and it can be used to specify the likely time and location of lightning during the life cycle of the convection. A threshold of 75 x 10 to the -6th/s change in divergence is the main criterion used to define a convergence event, and a set of flashes less than 30 min apart defines a lightning event. Time intervals are found from the study to be approximately 1 h from beginning convergence to first flash, and another hour to the end of lightning. The influences of low-level winds and midlevel moisture in determining the location and intensity of convection are discussed. This is the first known dynamically-based forecast method for lightning prediction. The technique, currently in use at KSC, has been shown to be a systematic, quantitative tool for predicting lightning onset in situations where conventional analysis tools such as radar and satellite are limited.

Watson, Andrew I.↗

Learning Based Edge Computing in Air-to-Air Communication Network

This paper studies learning-based edge computing and communication in a dynamic Air-to-Air Ad-hoc Network (AAAN). Due to spectrum scarcity, we assume the number of Air-to-Air (A2A) communication links is greater than that of the available frequency channels, such that some communication links have to share the same channel, causing co-channel interference. We formulate the joint channel selection and power control optimization problem to maximize the aggregate spectrum utilization efficiency under resource and fairness constraints. A distributed deep Q learning-based edge computing and communication algorithm is proposed to find the optimal solution. In particular, we design two different neural network structures and each communication link can converge to the optimal operation by exploiting only the local information from its neighbors, making it scalable to large networks. Finally, experimental results demonstrate the effectiveness of the proposed solution in various AAAN scenarios.

Zhe Wang↗

Integration of 5G and Time Sensitive Networks in Fossil Energy Generation Systems: A Case Study

Precise timing and data transmission within stringent time constraints are critical for numerous applications, such as robotics, virtual and augmented reality, industrial automation, energy and medical business, and various other sectors. Time-sensitive networks (TSN) and fifth-generation wireless communications (5G) are crucial for industrial communications, enabling convergent communication for various services using a common network core. Applications that are time-sensitive and require deterministic communications with low latency fall into this category, such as generation plant systems. This paper presents a simulated model of 5G-TSN for a fossil power plant based on the wired network parameters implemented in situ. Metrics analysis, comparison and future work are presented. © 2024 IEEE.

01 COAL, LIGNITE, AND PEAT↗

A Two-Stage Quantum Reinforcement Learning Method for Multi-Objective Transmission Switching

Multi-objective transmission switching (MO-TS) problems involve the strategic reconfiguration of network topology to simultaneously optimize multiple objectives. As the system scale increases, finding feasible solutions becomes increasingly challenging due to the problem's nonlinearity and high computational complexity. To address these challenges, this paper proposes a two-stage quantum reinforcement learning method that leverages potential quantum advantages for MO-TS. In the first stage, candidate switching lines are identified using a graph-theoretical approach to reduce the problem's dimensionality. The second stage introduces a quantum-classical reinforcement learning framework, where a learnable measurement-based CNN-ResVQC architecture is developed to effectively reduce the input dimension for quantum processing, mitigate vanishing gradients, and enhance trainability while improving the quantum circuit's flexibility in modeling complex decision policies for MO-TS. Numerical studies on IEEE 14-bus, 57-bus, and 118-bus systems demonstrate that the proposed algorithm achieves superior training stability and faster convergence with approximately 1% of the network parameters required by classical algorithms, highlighting its effectiveness, efficiency, and scalability. Furthermore, the practicality is validated through its stable convergence under three common quantum noise channels.

99 GENERAL AND MISCELLANEOUS↗

Error Estimates of Residual Minimization Using Neural Networks for Linear PDES

We propose an abstract framework for analyzing the convergence of least-squares methods based on residual minimization when feasible solutions are neural networks. With the norm relations and compactness arguments, we derive error estimates for both continuous and discrete formulations of residual minimization in strong and weak forms. The formulations cover recently developed physicsinformed neural networks based on strong and variational formulations.

97 MATHEMATICS AND COMPUTING↗

Ensuring Solution Uniqueness in Three-Phase Power System State Estimation

This paper is concerned with the issue of potential non-unique solutions in three-phase state estimation. Theory of observability analysis for positive sequence power system state estimation is based on certain assumptions that avoid possibility of multiple solutions. Also, it is shown that observability of a positive sequence network remains independent of the network parameters or the operating state. When extending single-phase observability analysis directly to the three-phase case, this paper considers the possibility of converging to multiple solutions, i.e. solution non-uniqueness, even for cases where state estimator successfully converges. The study illustrates via numerical examples the likelihood of converging to entirely different solutions for certain network parameters. It also examines how the operating state, particularly under unbalanced loading, leads to solution non-uniqueness. The paper then describes an alternative approach to ensure a unique solution in three-phase state estimation. This method aims to accurately and uniquely estimate the state of any unbalanced three-phase system, irrespective of load imbalance, network configuration, existence of synchronous generators or transformers.

Power System State Estimation, Three-Phase, Distri↗

Multidimensional Distributional Neural Network Output Demonstrated in Super‐Resolution of Surface Wind Speed

Accurate quantification of uncertainty in neural network predictions remains a central challenge for scientific applications involving high-dimensional, correlated data. While existing methods capture either aleatoric or epistemic uncertainty, few offer closed-form, multidimensional distributions that preserve spatial correlation while remaining computationally tractable. In this work, we present a framework for training neural networks with a multidimensional Gaussian loss, generating a closed-form predictive distribution over outputs informed by non-identically distributed training data. Our approach captures aleatoric uncertainty by iteratively estimating the means and covariance matrices, and is demonstrated on a super-resolution example out-of-training-sample. We leverage a Fourier representation of the covariance matrix to stabilize network training and preserve spatial correlation. We introduce a novel regularization strategy—referred to as information sharing—that interpolates between image-specific and global covariance estimates, enabling convergence of the super-resolution downscaling network trained on image-specific distributional loss functions. This framework allows for efficient sampling, explicit correlation modeling, and extensions to more complex distribution families all without disrupting prediction performance. We demonstrate the method on a surface wind speed downscaling task and discuss its broader applicability to uncertainty-aware prediction in scientific models.

17 WIND ENERGY↗

Challenges in Markov Chain Monte Carlo for Bayesian Neural Networks

Markov chain Monte Carlo (MCMC) methods have not been broadly adopted in Bayesian neural networks (BNNs). This paper initially reviews the main challenges in sampling from the parameter posterior of a neural network via MCMC. Such challenges culminate to lack of convergence to the parameter posterior. Nevertheless, this paper shows that a nonconverged Markov chain, generated via MCMC sampling from the parameter space of a neural network, can yield via Bayesian marginalization a valuable posterior predictive distribution of the output of the neural network. Further, classification examples based on multilayer perceptrons showcase highly accurate posterior predictive distributions. The postulate of limited scope for MCMC developments in BNNs is partially valid; an asymptotically exact parameter posterior seems less plausible, yet an accurate posterior predictive distribution is a tenable research avenue.

97 MATHEMATICS AND COMPUTING↗

Voltage Calculations in Secondary Distribution Networks via Physics-Inspired Neural Network Using Smart Meter Data

The increasing penetration of distributed energy resources (DERs) leads to voltage issues across distribution networks, necessitating voltage calculations by utilities. Electric model-free voltage calculation offers an enticing solution. However, most researches mainly focus on primary distribution networks ignoring secondary distribution networks and commonly overlook extreme voltage case calculations, which require the model’s extrapolation abilities. Here, in addressing the gaps, this paper presents a customized physics-inspired neural network (PINN) model, the structure of which is inspired by the derived coupled power flow model of primary-secondary distribution networks. To ensure precision and rapid convergence, a crafted training framework for the PINN model is proposed. The PINN’s “structure-mimetic” design enables superior extrapolation for unseen scenarios and enhances physical information awareness. We demonstrate this through two applications: hosting capacity analysis and customer-transformer connectivity. The effectiveness and advantages of the proposed PINN model are validated on two public testing systems and one utility distribution feeder model.

Distribution network↗

Sample-Efficient Adaptive Calibration of Quantum Networks Using Bayesian Optimization

All physical systems employed for quantum information tasks must act as unbiased carriers of encoded quantum states. Ensuring such indistinguishability of information carriers is a major challenge in many quantum information applications, including advanced quantum communication protocols. For photons, the workhorses of quantum communication networks, it is difficult to obtain and maintain their indistinguishability because of environment-induced transformations and loss imparted by communication channels, especially in noisy scenarios. Conventional strategies to mitigate these transformations often require hardware or software overhead that is restrictive (e.g., adding noise), infeasible (e.g., on a satellite), or time-consuming for deployed networks. In this work we propose and develop resource-efficient Bayesian optimization techniques to rapidly and adaptively calibrate the indistinguishability of individual photons for quantum networks using only information derived from their measurement. To experimentally validate our approach, we demonstrate the optimization of Hong-Ou-Mandel interference between two photons-a central task in quantum networking- finding rapid, efficient, and reliable convergence towards maximal photon indistinguishability in the presence of high loss and shot noise. We expect our resource-optimized and experimentally friendly methodology will allow fast and reliable calibration of indistinguishable quanta, a necessary task in distributed quantum computing, communications, and sensing, as well as for fundamental investigations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Accurate Compression of Tabulated Chemistry Models with Partition of Unity Networks

Tabulated chemistry models are widely used to simulate large-scale turbulent fires in applications including energy generation and fire safety. Tabulation via piecewise Cartesian interpolation suffers from the curse-of-dimensionality, leading to a prohibitive exponential growth in parameters and memory usage as more dimensions are considered. Artificial neural networks (ANNs) have attracted attention for constructing surrogates for chemistry models due to their ability to perform high-dimensional approximation. However, due to well-known pathologies regarding the realization of suboptimal local minima during training, in practice they do not converge and provide unreliable accuracy. Partition of unity networks (POUnets) are a recently introduced family of ANNs which preserve notions of convergence while performing high-dimensional approximation, discovering a mesh-free partition of space which may be used to perform optimal polynomial approximation. In this work, we assess their performance with respect to accuracy and model complexity in reconstructing unstructured flamelet data representative of nonadiabatic pool fire models. Our results show that POUnets can provide the desirable accuracy of classical spline-based interpolants with the low memory footprint of traditional ANNs while converging faster to significantly lower errors than ANNs. For example, we observe POUnets obtaining target accuracies in two dimensions with 40 to 50 times less memory and roughly double the compression in three dimensions. We also address the practical matter of efficiently training accurate POUnets by studying convergence over key hyperparameters, the impact of partition/basis formulation, and the sensitivity to initialization.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Self-adaptive weights based on balanced residual decay rate for physics-informed neural networks and deep operator networks

Physics-informed deep learning has emerged as a promising alternative for solving partial differential equations. However, for complex problems, training these networks can still be challenging, often resulting in unsatisfactory accuracy and efficiency. In this work, we demonstrate that the failure of plain physics-informed neural networks arises from the significant discrepancy in the convergence rate of residuals at different training points, where the slowest convergence rate dominates the overall solution convergence. Based on these observations, we propose a pointwise adaptive weighting method that balances the residual decay rate across different training points. The performance of our proposed adaptive weighting method is compared with current state-of-the-art adaptive weighting methods on benchmark problems for both physics-informed neural networks and physics-informed deep operator networks. In conclusion, through extensive numerical results we demonstrate that our proposed approach of balanced residual decay rates offers several advantages, including bounded weights, high prediction accuracy, fast convergence rate, low training uncertainty, low computational cost, and ease of hyperparameter tuning.

Balanced convergence rate↗

Workshop on Space Quantum Communications and Networks

NASA’s Space Communications and Navigation (SCaN) program and the National Institute of Science and Technology (NIST) co-sponsored a two-day workshop in January 2020 on space quantum communications and networks. The workshop was hosted by the Space Sciences Laboratory of the University of California, Berkeley. About 70 invited technical and program leaders from academia, industry, and government agencies defined science goals and technology requirements for a future NASA “quantum mission” that is fully aligned with the National Quantum Initiative (NQI) vision for a space-ground quantum network. This NQI vision is also a strategic milestone in SCaN’s plans for NASA’s space-based quantum communications and networks. The overall technical objectives of the Workshop were to (i) critically evaluate various mission design concepts, (ii) converge on a small subset of quantum communication and networking experiments suitable for space applications, and (iii) identify key technology gaps and promote new and emerging technologies to enable NASA’s “quantum mission” within a 5-year horizon.

quantum communications↗