Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “network generation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

Connectivity from spike trains of neocortex neuron populations

A principal goal of this work is to determine connectivity in cultured neuronal networks as they mature so that we can understand the relationship between connectivity and behavior in biologically generated neuronal networks. A challenge of this aim is that we are able to measure only a relatively small number of neurons. In our lab the cultures are grown on a arrays of 60 electrodes. With current techniques we can distinguish at most a handful of spiking neurons while mature cultures comprise more than 10K neurons. At this stage in the work we have collected data during development of cultures over a full 30 minutes of sub-millisecond samples.

59 BASIC BIOLOGICAL SCIENCES↗

Uncertainties associated with GAN-generated datasets in high energy physics

Recently, Generative Adversarial Networks (GANs) trained on samples of traditionally simulated collider events have been proposed as a way of generating larger simulated datasets at a reduced computational cost. In this paper we point out that data generated by a GAN cannot statistically be better than the data it was trained on, and critically examine the applicability of GANs in various situations, including a) for replacing the entire Monte Carlo pipeline or parts of it, and b) to produce datasets for usage in highly sensitive analyses or sub-optimal ones. We present our arguments using information theoretic demonstrations, a toy example, as well as in the form of a formal statement, and identify some potential valid uses of GANs in collider simulations.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Wind Resource Data for Southeast Asia Using a Hybrid Numerical Weather Prediction with Machine Learning Super Resolution Approach

In this work we develop and present a machine learning based downscaling approach using generative adversarial networks (GANs). GANs learn to distinguish the relationships between low-resolution and high-resolution simulations and generate accurate high-resolution output from low-resolution input (Stengel, Glaws, Hettinger, & King, 2020). Low-resolution numerical weather prediction (NWP) simulations at 9-km spatial and 60-minute temporal resolution were executed over Southeast Asia to provide input to the GANs model. GANs for wind, temperature, and pressure were trained on coarsened WIND Toolkit data with a diverse sampling of terrain and meteorological conditions. After training, the NWP simulations over Southeast Asia were enhanced by 3x along each horizontal spatial dimension and 4x along the temporal dimension. This novel downscaling approach generated 15-year high-resolution wind, temperature, and pressure data from January 2007 through December 2021 at multiple hub heights over Southeast Asia at 3-km spatial and 15-minute temporal resolution with a 16x reduction in compute time over standard dynamical downscaling.

17 WIND ENERGY↗

Flow matching meets biology and life science: a survey

Over the past decade, advances in generative modeling, such as generative adversarial networks, masked autoencoders, and diffusion models, have significantly transformed biological research and discovery, enabling breakthroughs in molecule design, protein generation, catalysis discovery, drug discovery, and beyond. At the same time, biological applications have served as valuable testbeds for evaluating the capabilities of generative models. Recently, flow matching has emerged as a powerful and efficient alternative to diffusion-based generative modeling, with growing interest in its application to problems in biology and life sciences. This paper presents the first comprehensive survey of recent developments in flow matching and its applications in biological domains. We begin by systematically reviewing the foundations and variants of flow matching, and then categorize its applications into three major areas: biological sequence modeling, molecule generation and design, and peptide and protein generation. For each, we provide an in-depth review of recent progress. We also summarize commonly used datasets and software tools, and conclude with a discussion of potential future directions.

59 BASIC BIOLOGICAL SCIENCES↗

Generative AI for design of nanoporous materials: review and future prospects

Generative artificial intelligence (AI) is emerging as a powerful tool for advancing the design of nanoporous materials such as metal–organic frameworks, covalent–organic frameworks, and zeolites. These materials have potential application in important areas such as carbon capture, catalysis, gas storage, chemical separation, and drug delivery due to their modular, tunable structures, and their performance in these areas depends on precise control over their structure, chemical functionalities, and properties. Herein, we provide a review of generative AI algorithms that are emerging as powerful tools for the design of nanoporous materials, namely generative adversarial networks, variational autoencoders, diffusion models, genetic algorithms, reinforcement learning, and large language models. Some models are particularly good at generating diverse and high-quality designs, while others excel at exploring large design spaces or optimizing materials with desired properties. Certain algorithms also allow for efficient transitions between different designs, and some offer versatility in generating materials based on textual input. We discuss the advantages, limitations, and applications of these algorithms in porous material design and emphasize the future potential of integrating AI with experimental workflows to accelerate the development and validation of AI-generated materials.

36 MATERIALS SCIENCE↗

Finding high-redshift strong lenses in DES using convolutional neural networks

We search Dark Energy Survey (DES) Year 3 imaging data for galaxy-galaxy strong gravitational lenses using convolutional neural networks. We generate 250 000 simulated lenses at redshifts > 0.8 from which we create a data set for training the neural networks with realistic seeing, sky and shot noise. Using the simulations as a guide, we build a catalogue of 1.1 million DES sources with 1.8 < g - i < 5, 0.6 < g - r < 3, r_mag > 19, g_mag > 20, and i_mag > 18.2. We train two ensembles of neural networks on training sets consisting of simulated lenses, simulated non-lenses, and real sources. We use the neural networks to score images of each of the sources in our catalogue with a value from 0 to 1, and select those with scores greater than a chosen threshold for visual inspection, resulting in a candidate set of 7301 galaxies. During visual inspection, we rate 84 as 'probably' or 'definitely' lenses. Four of these are previously known lenses or lens candidates. We inspect a further 9428 candidates with a different score threshold, and identify four new candidates. We present 84 new strong lens candidates, selected after a few hours of visual inspection by astronomers. This catalogue contains a comparable number of high-redshift lenses to that predicted by simulations. Based on simulations, we estimate our sample to contain most discoverable lenses in this imaging and at this redshift range.

Jacobs, C.↗

DLSIA: Deep Learning for Scientific Image Analysis

DLSIA (Deep Learning for Scientific Image Analysis) is a Python-based machine learning library that empowers scientists and researchers across diverse scientific domains with a range of customizable convolutional neural network (CNN) architectures for a wide variety of tasks in image analysis to be used in downstream data processing. DLSIA features easy-to-use architectures, such as autoencoders, tunable U-Nets and parameter-lean mixed-scale dense networks (MSDNets). Additionally, this article introduces sparse mixed-scale networks (SMSNets), generated using random graphs, sparse connections and dilated convolutions connecting different length scales. For verification, several DLSIA-instantiated networks and training scripts are employed in multiple applications, including inpainting for X-ray scattering data using U-Nets and MSDNets, segmenting 3D fibers in X-ray tomographic reconstructions of concrete using an ensemble of SMSNets, and leveraging autoencoder latent spaces for data compression and clustering. As experimental data continue to grow in scale and complexity, DLSIA provides accessible CNN construction and abstracts CNN complexities, allowing scientists to tailor their machine learning approaches, accelerate discoveries, foster interdisciplinary collaboration and advance research in scientific image analysis.

97 MATHEMATICS AND COMPUTING↗

Fracture Network Influence on Rock Damage and Gas Transport following an Underground Explosion

Simulations of rock damage and gas transport following underground explosions that omit preexisting fracture networks in the subsurface cannot fully characterize the influence of geo-structural variability on gas transport. Previous studies do not consider the impact that fracture network structure and variability have on gas seepage. In this study, we develop a sequentially coupled, axi-symmetric model to look at the damage pattern and resulting gas breakthrough curves following an underground explosion given different fracture network realizations. We simulate 0.327 and 0.164 kT chemical explosives with burial depths of 100 m for 90 stochastically generated fracture networks. Gases quickly reach the surface in 30% of the higher yield simulations and 5% of the lower yield simulations. The fast breakthrough can be attributed to the formation of connected pathways between fractures to the surface. The formation of a connected damage pathway to the surface is not clearly correlated with the fracture intensity (P32) in our simulations. Breakthrough curves with slower transport are highly variable depending on the fracture network sample. The variability in the breakthrough behavior indicates that ignoring the influence of fracture networks on rock damage, which strongly influences the hydraulic properties following an underground explosion, will likely lead to a large underestimation of the uncertainty in the gas transport to the surface. This work highlights the need for incorporation of fracture networks into models for accurately predicting gas seepage following underground explosions.

58 GEOSCIENCES↗

Adaptive enhanced sampling by force-biasing using neural networks

A machine learning assisted method is presented for molecular simulation of systems with rugged free energy landscapes. The method is general and can be combined with other advanced sampling techniques. In the particular implementation proposed here, it is illustrated in the context of an adaptive biasing force approach where, rather than relying on discrete force estimates, one can resort to a self-regularizing artificial neural network to generate continuous, estimated generalized forces. By doing so, the proposed approach addresses several shortcomings common to adaptive biasing force and other algorithms. Specifically, the neural network enables smooth estimates of generalized forces in sparsely sampled regions, force estimates in previously unexplored regions, and continuous force estimates with which to bias the simulation, as opposed to biases generated at specific points of a discrete grid. The usefulness of the method is illustrated with three different examples, chosen to highlight the wide range of applicability of the underlying concepts. In all three cases, the new method is found to enhance considerably the underlying traditional adaptive biasing force approach. Furthermore, the method is also found to provide improvements over previous implementations of neural network assisted algorithms.

97 MATHEMATICS AND COMPUTING↗

ANALYSIS OF DISTRIBUTION FEEDER LOSSES DUE TO ADDITION OF DISTRIBUTED PHOTOVOLTAIC GENERATORS

Distributed generators (DG) are small scale power supplying sources owned by customers or utilities and scattered throughout the power system distribution network. Distributed generation can be both renewable and non-renewable. Addition of distributed generation is primarily to increase feeder capacity and to provide peak load reduction. However, this addition comes with several impacts on the distribution feeder. Several studies have shown that addition of DG leads to reduction of feeder loss. However, most of these studies have considered lumped load and distributed load models to analyze the effects on system losses, where the dynamic variation of load due to seasonal changes is ignored. It is very important for utilities to minimize the losses under all scenarios to decrease revenue losses, promote efficient asset utilization, and therefore, increase feeder capacity. This paper will investigate an IEEE 13-node feeder populated with photovoltaic generators on detailed residential houses with water heater, Heating Ventilation and Air conditioning (HVAC) units, lights, and other plug and convenience loads. An analysis of losses for different power system components, such as transformers, underground and overhead lines, and triplex lines, will be performed. The analysis will utilize different seasons and different solar penetration levels (15%, 30%).

24 POWER TRANSMISSION AND DISTRIBUTION↗

A New Physics-Based Modeling of Multiple Non-Planar Hydraulic Fractures Propagation

Because of the low permeability in shale plays, closely spaced hydraulic fractures and multilateral horizontal wells are generally required to improve production. Therefore, understanding the potential fracture interaction and stress evolution is critical in optimizing fracture/well design and completion strategy in multi-stage horizontal wells. In this paper, a novel fully coupled reservoir flow and geomechanics model based on the dual-lattice system is developed to simulate multiple non-planar fractures propagation. The numerical model from Discrete Element Method (DEM) is used to simulate the mechanics of fracture propagations and interactions, while a conjugate irregular lattice network is generated to represent fluid flow in both fractures and formation. The fluid flow in the formation is controlled by Darcy’s law, but within fractures it is simulated by using cubic law for laminar flow through parallel plates. Initiation, growth and coalescence of the microcracks will lead to the generation of macroscopic fractures, which is explicitly mimicked by failure and removal of bonds between particles from the discrete element network. We investigate the fracture propagation path in both homogeneous and heterogeneous reservoirs using the simulator developed. Stress shadow caused by the transverse fracture will change the orientation of principal stress in the fracture neighborhood, which may inhibit or alter the growth direction of nearby fracture clusters. However, the initial in-situ stress anisotropy often helps overcome this phenomenon. Under large in-situ stress anisotropy, the hydraulic fractures are more likely to propagate in a direction that is perpendicular to the minimum horizontal stress. Under small in-situ stress anisotropy, there is a greater chance for fractures from nearby clusters to merge with each other. Then, we examine the differences in fracture geometry caused by fracturing in cemented or uncemented wellbore. Moreover, the impact of intrinsic reservoir heterogeneity caused by the rock fabric and mineralogy on fracture nucleation and propagation paths is examined through a three-layered reservoir. Finally, we apply the method to a realistic heterogeneous dataset.

02 PETROLEUM↗

Development of large wind energy power generation system

The background and development of an experimental 100 kW wind-energy generation system are described, and the results of current field tests are presented. The experimental wind turbine is a two-bladed down-wind horizontal axis propeller type with a 29.4 m diameter rotor and a tower 28 m in height. The plant was completed in March, 1983, and has been undergoing trouble-free tests since then. The present program calls for field tests during two years from fiscal 1983 to 1984. The development of technologies relating to the linkage and operation of wind-energy power generation system networks is planned along with the acquisition of basic data for the development of a large-scale wind energy power generation system.

Source record↗

Datasets for radiation network algorithm development and testing

Domestic Nuclear Detection Office s (DNDO) Intelligence Radiation Sensors Systems (IRSS) program supported the development of networks of commercial-off-the-shelf (COTS) radiation counters for detecting, localizing, and identifying low-level radiation sources. Under this program, a series of indoor and outdoor tests were conducted with multiple source strengths and types, different background profiles, and various types of source and detector movements. Following the tests, network algorithms were replayed in various re-constructed scenarios using sub-networks. These measurements and algorithm traces together provide a rich collection of highly valuable datasets for testing the current and next generation radiation network algorithms, including the ones (to be) developed by broader R&D communities such as distributed detection, information fusion, and sensor networks. From this multiple TeraByte IRSS database, we distilled out and packaged the first batch of canonical datasets for public release. They include measurements from ten indoor and two outdoor tests which represent increasingly challenging baseline scenarios for robustly testing radiation network algorithms.

Rao, Nageswara S↗

Optimal Transactive Energy Trading of Electric Vehicle Charging Stations With On-Site PV Generation in Constrained Power Distribution Networks

This paper presents a two-level transactive energy market framework, that enables energy trading among electric vehicle charging stations (EVCSs). At the lower level, the discharging capability of EVs and on-site PV generation are leveraged by individual EVCS for participating in the transactive trading with their peers. Once the lower-level trading is completed, EVCSs trade energy at the upper level through the power grid network managed by the distribution system operator (DSO). The upper-level market is cleared while satisfying the power distribution network constraints. A cooperative game-based model is proposed to model the energy trading among EVCSs. To this end, the asymmetric Nash bargaining method is applied to allocate the grand coalition's payoff to each EVCS at the upper-level market, while a weighted proportional allocation method is used to allocate individual EVCS's payoff to its respective EVs at the lower-level market. In this work, the upper-level market formulation is further decomposed into two subproblems representing an energy scheduling and trading subproblem which maximizes EVCS payoffs, and a bargaining subproblem which allocates EVCS payoffs. The effectiveness of the proposed framework for incentivizing transactive trades among EVs and EVCSs is validated in case studies.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Exascale Deep Learning to Accelerate Cancer Research

Deep learning, through the use of neural networks, has demonstrated remarkable ability to automate many routine tasks when presented with sufficient data for training. The neural network architecture (e.g. number of layers, types of layers, connections between layers, etc.) plays a critical role in determining what, if anything, the neural network is able to learn from the training data. The trend for neural network architectures, especially those trained on ImageNet, has been to grow ever deeper and more complex. The result has been ever increasing accuracy on benchmark datasets with the cost of increased computational demands. In this paper we demonstrate that neural network architectures can be automatically generated, tailored for a specific application, with dual objectives: accuracy of prediction and speed of prediction. Using MENNDL- an HPC-enabled software stack for neural architecture search-we generate a neural network with comparable accuracy to state-of-the-art networks on a cancer pathology dataset that is also 16× faster at inference. The speedup in inference is necessary because of the volume and velocity of cancer pathology data; specifically, the previous state-of-the-art networks are too slow for individual researchers without access to HPC systems to keep pace with the rate of data generation. Our new model enables researchers with modest computational resources to analyze newly generated data faster than it is collected.

Patton, Robert↗

Neural Network Predictive Controller for Grid-Connected Virtual Synchronous Generator

In this paper, a neural network predictive controller is proposed to regulate the active and the reactive power delivered to the grid generated by a three-phase virtual inertia-based inverter. The concept of the conventional virtual synchronous generator (VSG) is discussed, and it is shown that when the inverter is connected to non-inductive grids, the conventional PI-based VSGs are unable to perform acceptable tracking. The concept of the neural network predictive controller is also discussed to replace the traditional VSGs. This replacement enables inverters to perform in both inductive and non-inductive grids. The simulation results confirm that a well-trained neural network predictive controller illustrates can adapt to any grid impedance angle, compared to the traditional PI-based virtual inertia controllers.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Functional network inference of the suprachiasmatic nucleus

In the mammalian suprachiasmatic nucleus (SCN), noisy cellular oscillators communicate within a neuronal network to generate precise system-wide circadian rhythms. Although the intracellular genetic oscillator and intercellular biochemical coupling mechanisms have been examined previously, the network topology driving synchronization of the SCN has not been elucidated. This network has been particularly challenging to probe, due to its oscillatory components and slow coupling timescale. In this work, we investigated the SCN network at a single-cell resolution through a chemically induced desynchronization. We then inferred functional connections in the SCN by applying the maximal information coefficient statistic to bioluminescence reporter data from individual neurons while they resynchronized their circadian cycling. Our results demonstrate that the functional network of circadian cells associated with resynchronization has small-world characteristics, with a node degree distribution that is exponential. We show that hubs of this small-world network are preferentially located in the central SCN, with sparsely connected shells surrounding these cores. Lastly, we used two computational models of circadian neurons to validate our predictions of network structure.

97 MATHEMATICS AND COMPUTING↗