Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “large scale network”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

A Two-Stage Decomposition Approach for AC Optimal Power Flow

The alternating current optimal power flow (AC-OPF) problem is critical to power system operations and planning, but it is generally hard to solve due to its nonconvex and large-scale nature. Furthermore, this paper proposes a scalable decomposition approach in which the power network is decomposed into a master network and a number of subnetworks, where each network has its own AC-OPF subproblem. This formulates a two-stage optimization problem and requires only a small amount of communication between the master and subnetworks. The key contribution is a smoothing technique that renders the response of a subnetwork differentiable with respect to the input from the master problem, utilizing properties of the barrier problem formulation that naturally arises when subproblems are solved by a primal-dual interior-point algorithm. Consequently, existing efficient nonlinear programming solvers can be used for both the master problem and the subproblems. The advantage of this framework is that speedup can be obtained by processing the subnetworks in parallel, and it has convergence guarantees under reasonable assumptions. The formulation is readily extended to instances with stochastic subnetwork loads. Numerical results show favorable performance and illustrate the scalability of the algorithm which is able to solve instances with more than 11 million buses.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

New Measurements of the Lyα Forest Continuum and Effective Optical Depth with LyCAN and DESI Y1 Data

Abstract We present the Ly α Continuum Analysis Network (LyCAN), a convolutional neural network that predicts the unabsorbed quasar continuum within the rest-frame wavelength range of 1040–1600 Å based on the red side of the Ly α emission line (1216–1600 Å). We developed synthetic spectra based on a Gaussian mixture model representation of nonnegative matrix factorization (NMF) coefficients. These coefficients were derived from high-resolution, low-redshift ( z < 0.2) Hubble Space Telescope/Cosmic Origins Spectrograph (COS) quasar spectra. We supplemented this COS-based synthetic sample with an equal number of DESI Year 5 mock spectra. LyCAN performs extremely well on testing sets, achieving a median error in the forest region of 1.5% on the DESI mock sample, 2.0% on the COS-based synthetic sample, and 4.1% on the original COS spectra. LyCAN outperforms principal component analysis (PCA) and NMF-based prediction methods using the same training set by 40% or more. We predict the intrinsic continua of 83,635 DESI Year 1 spectra in the redshift range of 2.1 ≤ z ≤ 4.2 and perform an absolute measurement of the evolution of the effective optical depth. This is the largest sample employed to measure the optical depth evolution to date. We fit a power law of the form τ ( z ) = τ 0 ( 1 + z ) γ to our measurements and find τ 0 = (2.46 ± 0.14) × 10 −3 and γ = 3.62 ± 0.04. Our results show particular agreement with high-resolution, ground-based observations around z = 2, indicating that LyCAN is able to predict the quasar continuum in the forest region with only spectral information outside the forest.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Analysis of carbon capture at cellulosic biorefineries

The large-scale production of cellulosic biofuels would involve spatially distributed systems including biomass fields, logistics networks and biorefineries. Better understanding of the interactions between landscape-related decisions and the design of biorefineries with carbon capture and storage (CCS) in a supply chain context is needed to enable efficient systems. Here we analyse the cost and greenhouse gas mitigation potential for cellulosic biofuel supply chains in the US Midwest using realistic spatially explicit land availability and crop productivity data and consider fuel conversion technologies with detailed CCS design for their associated CO2 streams.

carbon capture and storage (CCS)↗
NASA NTRS1975

Periodic variations in stratospheric-mesospheric temperature from 20-65 km at 80 N to 30 S

Results on large-scale periodic variations of the stratospheric-mesospheric temperature field based on Meteorological Rocket Network (MRN) measurements are reported for a long-term (12-year) mean, the quasi-biennial oscillation (QBO), and the first three harmonics of the annual wave (annual wave, semi-annual wave, and terannual wave or 4-month variation). Station-to-station comparisons are tabulated and charted for amplitude and phase of periodic variations in the temperature field. Masking and biasing factors, such as diurnal tides, solar radiation variations, mean monthly variations, instrument lag, aerodynamic heating, are singled out for attention. Models of the stratosphere will have to account for these oscillations of different periods in the thermal field and related properties of the wind fields, with multilayered horizontal stratification with height taken into account.-

Nastrom, G. D.↗
NASA NTRS1987

Optimization of the computational load of a hypercube supercomputer onboard a mobile robot

A combinatorial optimization methodology is developed, which enables the efficient use of hypercube multiprocessors onboard mobile intelligent robots dedicated to time-critical missions. The methodology is implemented in terms of large-scale concurrent algorithms based either on fast simulated annealing, or on nonlinear asynchronous neural networks. In particular, analytic expressions are given for the effect of single-neuron perturbations on the systems' configuration energy. Compact neuromorphic data structures are used to model effects such as precedence constraints, processor idling times, and task-schedule overlaps. Results for a typical robot-dynamics benchmark are presented.

Barhen, Jacob↗
NASA NTRS1992

A distributed system for visualizing and analyzing multivariate and multidisciplinary data

The Linked Windows Interactive Data System (Link Winds) is being developed with NASA support. The objective of this proposal is to adapt and apply that system in a complex network environment containing elements to be found by scientists working multidisciplinary teams on very large scale and distributed data sets. The proposed three year program will develop specific visualization and analysis tools, to be exercised locally and remotely in the Link Winds environment, to demonstrate visual data analysis, interdisciplinary data analysis and cooperative and interactive televisualization and analysis of data by geographically separated science teams. These demonstrations will involve at least two science disciplines with the aim of producing publishable results.

Jacobson, Allan S.↗
NASA NTRS1993

A distributed system for visualizing and analyzing multivariate and multidisciplinary data

THe Linked Windows Interactive Data System (LinkWinds) is being developed with NASA support. The objective of this proposal is to adapt and apply that system in a complex network environment containing elements to be found by scientists working multidisciplinary teams on very large scale and distributed data sets. The proposed three year program will develop specific visualization and analysis tools, to be exercised locally and remotely in the LinkWinds environment, to demonstrate visual data analysis, interdisciplinary data analysis and cooperative and interactive televisualization and analysis of data by geographically separated science teams. These demonstrators will involve at least two science disciplines with the aim of producing publishable results.

Jacobson, Allan S.↗
DOE OSTI2024

The dynamics and stratigraphy of distributary channel networks (Final Technical Report)

Sedimentary reservoirs are frequently composed of the deposits of distributary channel networks. These networks are associated with coarse sediments (and high permeability) within the channel network, and relatively fine sediments (and low permeability) outside the channel network. The shape of the network is complex, and a product of the environmental boundary conditions under which it grows (Figure 1). These systems control heterogeneity at small and large scales within sedimentary basins, and understanding this heterogeneity and the links between scales represents the important scientific frontier addressed by this project.

58 GEOSCIENCES↗
NASA NTRS1991

Light domain walls, massive neutrinos and the large scale structure of the Universe

Domain walls generated through a cosmological phase transition are considered, which interact nongravitationally with light neutrinos. At a redshift z greater than or equal to 10(exp 4), the network grows rapidly and is virtually decoupled from the matter. As the friction with the matter becomes dominant, a comoving network scale close to that of the comoving horizon scale at z of approximately 10(exp 4) gets frozen. During the later phases, the walls produce matter wakes of a thickness d of approximately 10h(exp -1)Mpc, that may become seeds for the formation of the large scale structure observed in the Universe.

Massarotti, Alessandro↗
NASA NTRS1991

Ferroelectric Memory Capacitors For Neural Networks

Thin-film ferroelectric capacitors proposed as nonvolatile analog memory devices. Intended primarily for use as synaptic connections in electronic neural networks. Connection strengths (synaptic weights) stored as nonlinear remanent polarizations of ferroelectric films. Ferroelectric memory and interrogation capacitors combined into memory devices in vertical or lateral configurations. Photoconductive layer modulated by light provides variable resistance to alter bias signal applied to memory capacitor. Features include nondestructive readout, simplicity, and resistance to ionizing radiation. Interrogated without destroying stored analog data. Also amenable to very-large-scale integration. Allows use of ac coupling, eliminating errors caused by dc offsets in amplifier circuits of neural networks.

Thakoor, Sarita↗
DOE OSTI2021

Using Neural Network Force Fields to Ascertain the Quality of Ab Initio Simulations of Liquid Water

Accurately simulating the properties of bulk water, despite the apparent simplicity of the molecule, is still a challenge. In order to fully understand and reproduce its complex phase diagram, it is necessary to perform simulations at the ab initio level, including quantum mechanical effects both for electrons and nuclei. This comes at a high computational cost, given that the structural and dynamical properties tend to require long timescales and large simulation cells. In this work, we evaluate the errors that density functional theory (DFT)-based simulations routinely incur into due time- and size-scale limitations. These errors are evaluated using neural-network-trained force fields that are accurate at the level of DFT methods. We compare different exchange and correlation potentials for properties of bulk water that require large timescales. Here we show that structural properties are less dependent on the system size and that dynamical properties such as the diffusion coefficient have a strong dependence on the simulation size and timescale. Our results facilitate comparisons of DFT-based simulation results with experiments and offer a path to discriminate between model and convergence errors in these simulations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Surrogate construction via weight parameterization of residual neural networks

Surrogate model development is a critical step for uncertainty quantification or other sample-intensive tasks for complex computational models. Here, in this work, we develop a multi-output surrogate form using a class of neural networks (NNs) that employ shortcut connections, namely Residual NNs (ResNets). ResNets are known to regularize the surrogate learning problem and improve the efficiency and accuracy of the resulting surrogate. Inspired by the continuous, Neural ODE analogy, we augment ResNets with weight parameterization strategy with respect to ResNet depth. Weight-parameterized ResNets regularize the NN surrogate learning problem and allow better generalization with a drastically reduced number of learnable parameters. We demonstrate that weight-parameterized ResNets are more accurate and efficient than conventional feed-forward multi-layer perceptron networks. We also compare various options for parameterization of the weights as functions of ResNet depth. We demonstrate the results on both synthetic examples and a large scale earth system model of interest.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2010

Efficient Web Services Policy Combination

Large-scale Web security systems usually involve cooperation between domains with non-identical policies. The network management and Web communication software used by the different organizations presents a stumbling block. Many of the tools used by the various divisions do not have the ability to communicate network management data with each other. At best, this means that manual human intervention into the communication protocols used at various network routers and endpoints is required. Developing practical, sound, and automated ways to compose policies to bridge these differences is a long-standing problem. One of the key subtleties is the need to deal with inconsistencies and defaults where one organization proposes a rule on a particular feature, and another has a different rule or expresses no rule. A general approach is to assign priorities to rules and observe the rules with the highest priorities when there are conflicts. The present methods have inherent inefficiency, which heavily restrict their practical applications. A new, efficient algorithm combines policies utilized for Web services. The method is based on an algorithm that allows an automatic and scalable composition of security policies between multiple organizations. It is based on defeasible policy composition, a promising approach for finding conflicts and resolving priorities between rules. In the general case, policy negotiation is an intractable problem. A promising method, suggested in the literature, is when policies are represented in defeasible logic, and composition is based on rules for non-monotonic inference. In this system, policy writers construct metapolicies describing both the policy that they wish to enforce and annotations describing their composition preferences. These annotations can indicate whether certain policy assertions are required by the policy writer or, if not, under what circumstances the policy writer is willing to compromise and allow other assertions to take precedence. Meta-policies are specified in defeasible logic, a computationally efficient non-monotonic logic developed to model human reasoning. One drawback of this method is that at one point the algorithm starts an exhaustive search of all subsets of the set of conclusions of a defeasible theory. Although the propositional defeasible logic has linear complexity, the set of conclusions here may be large, especially in real-life practical cases. This phenomenon leads to an inefficient exponential explosion of complexity. The current process of getting a Web security policy from combination of two meta-policies consists of two steps. The first is generating a new meta-policy that is a composition of the input meta-policies, and the second is mapping the meta-policy onto a security policy. The new algorithm avoids the exhaustive search in the current algorithm, and provides a security policy that matches all requirements of the involved metapolicies.

Vatan, Farrokh↗
NASA NTRS2020

Dynamic Stability And Adaptive Control of Networked Evolving Formations with Weak Nonlinearities

The dynamic stability of formation geometry is vital to the design of large scale multiagent systems. In this paper, we probe into the structure of the formation system matrix using the Laplacian of a digraph to develop several fundamental theoretical results on the stability of formation geometry. Our key-results include the integration of the graph Laplacian into linear and weak-nonlinear relative dynamics, the development of several new coordinate transformations that expose the influence of the graph Laplacian matrix on the control laws of the agents, and the use of direct adaptive control as stability restoring devices. We also develop two fundamental results that provide upper bounds for stable formation evolution under nonlinear perturbations of agent dynamics. Finally, we use an illustrative example to demonstrate our theoretical findings.

Gehlot, Vinod P.↗
DOE OSTI2020

PREEMPT: Scalable Epidemic Interventions Using Submodular Optimization on Multi-GPU Systems

Preventing and slowing the spread of epidemics is achieved through techniques such as vaccination and social distancing. Given practical limitations on the number of vaccines and cost of administration, optimization becomes a necessity. Previous approaches using mathematical programming methods have shown to be effective but are limited by computational costs. In this work, we make several contributions: First, we present a new approach for intervention via maximizing the influence of vaccinated nodes on the network. We call this method \preempt. Next, we prove submodular properties associated with the objective function of our method so that it aids in construction of an efficient greedy approximation strategy. Consequently, we present a new parallel algorithm based on greedy hill climbing for \preempt, and present an efficient parallel implementation for distributed CPU-GPU heterogeneous platforms. Our results demonstrate that \preempt{} is able to achieve a significant reduction (up to 6.75$\times$) in the percentage of people infected on a city-scale network. We also show strong scaling results of \preempt{} on 128 nodes of the Summit supercomputer. Our parallel implementation is able to significantly reduce time to solution, from hours to minutes on large networks. This work represents a first-of-its-kind effort in parallelizing greedy hill climbing and applying it toward devising effective interventions for epidemics.

Minutoli, Marco↗
NASA NTRS2020

NeMO-Net – The Neural Multi-Modal Observation & Training Network for Global Coral Reef Assessment

We present NeMO-Net, the Srst open-source deep convolutional neural network (CNN) and interactive learning and training software aimed at assessing the present and past dynamics of coral reef ecosystems through habitat mapping into 10 biological and physical classes. Shallow marine systems, particularly coral reefs, are under significant pressures due to climate change, ocean acidification, and other anthropogenic pressures, leading to rapid, often devastating changes, in these fragile and diverse ecosystems. Historically, remote sensing of shallow marine habitats has been limited to meter-scale imagery due to the optical effects of ocean wave distortion, refraction, and optical attenuation. NeMO-Net combines 3D cm-scale distortion-free imagery captured using NASA FluidCam and Fluid lensing remote sensing technology with low resolution airborne and spaceborne datasets of varying spatial resolutions, spectral spaces, calibrations, and temporal cadence in a supercomputer-based machine learning framework. NeMO-Net augments and improves the benthic habitat classification accuracy of low-resolution datasets across large geographic ad temporal scales using high-resolution training data from FluidCam.NeMO-Net uses fully convolutional networks based upon ResNet and ReSneNet to perform semantic segmentation of remote sensing imagery of shallow marine systems captured by drones, aircraft, and satellites, including WorldView and Sentinel. Deep Laplacian Pyramid Super-Resolution Networks (LapSRN) alongside Domain Adversarial Neural Networks (DANNs) are used to reconstruct high resolution information from low resolution imagery, and to recognize domain-invariant features across datasets from multiple platforms to achieve high classification accuracies, overcoming inter-sensor spatial, spectral and temporal variations.Finally, we share our online active learning and citizen science platform, which allows users to provide interactive training data for NeMO-Net in 2D and 3D, integrated within a deep learning framework. We present results from the PaciSc Islands including Fiji, Guam and Peros Banhos 1 1 2 1 3 1 where 24-class classification accuracy exceeds 91%.

Chirayath, Ved↗
NASA NTRS2023

Evaluating MODIS Snow Products Using an Extensive Wildlife Camera Network

Snow covers a maximum of 47 million km 2 of Earth's northern hemisphere each winter and is an important component of the planet's energy balance, hydrology cycles, and ecosystems. Monitoring regional and global snow cover has increased in urgency in recent years due to warming temperatures and declines in snow cover extent. Optical satellite instruments provide large-scale observations of snow cover, but cloud cover and dense forest canopy can reduce accuracy in mapping snow cover. Remote camera networks deployed for wildlife monitoring operate below cloud cover and in forests, representing a virtually untapped source of snow cover observations to supplement satellite observations. Using images from 1,181 wildlife cameras deployed by the Norwegian Institute for Nature Research (NINA), we compared snow cover extracted from camera images to Moderate Resolution Imaging Spectroradiometer (MODIS) snow cover products during winter months of 2018–2020. Ordinal snow classifications (scale = 0–4) from cameras were closely related to normalized difference snow index (NDSI) values from the MODIS Terra Snow Cover Daily L3 Global 500m (MOD10A1) Collection 6 product (R 2 = 0.70). Tree canopy cover, the normalized difference vegetation index (NDVI), and image color mode influenced agreement between camera images and MOD10A1 NDSI values. For MOD10A1F, MOD10A1's corresponding cloud-gap filled product, agreement with cloud-gap filled values decreased from 78.5% to 56.4% in the first three days of cloudy periods and stabilized thereafter. Using our camera data as validation, we derived a threshold to create daily binary maps of snow cover from the MOD10A1 product. The threshold corresponding to snow presence was an NDSI value of 40.50, which closely matched a previously defined global binary threshold of 40 using the MOD10A2 8-day product. These analyses demonstrate the utility of camera trap networks for validation of snow cover products from satellite remote sensing, as well as their potential to identify sources of inaccuracy.

Validation↗
DOE OSTI2021

Freely scalable and reconfigurable optical hardware for deep learning

Abstract As deep neural network (DNN) models grow ever-larger, they can achieve higher accuracy and solve more complex problems. This trend has been enabled by an increase in available compute power; however, efforts to continue to scale electronic processors are impeded by the costs of communication, thermal management, power delivery and clocking. To improve scalability, we propose a digital optical neural network (DONN) with intralayer optical interconnects and reconfigurable input values. The path-length-independence of optical energy consumption enables information locality between a transmitter and a large number of arbitrarily arranged receivers, which allows greater flexibility in architecture design to circumvent scaling limitations. In a proof-of-concept experiment, we demonstrate optical multicast in the classification of 500 MNIST images with a 3-layer, fully-connected network. We also analyze the energy consumption of the DONN and find that digital optical data transfer is beneficial over electronics when the spacing of computational units is on the order of $$>10\,\upmu $$ > 10 μ m.

42 ENGINEERING↗