SEARCH · Engineering Papers

Results for “distributed algorithm”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,063 records · Page 59

All sources NASA NTRS DOE OSTI

NASA NTRS1994

Knowledge-based commodity distribution planning

This paper presents an overview of a Decision Support System (DSS) that incorporates Knowledge-Based (KB) and commercial off the shelf (COTS) technology components. The Knowledge-Based Logistics Planning Shell (KBLPS) is a state-of-the-art DSS with an interactive map-oriented graphics user interface and powerful underlying planning algorithms. KBLPS was designed and implemented to support skilled Army logisticians to prepare and evaluate logistics plans rapidly, in order to support corps-level battle scenarios. KBLPS represents a substantial advance in graphical interactive planning tools, with the inclusion of intelligent planning algorithms that provide a powerful adjunct to the planning skills of commodity distribution planners.

Saks, Victor↗

NASA NTRS2022

Cloud Mask Intercomparison eXercise (CMIX): An evaluation of cloud masking algorithms for Landsat 8 and Sentinel-2

Cloud cover is a major limiting factor in exploiting time-series data acquired by optical spaceborne remote sensing sensors. Multiple methods have been developed to address the problem of cloud detection in satellite imagery and a number of cloud masking algorithms have been developed for optical sensors but very few studies have carried out quantitative intercomparison of state-of-the-art methods in this domain. This paper summarizes results of the first Cloud Masking Intercomparison eXercise (CMIX) conducted within the Committee Earth Observation Satellites (CEOS) Working Group on Calibration & Validation (WGCV). CEOS is the forum for space agency coordination and cooperation on Earth observations, with activities organized under working groups. CMIX, as one such activity, is an international collaborative effort aimed at intercomparing cloud detection algorithms for moderate-spatial resolution (10–30 m) spaceborne optical sensors. The focus of CMIX is on open and free imagery acquired by the Landsat 8 (NASA/USGS) and Sentinel-2 (ESA) missions. Ten algorithms developed by nine teams from fourteen different organizations representing universities, research centers and industry, as well as space agencies (CNES, ESA, DLR, and NASA), are evaluated within the CMIX. Those algorithms vary in their approach and concepts utilized which were based on various spectral properties, spatial and temporal features, as well as machine learning methods. Algorithm outputs are evaluated against existing reference cloud mask datasets. Those datasets vary in sampling methods, geographical distribution, sample unit (points, polygons, full image labels), and generation approaches (experts, machine learning, sky images). Overall, the performance of algorithms varied depending on the reference dataset, which can be attributed to differences in how the reference datasets were produced. The algorithms were in good agreement for thick cloud detection, which were opaque and had lower uncertainties in their identification, in contrast to thin/semi-transparent clouds detection. Not only did CMIX allow identification of strengths and weaknesses of existing algorithms and potential areas of improvements, but also the problems associated with the existing reference datasets. The paper concludes with recommendations on generating new reference datasets, metrics, and an analysis framework to be further exploited and additional input datasets to be considered by future CMIX activities.

Sergii Skakun↗

NASA NTRS1984

Monthly distributions of precipitable water from the Nimbus 7 SMMR data

The first year of data from the Nimbus 7 Scanning Multichannel Microwave Radiometer (SMMR), covering the period December 1978 through November 1979, was used to study the monthly mean distributions of precipitable water over the global oceans. The water vapor algorithm is based on a multiple regression technique, utilizing three of the higher frequency channels on SMMR. The results obtained are in good agreement with other independent studies. They reveal features associated with other independent studies. They reveal features associated with the general circulation of the atmosphere and the ocean currents. Samples of monthly and annual distributions of precipitable water over oceans are presented, and their characteristics are discussed.

Chang, H. D.↗

DOE OSTI2024

Adaptive Online Model Update Algorithm for Predictive Control in Networked Systems

In this article, we introduce an adaptive on-line model update algorithm designed for predictive control applications in networked systems, particularly focusing on power distribution systems. Unlike traditional methods that depend on historical data for offline model identification, our approach utilizes real-time data for continuous model updates. This method integrates seamlessly with existing online control and optimization algorithms and provides timely updates in response to real-time changes. This methodology offers significant advantages, including a reduction in the communication network bandwidth requirements by minimizing the data exchanged at each iteration and enabling the model to adapt after disturbances. Furthermore, our algorithm is tailored for non-linear convex models, enhancing its applicability to practical scenarios. The efficacy of the proposed method is validated through a numerical study, demonstrating improved control performance using a synthetic IEEE test case.

data-driven model predictive control↗

DOE OSTI2021

Joint impedance and facies inversion of time-lapse seismic data for improving monitoring of CO 2 incidentally stored from CO 2 EOR

Time-lapse seismic monitoring is an effective and proven technology for mapping the distribution of CO 2 in a subsurface reservoir. When injected CO 2 displaces other reservoir fluids, porous-medium properties are changed and thus the seismic impedance changes, causing time-lapse seismic amplitude differences in the injection zones. The analysis and interpretation of images created from these amplitude differences can provide information about reservoir architecture and the CO 2 migration within the reservoir. Incorporating seismic inversion and rock physics into the interpretation of time-lapse seismic data can considerably improve the modeling and monitoring to detect and assess the location of CO 2 over time. The joint inversion method presented in this paper has an integral representation of the geology in the inversion algorithm using elastic facies, which provides information about the spatial distribution of the geologic heterogeneities controlling the movement of fluids in the reservoir. The method was successfully applied to time-lapse seismic data from a mature oil field undergoing CO 2 enhanced oil recovery. The estimated seismic acoustic impedances and facies reflect the characteristics of individual geologic facies and fluid conditions of the reservoir subject to CO 2 injection. Finally, the probabilities estimated by the joint impedance and facies inversion for the reservoir's litho-fluid facies can be used for forecasting CO 2 saturation and pressure changes within the target reservoir.

4D seismic↗

NASA NTRS1995

Genetic algorithms as global random search methods

Genetic algorithm behavior is described in terms of the construction and evolution of the sampling distributions over the space of candidate solutions. This novel perspective is motivated by analysis indicating that that schema theory is inadequate for completely and properly explaining genetic algorithm behavior. Based on the proposed theory, it is argued that the similarities of candidate solutions should be exploited directly, rather than encoding candidate solution and then exploiting their similarities. Proportional selection is characterized as a global search operator, and recombination is characterized as the search process that exploits similarities. Sequential algorithms and many deletion methods are also analyzed. It is shown that by properly constraining the search breadth of recombination operators, convergence of genetic algorithms to a global optimum can be ensured.

Peck, Charles C.↗

NASA NTRS1995

Genetic algorithms as global random search methods

Genetic algorithm behavior is described in terms of the construction and evolution of the sampling distributions over the space of candidate solutions. This novel perspective is motivated by analysis indicating that the schema theory is inadequate for completely and properly explaining genetic algorithm behavior. Based on the proposed theory, it is argued that the similarities of candidate solutions should be exploited directly, rather than encoding candidate solutions and then exploiting their similarities. Proportional selection is characterized as a global search operator, and recombination is characterized as the search process that exploits similarities. Sequential algorithms and many deletion methods are also analyzed. It is shown that by properly constraining the search breadth of recombination operators, convergence of genetic algorithms to a global optimum can be ensured.

Peck, Charles C.↗

NASA NTRS2019

Extending XBAER Algorithm to Aerosol and Cloud Condition

The retrieval of cloud optical properties for aerosol contaminated water cloud is challenging because of the complexity of physical processes in such situations. Conventionally, cloud optical data products are typically derived, ignoring the aerosol impacts on radiative transfer in the retrieval process. This is potentially a significant source of error. In this paper, the eXtensible Bremen Aerosol Retrieval (XBAER) algorithm has been optimized for the retrieval of aerosol/cloud properties for the aerosol contaminated cloud (ACC) scenarios. This version of XBAER delivers cloud optical thickness (COT) and cloud effective radius (CER) for ACCs and simultaneously retrieves aerosol optical thickness (AOT). The surface parameterization and aerosol types used in the standard XBAER algorithm have been adapted in this retrieval to account for the ACC conditions. Aerosol types in XBAER for the retrieval of ACC scenarios have been parameterized to comprise weak and strong absorptions. The comparisons of COT, CER, and AOT retrieved using this adapted XBAER algorithm and two new NASA algorithms show good agreements, especially for biomass burning aerosol. The correlation coefficients are >0.9 for AOT, ~0.8 for CER, and ~0.7 for COT. There is also a good agreement for dust plume contaminated cloud scene. The XBAER derived AOT values for dust aerosols are systematically smaller than the NASA retrieval, but both products have the same spatial distribution patterns. The comparison of COT retrieved using the adapted XBAER algorithm and that retrieved from ground-based microwave radiometer (MWR) measurements shows much better agreement for ACC conditions with high AOT.

satellite↗

DOE OSTI2023

Distribution System Model Calibration for GMLC 3.3.3 "Incipient Failure Identification for Common Grid Asset Classes" - Project Summary

Distribution system model calibration is a key enabling task for incipient failure identification within the distribution system. This report summarizes the work and publications by Sandia National Laboratories on the GMLC project titled “Incipient Failure Identification for Common Grid Asset Classes”. This project was a joint effort between Sandia National Laboratories, Lawrence Livermore National Laboratory, National Energy Technology Laboratory, and Oak Ridge National Laboratory. The included work covers distribution system topology identification, transformer groupings, phase identification, regulator and tap position estimation, and the open-source release and implementation of the developed algorithms.

24 POWER TRANSMISSION AND DISTRIBUTION↗

NASA NTRS1999

Improved Algorithm to Estimate Convective and Stratiform Rain from TRMM Microwave Radiometer Data

The rain rates associated with Mesoscale Convective Systems (MCSS) deduced from the Tropical Rainfall Measuring Mission (TRMM) Precipitation Radar (PR) follow the well known log-normal type frequency distribution characteristic of conventional radars and rain gauges. On the other hand, the current microwave radiometer rain retrieval algorithms cannot give good representations of convective and stratiform precipitation. Thus they capture poorly this log-normal character. In particular, this is noticed clearly over land areas. The objective of the present study is to improve TRMM Microwave Imager (TMI) retrievals of convective and stratiform rain to a level comparable to the PR. For this purpose, we have developed a TMI rain retrieval algorithm that depends primarily on the 85 GHz brightness temperatures (Tbs) and their spatial distribution. We emphasize the 85 GHz channel because of its fine footprint size (about 5.5 km) and strong extinction property. The other spectral channels, because they are poorer in these respects, are given less importance. The brightness temperatures and spatial distribution information in the 85 GHz allows us to detect thunderstorms, or cumulonimbus clouds (Cbs), that are in different stages of development, as well as stratiform rain outside of these Cbs. Utilizing our retrieval technique, we have produced maps of convective and stratiform rain for several MCS events over land and ocean that agree well with those given by the PR. On average, the convective and stratiform rain rates given by our technique have an accuracy of about 15 % with respect to those given by the PR.

Prabhakara, C.↗

NASA NTRS1990

Hardware-assisted software clock synchronization for homogeneous distributed systems

A clock synchronization scheme that strikes a balance between hardware and software solutions is proposed. The proposed is a software algorithm that uses minimal additional hardware to achieve reasonably tight synchronization. Unlike other software solutions, the guaranteed worst-case skews can be made insensitive to the maximum variation of message transit delay in the system. The scheme is particularly suitable for large partially connected distributed systems with topologies that support simple point-to-point broadcast algorithms. Examples of such topologies include the hypercube and the mesh interconnection structures.

Ramanathan, P.↗

NASA NTRS2018

Climatespark: an In-Memory Distributed Computing Framework for Big Climate Data Analytics

The unprecedented growth of climate data creates new opportunities for climate studies, and yet big climate data pose a grand challenge to climatologists to efficiently manage and analyze big data. The complexity of climate data content and analytical algorithms increases the difficulty of implementing algorithms on high performance computing systems. This paper proposes an in-memory, distributed computing framework, ClimateSpark, to facilitate complex big data analytics and time-consuming computational tasks. Chunking data structure improves parallel I/O efficiency, while a spatiotemporal index is built for the chunks to avoid unnecessary data reading and preprocessing. An integrated, multi-dimensional, array-based data model (ClimateRDD) and ETL operations are developed to address big climate data variety by integrating the processing components of the climate data lifecycle. ClimateSpark utilizes Spark SQL and Apache Zeppelin to develop a web portal to facilitate the interaction among climatologists, climate data, analytic operations and computing resources (e.g., using SQL query and Scala/Python notebook). Experimental results show that ClimateSpark conducts different spatiotemporal data queries/analytics with high efficiency and data locality. ClimateSpark is easily adaptable to other big multiple- dimensional, array-based datasets in various geoscience domains.

Hu, Fei↗

DOE OSTI2024

Joint Management and Optimization of Residential Natural Gas and Electricity Distribution Networks Coupled via Fuel Cells

The attractive features of natural gas as well as the growing electric power demand worldwide have created increasing interest in natural-gas-based distributed generation applications for electric distribution networks. Here, this paper investigates the interdependency between a residential natural gas network and an electric distribution network that are linked together via fuel cells. The modeling of the natural gas network is introduced first, and then the algorithm for gas flow study is presented. The optimal placement and sizing of fuel cell based distributed generation systems are formulated to minimize the losses in both the natural gas network and the electric distribution grid, subject to the constraints imposed by both networks. In addition, a probabilistic model for both gas and electricity demands is developed based on historical electricity and natural gas demand data. A K-means clustering method is used to determine the hourly load states to solve the joint probabilistic optimization problem. Simulation studies are carried out on an integrated system consisting of the IEEE 69-bus distribution network and a radial 27-node natural gas network to verify the developed optimization model and the proposed method.

24 POWER TRANSMISSION AND DISTRIBUTION↗

NASA NTRS2017

Meteorological Inventory of Rain-On-Snow Events in the Canadian Arctic Archipelago and Satellite Detection Assessment Using Passive Microwave Data

The spatial and temporal distributions of rain-on-snow (ROS) events across the Canadian Arctic Archipelago (CAA) remain poorly understood owing to their sporadic nature in time and space. This situation motivated the development of remote sensing detection algorithms. This paper uses a large meteorological dataset across the CAA to adapt an existing ROS-detection algorithm developed in a previous study by our group. Results highlight the spatial distribution and evolution of ROS occurrences reported since 1985 at 14 weather stations across the CAA. Results show that >600 ROS events were inventoried since 1985, for which >70% were classified as pure rain (liquid form) and 30% as mixed precipitation (solid/liquid). Of the pure rain events, 75% occurred during spring, 14% during fall, 8% during summer and <1% during winter. Such events can have significant impacts on ungulate grazing conditions through the creation of ice layers, causing serious problems for caribou calf survival, especially during the migration period. This paper introduces an adaptation for larger scale Arctic application of a detection algorithm (sensitivity analysis on the detection threshold) with an error of ~5%. The validation, however, remains limited due to a short study period and limited number of sites.

Canadian Arctic Archipelago (CAA)↗

DOE OSTI2021

Renewable energy integration and system operation challenge: control and optimization of millions of devices

The electric power infrastructure, originally designed and built on large-scale power plants, is evolving into a more resilient power generation and delivery system in which millions of smaller units of distributed energy generation resources units will be installed in sub-transmission and distribution networks. In order to control, manage and optimize the future grid, a hierarchical design is presented in this chapter which enables the distributed control on grid edge while inheriting the existing centralized control structure. This layered design of large-scale power system operation and control uses the following principle: reactive power control is treated as a primary control for voltage stability, and the real power control is primarily a grid-level control but can also be a supplementary control for voltage support in the case of insufficient reactive power control capacity. For the purpose of active control and operation at the distribution level, a recursive power network model is derived from nodal injection and branch power flow models. Based on the model, the proposed algorithms of hierarchical control, grid-edge inference and dynamic hosting allowance are developed and presented for multi-level controlled operation. And, a co-simulation architecture of integrated T&D system is presented to validate and demonstrate the feasibility and scalability of proposed algorithms.

Xu, Ying↗

DOE OSTI2023

Parallel Implementation of Nonadditive Gaussian Process Potentials for Monte Carlo Simulations

A strategy is presented to implement Gaussian process potentials in molecular simulations through parallel programming. Attention is focused on the three-body nonadditive energy, though all algorithms extend straightforwardly to the additive energy. The method to distribute pairs and triplets between processes is general to all potentials. Results are presented for a simulation box of argon, including full box and atom displacement calculations, which are relevant to Monte Carlo simulation. Data on speed-up are presented for up to 120 processes across four nodes. A 4-fold speed-up is observed over five processes, extending to 20-fold over 40 processes and 30-fold over 120 processes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2021

Integrated Models for Electrical Distribution Network Planning and District-Scale Building Energy Use

The increase of greenhouse emissions caused by a rise in global energy consumption is pushing the scientific community to develop tools that address key environmental, techno-economic and social issues. One specific area of focus is to create tools that enable the design of high-performance energy districts, including grid-interactive efficient buildings and electrical distribution infrastructure. This paper outlines the approach of integrating a synthetic distribution network tool (RNM-US) with URBANopt™, a modular and customizable software development kit for thermal and electrical modelling of buildings and energy systems at a district scale. First, we describe the algorithms implemented to integrate RNM-US with URBANopt to automatically generate the distribution network for the district considered. Following, we present a case study for the potential uses of the RNM-US integrations with URBANopt, highlighting the capabilities for economic and technical analysis of the distribution network built in relation to the electricity needs of the modelled buildings.

30 DIRECT ENERGY CONVERSION↗

DOE OSTI2023

Unified Communication Optimization Strategies for Sparse Triangular Solver on CPU and GPU Clusters

This paper presents a unified communication optimization framework for sparse triangular solve (SpTRSV) algorithms on CPU and GPU clusters. The framework builds upon a 3D communication-avoiding (CA) layout of Px × Py × Pz processes that divides a sparse matrix into Pz submatrices, each handled by a Px × Py 2D grid with block-cyclic distribution. We propose three communication optimization strategies: First, a new 3D SpTRSV algorithm is developed, which trades the inter-grid communication and synchronization with replicated computation. This design requires only one inter-grid synchronization, and the inter-grid communication is efficiently implemented with sparse allreduce operations. Second, broadcast and reduction communication trees are used to reduce message latency of the intra-grid 2D communication on CPU clusters. Finally, we leverage GPU-initiated one-sided communication to implement the communication trees on GPU clusters. With these nested inter- and intra-grid communication optimization strategies, the proposed 3D SpTRSV algorithm can attain up to 3.45x speedups compared to the baseline 3D SpTRSV algorithm using up to 2048 Cori Haswell CPU cores. In addition, the proposed GPU 3D SpTRSV algorithm can achieve up to 6.5x speedups compared to the proposed CPU 3D SpTRSV algorithm with Pz up to 64. Finally it is remarkable that the proposed GPU 3D SpTRSV can scale to 256 GPUs using the Perlmutter system while the existing 2D SpTRSV algorithm can only scale up to 4 GPUs.

Sao, Piyush↗