Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “remote access”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

Radar target for remotely sensing hydrological phenomena

An apparatus for remotely measuring and accessing water status relative to snow and glacial melt, surface runoff, rainfall, evaporation, flow rate, and soil moisture is described. A radar target located at a selected location on the surface of the Earth is designed to collect water and render its cross sectional area variable as a function of the height of the water level within the target. The target is remotely monitored by an orbiting or airborne synthetic aperature radar. The target appears as a bright spot embedded within the radar image. The target brightness is indicative of the height of the water level within the ground located target.

Sivertson, W. E., Jr.↗

McIDAS III - A modern interactive data access and analysis system

A powerful facility for meteorological analysis called the Man Computer Interactive Data Access System (McIDAS) was designed and implemented in the early 1970's at the Space Science and Engineering Center of the University of Wisconsin-Madison. Hardware and software experience gained via extensive use of that facility and its derivatives have led to a newer implementation of McIDAS on a larger computer with significant enhancements to the supporting McIDAS software. McIDAS allows remote and local access to a wide range of data from satellites and conventional observations, time lapse displays of imagery data, overlaid graphics, and current and past meteorological data. Available software allows one to perform analysis of a wide range of digital images as well as temperature and moisture sounding data obtained from satellites. McIDAS can generate multicolor composites of conventional and satellite weather data, radar and forecast data in a wide variety of two- and three-dimensional displays as well as time lapse movies of these analyses. These and other capabilities are described in this paper.

Suomi, V. E.↗

Atmospheric Radiation Measurement Program Climate Research Facility Operations Quarterly Report. October 1 - December 31, 2009.

Individual raw data streams from instrumentation at the Atmospheric Radiation Measurement (ARM) Program Climate Research Facility (ACRF) fixed and mobile sites are collected and sent to the Data Management Facility (DMF) at Pacific Northwest National Laboratory (PNNL) for processing in near real-time. Raw and processed data are then sent approximately daily to the ACRF Archive, where they are made available to users. For each instrument, we calculate the ratio of the actual number of data records received daily at the Archive to the expected number of data records. The results are tabulated by (1) individual data stream, site, and month for the current year and (2) site and fiscal year (FY) dating back to 1998. The U.S. Department of Energy (DOE) requires national user facilities to report time-based operating data. The requirements concern the actual hours of operation (ACTUAL); the estimated maximum operation or uptime goal (OPSMAX), which accounts for planned downtime; and the VARIANCE [1 - (ACTUAL/OPSMAX)], which accounts for unplanned downtime. The OPSMAX time for the first quarter of FY 2010 for the North Slope Alaska (NSA) locale is 1,987.20 hours (0.90 x 2,208); for the Southern Great Plains (SGP) site is 2,097.60 hours (0.95 x 2,208); and for the Tropical Western Pacific (TWP) locale is 1,876.8 hours (0.85 x 2,208). The ARM Mobile Facility (AMF) deployment in Graciosa Island, the Azores, Portugal, continues; its OPSMAX time this quarter is 2,097.60 hours (0.95 x 2,208). The differences in OPSMAX performance reflect the complexity of local logistics and the frequency of extreme weather events. It is impractical to measure OPSMAX for each instrument or data stream. Data availability reported here refers to the average of the individual, continuous data streams that have been received by the Archive. Data not at the Archive are the result of downtime (scheduled or unplanned) of the individual instruments. Therefore, data availability is directly related to individual instrument uptime. Thus, the average percentage of data in the Archive represents the average percentage of the time (24 hours per day, 92 days for this quarter) the instruments were operating this quarter. The Site Access Request System is a web-based database used to track visitors to the fixed and mobile sites, all of which have facilities that can be visited. The NSA locale has the Barrow and Atqasuk sites. The SGP locale has historically had a central facility, 23 extended facilities, 4 boundary facilities, and 3 intermediate facilities. Beginning this quarter, the SGP began a transition to a smaller footprint (150 km x 150 km) by rearranging the original and new instrumentation made available through the American Recovery and Reinvestment Act (ARRA). The central facility and 4 extended facilities will remain, but there will be up to 16 surface new characterization facilities, 4 radar facilities, and 3 profiler facilities sited in the smaller domain. This new configuration will provide observations at scales more appropriate to current and future climate models. The TWP locale has the Manus, Nauru, and Darwin sites. These sites will also have expanded measurement capabilities with the addition of new instrumentation made available through ARRA funds. It is anticipated that the new instrumentation at all the fixed sites will be in place within the next 12 months. The AMF continues its 20-month deployment in Graciosa Island, Azores, Portugal, that started May 1, 2009. The AMF will also have additional observational capabilities within the next 12 months. Users can participate in field experiments at the sites and mobile facility, or they can participate remotely. Therefore, a variety of mechanisms are provided to users to access site information. Users who have immediate (real-time) needs for data access can request a research account on the local site data systems. This access is particularly useful to users for quick decisions in executing time-dependent activities associated with field campaigns at the fixed sites and mobile facility locations. The eight computers for the research accounts are located at the Barrow and Atqasuk sites; the SGP central facility; the TWP Manus, Nauru, and Darwin sites; the AMF; and the DMF at PNNL. However, users are warned that the data provided at the time of collection have not been fully screened for quality and therefore are not considered to be official ACRF data. Hence, these accounts are considered to be part of the facility activities associated with field campaign activities, and users are tracked. In addition, users who visit sites can connect their computer or instrument to an ACRF site data system network, which requires an on-site device account. Remote (off-site) users can also have remote access to any ACRF instrument or computer system at any ACRF site, which requires an off-site device account. These accounts are also managed and tracked.

54 ENVIRONMENTAL SCIENCES↗

A SOAP Web Service for accessing MODIS land product subsets

Remote sensing data from satellites have provided valuable information on the state of the earth for several decades. Since March 2000, the Moderate Resolution Imaging Spectroradiometer (MODIS) sensor on board NASA s Terra and Aqua satellites have been providing estimates of several land parameters useful in understanding earth system processes at global, continental, and regional scales. However, the HDF-EOS file format, specialized software needed to process the HDF-EOS files, data volume, and the high spatial and temporal resolution of MODIS data make it difficult for users wanting to extract small but valuable amounts of information from the MODIS record. To overcome this usability issue, the NASA-funded Distributed Active Archive Center (DAAC) for Biogeochemical Dynamics at Oak Ridge National Laboratory (ORNL) developed a Web service that provides subsets of MODIS land products using Simple Object Access Protocol (SOAP). The ORNL DAAC MODIS subsetting Web service is a unique way of serving satellite data that exploits a fairly established and popular Internet protocol to allow users access to massive amounts of remote sensing data. The Web service provides MODIS land product subsets up to 201 x 201 km in a non-proprietary comma delimited text file format. Users can programmatically query the Web service to extract MODIS land parameters for real time data integration into models, decision support tools or connect to workflow software. Information regarding the MODIS SOAP subsetting Web service is available on the World Wide Web (WWW) at http://daac.ornl.gov/modiswebservice.

99 GENERAL AND MISCELLANEOUS↗

Satellite Sounder Products in NASA GES DISC & Services Supporting Their Applications

The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), in collaboration with NASA Sounder Team at the Jet Propulsion Laboratory (JPL), provides processing, archiving, and distribution services for remotely-sensed data acquired by satellite sounders. Supported data sets begin chronologically with the legacy TIROS Operational Vertical Sounder (TOVS) Pathfinder, continue to the Atmospheric Infrared Sounder (AIRS), a modern hyperspectral sounder onboard the Aqua satellite, and are followed by data from the subsequent Suomi-National Polar-orbiting Partnership Cross-track Infrared Sounder (CrIS) mission and the Joint Polar Satellite System (JPSS) series CrIS missions. These satellite sounders provide long-term global observations of the atmospheric state, including temperature and humidity profiles, outgoing longwave radiation, cloud properties, and trace gases. Applications of sounder data products cover a broad range of fields, including meteorology climatology, hydrology, and air quality. The GES DISC has developed many services to assist users, including simplified and efficient methods for searching, accessing, downloading, and analytically exploring these satellite sounder data products. We have also developed the Giovanni system, a broadly used Web-based application, which provides a simple and intuitive way to visualize, analyze, and access Earth science remote sensing data. In this presentation, we will introduce the standard and near-real time sounder data products, and demonstrate our services through some use cases. Highlights of our service capabilities include data subset, vertical profile plot, inter-comparison, multi-year monthly/seasonal mean, interannual monthly/seasonal time series, and anomaly analysis.

Ding, Feng↗

Impact of Increasing Distributed Wind Power and Wind Turbine Siting on Rural Distribution Feeder Voltage Profiles: Preprint

Many favorable wind energy resources in North America are located in remote locations without direct access to the transmission grid. Building transmission lines to connect remotely-located wind power plants to large load centers has become a barrier to increasing wind power penetration in North America. By connecting utility-sized megawatt-scale wind turbines to the distribution system, windpower supplied to consumers could be increased greatly. However, the impact of including megawatt-scale wind turbines on distribution feeders needs to be studied. The work presented here examined the impact that siting and power output of megawatt-scale wind turbines have on distribution feeder voltage. This is the start of work to present a general guide to megawatt-scale wind turbine impact onthe distribution feeder and finding the amount of wind power that can be added without adversely impacting the distribution feeder operation, reliability, and power quality.

17 WIND ENERGY↗

A Dynamic Landslide Hazard Monitoring Framework for the Lower Mekong Region

The Lower Mekong region is one of the most landslide-prone areas of the world. Despite the need for dynamic characterization of landslide hazard zones within the region, it is largely understudied for several reasons. Dynamic and integrated understanding of landslide processes requires landslide inventories across the region, which have not been available previously. Computational limitations also hamper regional landslide hazard assessment, including accessing and processing remotely sensed information. Finally, open-source software and modelling packages are required to address regional landslide hazard analysis. Leveraging an open-source data-driven global Landslide Hazard Assessment for Situational Awareness model framework, this study develops a region-specific dynamic landslide hazard system leveraging satellite-based Earth observation data to assess landslide hazards across the lower Mekong region. A set of landslide inventories were prepared from high-resolution optical imagery using advanced image-processing techniques. Several static and dynamic explanatory variables (i.e., rainfall, soil moisture, slope, relief, distance to roads, distance to faults, distance to rivers) were considered during the model development phase. An extreme gradient boosting decision tree model was trained for the monsoon period of 2015–2019 and the model was evaluated with independent inventory information for the 2020 monsoon period. The model performance demonstrated considerable skill using receiver operating characteristic curve statistics, with Area Under the Curve values exceeding 0.95. The model architecture was designed to use near-real-time data, and it can be implemented in a cloud computing environment (i.e., Google Cloud Platform) for the routine assessment of landslide hazards in the Lower Mekong region. This work was developed in collaboration with scientists at the Asian Disaster Preparedness Center as part of the NASA SERVIR Program’s Mekong hub. The goal of this work is to develop a suite of tools and services on accessible open-source platforms that support and enable stakeholder communities to better assess landslide hazard and exposure at local to regional scales for decision making and planning.

Nishan Kumar Biswas↗

Fine resolution remote sensing spectra improves estimates of gross primary production of croplands

Gross primary production (GPP) is a fundamental measure of the terrestrial carbon cycle critical to our understanding of ecosystem function under the changing climate and land use. Remote sensing enables access to continuous spatial coverage, but remains challenged in heterogeneous croplands. Coarse resolution products, like MOD17A (500 m), may aggregate fragmented land cover types commonly found in heavily managed landscapes and misrepresent their respective contribution to carbon production. Consequently, this study demonstrates the capability of fine-resolution imagery (20-30 m) and available red-edge vegetation indices to characterize GPP across seven Midwest cropping systems. Four sites were established on a 22-year-old USDA Conservation Reserve Program (CRP); and the other three on land conventionally farmed with corn-soybean-wheat rotation (AGR). We compare in situ GPP estimates from eddy-covariance towers with ten satellite models: eight variants of the vegetation photosynthesis models (VPM), of which five include a red-edge vegetation index, as well as conventional products Landsat CONUS GPP (30 m) and MOD17A2H V6 (500 m). Daily and cumulative fine-resolution imagery integrated within VPM generally agreed with tower-based GPP in heterogeneous landscapes more than those from MODIS 500 m VPM or conventional GPP products from MOD17AH V6 or Landsat 8 CONUS. Here, replacing EVI2 with red-edge indices NDRE2, NDRE1, and MTCI in Sentinel 2 VPMs notably improved explanation of variance and estimation of cumulative GPP. While existing methods using MODIS- and Landsat-derived GPP are important baselines for regional and global studies, future research may benefit from the higher spatial, temporal, and radiometric resolution.

54 ENVIRONMENTAL SCIENCES↗

Implications of the Golden Age of Remote Sensing on Earth Observation Applications in Central America

Appraising the period spanning the launch of the first Landsat satellite in 1972 to the present, the common consensus within the Earth observation (EO) community is that we are currently living in a “Golden Age of Remote Sensing,” with access to datasets, tools, and capacity building opportunities hitherto unavailable (e.g. data from Landsat, the Copernicus program, Planet / NICFI, platforms such as Google Earth Engine and SEPAL, and trainings via NASA’s ARSET and Europe's EO College). With the inter-governmental Group on Earth Observations (GEO) focusing its efforts on helping regions across the world to develop their EO capacities, Central America serves as a useful case study on the development of such capacity, with important implications for other emerging regions. A significant chapter of the region’s development of its EO capacity can be traced to 1998 when a regional body - the Central American Commission for the Environment and Development (CCAD, in Spanish) - signed a Memorandum of Understanding with NASA, which eventually led to the development of the SERVIR-Mesoamerica program, also with the support of the U.S. Agency for International Development, in 2004. The establishment of the Reducing Emissions from Deforestation and forest Degradation (REDD+) initiative in 2007 in the context of the United Nations Framework Convention on Climate Change provided additional impetus for strengthening the region’s environmental monitoring capacities. REDD+ paved the way, over the past decade, for the region’s countries to benefit from cooperation with the Germany development agency, GIZ, and the United States’ SilvaCarbon initiative. By 2021, the CCAD’s parent body - the Central American Integration System (SICA, in Spanish) - had also entered into collaborations with not only NASA, but other entities, including the Copernicus program, the Japanese Aerospace Exploration Agency, and the United Nations Office for Outer Space Affairs, and the region is also engaging with GEO’s AmeriGEO regional initiative. Nevertheless, the aforementioned collaborative efforts only convey part of the case study regarding Central America’s EO capacity. This presentation will also examine applications aspects, as well as implications for the development of EO capacity in other regions, including via regional GEO initiatives.

Earth observation↗

RXIO: Design and implementation of high performance RDMA-capable GridFTP

For its low-latency, high bandwidth, and low CPU utilization, Remote Direct Memory Access (RDMA) has established itself as an effective data movement technology in many networking environments. However, the transport protocols of grid run-time systems, such as GridFTP in Globus, are not yet capable of utilizing RDMA. In this study, we examine the architecture of GridFTP for the feasibility of enabling RDMA. An RDMA-capable XIO (RXIO) framework is designed and implemented to extend its XIO system and match the characteristics of RDMA. Our experimental results demonstrate that RDMA can significantly improve the performance of GridFTP, reducing the latency by 32% and increasing the bandwidth by more than three times. In achieving such performance improvements, RDMA dramatically cuts down CPU utilization of GridFTP clients and servers. In conclusion, these results demonstrate that RXIO can effectively exploit the benefits of RDMA for GridFTP. It offers a good prototype to further leverage GridFTP on wide-area RDMA networks.

97 MATHEMATICS AND COMPUTING↗

Emulation and detection of physical faults and cyber-attacks on building energy systems through real-time hardware-in-the-loop experiments

The increasing use of remote or mobile access, integrated wearable technologies, data exchange, and cloud-based data analytics in modern smart buildings is steering the building industry towards open communication technologies. The increased connectivity and accessibility could lead to more cyber-attacks in smart buildings. On the other hand, physical faults (e.g., HVAC -heating, ventilation, and air-conditioning faults) may have similar adverse impacts as those from the cyber-attacks on building energy systems, such as occupant discomfort, energy wastage, and equipment downtime. However, current physical behavior-based anomaly detection methods fail to differentiate between cyber-attacks and physical faults in building energy systems. Moreover, the challenge in collecting real-world threat data with ground truth has led researchers to rely on numerical models with user-defined assumptions, which may not accurately reflect real-world conditions due to the lack of in-situ experimental datasets. To address these challenges and gaps, this paper presents a flexible hardware-in-the-loop (HIL) testbed for generating cyber-attack and physical fault datasets and demonstrating threat detection algorithms in a real building automation system (BAS) environment. This testbed combines hardware (i.e., real BAS with local HVAC controllers and a physical network) with software (i.e., high-fidelity models to represent behaviors of building envelope and HVAC energy systems), enabling emulations of realistic threats. Five HIL experiments, including one baseline without any threats, two with physical faults, and two with cyber-attacks, were conducted to generate datasets containing detailed network traffic and system states. A joint classification framework, incorporating a network analyzer and a physical HVAC fault detector, was proposed to automatically detect cyber-physical abnormalities on BAS at both the network and the physical HVAC levels. The network analyzer comprises a conditional random fields (CRF) based command validator and a statistics-based detection strategy. The fault detector employs a weather and schedule-based pattern matching and feature-based principal component analysis (WPM-FPCA) method. Evaluation of the classification using four metrics from the multi-class confusion matrix revealed an average accuracy of 90.2%, recall of 89.7%, precision of 88.5% and F1-score of 89.2%. Finally, these results demonstrate that the proposed joint classification framework can effectively differentiate between specific types of cyber-attacks (e.g., device reinitialization attack, network Denial-of-Service attack) and physical faults (e.g., air handling unit operational fault, cooling coil valve stuck) in real time for improved building energy management.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

NSTX-U advances in real-time deterministic PCIe-based internode communication

Distributing control mechanisms across modern commercial off the shelf (COTS) GNU/Linux systems often introduces difficult to mitigate non-deterministic behavior. Existing methods to address this problem involve non-real-time technologies such as Remote Direct Memory Access (RDMA) over Infiniband or custom Ethernet solutions, such as RDMA over Converged Ethernet (RoCE) or userspace Ethernet drivers, that trade determinism for ease of use or lower cost. The National Spherical Torus Experiment Upgrade (NSTX-U) is pursuing a new design that allows direct communication between heterogeneous systems with scalable, microsecond latency with 1 μs of jitter on that latency, outside of the constant transmission delay at the physical layer. The future design of the NSTX-U Real-time Communication System will utilize direct PCIe-to-PCIe communication with kernel support tuned for low overhead, allowing two (or more, through a switch) real-time (RT) systems to communicate and share resources as one larger entity. As a result, this greatly increases the processing capability of the primary Plasma Control System (PCS), turning previously insurmountable computational challenges into a more manageable divide and conquer parallel task.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Performance of asynchronous optimized Schwarz with one-sided communication

In asynchronous iterative methods on distributed-memory computers, processes update their local solutions using data from other processes without an implicit or explicit global synchronization that corresponds to advancing the global iteration counter. Here in this work, we test the asynchronous optimized Schwarz domain-decomposition iterative method using various one-sided (remote direct memory access) communication schemes with passive target completion. The results show that when one-sided communication is well-supported, the asynchronous version of optimized Schwarz can outperform the synchronous version even for perfectly balanced partitionings of the problem on a supercomputer with uniform nodes.

97 MATHEMATICS AND COMPUTING↗

GLANCING VIEWS OF THE EARTH: FROM A LUNAR ECLIPSE TO AN EXOPLANETARY TRANSIT

It has been posited that lunar eclipse observations may help predict the in-transit signature of Earth-like extrasolar planets. However, a comparative analysis of the two phenomena addressing in detail the transport of stellar light through the planet's atmosphere has not yet been presented. Here, we proceed with the investigation of both phenomena by making use of a common formulation. Our starting point is a set of previously unpublished near-infrared spectra collected at various phases during the 2008 August lunar eclipse. We then take the formulation to the limit of an infinitely distant observer in order to investigate the in-transit signature of the Earth-Sun system as being observed from outside our solar system. The refraction bending of sunlight rays that pass through Earth's atmosphere is a critical factor in the illumination of the eclipsed Moon. Likewise, refraction will have an impact on the in-transit transmission spectrum for specific planet-star systems depending on the refractive properties of the planet's atmosphere, the stellar size, and the planet's orbital distance. For the Earth-Sun system, at mid-transit, refraction prevents the remote observer's access to the lower {approx}12-14 km of the atmosphere and, thus, also to the bulk of the spectroscopically active atmospheric gases. We demonstrate that the effective optical radius of the Earth in-transit is modulated by refraction and varies by {approx}12 km from mid-transit to internal contact. The refractive nature of atmospheres, a property which is rarely accounted for in published investigations, will pose additional challenges to the characterization of Earth-like extrasolar planets. Refraction may have a lesser impact for Earth-like extrasolar planets within the habitable zone of some M-type stars.

79 ASTRONOMY AND ASTROPHYSICS↗

Skluma: An extensible metadata extraction pipeline for disorganized data

To mitigate the effects of high-velocity data expansion and to automate the organization of filesystems and data repositories, we have developed Skluma-a system that automatically processes a target filesystem or repository, extracts content-and context-based metadata, and organizes extracted metadata for subsequent use. Skluma is able to extract diverse metadata, including aggregate values derived from embedded structured data; named entities and latent topics buried within free-text documents; and content encoded in images. Skluma implements an overarching probabilistic pipeline to extract increasingly specific metadata from files. It applies machine learning methods to determine file types, dynamically prioritizes and then executes a suite of metadata extractors, and explores contextual metadata based on relationships among files. The derived metadata, represented in JSON, describes probabilistic knowledge of each file that may be subsequently used for discovery or organization. Skluma's architecture enables it to be deployed both locally and used as an on-demand, cloud-hosted service to create and execute dynamic extraction workflows on massive numbers of files. It is modular and extensible-allowing users to contribute their own specialized metadata extractors. Thus far we have tested Skluma on local filesystems, remote FTP-accessible servers, and publicly-accessible Globus endpoints. We have demonstrated its efficacy by applying it to a scientific environmental data repository of more than 500,000 files. We show that we can extract metadata from those files with modest cloud costs in a few hours.

data swamp↗

A uGNI-based Asynchronous Message-driven Runtime System for Cray Supercomputers with Gemini Interconnect

Gemini, the network for the new Cray XE/XK systems, features low latency, high bandwidth and strong scalability. Its hardware support for remote direct memory access enables efficient implementation of the global address space programming languages. Although the user Generic Network Interface (uGNI) provides a low-level interface for Gemini with support to the message-passing programming model (MPI), it remains challenging to port alternative programming models with scalable performance. CHARM++ is an object-oriented message-driven programming model. Its applications have been shown to scale up to the full Jaguar Cray XT machine. In this paper, we present an implementation of this programming model on uGNI for the Cray XE/XK systems. Several techniques are presented to exploit the uGNI capabilites by reducing memory copy and registration overhead, taking advantage of the persistent communication, and improving intra-node communication. Our microbenchmark results demonstrate that the uGNI-based runtime system outperforms the MPI-based implementation by up to 50% in terms of message latency. For communication intensive applications such as N-Queens, this implementation scales up to 15, 360 cores of a Cray XE6 machine and is 70% faster than the MPI-based implementation. In molecular dynamics application NAMD, the performance is also considerably improved by as much as 18%.

Computer Science↗

Building Scalable PGAS Communication Subsystem on Blue Gene/Q

This paper presents a design of scalable Partitioned Global Address Space (PGAS) communication subsystems on recently proposed Blue Gene/Q architecture. The proposed design provides an in-depth modeling of communication infrastructure using Parallel Active Messaging Interface (PAMI). The communication infrastructure is used to design time-space efficient communication protocols for frequently used data-types (contiguous, uniformly non-contiguous) using Remote Direct Memory Access (RDMA) get/put primitives. The proposed design accelerates load balance counters by using asynchronous threads, which are required due to the missing network hardware support for Atomic Memory Operations (AMOs). Under the proposed design, the synchronization traffic is reduced by tracking conflicting memory accesses in distributed space with slightly increment in space complexity. An evaluation with simple communication benchmarks show a adjacent node get latency of 2.89$\mu$s and peak bandwidth of 1775 MB/s resulting in $\approx$ 99\% communication efficiency.The evaluation shows a reduction in the execution time by up to 30\% for NWChem self consistent field calculation on 4096 processes using the proposed asynchronous thread based design.

Vishnu, Abhinav↗

Implementing Directive-Based Deferred Execution for Effective Network Aggregation

Remote direct memory access technology provides an efficient mechanism for one-sided communication that can be leveraged to implement a distributed shared memory programming model. However, when applications generate large numbers of small, irregular messages, network congestion often arises. Existing solutions address this small message problem by facilitating message aggregation but typically require disruptive code transformations that detract from the algorithmic intent of applications, or can be limited by dependent operations on aggregated data between synchronisation points. A solution is to use a directive-assisted approach that enables compilers to transform code dependent on aggregated communication for deferred execution. This paper presents an algorithm that a compiler can use to implement and optimise deferred execution for code dependent on aggregated data, based on an "aggregation context" extension for the OpenSHMEM partitioned global address space library. This new capability addresses a key challenge of message aggregation, allowing its full potential to reduce network congestion and enhance programmability to be realised.

Welch, Aaron [ORNL]↗