Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distributed services”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Simple LDAP Schemas for Grid Monitoring

The purpose of this document is to provide an initial definition of the data we need in a directory service or database so that we can implement a performance monitoring testbed. To begin with, this document describes how to represent producers of events and event schemes. The representation of producers is simple and does not contain information such as who has access to the events and what protocols can be used to access the events. In the future, we will define how to describe consumers of events and add details to our representations. A popular choice for a directory service or database for grid computing is a distributed directory service that is accessed using the Lightweight Directory Access Protocol (LDAP). This document uses LDAP terminology, schemes, and formats to represent the directory service schemes.

Smith, Warren↗

Artificial Intelligence for Energy Systems Cybersecurity

Artificial intelligence and machine learning systems have the potential to influence the future design and implementation of cybersecurity systems for the power grid. These systems may enhance the overall operation of the power system by leveraging and making sense of massive amounts of data. However, we must also understand how AI/ML will need to be protected from cyber threat actors. We discuss the existing insights the NREL team has developed using AI/ML systems and then present resources including ESIF and the Cyber Energy Emulation Platform that can be used to generate training data and insights. We end by offering suggestions on priority research paths for AI in cybersecurity.

artificial intelligence↗

HEPnOS: a Specialized Data Service for High Energy Physics Analysis

In this paper, we present HEPnOS, a distributed data service for managing data produced by high-energy physics (HEP) experiments. Using HEPnOS, HEP applications can use HPC resources more effciently than traditional fle-based applications. The fle-based model leads to a rigid, chunk-based allocation of computational resources and limits the number of cores that can be used concurrently by an HEP application. The fundamental problem is that organizing domain-specifc data into fles inadvertently introduces a single, artifcial, confated tuning parameter that puts key optimization goals into confict: larger fle sizes reduce metadata overhead and thus improve I/O effciency, but smaller fle sizes provide more opportunity for workfow parallelism and load balancing. In this work, we introduce a domain-specifc data service that decouples that constraint so that data can be accessed and processed in its natural granularity while still maintaining I/O effciency. By removing the constraints introduced by fle handling we are able to obtain better scaling and make effcient use of more cores for processing a fxed-sized data sample. We demonstrate the improved scalability by using an application developed in the fle-based paradigm and comparing it to a version modifed to use HEPnOS.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Operational Evolution of FTS3: A DevOps Driven Approach to Elastic Operations

The File Transfer Service (FTS3) is a distributed data movement service developed at CERN and widely used to transfer data across the Worldwide LHC Computing Grid (WLCG). At Fermilab, FTS3 supports data transfers for multiple experiments, including Intensity Frontier experiments such as DUNE, enabling reliable data movement between WebDAV endpoints in Europe and the Americas.​ At CHEP 2021, we reported on the initial containerized deployment of FTS3 on OKD, the community Kubernetes distribution of Red Hat OpenShift. In this work, we present the subsequent evolution of this deployment, focusing on new operational capabilities introduced to improve scalability, robustness, and long-term maintainability.​ We describe the adoption of more secure and reproducible container build workflows, the integration of DevOps-driven operational practices, and enhancements in monitoring and automation. A key new result is the introduction of horizontal scaling and elastic resource management, allowing FTS3 components to dynamically adapt to workload variations while maintaining service reliability. We also discuss improvements in fault tolerance and operational procedures derived from production experience.​ Finally, we summarize lessons learned from operating FTS3 as a Kubernetes-native service and outline how these developments have improved the resilience and efficiency of data movement operations at Fermilab.

Munoz Flores, Victor Leopoldo [Fermilab]↗

Space Physics Data Facility Web Services

The Space Physics Data Facility (SPDF) Web services provides a distributed programming interface to a portion of the SPDF software. (A general description of Web services is available at http://www.w3.org/ and in many current software-engineering texts and articles focused on distributed programming.) The SPDF Web services distributed programming interface enables additional collaboration and integration of the SPDF software system with other software systems, in furtherance of the SPDF mission to lead collaborative efforts in the collection and utilization of space physics data and mathematical models. This programming interface conforms to all applicable Web services specifications of the World Wide Web Consortium. The interface is specified by a Web Services Description Language (WSDL) file. The SPDF Web services software consists of the following components: 1) A server program for implementation of the Web services; and 2) A software developer s kit that consists of a WSDL file, a less formal description of the interface, a Java class library (which further eases development of Java-based client software), and Java source code for an example client program that illustrates the use of the interface.

Candey, Robert M.↗

Diaspora: Resilience-Enabling Services for Real-Time Distributed Workflows

The need for real-time processing to enable automated decision making and experimental steering has driven a shift from high-performance computing workflows on a centralized system to a distributed approach that integrates remote data sources, edge devices, and diverse compute facilities. Under this paradigm, data can be processed close to the source where it is generated, thus reducing latency and bandwidth usage. System resilience is thus a key challenge, requiring distributed workflows to survive component failures and to meet stringent quality-of-service requirements, which results in the need to mitigate anomalies such as congestion and low availability of resources. To address these challenges, we propose Diaspora, a unified resilience framework that is inspired by event-driven communication patterns used in public clouds. Specifically, we propose an event fabric that extends across sites, facilities, and computations to provide timely, reliable, and accurate information about data, application, and resource status. On top of the event fabric, we build resilience-enabling services that combine QoS-aware data streaming, resilient data views, resilient compute and data resources, and anomaly detection and prediction, all of which collectively enhance workflow resilience for these scientific cases.

Rao, Nageswara↗

Utilizing Distributed Heterogeneous Computing with PanDA in ATLAS

In recent years, advanced and complex analysis workflows have gained increasing importance in the ATLAS experiment at CERN, one of the large scientific experiments at LHC. Support for such workflows has allowed users to exploit remote computing resources and service providers distributed worldwide, overcoming limitations on local resources and services. The spectrum of computing options keeps increasing across the Worldwide LHC Computing Grid (WLCG), volunteer computing, high-performance computing, commercial clouds, and emerging service levels like Platform-as-a-Service (PaaS), Container-as-a-Service (CaaS) and Function-as-a-Service (FaaS), each one providing new advantages and constraints. Users can significantly benefit from these providers, but at the same time, it is cumbersome to deal with multiple providers, even in a single analysis workflow with fine-grained requirements coming from their applications’ nature and characteristics. In this paper, we will first highlight issues in geographically-distributed heterogeneous computing, such as the insulation of users from the complexities of dealing with remote providers, smart workload routing, complex resource provisioning, seamless execution of advanced workflows, workflow description, pseudointeractive analysis, and integration of PaaS, CaaS, and FaaS providers. We will also outline solutions developed in ATLAS with the Production and Distributed Analysis (PanDA) system and future challenges for LHC Run4.

97 MATHEMATICS AND COMPUTING↗

Valuation of Distributed Wind Turbines Providing Multiple Market Services

The role of wind turbines has traditionally been limited to providing energy capacity to the grid, but the availability of smart inverters and recent regulatory changes provide the technical and policy capability for wind turbines to also provide ancillary services. However, in contrast to the technical and policy aspects, the valuation of distributed wind turbines providing such services has not been thoroughly studied. This paper presents an optimal market-participation method for distributed wind turbines and valuates different strategies in California Independent System Operator’s balancing area. The services include energy capacity, regulation up and down, and reserves. An optimization problem is formulated to determine optimal power output for each service and demonstrated using historical data for one complete year. The revenues from multiple services are quantified, and a sensitivity analysis is performed to relate market prices with revenues. It is found that the optimal strategy generates 6% more revenue compared to the revenue from participating in the energy market only. Also, the reduced energy prices in future scenarios increase the relative importance of market participation in ancillary services.

Bhatti, Bilal Ahmad↗

Have Heat Waves Become More Intense and Frequent in North America in the Past 40 Years?

Extreme events, especially heat waves, have seemingly become more frequent and intense in the past decades worldwide, likely associated with global warming. This study uses the extreme detection indices product derived from the NASA Modern-Era Retrospective analysis for Research and Applications version 2 (MERRA-2) data to address whether heat waves have become more intense and frequent in North America in the past 40 years. We also examine in-depth the recent heat wave in June 2023 in Canada and the associated drought and wildfire events and compare them with previous years. We use additional data products in this study for cross-validation, including surface temperature from Phase 2 of the North American Land Data Assimilation System (NLDAS 2.0) and Atmospheric Infrared Sounder (AIRS) version 7, with a shorter data latency, only a few days. In addition, we will demonstrate how to efficiently conduct long-term time-series data analysis, which involves a large volume of data, using data services developed at NASA GES DISC, such as Giovanni, datarod, and Thematic Real-time Environmental Distributed Data Services (THREDDS) Data Server (TDS). These services can be used to visualize and explore extreme events, and to download only the data that is of interest.

Xiaohua Pan↗

Large-Scale Adoption of Self Synchronized Universal Droop Controller-Based Inverters to Enable Ancillary Services for Different Modes of Distribution System Operations

This poster presents the results of using the self-synchronized universal droop controller to enable solar power to provide ancillary services so that the use of solar power can be increased. A 300-node system using the IEEE 123 bus test feeder are modeled on a real time power system simulator with the results presented.

Arce, Laura↗

An Interoperable, Agricultural Information System Based on Satellite Remote Sensing Data

Monitoring global agricultural crop conditions during the growing season and estimating potential seasonal production are critically important for market development of US. agricultural products and for global food security. The Goddard Space Flight Center Earth Sciences Data and Information Services Center Distributed Active Archive Center (GES DISC DAAC) is developing an Agricultural Information System (AIS), evolved from an existing TRMM Online Visualization and Analysis System (TOVAS), which will operationally provide satellite remote sensing data products (e.g., rainfall) and services. The data products will include crop condition and yield prediction maps, generated from a crop growth model with satellite data inputs, in collaboration with the USDA Agricultural Research Service. The AIS will enable the remote, interoperable access to distributed data, by using the GrADS-DODS Server (GDS) and by being compliant with Open GIS Consortium standards. Users will be able to download individual files, perform interactive online analysis, as well as receive operational data flows. AIS outputs will be integrated into existing operational decision support systems for global crop monitoring, such as those of the USDA Foreign Agricultural Service and the U.N. World Food Program.

Teng, William↗

Sharing the 620-790 MHz band allocated to terrestrial television with an audio-bandwidth social service satellite system

A study was carried out to identify the optimum uplink and downlink frequencies for audio-bandwidth channels for use by a satellite system distributing social services. The study considered functional-user-need models for five types of social services and identified a general baseline system that is appropriate for most of them. Technical aspects and costs of this system and of the frequency bands that it might use were reviewed, leading to the identification of the 620-790 MHz band as a perferred candidate for both uplink and downlink transmissions for nonmobile applications. The study also led to some ideas as to how to configure the satellite system.

Smith, E. K.↗

A two-stage service restoration method for electric power distribution systems

Improving the reliability of power distribution systems is critically important for both utilities and customers. This calls for an efficient service restoration module within a distribution management system to support the implementation of self-healing smart grid networks. Although the emerging smart grid technologies, including distributed generators (DGs) and remote-controlled switches, enhance the self-healing capability and allow faster recovery, they still pose additional complexity to the service restoration problem, especially under cold load pickup (CLPU) conditions. Herein, a novel two-stage restoration framework is proposed to generate a restoration solutions with a sequence of control actions. The first stage generates a restoration plan that supports both the traditional service restoration using feeder reconfiguration and the grid-forming DG-assisted intentional islanding methods. The second stage generates an optimal sequence of switching operations to bring the outaged system quickly to the final restored configuration. The problem is formulated as a mixed-integer linear program that incorporates system connectivity, operating constraints, and the CLPU models. It is demonstrated that on using a multi-feeder test case, the proposed framework is effective in utilizing all available resources to quickly restore the service and generate an optimal sequence of switching actions to be used by the operator to reach the desired optimal configuration.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Opportunities and Challenges to Capturing Distributed Battery Value via Retail Utility Rates and Programs

Distributed battery deployment is increasing with advanced metering, control, and communication technologies, leaving electric utilities with an under-utilized, flexible grid resource in aggregate. Rates can reflect locational and temporal prices while utility incentive-based programs allow DERs to provide direct grid services. However, utilities must balance accurately reflecting dynamic grid conditions versus simple and feasible design that encourages customer participation. Currently, most rates and incentive-based programs are simple, but as penetration of DER and advanced controls increase, dynamic designs could become prevalent. Utilities could encourage providing multiple services to optimize distributed battery dispatch and value streams, however, challenges persist when stacking services across distribution and bulk systems. A DER committed to multiple discrete services concurrently necessitates coordination between operators and a clear hierarchy of commitments. One way to address this is to separate commitments by time or capacity. For services that follow cyclic, predictable patterns, or those that are peak driven with predictability, an operator could ensure sufficient state of charge for participation, leaving time where a distributed battery could otherwise provide different services by segmenting participation temporally. To provide continuous or unexpected services, a battery operator may use state of charge management to reserve some percentage of the battery and segment participation by capacity. Macroeconomic trends, load patterns, generation profiles, and grid configurations drive variation in value and the subsequent implications for utility offerings and how a customer might participate. As distributed battery adoption increases, both regulators and utilities will need to ensure no adverse grid impacts and encourage provision of societal value beyond the customer domain.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Application of queueing models to multiprogrammed computer systems operating in a time-critical environment

A model of a central processor (CPU) which services background applications in the presence of time critical activity is presented. The CPU is viewed as an M/M/1 queueing system subject to periodic interrupts by deterministic, time critical process. The Laplace transform of the distribution of service times for the background applications is developed. The use of state of the art queueing models for studying the background processing capability of time critical computer systems is discussed and the results of a model validation study which support this application of queueing models are presented.

Eckhardt, D. E., Jr.↗

Advanced communications satellite systems

There is a rapidly growing demand for satellite circuits, particularly for domestic service within the U.S. NASA's current program is aimed at developing the high risk, advanced satellite communications technologies required to significantly increase the capacity of future satellite communications systems. Attention is given to aspects of traffic distribution and service scenario, problems related to effects of rain attenuation, details regarding system configuration, a 30/20 GHz technology development approach, an experimental flight system, the communications payload for the experimental flight system, a typical experiment flight system coverage, and a typical three axis stabilized flight spacecraft.

Sivo, J. N.↗