Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distributed infrastructure”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Model to inform the expansion of hydrogen distribution infrastructure

A growing hydrogen economy requires new hydrogen distribution infrastructure to link geographically distributed hubs of supply and demand. The Hydrogen Optimization with Deployment of Infrastructure (HOwDI) Model helps meet this requirement. The model is a spatially resolved optimization framework that determines location-specific hydrogen production and distribution infrastructure to cost-optimally meet a specified location-based demand. While these results are useful in understanding hydrogen infrastructure development, there is uncertainty in some costs that the model uses for inputs. Thus, the project team took the modeling effort a step further and developed a Monte Carlo methodology to help manage uncertainties. Seven scenarios were run using existing infrastructure and new demand in Texas exploring different policy and tax approaches. The inclusion of tax credits increased the percentage of runs that could deliver hydrogen at <$\$4$ /kg from 31% to 77% and decreased the average dispensed cost from $\$4.35$ /kg to $\$3.55$ /kg. However, even with tax credits there are still some runs where unabated SMR is deployed to meet new demand as the low-carbon production options are not competitive. Every scenario, except for the zero-carbon scenario (without tax credits), resulted in at least 20% of the runs meeting the $\$4$ /kg dispensed fuel cost target. This indicates that multiple pathways exist to deliver $\$4$ /kg hydrogen.

08 HYDROGEN↗
DOE OSTI2021

Final Report for ARPA-E NODES "Real-Time Optimization and Control of Next-Generation Distribution Infrastructure" Project

The project examined next-generation power distribution systems with high levels of power- electronics-interfaced distributed energy resources (DERs) that include: renewable energy systems (RESs), energy-storage devices, electric vehicles, fuel cells, small-scale diesel generators, and controllable loads. The project developed a comprehensive distribution- network management framework that unifies real-time voltage and frequency control with network-wide energy management under an integrated framework. The aim of the project was to: i) systematically optimize network-wide operation and congruently regulate voltages and frequency in the face of high volatility induced by rapidly varying RES and uncontrolled loads; ii) facilitate high renewable integration beyond 50% on an energy basis; iii) meet power-quality requirements and operational constraints; and, iv) respect response, ramp- time, and hold-time requirements for synthetic frequency and regulating reserves via fast- and longer-term dynamic energy management.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Real-Time Optimization and Control of Next-Generation Distribution Infrastructure

This presentation highlights the key developments of the ARAP-e NODES project, including the innovative real-time optimal power flow (RT-OPF) algorithm for distributed energy resource (DER) management, trip planning for T+D coordination, and extensive validation of the RT-OPF algorithm in NREL ESIF laboratory with 100+ physical hardware devices, controller-hardware-in-the-loop test at Southern California Edison (SCE), and two field demonstrations.

hardware-in-the-loop↗
DOE OSTI2024

Modeling Distributed Computing Infrastructures for HEP Applications

Predicting the performance of various infrastructure design options in complex federated infrastructures with computing sites distributed over a wide area network that support a plethora of users and workflows, such as the Worldwide LHC Computing Grid (WLCG), is not trivial. Due to the complexity and size of these infrastructures, it is not feasible to deploy experimental test-beds at large scales merely for the purpose of comparing and evaluating alternate designs. An alternative is to study the behaviours of these systems using simulation. This approach has been used successfully in the past to identify efficient and practical infrastructure designs for High Energy Physics (HEP). A prominent example is the Monarc simulation framework, which was used to study the initial structure of the WLCG. New simulation capabilities are needed to simulate large-scale heterogeneous computing systems with complex networks, data access and caching patterns. A modern tool to simulate HEP workloads that execute on distributed computing infrastructures based on the SimGrid and WRENCH simulation frameworks is outlined. Studies of its accuracy and scalability are presented using HEP as a case-study. Hypothetical adjustments to prevailing computing architectures in HEP are studied providing insights into the dynamics of a part of the WLCG and candidates for improvements.

Horzela, Maximilian↗
DOE OSTI2026

Tachyon: Intelligent Multi-Scale Modeling of Distributed Resilient Infrastructure and Workflows for Data Intensive HEP Analyses

The DOE High Energy Physics (HEP) program in Neutrino and Collider science drives data-intensive science and simulation on extreme-scale platforms. Modeling and optimizing the complex distributed components from experimental to leadership computing facilities are essential for HEP workflows to achieve required response times and resilience under various conditions. Tachyon proposes a framework for scalable modeling, simulation, and validation of key performance characteristics for the distributed infrastructure between FNAL and ALCF, along with associated HEP workflows.

Carothers, Chris [Rensselaer Poly.]↗
DOE OSTI2026

Tachyon: Intelligent Multi-Scale Modeling of Distributed Resilient Infrastructure and Workflows for Data Intensive HEP Analyses

The DOE High Energy Physics (HEP) program in Neutrino and Collider science drives data-intensive science and simulation on extreme-scale platforms. Modeling and optimizing the complex distributed components from experimental to leadership computing facilities are essential for HEP workflows to achieve required response times and resilience under various conditions. Tachyon proposes a framework for scalable modeling, simulation, and validation of key performance characteristics for the distributed infrastructure between FNAL and ALCF, along with associated HEP workflows.

Carothers, Chris [Rensselaer Poly.]↗
DOE OSTI2020

Real-Time Coupling of Geographically Distributed Research Infrastructures: Taxonomy, Overview, and Real-World Smart Grid Applications

Novel concepts enabling a resilient future power system and their subsequent experimental evaluation are experiencing a steadily growing challenge: large scale complexity and questionable scalability. The requirements on a research infrastructure (RI) to cope with the trends of such a dynamic system therefore grow in size, diversity and costs, making the feasibility of rigorous advancements questionable by a single RI. Analysis of large scale system complexity has been made possible by the real-time coupling of geographically separated RIs undertaking geographically distributed simulations (GDS), the concept of which brings the equipment, models and expertise of independent RIs, in combination, to optimally address the challenge. This article presents the outputs of IEEE PES Task Force on Interfacing Techniques for Simulation Tools towards standardization of GDS as a concept. First, the taxonomy for setups utilized for GDS is established followed by a comprehensive overview of the advancements in real-time couplings reported in literature. The overview encompasses fundamental technological design considerations for GDS. The article further presents four application oriented case studies (real-world implementations) where GDS setups have been utilized, demonstrating their practicality and potential in enabling the analysis of future complex power systems.

distributed laboratories↗
DOE OSTI2022

Advanced Metering Infrastructure for Distribution Planning and Operation: Closing the Loop on Grid-Edge Visibility

In the recent history of electric utilities, the potential to have visibility of the grid edge is gaining significance for the reliable planning and operation of a clean energy smart grid. Before the recent large-scale customer adoption of distributed energy resources (DERs), distribution networks were planned with a simpler fit-and-forget philosophy. The importance of customer-sited DERs to achieve climate change goals marks a major shift for utility operations. Changes to traditional fit-and-forget planning paradigms require better availability of grid-edge data. Smart metering is an enterprise-wide tool that is enabling visibility when and where it has been most needed. As of 2020, the rollout of smart metering, or advanced metering infrastructure (AMI), had reached more than 100 million meters in the United States, and nearly half of all electricity customers are now equipped with a smart meter (Figure 1). Smart meters are quickly becoming a ubiquitous data capture feature of smart grids. AMI enables utilities to record and measure electricity usage and power-flow metrics at a minimum of hourly intervals and at least once a day. At a minimum, AMI enables interval metering, automatic meter reading enabling accurate and time-interval billing, and the ability to provide feedback on customer energy consumption.

advanced metering infrastructure↗
DOE OSTI2020

Distributed heterogeneous compute infrastructure for the study of additive manufacturing systems

We present the current status of a large-scale computing framework to address the need of the multidisciplinary effort to study chemical dynamics. Specifically, we are enabling scientists to process and store experimental data, run large-scale computationally expensive high-fidelity physical simulation, and analyze these results using the state-of-the-art data analytics tools, machine learning, and uncertainty quantification methods using heterogeneous computing resources, such as CPU and GPU cluster. The framework can integrate or abstract out multiple domains based on roles. In order to develop this framework, we have leveraged an existing framework coupled with in-house heterogeneous computing resources. We present the results of using this framework on a single metadata triggered workflow to accelerate an additive manufacturing use case.

heterogeneous computing, hpc, workflows, reproduci↗
DOE OSTI2020

Artificial Intelligence for Natural Gas Utilities: A Primer

Modern natural gas utilities face numerous challenges and competing priorities from various stakeholders. Policymakers, customers, and advocacy groups want to see gas utilities improve performance on safety, reliability, resilience, affordability, and environmental stewardship. State utility regulators — public utility commissions — are responsible for overseeing utility performance, ensuring that ratepayer funds are being spent in the public interest, and aligning utility goals with public goals. The use of new technologies is critical to enabling cost-effective performance on these attributes. Artificial intelligence (AI) is a widely used term among utilities and regulators, but the term means different things to different stakeholders, and it is often used to describe data analytics approaches that fall short of the formal definition of AI, which is: “…the ability of a machine to receive inputs and produce a behavior or reaction similar to that of an intelligent human being.” AI (and related tools, techniques, and technologies) can help utilities solve current and emerging challenges. By combining customer and system data with analytical tools and technologies, AI can augment human decision-makers by assisting in identifying problems and events before they occur, enabling resources to be more efficiently directed across utility infrastructure. The intended primary audience for this primer is state regulators, although utilities and other stakeholders might also find it useful and relevant to improve their awareness of AI. The objectives of this primer are to: (a) offer a set of broadly applicable definitions for AI and related terms, allowing regulators, utilities, and other stakeholders to speak the same language; (b) discuss how AI is currently being implemented in the gas utility sector; and (c) understand the challenges affecting AI solutions and how tools might be implemented in the future. This primer fits within NARUC’s goals of providing impartial information to improve the ability of public utility commissions to regulate in the public interest. As such, this primer does not seek to recommend AI over any other investment, nor does it endorse any particular vendor, product, or approach. It does seek to prepare state regulators to oversee AI investments by sharing information about the current landscape of commercially available tools. To these ends, the primer is organized as follows: Section I discusses the current environment in which natural gas utilities operate and how AI, when thoughtfully designed and implemented, can enable utilities to achieve performance goals; Section II offers definitions of AI and related terms within the data analytics discipline; Section III provides three current opportunities for which AI can offer solutions: replacing aging gas distribution infrastructure, preventing excavator damage to gas distribution infrastructure, and improving energy efficiency programs. This section discusses each problem statement in detail. Second, Section III includes a discussion of how costs and benefits of investments to solve each problem are measured. And third, this section offers real-world examples of utility implementation of AI solutions; Section IV discusses challenges with implementing AI, both from the perspective of utilities and regulators; Section V suggests areas in which AI could feasibly be implemented in the near future; Finally, Section VI offers concluding thoughts and areas for further research.

03 NATURAL GAS↗
DOE OSTI2025

Towards an Introspective Dynamic Model of Globally Distributed Computing Infrastructures

Large-scale scientific collaborations like ATLAS, Belle II, CMS, DUNE, and others involve hundreds of research institutes and thousands of researchers spread across the globe. These experiments generate petabytes of data, with volumes soon expected to reach exabytes. Consequently, there is a growing need for computation, including structured data processing from raw data to consumer-ready derived data, extensive Monte Carlo simulation campaigns, and a wide range of end-user analysis. To manage these computational and storage demands, centralized workflow and data management systems are implemented. However, decisions regarding data placement and payload allocation are often made disjointly and via heuristic means. A significant obstacle in adopting more effective heuristic or AI-driven solutions is the absence of a quick and reliable introspective dynamic model to evaluate and refine alternative approaches. In this study, we aim to develop such an interactive system using real-world data. By examining job execution records from the PanDA workflow management system, we have pinpointed key performance indicators such as queuing time, error rate, and the extent of remote data access. The dataset includes five months of activity. Additionally, we are creating a generative AI model to simulate time series of payloads, which incorporate visible features like category, event count, and submitting group, as well as hidden features like the total computational load—derived from existing PanDA records and computing site capabilities. These hidden features, which are not visible to job allocators, whether heuristic or AI-driven, influence factors such as queuing times and data movement.

kilic, Ozgur Ozan [Brookhaven National Laboratory ↗
DOE OSTI2023

Extending the distributed computing infrastructure of the CMS experiment with HPC resources

Particle accelerators are an important tool to study the fundamental properties of elementary particles. Currently the highest energy accelerator is the LHC at CERN, in Geneva, Switzerland. Each of its four major detectors, such as the CMS detector, produces dozens of Petabytes of data per year to be analyzed by a large international collaboration. The processing is carried out on the Worldwide LHC Computing Grid, that spans over more than 170 compute centers around the world and is used by a number of particle physics experiments. Recently the LHC experiments were encouraged to make increasing use of HPC resources. While Grid resources are homogeneous with respect to the used Grid middleware, HPC installations can be very different in their setup. In order to integrate HPC resources into the highly automatized processing setups of the CMS experiment a number of challenges need to be addressed. For processing, access to primary data and metadata as well as access to the software is required. At Grid sites all this is achieved via a number of services that are provided by each center. However at HPC sites many of these capabilities cannot be easily provided and have to be enabled in the user space or enabled by other means. At HPC centers there are often restrictions regarding network access to remote services, which is again a severe limitation. The paper discusses a number of solutions and recent experiences by the CMS experiment to include HPC resources in processing campaigns.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Overview of the distributed image processing infrastructure to produce the Legacy Survey of Space and Time

The Vera C. Rubin Observatory is preparing to execute the most ambitious astronomical survey ever attempted, the Legacy Survey of Space and Time (LSST). Currently the final phase of construction is under way in the Chilean Andes, with the Observatory’s ten-year science mission scheduled to begin in 2025. Rubin’s 8.4-meter telescope will nightly scan the southern hemisphere collecting imagery in the wavelength range 320–1050 nm covering the entire observable sky every 4 nights using a 3.2 gigapixel camera, the largest imaging device ever built for astronomy. Automated detection and classification of celestial objects will be performed by sophisticated algorithms on high-resolution images to progressively produce an astronomical catalog eventually composed of 20 billion galaxies and 17 billion stars and their associated physical properties. In this article we present an overview of the system currently being constructed to perform data distribution as well as the annual campaigns which reprocess the entire image dataset collected since the beginning of the survey. These processing campaigns will utilize computing and storage resources provided by three Rubin data facilities (one in the US and two in Europe). Each year a Data Release will be produced and disseminated to science collaborations for use in studies comprising four main science pillars: probing dark matter and dark energy, taking inventory of solar system objects, exploring the transient optical sky and mapping the Milky Way. Also presented is the method by which we leverage some of the common tools and best practices used for management of large-scale distributed data processing projects in the high energy physics and astronomy communities. We also demonstrate how these tools and practices are utilized within the Rubin project in order to overcome the specific challenges faced by the Observatory.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Methods and Experiences for Developing Abstractions for Data-intensive, Scientific Applications

Developing software for scientific applications that require the integration of diverse types of computing, instruments, and data present challenges that are distinct from commercial software. These applications require scale, and the need to integrate various programming and computational models with evolving and heterogeneous infrastructure. Pervasive and effective abstractions for distributed infrastructures are thus critical; however, the process of developing abstractions for scientific applications and infrastructures is not well understood. While theory-based approaches for system development are suited for well-defined, closed environments, they have severe limitations for designing abstractions for scientific systems and applications. The design science research (DSR) method provides the basis for designing practical systems that can handle real-world complexities at all levels. In contrast to theory-centric approaches, DSR emphasizes both practical relevance and knowledge creation by building and rigorously evaluating all artifacts. In this work, we show how DSR provides a well-defined framework for developing abstractions and middleware systems for distributed systems. Specifically, we address the critical problem of distributed resource management on heterogeneous infrastructure over a dynamic range of scales, a challenge that currently limits many scientific applications. We use the pilot-abstraction, a widely used resource management abstraction for high-performance, high throughput, big data, and streaming applications, as a case study for evaluating the DSR activities. For this purpose, we analyze the research process and artifacts produced during the design and evaluation of the pilot-abstraction. We find DSR provides a concise framework for iteratively designing and evaluating systems. Finally, we capture our experiences and formulate different lessons learned.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Quantifying the Protectability of Power Systems for Restoration Applications

With the increasing availability of distributed energy resources, controllable switches, and advanced metering infrastructure, distribution systems are exploring opportunities for improving system reliability through fault location, isolation, and service restoration. During permanent outages, this requires islanding microgrids and/or reconfiguration of the feeders; however, it is critical to assess the protection of the islanded/reconfigured networks before transition because the rated load and fault current conditions change. This paper presents a novel “protectability” metric that quantifies the protection performance and allows the operators to compare the effectiveness of the protection between two or more possible reconfiguration and islanding approaches. We present the mathematical formulation and assumptions for the metric. Multiple configurations of the Electric Power Research Institute J1 feeder, both in grid-connected and weak-sourced islanded operation, are used to demonstrate the performance of the metric with reference to overcurrent protection. Takeaways for future studies on system planning integration are provided.

distributed energy resources↗
DOE OSTI2021

Integrated Models for Electrical Distribution Network Planning and District-Scale Building Energy Use

The increase of greenhouse emissions caused by a rise in global energy consumption is pushing the scientific community to develop tools that address key environmental, techno-economic and social issues. One specific area of focus is to create tools that enable the design of high-performance energy districts, including grid-interactive efficient buildings and electrical distribution infrastructure. This paper outlines the approach of integrating a synthetic distribution network tool (RNM-US) with URBANopt™, a modular and customizable software development kit for thermal and electrical modelling of buildings and energy systems at a district scale. First, we describe the algorithms implemented to integrate RNM-US with URBANopt to automatically generate the distribution network for the district considered. Following, we present a case study for the potential uses of the RNM-US integrations with URBANopt, highlighting the capabilities for economic and technical analysis of the distribution network built in relation to the electricity needs of the modelled buildings.

30 DIRECT ENERGY CONVERSION↗