Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distributed infrastructure”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Model to inform the expansion of hydrogen distribution infrastructure

A growing hydrogen economy requires new hydrogen distribution infrastructure to link geographically distributed hubs of supply and demand. The Hydrogen Optimization with Deployment of Infrastructure (HOwDI) Model helps meet this requirement. The model is a spatially resolved optimization framework that determines location-specific hydrogen production and distribution infrastructure to cost-optimally meet a specified location-based demand. While these results are useful in understanding hydrogen infrastructure development, there is uncertainty in some costs that the model uses for inputs. Thus, the project team took the modeling effort a step further and developed a Monte Carlo methodology to help manage uncertainties. Seven scenarios were run using existing infrastructure and new demand in Texas exploring different policy and tax approaches. The inclusion of tax credits increased the percentage of runs that could deliver hydrogen at <$\$4$ /kg from 31% to 77% and decreased the average dispensed cost from $\$4.35$ /kg to $\$3.55$ /kg. However, even with tax credits there are still some runs where unabated SMR is deployed to meet new demand as the low-carbon production options are not competitive. Every scenario, except for the zero-carbon scenario (without tax credits), resulted in at least 20% of the runs meeting the $\$4$ /kg dispensed fuel cost target. This indicates that multiple pathways exist to deliver $\$4$ /kg hydrogen.

08 HYDROGEN↗
DOE OSTI2021

Final Report for ARPA-E NODES "Real-Time Optimization and Control of Next-Generation Distribution Infrastructure" Project

The project examined next-generation power distribution systems with high levels of power- electronics-interfaced distributed energy resources (DERs) that include: renewable energy systems (RESs), energy-storage devices, electric vehicles, fuel cells, small-scale diesel generators, and controllable loads. The project developed a comprehensive distribution- network management framework that unifies real-time voltage and frequency control with network-wide energy management under an integrated framework. The aim of the project was to: i) systematically optimize network-wide operation and congruently regulate voltages and frequency in the face of high volatility induced by rapidly varying RES and uncontrolled loads; ii) facilitate high renewable integration beyond 50% on an energy basis; iii) meet power-quality requirements and operational constraints; and, iv) respect response, ramp- time, and hold-time requirements for synthetic frequency and regulating reserves via fast- and longer-term dynamic energy management.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Real-Time Optimization and Control of Next-Generation Distribution Infrastructure

This presentation highlights the key developments of the ARAP-e NODES project, including the innovative real-time optimal power flow (RT-OPF) algorithm for distributed energy resource (DER) management, trip planning for T+D coordination, and extensive validation of the RT-OPF algorithm in NREL ESIF laboratory with 100+ physical hardware devices, controller-hardware-in-the-loop test at Southern California Edison (SCE), and two field demonstrations.

hardware-in-the-loop↗
DOE OSTI2024

Modeling Distributed Computing Infrastructures for HEP Applications

Predicting the performance of various infrastructure design options in complex federated infrastructures with computing sites distributed over a wide area network that support a plethora of users and workflows, such as the Worldwide LHC Computing Grid (WLCG), is not trivial. Due to the complexity and size of these infrastructures, it is not feasible to deploy experimental test-beds at large scales merely for the purpose of comparing and evaluating alternate designs. An alternative is to study the behaviours of these systems using simulation. This approach has been used successfully in the past to identify efficient and practical infrastructure designs for High Energy Physics (HEP). A prominent example is the Monarc simulation framework, which was used to study the initial structure of the WLCG. New simulation capabilities are needed to simulate large-scale heterogeneous computing systems with complex networks, data access and caching patterns. A modern tool to simulate HEP workloads that execute on distributed computing infrastructures based on the SimGrid and WRENCH simulation frameworks is outlined. Studies of its accuracy and scalability are presented using HEP as a case-study. Hypothetical adjustments to prevailing computing architectures in HEP are studied providing insights into the dynamics of a part of the WLCG and candidates for improvements.

Horzela, Maximilian↗
DOE OSTI2026

Tachyon: Intelligent Multi-Scale Modeling of Distributed Resilient Infrastructure and Workflows for Data Intensive HEP Analyses

The DOE High Energy Physics (HEP) program in Neutrino and Collider science drives data-intensive science and simulation on extreme-scale platforms. Modeling and optimizing the complex distributed components from experimental to leadership computing facilities are essential for HEP workflows to achieve required response times and resilience under various conditions. Tachyon proposes a framework for scalable modeling, simulation, and validation of key performance characteristics for the distributed infrastructure between FNAL and ALCF, along with associated HEP workflows.

Carothers, Chris [Rensselaer Poly.]↗
DOE OSTI2026

Tachyon: Intelligent Multi-Scale Modeling of Distributed Resilient Infrastructure and Workflows for Data Intensive HEP Analyses

The DOE High Energy Physics (HEP) program in Neutrino and Collider science drives data-intensive science and simulation on extreme-scale platforms. Modeling and optimizing the complex distributed components from experimental to leadership computing facilities are essential for HEP workflows to achieve required response times and resilience under various conditions. Tachyon proposes a framework for scalable modeling, simulation, and validation of key performance characteristics for the distributed infrastructure between FNAL and ALCF, along with associated HEP workflows.

Carothers, Chris [Rensselaer Poly.]↗
NASA NTRS2002

The Computing and Data Grid Approach: Infrastructure for Distributed Science Applications

With the advent of Grids - infrastructure for using and managing widely distributed computing and data resources in the science environment - there is now an opportunity to provide a standard, large-scale, computing, data, instrument, and collaboration environment for science that spans many different projects and provides the required infrastructure and services in a relatively uniform and supportable way. Grid technology has evolved over the past several years to provide the services and infrastructure needed for building 'virtual' systems and organizations. We argue that Grid technology provides an excellent basis for the creation of the integrated environments that can combine the resources needed to support the large- scale science projects located at multiple laboratories and universities. We present some science case studies that indicate that a paradigm shift in the process of science will come about as a result of Grids providing transparent and secure access to advanced and integrated information and technologies infrastructure: powerful computing systems, large-scale data archives, scientific instruments, and collaboration tools. These changes will be in the form of services that can be integrated with the user's work environment, and that enable uniform and highly capable access to these computers, data, and instruments, regardless of the location or exact nature of these resources. These services will integrate transient-use resources like computing systems, scientific instruments, and data caches (e.g., as they are needed to perform a simulation or analyze data from a single experiment); persistent-use resources. such as databases, data catalogues, and archives, and; collaborators, whose involvement will continue for the lifetime of a project or longer. While we largely address large-scale science in this paper, Grids, particularly when combined with Web Services, will address a broad spectrum of science scenarios. both large and small scale.

Johnston, William E.↗
DOE OSTI2020

Real-Time Coupling of Geographically Distributed Research Infrastructures: Taxonomy, Overview, and Real-World Smart Grid Applications

Novel concepts enabling a resilient future power system and their subsequent experimental evaluation are experiencing a steadily growing challenge: large scale complexity and questionable scalability. The requirements on a research infrastructure (RI) to cope with the trends of such a dynamic system therefore grow in size, diversity and costs, making the feasibility of rigorous advancements questionable by a single RI. Analysis of large scale system complexity has been made possible by the real-time coupling of geographically separated RIs undertaking geographically distributed simulations (GDS), the concept of which brings the equipment, models and expertise of independent RIs, in combination, to optimally address the challenge. This article presents the outputs of IEEE PES Task Force on Interfacing Techniques for Simulation Tools towards standardization of GDS as a concept. First, the taxonomy for setups utilized for GDS is established followed by a comprehensive overview of the advancements in real-time couplings reported in literature. The overview encompasses fundamental technological design considerations for GDS. The article further presents four application oriented case studies (real-world implementations) where GDS setups have been utilized, demonstrating their practicality and potential in enabling the analysis of future complex power systems.

distributed laboratories↗
DOE OSTI2022

Advanced Metering Infrastructure for Distribution Planning and Operation: Closing the Loop on Grid-Edge Visibility

In the recent history of electric utilities, the potential to have visibility of the grid edge is gaining significance for the reliable planning and operation of a clean energy smart grid. Before the recent large-scale customer adoption of distributed energy resources (DERs), distribution networks were planned with a simpler fit-and-forget philosophy. The importance of customer-sited DERs to achieve climate change goals marks a major shift for utility operations. Changes to traditional fit-and-forget planning paradigms require better availability of grid-edge data. Smart metering is an enterprise-wide tool that is enabling visibility when and where it has been most needed. As of 2020, the rollout of smart metering, or advanced metering infrastructure (AMI), had reached more than 100 million meters in the United States, and nearly half of all electricity customers are now equipped with a smart meter (Figure 1). Smart meters are quickly becoming a ubiquitous data capture feature of smart grids. AMI enables utilities to record and measure electricity usage and power-flow metrics at a minimum of hourly intervals and at least once a day. At a minimum, AMI enables interval metering, automatic meter reading enabling accurate and time-interval billing, and the ability to provide feedback on customer energy consumption.

advanced metering infrastructure↗
DOE OSTI2020

Distributed heterogeneous compute infrastructure for the study of additive manufacturing systems

We present the current status of a large-scale computing framework to address the need of the multidisciplinary effort to study chemical dynamics. Specifically, we are enabling scientists to process and store experimental data, run large-scale computationally expensive high-fidelity physical simulation, and analyze these results using the state-of-the-art data analytics tools, machine learning, and uncertainty quantification methods using heterogeneous computing resources, such as CPU and GPU cluster. The framework can integrate or abstract out multiple domains based on roles. In order to develop this framework, we have leveraged an existing framework coupled with in-house heterogeneous computing resources. We present the results of using this framework on a single metadata triggered workflow to accelerate an additive manufacturing use case.

heterogeneous computing, hpc, workflows, reproduci↗
DOE OSTI2020

Artificial Intelligence for Natural Gas Utilities: A Primer

Modern natural gas utilities face numerous challenges and competing priorities from various stakeholders. Policymakers, customers, and advocacy groups want to see gas utilities improve performance on safety, reliability, resilience, affordability, and environmental stewardship. State utility regulators — public utility commissions — are responsible for overseeing utility performance, ensuring that ratepayer funds are being spent in the public interest, and aligning utility goals with public goals. The use of new technologies is critical to enabling cost-effective performance on these attributes. Artificial intelligence (AI) is a widely used term among utilities and regulators, but the term means different things to different stakeholders, and it is often used to describe data analytics approaches that fall short of the formal definition of AI, which is: “…the ability of a machine to receive inputs and produce a behavior or reaction similar to that of an intelligent human being.” AI (and related tools, techniques, and technologies) can help utilities solve current and emerging challenges. By combining customer and system data with analytical tools and technologies, AI can augment human decision-makers by assisting in identifying problems and events before they occur, enabling resources to be more efficiently directed across utility infrastructure. The intended primary audience for this primer is state regulators, although utilities and other stakeholders might also find it useful and relevant to improve their awareness of AI. The objectives of this primer are to: (a) offer a set of broadly applicable definitions for AI and related terms, allowing regulators, utilities, and other stakeholders to speak the same language; (b) discuss how AI is currently being implemented in the gas utility sector; and (c) understand the challenges affecting AI solutions and how tools might be implemented in the future. This primer fits within NARUC’s goals of providing impartial information to improve the ability of public utility commissions to regulate in the public interest. As such, this primer does not seek to recommend AI over any other investment, nor does it endorse any particular vendor, product, or approach. It does seek to prepare state regulators to oversee AI investments by sharing information about the current landscape of commercially available tools. To these ends, the primer is organized as follows: Section I discusses the current environment in which natural gas utilities operate and how AI, when thoughtfully designed and implemented, can enable utilities to achieve performance goals; Section II offers definitions of AI and related terms within the data analytics discipline; Section III provides three current opportunities for which AI can offer solutions: replacing aging gas distribution infrastructure, preventing excavator damage to gas distribution infrastructure, and improving energy efficiency programs. This section discusses each problem statement in detail. Second, Section III includes a discussion of how costs and benefits of investments to solve each problem are measured. And third, this section offers real-world examples of utility implementation of AI solutions; Section IV discusses challenges with implementing AI, both from the perspective of utilities and regulators; Section V suggests areas in which AI could feasibly be implemented in the near future; Finally, Section VI offers concluding thoughts and areas for further research.

03 NATURAL GAS↗
DOE OSTI2025

Towards an Introspective Dynamic Model of Globally Distributed Computing Infrastructures

Large-scale scientific collaborations like ATLAS, Belle II, CMS, DUNE, and others involve hundreds of research institutes and thousands of researchers spread across the globe. These experiments generate petabytes of data, with volumes soon expected to reach exabytes. Consequently, there is a growing need for computation, including structured data processing from raw data to consumer-ready derived data, extensive Monte Carlo simulation campaigns, and a wide range of end-user analysis. To manage these computational and storage demands, centralized workflow and data management systems are implemented. However, decisions regarding data placement and payload allocation are often made disjointly and via heuristic means. A significant obstacle in adopting more effective heuristic or AI-driven solutions is the absence of a quick and reliable introspective dynamic model to evaluate and refine alternative approaches. In this study, we aim to develop such an interactive system using real-world data. By examining job execution records from the PanDA workflow management system, we have pinpointed key performance indicators such as queuing time, error rate, and the extent of remote data access. The dataset includes five months of activity. Additionally, we are creating a generative AI model to simulate time series of payloads, which incorporate visible features like category, event count, and submitting group, as well as hidden features like the total computational load—derived from existing PanDA records and computing site capabilities. These hidden features, which are not visible to job allocators, whether heuristic or AI-driven, influence factors such as queuing times and data movement.

kilic, Ozgur Ozan [Brookhaven National Laboratory ↗
DOE OSTI2023

Extending the distributed computing infrastructure of the CMS experiment with HPC resources

Particle accelerators are an important tool to study the fundamental properties of elementary particles. Currently the highest energy accelerator is the LHC at CERN, in Geneva, Switzerland. Each of its four major detectors, such as the CMS detector, produces dozens of Petabytes of data per year to be analyzed by a large international collaboration. The processing is carried out on the Worldwide LHC Computing Grid, that spans over more than 170 compute centers around the world and is used by a number of particle physics experiments. Recently the LHC experiments were encouraged to make increasing use of HPC resources. While Grid resources are homogeneous with respect to the used Grid middleware, HPC installations can be very different in their setup. In order to integrate HPC resources into the highly automatized processing setups of the CMS experiment a number of challenges need to be addressed. For processing, access to primary data and metadata as well as access to the software is required. At Grid sites all this is achieved via a number of services that are provided by each center. However at HPC sites many of these capabilities cannot be easily provided and have to be enabled in the user space or enabled by other means. At HPC centers there are often restrictions regarding network access to remote services, which is again a severe limitation. The paper discusses a number of solutions and recent experiences by the CMS experiment to include HPC resources in processing campaigns.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS2014

Developing an Integration Infrastructure for Distributed Engine Control Technologies

Turbine engine control technology is poised to make the first revolutionary leap forward since the advent of full authority digital engine control in the mid-1980s. This change aims squarely at overcoming the physical constraints that have historically limited control system hardware on aero-engines to a federated architecture. Distributed control architecture allows complex analog interfaces existing between system elements and the control unit to be replaced by standardized digital interfaces. Embedded processing, enabled by high temperature electronics, provides for digitization of signals at the source and network communications resulting in a modular system at the hardware level. While this scheme simplifies the physical integration of the system, its complexity appears in other ways. In fact, integration now becomes a shared responsibility among suppliers and system integrators. While these are the most obvious changes, there are additional concerns about performance, reliability, and failure modes due to distributed architecture that warrant detailed study. This paper describes the development of a new facility intended to address the many challenges of the underlying technologies of distributed control. The facility is capable of performing both simulation and hardware studies ranging from component to system level complexity. Its modular and hierarchical structure allows the user to focus their interaction on specific areas of interest.

distributed control↗
NASA NTRS2022

Distributed Simulation Infrastructure for Researching Implementation of Evolving Concepts in the NAS

The National Airspace System (NAS) is evolving; it is becoming more crowded, and new vehicles with different capabilities are starting to utilize airspace. Increased capacity, new vehicles, and their varying performance and equipage profiles will require changes in how we operate in the NAS. The Crew Systems and Aviation Operations Branch (CSAOB) has actively supported crew systems and aviation research contributing to the safe evolution of the NAS. As the NAS continues to evolve to meet the needs of the nation, CSAOB has the history, infrastructure, and tools to support needed research for the introduction of new technologies and understand their impact on the NAS . This paper describes the software infrastructure and tools supported by CSAOB, lists how the tools have been used in the past, how researchers can integrate into our infrastructure, and how these tools are evolving to support research into the future of the NAS.

Simulation↗