Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distributed services”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Exploiting Kubernetes to Simplify the Deployment and Management of the Multi-purpose CMS Pilot Job Factory

GlideinWMS, a widely utilized workload management system in high-energy physics (HEP) research, serves as the backbone for efficient job provisioning across distributed computing resources. It is utilized by various experiments and organizations, including CMS, OSG, Dune, and FIFE, to create HTCondor pools as large as 600k cores. In particular, a shared factory service historically deployed at UCSD has been configured to interface with more than 500 routes to compute clusters. As part of our team’s initiative to modernize infrastructure and enhance scalability, we undertook the migration of the GlideinWMS factory service into the Kubernetes environment. Leveraging the flexibility and orchestration capabilities of Kubernetes, we successfully deployed the factory service within the OSG Tiger Kubernetes cluster. The major benefits Kubernetes gives us is it streamlines the management and monitoring of the factory infrastructure, and improves fault tolerance through its resilient deployment strategies. Through this case study, we aim to share insights, challenges, and best practices encountered during the migration process. Our experience underscores the benefits of embracing containerization and Kubernetes orchestration for HEP computing infrastructure, paving the way for scalability and resilience in distributed computing environments.

Dost, Jeffrey Michael [UC, San Diego (main)]↗
DOE OSTI2020

Performance Assessments of Demand Flexibility from Grid-Interactive Efficient Buildings: Issues and Considerations

This SEE Action Network report explains basic concepts and fundamental considerations for assessing the actual demand flexibility performance of buildings participating in demand flexibility programs and responding to time-varying retail rates. Demand flexibility is the capability of distributed energy resources (DERs) to adjust a building’s load profile across different timescales. Assessments determine the timing, location, quantity, and quality of grid services provided. The results can be used for financial settlements and to improve performance of demand flexibility, support its consideration in resource potential studies and electricity system planning, and contribute to cost-effectiveness evaluations. While practitioners and regulators regularly find opportunities to improve performance assessments of demand-related services, to a large degree current best practices are sufficient for basic service offerings as demand flexibility is implemented today. However, advances in assessment practices will be required in a future with grid-interactive efficient buildings (GEBs) that provide continuous demand flexibility by integrating multiple DERs and flexibility modes (load shed, load shift, modulate, and generate). Example practices include using new baseline constructs—including whether baselines are even required for certain building flexibility modes or configurations, deploying more advanced metering and analytics, further developing cybersecurity standards, improving communication standards for increased interoperability, and establishing performance metrics and assessment procedures for load modulation as it is more fully defined and implemented. This report provides information on prioritizing and designing performance assessment elements for demand flexibility programs and time-varying retail rates, assessment protocols, and research and development needs. Additional research sponsored by DOE’s Building Technologies Office offers more detailed technical information on assessing performance of demand flexibility, including definition of performance metrics.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Optimizing High-Throughput Inference on Graph Neural Networks at Shared Computing Facilities with the NVIDIA Triton Inference Server

Abstract With machine learning applications now spanning a variety of computational tasks, multi-user shared computing facilities are devoting a rapidly increasing proportion of their resources to such algorithms. Graph neural networks (GNNs), for example, have provided astounding improvements in extracting complex signatures from data and are now widely used in a variety of applications, such as particle jet classification in high energy physics (HEP). However, GNNs also come with an enormous computational penalty that requires the use of GPUs to maintain reasonable throughput. At shared computing facilities, such as those used by physicists at Fermi National Accelerator Laboratory (Fermilab), methodical resource allocation and high throughput at the many-user scale are key to ensuring that resources are being used as efficiently as possible. These facilities, however, primarily provide CPU-only nodes, which proves detrimental to time-to-insight and computational throughput for workflows that include machine learning inference. In this work, we describe how a shared computing facility can use the NVIDIA Triton Inference Server to optimize its resource allocation and computing structure, recovering high throughput while scaling out to multiple users by massively parallelizing their machine learning inference. To demonstrate the effectiveness of this system in a realistic multi-user environment, we use the Fermilab Elastic Analysis Facility augmented with the Triton Inference Server to provide scalable and high-throughput access to a HEP-specific GNN and report on the outcome.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

A Model for Hybrid Systems for Production Cost Modeling Studies Considering Ancillary Services

This paper introduces a model for simulating hybrid plants participating in energy and ancillary services for bulk power system studies. The model considers a hybrid plant comprised of a renewable energy source, a thermal power unit, a storage unit, fixed power loads, or any combination of these technologies. The model focuses on Production Cost Modeling (PCM) studies under the assumption of centralized dispatch. We present an example case study to illustrate the use of the model in a single-stage production cost model similar to those conducted by planning agencies. We explore the allocation of behind-the-meter ancillary services products and total energy participation to hybrid plant sub-assets and the resulting impacts on the system's ancillary service allocation. The model is implemented and simulated in a unit commitment problem in the RTS test system, which was modified to include a hybrid plant asset.

ancillary services↗
DOE OSTI2024

RhizoMAP: a comprehensive, nondestructive, and sensitive platform for metabolic imaging of the rhizosphere

Elucidating the intricate structural organization and spatial gradients of biomolecular composition within the rhizosphere is critical to understanding important biogeochemical processes, which include the mechanisms of root-microbe interactions for maintaining sustainable plant ecosystem services. While various analytical methods have been developed to assess the spatial heterogeneity within the rhizosphere, a comprehensive view of the fine distribution of metabolites within the root-soil interface has remained a significant challenge. This is primarily due to the difficulty of maintaining the original spatial organization during sample preparation without compromising its molecular content.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Facility Cybersecurity Framework Best Practices Version 2.0

Federal facilities are increasingly adopting automation and connecting to the Internet creating an energy-internet-of-things environment that converges operational technology (OT) and information technology (IT). Today's buildings increasingly weave together networked sensors and cyber and physical systems that enable data to be collected, aggregated, exchanged, stored and monetized in new ways. Building technological advances have created new energy technology, services, markets and value creation opportunities (e.g. transactive energy, two-way grid communications, machine learning, and increased use of renewable and distributed energy resources). But as larger data sets are being exchanged at faster speeds between an increasing number of OT systems, it becomes more difficult to protect the security of the data lifecycle and the physical equipment it interacts with. These challenges are especially difficult to overcome because the economic and environmental gain (interoperability, big data, social networks and ubiquitous information sharing) are driving these prominent trends in the digital age. Often cybersecurity is an afterthought.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Facility Cybersecurity Framework Best Practices Version 2.0

Federal facilities are increasingly adopting automation and connecting to the Internet creating an energy-internet-of-things environment that converges operational technology (OT) and information technology (IT). Today's buildings increasingly weave together networked sensors and cyber and physical systems that enable data to be collected, aggregated, exchanged, stored and monetized in new ways. Building technological advances have created new energy technology, services, markets and value creation opportunities (e.g. transactive energy, two-way grid communications, machine learning, and increased use of renewable and distributed energy resources). But as larger data sets are being exchanged at faster speeds between an increasing number of OT systems, it becomes more difficult to protect the security of the data lifecycle and the physical equipment it interacts with. These challenges are especially difficult to overcome because the economic and environmental gain (interoperability, big data, social networks and ubiquitous information sharing) are driving these prominent trends in the digital age. Often cybersecurity is an afterthought.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

Optical Fiber Sensor Technology Development and Field Validation for Distribution Transformer and Other Grid Asset Health Monitoring

Power transformers are critical pieces of infrastructure in the electric grid that are both extremely expensive and difficult to replace. These transformers often have long lead times for replacement, and failures can create long service disruptions. This project has developed a new suite of sensors designed to give early warning of the impending failure of these important power transformers before it is too late and a major failure occurs. By using novel fiber optic sensors instead of conventional existing technologies, we are able to measure transformer characteristics indicative of impending failures in ways that were not previously possible. These new optical fiber-based sensors are completely immune to the strong magnetic fields present in power transformers, as well as being capable of using distributed measurement techniques. Distributed measurement techniques enable the fiber to return information all along its length as opposed to only collecting data at a single point; as would a thermocouple or standard pressure sensor.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Rapidly Viable Sustained Grid

Rapid recovery of power flow, possibly after a blackout, is a crucial need arising in scenarios that are increasingly becoming more frequent; here, solutions for rapid viability of power while the grid is being restored are urgently needed to keep critical infrastructure (CI) online. Increasingly, after the initial recovery phase, sustenance of reliable power requires assistive services to the grid for long periods of time. Even though the need is urgent, there is only sparse effort present toward a comprehensive framework/strategy for making power rapidly viable with an emphasis on sustained grid ancillary services; which is the focus of this proposal. The proposed concept envisions four phases. In the first phase, when a large portion of power is disrupted (see Figure 1(a)), emphasis is on bringing CI online with the objective of maximizing the time horizon of power viability using resources available at the CI. In the second phase (Figure 1(b)), neighborhood resources are tightly coordinated that forms the CI’s central-core (CC) to provide guaranteed viability of CI over a longer horizon. In the third phase, self-organizing power networks are expanded in a distributed layer supporting the central-core (Figure 1(c)). In the fourth phase, separate CI-networks coalesce and are controlled in a coordinated fashion to provide grid ancillary services (AS), such as primary frequency control and enhancing grid resiliency. With time, system efficiencies and penetration of renewables increase, while the time-horizon of guaranteed sustenance of CI is maximized. Under proposed work, the concept will be instantiated with a focus on medical centers as CI. Comprehensive power hardware in the loop strategies and emulated field tests will guide and validate devised solutions. A strong T2M effort to commercialize resulting technology is outlined. The proposed technology will be transformative for the grid. It will fundamentally change the way large contingencies are managed where power systems and critical infrastructure transition from being fragile to being robust using intelligent, self-organizing control for coordinating resources, enhanced resiliency and use of sustainable energy sources.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Grid regulation services for energy storage devices based on grid frequency

Disclosed herein are representative embodiments of methods, apparatus, and systems for charging and discharging an energy storage device connected to an electrical power distribution system. In one exemplary embodiment, a controller monitors electrical characteristics of an electrical power distribution system and provides an output to a bi-directional charger causing the charger to charge or discharge an energy storage device (e.g., a battery in a plug-in hybrid electric vehicle (PHEV)). The controller can help stabilize the electrical power distribution system by increasing the charging rate when there is excess power in the electrical power distribution system (e.g., when the frequency of an AC power grid exceeds an average value), or by discharging power from the energy storage device to stabilize the grid when there is a shortage of power in the electrical power distribution system (e.g., when the frequency of an AC power grid is below an average value).

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Measurements at peak operational beam current in the SNS beam test facility

Work at the SNS beam test facility has focused on high dimensional and high dynamic range measurements of the medium energy (2.5 Mev) beam distribution. This is motivated by the need to understand and predict beam losses down to one-part-per-million. The initial demonstration of full-and-direct 6D phase space measurement was done at a current of 40 mA transported through the RFQ. Since that demonstration, more detailed studies have been performed at lower transported currents (in the range 30 mA and below). This is due to a hardware change - recent runs utilize the original SNS RFQ, which after a decade of service in the SNS achieves transmission significantly below design (50-60%, vs >80%). A short run in 2023 with a newly-commissioned RFQ enables maximum transmission. Preliminary results from beam distribution measurements during this run are discussed.

Ruisard, Kiersten↗
DOE OSTI2022

Transmission-Distribution Dynamic Co-Simulation of Electric Vehicles Providing Grid Frequency Response

This paper investigates the impacts of electric vehicles (EVs) on power system frequency regulation based on an open-source transmission-and-distribution (T&D) dynamic co-simulation framework. The development of a EV dynamic model based on appropriate WECC dynamic model is introduced first, then the T&D dynamic co-simulation platform is described. The advantage of the overall platform is that DERs such as distributed photovoltaic (DPV) and EV are modeled explicitly in both transmission and distribution simulators for frequency dynamics and voltage, respectively. In the case studies, EVs frequency responses (i.e., primary and/or secondary) are simulated after the system is exposed to N-1 contingency such as a generation trip. Various EV frequency regulation participation strategies are investigated as well to study their impacts on system frequency response. The studies shows that EVs have potential capability to provide effective frequency regulation services.

electric vehicle↗
DOE OSTI2021

Improving the Cyber and Physical Security Posture of the Electric Sector (Final Report)

Cooperative electric utilities represent an integral part of the larger electric grid and are part of the nation’s critical infrastructure. The National Rural Electric Cooperative Association (NRECA) has a unique relationship with approximately 900 cooperatively owned and operated electric utilities and engaged in a program with the Department of Energy (DOE) to promote a culture of cybersecurity and resiliency within the electric cooperative community. The Rural Cooperative Cybersecurity Capabilities (RC3) Program, funded under a Cooperative Agreement with DOE (Project DE-OE-0000807), focused on improving the cybersecurity and resiliency capabilities of small and mid-sized electric distribution cooperatives. This segment of electric utilities faces many challenges, but also embraces a culture of cooperation that presents opportunities. A customized approach is needed to reach these utilities – one that emphasizes collaboration, more focused and personalized training, use of trusted and familiar experts that can be deployed as needed, software security services that require limited in-house cybersecurity expertise, and shared resource models that enable access to more expensive cybersecurity options.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Modular HF Isolated MV String Inverters Enable a New Paradigm for Large PV Farms

The “Modular HF Isolated MV String Inverters Enable a New Paradigm for Large PV Farms” project focuses on exploring alternative power converter and system-level plant configurations to achieve the lowest cost and highest energy output for a given solar plus storage (e.g., PV + battery) plant, including the use of medium voltage (MV) collection while taking into account detailed models of all elements. To realize this objective, four approaches were utilized (i) employ a novel Medium Voltage String Inverter (MVSI) topology (soft switching solid state transformer – S4T) to convert 1000 Vdc to 4.16 kVac; (ii) plant collection using standard, low-cost overhead MV distribution network; (iii) enable energy storage integration without additional converter cost to achieve dispatchability of the PV resource; and (iv) provide advanced functionality (autonomous operation, track ISO signals for dynamic balancing and ancillary services, and PV farm operation as a virtual grid resource). Subsequently and in alignment with the previously mentioned approaches, the project was structured in five efforts (i) S4T MVSI simulation and design; (ii) system analysis and storage optimization; (iii) financial analysis; (iv) power converter prototype build and test; and (v) regulatory and commercial impact study. The outcomes provided by each effort can be summarized as follows (i) Project explored the use of MV AC distribution architecture for hybrid PV+storage utility-scale PV farms; (ii) Detailed loss and LCOE analysis for AC and DC side BESS architecture, including multiple converter topologies, as well as for proposed MVSI/MDCT systems; (iii) MVSI was built and holds promise but needs lower-cost high-voltage Si-C devices, which does not seem possible in the near term; (iv) MDCT provides a simpler modular building block – validated through HIL and farm level modeling, simulation and experimental validation; (v) 300 kVA MDCT prototype built and tested, technology is being commercialized; and (vi) Regulatory model of utility building PV plants, where PV panels are treated as DC generation (IPP), seems viable and can allow improved grid integration.

14 SOLAR ENERGY↗