Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distributed services”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,045 records · Page 58

Short-Term Forecasting of Thermostatic and Residential Loads Using Long Short-Term Memory Recurrent Neural Networks

Internet of Things (IoT) devices in smart grids enable intelligent energy management for grid managers and personalized energy services for consumers. Investigating a smart grid with IoT devices requires a simulation framework with IoT devices modeling. However, there lack comprehensive study on the modeling of IoT devices in smart grids. This paper investigates the IoT device modeling of a thermostatic load and implements the recurrent neural networks model for short-term load forecasting in this IoT-based thermostatic load. The recurrent neural network structure is leveraged to build a load forecasting model on temporal correlation. The temporal recurrent neural network layers including long short-term memory cells are employed to learn the data from both the simulation platform and New South Wales residential datasets. The simulation results are provided for demonstration.

electric load forecasting↗

Heterogeneous Multi-Domain Dataset Synthesis to Facilitate Privacy and Risk Assessments in Smart City IoT

The emergence of the Smart Cities paradigm and the rapid expansion and integration of Internet of Things (IoT) technologies within this context have created unprecedented opportunities for high-resolution behavioral analytics, urban optimization, and context-aware services. However, this same proliferation intensifies privacy risks, particularly those arising from cross-modal data linkage across heterogeneous sensing platforms. To address these challenges, this paper introduces a comprehensive, statistically grounded framework for generating synthetic, multimodal IoT datasets tailored to Smart City research. The framework produces behaviorally plausible synthetic data suitable for preliminary privacy risk assessment and as a benchmark for future re-identification studies, as well as for evaluating algorithms in mobility modeling, urban informatics, and privacy-enhancing technologies. As part of our approach, we formalize probabilistic methods for synthesizing three heterogeneous and operationally relevant data streams—cellular mobility traces, payment terminal transaction logs, and Smart Retail nutrition records—capturing the behaviors of a large number of synthetically generated urban residents over a 12-week period. The framework integrates spatially explicit merchant selection using K-Dimensional (KD)-tree nearest-neighbor algorithms, temporally correlated anchor-based mobility simulation reflective of daily urban rhythms, and dietary-constraint filtering to preserve ecological validity in consumption patterns. In total, the system generates approximately 116 million mobility pings, 5.4 million transactions, and 1.9 million itemized purchases, yielding a reproducible benchmark for evaluating multimodal analytics, privacy-preserving computation, and secure IoT data-sharing protocols. To show the validity of this dataset, the underlying distributions of these residents were successfully validated against reported distributions in published research. We present preliminary uniqueness and cross-modal linkage indicators; comprehensive re-identification benchmarking against specific attack algorithms is planned as future work. This framework can be easily adapted to various scenarios of interest in Smart Cities and other IoT applications. By aligning methodological rigor with the operational needs of Smart City ecosystems, this work fills critical gaps in synthetic data generation for privacy-sensitive domains, including intelligent transportation systems, urban health informatics, and next-generation digital commerce infrastructures.

IoT↗

Measuring Societal Infrastructure Service Burden

Social Infrastructure Service Burden (abbr. Social Burden) is defined as the burden to a population for attaining services needed from infrastructure. Infrastructure services represent opportunities to acquire things that people need, such as food, water, healthcare, financial services, etc. Accessing services requires effort, disruption to schedules, expenditure of money, etc. Social Burden represents the relative hardship people experience in the process of acquiring needed services. Social Burden is comprised of several components. One component is the effort associated with travel to a facility that provides a needed service. Another component of burden is the financial impact of acquiring resources once at the providing location. We are applying Social Burden as a resilience metric by quantifying it following a major disruption to infrastructure. Specifically, we are most interested in quantifying this metric for events in which energy systems are a major component of the disruption. We do not believe this is the only such use of the Social Burden metric, and therefore we will also be exploring its use to describe blue-sky conditions of a society in the future. Furthermore, while the construct can be applied to a dynamically changing situation, we are applying it statically, directly following a disruption. This notably ignores recovery dynamics that are a key capability of resilient systems. This too will be explored in future research.

24 POWER TRANSMISSION AND DISTRIBUTION↗

SPRUCE FT-ICR MS, Bulk Chemistry, and Mass Loss from Litter Decomposition Study in Experimental Plots, Marcell Experimental Forest, Minnesota, 2015-2017

This dataset contains molecular, bulk chemical, and mass loss measurements from a litter decomposition study at the Spruce and Peatland Responses Under Changing Environments (SPRUCE) experimental site within the Marcell Experimental Forest in northern Minnesota, USA. This site is in a Sphagnum spp. ombrotrophic bog forest. Litterbags were deployed into the peat in September 2015 across three warming levels (+0, +4.5, and +9°C) under ambient and elevated carbon dioxide (CO₂ - +500 ppm) and retrieved after roughly 0.5, 1, and 2 years of field incubation (2015-09-23 to 2017-08-02). Litterbags containing six peatland litter types: black spruce needles (Picea mariana - SPL), spruce fine roots (SPR), Sphagnum angustifolium (ANG), Sphagnum magellanicum (MAG), Labrador tea leaves (Rhododendron groenlandicum - LTL), and Labrador tea roots (LTR). Molecular composition of water-soluble organic matter extracts was characterized using Fourier Transform Ion Cyclotron Resonance Mass Spectrometry (FT-ICR MS) at 9.4 Tesla, operated in negative ion mode with electrospray ionization, providing molecular formula assignments and compound-class distributions across the decomposition time series. Bulk chemical characterization included elemental analysis (percent carbon, nitrogen, and phosphorus) and Fourier Transform Infrared Spectroscopy (FTIR) to quantify functional group composition. Litter mass loss was tracked gravimetrically at each retrieval interval, expressed as percent mass remaining relative to initial dry mass for each litter type and treatment combination. These data are valuable for understanding how vegetation shifts driven by increased atmospheric CO2 and temperature in peatlands alter litter inputs and organic matter stabilization trajectories, with implications for projecting and modeling peatland carbon cycling. This dataset contains two data files in comma-separated value (.csv) format. Additional metadata are provided: two data dictionaries and a file-level metadata file in comma separate (.csv) format and a user guide in PDF (*.pdf) format.

decomposition↗

IRES Microgrid Energy Integration Report Version 1.0

This report presents technical information and guidance for the planned Integrated Renewable Energy System (IRES) microgrid project. This deployment of the microgrid and its associated assets was initiated in the beginning of 2022 at the Marine and Coastal Research Laboratory (MCRL) facility of Pacific Northwest National Laboratory (PNNL)-Sequim, Washington. The information in the report is organized under two main focus areas: electrical power interface, or interconnection, information of planned IRES assets; and communication and control interface, or interoperability, information of the planned IRES assets. The information will provide technical input for the development of the IRES microgrid controller technical specification, and also provide input for PNNL’s evaluation of adequacy of the electrical service infrastructure at MCRL to support the IRES project and help identify any gaps that will require facility-based upgrades. From an R&D aspect, this study and report will build on PNNL’s research and development work relating to energy storage (ES) codes and standards (C&Ss), including hybrid systems, performed on behalf of the Department of Energy (DOE) Office of Electricity (OE) ES. The current state of C&Ss for advanced technologies and their application, including microgrid-based technology is limited. For cases where formal standards issued by recognized Standards Developing Organizations do not yet exist, guidance is provided based on emerging best practices, including industry-group references that can be leveraged for microgrid technology which is in its early stages of development and use.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Prototype Integrated Hydrogen Fuel Cell Powered Data Center (Cooperative Research and Development Final Report)

Data centers are the backbone of the modern economy-from the server rooms that power small- to medium-sized organizations, to the enterprise-class data centers that support American corporations, and the server farms that run cloud computing services. Rather than a traditional grid-centric data center approach, work under the CRADA will be directed towards implementing a proof-of-concept "hydrogen-based" data center utilizing hydrogen fuel cells, electrolyzers, and solar photovoltaics as key building blocks. This integrated proof-of-concept builds on preliminary work done by HPE and its partners Mercedes-Benz Research & Development North America, Inc. (MBRDNA) and Power Innovations, to dramatically simplify the electrical infrastructure in the data center, leverage the latest automotive-scale hydrogen fuel cell technologies, and tightly couple renewably generated DC power directly to the Information Technology (IT). While some limited aspects of this concept have been demonstrated previously the entire integrated proof of concept proposed here has not yet been realized.

08 HYDROGEN↗

Forecasting for the Weather Driven Energy System - A New Task under IEA Wind

The energy system needs a range of forecast types for its operation in addition to the narrow wind power forecast that has been the focus of considerable recent attention. Therefore, the group behind the former IEA Wind Task 36 Forecasting for Wind Energy has initiated a new IEA Wind Task with a much broader perspective, which includes prospective interaction with other IEA Technology Collaboration Programmes such as the ones for PV, hydropower, system integration, hydrogen etc. In the new IEA Wind Task 51 (entitled "Foreacsting for the Weather Drive Energy System") the existing Work Packages (WPs) are complemented by work streams in a matrix structure. The Task is divided in three WPs according to the stakeholders: WP1 is mainly aimed at meteorologists, providing the weather forecast basis for the power forecasts. In WP2, the forecast service vendors are the main stakeholders, while the end users populate WP3. The new Task 51 started in January 2022. Planned activities include 4 workshops. The first will focus on the state of the art in forecasting for the energy system plus related research issues and be held during September 2022 in Dublin. The other three workshops will be held later during the 4-year Task period and address (1) seasonal forecasting with emphasis on Dunkelflaute, storage and hydro, (2) minute-scale forecasting, and (3) extreme power system events. The issues and conclusions of each of the workshops will be documented by a published paper. Additionally, the Recommended Practice on Forecast Solution Selection will be updated to reflect the broader perspective.

geophysics computing↗

Multiple elements of soil biodiversity drive ecosystem functions across biomes

The role of soil biodiversity in regulating multiple ecosystem functions is poorly understood, limiting our ability to predict how soil biodiversity loss might affect human wellbeing and ecosystem sustainability. Furthermore, combining a global observational study with an experimental microcosm study, we provide evidence that soil biodiversity (bacteria, fungi, protists and invertebrates) is significantly and positively associated with multiple ecosystem functions. These functions include nutrient cycling, decomposition, plant production, and reduced potential for pathogenicity and belowground biological warfare. Our findings also reveal the context dependency of such relationships and the importance of the connectedness, biodiversity and nature of the globally distributed dominant phylotypes within the soil network in maintaining multiple functions. Moreover, our results suggest that the positive association between plant diversity and multifunctionality across biomes is indirectly driven by soil biodiversity. Together, our results provide insights into the importance of soil biodiversity for maintaining soil functionality locally and across biomes, as well as providing strong support for the inclusion of soil biodiversity in conservation and management programmes.

54 ENVIRONMENTAL SCIENCES↗

Cooperative Load Scheduling for Multiple Aggregators Using Hierarchical ADMM

Demand response (DR) serves an important role in improving the efficiency and stability of power systems. In recent years, with advances in communication and smart device technologies, many aggregators have emerged to facilitate end customer participation in DR programs. These aggregators, equipped with customized optimal control algorithms, are capable of providing various grid services. Among them is load scheduling during DR events, namely following a load signal provided by the utility company while minimizing overall customer discomfort. However, as the number of aggregators keeps increasing, it becomes challenging for utility companies to conduct load scheduling for multiple aggregators and generate reference signals for each of them. This paper proposes an optimization framework using hierarchical alternating direction method of multipliers (H-ADMM) to optimally generate load following signals for multiple aggregators. Under this framework, utility and multiple aggregators work in a cooperative manner, aiming at minimizing an overall system cost from different levels of the power system hierarchy, while protecting user privacy. A case study has been conducted in a system with multiple aggregators, based on control of HVAC loads. Experimental results validate the effectiveness of the proposed algorithm.

ADMM↗

Offering of Variable Resources in Regulation Markets with Performance Targets: An Analysis

To date, wind and solar power plants have mainly provided energy. Going forward, with the application of appropriate controls, they can offer additional grid services, such as regulating reserves. Additional grid services can present an opportunity for additional value streams to wind and solar power plants. However, the additional value might not be realized when operator-determined performance targets and settlement adjustments for the delivery of regulation capacity are disregarded. Additionally, this article studies the participation of variable resources in centralized regulation markets. We derive analytical results for regulation offers in terms of quantity and price considering that a variable resource does not want to risk being disqualified as a regulation provider, incurring losses, or foregoing more profitable opportunities. Our analysis suggests that U.S. operator-determined performance targets impose an upper bound on the quantity of a variable resource’s regulation offer; and settlement adjustments for the delivery of regulation affect the price at which variable resources offer and the calculations of opportunity costs in case of imperfect regulation delivery.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Utah FORGE: Well 16B(78)-32 DTS, RFS DSS Strain, and Absolute Strain Circulation Test Fiber Optic Data - August 2024

This dataset contains processed fiber optic measurements collected during the extended cross-well circulation test at the Utah FORGE site in August 2024. The data was acquired from the 16B(78)-32 well using distributed fiber optic sensing (DFOS) technology, including distributed temperature sensing (DTS) on multimode fiber and distributed strain sensing (DSS) measurements on single-mode fiber. The dataset includes Brillouin absolute strain, Rayleigh frequency shift (RFS) DSS strain change, RFS DSS strain change rate, and temperature (DTS) data, all stored in HDF5 format. Time coordinates are provided in UTC, and depth measurements are given in measured depth relative to the rotary kelly bushing (MD RKB) in feet. The spatial sampling on the RFS DSS strain data and the Brillouin Absolute Total Strain data is 20 cm and the spatial sampling on the DTS data is 1m. The dataset is accompanied by a report from Neubrex, which provides further documentation.

15 GEOTHERMAL ENERGY↗

Integrating a Microgrid Controller with a Local OpenADR Server

When military microgrids isolate themselves from the main electrical grid, they must locally balance electricity supply and demand. Since local generation may be limited, the current strategy is to shed all but the most critical loads by tripping smart circuit breakers, which must then be reset manually (e.g., ESTCP project EW-201350). This strategy is typically applied at the building level, meaning that entire buildings housing mission critical activities must be excluded from any load management, while those considered non-critical may lose service entirely. The remotely controlled switchgear needed to manage load in this way is very expensive ($\$30,000$-$\$50,000$ per building). While effective at shedding load, this strategy disrupts installation operation and risks damaging equipment during both disconnection and re-energization. With the goals of lowering costs, protecting equipment, and enhancing the agility of DoD microgrids, this report demonstrates the use of cybersecure automated demand response (ADR) technology to manage microgrid loads during grid-independent (a.k.a. "islanded") operation. This automated approach achieves load shedding and shifting through communication signals sent to equipment controllers rather than by cutting off the flow of electricity within the microgrid itself. Because it operates only on the base network, with no connection to external entities, this strategy avoids the main cybersecurity concern raised by past applications of ADR on military bases.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A Unified Testing Platform to Mature Blockchain Applications for Grid Emulation Environments

Blockchain technology is a relatively novel technology that can be used to develop more decentralized, autonomous and tamper-evident solutions. A feature that can aid Transactive Energy Systems to reach their goals by enabling individual actors to communicate and reach consensus with other participants in a more decentralized fashion. However, technical barriers to evaluate and adopt this type of technology within the electrical domain still exist. To facilitate this task, BLOSEM Unified Testing Platform (UTP), a DOE-sponsored, multi-lab effort intends to accelerate the development of solutions by offering a common set of reusable services that can be used to interconnect existent grid tools with blockchain services. UTP is intended to serve as development platform that can provide application engineers with the technical means to evaluate potential blockchain solutions, by enabling them to concentrate on the actual application functionalities while at the same time abstracting the connectivity and performance measurement tasks. The use of BLOSEM UTP is further demonstrated by implementing two potential use cases that are intended to validate both the feasibility of implementing these applications as blockchain-based solutions while also demonstrating the features provided by UTP.

blockchain co-simulation↗

Proactive Data Containers for Scientific Storage (Final Report)

Emerging HPC systems are expected to be deployed with an unprecedented level of complexity, due to a deep system memory/storage hierarchy and heterogeneity of the storage hardware. This hierarchy is expected to range from CPU cache through several levels of volatile memory to nonvolatile memory, traditional hard disks, and tape. Simple and efficient methods of data management and movement through this hierarchy is critical for scientific applications using exascale systems. Existing storage system and I/O (SSIO) technologies face severe challenges in dealing with these requirements. POSIX and MPI I/O standards that are the basis for existing I/O libraries and parallel file systems present fundamental challenges in the areas of scalable metadata operations, semantics-based data movement performance tuning, asynchronous operation, and support for scalable consistency of distributed operations. Moving toward new paradigms for SSIO in the extreme-scale era, we have proposed to investigate novel object-based data abstractions and storage mechanisms that take advantage of the deep storage hierarchy and enable proactive automated performance tuning. In order to achieve these overarching goals, we initiated an effort to develop a fundamental new data abstraction, called Proactive Data Containers (PDC). A PDC is a container within a locus of storage (memory, NVRAM, disk, etc.) that stores science data in an object-centric manner. Managing data as objects enables powerful optimization opportunities for data movement and transformations. The R&D focus of this project are: 1) formulation of object-oriented PDCs and their mapping in different levels of the exascale storage hierarchy; 2) efficient strategies for moving data in deep storage hierarchies using PDCs; 3) techniques for transforming and reorganizing data based on application requirements; and 4) novel analysis paradigms for enabling data transformations and user-defined analysis on data in PDCs. Toward achieving these overarching goals, we designed an object-centric application programing interface (API) for HPC, scalable metadata management for object-centric storage systems, and data movement optimizations such as Data Elevator for moving data between two levels of storage devices and TAPIOCA for efficient aggregation of data on compute nodes. We then implemented several components of the PDC system. They include metadata management, data placement services, remote procedure calls, data aggregation, etc. We have put them together into the overall PDC framework.

97 MATHEMATICS AND COMPUTING↗

Connecting Risk and Resilience for a Power System Using the Portland Hills Fault Case Study

Active seismic faults in the Pacific Northwest area have encouraged electric utilities in the region to deeply contemplate and proactively intervene to support grid resilience. To further this effort this research introduces Monte Carlo (MC)-based power system modeling as a means to inform the Performance Based Earthquake Engineering method and simulates 100,000 sample earthquakes of a 6.8 magnitude (M6.8) Portland Hills Fault (PHF) scenario in the Portland General Electric (PGE) service territory as a proof of concept. This paper also proposes the resilience metric Seismic Load Recovery Factor (SLRF) to quantify the recovery of a downed power system and thus can be used to quantify earthquake economic risk. Using MC results, the SLRF was evaluated to be 19.7 h and the expected economic consequence cost of a M6.8 PHF event was found to be $\$180$ million with an annualized risk of $\$90,000$ given the event’s 1 in 2000 year probability of occurrence. The MC results also identified the eight most consequential substations in the PGE system—i.e., those that contributed to maximum load loss. This paper concludes that retrofitting these substations reduced the expected consequence cost of a M6.8 PHF event to $117 million.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Performance Evaluation of Vertical Federated Machine Learning Against Adversarial Threats on Wide-Area Control System: Preprint

Federated machine learning (FL) is gaining significant popularity to develop cybersecurity solutions in power grids because of its advanced capability to support decentralized data handing at local devices, its privacy preservation, and its low-bandwidth requirement. However, the evolving adversarial machine learning (AML) threats raise significant concerns for the cybersecurity of FL architectures. The FL-based split neural network (SplitNN) achieves high performance through the decentralized training of local neural network models while preserving data privacy across multiple entities. In this paper, we propose a methodology for evaluating the performance of a vertical FLbased anomaly detector against different types of AML attacks, including denial-of-service attacks, adversarial data injection attacks, and replay attacks on the trained local models deployed in the grid network. For a case study, we consider the modified IEEE 13-bus system, and we develop SplitNN-based binary and multiclass classification models to detect, locate, and identify different types of data integrity attacks on the volt-watt control with two pooling layers: maximum pooling and AvgPool. Our experimental results, computed through performance metrics, reveal that the severity of these AML attacks varies with the integrated pooling mechanism, the type of classification model, and the nature of the cyberattack. Further, the AML attacks negatively impacted the prediction time per sample for the pretrained SplitNN during the online testing.

adversarial threats↗

User Manual - HydraGNN v5.0: Distributed Implementation of Multi-Tasking Graph Neural Networks

This document serves as the user manual for HydraGNN v5.0, a scalable graph neural network (GNN) architecture for simultaneous prediction of multiple target properties using multi-task learning (MTL). This version of HydraGNN has been developed primarily to support the development, training, and deployment of predictive graph-based deep learning (DL) models for atomistic materials modeling. HydraGNN is templated over 13 message-passing policies, including invariant models (GIN, PNA, PNAPlus, GAT, MFC, CGCNN, SAGE, SchNet, DimeNet) and equivariant models (EGNN, PNAEq, PAINN, MACE), and supports distributed training via distributed data parallelism (DDP), DeepSpeed, and Fully Sharded Data Parallelism (FSDP) on leadership-class supercomputers. Although HydraGNN can be applied to problems beyond atomistic materials modeling, its current use is confined to homogeneous graphs. Additional capabilities include machine-learned interatomic potentials with energy-conserving forces, General, Powerful, and Scalable Graph Transformer (GraphGPS) global attention, periodic boundary conditions, hyperparameter optimization, mixed-precision training, and uncertainty quantification.

97 MATHEMATICS AND COMPUTING↗

Development of Self-Assembly Supports Enabling Transformational Membrane Performance for Cost-Effective Carbon Capture

This final technical report describes work conducted by Membrane Technology and Research, Inc. (MTR) for the U.S. Department of Energy (DOE), National Energy Technology Lab (NETL) on the development of membranes with transformational performance for carbon capture under award number DE-FE0031596. The work was performed from June 1, 2018 through May 31, 2024. For more than a decade, MTR has worked in partnership with DOE to develop an innovative membrane-based CO 2 capture process. This effort has included the first test of membrane modules with coal-fired flue gas at the Arizona Public Services (APS) Cholla plant in 2010; the accumulation of >11,000 hours of flue gas operation for Polaris modules on a bench-scale 1 tonne/day (TPD) system at the National Carbon Capture Center (NCCC); scale-up of first-generation (Gen-1) Polaris to a 20 TPD small pilot system, and successful operation of this system on a flue gas slipstream at NCCC and in integrated boiler testing at Babcock & Wilcox (B&W). Through continued development efforts, a second-generation (Gen-2) version of the Polaris membrane has been scaled-up to pilot production. This membrane offers 70% higher CO 2 permeance with similar selectivity to the base case Polaris. MTR also developed planar modules designed specifically for the low-pressure, high-volumetric flow rate process conditions of flue gas operation. These new modules have significantly lower pressure-drop values compared to the type originally used (spiral-wound modules), which results in significant energy savings. The goal of the work described in this report was to improve on the Polaris Gen-2 membrane with the ultimate aim to reduce the cost of carbon capture. The majority of the effort was to develop improved support membranes for the multi-layer composite structure of MTR’s Polaris membrane. Earlier work at MTR had identified the support structure as limiting membrane permeances, not because the support itself represents a permeation resistance, but because the distribution of pores at the surface of the support imposes a geometric restriction to diffusion in the layers above it. Support membranes were prepared from a range of polymers, including commercially available block copolymers and a custom synthesized block copolymer alternative. The best support membranes developed in this project reduced the geometric restriction by a factor of two to three. These supports then were used to produce Polaris composite membranes with improved permeances. The second topic was to create a high-selectivity version of the Polaris membrane. The high-selectivity version uses a novel selective polymeric material and high selectivities were confirmed in experiments at MTR. The material is not easily made into very thin films. Consequently, the permeances are significantly lower than the Polaris Gen-2 membrane. The utility of this membrane is therefore limited to the carbon dioxide purification step that produces liquid CO 2 . A Technical and Economic Analysis (TEA) was performed for a carbon capture system that uses both advanced membrane types. The TEA shows the novel advanced membranes reduce the cost of capture by 10%, from $63.32/tonne CO 2 to $56.90/tonne CO 2 (2022 USD). Most of the development work was carried out with laboratory-scale casting and coating equipment. A number, but not all, of the improvements identified have been implemented on commercial-scale manufacturing equipment. The focus of future work at MTR is to incorporate the advancements made into the Polaris membrane manufacturing process.

01 COAL, LIGNITE, AND PEAT↗