Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Distribution Service”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Multi-modal Energy-optimal Trip Scheduling in Real-time (METS-R) for Transportation Hubs (Final Report)

This report summarizes the work performed under the award number EE0008524. The project develops the Multi-modal Energy-optimal Trip Scheduling in Real-time (METS-R) platform as the next-generation transportation solution based on autonomous electric vehicles (AEV) serving passenger trips from and to urban transportation hubs, to substantially reduce transportation energy consumption. Extensive data collection and analyses were first conducted to understand the demand patterns and energy consumption of hub-based on-road trips. Then, a data-driven framework that consists of an analytical module and a simulation module was proposed. For the analytical module, five planning + operation tools were developed to support the planning and energy-efficient operations of urban AEV services: the charging station planning that robotically allocates charging supplies based on the stationary charging demand distribution; the transit planning and demand adaptive scheduling model that efficiently generates\ candidate transit routes from hubs to other places and dynamically adjusts the transit time table to fit the current demand; the online energy-efficient routing that learns the energy-optimal paths from observations of link-level energy consumption in real-time; the hub-based ridesharing that matches trip requests together with account for the uncertainty of future trip demand and vehicle supply; and finally, the integrated demand prediction and anomaly detection pipeline that leverages the flight/train time table and support other planning/operation tools. To demonstrate the performance of these tools, a scalable high-performance agent-based simulator was built. We divided the urban space into multiple service zones where each zone was considered as an agent for passenger generation and vehicle charging. Two types of AEV agents were coded to model two types of mobility services: AEV taxi and AEV transit. For the AEV taxi, the team implemented the functions of pickup/drop-off passengers, energy-efficient routing, ridesharing, fleet rebalancing, and recharging. For the AEV bus, the team implemented the functions of demand-adaptive route scheduling, passenger boarding, and recharging. A high-performance computing framework was introduced to receive various profiling information (such as link energy updates, vehicle speed) from the simulator instances and communicate the operational commands back to the instances. The numerical experiments show that each of the proposed operational algorithms can reduce energy consumption and improve system efficiency. Furthermore, there exists the need to collectively consider multiple planning + operational strategies as multiple strategies can influence each other in terms of performance impacts. Recommendations for future work related to AEV planning and simulation are discussed.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Can artificial intelligence and data-driven machine learning models match or even replace process-driven hydrologic models for streamflow simulation?: A case study of four watersheds with different hydro-climatic regions across the CONUS

With recent developments in computational techniques, Data-driven Machine Learning Models (DMLs) have shown great potential in simulating streamflow and capturing the rainfall-runoff relationship in given watersheds, which are traditionally fulfilled by Process-based Hydrologic Models (PHMs). There are debates on whether the DMLs can outperform and possibly replace the classical PHMs for streamflow simulation and river forecasting, but no clear conclusions have been made. This study aims to investigate whether the newer DMLs have any potential in further improving the simulation accuracy of classical PHMs, and vice versa. To do this, we compared a few popular PHMs and DMLs over four watersheds across the Continental US (CONUS) that are associated with different input, climate, and regional conditions. A total of five hydrologic models were chosen, including (1) two classical lumped models, i.e., the Sacramento Soil Moisture Accounting (SAC-SMA) and Xinanjiang (XAJ); (2) one modern distributed model, termed Coupled Routing and Excess Storage (CREST); (3) and two DMLs including an Artificial Neural Networks (ANN) and a deep learning model, termed Long Short Term Memory (LSTM). Our results demonstrated that the DMLs still significantly biased when using the baseline input scenario with the PHMs. However, the DMLs fed with delayed input scenarios had great potential and can reach high simulation accuracy. The DMLs, especially the ANN, outperformed other employed models under the rainfall-runoff relationship in which rainfall dominantly drives. Furthermore, the DMLs also showed better performance in the high-flow regime, while the PHMs had a better performance for the low-flow regime, implying both PHMs and DMLs have their own merits and are worthy of joint development. In general, our study indicated a great potential of using DMLs to simulate streamflow, but further studies are still needed to verify the transferability and scalability of DMLs in large-scale experiments, such as the Distributed Model Intercomparison Projects 1&2 conducted by National Weather Services but to compare modern DMLs and PHMs.

58 GEOSCIENCES↗

Interconnection Assessment Methodology and Cost Benefit Analysis for High-Penetration PV Deployment in the Arizona Public Service System

In an effort to better understand the impacts of high penetrations of photovoltaic (PV) generators on distribution systems, Arizona Public Service and its partners completed a multi-year project to develop the tools and knowledge base needed to safely and reliably integrate high penetrations of utility- and residential-scale PV. Building upon the APS Community Power Project-Flagstaff Pilot, this project investigates the impact of PV on a representative feeder in northeast Flagstaff. To quantify and catalog the effects of the estimated 1.3 MW of PV that will be installed on the feeder (both smaller units at homes and large, centrally located systems), high-speed weather and electrical data acquisition systems and digital 'smart' meters were designed and installed to facilitate monitoring and to build and validate comprehensive, high-resolution models of the distribution system. These models are being developed to analyze the impacts of PV on distribution circuit protection systems (including coordination and anti-islanding), predict voltage regulation and phase balance issues, and develop volt/VAr control schemes. This paper continues from a paper presented at the 2014 IEEE PVSC conference that described feeder model evaluation and high penetration advanced scenario analysis, specifically feeder reconfiguration. This paper presents results from Phase 5 of the project. Specifically, the paper discusses tool automation; interconnection assessment methodology and cost benefit analysis.

14 SOLAR ENERGY↗

The Use of Proxy Caches for File Access in a Multi-Tier Grid Environment

The use of proxy caches has been extensively studied in the HEP environment for efficient access of database data and showed significant performance with only very moderate operational effort at higher grid tiers (T2, T3). In this contribution we propose to apply the same concept to the area of file access and analyze the possible performance gains, operational impact on site services and applicability to different HEP use cases. Base on a proof-of-concept studies with a modified XROOT proxy server we review the cache efficiency and overheads for access patterns of typical ROOT based analysis programs. We conclude with a discussion of the potential role of this new component at the different tiers of a distributed computing grid.

99 GENERAL AND MISCELLANEOUS↗

ParaText : scalable text modeling and analysis.

Automated processing, modeling, and analysis of unstructured text (news documents, web content, journal articles, etc.) is a key task in many data analysis and decision making applications. As data sizes grow, scalability is essential for deep analysis. In many cases, documents are modeled as term or feature vectors and latent semantic analysis (LSA) is used to model latent, or hidden, relationships between documents and terms appearing in those documents. LSA supplies conceptual organization and analysis of document collections by modeling high-dimension feature vectors in many fewer dimensions. While past work on the scalability of LSA modeling has focused on the SVD, the goal of our work is to investigate the use of distributed memory architectures for the entire text analysis process, from data ingestion to semantic modeling and analysis. ParaText is a set of software components for distributed processing, modeling, and analysis of unstructured text. The ParaText source code is available under a BSD license, as an integral part of the Titan toolkit. ParaText components are chained-together into data-parallel pipelines that are replicated across processes on distributed-memory architectures. Individual components can be replaced or rewired to explore different computational strategies and implement new functionality. ParaText functionality can be embedded in applications on any platform using the native C++ API, Python, or Java. The ParaText MPI Process provides a 'generic' text analysis pipeline in a command-line executable that can be used for many serial and parallel analysis tasks. ParaText can also be deployed as a web service accessible via a RESTful (HTTP) API. In the web service configuration, any client can access the functionality provided by ParaText using commodity protocols ... from standard web browsers to custom clients written in any language.

99 GENERAL AND MISCELLANEOUS↗

Residual service life of carbonated structures based on site non-destructive tests

Assessing the residual service life of carbonated reinforced concrete structures is typically conducted by measuring cover depths and carbonation of drilled cores, assuming the ''square root law'' for the progress of the carbonation front. Given the large spatial variability of carbonation depths, the required number of cores becomes prohibitive. A model is presented, based on numerous experimental data, by which the carbonation rate can be estimated by means of non-destructive site measurements of the air-permeability kT. A Weibull distribution of the carbonation rate K{sub c} is fitted to the results, which is a function of kT. Hence, for each kT value measured on site coupled with the cover depth x{sub d}, expected, optimistic and pessimistic values of the corrosion initiation time can be obtained without the need of drilling cores. The method is validated on 111 paired results of kT and x{sub d}, obtained on the emblematic Tokyo's Museum of Western Art.

36 MATERIALS SCIENCE↗

Distributed computing strategies for processing of FT-ICR MS imaging datasets for continuous mode data visualization

High-resolution Fourier transform ion cyclotron resonance (FT-ICR) mass spectrometry imaging enables the spatial mapping and identification of biomolecules from complex surfaces. The need for long time-domain transients, and thus large raw file sizes, results in a large amount of raw data (“big data”) that must be processed efficiently and rapidly. This can be compounded by largearea imaging and/or high spatial resolution imaging. For FT-ICR, data processing and data reduction must not compromise the high mass resolution afforded by the mass spectrometer. The continuous mode “Mosaic Datacube” approach allows high mass resolution visualization (0.001 Da) of mass spectrometry imaging data, but requires additional processing as compared to featurebased processing. We describe the use of distributed computing for processing of FT-ICR MS imaging datasets with generation of continuous mode Mosaic Datacubes for high mass resolution visualization. An eight-fold improvement in processing time is demonstrated using a Dutch nationally available cloud service.

Environmental Molecular Sciences Laboratory↗

SourceFinder: a Machine-Learning-Based Tool for Identification of Chromosomal, Plasmid, and Bacteriophage Sequences from Assemblies

High-throughput genome sequencing technologies enable the investigation of complex genetic interactions, including the horizontal gene transfer of plasmids and bacteriophages. However, identifying these elements from assembled reads remains challenging due to genome sequence plasticity and the difficulty in assembling complete sequences. In this study, we developed a classifier, using random forest, to identify whether sequences originated from bacterial chromosomes, plasmids, or bacteriophages. The classifier was trained on a diverse collection of 23,211 chromosomal, plasmid, and bacteriophage sequences from hundreds of bacterial species. In order to adapt the classifier to incomplete sequences, each complete sequence was subsampled into 5,000 nucleotide fragments and further subdivided into k-mers. This three-class classifier succeeded in identifying chromosomes, plasmids, and bacteriophages using k-mer distributions of complete and partial genome sequences, including simulated metagenomic scaffolds with minimum performance of 0.939 area under the receiver operating characteristic curve (AUC). This classifier, implemented as SourceFinder, has been made available as an online web service to help the community with predicting the chromosomal, plasmid, and bacteriophage sources of assembled bacterial sequence data (https://cge.food.dtu.dk/services/SourceFinder/).

59 BASIC BIOLOGICAL SCIENCES↗

National Geothermal Data System: Interactive Assessment of Geothermal Energy Potential in the U.S.

Geothermal-relevant geosciences data from all 50 states (www.stategeothermaldata.org), federal agencies, national labs, and academic centers are being digitized and linked in a distributed online network via the U.S. Department of Energy-funded National Geothermal Data System (NGDS) to foster geothermal energy exploration and development through use of interactive online ‘mashups,’data integration, and applications. Emphasis is first to make as much information as possible accessible online, with a long range goal to make data interoperable through standardized services and interchange formats. An initial set of thirty geoscience data content models is in use or under development to define a standardized interchange format: aqueous chemistry, borehole temperature data, direct use feature, drill stem test, earthquake hypocenter, fault feature, geologic contact feature, geologic unit feature, thermal/hot spring description, metadata, quaternary fault, volcanic vent description, well header feature, borehole lithology log, crustal stress, gravity, heat flow/temperature gradient, permeability, and feature descriptions data like developed geothermal systems, geologic unit geothermal properties, permeability, production data, rock alteration description, rock chemistry, and thermal conductivity. Map services are also being developed for isopach maps, aquifer temperature maps, and several states are working on geothermal resource overview maps. Content models are developed preferentially from existing community use in order to encourage widespread adoption and promulgate minimum metadata quality standards. Geoscience data and maps from other NGDS participating institutions, or “nodes” (USGS, Southern Methodist University, Boise State University Geothermal Data Coalition) are being supplemented with extensive land management and land use resources from the Western Regional Partnership (15 federal agencies and 5 Western states) to provide access to a comprehensive, holistic set of data critical to geothermal energy development. As of September 2011, we have over 34,000 records registered in the system catalog, and 234,942 data resources online, along with scores of Web services to deliver integrated data to the desktop for free downloading or online use. The data exchange mechanism is built on the U.S. Geoscience Information Network (USGIN, http://usgin.org and http://lab.usgin.org) protocols and standards developed as a partnership of the Association of American State Geologists (AASG) and U.S. Geological Survey.

15 GEOTHERMAL ENERGY↗

Customizable Scale-Out Key-Value Stores

Enterprise KV stores are often not well suited for HPC applications, and thus cumbersome end-to-end KV design customization is required to meet the needs of modern HPC applications. To this end, in this article we present bespoKV, an adaptive, extensible, and scale-out KV store framework. bespoKV decouples the KV store design into the control plane for distributed management and the data plane for local data store. For the control plane, bespoKVprovides pre-built modules, called controlets, supporting common distributed functionalities (e.g., replication, consistency, and topology) and their various combinations. This decoupling allows bespoKV to take a user-provided single-server KV store, called a datalet, and transparently enables a scalable and fault-tolerant distributed KV store service. The resulting distributed stores are also adaptive to consistency or topology requirement changes and can be easily extended for new types of services. Such specializations enable innovative uses of KV stores in HPC applications, especially for emerging applications that utilize KV-friendly workloads. We evaluate bespoKV in a local testbed as well as in a public cloud settings. Experiments show that bespoKV-enabled distributed KV stores scale horizontally to a large number of nodes, and performs comparably and sometimes 1.2× to 2.6× better than the state-of-the-art systems.

97 MATHEMATICS AND COMPUTING↗

Evaluation of Aggregated EV Flexibility With TSO-DSO Coordination

Electric vehicles (EVs) are becoming a promising source of grid ancillary services due to the temporal and spatial charging flexibility, quick response and storage capability. Such advantages are increasing with government policy promotion and technology improvement. However, the exploration of EV flexibility requires the coordination of both transmission system operators (TSOs) and distribution system operators (DSOs), to ensure the safe and reliable operation of power network. In this paper, we propose a coordinated evaluation method that determines the optimal utilization of EV temporal flexibility without compromising EV owners’ usage. At the distribution level, DSOs first evaluate EV aggregators’ operational boundaries to exploit distribution level services. At the transmission level, TSOs then determine EV charging schedules and ancillary service capacity simultaneously, taking into account the requirement from DSOs. Here, we validate the model in a case study using the IEEE 123 node test feeder and EV charging sessions obtained from a transportation simulation tool that uses real-world data.

33 ADVANCED PROPULSION SYSTEMS↗

Empirical Assessment of the Appliance-Level Load Shape and Demand Response Potential in India

Over the next 15 years, electricity demand from the key residential and commercial appliances is projected to be nearly 300 GW or ~65% of India’s total peak demand. The objective of this study is to characterize appliance level demand and temporal variation, and identify the overall DR potential in India. We use Bangalore Electricity Supply Company territory (peak load of 3,505 MW in 2016) as a case study, using actual one-minute resolution load data for 2,979 distribution feeders and a detailed load survey. Our results show that agricultural pumping and space cooling (residential, commercial, and industrial) are the main contributors to the peak demand – with shares of 23-27% and 14-23%, respectively. Both sectors have about 1,000 MW of DR potential – agricultural pumps offering load shifting service while space cooling offering shimmy service that is capable of dynamically adjusting to react to short-run ramps and grid disturbances. Residential electric water heaters contribute nearly 18% of the winter morning peak demand and can also offer about 500 MW in shimmy service. Overall, we find that shifting and shimmy services offer 1,199 MW and 1,511 MW total DR potential, respectively.

demand response↗

A Review of Value of Solar Studies In Theory and In Practice

This brief summarizes a collection of state- and utility-commissioned value-of-solar (VoS) studies and related literature, with a focus on who commissioned the study, which value and cost categories were discussed and/or quantified, and the methods used. Our objective is to compile information on prior VoS studies to inform state regulators and other stakeholders that may pursue related studies or integrate findings into rate design. The brief is organized into three parts: 1) an introduction to distributed solar photovoltaic (DPV) compensation; 2) a review of theoretical research on VoS; and 3) a review of VoS studies. The vast majority of VoS studies have served an informational role of quantifying the net benefits of PV. Three studies were commissioned in states or utility service territories that subsequently implemented VoS tariffs in California, New York, and Austin, Texas. When applied as a tariff, VoS aims to compensate PV output as efficiently as possible by doing so at rates that reflect the marginal benefits and costs of PV through value and cost categories that may vary temporally and/or geographically. This could lead to higher compensation in locations and times where more PV output is more valuable and consequently drive adoption in those locations to provide more societal benefits. Value and cost factors can be broadly grouped into five categories: generation, transmission, distribution, other utility, and other social categories. Those conducting VoS studies must weigh various tradeoffs when deciding which categories to include and quantify. Tradeoffs include prioritizing values based on their magnitude of value or cost impact, as well as taking into account the feasibility of data collection and accurate quantification. Values of higher magnitude and estimation feasibility are quantified in the majority of studies, including the earliest of studies conducted in the 2000s and 2010s. Additionally, some values of higher magnitude but low feasibility in the earliest of studies have become quantifiable in recent years. There are some values with low average system-wide levels but very high magnitude in specific locations or hours. The value magnitude in some cases can be tied to DPV penetration with low value in areas with little congestion and/or low penetration and vice versa. In these cases, values that are easier to quantify are often incorporated, while those that are more difficult are often addressed via a placeholder value. The placeholder value is paired with a discussion around data needs and methods to improve future estimates, as well as a conversation about when these value categories may increase in magnitude and necessitate more rigorous quantification. This brief summarizes findings from two meta-analyses of VoS studies that took place between 2005 and 2018, as well as findings from four additional studies published from 2018 to 2023. Table ES-1 summarizes the various value and cost categories included in each respective study and whether they were quantified, discussed, or omitted. Values such as avoided energy, capacity, transmission capacity, line losses, and avoided environmental costs are quantified in every study. Some categories were deemed harder to quantify and less impactful at the time of the study, so they were discussed but not quantified (e.g., ancillary services). Other categories, including many at the distribution level, were very locationally and/or temporally specific and dependent on high DPV penetration. These were sometimes quantified and at other times discussed. Notably, when it came to utility costs, integration costs were discussed in all cases, though they were deemed to have a small impact. Other utility costs were omitted for the most part; however, the utility-commissioned study (by NorthWestern Energy in Montana) included both lost utility revenue and programmatic/administrative cost categories. While there are some similarities across studies, each had fairly unique methods that are detailed in the body of this brief.

14 SOLAR ENERGY↗

A Physical Model Enhanced Data Driven Method for High-Resolution Residential Load Profile Generation

Residential buildings account for significant energy consumption, creating opportunities to offer grid services. As electric utilities seek to implement effective system operation strategies, understanding residential energy consumption patterns becomes essential; However, the time intervals of load profiles measured by utilities' smart meters are typically from 15 minutes to 60 minutes. The low-resolution data make it hard to extract appliance-level load information, which is critical for providing grid services. This paper presents a load profile generator designed to produce synthetic load profiles for residential buildings that emphasizes the importance of accurate representations of realistic energy consumption patterns. The generator takes realistic low-resolution residential load measurements and weather data as inputs, producing 1-minute interval profiles that match the characteristics of the original profiles. Further, this generator can be used to populate load profiles in areas where actual measurements are limited to improve the ability of utilities to analyze their distribution systems. By providing more high-resolution residential building load profiles, this tool supports electric utilities to enhance their residential building load control strategies and improve overall grid stability.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

High-Penetration PV Deployment in the Arizona Public Service System, Phase 1 Update: Preprint

In an effort to better understand the impacts of high penetrations of photovoltaic generators on distribution systems, Arizona Public Service and its partners have begun work on a multi-year project to develop the tools and knowledge base needed to safely and reliably integrate high penetrations of utility- and residential-scale photovoltaics (PV). Building upon the APS Community Power Project --Flagstaff Pilot, this project will analyze the impact of PV on a representative feeder in northeast Flagstaff. To quantify and catalog the effects of the estimated 1.3 MW of PV that will be installed on the feeder (both smaller units at homes as well as large, centrally located systems), high-speed weather and electrical data acquisition systems and digital 'smart' meters are being designed andinstalled to facilitate monitoring and to build and validate comprehensive, high-resolution models of the distribution system. These models will be used to analyze the impacts of the PV on distribution circuit protection systems (including anti-islanding), predict voltage regulation and phase balance issues, and develop volt/var control schemes. This paper continues from a paper presented at the2011 IEEE PVSC conference that introduces the project and describes some of the preliminary consideration, as well as project plans and early results. This paper gives a status update of the project and presents selected results from Phase 2 of the project. It discusses baseline feeder modeling, load allocation, data acquisition, utility-scale PV integration, preliminary model validation, andplans for future phases.

14 SOLAR ENERGY↗

Autonomous Anomaly Detection for MPC Forecasts of HVAC Systems in Residential Communities

The use of residential heating, ventilation, and air conditioning (HVAC) to shift peak demand or provide ancillary services is a potential solution in the presence of older grids and distributed renewables. However, to ensure the efficient use of devices, utilities need to accurately forecast the load and adopt error correction schemes when necessary. While significant theoretical research exists in the area of predictive control of HVAC, little experimental evidence exists. The lack of experimental data in turn causes researchers to be unprepared for unsystematic errors which emerge due to the higher complexity of the data generating process. This study offers an anomaly detection methodology that uses unsupervised machine learning algorithms to detect and isolate these errors with different forecast error ranges. The results of anomaly detection procedure can then be used for error correction and would eventually help develop better predictive controllers. The methodology is tested using real world data from a smart neighborhood that currently operates in Atlanta. GA.

Lebakula, Viswadeep↗

Resilient Entanglement Distribution in a Multihop Quantum Network

The evolution of quantum networking requires architectures capable of dynamically reconfigurable entanglement distribution to meet diverse user needs and ensure tolerance against transmission disruptions. We introduce multihop quantum networks to improve network reach and resilience by enabling quantum communications across intermediate nodes, thus broadening network connectivity and increasing scalability. We present multihop two-qubit polarization-entanglement distribution within a quantum network at the Oak Ridge National Laboratory campus. Our system uses wavelength-selective switches for adaptive bandwidth management on a software-defined quantum network that integrates a quantum data plane with classical data and control planes, creating a flexible, reconfigurable mesh. Our network distributes entanglement across six nodes within three subnetworks, each located in a separate building, optimizing quantum state fidelity and transmission rate through adaptive resource management. Additionally, we demonstrate the network's resilience by implementing a link recovery approach that monitors and reroutes quantum resources to maintain service continuity despite link failures—paving the way for scalable and reliable quantum networking infrastructures.

Alshowkan, Muneer [Oak Ridge National Laboratory (↗

Coal-by-Rail: A Business-as-Usual Reference Case

As proposed carbon emission standards reduce domestic coal use, the role of coal in the U.S. energy mix may be expected to decline. If such a decline were to occur, how would it affect rail traffic? Today, coal represents a major share of rail tonnage and gross revenue. While growth in other traffic—most notably, crude oil—may offset some of any potential decline in coal shipments, would it be sufficient? This paper explores trends in coal production volumes and use, rail tonnage and revenue, and the distribution of traffic origins and destinations in order to consider the impact of potential changes in future coal traffic. Rather than modeling discrete flows, it draws on historical data and forecasts maintained by the U.S. Department of Energy’s Energy Information Administration (EIA), industry studies and analyses, and background knowledge of the rail industry, specific routes and service territories, and commodity-level traffic volumes.

01 COAL, LIGNITE, AND PEAT↗