Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data services”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32

Operation of the Australian Store.Synchrotron for macromolecular crystallography

The Store.Synchrotron service, a fully functional, cloud computing-based solution to raw X-ray data archiving and dissemination at the Australian Synchrotron, is described. The Store.Synchrotron service, a fully functional, cloud computing-based solution to raw X-ray data archiving and dissemination at the Australian Synchrotron, is described. The service automatically receives and archives raw diffraction data, related metadata and preliminary results of automated data-processing workflows. Data are able to be shared with collaborators and opened to the public. In the nine months since its deployment in August 2013, the service has handled over 22.4 TB of raw data (∼1.7 million diffraction images). Several real examples from the Australian crystallographic community are described that illustrate the advantages of the approach, which include real-time online data access and fully redundant, secure storage. Discoveries in biological sciences increasingly require multidisciplinary approaches. With this in mind, Store.Synchrotron has been developed as a component within a greater service that can combine data from other instruments at the Australian Synchrotron, as well as instruments at the Australian neutron source ANSTO. It is therefore envisaged that this will serve as a model implementation of raw data archiving and dissemination within the structural biology research community.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

AASG Wells Data for the EGS Test Site Planning and Analysis Task

Temperature measurement data obtained from boreholes for the Association of American State Geologists (AASG) geothermal data project. Typically bottomhole temperatures are recorded from log headers, and this information is provided through a borehole temperature observation service for each state. Service includes header records, well logs, temperature measurements, and other information for each borehole. Information presented in Geothermal Prospector was derived from data aggregated from the borehole temperature observations for all states. For each observation, the given well location was recorded and the best available well identifier (name), temperature and depth were chosen. The "Well Name Source," "Temp. Type" and "Depth Type" attributes indicate the field used from the original service. This data was then cleaned and converted to consistent units. The accuracy of the observation's location, name, temperature or depth was note assessed beyond that originally provided by the service. Bottom hole temperature datasets from the AASG were downloaded from repository.usgin.org between May 16 and May 24, 2013. The data were cleaned to remove null and non-real entries, and units were standardized across all datasets. When selecting key attributes, specific criteria were used to determine the best available values. For temperature, corrected temperature was preferred, followed by measured temperature. For depth, depth of measurement was prioritized, with true vertical depth and driller total depth used as alternatives. Well identification was assigned based on the API number when available, followed by the well name, with the observation URI used as a last option.

15 GEOTHERMAL ENERGY↗

SQL and NoSQL Databases for Cyber Physical Production Systems in Internet of Things for Manufacturing (IoTfM)

Abstract In this paper, the design and performance differences between Relational Database Management Systems (RDBMS) and NoSQL Database Systems are examined, with attention to their applicability for real-world Internet of Things for manufacturing (IoTfM) data. While previous work has extensively compared SQL and NoSQL for both generalized and IoT uses, this work specifically examines the tradeoffs and performance differences for manufacturing applications by using a high-fidelity data set collected from a large US manufacturing firm. Growing an IoT system beyond the pilot stage requires scalable data storage; this work seeks to determine the impact of selected database systems on data write performance at scale. Payload size and message frequency were used as the primary characteristics to maintain model fidelity in simulated clients. As the number of simulated asset clients grow, the data write latency was calculated to determine how both database systems’ performance were affected. To isolate the RDBMS and NoSQL differences, a cloud environment was created using Amazon Web Services (AWS) with two identical data ingestion pipelines: writing data to an RDMBS (1) using AWS Aurora MySQL, and (2) using AWS DynamoDB NoSQL. The findings may provide guidance for further experimentation in large-scale manufacturing IoT implementations.

Gamero, David↗

Development of an end state vision to implement digital monitoring in nuclear plants

Transitioning from an onsite Maintenance & Diagnostics Center to cloud-based services offers many new opportunities with computing power and storage, but also new challenges in terms of networking and security. This report will cover everything required for that transition including data processing and uploading to cloud services, feature selection, model creation, and result visualization for decision making. Although there are several other cloud-based services (e.g. Amazon Web Services and Google Cloud), this report explores Microsoft Azure to simplify nomenclature and maintain a consistent focus. Many of the services offered by Microsoft Azure are also available in the other cloud-based services, and their differences have been recorded in other literature. The Azure services most important to a nuclear power plant including networking & security, storage & databases, and Artificial Intelligence (AI) are reviewed here. Networking covers all aspects related to communication to Azure resources including security, privacy, and redundancy. Storage & databases includes data storage, upgrading, patching, backups, and monitoring. The AI services allows the user access to the machine learning (ML) techniques developed with Azure including automated ML, anomaly detection, computer vision, and natural language processing. This report summaries the features, capabilities, and challenges when using cloud-based services in a user-friendly manner.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Weather and Flight Arrival Data

This dataset includes externalities: weather, number of arrival flights, and day of the week. Weather data are collected from the National Weather Service’s NY-Central Park Area record, and flight arrival data are collected from the Bureau of Transportation Statistics.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

JANUS: Resilient and Adaptive Data Transmission for Enabling Timely and Efficient Cross-Facility Scientific Workflows

In modern science, the growing complexity of large-scale scientific projects has led to an increasing reliance on cross-facility scientific workflows, where resources and expertise from multiple institutions and geographic locations are leveraged to accelerate scientific discovery. These workflows often require transmitting huge amounts of scientific data through wide-area networks. Although high-speed networks like ESnet and transfer services such as Globus have improved data mobility, several challenges remain. The sheer volume of data can overwhelm network bandwidth, widely used transport protocols such as TCP suffer from inefficiencies due to retransmissions triggered by packet loss, and existing fault-tolerance mechanisms like erasure coding introduce substantial overhead. In this paper, we propose Janus, a resilient and adaptable data transmission approach designed for cross-facility scientific workflows. Unlike traditional TCP-based methods, Janus leverages UDP, integrates erasure coding for fault tolerance, and combines it with error-bounded lossy compression to reduce overhead. This novel design allows users to balance data transmission time and accuracy, optimizing transfer performance based on specific scientific requirements. Additionally, Janus dynamically adjusts erasure coding parameters in response to real-time network conditions, ensuring efficient data transfers even in fluctuating environments. We develop optimization models for determining ideal configurations and implement adaptive data transfer protocols to enhance reliability. Through extensive simulations and real-network experiments, we demonstrate that Janus significantly improves transfer efficiency while maintaining data fidelity.

Esaulov, Vladislav [Georgia State University, Atla↗

EAGLE-I County Customer Dataset Fall 2025

This dataset provides a combination of modeled and collected county-level electric customer counts derived from 2023 EIA-861 utility customer data, 2021 HIFLD electric retail service territory boundaries, 2021 LandScan population estimates, and 2025 EAGLE-I customer outages. The dataset details county FIPS code, number of customers, and customer type (modeled, collected, mixed). Outage data in included for all 50 U.S. states, Puerto Rico, and the District of Columbia (excluding other U.S. territories).

24 POWER TRANSMISSION AND DISTRIBUTION↗

Editorial [Special issue on software defined networks and infrastructures, network function virtualisation, autonomous systems and network management]

For last few years, there has been a tremendous growth in data traffic due to high adoption rate of mobile devices and cloud computing. Internet of things (IoT) will stimulate even further growth. This is increasing scale and complexity of telecom/internet service provider (SP) and enterprise data centre (DC) compute and network infrastructures. As a result, managing these large network-compute converged infrastructures is becoming complex and cumbersome. To cope up, network and DC operators are trying to automate network and system operations, administrations and management (OAM) functions. OAM includes all non-functional mechanisms which keep the network running.

97 MATHEMATICS AND COMPUTING↗

A spark‐based big data analysis framework for real‐time sentiment prediction on streaming data

Summary There are many data sources that produce large volumes of data. The Big Data nature requires new distributed processing approaches to extract the valuable information. Real‐time sentiment analysis is one of the most demanding research areas that requires powerful Big Data analytics tools such as Spark. Prior literature survey work has shown that, though there are many conventional sentiment analysis researches, there are only few works realizing sentiment analysis in real time. One major point that affects the quality of real‐time sentiment analysis is the confidence of the generated data. In more clear terms, it is a valuable research question to determine whether the owner that generates sentiment is genuine or not. Since data generated by fake personalities may decrease accuracy of the outcome, a smart/intelligent service that can identify the source of data is one of the key points in the analysis. In this context, we include a fake account detection service to the proposed framework. Both sentiment analysis and fake account detection systems are trained and tested using Naïve Bayes model from Apache Spark's machine learning library. The developed system consists of four integrated software components, ie, (i) machine learning and streaming service for sentiment prediction, (ii) a Twitter streaming service to retrieve tweets, (iii) a Twitter fake account detection service to assess the owner of the retrieved tweet, and (iv) a real‐time reporting and dashboard component to visualize the results of sentiment analysis. The sentiment classification performances of the system for offline and real‐time modes are 86.77% and 80.93%, respectively.

Kılınç, Deniz↗

DOE Hanford Network Upgrades and Disaster Recovery Exercise Support the Cleanup Mission Now and into the Future

In 2013, the U.S. Department of Energy's (DOE) Hanford Site, located in Washington State, funded an update to the critical network infrastructure supporting the Hanford Federal Cloud (HFC). The project, called ET-50, was the final step in a plan that was initiated five years ago called "Hanford's IT Vision, 2015 and Beyond." The ET-50 project upgraded Hanford's core data center switches and routers along with a majority of the distribution layer switches. The upgrades allowed HFC the network intelligence to provide Hanford with a more reliable and resilient network architecture. The culmination of the five year plan improved network intelligence and high performance computing as well as helped to provide 10 Gbps capable links between core backbone devices (10 times the previous bandwidth). These improvements allow Hanford the ability to further support bandwidth intense applications, such as video teleconferencing. The ET-50 switch upgrade, along with other upgrades implemented from the five year plan, have prepared Hanford's network for the next evolution of technology in voice, video, and data. Hand-in-hand with ET-50's major data center outage, Mission Support Alliance's (MSA) Information Management (IM) organization executed a disaster recovery (DR) exercise to perform a true integration test and capability study. The DR scope was planned within the constraints of ET-50's 14 hour datacenter outage window. This DR exercise tested Hanford's Continuity of Operations (COOP) capability and failover plans for safety and business critical Hanford Federal Cloud applications. The planned suite of services to be tested was identified prior to the outage and plans were prepared to test the services ability to failover from the primary Hanford data center to the backup data center. The services tested were: Core Network (backbone, firewall, load balancers); Voicemail; Voice over IP (VoIP); Emergency Notification; Virtual desktops; and, Select set of production applications and data. The primary objective of the exercise was to test COOP around the emergency operations at Hanford to provide information on capabilities and dependencies of the current system to insure improved focus of emergency, safety and security capacity in a disaster situation. The integration of the DR test into the ET-50 project allowed the testing of COOP at Hanford and allowed the lessons learned to be defined. These lessons learned have helped improve the understanding of Hanford's COOP capabilities and will be critical for future planning. With the completion of the Hanford Federal Cloud network upgrades and the disaster recovery exercise, the MSA has a clearer path forward for future technology implementations as well as network improvements to help shape the usability and reliability of the Hanford network in support of the cleanup mission.

97 MATHEMATICS AND COMPUTING↗

Data Storage and sharing for the long tail of science

Research data infrastructure such as storage must now accommodate new requirements resulting from trends in research data management that require researchers to store their data for the long term and make it available to other researchers. We propose Data Depot, a system and service that provides capabilities for shared space within a group, shared applications, flexible access patterns and ease of transfer at Purdue University. We evaluate Depot as a solution for storing and sharing multiterabytes of data produced in the long tail of science with a use case in soundscape ecology studies from the Human- Environment Modeling and Analysis Laboratory. We observe that with the capabilities enabled by Data Depot, researchers can easily deploy fine-grained data access control, manage data transfer and sharing, as well as integrate their workflows into a High Performance Computing environment.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Design and impact assessment of watershed investments: An approach based on ecosystem services and boundary work

Watershed investments, whose main aim is to secure water for cities, represent a promising opportunity for large-scale sustainability transitions in the near future. If properly designed, they promote activities in the watershed that enhance ecosystem services while protecting nature and biodiversity, as well as achieving other societal goals. In this paper, we build on the concepts of ecosystem services and boundary work, to develop and test an operative approach for designing and assessing the impact of watershed investments. The approach is structured to facilitate negotiations among stakeholders. Its strategic component includes setting the agenda; defining investment scenarios; and assessing the performance of watershed investments as well as planning for a follow-up. Its technical component concerns data processing; tailoring spatially explicit ecosystem service models; hence their application to design a set of “investment portfolios”, generate future land use scenarios, and model impacts on selected ecosystem services. A case study illustrates how the technical component can be developed in a data scarce context in sub-Saharan Africa in a way that is functional to support the steps of the strategic component. The case study addresses soil erosion and water scarcity-related challenges affecting Asmara, a medium-sized city in Eritrea, and considers urban water security and rural poverty alleviation as two illustrative objectives, within a ten-year planning horizon. The case study results consist in spatially explicit data (investment portfolio, land use scenario, impact on ecosystem services), which were aggregated to quantitatively assess the performance of different watershed investments scenarios, in terms of changes in soil erosion control. By addressing stakeholders' concerns of credibility, saliency, and legitimacy, the approach is expected to facilitate negotiation of objectives, definition of scenarios, and assessment of alternative watershed investments, ultimately, to contribute to implementing an adaptive watershed management.

54 ENVIRONMENTAL SCIENCES↗

Monitoring techniques and alarm procedures for CMS services and sites in WLCG

The CMS offline computing system is composed of roughly 80 sites (including most experienced T3s) and a number of central services to distribute, process and analyze data worldwide. A high level of stability and reliability is required from the underlying infrastructure and services, partially covered by local or automated monitoring and alarming systems such as Lemon and SLS, the former collects metrics from sensors installed on computing nodes and triggers alarms when values are out of range, the latter measures the quality of service and warns managers when service is affected. CMS has established computing shift procedures with personnel operating worldwide from remote Computing Centers, under the supervision of the Computing Run Coordinator at CERN. This dedicated 24/7 computing shift personnel is contributing to detect and react timely on any unexpected error and hence ensure that CMS workflows are carried out efficiently and in a sustained manner. Synergy among all the involved actors is exploited to ensure the 24/7 monitoring, alarming and troubleshooting of the CMS computing sites and services. We review the deployment of the monitoring and alarming procedures, and report on the experience gained throughout the first two years of LHC operation. We describe the efficiency of the communication tools employed, the coherent monitoring framework, the proactive alarming systems and the proficient troubleshooting procedures that helped the CMS Computing facilities and infrastructure to operate at high reliability levels.

Molina-Perez, J.↗

SunLine Transit Agency Advanced Technology Fuel Cell Bus Evaluation: First Results Report

This report describes operations at SunLine Transit Agency for their newest prototype fuel cell bus and five compressed natural gas (CNG) buses. In May 2010, SunLine began operating its sixth-generation hydrogen fueled bus, an Advanced Technology (AT) fuel cell bus that incorporates the latest design improvements to reduce weight and increase reliability and performance. The agency iscollaborating with the U.S. Department of Energy's (DOE) National Renewable Energy Laboratory (NREL) to evaluate the bus in revenue service. This report provides the early data results and implementation experience of the AT fuel cell bus since it was placed in service.

03 NATURAL GAS↗

Developing an Interactive Landscape for Mobility Resources: Preprint

As the world continues to be increasingly driven by data, the ways researchers and professionals sort and collect this data is critical. In the world of mobility data, new levels of data from public transportation systems, location services, and other means are being lost due to how little organization exists. Much of the data is proprietary, and there are few if any de jure or even de facto standards connecting data. There is also little knowledge about the gaps that exist in the data. In this project, we created an interactive landscape where mobility resources are categorized and organized in an easy to use, living document. We made this landscape with open-source code from the CNCF Cloud Native Landscape and repurposed it to the mobility data's needs. Additionally, unlike previous sources that organize mobility data, this document can be updated through GitHub by those in the field to keep its sources relevant. Following the creation of a beta version of the landscape, we conducted several interviews with industry researchers and professionals to ensure the landscape would be useful. The result is an online hub where mobility researchers and resource creators can easily access research and collaborate.

ADVANCED PROPULSION SYSTEMS↗

China Energy Databook -- User Guide and Documentation, Version 7.0

Since 2001, China's energy consumption has grown more quickly than expected by Chinese or international observers. This edition of the China Energy Databook traces the growth of the energy system through 2006. As with version six, the Databook covers a wide range of energy-related information, including resources and reserves, production, consumption, investment, equipment, prices, trade, environment, economy, and demographic data. These data provide an extensive quantitative foundation for understanding China's growing energy system. In addition to providing updated data through 2006, version seven includes revised energy and GDP data back to the 1990s. In the 2005 China Energy Statistical Yearbook, China's National Bureau of Statistics (NBS) published revised energy production, consumption, and usage data covering the years 1998 to 2003. Most of these revisions related to coal production and consumption, though natural gas data were also adjusted. In order to accommodate underestimated service sector growth, the NBS also released revised GDP data in 2005. Beyond the inclusion of historical revisions in the seventh edition, no attempt has been made to rectify known or suspected issues in the official data. The purpose of this volume is to provide a common basis for understanding China's energy system. In order to broaden understanding of China's energy system, the Databook includes information from industry yearbooks, periodicals, and government websites in addition to data published by NBS. Rather than discarding discontinued data series, information that is no longer possible to update has been placed in C section tables and figures in each chapter. As with previous versions, the data are presented in digital database and tabular formats. The compilation of updated data is the result of tireless work by Lu Hongyou and Nina Zheng.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

AVTA Federal Fleet PEV Readiness Data Logging and Characterization Study for Department of Health and Human Services – ASPR

This report focuses on the Department of Health and Human Services, Assistant Secretary for Preparedness and Response fleet to identify daily operational characteristics of select vehicles and report findings on vehicle and mission characterizations to support the successful introduction of PEVs into the agency’s fleet. Individual observations of these selected vehicles provide the basis for recommendations related to electric vehicle adoption and whether a battery electric vehicle or plug-in hybrid electric vehicle (collectively referred to as PEVs) can fulfill the mission requirements.

33 ADVANCED PROPULSION SYSTEMS↗

AmeriFlux FLUXNET-1F US-xST NEON Steigerwaldt Land Services (STEI)

This is the AmeriFlux Management Project (AMP) created FLUXNET-1F version of the carbon flux data for the site US-xST NEON Steigerwaldt Land Services (STEI). This is the FLUXNET version of the carbon flux data for the site US-xST NEON Steigerwaldt Land Services (STEI) produced by applying the standard ONEFlux (1F) software.

Network), NEON (National Ecological Observatory↗