Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data infrastructure”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,369 records · Page 76
All sourcesNASA NTRSDOE OSTI
NASA NTRS2012

Bridging Informatics and Earth Science: a Look at Gregory Leptoukh's Contributions

With the tragic passing this year of Gregory Leptoukh, the Earth and Space Sciences community lost a tireless participant in--and advocate for--science informatics. Throughout his career at NASA, Dr. Leptoukh established a theme of bridging the gulf between the informatics and science communities. Nowhere is this more evident than his leadership in the development of Giovanni (GES DISC Interactive Online Visualization ANd aNalysis Infrastructure). Giovanni is an online tool that serves to hide the often-complex technical details of data format and structure, making science data easier to explore and use by Earth scientists. To date Giovanni has been acknowledged as a contributor in 500-odd scientific articles. In recent years, Leptoukh concentrated his efforts on multi-sensor data inter-comparison, merging and fusion. This work exposed several challenges at the intersection of data and science. One of these was the ease with which a naive user might generate spurious comparisons, a potential hazard that was the genesis of the Multi-sensor Data Synergy Advisor (MDSA). The MDSA uses semantic ontologies and inference rules to organize knowledge about dataset quality and other salient characteristics in order to advise users on potential caveats for comparing or merging two datasets. Recently, Leptoukh also led the development of AeroStat, an online Giovanni instance to investigate aerosols via statistics from station and satellite comparisons and merged maps of data from more than one instrument. Aerostat offers a neural net based bias adjustment to harmonize the data by removing systematic offsets between datasets before merging. These examples exhibit Leptoukh's talent for adopting advanced computer technologies in the service of making science data more accessible to researchers. In this, he set an example that is at once both vital and challenging for the ESSI community to emulate.

Source record↗
NASA NTRS2016

Methods for Determining Aircraft Surface State at Lesser-Equipped Airports

Tactical departure scheduling within a terminal airspace must accommodate a wide spectrum of surveillance and communication capabilities at multiple airports. The success of such a scheduler is highly dependent upon the knowledge of a departure's state while it is still on the surface. Airports within a common Terminal RAdar CONtrol (TRACON) airspace possess varying levels of surface surveillance infrastructure which directly impacts uncertainties in wheels-off times. Large airports have access to surface surveillance data, which is shared with the TRACON, while lesser-equipped airports still rely solely on controllers in Air Traffic Control Towers (Towers). Coordination between TRACON and Towers can be greatly enhanced when the TRACON controller has access to the surface surveillance and the associated decision-support tools at well-equipped airports. Similar coordination at lesser-equipped airports is still based on verbal communications. This paper investigates possible methods to reduce the uncertainty in wheels-off time predictions at the lesser-equipped airports through the novel use of Over-the-Air (OTA) data transmissions. We also discuss the methods and equipment used to collect sample data at lesser-equipped airports within a large US TRACON, as well as the data evaluation to determine if meaningful information can be extracted from it.

departure scheduling↗
NASA NTRS2019

A Web of Data Analytics Services

Cloud Computing has become the ubiquitous approach to our Big Data challenge. However, one will quickly discover that moving (a.k.a. forklifting) existing on-premise data analytics solutions to the Cloud doesn’t always translate to costing saving and performance boost. The Cloud’s elasticity, its availability, and its wide selection of computing options and selections of costing models making Cloud an attractive environment to tackle our Big Data challenge. The fact is Cloud, on its own, is not the silver bullet to our daunting challenge need for analyze and derive scientific inferences through vast collections of multi-sensor measurements. We would like to have all scientific data in one easy to access environment, but getting the world of scientific data in one analytic system is immensely difficult to achieve. This paper describes the data analytics web architecture NASA is developing by infusing instances of Integrated Data Analytics systems next to the data. The goal is to minimize unnecessary data movement through collection of data access and analytics webservices for researchers to interact with and analyze measurements without have to download data to their local computer. These services are RESTful and provisioned by the data centers with the help from subject matter and science experts. These services encapsulate the physical computing infrastructure, which could local computing cluster, on-premise or public Cloud environment.

Huang, Thomas↗
NASA NTRSDate not supplied

DEVELOP: Building Capacity in Early Career Individuals to Apply NASA Earth Observations in Health and Air Quality

The NASA DEVELOP National Program builds capacity to use and apply NASA Earth observations to address environmental concerns around the globe. The DEVELOP model builds capacity in both participants (students, recent graduates, and early and transitioning career professionals), who conduct the projects, and partners (decision and policy makers), who are recipients of project methodologies and results. While projects focus on a spectrum of thematic topics, health and air quality related topics made up more than a quarter of DEVELOP’s FY2023 project portfolio. These projects worked in collaboration with over 30 partner organizations throughout the US and internationally to explore how Earth observations could support decision making in areas such as health and air quality, wildland fires, climate, urban development, and transportation and infrastructure. This presentation provides an overview of the DEVELOP model of building capacity to use Earth observation data, environmental decision-making needs identified in health and air quality relevant projects, DEVELOP project case studies, commonly utilized data sources, and lessons learned. Key takeaways include best practices for project development and execution, how to balance learning with delivering impactful results for partners, and water resource relevant decisions guided by project end products.

Remote sensing↗
DOE OSTI2023

STREAM: A Scalable Federated HPC Telemetry Platform

Obtaining and analyzing high performance computing (HPC) telemetry in real time is a complex task that can impact algo- rithmic performance, operating costs, and ultimately scientific outcomes. If your organization operates multiple HPC systems, filesystems, and clusters, telemetry streams can be synthesized in order to ease operational and analytics burden. In order to collect this telemetry, the Oak Ridge Leadership Computing Facility (OLCF) has deployed STREAM (Streaming Telemetry for Resource Events, Analytics, and Monitoring), which is a distributed and high-performance message bus based on Apache Kafka. STREAM collects center-wide performance information and must interface with many sources, including five HPE deployed supercomputers, each with their own Kafka cluster which is managed by HPCM. OLCF Supercomputers and their attached scratch filesystems currently send more than 300 million messages to over 200 topics producing around 1.3 Terabytes per day of telemetry data to STREAM. This paper describes the architectural principles that enable STREAM to be both resilient and highly performant while supporting multiple upstream Kafka clusters and other data sources. It also discusses the design challenges and decisions faced in adapting our existing system- monitoring infrastructure to support the first Exascale computing platform.

Adamson, Ryan↗
DOE OSTI2025

Hydrogen and Electric Charging Infrastructure for Heavy-Duty Trucks: A Nationally Scalable Megaregion Assessment

Decarbonizing regional and long-haul freight is challenging due to the limitations of battery-electric commercial vehicles and infrastructure constraints. Hydrogen fuel cell medium- and heavy-duty vehicles (MHDVs) offer a viable alternative, aligning with the decarbonization goals of the Department of Energy and commercial entities. Historically, alternative fuels like compressed natural gas and liquefied propane gas have faced slow adoption due to barriers like infrastructure availability. To avoid similar issues, effective planning and deploying zero-emission hydrogen fueling infrastructure is crucial. This research develops deployment plans for affordable, accessible, and sustainable hydrogen refueling stations, supporting stakeholders in the decarbonized commercial vehicle freight system. It aims to benefit underserved and rural energy-stressed communities by improving air quality, reducing noise pollution, and enhancing energy resiliency. This research also provides a blueprint for replacing diesel in over-the-road Class 8 freight truck applications with hydrogen fueling solutions. The study focuses on the Texas Triangle Megaregion (I-45, I-35, and I-10), the I-10 corridor between San Antonio, TX, and Los Angeles, CA, and the I-5/CA-99 corridors between Los Angeles, CA, and San Francisco, CA. This area represents a significant portion of U.S. heavy-duty freight movement, carrying ~8.5% of the national freight volume. Using the OR-AGENT (Optimal Regional Architecture Generation for Efficient National Transport) modeling framework, the study conducts an advanced assessment of commercial vehicles, road and freight networks, and energy systems. The framework integrates data on freight mobility, traffic, weather, and energy pathways to deliver a region-specific, optimized vehicles powertrain architectures, infrastructure deployment solutions, operational logistics, and energy pathways. By considering all vehicle origin-destination pairs utilizing these corridors and all feasible fueling station location options, the framework's genetic algorithm identifies the minimum number and optimal locations of hydrogen refueling stations, ensuring no vehicle is stranded. It also determines fuel schedules and quantities at each station. A roadmap for station deployment based on multiple adoption trajectories ensures a strategic rollout of hydrogen refueling infrastructure.

Sujan, Vivek [ORNL] (ORCID:0000000269882342)↗
DOE OSTI2022

Smart connected worker edge platform for smart manufacturing: Part 1—Architecture and platform design

Abstract The challenge of sustainably producing goods and services for healthy living on a healthy planet requires simultaneous consideration of economic, societal, and environmental dimensions in manufacturing. Enabling technology for data driven manufacturing paradigms like Smart Manufacturing (a.k.a. Industry 4.0) serve as the technological backbone from which sustainable approaches to manufacturing can be implemented. Unfortunately, these technologies are typically associated with broader and deeper factory automation that is often too expensive and complex for the small and medium sized manufacturers (SMMs) that comprise the majority of manufacturing business in the USA and for whom their most valuable asset are the people whose jobs automation while replace. This paper describes an edge intelligent platform to integrate internet‐of‐things technologies with computing hardware, software, computational workflows for machine learning, and data ingestion, enabling SMMs to transition into smart manufacturing paradigms by leveraging the intelligence of their people. The platform leverages consumer grade electronics and sensors (affordable and portable), customized software with open source software packages (accessible), and existing communication network infrastructures (scalable). The software systems are implemented via Kubernetes orchestration of Docker containerization to ensure scalability and programmability. The platform is adaptive via computational workflow engines that produce information from data by processing with low‐cost edge computing devices while efficiently accessing resources of cloud servers as needed. The proposed edge platform connects workers to technological resources that provide computational intelligence (i.e., silicon‐based sensing and computation for data collection and contextualization) to enable decision making at the edge of advanced manufacturing.

Kim, Yoon G.↗
NASA NTRS2009

Phase Fluctuations at Goldstone Derived from 1-Year Site Testing Interferometer Data

A two-element site test interferometer has been deployed at the NASA Deep Space Network (DSN) tracking complex in Goldstone, California, since May 2007. The interferometer system consists of two offset-fed 1.2 m parabolic reflectors which monitor atmospheric-induced amplitude and phase fluctuations on an unmodulated beacon signal (20.199 GHz) broadcast from a geostationary satellite (Anik F2). The geometry of the satellite and the ground-based infrastructure imposes a 48.5 elevation angle with a separation distance of 256 m along an east-west baseline. The interferometer has been recording phase fluctuation data, to date, for 1 yr with an overall system availability of 95 percent. In this paper, we provide the cumulative distribution functions (CDFs) for 1 year of recorded data, including phase rms, spatial structure function exponent, and surface meteorological measurements: surface wind speed, relative humidity, temperature, barometric pressure, and rain rate. Correlation between surface measurements, phase rms, and amplitude rms at different time scales are discussed. For 1 year, phase fluctuations at the DSN site in Goldstone, are better than 23 for 90 percent of the time (at 48.5 elevation). This data will be used to determine the suitability of the Goldstone site as a location for the Next Generation Deep Space Network.

Nessel, James A.↗
DOE OSTI2026

Energy Technology Innovation Partnership Project Strategic Energy Plan for Washington County, Maine

This Strategic Energy Plan (SEP) for Washington County, Maine was developed through the U.S. Department of Energy's Energy Technology Innovation Partnership Project (ETIPP) to address local challenges related to electricity reliability, affordability, and safety. Grounded in a "relational infrastructure" approach, the plan recognizes that improved energy outcomes depend not only on physical grid investments but also on strengthened coordination and trust between utilities and communities. Using utility-provided reliability data, public datasets, and community input, the plan identifies key risks, including vegetation-related outages, high energy burden, and vulnerability among elderly and medically dependent populations. The SEP establishes three priority areas: hazard mitigation for energy infrastructure, outage safety and emergency readiness, and energy assistance and thermal safety. It outlines community-driven actions designed to complement utility-led system improvements, including targeted outreach, municipal coordination, and expanded access to energy programs. The plan also situates local conditions within broader state policy, market dynamics, and funding opportunities. Intended as a living document, this SEP provides a scalable framework for collaborative action to improve resilience, safety, and affordability in rural energy systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

WormBase in 2022—data, processes, and tools for analyzing Caenorhabditis elegans

WormBase (www.wormbase.org) is the central repository for the genetics and genomics of the nematode Caenorhabditis elegans. We provide the research community with data and tools to facilitate the use of C. elegans and related nematodes as model organisms for studying human health, development, and many aspects of fundamental biology. Throughout our 22-year history, we have continued to evolve to reflect progress and innovation in the science and technologies involved in the study of C. elegans. We strive to incorporate new data types and richer data sets, and to provide integrated displays and services that avail the knowledge generated by the published nematode genetics literature. Here, we provide a broad overview of the current state of WormBase in terms of data type, curation workflows, analysis, and tools, including exciting new advances for analysis of single-cell data, text mining and visualization, and the new community collaboration forum. Concurrently, we continue the integration and harmonization of infrastructure, processes, and tools with the Alliance of Genome Resources, of which WormBase is a founding member.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Gaussian processes for autonomous data acquisition at large-scale synchrotron and neutron facilities

The execution and analysis of complex experiments are challenged by the vast dimensionality of the underlying parameter spaces. Although an increase in data-acquisition rates should allow broader querying of the parameter space, the complexity of experiments and the subtle dependence of the model function on input parameters remains daunting owing to the sheer number of variables. New strategies for autonomous data acquisition are being developed, with one promising direction being the use of Gaussian process regression (GPR). GPR is a quick, non-parametric and robust approximation and uncertainty quantification method that can be applied directly to autonomous data acquisition. We review GPR-driven autonomous experimentation and illustrate its functionality using real-world examples from large experimental facilities in the USA and France. We introduce the basics of a GPR-driven autonomous loop with a focus on Gaussian processes, and then shift the focus to the infrastructure that needs to be built around GPR to create a closed loop. Finally, the case studies we discuss show that Gaussian-process-based autonomous data acquisition is a widely applicable method that can facilitate the optimal use of instruments and facilities by enabling the efficient acquisition of high-value datasets.

36 MATERIALS SCIENCE↗
DOE OSTI2020

ARM Data-Oriented Metrics and Diagnostics Package for Climate Model Evaluation

A Python-based metrics and diagnostics package is currently being developed by the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility Infrastructure Team at Lawrence Livermore National Laboratory to facilitate the use of long-term, high-frequency measurements from ARM in evaluating the regional climate simulation of clouds, radiation, and precipitation. This metrics and diagnostics package computes climatological means of targeted climate model simulation and generates tables and plots for comparing the model simulation with ARM observational data.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Data-driven Community-centered Resilient Assessment and Planning Toolkit for Nexus of Energy and Water (DCRAPT-NEW)

Urban areas, including Detroit and Pittsburgh, have suffered significant dual outages of the electrical and water infrastructure in the past decade due, in part, to the increasing number of extreme weather events. With increasing temperatures and rainfall intensity, these regions need to prepare for increasing extreme events through community-based energy and water resilience analysis, planning, and enhancement. This project developed a suite of open-source, open-access, community-centered, data-driven assessment and distributed energy resource (DER) and planning tools for energy and water resilience enhancement in urban areas. Through establishing a multi-level community awareness and engagement mechanism and a comprehensive collection of power outage and flooding data, an innovative group of community energy and water resilience assessment and planning tools have been developed for a wide range of users with differing and variable sets of data available to them. The developed tools include (1) DOE EAGLE-I data-driven, deep-learning assisted resilience assessment and DER planning tools at the county level with socioeconomic factors incorporated; (2) Utility annual power outage data-driven tools for long term resilience assessment and DER planning and 15-min power outage data-driven tools for short term resilience assessment and planning; (3) Detailed engineering tools for energy and water systems resilience assessment and planning when the system topology and component fragility curves are available; (4) Alternative Resiliency Metric Calculation that extracts and separates outage and restoration processes; and (5) Co-optimization tools that evaluate the resilience of the power and sewage system and allow users to conduct joint planning with energy and wastewater systems. The developed tools provide planners, decision-makers, and stakeholders with powerful capabilities to systematically evaluate system/community resilience and optimal and actionable guidance for enhancing resilience while prioritizing DER investments. The tools have been used and validated in Detroit and Pittsburgh and can be used in other areas of the nation. In addition, this project will (1) advance the knowledge and applications of machine-learning methods in analyzing and fusing different layers of information and generating meaningful data points such as generating rare weather events; (2) significantly improve the energy and water resilience of the identified communities in Detroit and Pittsburgh and prepare for more frequent and severe weather conditions; (3) help communities assess extreme weather event impacts and address short-term and long-term resilience-related issues The developed tools have been made public via GitHub and demonstrated to community stakeholders and utility companies via the two annual workshops and numerous community engagement meetings. The project outcomes are also disseminated through publications in various journals and conference proceedings, and presentations at top conferences.

13 HYDRO ENERGY↗
DOE OSTI2021

Universal Utility Data Exchange (UUDEX) – Protocol Design - Rev 1

This design document describes protocol related aspects of Universal Utility Data Exchange (UUDEX). The focus of the design is to describe the interactions between UUDEX Clients and UUDEX Servers in the UUDEX Infrastructure. This design is purposely transport and programming language agnostic.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Carbon Storage Planning Inquiry Tool (CS PlanIT)

The CS PlanIT provides stakeholders with easy access to geographically explore, query, and evaluate multiple data layers for a user-defined area of interest, with the goal to accelerate carbon storage resource, feasibility assessments, and planning efforts. The data within CS PlanIT are arranged and categorized to assess each stage of the Carbon Capture and Storage supply chain, from CO2 (Carbon Dioxide) emission sources, critical energy infrastructure (including transport), to CO2 geologic storage and sink locations. Furthermore, stakeholders can gain insights into community and environmental impacts, as CS PlanIT leverages Environmental Justice and Social Justice (EJSJ) and natural hazard datasets. Additionally, documentation in the form of an interactive ArcGIS story map and data catalog are included within the EDX publication to provide user’s information to better understand and explain CS PlanIT’s layout, functions, and associated data sets.

Justman, Devin M.↗
NASA NTRS2009

Evaluation of IEEE 802.11g and 802.16 for Lunar Surface Exploration Missions Using MACHETE Simulations

In this paper, we investigated the suitability of terrestrial wireless networking technologies for lunar surface exploration missions. Specifically, the scenario we considered consisted of two teams of collaborating astronauts, one base station and one rover, where the base station and the rover have the capability of acting as relays. We focused on the evaluation of IEEE 802.11g and IEEE 802.16 protocols, simulating homogeneous 802.11g network, homogeneous 802.16 network, and heterogeneous network using both 802.11g and 802.16. A mix of traffic flows were simulated, including telemetry, caution and warning, voice, command and file transfer. Each traffic type had its own distribution profile, data volume, and priority. We analyzed the loss and delay trade-offs of these wireless protocols with various link-layer options. We observed that 802.16 network managed the channel better than an 802.11g network due to controlled infrastructure and centralized scheduling. However, due to the centralized scheduling, 802.16 also had a longer delay. The heterogeneous (hybrid) of 802.11/802.16 achieved a better balance of performance in terms of data loss and delay compared to using 802.11 or 802.16 alone.

Segui, John↗
DOE OSTI2024

Road Lidar Dataset for the TxDOT Austin District

This is a road lidar data collection for developing road elevation models and road inundation mapping methodologies, a joint work between ORNL and The University of Texas at Austin. This dataset is generated as part of the flood transportation infrastructure, partly funded by the NOAA CIROH project. ORNL is a project partner for high-performance computing-empowered flood inundation mapping methodology R&D. The dataset is computed using a GPU-accelerated lidar data processing workflow developed at ORNL. The lidar data source is from TxGIO, the state lidar data collection site. The output dataset is in two formats: laz and copc. It is organized by TxDOT's maintenance sections, covering the Austin District. Data size: 3.86 billion road lidar points, 1.67% of the entire lidar data input Projection: EPSG:32614 (WGS84/UTM zone 14N) Website: https://web.corral.tacc.utexas.edu/nfiedata/road3d/austin_district/AustinMaintenanceSections_H_epsg6343_V_epsg5703/ LICENSE FOR USE -- MAPS AND DATA DISCLAIMER This resource is shared under the Creative Commons Attribution CC BY, http://creativecommons.org/licenses/by/4.0/ MAPS AND DATA DISCLAIMER The Oak Ridge National Laboratory (ORNL) shall not be held liable for improper or incorrect use of the data described or information contained on this map or associated series of maps. The data and related map graphics are not legal, land survey or engineering documents and are not intended to be used as such. ORNL gives no warranty, express or implied, as to the accuracy, reliability, utility or completeness of this information. The user of these maps and data assumes all responsibility and risk for the use of the maps and data. ORNL disclaims all warranties, representations or endorsements either express or implied, with regard to the information contained in this map product, including, but not limited to, all implied warranties of merchantability, fitness for a particular purpose or non-infringement. This preliminary map product is for research and review purposes only. It is not intended to be used for emergency management operational or life safety decisions at the local or regional governmental level or by the general public. Users requiring information regarding hazardous conditions or meteorological conditions for specific geographic areas should consult directly with their city or county emergency management office.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Supply Chain Management in Cyber Grid Guard Framework

Grid modernization has impeded innovative power grid applications and energy resources that are increasingly distributed. Blockchain/distributed ledger technology (DLT) has the potential to enhance the resilience of the electric infrastructure, particularly in a decentralized and distributed environment. The benefits of blockchain are to ensure asset information and lifecycle events are secure and traceable and identify potential malicious modification of data. Oak Ridge National Laboratory (ORNL) has developed a framework, Cyber Grid Guard (CGG), incorporating blockchain. The system implements a low-energy, fast, and robust enhancement to system trustworthiness within and across electric grid systems, including substations, control centers, and metering infrastructures. Currently, one of the major concerns is supply chain attacks. There have been several recent attacks that have significantly impacted critical infrastructures and organizations around the world. This document focuses on how CGG can be used to address the supply chain issue.

24 POWER TRANSMISSION AND DISTRIBUTION↗