SEARCH · Engineering Papers

Results for “data infrastructure”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,117 records · Page 62

All sources NASA NTRS DOE OSTI

DOE OSTI2022

ZFS Interface For Accelerators

As data volume increases in HPC centers, storing data in reasonable amounts of space and time while maintaining data integrity and recoverability becomes ever more difficult. ZFS is a filesystem that provides these features, among many others, that make it attractive for usage in HPC environments. It has the ability to compress data, compute checksums, and compute redundancy codes within the same runtime, rather than compute each separately, without knowledge of the underlying structure of the filesystem. However, measurements have shown that compression on CPUs can be incredibly inefficient and significantly reduce the performance of ZFS. The ZFS Interface for Accelerators (Z.I.A.) was developed to provide an interface to route data to accelerators while being processed by ZFS, so that the ZFS infrastructure and features are maintained, while allowing for ZFS administrators to provide faster implementations of compression, or other features, to their instance of ZFS.

Lee, Jason↗

DOE OSTI2025

Carbon Storage Technical Viability Approach (CS TVA) Matrix

The Carbon Storage Technical Viability Approach (CS TVA) Matrix is a knowledge framework developed to outline the information needed for geologic carbon storage. The CS TVA Matrix contains 5 categories, 14 sub-categories, and 47 components. This framework can be leveraged to assess the availability of data and information needed for a carbon storage project. The information categories of the matrix are tied to a list of required data using weighted mapping, published herein.

carbon storage↗

DOE OSTI2019

CICE Consortium Progress Report, June 2018 - December 2019

The CICE Consortium accomplished a number of major upgrades to our sea ice model code, scripts and testing infrastructure, while strengthening our visibility in the international modeling community. We released CICE versions 6.0.0, 6.0.1, 6.0.2 and 6.1.0, all of which include updated releases of Icepack. Major new capabilities include a floe size distribution, new coupling infrastructure, improvements to all of CICE’s dynamics options, a new atmospheric data set for historical simulations, overhauled documentation, and more robust and flexible scripts for running and testing the code. Several key testing processes were automated this year. In addition, the team is actively engaged in planning our first user workshop and tutorial in February 2020. In addition to overseeing modifications to the Consortium’s resources and code releases, management tasks included meeting with and updating the Consortium’s Sponsors group in October 2018, prioritizing tasks by mapping them onto potential release targets, and rescuing early CICE releases (version 1 through 3.14) from a disappearing LANL archive.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

LABS: Los Alamos Benchmark Suite - Current status and planning [Slides]

The LABS repository now has over 500 verified and revised input files with about 600 input files left to get up to speed with what we currently use. After that there are many, many more to go. We're in the process of building code infrastructure, moving to template output files, automating input file generation, outputting file data mining for calculation results, and benchmarking selection on sensitivity and other benchmark characteristics. We intend to open source LABS. We'll most likely release the input files sooner rather than later. The associated tool will probably be open sourced later.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2024

GlideinBenchmark: collecting resource information to optimize provisioning

Choosing the right resource can speedup jobs completion, better utilize the available hardware and visibly reduce costs, especially when renting computers on the cloud. This was demonstrated in earlier studies on HEPCloud. But the benchmarking of the resources proved to be a laborious and time-consuming process. This paper presents GlideinBenchmark, a new Web application leveraging the pilot infrastructure of GlideinWMS to benchmark resources, and shows how to use the data collected and published by GlideinBenchmark to automate the optimal selection of resources. An experiment can select the benchmark or the set of benchmarks that most closely evaluate the performance of its workflows. With GlideinBenchmark and the help of the GldieinWMS Factory it controls the benchmark execution. Finally, a scheduler like HEPCloud’s Decision Engine can use the results to optimize resource provisioning.

Mambelli, Marco↗

DOE OSTI2024

Airport and Heliport Setbacks

This dataset represents a first-order quantification of airport and heliport setback requirements based on the Federal Aviation Administration (FAA) 14 CFR Part 77.9. It defines the following FAA notice criteria that we use to create runway buffers. Runways longer than 3,200 feet receive a 20,000 foot buffer, runways less than 3,200 feet long receive a buffer of 10,000 feet, and heliports receive a buffer of 5,000 feet. A setback requirement is a minimum distance from an airport or heliport that an energy project may be developed. For further details and citation, please refer to the publication linked below: Lopez, Anthony, Pavlo Pinchuk, Michael Gleason, Wesley Cole, Trieu Mai, Travis Williams, Owen Roberts, Marie Rivers, Mike Bannister, Sophie-Min Thomson, Gabe Zuckerman, and Brian Sergi. 2024. Solar Photovoltaics and Land-Based Wind Technical Potential and Supply Curves for the Contiguous United States: 2023 Edition. Golden, CO: National Renewable Energy Laboratory. NREL/TP-6A20-87843.

airport↗

NASA NTRS2010

Influence of Averaging Method on the Evaluation of a Coastal Ocean Color Event on the U.S. Northeast Coast

Application of appropriate spatial averaging techniques is crucial to correct evaluation of ocean color radiometric data, due to the common log-normal or mixed log-normal distribution of these data. Averaging method is particularly crucial for data acquired in coastal regions. The effect of averaging method was markedly demonstrated for a precipitation-driven event on the U.S. Northeast coast in October-November 2005, which resulted in export of high concentrations of riverine colored dissolved organic matter (CDOM) to New York and New Jersey coastal waters over a period of several days. Use of the arithmetic mean averaging method created an inaccurate representation of the magnitude of this event in SeaWiFS global mapped chl a data, causing it to be visualized as a very large chl a anomaly. The apparent chl a anomaly was enhanced by the known incomplete discrimination of CDOM and phytoplankton chlorophyll in SeaWiFS data; other data sources enable an improved characterization. Analysis using the geometric mean averaging method did not indicate this event to be statistically anomalous. Our results predicate the necessity of providing the geometric mean averaging method for ocean color radiometric data in the Goddard Earth Sciences DISC Interactive Online Visualization ANd aNalysis Infrastructure (Giovanni).

Acker, James G.↗

NASA NTRS2012

Multi-Parameter Observation and Detection of Pre-Earthquake Signals in Seismically Active Areas

The recent large earthquakes (M9.0 Tohoku, 03/2011; M7.0 Haiti, 01/2010; M6.7 L Aquila, 04/2008; and M7.9 Wenchuan 05/2008) have renewed interest in pre-anomalous seismic signals associated with them. Recent workshops (DEMETER 2006, 2011 and VESTO 2009 ) have shown that there were precursory atmospheric /ionospheric signals observed in space prior to these events. Our initial results indicate that no single pre-earthquake observation (seismic, magnetic field, electric field, thermal infrared [TIR], or GPS/TEC) can provide a consistent and successful global scale early warning. This is most likely due to complexity and chaotic nature of earthquakes and the limitation in existing ground (temporal/spatial) and global satellite observations. In this study we analyze preseismic temporal and spatial variations (gas/radon counting rate, atmospheric temperature and humidity change, long-wave radiation transitions and ionospheric electron density/plasma variations) which we propose occur before the onset of major earthquakes:. We propose an Integrated Space -- Terrestrial Framework (ISTF), as a different approach for revealing pre-earthquake phenomena in seismically active areas. ISTF is a sensor web of a coordinated observation infrastructure employing multiple sensors that are distributed on one or more platforms; data from satellite sensors (Terra, Aqua, POES, DEMETER and others) and ground observations, e.g., Global Positioning System, Total Electron Content (GPS/TEC). As a theoretical guide we use the Lithosphere-Atmosphere-Ionosphere Coupling (LAIC) model to explain the generation of multiple earthquake precursors. Using our methodology, we evaluated retrospectively the signals preceding the most devastated earthquakes during 2005-2011. We observed a correlation between both atmospheric and ionospheric anomalies preceding most of these earthquakes. The second phase of our validation include systematic retrospective analysis for more than 100 major earthquakes (M>5.9) in Taiwan and Japan. We have found anomalous behavior before all of these events with no false negatives. Calculated false alarm ratio for the for the same month over the entire period of analysis (2003-2009) is less than 10% and was d as the earthquakes. The commonalities in detecting atmospheric/ionospheric anomalies show that they may exist over both land and sea in regions of maximum stress (i.e., along plate boundaries) Our results indicate that the ISTF model could provide a capability to observe pre-earthquake atmospheric/ionospheric signals by combining this information into a common framework.

Ouzounov, D.↗

NASA NTRS2016

The Matsu Wheel: A Cloud-Based Framework for Efficient Analysis and Reanalysis of Earth Satellite Imagery

Project Matsu is a collaboration between the Open Commons Consortium and NASA focused on developing open source technology for cloud-based processing of Earth satellite imagery with practical applications to aid in natural disaster detection and relief. Project Matsu has developed an open source cloud-based infrastructure to process, analyze, and reanalyze large collections of hyperspectral satellite image data using OpenStack, Hadoop, MapReduce and related technologies. We describe a framework for efficient analysis of large amounts of data called the Matsu "Wheel." The Matsu Wheel is currently used to process incoming hyperspectral satellite data produced daily by NASA's Earth Observing-1 (EO-1) satellite. The framework allows batches of analytics, scanning for new data, to be applied to data as it flows in. In the Matsu Wheel, the data only need to be accessed and preprocessed once, regardless of the number or types of analytics, which can easily be slotted into the existing framework. The Matsu Wheel system provides a significantly more efficient use of computational resources over alternative methods when the data are large, have high-volume throughput, may require heavy preprocessing, and are typically used for many types of analysis. We also describe our preliminary Wheel analytics, including an anomaly detector for rare spectral signatures or thermal anomalies in hyperspectral data and a land cover classifier that can be used for water and flood detection. Each of these analytics can generate visual reports accessible via the web for the public and interested decision makers. The result products of the analytics are also made accessible through an Open Geospatial Compliant (OGC)-compliant Web Map Service (WMS) for further distribution. The Matsu Wheel allows many shared data services to be performed together to efficiently use resources for processing hyperspectral satellite image data and other, e.g., large environmental datasets that may be analyzed for many purposes.

0↗

NASA NTRS2019

Human Performance Contributions to Safety in Commercial Aviation

In the commercial aviation domain, large volumes of data are collected and analyzed on the failures and errors that result in infrequent incidents and accidents, but in the absence of data on behaviors that contribute to routine successful outcomes, safety management and system design decisions are based on a small sample of non- representative safety data. Analysis of aviation accident data suggests that human error is implicated in up to 80% of accidents, which has been used to justify future visions for aviation in which the roles of human operators are greatly diminished or eliminated in the interest of creating a safer aviation system. However, failure to fully consider the human contributions to successful system performance in civil aviation represents a significant and largely unrecognized risk when making policy decisions about human roles and responsibilities. Opportunities exist to leverage the vast amount of data that has already been collected, or could be easily obtained, to increase our understanding of human contributions to “things going right” in commercial aviation. The principal focus of this assessment was to identify current gaps and explore methods for identifying human “success” data generated by the aviation system, from personnel and within the supporting infrastructure.

Holbrook, Jon B.↗

NASA NTRSDate not supplied

An Approach to Reasoning Service Migration in Data and Reasoning Fabric (DRF) Implementation

In this paper we consider service placement problem for Data and Reasoning Fabric (DRF) enabled airspace operations assuming a fixed cloud/edge infrastructure with allocated computing, storage and power resources, where cloud/edge servers, and communication stations are in a wired connected network, while vehicles use a wireless network for communication. The objective is to automatically select the best location for the requested service execution, which achieves minimum cost while satisfying the user quality of service (QoS) and available resources constraints. To this end, we estimate for each potential location the response time, consumed energy and total cost; formulate an optimization problem for cost minimization given the users QoS constraints and network infrastructure limitations; and solve it using nonlinear programming tools. The approach is applied to trajectory re-planning use case to handle a no-fly zone contingency in real time.

Vahram Stepanyan↗

NASA NTRSDate not supplied

Flow Visualization for Plume-Surface Interaction Testing Within Large-Scale Vacuum Environments at Conditions Relevant to Lunar and Martian Landers

Interactions between rocket exhaust plumes and the landing surface during powered spacecraft descent on the Moon and Mars pose significant risks to the landing vehicle, landing site, and nearby infrastructure. Understanding the underlying plume-surface interaction phenomena through ground test data can provide critical insights on the sensitivities of parameters such as the spacecraft altitude and thrust. In the present work, we summarize a scaled ground test recently conducted within a 20-ft vacuum chamber environment located in the historical East Test Area at the NASA Marshall Space Flight Center. The ground test featured a Mach 5.3 inert gas plume impinging upon an instrumented flat plate. Planar laser-induced fluorescence, which is a 2D laser-based flow field measurement technique, was performed at this test area for the first time to visualize salient flow features such as the barrel shock, stagnation shock, and wall jet. Measurements were obtained at discrete lander altitudes, made dimensionless using the nozzle exit diameter, corresponding to h/D = 10, 8, 5, 4, 3, and 2. The stagnation pressures of the plume were varied from approximately 0.04 to 1 MPa, providing sensitivity to the engine thrust of a powered spacecraft. The unique test facility allowed for near-lunar conditions to be obtained at initial vacuum chamber pressures less than 0.1 Pa. Martian-relevant measurements were also performed at ambient pressures near 600 Pa. Furthermore, a third set of measurements were obtained at so called lunar-relevant conditions near 3 Pa chamber pressure

Plume Surface Interaction↗

NASA NTRSDate not supplied

Flow Visualization for Plume-Surface Interaction Testing Within Large-Scale Vacuum Environments at Conditions Relevant to Lunar and Martian Landers

Plume Surface Interaction↗

DOE OSTI2023

Charging Needs for Battery Electric Semi-Trucks

Battery-electric vehicles provide a pathway to decarbonize heavy-duty trucking, but the market for heavy-duty battery-electric semi-trailer trucks is nascent, and specific charging requirements remain uncertain. We leverage large-scale vehicle telematics data (>205 million miles of driving) to estimate the charging behaviors and infrastructure requirements for U.S. battery-electric semi-trailer trucks within three operating segments: local, regional, and long-haul. We model two types of charging; mid-shift (fast) and off-shift (slow), and show that off-shift charging at speeds compatible with current light-duty charging infrastructure (i.e., =350 kW) can supply 35 to 77% of total energy demand for local and regional trucks with =300-mile range. Megawatt-level speeds are required for mid-shift charging, which make up 44 to 57% of energy demand for long-haul trucks with =500-mile range. However, demand shifts from mid-shift to off-shift charging as the range for battery-electric trucks increases and when off-shift charging is widely available. Finally, we observe geographic trends in charging demand, finding that local trucks have greater demand within urban areas, whereas long-haul trucks have more demand along rural interstate corridors. As the range for battery-electric trucks increases, we show that charging demand shifts from rural to urban locations due to observed vehicle dwell tendencies.

ADVANCED PROPULSION SYSTEMS,ENERGY PLANNING, POLIC↗

DOE OSTI2023

Charging Needs for Battery Electric Semi Trucks

Battery-electric vehicles provide a pathway to decarbonize heavy-duty trucking, but the market for electric trucks is nascent, and specific charging requirements remain uncertain. This paper summarizes methods and findings from Charging Needs for Electric Semi-Trailer Trucks [1] wherein we leverage large-scale vehicle telematics data (>205 million miles of driving) to estimate the charging behaviors and infrastructure requirements for U.S. battery-electric semi-trailer trucks within three operating segments: local, regional, and long-haul. We model two types of charging - mid-shift (fast en-route charging) and off-shift (slow depot charging) - and show that off-shift charging at speeds compatible with current light-duty charging infrastructure (i.e., =350 kW) can supply 35% to 77% of total energy demand for local and regional trucks with =300-mile range. Megawatt-level speeds are required for mid-shift charging, which make up 44% to 57% of energy demand for long-haul trucks with =500-mile range. However, the role of off-shift charging increases as the range for battery-electric trucks increases and when off-shift charging is widely available.

ADVANCED PROPULSION SYSTEMS↗

NASA NTRS1994

International Space Station Alpha user payload operations concept

International Space Station Alpha (ISSA) will accommodate a variety of user payloads investigating diverse scientific and technology disciplines on behalf of five international partners: Canada, Europe, Japan, Russia, and the United States. A combination of crew, automated systems, and ground operations teams will control payload operations that require complementary on-board and ground systems. This paper presents the current planning for the ISSA U.S. user payload operations concept and the functional architecture supporting the concept. It describes various NASA payload operations facilities, their interfaces, user facility flight support, the payload planning system, the onboard and ground data management system, and payload operations crew and ground personnel training. This paper summarizes the payload operations infrastructure and architecture developed at the Marshall Space Flight Center (MSFC) to prepare and conduct ISSA on-orbit payload operations from the Payload Operations Integration Center (POIC), and from various user operations locations. The authors pay particular attention to user data management, which includes interfaces with both the onboard data management system and the ground data system. Discussion covers the functional disciplines that define and support POIC payload operations: Planning, Operations Control, Data Management, and Training. The paper describes potential interfaces between users and the POIC disciplines, from the U.S. user perspective.

Schlagheck, Ronald A.↗

DOE OSTI2024

Modeling Distributed Computing Infrastructures for HEP Applications

Predicting the performance of various infrastructure design options in complex federated infrastructures with computing sites distributed over a wide area network that support a plethora of users and workflows, such as the Worldwide LHC Computing Grid (WLCG), is not trivial. Due to the complexity and size of these infrastructures, it is not feasible to deploy experimental test-beds at large scales merely for the purpose of comparing and evaluating alternate designs. An alternative is to study the behaviours of these systems using simulation. This approach has been used successfully in the past to identify efficient and practical infrastructure designs for High Energy Physics (HEP). A prominent example is the Monarc simulation framework, which was used to study the initial structure of the WLCG. New simulation capabilities are needed to simulate large-scale heterogeneous computing systems with complex networks, data access and caching patterns. A modern tool to simulate HEP workloads that execute on distributed computing infrastructures based on the SimGrid and WRENCH simulation frameworks is outlined. Studies of its accuracy and scalability are presented using HEP as a case-study. Hypothetical adjustments to prevailing computing architectures in HEP are studied providing insights into the dynamics of a part of the WLCG and candidates for improvements.

Horzela, Maximilian↗

DOE OSTI2024

ESM data downscaling: a comparison of super-resolution deep learning models

Abstract Climate projections at fine spatial resolutions are required to conduct accurate risk assessment for critical infrastructure and design adaptation planning. Generating these projections using advanced Earth system models (ESM) requires significant computational resources. To address this issue, various statistical downscaling techniques have been introduced to generate fine-resolution data from coarse-resolution simulations. In this study, we evaluate and compare five deep learning-based downscaling techniques, namely, super-resolution convolutional neural networks, fast super-resolution convolutional neural network ESM, efficient sub-pixel convolutional neural network, enhanced deep residual network (EDRN), and super-resolution generative adversarial network (SRGAN). These techniques are applied to a dataset generated by the Energy Exascale Earth System Model (E3SM), focusing on key surface variables such as surface temperature, shortwave heat flux, and longwave heat flux. Models are trained and validated using paired fine-resolution (0.25 $$^{\circ }$$ ∘ ) and coarse-resolution (1 $$^{\circ }$$ ∘ ) monthly data obtained from a 9-year simulation. Next, blind testing is performed using monthly data obtained from two different years outside of the training and validation set. To evaluate the efficiency of each technique, different statistical metrics are used, including mean squared error (MSE), peak signal-to-noise ratio (PSNR), structural similarity index measure (SSIM), and learned perceptual image patch similarity (LPIPS). The results show that EDRN outperforms other algorithms in terms of PSNR, SSIM, and MSE, but struggles to capture fine-scale features in the data. In contrast, SRGAN, a generative model that uses perceptual loss, excels in capturing fine details at boundaries and internal structures, resulting in lower LPIPS than other methods.

Pawar, Nikhil M. (ORCID:0000000211613289)↗