Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data infrastructure”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,783 records · Page 99
All sourcesNASA NTRSDOE OSTI
NASA NTRS2000

Implementing Journaling in a Linux Shared Disk File System

In computer systems today, speed and responsiveness is often determined by network and storage subsystem performance. Faster, more scalable networking interfaces like Fibre Channel and Gigabit Ethernet provide the scaffolding from which higher performance computer systems implementations may be constructed, but new thinking is required about how machines interact with network-enabled storage devices. In this paper we describe how we implemented journaling in the Global File System (GFS), a shared-disk, cluster file system for Linux. Our previous three papers on GFS at the Mass Storage Symposium discussed our first three GFS implementations, their performance, and the lessons learned. Our fourth paper describes, appropriately enough, the evolution of GFS version 3 to version 4, which supports journaling and recovery from client failures. In addition, GFS scalability tests extending to 8 machines accessing 8 4-disk enclosures were conducted: these tests showed good scaling. We describe the GFS cluster infrastructure, which is necessary for proper recovery from machine and disk failures in a collection of machines sharing disks using GFS. Finally, we discuss the suitability of Linux for handling the big data requirements of supercomputing centers.

Preslan, Kenneth W.↗
NASA NTRS1997

NASA Virtual Conferences and Instruction Over the Internet

Distance learning is not new. Since the time that radio has embellished our culture distance learning has taken on may forms. With the onset of television, video tape and satellite link ups the world of multimedia has taken a presence in our remote learning environment. Now in the information age new models for bring the best education to people through out the world is in its early stages. Recent "Information Age" technological developments have made key advancements to distance learning through the greater bandwidths now available over the Internet and a broader communications infrastructure that extends to classrooms throughout the country and the world. Further, new software compression technology allows audio and video to be communicated over the Internet much more efficiently. Larger amounts of data can be transferred to remote sites at less cost. The purpose of this paper is to demonstrate the use of state-of-art technology in the educational community. The focus will be on virtual conferences, virtual instruction and remote education. The techniques herein have been developed by NASA and the University of North Dakota(UND) through the use of existing software and hardware purchased in the United States. NASA has awarded UND a grant for continued research in this area based on their pioneering effort to date. NASA has been conducting "Virtual Conferences" from Ames Research Center in order to make unique educational opportunities available to participants across the country and internationally. Through the use of this technical approach, hundreds of teachers have been able to attend events where physical or financial barriers traditionally prevented their attendance. This technique is currently being adopted by industry due to its scaleable merit.

Leon, Mark↗
NASA NTRS2008

Sensor-Web Operations Explorer

Understanding the atmospheric state and its impact on air quality requires observations of trace gases, aerosols, clouds, and physical parameters across temporal and spatial scales that range from minutes to days and from meters to more than 10,000 kilometers. Observations include continuous local monitoring for particle formation; field campaigns for emissions, local transport, and chemistry; and periodic global measurements for continental transport and chemistry. Understanding includes global data assimilation framework capable of hierarchical coupling, dynamic integration of chemical data and atmospheric models, and feedback loops between models and observations. The objective of the sensor-web system is to observe trace gases, aerosols, clouds, and physical parameters, an integrated observation infrastructure composed of space-borne, air-borne, and in-situ sensors will be simulated based on their measurement physics properties. The objective of the sensor-web operation is to optimally plan for heterogeneous multiple sensors, the sampling strategies will be explored and science impact will be analyzed based on comprehensive modeling of atmospheric phenomena including convection, transport, and chemical process. Topics include system architecture, software architecture, hardware architecture, process flow, technology infusion, challenges, and future direction.

observation↗
NASA NTRS2021

Harmonized Emissions Component (HEMCO) 3.0 as a Versatile Emissions Component for Atmospheric Models: Application in the GEOS-Chem, NASA GEOS, WRF-GC, CESM2, NOAA GEFS-Aerosol, and NOAA UFS Models

Emissions are a central component of atmospheric chemistry models. The Harmonized Emissions Component (HEMCO) is a software component for computing emissions from a user-selected ensemble of emission inventories and algorithms. It allows users to re-grid, combine, overwrite, subset, and scale emissions from different inventories through a configuration file and with no change to the model source code. The configuration file also maps emissions to model species with appropriate units. HEMCO can operate in offline stand-alone mode, but more importantly it provides an online facility for models to compute emissions at runtime. HEMCO complies with the Earth System Modeling Framework (ESMF) for portability across models. We present a new version here, HEMCO 3.0, that features an improved three-layer architecture to facilitate implementation into any atmospheric model and improved capability for calculating emissions at any model resolution including multiscale and unstructured grids. The three-layer architecture of HEMCO 3.0 includes (1) the Data Input Layer that reads the configuration file and accesses the HEMCO library of emission inventories and other environmental data, (2) the HEMCO Core that computes emissions on the user-selected HEMCO grid, and (3) the Model Interface Layer that re-grids (if needed) and serves the data to the atmospheric model and also serves model data to the HEMCO Core for computing emissions dependent on model state (such as from dust or vegetation). The HEMCO Core is common to the implementation in all models, while the Data Input Layer and the Model Interface Layer are adaptable to the model environment. Default versions of the Data Input Layer and Model Interface Layer enable straightforward implementation of HEMCO in any simple model architecture, and options are available to disable features such as re-gridding that may be done by independent couplers in more complex architectures. The HEMCO library of emission inventories and algorithms is continuously enriched through user contributions so that new inventories can be immediately shared across models. HEMCO can also serve as a general data broker for models to process input data not only for emissions but for any gridded environmental datasets. We describe existing implementations of HEMCO 3.0 in (1) the GEOS-Chem “Classic” chemical transport model with shared-memory infrastructure, (2) the high-performance GEOS-Chem (GCHP) model with distributed-memory architecture, (3) the NASA GEOS Earth System Model (GEOS ESM), (4) the Weather Research and Forecasting model with GEOS-Chem (WRF-GC), (5) the Community Earth System Model Version 2 (CESM2), and (6) the NOAA Global Ensemble Forecast System – Aerosols (GEFS-Aerosols), as well as the planned implementation in the NOAA Unified Forecast System (UFS). Implementation of HEMCO in CESM2 contributes to the Multi-Scale Infrastructure for Chemistry and Aerosols (MUSICA) by providing a common emissions infrastructure to support different simulations of atmospheric chemistry across scales.

Haipeng Lin↗
NASA NTRSDate not supplied

On The Processing of Log Files for Monitoring Antenna Health

In order to improve the quality of geodetic results, we have developed an infrastructure for timely processing of telemetry from IVS observing stations. We check every hour for new log files with telemetry from both VLBI observing sessions, single dish experiments, and stow-in data collection and automatically process them. The telemetry data we use is the system temperature, phase calibration phases and amplitudes, system equivalent flux density, and the differences between formatter clock and GPS clock. For the system temperature and phase calibration, processing includes filtering out outliers and computing averages and rms of the scatter in each scan. Furthermore, for the phase calibration we also compute the group delay and detect spurious signals. Cleaned and post-processed telemetry is archived. Our process detects abnormalities, such as, anomalously high system temperature, unstable phase calibration phases, jumps in the GPS and formatter clock differences, and others. With our procedure, the latency of detection of station abnormalities is reduced to less than two hours. Early detection of abnormalities reduces the amount of affected data since station personnel get early alerts. We discuss our experience of running this system since 2022.

Phase Calibration↗
NASA NTRSDate not supplied

On The Processing of Log Files for Monitoring Antenna Health

In order to improve the quality of geodetic results, we have developed an infrastructure for timely processing of telemetry from IVS observing stations. We check every hour for new log files with telemetry from both VLBI observing sessions, single dish experiments, and stow-in data collection and automatically process them. The telemetry data we use is the system temperature, phase calibration phases and amplitudes, system equivalent flux density, and the differences between formatter clock and GPS clock. For the system temperature and phase calibration, processing includes filtering out outliers and computing averages and rms of the scatter in each scan. Furthermore, for the phase calibration we also compute the group delay and detect spurious signals. Cleaned and post-processed telemetry is archived. Our process detects abnormalities, such as, anomalously high system temperature, unstable phase calibration phases, jumps in the GPS and formatter clock differences, and others. With our procedure, the latency of detection of station abnormalities is reduced to less than two hours. Early detection of abnormalities reduces the amount of affected data since station personnel get early alerts. We discuss our experience of running this system since 2022.

VLBI↗
DOE OSTI2021

Reanalysis of Water Withdrawal for Irrigation, Electric Power, and Public Supply Sectors in the Conterminous United States, 1950–2016

Accurately measuring water use by the economy is essential for developing reliable models of water resource availability. Indeed, these models rely on retrospective analyses that provide insights into shifting human population demands and adaptions to water shortages. However, accurate, methodologically consistent, empirically authentic, and spatiotemporally comprehensive historical datasets for water withdrawals are scarce. Herein, we present a reanalysis of annual resolution (1950–2016) historical data set on irrigation, electric power, and public supply water withdrawal within the conterminous United States (US) at the county-level, and, for power plants, at the site-level. To estimate electric power water use, we synthesized a historically comprehensive list of generators and historic patterns in generation across fuels, prime movers, and cooling technologies. Irrigation water use estimation required building a crop-demand model that utilized historical information on irrigated acreage for crops and golf courses, stage-specific crop water demand, and climate information. To estimate public water supply use, we developed a random forest model constructed from information on population, infrastructure, climate, and land cover. These estimates generally agree with total county and state water use information provided by the US Geological Survey (USGS) water use circular and estimates generated from independent studies for specific years. However, we also observed discrepancies between our estimates and USGS data that appear to be caused by inconsistencies in the methods used by the USGS's primary data sources at the state level over decades of data collection, highlighting the importance of reanalysis to yield spatiotemporally consistent and intercomparable estimates of water use.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

Software and Hardware Development for the Mu2e Trigger and Data Acquisition System

The Mu2e experiment at Fermilab will be 10,000 times more sensitive than previous experiments looking for muon-to-electron conversion. This precise and complex experimental apparatus will produce 200 million billion muons per year. The accelerator complex repurposes elements of the infrastructure that produced high energy proton and anti-protons beams for the Tevatron experiments to produce the high-intensity muon beams necessary for Mu2e and the Muon (g-2) experiments.

43 PARTICLE ACCELERATORS↗
NASA NTRS2023

Youngstown and Warren Disasters: Mapping Flood Susceptibility, Vulnerability, and Risk and Tree Canopy Coverage in Northern Ohio to Inform Stormwater Management and Flood Mitigation Efforts

Both pluvial and fluvial flooding events pose direct challenges on urban infrastructure and communities across the United States. Heavy rainfall events oversaturate the ground, overflow waterbodies, and overwhelm stormwater infrastructure. Vulnerable areas receive heavy damage from flooding events due to physical factors like increased impervious surfaces, poor stormwater systems, and limited greenspaces. These vulnerable neighborhoods are comprised of aging populations, minority communities, and lower income levels. Lack of data in these communities have made it difficult to implement policymaking and flood mitigation strategies. Using the Urban Flood Risk Mitigation model (InVEST) and the PlanetScope satellite constellation, the team visualized historical flooding and tree canopy coverage as a measure of flood susceptibility. The team also used the Arc-Malstrom model to provide further insight into where flooding accumulates via surface elevation depressions in the study area. To validate these models, the team explored the spatial variation of rainfall events using NASA’s Integrated Multi-satellite Retrievals for Global Precipitation Measurement (GPM IMERG). The resulting maps highlight areas surrounding the cities of Youngstown and Warren as being the most flood susceptible and socially vulnerable, while the city centers contain the lowest tree canopy coverage. The DEVELOP team collaborated with the Environmental Collaborative of Ohio (ECO) to create products for end users within the City of Warren’s Water Pollution Control Department, the Eastgate Regional Council of Governments and the Healthy Community Partnership of Mahoning Valley. These products help identify target areas for preventative flood mitigation measures as well as areas ideal for green infrastructure intervention.

InVEST Urban Flood Risk Mitigation Model↗
NASA NTRS2005

Creating Communications, Computing, and Networking Technology Development Road Maps for Future NASA Human and Robotic Missions

For human and robotic exploration missions in the Vision for Exploration, roadmaps are needed for capability development and investments based on advanced technology developments. A roadmap development process was undertaken for the needed communications, and networking capabilities and technologies for the future human and robotics missions. The underlying processes are derived from work carried out during development of the future space communications architecture, an d NASA's Space Architect Office (SAO) defined formats and structures for accumulating data. Interrelationships were established among emerging requirements, the capability analysis and technology status, and performance data. After developing an architectural communications and networking framework structured around the assumed needs for human and robotic exploration, in the vicinity of Earth, Moon, along the path to Mars, and in the vicinity of Mars, information was gathered from expert participants. This information was used to identify the capabilities expected from the new infrastructure and the technological gaps in the way of obtaining them. We define realistic, long-term space communication architectures based on emerging needs and translate the needs into interfaces, functions, and computer processing that will be required. In developing our roadmapping process, we defined requirements for achieving end-to-end activities that will be carried out by future NASA human and robotic missions. This paper describes: 10 the architectural framework developed for analysis; 2) our approach to gathering and analyzing data from NASA, industry, and academia; 3) an outline of the technology research to be done, including milestones for technology research and demonstrations with timelines; and 4) the technology roadmaps themselves.

Bhasin, Kul↗
NASA NTRSDate not supplied

Space Communications in Support of the Artemis Program

NASA has been challenged to send the first woman and first person of color to the South Pole of the moon by 2024. Named the Artemis Program, this effort serves as a proving ground for the greater Moon-to-Mars campaign and establishes a lunar outpost by 2028. The Artemis Program relies on simultaneous operation of multiple flight assets separated by large angular distances that require a unique communication strategy and is a departure from the previous Apollo-era architecture. NASA’s Space Communications and Navigation (SCaN) Program is designing a scalable, extensible, and reusable network architecture to provide communication and navigation services in support of lunar exploration. This architecture serves at the foundational infrastructure, paving the way for future exploration of Mars. In pursuance of this new architecture, the SCaN Program is augmenting NASA’s space communications networks by upgrading the current 34-meter beam waveguide antenna systems and incorporating an 18-meter class subnet. This paper presents an overview of NASA’s plans to provide high data rate communication and navigation services for lunar exploration efforts including: operations concepts to support the lunar communications architecture, major network enhancements and new capabilities, and a Mars-forward approach that maximizes the reuse of these capabilities. Capabilities include:(1) Delay/Disruption Tolerant Networking (DTN), (2) Multiple Spacecraft Per Aperture (MSPA, also known as Multiple Spacecraft Per Antenna), and (3) Simultaneous Ka-band uplink and downlink. The mid-2020s era is a historic opportunity to advance NASA’s space communications infrastructure as humans return to the moon and continue to interplanetary exploration, starting with Mars. The space communication infrastructure is a lifeline that supports these endeavors, furthering humankinds’ exploration and understanding of the universe.

Philip A Baldwin↗
DOE OSTI2023

Deliver Signal Phase and Timing (SPAT) for Energy Optimization of Vehicle Cohort Via Cloud-Computing and LTE Communications

Predictive Signal Phase and Timing (SPAT) message set is one fundamental building block for vehicle-to-infrastructure (V2I) applications such as Eco-Approach and Departure (EAD) at traffic signal controlled urban intersections. Among the two complementary communication methods namely short-range sidelink (PC5) and long-range cellular radio link (Uu), this paper documents the work with long-range link: the complete data chain includes connecting to the traffic signals via existing backhaul communication network, collecting the raw signal phase state data, predicting the signal state changes and delivering the SPAT data via a geofenced service to requests over HTTP protocols. An Application Programming Interface (API) library is developed to support various cellular data transmission reduction and latency improvement techniques. An emulation-based algorithm is applied to predict the traffic signal state changes to provide adequate prediction horizon (e.g., at minimum 2 minutes) for the cohort energy optimization. In fact, the same connectivity and SPAT delivery methodology has been applied to traffic signalized intersections nationwide in the United States upon public agency approvals for access to their firewalled traffic control network and signal control systems or directly to individual controllers. This methodology proves its effectiveness and potential for rapid growth of such SPAT deliveries at mass production scale without needing infrastructure hardware retrofit or excessive communication means. To support the energy optimization of light and heavy-duty vehicle cohorts of mixed automation and propulsion systems (EV, ICE and hybrid), the connection and SPAT deliveries at two sites were completed, including public roads in Washtenaw County, Michigan and closed track test sites at American Center for Mobility (ACM) in Ypsilanti, Michigan. However, only closed test track results at ACM will be presented in this paper. A neuroevolution based optimizer is developed and implemented to control the speed of a vehicle cohort with different propulsion systems and automation levels. Closed track tests showed significant energy savings of the cohort operation.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2021

A framework for integrated dispatching and charging management of an autonomous electric vehicle ride-hailing fleet

The convergence of electrification and automated driving will introduce opportunities to improve the operation and energy-efficiency of transportation systems. This paper discusses the challenges of dispatching autonomous electric vehicles (AEVs) in a ride-hailing fleet and their interactions with charging infrastructure. An integrated decision-making framework for dispatching and charging has been proposed using system optimization approaches. An agent-based platform has been developed for simulating and testing the proposed methods. A case study using New York City taxi data has been performed with different fleet sizes, dispatching strategies, and charging networks. Advantages of optimization-based approaches for AEV fleet management have been studied and demonstrated, for example, for a fleet of 1,750 AEVs to meet 100,000 daily requests, optimization-based centralized fleet management would result in 14% more ride requests satisfied and 43% fewer zero-occupancy miles traveled than if AEVs make independent decisions based on heuristic strategy. Benefits on reducing fleet size and charging downtime from optimization approaches are also comprehensively illustrated.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2026

System-of-systems optimization of hydrogen infrastructure for heavy-duty freight corridors: The interstate 10 case study

Medium and heavy-duty freight transportation requires hydrogen energy infrastructure that is cost-effective, operationally reliable, spatially coherent, and resilient to demand variability along major corridors. This paper presents an integrated hydrogen corridor planning framework using Oak Ridge National Laboratory's OR-AGENT that couples freight-driven, route-resolved hydrogen demand modeling with optimized station siting, sizing, and station-level techno-economic analysis. The framework is demonstrated for the Interstate 10 freight corridor and the Houston-to-Los-Angeles region. Hydrogen demand is derived from high-resolution origin–destination freight data, duty-cycle characterization, and physics-based energy consumption modeling. Candidate refueling sites are selected from existing heavy-duty diesel fueling locations and optimized subject to onboard storage and station capacity constraints. Resulting station throughputs are evaluated using established techno-economic models for electrolytic hydrogen production and dispensing infrastructure. Results show that a regional, portfolio-level aggregation, average dispensed electrolytic hydrogen cost of $6.87–$7.26/kg is currently feasible, and is strongly influenced by demand density and utilization.

Sujan, Vivek [ORNL] (ORCID:0000000269882342)↗
NASA NTRS2016

The Earth Observing System (EOS) Ground System: Leveraging an Existing Operational Ground System Infrastructure to Support New Missions

The Earth Observer System (EOS) was officially established in 1990 and went operational in December 1999 with the launch of its flagship spacecraft Terra. Aqua followed in 2002 and Aura in 2004. All three spacecraft are still operational and producing valuable scientific data. While all are beyond their original design lifetime, they are expected to remain viable well into the 2020s. The EOS Ground System is a multi-mission system based at NASA Goddard Space Flight Center that supports science and spacecraft operations for these three missions. Over its operational lifetime to date, the EOS Ground System has evolved as needed to accommodate mission requirements. With an eye towards the future, several updates are currently being deployed. Subsystem interconnects are being upgraded to reduce data latency and improve system performance. End-of-life hardware and operating systems are being replaced to mitigate security concerns and eliminate vendor support gaps. Subsystem hardware is being consolidated through the migration to Virtual Machine based platforms. While mission operations autonomy was not a design goal of the original system concept, there is an active effort to apply state-of-the-art products from the Goddard Mission Services Evolution Center (GMSEC) to facilitate automation where possible within the existing heritage architecture. This presentation will provide background information on the EOS ground system architecture and evolution, discuss latest improvements, and conclude with the results of a recent effort that investigated how the current system could accommodate a proposed new earth science mission.

Earth Science Mission Operations (ESMO)↗
DOE OSTI2023

Opportunities for wave energy in bulk power system operations

Wave energy resources have high, yet largely untapped potential as candidate generation technology. In this paper, we perform a data-driven analysis to characterize the impact of wave energy integration on bulk-scale power systems and market operations. Through data-driven sensitivity studies centered on an optimization-based production cost modeling formulation, our work characterizes the inflection point beyond which wave integration starts impacting power system operations, considering present day transmission infrastructure. Furthermore, our analysis also considers the joint effects of wave energy integration and system-wide transmission expansion. Finally, potential resilience scenarios such as wildfire-driven transmission contingencies and heat wave events are investigated, whereby the contributions of grid-integrated wave energy in alleviating the effects of the resilience events are analyzed. As our demonstration test bed, we consider a reduced-order network topology for the U.S. Western Interconnection with wave energy generation integrated at carefully selected sites across the coastal areas of Washington, Oregon, and northern California. Our results indicate that over a representative year of operations, wave energy integration systematically reduces locational marginal prices (LMPs) of energy and price volatility, especially during periods of high wave resource availability (winter months for the U.S. west coast). Average, maximum, and minimum of hourly LMPs over a typical year of operation was reduced by 2.95, 51.28, and 1.13 $\$$/MWh respectively (over a baseline scenario with no wave energy integration), when the selected network model had a total of 5000 MW wave power installed capacity during the representative year of study. The effects of wave energy integration can remain localized with existing transmission infrastructure (identified to be most pronounced in the Pacific Northwest region in the example we studied). However, with concurrent transmission expansion, the impacts of wave energy integration are likely to have a higher geographical spread. Our results also indicate that wave energy may be able to assist power system operations during resilience events such as major transmission contingencies and heat wave events, although such benefits might be dependent on factors such as proximity of affected area to wave resources, availability of adequate resource potential and adequate transmission capacity.

16 TIDAL AND WAVE POWER↗
DOE OSTI2024

Observational Constraints on the Spatial Effect of Greenness and Canopy Cover on Urban Heat in a Major Midlatitude City

Abstract Urban heat stress is a critical issue, particularly in cities where dense infrastructure and limited green space exacerbate temperature extremes. This study investigates the impact of greenery (EVI2), canopy cover (CC), impervious cover (IC), and water bodies on heat index in Chicago using high‐resolution data from the Heat Watch campaign. We find that EVI2, CC and proximity to water body significantly reduce heat while IC increases heat, particularly in the afternoon when solar radiation is intense. Additionally, the effective radius that land cover impacts heat is smaller in the afternoon. The combined effect analysis indicates that enhancing total greenness, not just canopy cover, is the most effective strategy to reduce heat. This study underscores the importance of strategic vegetation management, highlighting the critical role of integrated approaches in reducing urban heat.

Lee, Jangho↗
DOE OSTI2024

Blockchain-Enabled Secure Device-to-Device Communication in Software-Defined Networking

The Internet of Things (IoT) continues to increase the demand for seamless communication among IoT devices. The rapid growth of IoT devices has led to an exponential increase in device-to-device (D2D) communication within the Software-Defined Networking (SDN), though it enables a flexible archi-tecture for managing network resources. However, traditional security models face challenges (e.g., Security, privacy, and trust) in addressing the dynamic and decentralized nature of these communications. Despite of these challenges, this paper proposes a novel approach that leverages blockchain technology to enhance the security, privacy, and trustworthiness of D2D communication within an SDN environment. The proposed approach integrates blockchain nodes in sDN components to establish a decentralized ledger for transparent and verifiable records. Smart contracts enforce authentication rules to ensure that only authenticated devices can access the network and engage in transactions securely. It also automates the security policies to ensure temper resistance execution using the cryptographic mechanism for data integrity and authentic communication. The Implementation of the proposed algorithms validates the resilience of the proposed approach against cyberattacks. Overall, the proposed approach enables efficient and secure D2D communication for resilient SDN infrastructure in IoT ecosystems.

Das, Debashis↗