Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data locality”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15
All sourcesNASA NTRSDOE OSTI
NASA NTRS2015

High-Resolution Mesoscale Model Setup for the Eastern Range and Wallops Flight Facility

Mesoscale weather conditions can have an adverse effect on space launch, landing, ground processing, and weather advisories, watches, and warnings at the Eastern Range (ER) in Florida and Wallops Flight Facility (WFF) in Virginia. During summer, land-sea interactions across Kennedy Space Center (KSC) and Cape Canaveral Air Force Station (CCAFS) lead to sea breeze front formation, which can spawn deep convection that can hinder operations and endanger personnel and resources. Many other weak locally-driven low-level boundaries and their interactions with the sea breeze front and each other can also initiate deep convection in the KSC/CCAFS area. These convective processes often last 60 minutes or less and pose a significant challenge to the local forecasters. Surface winds during the transition seasons (spring and fall) pose the most difficulties for the forecasters at WFF. They also encounter problems forecasting convective activity and temperature during those seasons. Therefore, accurate mesoscale model forecasts are needed to better forecast a variety of unique weather phenomena. Global and national scale models cannot properly resolve important local-scale weather features at each location due to their horizontal resolutions being much too coarse. Therefore, a properly tuned local data assimilation (DA) and forecast model at a high resolution is needed to provide improved capability. To accomplish this, a number of sensitivity tests were performed using the Weather Research and Forecasting (WRF) model in order to determine the best DA/model configuration for operational use at each of the space launch ranges to best predict winds, precipitation, and temperature. A set of Perl scripts to run the Gridpoint Statistical Interpolation (GSI)/WRF in real-time were provided by NASA's Short-term Prediction Research and Transition Center (SPoRT). The GSI can analyze many types of observational data including satellite, radar, and conventional data. The GSI/WRF scripts use a cycled GSI system similar to the operational North American Mesoscale (NAM) model. The scripts run a 12-hour pre-cycle in which data are assimilated from 12 hours prior up to the model initialization time. A number of different model configurations were tested for both the ER and WFF by varying the horizontal resolution on which the data assimilation was done. Three different grid configurations were run for the ER and two configurations were run for WFF for archive cases from 27 Aug 2013 through 10 Nov 2013. To quantify model performance, standard model output will be compared to the Meteorological Assimilation Data Ingest System (MADIS) data. The MADIS observation data will be compared to the WRF forecasts using the Model Evaluation Tools (MET) verification package. In addition, the National Centers for Environmental Prediction's Stage IV precipitation data will be used to validate the WRF precipitation forecasts. The author will summarize the relative skill of the various WRF configurations and how each configuration behaves relative to the others, as well as determine the best model configuration for each space launch range.

Watson, Leela R.↗
NASA NTRS2018

Climatespark: an In-Memory Distributed Computing Framework for Big Climate Data Analytics

The unprecedented growth of climate data creates new opportunities for climate studies, and yet big climate data pose a grand challenge to climatologists to efficiently manage and analyze big data. The complexity of climate data content and analytical algorithms increases the difficulty of implementing algorithms on high performance computing systems. This paper proposes an in-memory, distributed computing framework, ClimateSpark, to facilitate complex big data analytics and time-consuming computational tasks. Chunking data structure improves parallel I/O efficiency, while a spatiotemporal index is built for the chunks to avoid unnecessary data reading and preprocessing. An integrated, multi-dimensional, array-based data model (ClimateRDD) and ETL operations are developed to address big climate data variety by integrating the processing components of the climate data lifecycle. ClimateSpark utilizes Spark SQL and Apache Zeppelin to develop a web portal to facilitate the interaction among climatologists, climate data, analytic operations and computing resources (e.g., using SQL query and Scala/Python notebook). Experimental results show that ClimateSpark conducts different spatiotemporal data queries/analytics with high efficiency and data locality. ClimateSpark is easily adaptable to other big multiple- dimensional, array-based datasets in various geoscience domains.

Hu, Fei↗
NASA NTRS2017

Transformers for Lunar Extreme Environments: Ensuring Long-Term Operations in Regions of Darkness and Low Temperatures: II - Phase

This report shows how solar power could enable robotic operations in permanently shaded regions at lunar poles, to extract water ice and further produce liquid hydrogen and oxygen (LH2/LO2) propellant. The power needs are derived from an Architecture for Human Exploration of Mars based entirely on lunar propellant. The extraction of 10 metric tons of water per day (at 10% water in regolith) requires approx. 0.6 MW thermal power. Additional approx. 2 MW electric power are required to produce 7.5 metric tons of LH2/LO2 propellant per day, as needed by the architecture. To provide power to processing equipment inside Shackleton Crater, optimal locations are determined on the crater rim, from which several reflecting TransFormers (TFs) would redirect sunlight, achieving a combined period of illumination of approx. 99% of the year. A single 40-m diameter reflector could provide up to 1 MW solar power. Inflatable rigidizable tower support structures raise reflectors above ground for better solar exposure. There are trade-offs: e.g., two reflectors at ground level would provide the same combined total illumination as a single tower approx. 100-m tall. Such a TF based on a 100-m tower made with inflatable 2-m beams and 40-m diameter reflectors would be of similar dimensions as an MSL-class rover (approx. 1000 kg, 10 m(exp 3)). A TF-prospector rover combo could be designed and deployed in a Discovery-class mission searching for water. The TransFormers would be nodes of a Lunar Utilities Infrastructure that provides solar power year-round in the proximity of the pole, as well as local data transmission andintermittent direct to earth communications. This infrastructure would be instrumental infacilitating the development of a lunar economy.

fuel↗
NASA NTRS2022

Regional Variations of Mercury's Crustal Density and Porosity From MESSENGER Gravity Data

A new solution of Mercury's gravity field to degree and order 160, named HgM009, is retrieved through a reprocessing of MESSENGER radio science measurements. By combining our latest gravity field with topography data, localized spectral admittance analyses are carried out to investigate Mercury's crustal and lithospheric properties across the northern hemisphere. The measured spectra are compared with admittances predicted by lithospheric flexure models. The localized gravity/topography admittance analyses yield key information on the lateral variations of the bulk density of the upper crust. Elastic and crustal thicknesses are also adjusted in our study, but the local admittance spectra allow us to constrain these parameters only over a few regions. The average bulk density across the observed areas in the northern hemisphere is 2540 ±60 kg m −3 . The crustal porosity is then constrained by using an estimate of the pore-free grain density of surface materials with our measured bulk density. Our estimate of the mean porosity is 14.7 ±1.6 %, which is comparable to, but slightly higher than, the average value measured on the Moon. Larger crustal porosities are observed over heavily cratered regions, suggesting that impact bombardment is the main cause of the crustal porosity.

Mercury's crust↗
DOE OSTI2015

Scalable Out-of-Core Solvers on Xeon Phi Cluster

This paper documents the implementation of a distributive out-of-core (OOC) solver for performing LU and Cholesky factorizations of a large dense matrix on clusters of many-core programmable co-processors. The out-of- core algorithm combines both the left-looking and right-looking schemes aimed to minimize the movement of data between the CPU host and the co-processor, optimizing data locality as well as computing throughput. The OOC solver is built to align with the format of the ScaLAPACK software library, making it readily portable to any existing codes using ScaLAPACK. A runtime analysis conducted on Beacon (an Intel Xeon plus Intel Xeon Phi cluster which composed of 48 nodes of multi-core CPU and MIC) at the Na- tional Institute for Computational Sciences is presented. Comparison of the performance on the Intel Xeon Phi and GPU clusters are also provided.

D'Azevedo, Ed F↗
DOE OSTI2016

Early Experiences Writing Performance Portable OpenMP 4 Codes

In this paper, we evaluate the recently available directives in OpenMP 4 to parallelize a computational kernel using both the traditional shared memory approach and the newer accelerator targeting capabilities. In addition, we explore various transformations that attempt to increase application performance portability, and examine the expressiveness and performance implications of using these approaches. For example, we want to understand if the target map directives in OpenMP 4 improve data locality when mapped to a shared memory system, as opposed to the traditional first touch policy approach in traditional OpenMP. To that end, we use recent Cray and Intel compilers to measure the performance variations of a simple application kernel when executed on the OLCF s Titan supercomputer with NVIDIA GPUs and the Beacon system with Intel Xeon Phi accelerators attached. To better understand these trade-offs, we compare our results from traditional OpenMP shared memory implementations to the newer accelerator programming model when it is used to target both the CPU and an attached heterogeneous device. We believe the results and lessons learned as presented in this paper will be useful to the larger user community by providing guidelines that can assist programmers in the development of performance portable code.

Joubert, Wayne↗
DOE OSTI2017

Distributed-Memory Breadth-First Search on Massive Graphs. IN: Parallel Graph Algorithms

This chapter studies the problem of traversing large graphs using the breadth-first search order on distributed-memory supercomputers. We consider both the traditional level-synchronous top-down algorithm as well as the recently discovered direction optimizing algorithm. We analyze the performance and scalability trade-offs in using different local data structures such as CSR and DCSC, enabling in-node multithreading, and graph decompositions such as 1D and 2D decomposition.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

High Performance Computing Traffic Simulations for Real-Time Traffic Control of Mobility in Chattanooga Region

In 2019, highway congestion wasted over 3 billion gallons of fuel and caused 8.8 billion hours of lost productivity.1 Research has shown that introducing near-real time traffic controls can significantly reduce congestion. Validated and calibrated traffic simulations enable the modeling of transportation systems and the evaluation of different traffic control actions and schemes given a variety of circumstances that represent likely future scenarios. The developed scenarios can inform the deployment of controls in near real-time to improve freight and passenger vehicle congestion and energy use. In this work, we present simulations used to model the traffic in the Chattanooga, Tennessee, metropolitan area. Simulations were constructed and calibrated using a variety of local, data science enhanced, data sources utilizing open source software including the Simulation of Urban Mobility (SUMO) simulator. High-Performance Computing (HPC) provides a scalable platform with enough computing for the high-fidelity simulation of many scenarios and the application of advance data science especially for large-scale systems. Our simulations include microscopic simulations at a corridor level for traffic signal control, and mesoscopic simulations to evaluate regional operational controls and infrastructure.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Enhancing Security and Resiliency in Operational Technology Environments Through Network Slicing and Federated Learning

The growing convergence of Information Technology (IT) and Operational Technology (OT) within Industry 4.0 environments has introduced new demands on industrial network infrastructure. As cyber-physical systems become increasingly interconnected, ensuring the secure, timely, and efficient exchange of critical data is essential. This thesis explores how network slicing, a method of creating isolated virtual network segments, can be applied within OT environments to address challenges such as latency, security, and resource allocation. The first research question addressed in this thesis is: How can OT networks take advantage of NFV and SDN technology to become cyber resilient? This study examines the operational, security, and architectural implications of introducing network slicing into traditionally static OT infrastructures such as Industrial Control Systems (ICS) and SCADA. Through simulated deployments and case studies, the research demonstrates how slicing enables better isolation between critical and non-critical services, thereby improving response time, throughput, and security in sensitive environments. The second question considers: How to dynamically implement network slicing and take advantage of network resources towards integrating decentralized machine learning? In response, this thesis proposes a framework that combines Software-Defined Networking (SDN), Network Function Virtualization (NFV), and Federated Learning (FL) to enable real-time analytics while maintaining data locality. The proposed approach reduces the burden on centralized infrastructure and minimizes privacy risks by supporting on-site training of models across distributed OT nodes, coordinated through dynamically allocated network slices. The third focus explores: How slicing helps to increase the resiliency of OT networks through the orchestration of a dynamic DMZ? To answer this, the thesis presents a method for creating and managing Dynamic Demilitarized Zones (DMZs) using network slicing. This enables flexible and automated isolation of sensitive subsystems during threat scenarios or high-risk operations. Coupled with intelligent orchestration and containerized security services, the dynamic DMZ significantly enhances the system's ability to respond to cyber incidents without halting production. Ultimately, this thesis contributes a comprehensive architecture that blends network slicing with machine learning, secure segmentation, and automation, paving the way for resilient, adaptive, and intelligent OT environments. Performance evaluations across multiple scenarios show improvements in system reliability, threat response time, model accuracy, and resource utilization, providing a strong foundation for future industrial automation systems.

Rodiles Delgado, Brian G↗
DOE OSTI2023

CASTLE: Conflict Analysis Strategy Testing Laboratory Environment v.1.0.0

SAND2024-01743O The Conflict Analysis Strategy Testing Laboratory Environment (CASTLE) is a software framework that enables and simplifies building a novel, turn-based strategy game in which it can define its own rules, maps, pieces, and interactions. The software is for novice to experienced programmers with some knowledge of Unity3D, a tool used in game production. CASTLE includes a library of common game mechanics used for strategic wargames and traditional board games, such as cards, tokens, dice, and grid maps. It follows design principles popularized by the video game industry and uses singletons for managing portions of the code. CASTLE builds on Unity's component-based design and can respond to engine events during execution. Among the numerous user-friendly features: Build games quickly and cost-effectively Network in real-time and apply data to new games developed on the framework Host multiple participants online Connect rule- or machine learning-based agents to a CASTLE game to serve as opponents or to simulate games Collect data collection from players and in-game behaviors Create a survey to gather demographics or opinions from players Store data locally or save it to an external database through Representational State Transfer (REST) functions CASTLE, which was prototyped using Microsoft Azure, is also designed for easily distributing online games using popular cloud services. The multiplayer functionality includes an agent interface, allowing developers to construct AI players that can substitute for humans in any of the games. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Fabian, Nathan↗
DOE OSTI2018

Drivers of Change Analysis for Local GHG Emissions: Data for Better Decisions

The City of Bellevue, Washington, and ICLEI Local Governments for Sustainability with funding from the Energy Departments Cities Leading through Energy Analysis and planning (Cities-LEAP) program, developed a toolkit to give cities more insight into what is driving changes in local greenhouse gas (GHG) emissions from year to year.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

Symmetry-mode analysis for local structure investigations using pair distribution function data

Symmetry-adapted distortion modes provide a natural way of describing distorted structures derived from higher-symmetry parent phases. Structural refinements using symmetry-mode amplitudes as fit variables have been used for at least ten years in Rietveld refinements of the average crystal structure from diffraction data; more recently, this approach has also been used for investigations of the local structure using real-space pair distribution function (PDF) data. Here, the value of performing symmetry-mode fits to PDF data is further demonstrated through the successful application of this method to two topical materials: TiSe2, where a subtle but long-range structural distortion driven by the formation of a charge-density wave is detected, and MnTe, where a large but highly localized structural distortion is characterized in terms of symmetry-lowering displacements of the Te atoms. Here, the analysis is performed using fully open-source code within the DiffPy framework via two packages developed for this work: isopydistort, which provides a scriptable interface to the ISODISTORT web application for group theoretical calculations, and isopytools, which converts the ISODISTORT output into a DiffPy-compatible format for subsequent fitting and analysis. These developments expand the potential impact of symmetry-adapted PDF analysis by enabling high-throughput analysis and removing the need for any commercial software.

36 MATERIALS SCIENCE↗
DOE OSTI2025

HPC Campaign Management: Remote data access with user-defined error bound using ADIOS and ZFP

Remote access to large-scale scientific datasets, like those generated by combustion simulations or other high-performance computing (HPC) applications, presents a significant challenge. Downloading entire datasets is often impractical due to their size and the bandwidth limitations of typical networks. To address this challenge, we propose a novel approach that enables efficient remote access to large datasets distributed across multiple facilities. Our method enables technologies to download only the data values of a select variable, in a select region of interest, to a user-defined accuracy. For this purpose, we extended the ADIOS IO library to provide read functions with user-defined accuracy, a remote data server that understands multidimensional selections of specific variables, steps and accuracy from an ADIOS dataset, and which uses lossy compression on the remote site to reduce the data to be transferred back to the client. In addition, our extension of the ADIOS library collects metadata from multiple datasets in small files called Campaign Archives, which can be shared among project participants on any HPC, cloud or laptop, and which can easily facilitate the discovery of content and pointers to the data location as well as remote access to the data by local tools as if data was local. This feature called Campaign Management, enables a group of scientists to manage related datasets stored in multiple files, across multiple facilities as if it was in a single file/database. We demonstrate the effectiveness of our approach using a 1.5 TB dataset from the S3D combustion simulation on Frontier at the Oak Ridge Leadership Facility. Even a single variable from this dataset, at 64 GB, is too large to be processed on a standard laptop. We show two different reading patterns for 2D plots and 3D visualization, with careful settings that a scientist studying combustion data would do and show that running the same Python scripts on Frontier directly takes comparable time than running them on the local laptop with remote access to the data on Frontier.

Podhorszki, Norbert [ORNL] (ORCID:000000019647542X↗
DOE OSTI2022

A preference for cold dark matter over Superfluid Dark Matter in local Milky Way data

There are many well-known correlations between dark matter and baryons that exist on galactic scales. These correlations can essentially be encompassed by a simple scaling relation between observed and baryonic accelerations, historically known as the Mass Discrepancy Acceleration Relation (MDAR). The existence of such a relation has prompted many theories that attempt to explain the correlations by invoking additional fundamental forces on baryons. The standard lore has been that a theory that reduces to the MDAR on galaxy scales but behaves like cold dark matter (CDM) on larger scales provides an excellent fit to data, since CDM is desirable on scales of clusters and above. However, this statement should be revised in light of recent results showing that a fundamental force that reproduces the MDAR is challenged by local Milky Way dynamics and rotation curve data between 5–18 kpc. In this study, we test this claim on the example of Superfluid Dark Matter. We find that a standard CDM model is preferred over a static superfluid profile assuming a steady-state Galactic disk and discuss the robustness of this conclusion to disequilibrium effects. This preference is due to the fact that the superfluid model over-predicts vertical accelerations, even while reproducing galactic rotation curves. Our results establish an important criterion that any dark matter model must satisfy within the Milky Way.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2018

Scaling and data collapse from local moments in frustrated disordered quantum spin systems

Recently measurements on various spin–1/2 quantum magnets such as H 3 LiIr 2 O 6 , LiZn 2 Mo 3 O 8 , ZnCu 3 (OH) 6 Cl 2 and 1T-TaS 2 —all described by magnetic frustration and quenched disorder but with no other common relation—nevertheless showed apparently universal scaling features at low temperature. In particular the heat capacity C[H, T] in temperature T and magnetic field H exhibits T/H data collapse reminiscent of scaling near a critical point. Here we propose a theory for this scaling collapse based on an emergent random-singlet regime extended to include spin-orbit coupling and antisymmetric Dzyaloshinskii-Moriya (DM) interactions. We derive the scaling C[H, T]/T ~ H- γ F q [T/H] with F q [x] = x q at small x, with q ϵ {0, 1, 2} an integer exponent whose value depends on spatial symmetries. The agreement with experiments indicates that a fraction of spins form random valence bonds and that these are surrounded by a quantum paramagnetic phase. We also discuss distinct scaling for magnetization with a q-dependent subdominant term enforced by Maxwell’s relations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
NASA NTRSDate not supplied

MISR Level 1B1 Local Mode Radiance Data (MIB1LM_V1)

The results of two types of processing are included in this product. First, the Radiance Scaling operation converts the camera's digital number output to a measure of energy incident on the front optical surface. The measurement is expressed in units called radiance (energy per unit area, wavelength, and solid angle) as defined by the International Standard (SI). Second, Radiance Conditioning modifies the radiances to remove instrument-dependent effects. Specifically, image sharpening is applied, and focal-plane scattering is removed. Additionally, all radiances are adjusted to remove slight spectral sensitivity differences among the 1504 detector elements of each spectral band and each camera. In addition to the Level 1B1 radiometric product for MISR's Global Mode imagery, there is a separate Level 1B1 product for each high-resolution Local Mode scene. The Radiometric Product contains spectral radiances for all MISR channels (four spectral bands and nine cameras). Each radiance value represents the incident radiance averaged over the sensor's total band response. Processing includes both radiance scaling and conditioning steps. Radiance scaling converts the Level 1A data from digital counts to radiances using coefficients derived in combination with the On-Board Calibrator (OBC) and vicarious calibrations. The OBC contains Spectralon calibration panels which are deployed monthly and reflect sunlight into the cameras. The OBC detector standards then measure this reflected light to provide the calibration. Vicarious field campaigns are conducted less frequently but provide an independent methodology useful for reducing systematic errors. Radiance conditioning removes undesirable instrument effects. Image enhancement is provided by deconvolving the scene with the sensor's point-spread-function. Additionally, in-band scaling adjusts the reported radiances to correspond to a nominal band response profile. This frees the Level 2 software from the need to correct for detector element non-uniformities. No out-of-band correction is done for this product, nor are the data geometrically corrected or resampled at this point. In summary, the Level 1B1 Product contains the Data Numbers (DNs) radiometrically-scaled to radiances with no geometric resampling. [Location=GLOBAL] [Temporal_Coverage: Start_Date=2000-02-24; Stop_Date=] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=180] [Data_Resolution: Latitude_Resolution=275 m for red band only; Longitude_Resolution=275 m for red band only; Horizontal_Resolution_Range=250 km - < 500 km or approximately 2.5 degrees - < 5.0 degrees; Temporal_Resolution=about 15 orbits/day].

NEAR IR IMAGERY↗