Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data locality”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,315 records · Page 73

Evaluation of turbulent heating predictions with flight data.

The results of three turbulent heating predictions have been compared to the data of several reentry vehicles. Details and comparisons of each technique with the data are presented. The data analyzed cover a range of local Mach numbers of 3.3 to 15.2, wall to boundary layer edge temperature ratio of 0.46 to 2.6, and local Reynolds number of 7 to 530 millions. The data were transformed to an incompressible plane, using the three prediction methods, and compared with the Colburn and von Karman forms of the Reynolds analogy.

Laganelli, A. L.↗

Estimation of local planetary gravity fields using line of sight gravity data and an integral operator

A novel method is presented for mapping line-of-sight gravity data (LOSGD) joining planetary probes and observers during Doppler tracking operations, with a view to geodetic and geophysical applications. LOSGD are in this case mapped as gravity anomalies along a radial direction, at constant altitude, using an inversion procedure in conjunction with a Tikhonov-Arsenine regularization method. The application of different regularization-parameter choices to a synthetic case is followed by application to the real case of Pioneer-Venus orbiter data for Venus' Gula Mons.

Barriot, J. P.↗

The Enhancement of Water Ice Content in the Local Area Northeast of Arcadia Planitia: Evidence from Neutron Data from HEND (Mars Odyssey) and Elevation from MOLA (MGS)

The first year of neutron mapping measurements from the Mars Odyssey spacecraft revealed enormous hydrogen-rich regions in the southern and northern hemispheres of the Martian crust that imply significant amounts of near surface water ice. The hydrogen-rich areas of the southern and northern regions appear generally comparable in spatial extent and water ice content. This observation is interesting in light of topography measured by the Mars Orbiter Laser Altimeter (MOLA) on the Mars Global Surveyor (MGS) spacecraft, which shows a significant difference in elevation between northern lowlands and southern highlands that could imply a difference in seasonal CO2 condensation. In this study we correlate the high energy neutron flux observed by HEND (Mars Odyssey) and surface elevation measured by MOLA in order to interpret the seasonal change in epithermal neutron flux in terms near-surface water ice content.

Sanin, A. B.↗

Using NASA Environmental Data to Enhance Public Health Decision Making

The Universities Space Research Association at the NASA Marshall Space Flight Center is collaborating with the University of Alabama at Birmingham (UAB) School of Public Health and the Centers for Disease Control and Prevention (CDC) to address issues of environmental health and enhance public health decision making by utilizing NASA remotely sensed data and products. The objectives of this collaboration are to develop high-quality spatial data sets of environmental variables, and deliver the data sets and associated analyses to local, state and federal end-user groups. These data can be linked spatially and temporally to public health data, such as mortality and disease morbidity, for further analysis and decision making. Three daily environmental data sets have been developed for the conterminous U.S. on different spatial resolutions for the time period 2003-2008: (1) spatial surfaces of estimated fine particulate matter (PM2.5) exposures on a 10-km grid utilizing the US Environmental Protection Agency (EPA) ground observations and NASA s MODerate-resolution Imaging Spectroradiometer (MODIS) data; (2) a 1-km grid of Land Surface Temperature (LST) using MODIS data; and (3) a 12-km grid of daily Solar Insolation (SI) and maximum and minimum air temperature using the North American Land Data Assimilation System (NLDAS) forcing data. These environmental data sets will be linked with public health data from the UAB REasons for Geographic And Racial Differences in Stroke (REGARDS) national cohort study to determine whether exposures to these environmental risk factors are related to cognitive decline and other health outcomes. These environmental datasets and public health linkage analyses will be made available to public health professionals, researchers and the general public through the CDC Wide-ranging Online Data for Epidemiologic Research (WONDER) system and through peer reviewed publications. To date, two of the data sets have been released to the public in CDC WONDER, Daily Air Temperature and Heat Index for years 1979-2010, and Daily Fine Particulate Matter (PM2.5) air quality measures for years 2003-2008. These data in CDC WONDER can be aggregated to the county-level, state-level, or regional-level as per users need and downloaded in tabular, graphical, and map formats. The summary statistical output are available to web and app developers via the WONDER Application Programming Interface (API). The linkage of these data with the CDC WONDER system provides a significant addition to CDC WONDER, allowing public health researchers and policy makers to better include environmental exposure data in the context of other health data available in CDC WONDER online system. It also substantially expands public access to NASA environmental data, making their use by a wide range of decision makers feasible.

Al-Hamdan, Mohammad↗

Localization of L-Band RFI Sources from SMAP Data

RFI (Radio-Frequency Interference) in the 1400-1427 MHz band degrades the quality of measurements made by satellite missions such as SMAP (Soil Moisture Active/Passive), Aquarius and SMOS (Soil Moisture and Ocean Salinity). A technique is presented here to estimate the location on the ground of RFI sources using SMAP measurements. The results of this technique have been validated against data derived by other means.

Soldo, Yan↗

Precise Time-Tag Generator For A Local-Area-Network Monitor

Time-tag-generating circuit designed for use in LAN monitor, monitors frames of data transmitted among computers on local-area network (LAN). To each frame of data that LAN monitor receives from LAN, time-tag generator appends ancillary data on time of arrival of frame, precise to within 1 microsecond of centrally generated time signal. Inserts ancillary time data in place of already used frame-check data before frames of data stored in memory of LAN monitor.

Stauffer, David R.↗

Towards the Interoperability of Web, Database, and Mass Storage Technologies for Petabyte Archives

At the San Diego Supercomputer Center, a massive data analysis system (MDAS) is being developed to support data-intensive applications that manipulate terabyte sized data sets. The objective is to support scientific application access to data whether it is located at a Web site, stored as an object in a database, and/or storage in an archival storage system. We are developing a suite of demonstration programs which illustrate how Web, database (DBMS), and archival storage (mass storage) technologies can be integrated. An application presentation interface is being designed that integrates data access to all of these sources. We have developed a data movement interface between the Illustra object-relational database and the NSL UniTree archival storage system running in a production mode at the San Diego Supercomputer Center. With this interface, an Illustra client can transparently access data on UniTree under the control of the Illustr DBMS server. The current implementation is based on the creation of a new DBMS storage manager class, and a set of library functions that allow the manipulation and migration of data stored as Illustra 'large objects'. We have extended this interface to allow a Web client application to control data movement between its local disk, the Web server, the DBMS Illustra server, and the UniTree mass storage environment. This paper describes some of the current approaches successfully integrating these technologies. This framework is measured against a representative sample of environmental data extracted from the San Diego Ba Environmental Data Repository. Practical lessons are drawn and critical research areas are highlighted.

Moore, Reagan↗

Inpainting radar missing data regions with deep learning

Abstract. Missing and low-quality data regions are a frequent problem for weather radars. They stem from a variety of sources: beam blockage, instrument failure, near-ground blind zones, and many others. Filling in missing data regions is often useful for estimating local atmospheric properties and the application of high-level data processing schemes without the need for preprocessing and error-handling steps – feature detection and tracking, for instance. Interpolation schemes are typically used for this task, though they tend to produce unrealistically spatially smoothed results that are not representative of the atmospheric turbulence and variability that are usually resolved by weather radars. Recently, generative adversarial networks (GANs) have achieved impressive results in the area of photo inpainting. Here, they are demonstrated as a tool for infilling radar missing data regions. These neural networks are capable of extending large-scale cloud and precipitation features that border missing data regions into the regions while hallucinating plausible small-scale variability. In other words, they can inpaint missing data with accurate large-scale features and plausible local small-scale features. This method is demonstrated on a scanning C-band and vertically pointing Ka-band radar that were deployed as part of the Cloud Aerosol and Complex Terrain Interactions (CACTI) field campaign. Three missing data scenarios are explored: infilling low-level blind zones and short outage periods for the Ka-band radar and infilling beam blockage areas for the C-band radar. Two deep-learning-based approaches are tested, a convolutional neural network (CNN) and a GAN that optimize pixel-level error or combined pixel-level error and adversarial loss respectively. Both deep-learning approaches significantly outperform traditional inpainting schemes under several pixel-level and perceptual quality metrics.

54 ENVIRONMENTAL SCIENCES↗

Data collection from crystals grown in microfluidic droplets

Protein crystals grown in microfluidic droplets have been shown to be an effective and robust platform for storage, transport and serial crystallography data collection with a minimal impact on diffraction quality. Single macromolecular microcrystals grown in nanolitre-sized droplets allow the very efficient use of protein samples and can produce large quantities of high-quality samples for data collection. However, there are challenges not only in growing crystals in microfluidic droplets, but also in delivering the droplets into X-ray beams, including the physical arrangement, beamline and timing constraints and ease of use. Here, the crystallization of two human gut microbial hydrolases in microfluidic droplets is described: a sample-transport and data-collection approach that is inexpensive, is convenient, requires small amounts of protein and is forgiving. It is shown that crystals can be grown in 50–500 pl droplets when the crystallization conditions are compatible with the droplet environment. Local and remote data-collection methods are described and it is shown that crystals grown in microfluidics droplets and housed as an emulsion in an Eppendorf tube can be shipped from the US to the UK using a FedEx envelope, and data can be collected successfully. Details of how crystals were delivered to the X-ray beam by depositing an emulsion of droplets onto a silicon fixed-target serial device are provided. After three months of storage at 4°C, the crystals endured and diffracted well, showing only a slight decrease in diffracting power, demonstrating a suitable way to grow crystals, and to store and collect the droplets with crystals for data collection. This sample-delivery and data-collection strategy allows crystal droplets to be shipped and set aside until beamtime is available.

59 BASIC BIOLOGICAL SCIENCES↗

Quantifying drivers of wild pig movement across multiple spatial and temporal scales

The movement behavior of an animal is determined by extrinsic and intrinsic factors that operate at multiple spatio-temporal scales, yet much of our knowledge of animal movement comes from studies that examine only one or two scales concurrently. Understanding the drivers of animal movement across multiple scales is crucial for understanding the fundamentals of movement ecology, predicting changes in distribution, describing disease dynamics, and identifying efficient methods of wildlife conservation and management. We obtained over 400,000 GPS locations of wild pigs from 13 different studies spanning six states in southern U.S.A., and quantified movement rates and home range size within a single analytical framework. We used a generalized additive mixed model framework to quantify the effects of five broad predictor categories on movement: individual-level attributes, geographic factors, landscape attributes, meteorological conditions, and temporal variables. We examined effects of predictors across three temporal scales: daily, monthly, and using all data during the study period. We considered both local environmental factors such as daily weather data and distance to various resources on the landscape, as well as factors acting at a broader spatial scale such as ecoregion and season. We found meteorological variables (temperature and pressure), landscape features (distance to water sources), a broad-scale geographic factor (ecoregion), and individual-level characteristics (sex-age class), drove wild pig movement across all scales, but both the magnitude and shape of covariate relationships to movement differed across temporal scales. The analytical framework we present can be used to assess movement patterns arising from multiple data sources for a range of species while accounting for spatio-temporal correlations. Our analyses show the magnitude by which reaction norms can change based on the temporal scale of response data, illustrating the importance of appropriately defining temporal scales of both the movement response and covariates depending on the intended implications of research (e.g., predicting effects of movement due to climate change versus planning local-scale management). We argue that consideration of multiple spatial scales within the same framework (rather than comparing across separate studies post-hoc) gives a more accurate quantification of cross-scale spatial effects by appropriately accounting for error correlation.

60 APPLIED LIFE SCIENCES↗

ConductorIdentification [SWR-21-58]

This is a novel data-driven model that can identify power system model impedance for local utilities. The model builds a multi-category logistic regression that is trained on local utility secondary system partial GIS data, and then the model can be used to predict the conductor types/impedance for the local utilities secondary models.

Wang, Wenbo↗

Data compression for Eos on-board SAR processor

A lightweight, low-power, real-time data compressor design for the Earth Observing System (Eos) onboard synthetic aperture radar (SAR) processor is presented. The implementation is based on VLSI design of a pipelined binary tree-searched vector quantizer (VQ), utilizing space-qualifiable 1.25-micron CMOS technology. The implementation exploits VLSI system design principles such as the modularity, regular data flow, simple interconnection, localized communication, simple global control, and parallel/pipelined processing. The overall system requires 30 chips with only one VLSI processing element design. The total weight is about 1.2 lbs, with an estimated power dissipation of approximately 4 watts operating at the maximum input data rate. The projected throughput rate exceeds 5 MHz.

Chang, C. Y.↗

A Satellite Data-Driven, Client-Server Decision Support Application for Agricultural Water Resources Management

Water cycle extremes such as droughts and floods present a challenge for water managers and for policy makers responsible for the administration of water supplies in agricultural regions. In addition to the inherent uncertainties associated with forecasting extreme weather events, water planners need to anticipate water demands and water user behavior in a typical circumstances. This requires the use decision support systems capable of simulating agricultural water demand with the latest available data. Unfortunately, managers from local and regional agencies often use different datasets of variable quality, which complicates coordinated action. In previous work we have demonstrated novel methodologies to use satellite-based observational technologies, in conjunction with hydro-economic models and state of the art data assimilation methods, to enable robust regional assessment and prediction of drought impacts on agricultural production, water resources, and land allocation. These methods create an opportunity for new, cost-effective analysis tools to support policy and decision-making over large spatial extents. The methods can be driven with information from existing satellite-derived operational products, such as the Satellite Irrigation Management Support system (SIMS) operational over California, the Cropland Data Layer (CDL), and using a modified light-use efficiency algorithm to retrieve crop yield from the synergistic use of MODIS and Landsat imagery. Here we present an integration of this modeling framework in a client-server architecture based on the Hydra platform. Assimilation and processing of resource intensive remote sensing data, as well as hydrologic and other ancillary information occur on the server side. This information is processed and summarized as attributes in water demand nodes that are part of a vector description of the water distribution network. With this architecture, our decision support system becomes a light weight 'app' that connects to the server to retrieve the latest information regarding water demands, land use, yields and hydrologic information required to run different management scenarios. Furthermore, this architecture ensures all agencies and teams involved in water management use the same, up-to-date information in their simulations.

Agricultural↗

Locality-Aware Scheduling for Scalable Heterogeneous Environments

Heterogeneous computing promise boost performance of scientific applications by allowing massively parallel execution of computational tasks. However, manually managing extremely heterogeneous, multi-device systems is complicated and may result in sub-optimal performance. Specifically, data management is an extremely challenging problem on multi-device systems. In this work, we introduce two locality-aware schedulers for the Minos Computing Library (MCL), an asynchronous, task-based programming model and runtime for extremely heterogeneous systems. The first scheduler implements a pure locality-aware algorithm to maximize data reuse, though it might incur in ”hot-spots” that limit system utilization. The second scheduler mitigates this drawback by dynamically targeting between locality-awareness and system utilization based on the current workload and available computing devices. Our results show that locality-awareness greatly benefit applications that exhibit data reuse, providing up to 6.9x and 7.9x over the original MCL scheduler and equivalent OpenCL implementations, respectively. Moreover, our schedulers introduce negligible overhead compared with the original MCL scheduler and achieve similar performance for applications that don’t benefit from data locality.

Architecture, co-design, Task-based programming mo↗

On Hammershock Propagation in a Supersonic Flow Field

A wind tunnel test program was conducted to acquire flow-field data during a supersonic propulsion system compressor stall and inlet unstart sequence. The propulsion system consisted of a mixed-compression, two-dimensional bifurcated inlet coupled to a General Electric J85-13 turbojet engine. The propulsion system was mounted beneath a large flat plate that simulated an underwing propulsion pod installation. Transient flow-field pitot pressure and wing simulator surface static pressure data were acquired during multiple compressor stall and inlet unstart events at a free-stream Mach number of 2.20. The experimental results obtained in this investigation indicate that a supersonic propulsion system compressor stall-inlet unstart transient event adversely affects the surrounding local flow field. The data show that the stall-unstart event affects the surrounding flow field on a millisecond time scale and causes a three-dimensional expanding wave front called a hammershock to propagate outward from the inlet. The flow nearest the wing simulator separates from the surface during the transient event. At the end of the transient event, a distinct process occurs wherein the affected flow field recovers to free-stream conditions and the wing simulator boundary layer reattaches to the flow surface.

Porro, A. Robert↗

Beyond Taylor’s hypothesis: a novel volumetric reconstruction of velocity and density fields for variable‑density and shear flows

Abstract This work presents a novel numerical procedure for reconstructing volumetric density and velocity fields from planar laser-induced fluorescence (PLIF) and stereoscopic particle image velocimetry (SPIV) data. This new method is theoretically and practically demonstrated to provide more accurate 3D vortical structures and density fields in high shear flows than reconstruction methods based on the mean convective velocity. While Taylor’s hypothesis of frozen turbulence is commonly applied by using the local mean streamwise velocity, the proposed algorithm uses the measured local instantaneous velocity for data convection. It consists of a step-by-step reconstruction based on a mixed Lagrangian–Eulerian solver that includes the 3D interpolation of scattered flow data and that relaxes the Taylor’s hypothesis by iterative enforcement of the incompressibility constraint on the velocity field. This methodology provides 3D fields with temporal resolution, spatial resolution, and accuracy comparable to that of real 3D snapshots, thus providing a practical alternative to tomographic measurements. The procedure is validated using numerical data of the constant-density channel flow available on the Johns Hopkins University Turbulence Database (JHTDB), showing the accurate reconstruction of the 3D velocity field. The algorithm is applied to an experimental dataset of PLIF and SPIV measurements of a variable-density jet flow, demonstrating its capability to provide 3D velocity and density fields that are more consistent with the Navier–Stokes equations compared to the mean flow convective method. Graphic abstract

42 ENGINEERING↗

Effectively Using Remote I/O For Work Composition in Distributed Workflows

Distributed scientific workflows are becoming more important with the interest in incorporating AI into their loops. A critical programming and performance question is how to compose workflow tasks when data is produced on one system but must be consumed on another. Since the dominant technique is composition with remote I/O, this paper explores its performance expectations. We describe BigFlowSim, a workflow I/O simulator that captures key implementation choices for remote I/O, including intensity, reuse, locality, access pattern, and data movement.With BigFlowSim, we generate a synthetic benchmark. We quantify the effects of each parameter with a performance sensitivity study. We explain trends in terms of data movement reduction and show that, under certain conditions, it is possible to establish a total order among most parameters. We apply these insights to a high energy physics workflow, Belle II Monte Carlo and simulate several I/O optimizations. Speedups range from 5% to 2×, without changing compute time.

Friese, Ryan D.↗