Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data locality”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,207 records · Page 67

International Space Weather Initiative (ISWI)

The International Heliophysical Year (IHY), an international program of scientific collaboration to understand the external drivers of planetary environments, has come to an end. The IHY was a major international event of great interest to the member States, which involved the deployment of new instrumentation, new observations from the ground and in space, and an education component. We propose to continue the highly successful collaboration between the heliophysics science community and the United Nations Basic Space Science (UNBSS) program. One of the major thrust of the IHY was to deploy arrays of small instruments such as magnetometers, radio antennas, GPS receivers, all-sky cameras, particle detectors, etc. around the world to provide global measurements of heliospheric phenomena. The United Nations Basic Space Science Initiative (UNBSSI) played a major role in this effort. Scientific teams were organized through UNBSS, which consisted of a lead scientist who provided the instruments or fabrication plans for instruments in the array. As a result of the this program, scientists from UNBSS member states now participate in the instrument operation, data collection, analysis, and publication of scientific results, working at the forefront of science research. As part of this project, support for local scientists, facilities and data acquisition is provided by the host nation. In addition, support at the Government level is provided for local scientists to participate. Building on momentum of the IHY, we propose to continue the highly successful collaboration with the UNBSS program to continue the study of universal processes in the solar system that affect the interplanetary and terrestrial environments, and to continue to coordinate the deployment and operation of new and existing instrument arrays aimed at understanding the impacts of Space Weather on Earth and the near-Earth environment. Toward this end, we propose a new program, the International Space Weather Initiative (ISWI).

Davila, Joseph↗

Eridanus IV: an Ultra-faint Dwarf Galaxy Candidate Discovered in the DECam Local Volume Exploration Survey

We present the discovery of a candidate ultra-faint Milky-Way satellite, Eridanus IV (DELVE J0505−0931), detected in photometric data from the DECam Local Volume Exploration survey (DELVE). Eridanus IV is a faint (M V = − 4.7 ± 0.2), extended (), and elliptical (ϵ = 0.54 ± 0.1) system at a heliocentric distance of , with a stellar population that is well described by an old, metal-poor isochrone (age of τ ∼ 13.0 Gyr and metallicity of [Fe/H] ≲ − 2.1 dex). These properties are consistent with the known population of ultra-faint Milky-Way satellite galaxies. Eridanus IV is also prominently detected using proper-motion measurements from Gaia Early Data Release 3, with a systemic proper motion of mas yr−1 measured from its horizontal branch and red-giant-branch member stars. We find that the spatial distribution of likely member stars hints at the possibility that the system is undergoing tidal disruption.

79 ASTRONOMY AND ASTROPHYSICS↗

Band Excitation Kelvin probe force microscopy utilizing photothermal excitation

A multifrequency open loop Kelvin probe force microscopy (KPFM) approach utilizing photothermal as opposed to electrical excitation is developed. Photothermal band excitation (PthBE)-KPFM is implemented here in a grid mode on a model test sample comprising a metal-insulator junction with local charge-patterned regions. Unlike the previously described open loop BE-KPFM, which relies on capacitive actuation of the cantilever, photothermal actuation is shown to be highly sensitive to the electrostatic force gradient even at biases close to the contact potential difference (CPD). PthBE-KPFM is further shown to provide a more localized measurement of true CPD in comparison to the gold standard ambient KPFM approach, amplitude modulated KPFM. In conclusion, PthBE-KPFM data contain information relating to local dielectric properties and electronic dissipation between tip and sample unattainable using conventional single frequency KPFM approaches.

36 MATERIALS SCIENCE↗

Dual Channel Dual Staging: Hierarchical and Portable Staging for GPU-Based In-Situ Workflow

In-situ workflows have emerged as an attractive approach for addressing data movement challenges at very large scales. Since GPU-based architectures dominate the HPC landscapes, porting these in-situ workflows, and, specifically, the inter-application data exchange, to GPU-based systems can be challenging. Technologies such as GPUDirect RDMA (GDR), which is typically used for I/O in GPU applications as an optimization that circumvents the CPU overhead, can be leveraged to support bulk data exchanges between GPU applications. However, current GDR design often lacks performance portability across HPC clusters built with different hardware configurations. Furthermore, the local CPU may also be effectively used as an auxiliary communication mechanism to offload data exchanges. In this paper, we present a dual channel dual staging approach for efficient, scalable, and performance-portable inter-application data exchange for in-situ workflows. This approach exploits the data access pattern within in-situ workflows along with the inherent execution asynchrony to accelerate data exchanges and, at the same time, improve performance portability. Specifically, the dual channel dual staging method leverages both the local CPU and the remote data staging server to build a hierarchical joint staging area and uses this staging area to transform blocking inter-application bulk data exchanges into best-effort local data movements between GPU and CPU. The dual channel dual staging is implemented as a portability extension of the Dataspaces-GPU staging framework. We present an experimental evaluation of its performance, portability, and scalability using this implementation on three leadership GPU clusters. The evaluation results demonstrate that the dual channel dual staging method saves up to 75% in data-exchange time compared to host-based, GDR, and alternate portable designs, while maintaining scalability (up to 512 GPUs) and performance portability across the three platforms.

Zhang, Bo [University of Utah]↗

Domi

Domi (Greek for "structure") is a Trilinos package that provides support for multi-dimensional data arrays distributed over multiple processors of a high performance computing system. The software supports data arrays of arbitrary number of dimensions mapped to a multi-dimensional grid of processors. Domi provides local access to the data, as well as the ability to compute global quantities such as norms, maxima and minima. Data arrays can be constructed with boundary and communication padding, necessary for finite difference algorithms, and provides high-level methods for communicating data between processors to update these buffers. The distributed maps and vectors in Domi can be converted to the equivalent data structures in Epetra and Tpetra (both of which assume unstructured data), using view semantics when appropriate, for use with other Trilinos solvers.

Spotz, WilliamF.↗

Ionospheric calibration for single frequency altimeter measurements

This report investigates the potential of using Global Positioning System (GPS) data and a model of the ionosphere to supply a measure of the sub-satellite Total Electron Current (TEC) of the required accuracy (10 TECU rms) for the purpose of calibrating single frequency radar altimeter measurements. Since climatological (monthly mean) models are known to be in error by as much as 50 percent, this work focused on the Parameterized Real-Time Ionospheric Specification Model (PRISM) which has the capability to improve model accuracy by ingesting (adjusting to) in situ ionospheric measurements. A set of globally distributed TEC measurements were generated using GPS data and were used as input to improve the accuracy of the PRISM model. The adjusted PRISM TEC values were compared to TOPEX dual frequency TEC measurements (which are considered truth) for a number of TOPEX sub-satellite tracks. The adjusted PRISM values generally compared to the TOPEX measurements within the 10 TECU accuracy requirements when the sub-satellite track passed within 300 to 400 km of the GPS TEC data or when the track passed through a night time ionosphere. However, when the sub-satellite points were greater than 300 to 400 km away from the GPS TEC data or when a local noon ionosphere was sampled, the adjusted PRISM values generally differed by greater than 10 TECU rms with data excursions from the TOPEX TEC measurements of as much as 40 TECU (an 8 cm path delay error at K band). Therefore, it can be concluded from this analysis that an unrealistically large number of GPS stations would be needed to predict sub-satellite TEC at the 10 TECU level in the day time ionosphere using a model such as PRISM. However, a technique currently being studied at the Jet Propulsion Laboratory (JPL) may provide a means of supplying adequate TEC data to meet the 10 TECU ionospheric correction accuracy when using a realistic number of ionospheric stations. This method involves using global GPS TEC data to estimate a global grid of vertical ionospheric TEC as a function of time (i.e. every one half hour) in a sun-fixed longitude frame. Working in a sun-fixed longitude frame, one is not limited by the spatial decorrelation distance of the ionosphere, but instead is limited more by the temporal correlations of the ionosphere in the sun-fixed frame which are a smaller effect. It is the opinion of the authors that using the global sun-fixed TEC grid data, in particular, ingesting it into PRISM, offers the best possibility of meeting the 10 TECU ionospheric correction accuracy requirement, and should be the subject of further study.

Schreiner, William S.↗

Domi

Domi (Greek for "structure") is a Trilinos package that provides support for multi-dimensional data arrays distributed over multiple processors of a high performance computing system. The software supports data arrays of arbitrary number of dimensions mapped to a multi-dimensional grid of processors. Domi provides local access to the data, as well as the ability to compute global quantities such as norms, maxima and minima. Data arrays can be constructed with boundary and communication padding, necessary for finite difference algorithms, and provides high-level methods for communicating data between processors to update these buffers. The distributed maps and vectors in Domi can be converted to the equivalent data structures in Epetra and Tpetra (both of which assume unstructured data), using view semantics when appropriate, for use with other Trilinos solvers.

Spotz, William F.↗

Program Facilitates Distributed Computing

KNET computer program facilitates distribution of computing between UNIX-compatible local host computer and remote host computer, which may or may not be UNIX-compatible. Capable of automatic remote log-in. User communicates interactively with remote host computer. Data output from remote host computer directed to local screen, to local file, and/or to local process. Conversely, data input from keyboard, local file, or local process directed to remote host computer. Written in ANSI standard C language.

Hui, Joseph↗

Surface temperature and albedo relationships in Senegal derived from NOAA-7 satellite data

The interaction between surface albedo and local climate in Senegal, Africa, is examined using NOAA AVHRR data collected from September 1981-October 1982. The temporal variations of albedo and surface temperature are calculated and examined. It is observed that the albedo and ground temperature are largest in the winter and spring (dry season) and smallest in the late summer and fall (wet season). From the wet to the dry seasons the albedo varied by about 3 percentage points and the ground temperature by about 13 K. A positive correlation between albedo and ground temperatures is detected; this indicates that the albedo does not control the ground temperature. Other factors that can influence ground temperatures are atmospheric turbulence, soil moisture, thermal inertia, and ground emissivity, which are all affected by the presence or absence of vegetation.

Vukovich, Fred M.↗

A Systematic Review of Local to Regional Yield Forecasting Approaches and Frequently Used Data Resources

Forecasting crop yields, or providing an expectation of ex-ante harvest amounts, is highly relevant to the whole agricultural production chain. Farmers can adapt their management, traders or insurers their pricing schemes, suppliers their stocks, logistic companies their routes, national authorities their food balance sheets to guide import or export and, finally, international aid organizations can mobilize reliefs. Evidence has grown in the literature that such forecasts with a meaningful lead time are possible on various geographic scales and for a broad range of crops. Here, we present a systematic review of the methods applied in end-of-season yield forecasting and three frequently used data sources: weather data, satellite data and crop masks. Our literature database comprises 362 studies (2004–2019) which were evaluated regarding methods, crops, regions, data sources, lead time and performance. Moreover, we present 24 sources of real-time and predictive weather data, 21 sources of remote sensing data and 16 crop masks. Yield forecasting in our literature sample has been performed for 44 crops in 71 countries, also including many non-staple crops, but with an apparent bias in regions and crops. Forecasting performance depends on various factors, including crop, region, method, lead time to harvest and input diversity. Our systematic review supports a broader application of locally successful approaches at larger scales by providing a comprehensive, accessible compendium of necessary information for yield forecasting. We discuss improvement potentials with respect to methodological approaches and available data sources. We additionally suggest standardization procedures for future forecasting studies and encourage studying additional crops and geographic regions. Implications of forecasts for different target groups on different scales and the adaptation towards climate change are also discussed.

Seasonal crop yield forecasting↗

Front-End Processor For Metrology-Information System

Front-end processor for NASA Metrology Information System (NMIS) is real-time relational data-base computer system designed to distribute processing for NMIS mainframe system or run as stand-alone local-area-network data-base system. System used in large calibration laboratories for work control and to maintain records of calibration, repair, costs, manpower usage, traceability, and other pertinent facts about instruments supported by laboratories. Provides enhancements to existing NASA Metrology Information System and batches upload to minimize mainframe I/O at times of heavy usage.

Muse, Walter S.↗

The development and validation of command schedules for SeaWiFS

An automated method for developing and assessing spacecraft and instrument command schedules is presented for the Sea-viewing Wide Field-of-view Sensor (SeaWiFS) project. SeaWiFS is to be carried on the polar-orbiting SeaStar satellite in 1995. The primary goal of the SeaWiFS mission is to provide global ocean chlorophyll concentrations every four days by employing onboard recorders and a twice-a-day data downlink schedule. Global Area Coverage (GAC) data with about 4.5 km resolution will be used to produce the global coverage. Higher resolution (1.1 km resolution) Local Area Coverage (LAC) data will also be recorded to calibrate the sensor. In addition, LAC will be continuously transmitted from the satellite and received by High Resolution Picture Transmission (HRPT) stations. The methods used to generate commands for SeaWiFS employ numerous hierarchical checks as a means of maximizing coverage of the Earth's surface and fulfilling the LAC data requirements. The software code is modularized and written in Fortran with constructs to mirror the pre-defined mission rules. The overall method is specifically developed for low orbit Earth-observing satellites with finite onboard recording capabilities and regularly scheduled data downlinks. Two software packages using the Interactive Data Language (IDL) for graphically displaying and verifying the resultant command decisions are presented. Displays can be generated which show portions of the Earth viewed by the sensor and spacecraft sub-orbital locations during onboard calibration activities. An IDL-based interactive method of selecting and testing LAC targets and calibration activities for command generation is also discussed.

Woodward, Robert H.↗

Local coexistence of VO 2 phases revealed by deep data analysis

We report a synergistic approach of micro-Raman spectroscopic mapping and deep data analysis to study the distribution of crystallographic phases and ferroelastic domains in a defected Al-doped VO 2 microcrystal. Bayesian linear unmixing revealed an uneven distribution of the T phase, which is stabilized by the surface defects and uneven local doping that went undetectable by other classical analysis techniques such as PCA and SIMPLISMA. This work demonstrates the impact of information recovery via statistical analysis and full mapping in spectroscopic studies of vanadium dioxide systems, which is commonly substituted by averaging or single point-probing approaches, both of which suffer from information misinterpretation due to low resolving power.

36 MATERIALS SCIENCE↗

Gyrokinetic simulations compared with magnetic fluctuations diagnosed with a Faraday-effect radial interferometer-polarimeter in the DIII-D pedestal

Abstract Experimental data on electromagnetic fluctuations in DIII-D, made available by the Faraday-effect radial interferometer-polarimeter (RIP) diagnostic Chen (2016 Rev. Sci. Instrum. 87 11E108), is examined in comparison with detailed gyrokinetic simulations using gyrokinetic electromagnetic numerical experiment (GENE). The diagnostic has the unique capability of making internal measurements of fluctuating magnetic fields ∫ n e δ B r d R ∫ n e d R . Local linear simulations identify microtearing modes (MTMs) over a substantial range of toroidal mode numbers (peaking at n = 15) with frequencies in good agreement with the experimental data. Local nonlinear simulations reinforce this result by producing a magnetic frequency spectrum in good agreement with that diagnosed by RIP. Simulated heat fluxes are in the range of experimental expectations. However, magnetic fluctuation amplitudes are substantially lower than the experimental expectations. Possible sources of this discrepancy are discussed, notably the fact that the diagnostics are localized at the mid-plane—the poloidal location where the simulations predict the fluctuation amplitudes to be smallest. Despite some discrepancies, several connections between simulations and experiments, combined with general criteria discriminating between potential pedestal instabilities, strongly point to MTMs as the source of the observed magnetic fluctuations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Evaluation of Data Catalog Software for Hanford Site Environmental Datasets

Environmental information and data underpin achievement of the U.S. Department of Energy (DOE) Office of Environmental Management (EM) mission at the Hanford Site. The Hanford Environmental Data Management (HEDM) Program is the DOE Richland Operations Office (RL) approach to develop and implement a formal program for managing environmental data and the associated records, materials, and systems at the Hanford Site. The current project, contract, organization, and contractor-specific efforts at managing environmental data sets are insufficient to provide orderly, long-term, site-wide access. A vital element to be created within the HEDM program plan is a catalog of data sources, called the Hanford Environmental Information and Data Index (HEIDI), that will enable long-term access and retrievability for the multiple independent sources of data that might otherwise be difficult to discover. This report compares leading open source and commercial data catalog platforms using criteria to assess the functionality needed to develop the HEIDI catalog of Hanford data sources that connects and exchanges data with established Hanford Local Area Network (HLAN) enterprise information technology systems. Proprietary platforms evaluated included ArcGIS Enterprise Sites, Junar, OpenDataSoft, and Socrata, and non-proprietary platforms included Energy Data eXchange (EDX), Comprehensive Knowledge Archive Network (CKAN), and DKAN (a Drupal-based open data portal based on CKAN). Capabilities supporting data discoverability, retrieval, and archival, as well as metadata standard requirements and integration into the HLAN were rated as either failing to meet requirements (F), meeting requirements (M), or exceeding requirements by delivering additional desired features (E). The lowest rating for any capability area was assigned as the overall rating for the platform. These findings enable DOE-RL and the contractors implementing the HEDM plan to focus on candidate tools likely to meet the requirements for implementing HEIDI. All of the platforms receiving an overall rating of ‘F’ were unable to be deployed on Hanford infrastructure or within dedicated cloud resources. A propriety software-as-a-service (SaaS) model of delivering a data catalog (e.g., found in software such as Junar and OpenDataSoft) favors consistency across customers at the expense of customization and configurable roles that are needed for Hanford work. Hosting data on a shared commercial platform places limits on dataset size (maximum of 240 Mb for OpenDataSoft), a significant limitation for HEIDI implementation. EDX, a government data catalog based on CKAN, received the ‘F’ rating due to an inability to incorporate authentication from HLAN into the system. Among platforms rated ‘M’ or ‘E’, only the Socrata platform had a SaaS delivery model. In contrast to other SaaS platforms, Socrata provided custom roles and gateways that allow local datasets to be incorporated into an online catalog. Socrata also complies with the Federal Risk and Authorization Management Program, a significant benefit for cloud-based management of Hanford data. The other platforms rated ‘M’ or ‘E’, ArcGIS Enterprise Sites, CKAN, and DKAN, provide fully self-hosted options, allowing for greater control and flexibility with the HEIDI catalog. These widely used tools have supportive communities of practice, extensive customization options, and demonstrated deployments that provide evidence that they can meet requirements, often deliver additional desired features, and work well with federal government systems. Completely customized alternatives built on a collection of applications were not evaluated because achieving similar performance to CKAN or DKAN requires substantial resources, especially in the absence of the active communities that have grown to support these tools. ArcGIS Enterprise Sites, Socrata, CKAN, and DKAN were evaluated as strong candidates for successful implementation with HEIDI.

54 ENVIRONMENTAL SCIENCES↗

Planck 2015 results: XVII. Constraints on primordial non-Gaussianity

We report that the Planck full mission cosmic microwave background (CMB) temperature and E-mode polarization maps are analysed to obtain constraints on primordial non-Gaussianity (NG). Using three classes of optimal bispectrum estimators – separable template-fitting (KSW), binned, and modal – we obtain consistent values for the primordial local, equilateral, and orthogonal bispectrum amplitudes, quoting as our final result from temperature alone ƒ local NL = 2.5 ± 5.7, ƒ equil NL = -16 ± 70, , and ƒ ortho NL = -34 ± 32 (68% CL, statistical). Combining temperature and polarization data we obtain ƒ local NL = 0.8 ± 5.0, ƒ equil NL = -4 ± 43, and ƒ ortho NL = -26 ± 21 (68% CL, statistical). The results are based on comprehensive cross-validation of these estimators on Gaussian and non-Gaussian simulations, are stable across component separation techniques, pass an extensive suite of tests, and are consistent with estimators based on measuring the Minkowski functionals of the CMB. The effect of time-domain de-glitching systematics on the bispectrum is negligible. In spite of these test outcomes we conservatively label the results including polarization data as preliminary, owing to a known mismatch of the noise model in simulations and the data. Beyond estimates of individual shape amplitudes, we present model-independent, three-dimensional reconstructions of the Planck CMB bispectrum and derive constraints on early universe scenarios that generate primordial NG, including general single-field models of inflation, axion inflation, initial state modifications, models producing parity-violating tensor bispectra, and directionally dependent vector models. We present a wide survey of scale-dependent feature and resonance models, accounting for the “look elsewhere” effect in estimating the statistical significance of features. We also look for isocurvature NG, and find no signal, but we obtain constraints that improve significantly with the inclusion of polarization. The primordial trispectrum amplitude in the local model is constrained to be g local NL = (-0.9 ± 7.7 ) X 10 4 (68% CL statistical), and we perform an analysis of trispectrum shapes beyond the local case. The global picture that emerges is one of consistency with the premises of the ΛCDM cosmology, namely that the structure we observe today was sourced by adiabatic, passive, Gaussian, and primordial seed perturbations.

79 ASTRONOMY AND ASTROPHYSICS↗

The HEPCloud Facility: elastic computing for High Energy Physics – The NOvA Use Case

The need for computing in the HEP community follows cycles of peaks and valleys mainly driven by conference dates, accelerator shutdown, holiday schedules, and other factors. Because of this, the classical method of provisioning these resources at providing facilities has drawbacks such as potential overprovisioning. As the appetite for computing increases, however, so does the need to maximize cost efficiency by developing a model for dynamically provisioning resources only when needed. To address this issue, the HEPCloud project was launched by the Fermilab Scientific Computing Division in June 2015. Its goal is to develop a facility that provides a common interface to a variety of resources, including local clusters, grids, high performance computers, and community and commercial Clouds. Initially targeted experiments include CMS and NOvA, as well as other Fermilab stakeholders. In its first phase, the project has demonstrated the use of the “elastic” provisioning model offered by commercial clouds, such as Amazon Web Services. In this model, resources are rented and provisioned automatically over the Internet upon request. In January 2016, the project demonstrated the ability to increase the total amount of global CMS resources by 58,000 cores from 150,000 cores - a 25 percent increase - in preparation for the Recontres de Moriond. In March 2016, the NOvA experiment has also demonstrated resource burst capabilities with an additional 7,300 cores, achieving a scale almost four times as large as the local allocated resources and utilizing the local AWS s3 storage to optimize data handling operations and costs. NOvA was using the same familiar services used for local computations, such as data handling and job submission, in preparation for the Neutrino 2016 conference. In both cases, the cost was contained by the use of the Amazon Spot Instance Market and the Decision Engine, a HEPCloud component that aims at minimizing cost and job interruption. This paper describes the Fermilab HEPCloud Facility and the challenges overcome for the CMS and NOvA communities.

Fuess, S.↗

Inspection of plate weldments through an interposed layer of viscoelastic material using an elastic-electromagnetic scanning method

In this study, an elastic-microwave based non-destructive evaluation method is presented to inspect for cracks in weldments and thinning of coated steel plates. The approach uses a microwave interferometer operating at 94 GHz to record the total surface displacement of a coated steel plated as it is driven by an incident elastic field. These spatiotemporal data coupled with wavefield processing algorithms provide powerful detection and localization capabilities. From these wavefield data sets, a plate thickness mapping capability has been demonstrated that can detect thickness changes on the order of 0.79 mm (1/32 in.). It is also shown that a topological energy analysis of the wavefield data can detect and locate small flaws on the order of 5–10 mm (0.19–0.40 in.) in the welded joint. Note, all of these results are obtained through a 50.8 mm (2 in.) thick viscoelastic coating without disturbing the coating or the coating bond. At present the algorithm cannot resolve individual flaws within a grid space, just their cumulative effect. Even with the current limitations, this detection approach appears to be a promising alternative to traditional phased array imaging methods where the coating layer must be removed prior to inspection.

42 ENGINEERING↗