Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “DISTRIBUTED DATA PROCESSING”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

NASA IVHM Technology Experiment for X-vehicles (NITEX)

The purpose of the NASA IVHM Technology Experiment for X-vehicles (NITEX) is to advance the development of selected IVHM technologies in a flight environment and to demonstrate the potential for reusable launch vehicle ground processing savings. The technologies to be developed and demonstrated include system-level and detailed diagnostics for real-time fault detection and isolation, prognostics for fault prediction, automated maintenance planning based on diagnostic and prognostic results, and a microelectronics hardware platform. Complete flight The Evolution of Flexible Insulation as IVHM consists of advanced sensors, distributed data acquisition, data processing that includes model-based diagnostics, prognostics and vehicle autonomy for control or suggested action, and advanced data storage. Complete ground IVHM consists of evolved control room architectures, advanced applications including automated maintenance planning and automated ground support equipment. This experiment will advance the development of a subset of complete IVHM.

Sandra, Hayden↗

A fast and memory-sparing probabilistic selection algorithm for the GPU

A fast and memory-sparing probabilistic top-N selection algorithm is implemented on the GPU. This probabilistic algorithm gives a deterministic result and always terminates. The use of randomization reduces the amount of data that needs heavy processing, and so reduces both the memory requirements and the average time required for the algorithm. This algorithm is well-suited to more general parallel processors with multiple layers of memory hierarchy. Probabilistic Las Vegas algorithms of this kind are a form of stochastic optimization and can be especially useful for processors having a limited amount of fast memory available.

99 GENERAL AND MISCELLANEOUS↗

Fourth moments reveal the negativity of the Wigner function

The presence of unique quantum correlations is the core of quantum-information processing and general quantum theory. We address the fundamental question of how quantum correlations of a generic quantum system can be probed using correlation functions defined for quasiprobability distributions. In particular, we discuss the possibility of probing the negativity of a quasiprobability by comparing moments of the Wigner function. We show that one must take at least the fourth moments to find the negativity in general and the eighth moments for states with a rotationally invariant Wigner function.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Experiment in Onboard Synthetic Aperture Radar Data Processing

Single event upsets (SEUs) are a threat to any computing system running on hardware that has not been physically radiation hardened. In addition to mandating the use of performance-limited, hardened heritage equipment, prior techniques for dealing with the SEU problem often involved hardware-based error detection and correction (EDAC). With limited computing resources, software- based EDAC, or any more elaborate recovery methods, were often not feasible. Synthetic aperture radars (SARs), when operated in the space environment, are interesting due to their relevance to NASAs objectives, but problematic in the sense of producing prodigious amounts of raw data. Prior implementations of the SAR data processing algorithm have been too slow, too computationally intensive, and require too much application memory for onboard execution to be a realistic option when using the type of heritage processing technology described above. This standard C-language implementation of SAR data processing is distributed over many cores of a Tilera Multicore Processor, and employs novel Radiation Hardening by Software (RHBS) techniques designed to protect the component processes (one per core) and their shared application memory from the sort of SEUs expected in the space environment. The source code includes calls to Tilera APIs, and a specialized Tilera compiler is required to produce a Tilera executable. The compiled application reads input data describing the position and orientation of a radar platform, as well as its radar-burst data, over time and writes out processed data in a form that is useful for analysis of the radar observations.

Holland, Matthew↗

The NASA Earth Science Program and Small Satellites

Earth's changing environment impacts every aspect of life on our planet and climate change has profound implications on society. Studying Earth as a single complex system is essential to understanding the causes and consequences of climate change and other global environmental concerns. NASA's Earth Science Division (ESD) shapes an interdisciplinary view of Earth, exploring interactions among the atmosphere, oceans, ice sheets, land surface interior, and life itself. This enables scientists to measure global and climate changes and to inform decisions by Government, other organizations, and people in the United States and around the world. The data collected and results generated are accessible to other agencies and organizations to improve the products and services they provide, including air quality indices, disaster prediction and response, agricultural yield projections, and aviation safety. ESD's Flight Program provides the spacebased observing systems and supporting infrastructure for mission operations and scientific data processing and distribution that support NASA's Earth science research and modeling activities. The Flight Program currently has 21 operating Earth observing space missions, including the recently launched Global Precipitation Measurement (GPM) mission, the Orbiting Carbon Observatory-2 (OCO-2), the Soil Moisture Active Passive (SMAP) mission, and the International Space Station (ISS) RapidSCAT and Cloud-Aerosol Transport System (CATS) instruments. The ESD has 22 more missions and instruments planned for launch over the next decade. These include first and second tier missions from the 2007 Earth Science Decadal Survey, Climate Continuity missions to assure availability of key climate data sets, and small-sized competitively selected orbital missions and instrument missions of opportunity belonging to the Earth Venture (EV) Program. Small satellites (~500 kg or less) are critical contributors to these current and future satellite missions. Some examples are the aforementioned Orbiting Carbon Observatory-2 (OCO-2), the Gravity Recovery and Climate Experiment Follow On (GRACE FO), and the Cyclone Global Navigation Satellite System (CYGNSS) microsatellite constellation. Small satellites also support ESD in space validation and risk reduction of enabling technologies (components and systems). The status of the ESD Flight Program and the role of small satellites will be discussed.

Earth Science Prog & Small Sat↗

Earth Observatory Satellite system definition study. Report no. 3: Design/cost tradeoff studies. Appendix E: EOS program supporting system trade data. Part 2: System trade studies no. 9 - 19

The relative merits of several international data acquisition (IDA) alternatives for the Earth Observatory Satellite (EOS) are established and rated on a cost effectiveness basis. The primary alternatives under consideration are: (1) direct transmission to foreign ground stations, (2) a wideband video tape recorder system for collection of foreign data and processing and distribution from the United States, and (3) a tracking and data relay satellite (TDRS) system for the relay of foreign data to the United States for processing and distribution. A requirements model is established for the analysis on the basis of the heaviest concentration of agricultural areas around the world. The model, the orbit path and the constraints of EOS and data volume summaries are presented. Alternative system descriptions and costs are given in addition to cost-performance summaries.

Source record↗

Extension of the possibilities of a commercial digital camera in detecting spatial intensity distribution of laser radiation

Performance capabilities of commercial digital cameras are demonstrated by the example of a Canon EOS 400D camera in measuring and detecting spatial distributions of laser radiation intensity. It is shown that software extraction of linear data expands the linear dynamic range of the camera by a factor greater than 10, up to 58 dB. Basic measurement characteristics of the camera are obtained in the regime of linear data extraction: the radiometric function, deviation from linearity, dynamic range, temporal and spatial noises (both dark and those depending on the signal value). The parameters obtained correspond to those of technical measuring cameras. (measurement of laser radiation parameters)

42 ENGINEERING↗

Hydrological Data at the NASA GES DISC: Current Capabilities and New Opportunities

The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) is one of twelve NASA Earth science data centers that document, process, archive and distribute data from Earth observation missions and projects. GES DISC maintains an archive of several hydrology datasets, including the Land Data Assimilation Systems (LDAS) and the Gravity Recovery and Climate Experiment (GRACE) Data Assimilation for Drought Monitoring (GRACE-DA-DM) data products. These datasets include model output of heat fluxes, rain, snow, soil temperature, soil moisture, and runoff; and observational forcing data, including surface pressure, temperature, precipitation, downward shortwave and longwave radiation, humidity, and wind. The temporal resolution of the hydrology data at GES DISC ranges from hourly to monthly, and spatial resolutions range from 0.1° to 1.0°. The GES DISC provides services which enable users to aggregate, temporally and spatially subset, regrid, and visualize archived data including the GES DISC Subsetter, Hydrology Data Rods, and the Geospatial Interactive Online Visualization and Analysis Infrastructure (GIOVANNI). The Hydrology Data Rods service optimally reorganizes large hydrological data sets as extended time series, providing more efficient access for the hydrological community. The time series data (aka “data rods”) were integrated into hydrology community tools, such as the Data Rods Explorer on HydroShare. Furthermore, the GES DISC is in the process of migrating its data and services to the cloud. Hydrological data available at the GES DISC are now available in the Amazon Web Services (AWS) cloud (us-west-2 region) providing users Direct S3 data access and the capability for cloud computing operations. In this presentation, the hydrology data products and services currently available at the GES DISC will be summarized. Also discussed are the migration to the cloud, user support through this transition, and the status of migrating the data rods service to the cloud.

Ashley Heath↗

Reconciling Scratch Space Consumption, Exposure, and Volatility to Achieve Timely Staging of Job Input Data

Innovative scientific applications and emerging dense data sources are creating a data deluge for high-end computing systems. Processing such large input data typically involves copying (or staging) onto the supercomputer's specialized high-speed storage, scratch space, for sustained high I/O throughput. The current practice of conservatively staging data as early as possible makes the data vulnerable to storage failures, which may entail re-staging and consequently reduced job throughput. To address this, we present a timely staging framework that uses a combination of job startup time predictions, user-specified intermediate nodes, and decentralized data delivery to coincide input data staging with job start-up. By delaying staging to when it is necessary, the exposure to failures and its effects can be reduced. Evaluation using both PlanetLab and simulations based on three years of Jaguar (No. 1 in Top500) job logs show as much as 85.9% reduction in staging times compared to direct transfers, 75.2% reduction in wait time on scratch, and 2.4% reduction in usage/hour.

99 GENERAL AND MISCELLANEOUS↗

Implementing Molecular Dynamics on Hybrid High Performance Computers - Particle-Particle Particle-Mesh

The use of accelerators such as graphics processing units (GPUs) has become popular in scientific computing applications due to their low cost, impressive floating-point capabilities, high memory bandwidth, and low electrical power requirements. Hybrid high-performance computers, machines with nodes containing more than one type of floating-point processor (e.g. CPU and GPU), are now becoming more prevalent due to these advantages. In this paper, we present a continuation of previous work implementing algorithms for using accelerators into the LAMMPS molecular dynamics software for distributed memory parallel hybrid machines. In our previous work, we focused on acceleration for short-range models with an approach intended to harness the processing power of both the accelerator and (multi-core) CPUs. To augment the existing implementations, we present an efficient implementation of long-range electrostatic force calculation for molecular dynamics. Specifically, we present an implementation of the particle-particle particle-mesh method based on the work by Harvey and De Fabritiis. We present benchmark results on the Keeneland InfiniBand GPU cluster. We provide a performance comparison of the same kernels compiled with both CUDA and OpenCL. We discuss limitations to parallel efficiency and future directions for improving performance on hybrid or heterogeneous computers.

97 MATHEMATICS AND COMPUTING↗

Architecture for the Next Generation System Management Tools

To get more results or greater accuracy, computational scientists execute their applications on distributed computing platforms such as Clusters, Grids and Clouds. These platforms are different in terms of hardware and software resources as well as locality: some span across multiple sites and multiple administrative domains whereas others are limited to a single site/domain. As a consequence, in order to scale their applica- tions up the scientists have to manage technical details for each target platform. From our point of view, this complexity should be hidden from the scientists who, in most cases, would prefer to focus on their research rather than spending time dealing with platform configuration concerns. In this article, we advocate for a system management framework that aims to automatically setup the whole run-time environment according to the applications needs. The main difference with regards to usual approaches is that they generally only focus on the software layer whereas we address both the hardware and the software expecta- tions through a unique system. For each application, scientists describe their requirements through the definition of a Virtual Platform (VP) and a Virtual System Environment (VSE). Relying on the VP/VSE definitions, the framework is in charge of: (i) the configuration of the physical infrastructure to satisfy the VP requirements, (ii) the setup of the VP, and (iii) the customization of the execution environment (VSE) upon the former VP. We propose a new formalism that the system can rely upon to successfully perform each of these three steps without burdening the user with the specifics of the configuration for the physical resources, and system management tools. This formalism leverages Goldberg s theory for recursive virtual machines by introducing new concepts based on system virtualization (identity, partitioning, aggregation) and emulation (simple, abstraction). This enables the definition of complex VP/VSE configurations without making assumptions about the hardware and the software re- sources. For each requirement, the system executes the corresponding operation with the appropriate management tool. As a proof of concept, we implemented a first prototype that currently interacts with several system management tools (e.g., OSCAR, the Grid 5000 toolkit, and XtreemOS) and that can be easily extended to integrate new resource brokers or cloud systems such as Nimbus, OpenNebula or Eucalyptus for instance.

99 GENERAL AND MISCELLANEOUS↗

Optimization of X-ray tomography through a cooperative computing system in grid

Cooperative Computing implemented as Cooperative Computing System (CCS) in grid has been proved a considerably reliable technique to execute the tasks with real time constraints in a grid environment. This technique can be applied in many high performance distributed computing applications. HPC has a large number of applications in various fields of physics. One such application in radiation physics is X-ray tomography. X-Ray tomography contains numerous applications in various fields of science, technology and research. As the technology is changing from analog to digital in almost all the scenarios, this paper presents an idea towards the attachment of X-ray tomography assembly to HPC environment so as to obtain the highly reliable optimization.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

WAVEMOTH-FAST SPHERICAL HARMONIC TRANSFORMS BY BUTTERFLY MATRIX COMPRESSION

We present Wavemoth, an experimental open source code for computing scalar spherical harmonic transforms (SHTs). Such transforms are ubiquitous in astronomical data analysis. Our code performs substantially better than existing publicly available codes owing to improvements on two fronts. First, the computational core is made more efficient by using small amounts of pre-computed data, as well as paying attention to CPU instruction pipelining and cache usage. Second, Wavemoth makes use of a fast and numerically stable algorithm based on compressing a set of linear operators in a pre-computation step. The resulting SHT scales as O(L{sup 2}log{sup 2} L) for the resolution range of practical interest, where L denotes the spherical harmonic truncation degree. For low- and medium-range resolutions, Wavemoth tends to be twice as fast as libpsht, which is the current state-of-the-art implementation for the HEALPix grid. At the resolution of the Planck experiment, L {approx} 4000, Wavemoth is between three and six times faster than libpsht, depending on the computer architecture and the required precision. Because of the experimental nature of the project, only spherical harmonic synthesis is currently supported, although adding support for spherical harmonic analysis should be trivial.

79 ASTRONOMY AND ASTROPHYSICS↗

Scientific Workflows Composition and Deployment on SOA Frameworks

Scientific workflows normally consist of multiple applications acquiring and transforming data, running data intensive analyses and visualizing the results for scientific discovery. To compose and deploy such scientific workflows, an SOA platform can provide integration of third-party components, services, and tools. In this paper, we present our application of Service-Oriented Architecture (SOA) to compose and deploy systems biology workflows. In developing this application, our solution uses MeDICi a middleware framework built on SOA platforms as an integration layer. We discuss our experience and lessons learnt about this solution that are generally applicable to scientific workflows in other domains.

99 GENERAL AND MISCELLANEOUS↗

Hybrid AI/Cognitive Tactical Behavior Framework for LVC (LDRD Project Final Report)

This Lab-Directed Research and Development (LDRD) sought to develop technology that enhances scenario construction speed, entity behavior robustness, and scalability in Live-Virtual-Constructive (LVC) simulation. We investigated issues in both simulation architecture and behavior modeling. We developed path-planning technology that improves the ability to express intent in the planning task while still permitting an efficient search algorithm. An LVC simulation demonstrated how this enables 'one-click' layout of squad tactical paths, as well as dynamic re-planning for simulated squads and for real and simulated mobile robots. We identified human response latencies that can be exploited in parallel/distributed architectures. We did an experimental study to determine where parallelization would be productive in Umbra-based force-on-force (FOF) simulations. We developed and implemented a data-driven simulation composition approach that solves entity class hierarchy issues and supports assurance of simulation fairness. Finally, we proposed a flexible framework to enable integration of multiple behavior modeling components that model working memory phenomena with different degrees of sophistication.

99 GENERAL AND MISCELLANEOUS↗

An Online Scheduling Algorithm with Advance Reservation for Large-Scale Data Transfers

Scientific applications and experimental facilities generate massive data sets that need to be transferred to remote collaborating sites for sharing, processing, and long term storage. In order to support increasingly data-intensive science, next generation research networks have been deployed to provide high-speed on-demand data access between collaborating institutions. In this paper, we present a practical model for online data scheduling in which data movement operations are scheduled in advance for end-to-end high performance transfers. In our model, data scheduler interacts with reservation managers and data transfer nodes in order to reserve available bandwidth to guarantee completion of jobs that are accepted and confirmed to satisfy preferred time constraint given by the user. Our methodology improves current systems by allowing researchers and higher level meta-schedulers to use data placement as a service where theycan plan ahead and reserve the scheduler time in advance for their data movement operations. We have implemented our algorithm and examined possible techniques for incorporation into current reservation frameworks. Performance measurements confirm that the proposed algorithm is efficient and scalable.

97 MATHEMATICS AND COMPUTING↗

Research in Elementary Particle Physics

This report details the accomplishments and research results for the High Energy Physics Group at the University of Texas at Arlington at the Energy and Intensity Frontiers. For the Energy Frontier we have made fundamental contributions in the search for supersymmetric particles, proposed to explain the stabilization of the mass of the Higgs Boson – the agent giving mass to all known particles. We have also made major contributions to the search for additional Higgs Bosons and to the planning for future searches. This work has been carried out in the context of the ATLAS Experiment at CERN (European Nuclear Research Laboratory) and for which we have made major contributions to computing and data distribution and processing, and have worked to calibrate the detector and prepare upgraded electronics for the future. Our other contribution to the Energy Frontier has been to the International Linear Collider (ILC) project, potentially hosted by Japan, and to the Silicon Detector Concept (SiD) in particular. We have lead the development of the SiD Concept and have worked on a new form of precise energy measurement for particles from the high energy collisions of electrons and positrons at the ILC. For the Intensity Frontier, we have worked to develop the concept of Long Baseline Neutrino Experiment(s) (LBNE) at the Fermi National Accelerator Laboratory. Our contributions to detector development, neutrino beam studies, particle identification, software development will facilitate future studies of the oscillation of one type of neutrino into other type(s), establish the order of the neutrino masses, and, through an innovative new idea, allow us to create a beam of dark matter particles.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗