Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data parallelism”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,225 records · Page 68
All sourcesNASA NTRSDOE OSTI
NASA NTRS2018

The New (Version 4) Calibration of the Nighttime 532nm Channel of the CALIPSO Lidar

The data products from the Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) on board Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO) were recently updated following the implementation of a new (version 4.1) calibration algorithm for all the level 1 products. We present the motivation for and the implementation of the version 4.1 nighttime 532 nm parallel channel measurements. This is the most fundamental calibration of CALIOP data since all other measurements, i.e the 532 nm nighttime perpendicular, daytime 532 nm as well as 1064 nm are tied to this calibration. The new calibration is shown to resolve the discrepancies in the earlier version and also leads to an improved representation of the stratospheric aerosols. Initial validation results using ground based and airborne lidar measurements are also presented.

Kar, J.↗
NASA NTRS1993

A tool for manual endmember selection and spectral unmixing

Sampling a continuous radiance spectrum in many narrow contiguous spectral bands results in a high covariance between the bands. Hence, the true dimensionality of imaging spectrometer data is not determined by the number of spectral bands, but by the number of spectrally unique signatures whose mixtures reproduce the spectral variance observed in an image. Methods to unmix high dimensional multispectral data use principal components analysis to reduce the dimensionality. The variance of the spectral data is modeled as a linear combination of a finite set of endmembers in the space of the eigen-vectors that account for most of the variance. The number and characteristics of these endmembers are determined not only by the number and characteristics of the spectrally unique materials on the surface but also by processes (e.g., illumination, atmospheric scattering and absorption) affecting the signal received by the sensor. Selection of endmember spectra has typically been from a library. However, since most libraries are incomplete and do not account for the processes mentioned above, we have devised a computer display that allows researchers to explore interactively the eigenvector space of a representative and mean-corrected subset of the image data in search of extreme spectra to designate as endmembers. This display, which is based on parallel coordinates, is unique in the area of multidimensional visualization in that it includes not only a passive view of higher dimensional data but also the capability to interact and move geometrical objects in higher dimensional spaces.

Bateson, C. Ann↗
NASA NTRS1982

On nonlinear finite element analysis in single-, multi- and parallel-processors

Numerical solution of nonlinear equilibrium problems of structures by means of Newton-Raphson type iterations is reviewed. Each step of the iteration is shown to correspond to the solution of a linear problem, therefore the feasibility of the finite element method for nonlinear analysis is established. Organization and flow of data for various types of digital computers, such as single-processor/single-level memory, single-processor/two-level-memory, vector-processor/two-level-memory, and parallel-processors, with and without sub-structuring (i.e. partitioning) are given. The effect of the relative costs of computation, memory and data transfer on substructuring is shown. The idea of assigning comparable size substructures to parallel processors is exploited. Under Cholesky type factorization schemes, the efficiency of parallel processing is shown to decrease due to the occasional shared data, just as that due to the shared facilities.

Utku, S.↗
NASA NTRS2000

Advantages of Parallel Processing and the Effects of Communications Time

Many computing tasks involve heavy mathematical calculations, or analyzing large amounts of data. These operations can take a long time to complete using only one computer. Networks such as the Internet provide many computers with the ability to communicate with each other. Parallel or distributed computing takes advantage of these networked computers by arranging them to work together on a problem, thereby reducing the time needed to obtain the solution. The drawback to using a network of computers to solve a problem is the time wasted in communicating between the various hosts. The application of distributed computing techniques to a space environment or to use over a satellite network would therefore be limited by the amount of time needed to send data across the network, which would typically take much longer than on a terrestrial network. This experiment shows how much faster a large job can be performed by adding more computers to the task, what role communications time plays in the total execution time, and the impact a long-delay network has on a distributed computing system.

Eddy, Wesley M.↗
NASA NTRS2011

The Impact of Rise of the Andes and Amazon Landscape Evolution on Diversification of Lowland terra-firme Forest Birds

Since the 19th Century, the unmatched biological diversity of Amazonia has stimulated a diverse set of hypotheses accounting for patterns of species diversity and distribution in mega-diverse tropical environments. Unfortunately, the evidence supporting particular hypotheses to date is at best described as ambiguous, and no generalizations have emerged yet, mostly due to the lack of comprehensive comparative phylogeographic studies with thorough trans-Amazonian sampling of lineages. Here we report on spatial and temporal patterns of diversification estimated from mitochondrial gene trees for 31 lineages of birds associated with upland terra-firme forest, the dominant habitat in modern lowland Amazonia. The results confirm the pervasive role of Amazonian rivers as primary barriers separating sister lineages of birds, and a protracted spatio-temporal pattern of diversification, with a gradual reduction of earlier (1st and 2nd) and older (> 2 mya) splits associated with each lineage in an eastward direction. (The easternmost tributaries of the Amazon, the Xingu and Tocantins Rivers, are not associated with any splits older than > 2 mya). For the suboscine passerines, maximum-likelihood estimates of rates of diversification point to an overall constant rate over the past 5 my (up to a significant downturn at 300,000 y ago). This "younging-eastward" pattern may have an abiotic explanation related to landscape evolution. Triggered by a new pulse of Andean uplift, it has been proposed that modern Amazon basin landscapes may have evolved successively eastward, away from the mountain chain, starting approximately 10 mya. This process was likely based on the deposition of vast fluvial sediment masses, known as megafans, that may have extended progressively and in series eastward from Andean sources. This process plausibly explains the progressive extinction of original Pebas wetland of western-central Amazonia by the present fluvial landsurfaces of a more terra-firme type. The youngest landsurfaces thus lie furthest from the mountains. In this scenario major drainages were also reoriented in wholesale fashion away from a northerly orientation generally towards the east and an Atlantic Ocean outlet. The advance of megafans is best seen by the location of axial rivers such as the Orinoco and Mamore which lie against the cratonic margins furthest from the Andes, at the distal ends of major megafan ramparts. More importantly, other major river courses in western-central Amazonia will have been established at progressively younger dates with distance eastward. If this landscape-sequence scenario is accurate, it parallels the progressive younging of the passerine lineages. The bird DNA data appears to confirm strongly the pervasive role of Amazonian rivers--as primary barriers separating sister lineages of birds, and thus probably as facilitaters of bird speciation. We show for the first time that a general spatio-temporal pattern of diversification for terra-firme lineages in the Amazon is associated with rivers ("younging-eastward"), and furthermore parallels a specific scenario of regional drainage evolution.

Aleixo, Alexandre↗
NASA NTRS1993

Evaluation of the Intel iWarp parallel processor for space flight applications

The potential of a DARPA-sponsored advanced processor, the Intel iWarp, for use in future SSF Data Management Systems (DMS) upgrades is evaluated through integration into the Ames DMS testbed and applications testing. The iWarp is a distributed, parallel computing system well suited for high performance computing applications such as matrix operations and image processing. The system architecture is modular, supports systolic and message-based computation, and is capable of providing massive computational power in a low-cost, low-power package. As a consequence, the iWarp offers significant potential for advanced space-based computing. This research seeks to determine the iWarp's suitability as a processing device for space missions. In particular, the project focuses on evaluating the ease of integrating the iWarp into the SSF DMS baseline architecture and the iWarp's ability to support computationally stressing applications representative of SSF tasks.

Hine, Butler P., III↗
DOE OSTI2023

PhytoOracle: Scalable, modular phenomics data processing pipelines

As phenomics data volume and dimensionality increase due to advancements in sensor technology, there is an urgent need to develop and implement scalable data processing pipelines. Current phenomics data processing pipelines lack modularity, extensibility, and processing distribution across sensor modalities and phenotyping platforms. To address these challenges, we developed PhytoOracle (PO), a suite of modular, scalable pipelines for processing large volumes of field phenomics RGB, thermal, PSII chlorophyll fluorescence 2D images, and 3D point clouds. PhytoOracle aims to ( i ) improve data processing efficiency; ( ii ) provide an extensible, reproducible computing framework; and ( iii ) enable data fusion of multi-modal phenomics data. PhytoOracle integrates open-source distributed computing frameworks for parallel processing on high-performance computing, cloud, and local computing environments. Each pipeline component is available as a standalone container, providing transferability, extensibility, and reproducibility. The PO pipeline extracts and associates individual plant traits across sensor modalities and collection time points, representing a unique multi-system approach to addressing the genotype-phenotype gap. To date, PO supports lettuce and sorghum phenotypic trait extraction, with a goal of widening the range of supported species in the future. At the maximum number of cores tested in this study (1,024 cores), PO processing times were: 235 minutes for 9,270 RGB images (140.7 GB), 235 minutes for 9,270 thermal images (5.4 GB), and 13 minutes for 39,678 PSII images (86.2 GB). These processing times represent end-to-end processing, from raw data to fully processed numerical phenotypic trait data. Repeatability values of 0.39-0.95 (bounding area), 0.81-0.95 (axis-aligned bounding volume), 0.79-0.94 (oriented bounding volume), 0.83-0.95 (plant height), and 0.81-0.95 (number of points) were observed in Field Scanalyzer data. We also show the ability of PO to process drone data with a repeatability of 0.55-0.95 (bounding area).

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1998

Implementation of a Parallel Kalman Filter for Stratospheric Chemical Tracer Assimilation

A Kalman filter for the assimilation of long-lived atmospheric chemical constituents has been developed for two-dimensional transport models on isentropic surfaces over the globe. An important attribute of the Kalman filter is that it calculates error covariances of the constituent fields using the tracer dynamics. Consequently, the current Kalman-filter assimilation is a five-dimensional problem (coordinates of two points and time), and it can only be handled on computers with large memory and high floating point speed. In this paper, an implementation of the Kalman filter for distributed-memory, message-passing parallel computers is discussed. Two approaches were studied: an operator decomposition and a covariance decomposition. The latter was found to be more scalable than the former, and it possesses the property that the dynamical model does not need to be parallelized, which is of considerable practical advantage. This code is currently used to assimilate constituent data retrieved by limb sounders on the Upper Atmosphere Research Satellite. Tests of the code examined the variance transport and observability properties. Aspects of the parallel implementation, some timing results, and a brief discussion of the physical results will be presented.

Chang, Lang-Ping↗
NASA NTRS1991

Querying databases of trajectories of differential equations 2: Index functions

Suppose that a large number of parameterized trajectories (gamma) of a dynamical system evolving in R sup N are stored in a database. Let eta is contained R sup N denote a parameterized path in Euclidean space, and let parallel to center dot parallel to denote a norm on the space of paths. A data structures and indices for trajectories are defined and algorithms are given to answer queries of the following forms: Query 1. Given a path eta, determine whether eta occurs as a subtrajectory of any trajectory gamma from the database. If so, return the trajectory; otherwise, return null. Query 2. Given a path eta, return the trajectory gamma from the database which minimizes the norm parallel to eta - gamma parallel.

Grossman, Robert↗
NASA NTRS1989

Investigating ocean surface solar irradiance using Nimbus-7 Earth Radiation Budget data

A new estimation technique is introduced, using a surface solar irradiance database with advanced climate monitoring capabilities. Incorporating the Nimbus-7 Earth Radiation Budget (ERB) planetary albedo data obtained from wide-field-of-view radiometer measurements, the new solar irradiance model uses plane-parallel theory and assumes the isotropy of radiance reflected by the clouds and ocean surface. A brief description of the data, a treatment of the model verification, and a discussion of surface solar irradiance variability are presented. The results demonstrate the model's sensitivity to large-scale seasonal and interannual phenomena. A summary of the investigation is also presented, along with a perspective on potential uses and future development.

Chertock, Beth↗
NASA NTRS1996

Parallelization and Algorithmic Enhancements of High Resolution IRAS Image Construction

The Infrared Astronomical Satellite caried out a nearly complete survey of the infrared sky, and the survey data are important for the study of many astrophysical phenomena. However, many data sets at other wavelengths have higher resolutions than that of the co-added IRAS maps, and high resolution IRAS images are strongly desired both for their own information content and their usefulness in correlation. The HIRES program was developed by the Infrared Processing and Analysis Center (IPAC) to produce high resolution (approx. 1') images from IRAS data using the Maximum Correlation Method (MCM). We describe the port of HIRES to the Intel Paragon, a massively parallel supercomputer, other software developments for mass production of HIRES images, and the IRAS Galaxy Atlas, a project to map the Galactic plane at 60 and 100(micro)m.

Satellite infrared IRAS IRAS maps IRAS images↗
DOE OSTI2020

An open source fast fluid dynamics model for data center thermal management

Although computational fluid dynamics (CFD) has been widely adopted to improve data center thermal management, the high computational demand limits its applications, such as multivariate optimal design and operation. Fast fluid dynamics (FFD), which has been applied for fast airflow simulation, shows great potential. However, few research applied FFD for optimal design and operation of data center thermal management. This research improves the FFD model for data centers and conducts a comprehensive evaluation and demonstration. First, the FFD model is improved by solving the advection and diffusion equations together using an upwind scheme instead of a semi-Lagrangian advection solver in the conventional FFD model. Second, new features for data centers are added, such as a pressure correction method to simulate plenum airflow and dynamic boundary conditions for IT racks. The new FFD model is first validated with two indoor environment cases and the results show that the new FFD model has slightly better overall prediction accuracy and faster speed compared to the conventional FFD model. It is also observed that both FFD models achieve acceptable accuracy, except for a few localized disparities with experimental data, which might be due to simplified handling of turbulence viscosity near the boundaries. Furthermore, validation with a real data center shows that the FFD model achieves a similar level of accuracy as CFD when compared to the experimental measurements with some level of uncertainties. It is then demonstrated for data center optimal design and operation, which saves 53.4–58.8% of annual energy while still meeting the thermal requirements. In conclusion, with a much faster speed and comparable accuracy compared to CFD, the FFD model parallelized on a graphics processing unit is promising for practical model-based data center early design and operation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
NASA NTRS2013

NASA Tech Briefs, March 2013

Topics covered include: Remote Data Access with IDL Data Compression Algorithm Architecture for Large Depth-of-Field Particle Image Velocimeters Vectorized Rebinning Algorithm for Fast Data Down-Sampling Display Provides Pilots with Real-Time Sonic-Boom Information Onboard Algorithms for Data Prioritization and Summarization of Aerial Imagery Monitoring and Acquisition Real-time System (MARS) Analog Signal Correlating Using an Analog-Based Signal Conditioning Front End Micro-Textured Black Silicon Wick for Silicon Heat Pipe Array Robust Multivariable Optimization and Performance Simulation for ASIC Design; Castable Amorphous Metal Mirrors and Mirror Assemblies; Sandwich Core Heat-Pipe Radiator for Power and Propulsion Systems; Apparatus for Pumping a Fluid; Cobra Fiber-Optic Positioner Upgrade; Improved Wide Operating Temperature Range of Li-Ion Cells; Non-Toxic, Non-Flammable, -80 C Phase Change Materials; Soft-Bake Purification of SWCNTs Produced by Pulsed Laser Vaporization; Improved Cell Culture Method for Growing Contracting Skeletal Muscle Models; Hand-Based Biometric Analysis; The Next Generation of Cold Immersion Dry Suit Design Evolution for Hypothermia Prevention; Integrated Lunar Information Architecture for Decision Support Version 3.0 (ILIADS 3.0); Relay Forward-Link File Management Services (MaROS Phase 2); Two Mechanisms to Avoid Control Conflicts Resulting from Uncoordinated Intent; XTCE GOVSAT Tool Suite 1.0; Determining Temperature Differential to Prevent Hardware Cross-Contamination in a Vacuum Chamber; SequenceL: Automated Parallel Algorithms Derived from CSP-NT Computational Laws; Remote Data Exploration with the Interactive Data Language (IDL); Mixture-Tuned, Clutter Matched Filter for Remote Detection of Subpixel Spectral Signals; Partitioned-Interval Quantum Optical Communications Receiver; and Practical UAV Optical Sensor Bench with Minimal Adjustability.

Source record↗
NASA NTRS1993

Hyperspectral data analysis procedures with reduced sensitivity to noise

Multispectral sensor systems have become steadily improved over the years in their ability to deliver increased spectral detail. With the advent of hyperspectral sensors, including imaging spectrometers, this technology is in the process of taking a large leap forward, thus providing the possibility of enabling delivery of much more detailed information. However, this direction of development has drawn even more attention to the matter of noise and other deleterious effects in the data, because reducing the fundamental limitations of spectral detail on information collection raises the limitations presented by noise to even greater importance. Much current effort in remote sensing research is thus being devoted to adjusting the data to mitigate the effects of noise and other deleterious effects. A parallel approach to the problem is to look for analysis approaches and procedures which have reduced sensitivity to such effects. We discuss some of the fundamental principles which define analysis algorithm characteristics providing such reduced sensitivity. One such analysis procedure including an example analysis of a data set is described, illustrating this effect.

Landgrebe, David A.↗
DOE OSTI2023

Determination of the titanium spectral function from ($e,e'p$) data

The E12-14-012 experiment, performed in Jefferson Lab Hall A, has measured the (e, e'p) cross section in parallel kinematics using a natural titanium target. In this paper, we report the analysis of the dataset obtained in different kinematics for our solid natural titanium target. Data were obtained in a range of missing momentum and missing energy between 15 ≲ p m ≲ 250 MeV / c and 12 ≲ E m ≲ 80 MeV, respectively, and using an electron beam energy of 2.2 GeV. We measured the reduced cross section with ~7% accuracy as a function of both missing momentum and missing energy. Furthermore, our Monte Carlo simulation, including both a model spectral function and the effects of final-state interactions, satisfactorily reproduces the data.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

GeantV: Results from the Prototype of Concurrent Vector Particle Transport Simulation in HEP

Full detector simulation was among the largest CPU consumers in all CERN experiment software stacks for the first two runs of the Large Hadron Collider. In the early 2010s, it was projected that simulation demands would scale linearly with increasing luminosity, with only partial compensation from increasing computing resources. The extension of fast simulation approaches to cover more use cases that represent a larger fraction of the simulation budget is only part of the solution, because of intrinsic precision limitations. The remainder corresponds to speeding up the simulation software by several factors, which is not achievable by just applying simple optimizations to the current code base. In this context, the GeantV R&D project was launched, aiming to redesign the legacy particle transport code in order to benefit from features of fine-grained parallelism, including vectorization and increased locality of both instruction and data. This paper provides an extensive presentation of the results and achievements of this R&D project, as well as the conclusions and lessons learned from the beta version prototype.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Summary of Savannah River Site FY23 Salt Waste Qualification Data

The Savannah River National Laboratory (SRNL) analyzed samples from Savannah River Site (SRS) Waste Tanks 41H and 21H to support qualification of Salt Waste Processing Facility (SWPF) Waste Batches 8 and 9 for processing (the FY23 Salt Batch Qualification samples). These Tanks (i.e. 41H and 21H) are blend tanks for feed to SWPF. None of the samples displayed any unusual or unexpected characteristics such as large amounts of solids, floating solids, or unusual color. Characterization of these samples confirmed similar chemical composition and characteristics to previous salt waste batches. The results for Batches 8 and 9 were provided by SRNL to Savannah River Mission Completion (SRMC), the Liquid Waste Operations subcontractor at SRS, as External Sample Results (Laboratory Information Management System (LIMS)) Reports. Additionally, a separate technical memo was issued by SRNL to report re-test data for Batch 8 for Cs-137 for filtered samples only which were run at the request of SWPF. For Batch 9, a set of samples was also analyzed in parallel by the SWPF-Analytical Laboratory (SWPF-AL). The SWPF-AL data is included herein for comparison with the SRNL data where applicable. The analytical results (both rapid, typically 4 weeks, and long term, typically 8 weeks) for Batches 8 and 9 are now summarized and discussed in this technical report.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
NASA NTRS1986

Argon ions injected parallel and perpendicular to the magnetic field

Preliminary results are reported of measurements obtained with the 0-10-kHz electric-field plasma-wave receivers and single-particle ion detectors of the ARCS-3 sounding-rocket payload over the auroral oval on February 10, 1985, after downward/field-parallel or transverse-spiral injection of Ar ions from the accelerator subpayload (separating itself at 2.3 m/s). The data are presented graphically and briefly characterized. The waves induced by the parallel injections are found to be much weaker than those induced by the perpendicular injections. In addition to the expected response to the Ar beam, an ion flux at pitch angle 90 deg was detected during the second parallel injection.

Erlandson, R. E.↗