Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data parallelism”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,243 records · Page 69
All sourcesNASA NTRSDOE OSTI
NASA NTRS2021

PatchworkWave: A Multipatch Infrastructure for Multiphysics/Multiscale/Multiframe/Multimethod Simulations at Arbitrary Order

We present an extension of the PatchworkMHD code [1], itself an MHD-capable extension of thePatch-workcode [2], for which several algorithms presented here were co-developed. Its purpose is to create a“multipatch” scheme compatible with numerical simulations of arbitrary equations of motion at any dis-cretization order in space and time. In thePatchworkframework, the global simulation is comprised of anarbitrary number of moving, local meshes, or “patches”, which are free to employ their own resolution, co-ordinate system/topology, physics equations, reference frame, and in our new approach, numerical method.Each local patch exchanges boundary data with a single global patch on which all other patches residethrough a client-router-server parallelization model. In generalizingPatchworkto be compatible witharbitrary order time integration,PatchworkMHDandPatchworkWavehave significantly improved theinterpatch interpolation accuracy by removing an interpolation of interpolated data feedback present in theoriginalPatchworkcode. Furthermore, we extendPatchworkto bemultimethodby allowing multiplestate vectors to be updated simultaneously, with each state vector providing its own interpatch interpolationand transformation procedures. As such, our scheme is compatible with nearly any set of hyperbolic partialdifferential equations. We demonstrate our changes through the implementation of a scalar wave toy-modelthat is evolved on arbitrary, time dependent patch configurations at 4th order accuracy.

Dennis B Bowen↗
NASA NTRS1980

Overseas trip report, CV 990 underflight mission

The scanning microwave radiometer-7 simulator, the ocean temperature scanner, and an imaging scatterometer/altimeter operating at 14 GHz were carried onboard the NASA CV-990 over open oceans, sea ice, and continental ice sheets to gather surface truth information. Data flights were conducted over the Norwegian Sea to map the ocean polar front south and west of Bear Island and to transect several Nimbus-7 footprints in a rectangular pattern parallel to the northern shoreline of Norway. Additional flights were conducted to obtain correlative data on the cryosphere parameters and characteristics of the Greenland ice sheet, and study the frozen lakes near Barrow. The weather conditions and flight path way points for each of the nineteen flights are presented in tables and maps.

Gloersen, P.↗
NASA NTRS1994

Statistical study of ULF wave occurrence in the dayside magnetosphere

Ultralow-frequency (ULF) waves are observed almost everywhere in the dayside magnetosphere. The mechanism by which these waves are generated and transformed in the dayside magnetosphere is still not understood. Here we report a statistical study of these waves based on magnetic field data from the International Sun-Earth Explorer 1 (ISEE 1) spacecraft. Data from the first traversal of the spacecraft through the entire dayside magnetosphere have been examined to determine the spatial distribution of wave occurrence. Successive 20-min segments of data were transformed to a field-aligned coordinate system. The parallel component was detrended and all three components of the field spectrally analyzed. Wave occurrence was defined by the presence of significant peaks in the power spectra. Wave events were categorized by three wave frequency bands: Pc 3 with T approximately 10-45 s; Pc 4 with T approximately 45-150 s; the short-period part of the Pc 5 wave band with T approximately 150-324 s. Properties of the spectral peaks were then entered into a data base. The data base was next sorted to determine the spatial occurrence pattern for the waves. Our results show that Pc 3 waves most frequently occur just outside synchronous orbit and are approximately centered on local noon. Pc 4 waves have a similar distribution with its peak further out. Pc 5 waves have high occurrence rate at the two flanks of the magnetosphere. Peaks in spectra obtained near the magnetopause are less clearly defined than those deeper in the magnetosphere.

Cao, M.↗
NASA NTRS1987

Contextual classification on the massively parallel processor

Classifiers are often used to produce land cover maps from multispectral Earth observation imagery. Conventionally, these classifiers have been designed to exploit the spectral information contained in the imagery. Very few classifiers exploit the spatial information content of the imagery, and the few that do rarely exploit spatial information content in conjunction with spectral and/or temporal information. A contextual classifier that exploits spatial and spectral information in combination through a general statistical approach was studied. Early test results obtained from an implementation of the classifier on a VAX-11/780 minicomputer were encouraging, but they are of limited meaning because they were produced from small data sets. An implementation of the contextual classifier is presented on the Massively Parallel Processor (MPP) at Goddard that for the first time makes feasible the testing of the classifier on large data sets.

Tilton, James C.↗
NASA NTRS1985

Evaluation of existing and proposed computer architectures for future ground-based systems

Parallel processing architectures and techniques used in current supercomputers are described and projections are made of future advances. Presently, the von Neumann sequential processing pattern has been accelerated by having separate I/O processors, interleaved memories, wide memories, independent functional units and pipelining. Recent supercomputers have featured single-input, multiple data stream architectures, which have different processors for performing various operations (vector or pipeline processors). Multiple input, multiple data stream machines have also been developed. Data flow techniques, wherein program instructions are activated only when data are available, are expected to play a large role in future supercomputers, along with increased parallel processor arrays. The enhanced operational speeds are essential for adequately treating data from future spacecraft remote sensing instruments such as the Thematic Mapper.

Schulbach, C.↗
DOE OSTI2023

HEPnOS: a Specialized Data Service for High Energy Physics Analysis

In this paper, we present HEPnOS, a distributed data service for managing data produced by high-energy physics (HEP) experiments. Using HEPnOS, HEP applications can use HPC resources more effciently than traditional fle-based applications. The fle-based model leads to a rigid, chunk-based allocation of computational resources and limits the number of cores that can be used concurrently by an HEP application. The fundamental problem is that organizing domain-specifc data into fles inadvertently introduces a single, artifcial, confated tuning parameter that puts key optimization goals into confict: larger fle sizes reduce metadata overhead and thus improve I/O effciency, but smaller fle sizes provide more opportunity for workfow parallelism and load balancing. In this work, we introduce a domain-specifc data service that decouples that constraint so that data can be accessed and processed in its natural granularity while still maintaining I/O effciency. By removing the constraints introduced by fle handling we are able to obtain better scaling and make effcient use of more cores for processing a fxed-sized data sample. We demonstrate the improved scalability by using an application developed in the fle-based paradigm and comparing it to a version modifed to use HEPnOS.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Phoenix: A Scalable Streaming Hypergraph Analysis Framework

We present Phoenix, a scalable hypergraph analytics framework for data analytics and knowledge discovery that was implemented on the leadership class computing platforms at Oak Ridge National Laboratory (ORNL). Our software framework comprises a distributed implementation of a streaming server architecture which acts as a gateway for various hypergraph generators/external sources to connect. Phoenix has the capability to utilize diverse hypergraph generators, including HyGen, a very large-scale hypergraph generator developed by ORNL. Phoenix incorporates specific algorithms for efficient data representation by exploiting hidden structures of the hypergraphs. Our experimental results demonstrate Phoenix’s scalable and stable performance on massively parallel computing platforms. Phoenix’s superior performance is due to the merging of high-performance computing with data analytic.

Kurte, Kuldeep↗
NASA NTRS2000

The High Mosaicity Illusion: Revealing the True Physical Characteristics of Macromolecular Crystals

An experimental system and software have been developed for simultaneously measuring the diffraction resolution and mosaic spread of macromolecular crystals. Hundreds of reflection profiles over a wide resolution range were rapidly measured by using a charge coupled device (CCD) area detector in combination with superfine phi slicing data collection. The contributions of the X-ray beam to the reflection widths were minimized by using a highly-parallel, highly-monochromatic synchrotron source. These contributions and Lorentz effects were evaluated and deconvoluted from the recorded data. Data collection and processing is described. From one degree of superfine phi slice data collected on a crystal of manganese superoxide dismutase the mosaicity of 261 reflections were measured. The average mosaicity was 0.0101 degrees (0.0035) at the full-width-at-half-maximum (FWHM) and ranged from 0.0011 degrees to 0.0188 degrees. Each reflection profile was individually fit with two gaussian profiles with the first gaussian contributing 55% and the second contributing 35% of the reflection. On average, the mosaicity of the first gaussian was 0.0054 degrees (0.0015) and the second was 0.0061 degrees (0.0023). The mosaicity of the crystal was anisotropic with fh, f k, and fl values of 0.0068 degrees, 0.0140 degrees and 0.0046 degrees, respectively at the FWHM. The anisotropic mosaicity analysis indicates that the crystal is the most perfect in the I direction which corresponds to the favored growth direction of the crystal.

Bellamy, Henry↗
NASA NTRS1998

Distributed Parallel Processing and Dynamic Load Balancing Techniques for Multidisciplinary High Speed Aircraft Design

Multidisciplinary design optimization (MDO) for large-scale engineering problems poses many challenges (e.g., the design of an efficient concurrent paradigm for global optimization based on disciplinary analyses, expensive computations over vast data sets, etc.) This work focuses on the application of distributed schemes for massively parallel architectures to MDO problems, as a tool for reducing computation time and solving larger problems. The specific problem considered here is configuration optimization of a high speed civil transport (HSCT), and the efficient parallelization of the embedded paradigm for reasonable design space identification. Two distributed dynamic load balancing techniques (random polling and global round robin with message combining) and two necessary termination detection schemes (global task count and token passing) were implemented and evaluated in terms of effectiveness and scalability to large problem sizes and a thousand processors. The effect of certain parameters on execution time was also inspected. Empirical results demonstrated stable performance and effectiveness for all schemes, and the parametric study showed that the selected algorithmic parameters have a negligible effect on performance.

Krasteva, Denitza T.↗
NASA NTRS2025

Influence of Microgravity on Bacterial Pathogen Virulence and Immune Cell Function—Relevance for Infectious Disease Risk During Spaceflight

Spaceflight has measurable impacts on astronaut immune profiles as well as the virulence patterns of bacterial pathogens. Data with respect to human immunity indicate diminished T and NK cell function, altered cytokine profiles, persistent inflammation, and latent herpesvirus reactivation. Furthermore, evaluation of International Space Station (ISS) crewmembers gives evidence of compromised immunity, including atypical allergy, infectious disease, and dermatitis. Data with respect to certain human bacterial pathogens suggest modified virulence that may be enhanced. It is therefore critical to examine this interaction of immune dysregulation and increased microbial virulence and whether it might synergistically increase the risk of infectious disease to crew members. The goal of this study is to use modeled microgravity to study the impact of medically significant ISS bacteria that may have altered virulence on the immune response of the host. This study consists of two primary aims to assess this relationship. First, immune cells will be collected from healthy test subjects and cultured in static or in modeled microgravity conditions together with either control pathogens or with microgravity conditioned pathogens that were grown in bioreactors. Second, immune cells will be collected from astronauts before, during, and after flight and co-cultured with the control or the microgravity conditioned bacteria. Three pathogens were selected for this investigation: Pseudomonas aeruginosa , Salmonella enterica serovar Enteritidis and Burkholderia cepacia . Previously, the optimal cell to bacteria ratios that produce the greatest immune cell responses have been derived for these three bacteria. Cellular activation, as determined by the induction of cell surface activation markers and cytokine profiles, will be measured. Interactions between cells and bacteria will be assessed using fluorescent and electron microscopy techniques. This study will provide critical information to help understand how microgravity alters microbial virulence and the associated infectious disease risk to crewmembers during spaceflight missions. Over the past year, the Immunology and Microbiology laboratories at NASA Johnson Space Center have collaborated to process the astronaut subject samples to complete the last year of the flight portion of this study. This included the completion of four astronaut subjects full mission sampling sets. Sample processing included innate and adaptive cell flow cytometry as well as analysis of cytokine concentrations in the supernatant. The ground control segment of the study will take place during FY25 which involves parallel infections run under static and clinostat conditions. The acquired data sets over this 3-year study are now being analyzed to provide a comprehensive set of results and conclusions that will contribute to a more effective risk assessment for astronauts during spaceflight regarding this host-pathogen context.

Immunology↗
NASA NTRS1985

Generation of available potential energy and the energy cycle during the global weather experiment

Two parallel sets of analyses, which in one case included and in the other omitted data observed by satellite based and other FGGE special observing systems are examined. The results of our previous work is extended in two separate, but not unrelated, ways. First, from these two parallel analyses, which are labeled FGGE (full FGGE system) and NOSAT (satellite omitted), it was discovered that the two sets of fields were quite close over much of the globe. Locally the influence of satellite based systems led to some differences, particularly over the Southern Hemisphere Oceans. The diabatic heating fields generated by the GLA FGGE analysis was also examined. From these fields, one can ascertain the role of total diabatic heating and of the various diabatic heating components in the atmospheric energy cycle, in particular in the generation of available potential energy.

Salstein, D. A.↗
NASA NTRS1961

Results of the Second U.S. Manned Suborbital Space Flight, July 21, 1961

This document presents the results of the second United States manned suborbital space flight. The data and flight description presented form a continuation of the information provided at an open conference held under the auspices of the National Aeronautics and Space Administration, in cooperation with the National Institutes of Health and the National Academy of Sciences, at the U.S. Department of State Auditorium on June 6, 1961. The papers presented herein generally parallel the presentations of the first report and were prepared by the personnel of the NASA Manned Spacecraft Center in collaboration with personnel from other government agencies, participating industry, and universities. The second successful manned suborbital space flight on July 21, 1961, in which Astronaut Virgil I. Grissom was the pilot was another step in the progressive research, development, and training program leading to the study of man's capabilities in a space environment during manned orbital flight. Data and operational experiences gained from this flight were in agreement with and supplemented the knowledge obtained from the first suborbital flight of May 5, 1961, piloted by Astronaut Alan B. Shepard, Jr. The two recent manned suborbital flights, coupled with the unmanned research and development flights, have provided valuable engineering nd scientific data on which the program can progress. The successful active participation of the pilots, in much the same way as in the development and testing of high performance aircraft, has. greatly increased our confidence in giving man a significant role in future space flight activities. It is the purpose of this report to continue the practice of providing data to the scientific community interested in activities of this nature. Brief descriptions are presented of the Project Mercury spacecraft and flight plan. Papers are provided which parallel the presentations of data published for the first suborbital space flight. Additional information is given relating to the operational aspects of the medical support activities for the two manned suborbital space flights.

Source record↗
DOE OSTI2022

Power Converter Circuit Design Automation using Parallel Monte Carlo Tree Search

The tidal waves of modern electronic/electrical devices have led to increasing demands for ubiquitous application-specific power converters. A conventional manual design procedure of such power converters is computation- and labor-intensive, which involves selecting and connecting component devices, tuning component-wise parameters and control schemes, and iteratively evaluating and optimizing the design. To automate and speed up this design process, we propose an automatic framework that designs custom power converters from design specifications using Monte Carlo Tree Search. Specifically, the framework embraces the upper-confidence-bound-tree (UCT), a variant of Monte Carlo Tree Search, to automate topology space exploration with circuit design specification-encoded reward signals. Moreover, our UCT-based approach can exploit small offline data via the specially designed default policy and can run in parallel to accelerate topology space exploration. Further, it utilizes a hybrid circuit evaluation strategy to substantially reduce design evaluation costs. Empirically, we demonstrated that our framework could generate energy-efficient circuit topologies for various target voltage conversion ratios. Compared to existing automatic topology optimization strategies, the proposed method is much more computationally efficient --- the sequential version can generate topologies with the same quality while being up to 67% faster. Here, the parallelization schemes can further achieve high speedups compared to the sequential version.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

OPER: Optimality-Guided Embedding Table Parallelization for Large-scale Recommendation Model

With the sharp increasing volume of user data, Deep Learning Recommendation Model (DLRM) becomes an indispensable infrastructure in large technology companies. However, large-scale DLRM on the multi-GPU platform is still inefficient due to unbalanced workload partitioning and intensive inter-GPU communication. To this end, we propose OPER, an OPtimality guided Embedding table placement for large-scale Recommendation model training and inference. OPER explores the potential of mitigating remote memory access latency in DLRM through fine-grained embedding table placement. Specifically, OPER proposes a theoretical modeling that builds up the relationship between EMT placement and the embedding communication latency in both training and inference. OPER proves the NP hardness of finding the optimal embedding table placement and proposes a heuristic algorithm that yields near optimal placement. OPER implements a SHMEM-based embedding table training system and a unified embedding index mapping to support fine-grained embedding table sharding and placement. Comprehensive experiments reveal that OPER achieves on average 3.4× and 5.1× speedup on training and inference respectively over state-of-the-art DLRM frameworks.

Wang, Zheng↗
NASA NTRS2009

Improving 3D Wavelet-Based Compression of Hyperspectral Images

Two methods of increasing the effectiveness of three-dimensional (3D) wavelet-based compression of hyperspectral images have been developed. (As used here, images signifies both images and digital data representing images.) The methods are oriented toward reducing or eliminating detrimental effects of a phenomenon, referred to as spectral ringing, that is described below. In 3D wavelet-based compression, an image is represented by a multiresolution wavelet decomposition consisting of several subbands obtained by applying wavelet transforms in the two spatial dimensions corresponding to the two spatial coordinate axes of the image plane, and by applying wavelet transforms in the spectral dimension. Spectral ringing is named after the more familiar spatial ringing (spurious spatial oscillations) that can be seen parallel to and near edges in ordinary images reconstructed from compressed data. These ringing phenomena are attributable to effects of quantization. In hyperspectral data, the individual spectral bands play the role of edges, causing spurious oscillations to occur in the spectral dimension. In the absence of such corrective measures as the present two methods, spectral ringing can manifest itself as systematic biases in some reconstructed spectral bands and can reduce the effectiveness of compression of spatially-low-pass subbands. One of the two methods is denoted mean subtraction. The basic idea of this method is to subtract mean values from spatial planes of spatially low-pass subbands prior to encoding, because (a) such spatial planes often have mean values that are far from zero and (b) zero-mean data are better suited for compression by methods that are effective for subbands of two-dimensional (2D) images. In this method, after the 3D wavelet decomposition is performed, mean values are computed for and subtracted from each spatial plane of each spatially-low-pass subband. The resulting data are converted to sign-magnitude form and compressed in a manner similar to that of a baseline hyperspectral- image-compression method. The mean values are encoded in the compressed bit stream and added back to the data at the appropriate decompression step. The overhead incurred by encoding the mean values only a few bits per spectral band is negligible with respect to the huge size of a typical hyperspectral data set. The other method is denoted modified decomposition. This method is so named because it involves a modified version of a commonly used multiresolution wavelet decomposition, known in the art as the 3D Mallat decomposition, in which (a) the first of multiple stages of a 3D wavelet transform is applied to the entire dataset and (b) subsequent stages are applied only to the horizontally-, vertically-, and spectrally-low-pass subband from the preceding stage. In the modified decomposition, in stages after the first, not only is the spatially-low-pass, spectrally-low-pass subband further decomposed, but also spatially-low-pass, spectrally-high-pass subbands are further decomposed spatially. Either method can be used alone to improve the quality of a reconstructed image (see figure). Alternatively, the two methods can be combined by first performing modified decomposition, then subtracting the mean values from spatial planes of spatially-low-pass subbands.

Klimesh, Matthew↗
DOE OSTI2024

Mesoscale modeling and semi-analytical approach for the microstructure-aware effective thermal conductivity of porous polygranular materials

Here we established a comprehensive modeling approach for investigating the microstructure-aware effective thermal conductivity ($κ_{eff}$) for porous microstructures containing solid particles and gaseous pores. Our approach combines the mesoscale computational modeling framework and the semi-analytical method, allowing for efficient prediction of $κ_{eff}$ for realistic porous microstructures, while considering complicated microstructural thermal conduction pathways effectively in the prediction. We used the diffuse-interface mesoscale computational model to generate extensive simulated $κ_{eff}$ data for realistic digital representations of microstructures with wide ranges of porosity ($f_p$), thermal conductivity of the gas phase ($κ_g$), and thermal conductivity of the solid phase ($κ_s$). From the simulated data, we identified two property variation regimes for $κ_{eff}$: (1) a slow $κ_{eff}$ increase for $κ_s ~ κ_g$; and (2) a faster $κ_{eff}$ increase for $κ_s \gg κ_g$. To capture the key features of the relationship between the microstructure and $κ_{eff}$, we derived a semi-analytical model by introducing structure and intensification factors. The two new factors incorporate the calibrated effective contribution of the solid volume with $κ_s$ and additional interfacial effects into the prediction of $κ_{eff}$, respectively, allowing for consideration of parallel, serial, and interfacial conduction mechanisms effectively. Using the selected simulation data, we quantified key model parameters within the semi-analytical model and verified that the parameterized model exhibits excellent agreement with simulated $κ_{eff}$ for the entire range of the parameter space.

36 MATERIALS SCIENCE↗
NASA NTRS1975

System for generating timing and control signals

A system capable of generating every possible data frame subperiod and delayed subperiod of a data frame of length of M clock pulse intervals (CPIs) comprised of parallel modulo-m sub i counters is presented. Each m sub i is a prime power divisor of M and a cascade of alpha sub i identical modulo-p sub i counters. The modulo-p sub i counters are feedback shift registers which cycle through p sub i distinct states. Every possible nontrivial data frame subperiod and delayed subperiod is derived and a specific CPI in the data frame is detected. The number of clock pulses required to bring every modulo-p sub i counter to a respective designated state or count is determined by the Chinese remainder theorem. This corresponds to the solution of simultaneous congruences over relatively prime moduli.

Perlman, M.↗
NASA NTRS2017

Characterizing DebriSat Fragments: So Many Fragments, So Much Data, and So Little Time

To improve prediction accuracy, the DebriSat project was conceived by NASA and DoD to update existing standard break-up models. Updating standard break-up models require detailed fragment characteristics such as physical size, material properties, bulk density, and ballistic coefficient. For the DebriSat project, a representative modern LEO spacecraft was developed and subjected to a laboratory hypervelocity impact test and all generated fragments with at least one dimension greater than 2 mm are collected, characterized and archived. Since the beginning of the characterization phase of the DebriSat project, over 130,000 fragments have been collected and approximately 250,000 fragments are expected to be collected in total, a three-fold increase over the 85,000 fragments predicted by the current break-up model. The challenge throughout the project has been to ensure the integrity and accuracy of the characteristics of each fragment. To this end, the post hypervelocity-impact test activities, which include fragment collection, extraction, and characterization, have been designed to minimize handling of the fragments. The procedures for fragment collection, extraction, and characterization were painstakingly designed and implemented to maintain the post-impact state of the fragments, thus ensuring the integrity and accuracy of the characterization data. Each process is designed to expedite the accumulation of data, however, the need for speed is restrained by the need to protect the fragments. Methods to expedite the process such as parallel processing have been explored and implemented while continuing to maintain the highest integrity and value of the data. To minimize fragment handling, automated systems have been developed and implemented. Errors due to human inputs are also minimized by the use of these automated systems. This paper discusses the processes and challenges involved in the collection, extraction, and characterization of the fragments as well as the time required to complete the processes. The objective is to provide the orbital debris community an understanding of the scale of the effort required to generate and archive high quality data and metadata for each debris fragment 2 mm or larger generated by the DebriSat project.

Shiotani, B.↗