Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distributed processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45
All sourcesNASA NTRSDOE OSTI
DOE OSTI2016

Distributed Halide

Many image processing tasks are naturally expressed as a pipeline of small computational kernels known as stencils. Halide is a popular domain-specific language and compiler designed to implement image processing algorithms. Halide uses simple language constructs to express what to compute and a separate scheduling co-language for expressing when and where to perform the computation. This approach has demonstrated performance comparable to or better than hand-optimized code. Until now, however, Halide has been restricted to parallel shared memory execution, limiting its performance for memory-bandwidth-bound pipelines or large-scale image processing tasks. We present an extension to Halide to support distributed-memory parallel execution of complex stencil pipelines. These extensions compose with the existing scheduling constructs in Halide, allowing expression of complex computation and communication strategies. Existing Halide applications can be distributed with minimal changes, allowing programmers to explore the tradeoff between recomputation and communication with little effort. Approximately 10 new of lines code are needed even for a 200 line, 99 stage application. On nine image processing benchmarks, our extensions give up to a 1.4× speedup on a single node over regular multithreaded execution with the same number of cores, by mitigating the effects of non-uniform memory access. The distributed benchmarks achieve up to 18× speedup on a 16 node testing machine and up to 57× speedup on 64 nodes of the NERSC Cori supercomputer.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2004

Science Data Processing for the Advanced Microwave Scanning Radiometer: Earth Observing System

The National Aeronautics and Space Administration established the framework for the Science Investigator-led Processing Systems (SIPS) to enable the Earth science data products to be produced by personnel directly associated with the instrument science team and knowledgeable of the science algorithms. One of the first instantiations implemented for NASA was the Advanced Microwave Scanning Radiometer - Earth Observing System (AMSR-E) SIPS. The AMSR-E SIPS is a decentralized, geographically distributed ground data processing system composed of two primary components located in California and Alabama. Initial science data processing is conducted at Remote Sensing Systems (RSS) in Santa Rosa, California. RSS ingests antenna temperature orbit data sets from JAXA and converts them to calibrated, resampled, geolocated brightness temperatures. The brightness temperatures are sent to the Global Hydrology and Climate Center in Huntsville, Alabama, which generates the geophysical science data products (e.g., water vapor, sea surface temperature, sea ice extent, etc.) suitable for climate research and applications usage. These science products are subsequently sent to the National Snow and Ice Data Center Distributed Active Archive Center in Boulder, Colorado for archival and dissemination to the at-large science community. This paper describes the organization, coordination, and production techniques employed by the AMSR-E SIPS in implementing, automating and operating the distributed data processing system.

Goodman, H. Michael↗
DOE OSTI2018

Auto-adaptive Harris corner detection algorithm based on entropy-improved block processing

Extracting well distributed control points (CPs) is a very challenging task for remote sensing image registration, particularly for large high-resolution images over heterogeneous landscape. Based on image analysis such as edge detection, corner detection, and information theory, a new CP detection approach is proposed to select high- quality, evenly distributed CPs. The Entropy-Block-Based variant of the Harris Corner Detector (EBB-HCD) is achieved by dividing the image into blocks and by allocating the number of CP's based upon the entropy of each block. While the block-based strategy improves the CP balance problem, a factor calculated from entropy avoids overdetection. We conducted a comparison study utilizing the well-known Harris Corner Detector (HCD) and an implementation of the Block-Based Harris Corner Detector (BB-HCD). Experimental results indicate that using EBB-HCD to find the CPs improves the overall alignment accuracy during registration compared with HCD or BB-HCD.

Sun, Yihang↗
NASA NTRS1982

One Way of Testing a Distributed Processor

Launch processing for Space Shuttle is checked out, controlled, and monitored with new system. Entire system can be exercised by two computer programs--one in master console and other in each of operations consoles. Control program in each operations console detects change in status and begins task initiation. All of front-end processors are exercised from consoles through common data buffer, and all data are logged to processed-data recorder for posttest analysis.

Edstrom, R.↗
NASA NTRS1987

Experience in highly parallel processing using DAP

Distributed Array Processors (DAP) have been in day to day use for ten years and a large amount of user experience has been gained. The profile of user applications is similar to that of the Massively Parallel Processor (MPP) working group. Experience has shown that contrary to expectations, highly parallel systems provide excellent performance on so-called dirty problems such as the physics part of meteorological codes. The reasons for this observation are discussed. The arguments against replacing bit processors with floating point processors are also discussed.

Parkinson, D.↗
DOE OSTI2015

Grain boundary character distribution in nanocrystalline metals produced by different processing routes

Nanocrystalline materials are defined by their fine grain size, but details of the grain boundary character distribution should also be important. Grain boundary character distributions are reported for ball-milled, sputter-deposited, and electrodeposited Ni and Ni-based alloys, all with average grain sizes of ~20 nm, to study the influence of processing route. The two deposited materials had nearly identical grain boundary character distributions, both marked by a Σ3 length percentage of 23 to 25 pct. In contrast, the ball-milled material had only 3 pct Σ3-type grain boundaries and a large fraction of low-angle boundaries (16 pct), with the remainder being predominantly random high angle (73 pct). Furthermore, these grain boundary character measurements are connected to the physical events that control their respective processing routes. Consequences for material properties are also discussed with a focus on nanocrystalline corrosion. As a whole, the results presented here show that grain boundary character distribution, which has often been overlooked in nanocrystalline metals, can vary significantly and influence material properties in profound ways.

36 MATERIALS SCIENCE↗
NASA NTRS1997

Morphological evidence for local microcircuits in rat vestibular maculae

Previous studies suggested that intramacular, unmyelinated segments of vestibular afferent nerve fibers and their large afferent endings (calyces) on type I hair cells branch. Many of the branches (processes) contain vesicles and are presynaptic to type II hair cells, other processes, intramacular nerve fibers, and calyces. This study used serial section transmission electron microscopy and three-dimensional reconstruction methods to document the origins and distributions of presynaptic processes of afferents in the medial part of the adult rat utricular macula. The ultrastructural research focused on presynaptic processes whose origin and termination could be observed in a single micrograph. Results showed that calyces had 1) vesiculated, spine-like processes that invaginated type I cells and 2) other, elongate processes that ended on type II cells pre- as well as postsynaptically. Intramacular, unmyelinated segments of afferent nerve fibers gave origin to branches that were presynaptic to type II cells, calyces, calyceal processes, and other nerve fibers in the macula. Synapses with type II cells occurred opposite subsynaptic cisternae (C synapses); all other synapses were asymmetric. Vesicles were pleomorphic but were differentially distributed according to process origin. Small, clear-centered vesicles, approximately 40-60 nm in diameter, predominated in processes originating from afferent nerve fibers and basal parts of calyces. Larger vesicles approximately 70-120 nm in diameter having approximately 40-80 nm electron-opaque cores were dominant in processes originating from the necks of calyces. Results are interpreted to indicate the existence of a complex system of intrinsic feedforward (postsynaptic)-feedback (presynaptic) connections in a network of direct and local microcircuits. The morphological findings support the concept that maculae dynamically preprocess linear acceleratory information before its transmission to the central nervous system.

NASA Center ARC↗
NASA NTRS1974

Martian planetwide crater distributions - Implications for geologic history and surface processes

Three different diameter size ranges are considered in connection with the Martian crater distribution, taking into account small craters from 0.6 to 1.2 km, intermediate-sized craters from 4 to 10 km, and large craters with diameters exceeding 20 km. One of the objectives of the investigation reported is to establish the effects of eolian processes in the modification of craters in the different size ranges. Another objective is concerned with a description of the genetic relationships among the three size ranges of craters. Observables related to the relative age of geologic provinces are to be separated from observables related to geographic variations in eolian transport and deposition. Lunar and Martian cratering histories are compared as a basis for establishing relative and absolute time scales for the geological evolution of Mars.

Soderblom, L. A.↗
NASA NTRS1975

A mathematical examination of the press model for atmospheric turbulence

The random process used to model atmospheric turbulence in aircraft response problems is examined. The first, second, and higher order probability density and characteristic functions were developed. The concepts of the Press model lead to an approximate procedure for the analysis of the response of linear dynamic systems to a class of non-Gaussian random processes. The Press model accounts for both the Gaussian and non-Gaussian forms of measured turbulence data. The nonstationary aspects of measured data are explicitly described by the transition properties of the random process. The effects of the distribution of the intensity process upon calculated exceedances are examined. It is concluded that the press model with a Gaussian intensity distribution gives a conservative prediction of limit load values.

Sidwell, K.↗
NASA NTRS2016

Performance of the Goddard Multiscale Modeling Framework with Goddard Ice Microphysical Schemes

The multiscale modeling framework (MMF), which replaces traditional cloud parameterizations with cloud-resolving models (CRMs) within a host atmospheric general circulation model (GCM), has become a new approach for climate modeling. The embedded CRMs make it possible to apply CRM-based cloud microphysics directly within a GCM. However, most such schemes have never been tested in a global environment for long-term climate simulation. The benefits of using an MMF to evaluate rigorously and improve microphysics schemes are here demonstrated. Four one-moment microphysical schemes are implemented into the Goddard MMF and their results validated against three CloudSat/CALIPSO cloud ice products and other satellite data. The new four-class (cloud ice, snow, graupel, and frozen drops/hail) ice scheme produces a better overall spatial distribution of cloud ice amount, total cloud fractions, net radiation, and total cloud radiative forcing than earlier three-class ice schemes, with biases within the observational uncertainties. Sensitivity experiments are conducted to examine the impact of recently upgraded microphysical processes on global hydrometeor distributions. Five processes dominate the global distributions of cloud ice and snow amount in long-term simulations: (1) allowing for ice supersaturation in the saturation adjustment, (2) three additional correction terms in the depositional growth of cloud ice to snow, (3) accounting for cloud ice fall speeds, (4) limiting cloud ice particle size, and (5) new size-mapping schemes for snow and graupel. Despite the cloud microphysics improvements, systematic errors associated with subgrid processes, cyclic lateral boundaries in the embedded CRMs, and momentum transport remain and will require future improvement.

snow↗
DOE OSTI2022

Inverse Calculation of Burden Distribution Matrix Using B-spline Model Based PDF control in Blast Furnace Burden Charging Process

The inverse calculation of burden distribution matrix (BDM) is one of the most important challenges in the blast furnace operation in iron-making processes. In general, blast furnace consumes 65% of the total energy for the whole steel-making. Focusing on this practical challenge, this article proposes a new burden distribution spatial model in calculating burden charging process, and develops a B-spline approximation-based probability density function (PDF) control algorithm to assign the expected thickness distribution of burden layer and, thus, develops a new method for the required inverse calculation of BDM. First, a novel method for the thickness distribution of burden layer is given using B-spline model to produce an expected distribution shape subjected to a desired tracking within a specific spatial constraint. Then, according to the coexistence of continuous and bounded discrete variables in BDM, a novel hybrid optimization control method by combining integer programming and PDF tracking is further established for the effective inverse calculation of BDM. Finally, the proposed PDF-based iterative inverse calculation of BDM using B-spline models are tested using various data from industrial examples. Furthermore, the simulation results show that the proposed method is well suited to solve the BDM inverse calculation problem in practice.

42 ENGINEERING↗
DOE OSTI2011

RACORO aerosol data processing

The RACORO aerosol data (cloud condensation nuclei (CCN), condensation nuclei (CN) and aerosol size distributions) need further processing to be useful for model evaluation (e.g., GCM droplet nucleation parameterizations) and other investigations. These tasks include: (1) Identification and flagging of 'splash' contaminated Twin Otter aerosol data. (2) Calculation of actual supersaturation (SS) values in the two CCN columns flown on the Twin Otter. (3) Interpolation of CCN spectra from SGP and Twin Otter to 0.2% SS. (4) Process data for spatial variability studies. (5) Provide calculated light scattering from measured aerosol size distributions. Below we first briefly describe the measurements and then describe the results of several data processing tasks that which have been completed, paving the way for the scientific analyses for which the campaign was designed. The end result of this research will be several aerosol data sets which can be used to achieve some of the goals of the RACORO mission including the enhanced understanding of cloud-aerosol interactions and improved cloud simulations in climate models.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2012

Calibration of a distributed flood forecasting model with input uncertainty using a Bayesian framework

In the process of calibrating distributed hydrological models, accounting for input uncertainty is important, yet challenging. In this study, we develop a Bayesian model to estimate parameters associated with a geomorphology‐based hydrological model (GBHM). The GBHM model uses geomorphic characteristics to simplify model structure and physically based methods to represent hydrological processes. We divide the observed discharge into low‐ and high‐flow data, and use the first‐order autoregressive model to describe their temporal dependence. We consider relative errors in rainfall as spatially distributed variables and estimate them jointly with the GBHM parameters. The joint posterior probability distribution is explored using Markov chain Monte Carlo methods, which include Metropolis‐Hastings, delay rejection adaptive Metropolis, and Gibbs sampling methods. We evaluate the Bayesian model using both synthetic and field data sets. The synthetic case study demonstrates that the developed method generally is effective in calibrating GBHM parameters and in estimating their associated uncertainty. The calibration ignoring input errors has lower accuracy and lower reliability compared to the calibration that includes estimation of the input errors, especially under model structure uncertainty. The field case study shows that calibration of GBHM parameters under complex field conditions remains a challenge. Although jointly estimating input errors and GBHM parameters improves the continuous ranked probability score and the consistency of the predictive distribution with the observed data, the improvement is incremental. To better calibrate parameters in a distributed model, such as GBHM here, we need to develop a more complex model and incorporate much more information.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2015

Fault-Tolerant and Elastic Streaming MapReduce with Decentralized Coordination

The MapReduce programming model, due to its simplicity and scalability, has become an essential tool for processing large data volumes in distributed environments. Recent Stream Processing Systems (SPS) extend this model to provide low-latency analysis of high-velocity continuous data streams. However, integrating MapReduce with streaming poses challenges: first, the runtime variations in data characteristics such as data-rates and key-distribution cause resource overload, that inturn leads to fluctuations in the Quality of the Service (QoS); and second, the stateful reducers, whose state depends on the complete tuple history, necessitates efficient fault-recovery mechanisms to maintain the desired QoS in the presence of resource failures. We propose an integrated streaming MapReduce architecture leveraging the concept of consistent hashing to support runtime elasticity along with locality-aware data and state replication to provide efficient load-balancing with low-overhead fault-tolerance and parallel fault-recovery from multiple simultaneous failures. Our evaluation on a private cloud shows up to 2:8 improvement in peak throughput compared to Apache Storm SPS, and a low recovery latency of 700 -1500 ms from multiple failures.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1991

Development of a Weibull posterior distribution by combining a Weibull prior with an actual failure distribution using Bayesian inference

A Bayesian inference process for system logistical planning is presented which provides a method for incorporating actual failures with prediction data for an ongoing and improving reliability estimates. The process uses the Weibull distribution, and provides a means for examining and updating logistical and maintenance support needs.

Giuntini, Michael E.↗
NASA NTRS2007

A Contrast in Use of Metrics in Earth Science Data Systems

In recent years there has been a surge in the number of systems for processing, archiving and distributing remotely sensed data. Such systems, working independently as well as in collaboration, have been contributing greatly to the advances in the scientific understanding of the Earth system, as well as utilization of the data for nationally and internationally important applications. Among such systems, we consider those that are developed by or under the sponsorship of NASA to fulfill one of its strategic objectives: "Study Earth from space to advance scientific understanding and meet societal needs." NASA's Earth science data systems are of varying size and complexity depending on the requirements they are intended to meet. Some data systems are regarded as NASA's "Core Capabilities" that provide the basic infrastructure for processing, archiving and distributing a set of data products to a large and diverse user community in a robust and reliable manner. Other data systems constitute "Community Capabilities". These provide specialized and innovative services to data users and/or research products offering new scientific insight. Such data systems are generally supported by NASA through peer reviewed competition. Examples of Core Capabilities are 1. Earth Observing Data and Information System (EOSDIS) with its Distributed Active Archive Centers (DAACs), Science Investigator-led Processing Systems (SIPSs), and the EOS Clearing House (ECHO); 2. Tropical Rainfall Measurement Mission (TRMM) Science Data and Information System (TSDIS); 3. Ocean Data Processing System (ODPS); and 4. CloudSat Data Processing Center. Examples of Community Capabilities are projects under the Research, Education and Applications Solutions Network (REASON), and Advancing Collaborative Connections for Earth System Science (ACCESS) Programs. In managing these data system capabilities, it is necessary to have well-established goals and to measure progress relative to them. Progress is measured through "metrics", which can be a combination of quantitative as well as qualitative assessments. The specific metrics of interest depend on the user of the metrics as well as the type of data system. The users of metrics can be data system managers, program managers, funding agency or the public. Data system managers need metrics for assessing and improving the performance of the system and for future planning. Program managers need metrics to assess progress and the value of the data systems sponsored by them. Also, there is a difference in the metrics needed for core capabilities that tend to be more complex, larger and longer-term compared to community capabilities and the community capabilities that tend to be simpler, smaller and shorter-term. Even among community capabilities there are differences; hence the same set of metrics does not apply to all. Some provide data products to users, some provide services that enable better utilization of data or interoperability among other systems, and some are a part of a larger project where provision of data or services is only a minor activity. There is also a contrast between metrics used for internal and external purposes. Examples of internal purposes are: ensuring that the system meets its requirements, and planning for evolution and growth. Examples of external purposes are: providing to sponsors indicators of success of the systems, demonstrating the contributions of the system to overall program success, etc. This paper will consider EOSDIS, REASON and ACCESS programs to show the various types of metrics needed and how they need to be tailored to the types of data systems while maintaining the overall management goals of measuring progress and contributions made by the data systems.

Ramapriyan, Hampapuram↗
DOE OSTI2023

Impact of fabrication methods on binder distribution and charge transport in composite cathodes of all-solid-state batteries

Abstract The manufacturing process of all-solid-state batteries necessitates the use of polymer binders. However, these binders, being ionic insulators by nature, can adversely affect charge transport within composite cathodes, thereby impacting the rate performance of the batteries. In this work, we aim to investigate the impact of fabrication methods, specifically the solvent-free dry process versus the slurry-cast wet process, on binder distribution and charge transport in composite cathodes of solid-state batteries. In the dry process, the binder forms a fibrous network, while the wet process results in binder coverage on the surface of cathode active materials. The difference in microstructure leads to a notable 20-fold increase in ionic conductivity in the dry-processed cathode. Consequently, the cells processed via the dry method exhibit higher capacity retention of 89% and 83% at C/3 and C/2 rates, respectively, in comparison to 68% and 58% for the wet-processed cells at the same rate. These findings provide valuable insights into the influence of fabrication methods on binder distribution and charge transport, contributing to a better understanding of the binder’s role in manufacturing of all-solid-state batteries.

Emley, Benjamin↗
DOE OSTI2011

Ion distribution measurements to probe target and plasma processes in electronegative magnetron discharges. II. Positive ions

Spectra of the ion mass and energy distributions of positive ions in reactive (Ar/O{sub 2}) and nonreactive (Ar) dc magnetron sputtering discharges have been investigated by energy-resolved mass spectrometry. The results of three sputter target materials, i.e., Cu, In, and W are compared to each other. Besides the main gas constituents, mass spectra reveal a variety of molecular ions which are dependent on the target material. In reactive mode, ArO{sup +} is always observed in Ar/O{sub 2} but molecules containing Ar and the metal were exclusively found for the Cu target. The occurrence of the different ions is explained in the context of their bond strengths obtained from density functional theory calculations. The energy spectra generally contain the known low-energy peak corresponding to the plasma potential. Differently extended high-energy tails due to sputtered material were observed for the different targets. Besides these, high-energetic ions were detected with up to several 100 eV. Their energies are significantly different for Ar{sup +} and O{sup +} with Ar{sup +} strongly depending on the target material. The spectra are discussed together with results from transport of ions in matter (TRIM) calculation to elucidate the origin of these energetic ions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗