Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distributed processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25
All sourcesNASA NTRSDOE OSTI
NASA NTRS2002

Planning Systems for Distributed Operations

This viewgraph representation presents an overview of the mission planning process involving distributed operations (such as the International Space Station (ISS)) and the computer hardware and software systems needed to support such an effort. Topics considered include: evolution of distributed planning systems, ISS distributed planning, the Payload Planning System (PPS), future developments in distributed planning systems, Request Oriented Scheduling Engine (ROSE) and Next Generation distributed planning systems.

Maxwell, Theresa G.↗
NASA NTRS1991

Quantitative characterization of the spatial distribution of particles in materials: Application to materials processing

Inhomogeneities in the spatial distribution of second phase particles in engineering materials are known to affect certain mechanical properties. Progress in this area has been hampered by the lack of a convenient method for quantitative description of the spatial distribution of the second phase. This study intends to develop a broadly applicable method for the quantitative analysis and description of the spatial distribution of second phase particles. The method was designed to operate on a desktop computer. The Dirichlet tessellation technique (geometrical method for dividing an area containing an array of points into a set of polygons uniquely associated with the individual particles) was selected as the basis of an analysis technique implemented on a PC. This technique is being applied to the production of Al sheet by PM processing methods; vacuum hot pressing, forging, and rolling. The effect of varying hot working parameters on the spatial distribution of aluminum oxide particles in consolidated sheet is being studied. Changes in distributions of properties such as through-thickness near-neighbor distance correlate with hot-working reduction.

Parse, Joseph B.↗
DOE OSTI2015

Relative Roles of Deterministic and Stochastic Processes in Driving the Vertical Distribution of Bacterial Communities in a Permafrost Core from the Qinghai-Tibet Plateau, China

Understanding the processes that influence the structure of biotic communities is one of the major ecological topics, and both stochastic and deterministic processes are expected to be at work simultaneously in most communities. Here, we investigated the vertical distribution patterns of bacterial communities in a 10-m-long soil core taken within permafrost of the Qinghai-Tibet Plateau. To get a better understanding of the forces that govern these patterns, we examined the diversity and structure of bacterial communities, and the change in community composition along the vertical distance (spatial turnover) from both taxonomic and phylogenetic perspectives. Measures of taxonomic and phylogenetic beta diversity revealed that bacterial community composition changed continuously along the soil core, and showed a vertical distance-decay relationship. Multiple stepwise regression analysis suggested that bacterial alpha diversity and phylogenetic structure were strongly correlated with soil conductivity and pH but weakly correlated with depth. There was evidence that deterministic and stochastic processes collectively drived bacterial vertically-structured pattern. Bacterial communities in five soil horizons (two originated from the active layer and three from permafrost) of the permafrost core were phylogenetically random, indicator of stochastic processes. However, we found a stronger effect of deterministic processes related to soil pH, conductivity, and organic carbon content that were structuring the bacterial communities. We therefore conclude that the vertical distribution of bacterial communities was governed primarily by deterministic ecological selection, although stochastic processes were also at work. Furthermore, the strong impact of environmental conditions (for example, soil physicochemical parameters and seasonal freeze-thaw cycles) on these communities underlines the sensitivity of permafrost microorganisms to climate change and potentially subsequent permafrost thaw.

Science & Technology - Other Topics↗
DOE OSTI2023

Data transfer for STAR grid jobs

The Solenoidal Tracker at RHIC (STAR) is a multipurpose experiment at the Relativistic Heavy Ion Collider (RHIC) with the primary goal to study the formation and properties of the quark-gluon plasma. STAR is an international collaboration of member institutions and laboratories from around the world. Yearly data-taking period produces PBytes of raw data collected by the experiment. STAR primarily uses its dedicated facility at BNL to process this data, but has routinely leveraged distributed systems, both high throughput (HTC) and high performance (HPC) computing clusters, to significantly augment the processing capacity available to the experiment. The ability to automate the efficient transfer of large data sets on reliable, scalable, and secure infrastructure is critical for any large-scale distributed processing campaign. For more than a decade, STAR computing has relied upon GridFTP with its x509-based authentication to build such data transfer systems and integrate them into its larger production workflow. The end of support by the community for both GridFTP and the x509 standard requires STAR to investigate other approaches to meet its distributed processing needs. In this study we investigate two multi-purpose data distribution systems, Globus.org and XRootD, as alternatives to GridFTP. We compare both their performance and the ease by which each service is integrated into the type of secure and automated data transfer systems STAR has previously built using GridFTP. The presented approach and study may be applicable to other distributed data processing use cases beyond STAR.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2014

Structure of an Rrp6-RNA exosome complex bound to poly(A) RNA

The eukaryotic RNA exosome processes and degrades RNA by directing substrates to the distributive or processive 3' to 5' exoribonuclease activities of Rrp6 or Rrp44, respectively. The non-catalytic nine-subunit exosome core (Exo9) features a prominent central channel. Although RNA can pass through the channel to engage Rrp44, it is not clear how RNA is directed to Rrp6 or whether Rrp6 uses the central channel. Here we report a 3.3 Å crystal structure of a ten-subunit RNA exosome complex from Saccharomyces cerevisiae composed of the Exo9 core and Rrp6 bound to single-stranded poly(A) RNA. The Rrp6 catalytic domain rests on top of the Exo9 S1/KH ring above the central channel, the RNA 3' end is anchored in the Rrp6 active site, and the remaining RNA traverses the S1/KH ring in an opposite orientation to that observed in a structure of a Rrp44-containing exosome complex. Solution studies with human and yeast RNA exosome complexes suggest that the RNA path to Rrp6 is conserved and dependent on the integrity of the S1/KH ring. Although path selection to Rrp6 or Rrp44 is stochastic in vitro, the fate of a particular RNA may be determined in vivo by the manner in which cofactors present RNA to the RNA exosome.

Wasmuth, Elizabeth V.↗
DOE OSTI2012

Long gamma-ray burst as a production site of r-process elements

We simulated the r-process nucleosynthesis in and around a high entropy jet from a long gamma-ray burst (GRB). Our simulation is based on the collapsar scenario for long GRBs and on relativistic magnetohydrodynamic simulations (Harikae et al. 2009, 2010) including ray-tracing neutrino transport, which describe the development of the black hole accretion disk and the heating of the funnel region to produce a relativistic jet. The time evolution of the jet was then extended to later phase via axi-symmetric special relativistic hydrodynamic simulation to follow the temperature, entropy, electron fraction, and density evolution for representative test particles. The evolution of nuclear abundances from nucleons to heavy nuclei for representative test particle trajectories was solved in a large nuclear reaction network including more than 5000 isotopes. We show that a robust r-process successfully occurs within the collapsar jet outflow and that sufficient mass is ejected within the flow to account for the observed r-process abundance distribution along with the large dispersion in r-process elements observed in metal-poor halo stars.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2016

Dust charging processes with a Cairns-Tsallis distribution function with negative ions

Dust grain charging processes are presented in a non-Maxwellian dusty plasma following the Cairns-Tsallis (q, α)–distribution, whose constituents are the electrons, as well as the positive/negative ions and negatively charged dust grains. For this purpose, we have solved the current balance equation for a negatively charged dust grain to achieve an equilibrium state value (viz., q{sub d} = constant) in the presence of Cairns-Tsallis (q, α)–distribution. In fact, the current balance equation becomes modified due to the Boltzmannian/streaming distributed negative ions. It is numerically found that the relevant plasma parameters, such as the spectral indexes q and α, the positive ion-to-electron temperature ratio, and the negative ion streaming speed (U{sub 0}) significantly affect the dust grain surface potential. It is also shown that in the limit q → 1 the Cairns-Tsallis reduces to the Cairns distribution; for α = 0 the Cairns-Tsallis distribution reduces to pure Tsallis distribution and the latter reduces to Maxwellian distribution for q → 1 and α = 0.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
NASA NTRS2007

A Disk-Based System for Producing and Distributing Science Products from MODIS

Since beginning operations in 1999, the MODIS Adaptive Processing System (MODAPS) has evolved to take advantage of trends in information technology, such as the falling cost of computing cycles and disk storage and the availability of high quality open-source software (Linux, Apache and Perl), to achieve substantial gains in processing and distribution capacity and throughput while driving down the cost of system operations.

Masuoka, Edward↗
DOE OSTI2025

Evolution of DUNE’s Production System

The DUNE experiment will start running in 2029 and record 30 PB/year of raw waveforms from Liquid Argon TPCs and photon detectors. The size of individual readouts can range from 100 MB to a typical 8 GB full readout of the detector, and even 100 TB for extended readouts from supernova candidates. These data then need to be cataloged, stored and distributed for processing worldwide. This massive amount of data and a heterogeneous computing environment necessitates a powerful and robust distributed computing infrastructure. In the process of building up that infrastructure, DUNE’s production system has recently undergone an overhaul, in which it has integrated 1) a new workflow management system (justIN) 2) a new data catalog (MetaCat) and 3) a state-of-the-art data management system (Rucio). Simulations of DUNE’s Far Detector and its prototypes ProtoDUNE Horizontal Drift (ProtoDUNE-HD) and ProtoDUNE Vertical Drift (ProtoDUNE-VD), as well as data from ProtoDUNE-HD serve as the first tests of this infrastructure.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS2007

AIRSAR Web-Based Data Processing

The AIRSAR automated, Web-based data processing and distribution system is an integrated, end-to-end synthetic aperture radar (SAR) processing system. Designed to function under limited resources and rigorous demands, AIRSAR eliminates operational errors and provides for paperless archiving. Also, it provides a yearly tune-up of the processor on flight missions, as well as quality assurance with new radar modes and anomalous data compensation. The software fully integrates a Web-based SAR data-user request subsystem, a data processing system to automatically generate co-registered multi-frequency images from both polarimetric and interferometric data collection modes in 80/40/20 MHz bandwidth, an automated verification quality assurance subsystem, and an automatic data distribution system for use in the remote-sensor community. Features include Survey Automation Processing in which the software can automatically generate a quick-look image from an entire 90-GB SAR raw data 32-MB/s tape overnight without operator intervention. Also, the software allows product ordering and distribution via a Web-based user request system. To make AIRSAR more user friendly, it has been designed to let users search by entering the desired mission flight line (Missions Searching), or to search for any mission flight line by entering the desired latitude and longitude (Map Searching). For precision image automation processing, the software generates the products according to each data processing request stored in the database via a Queue management system. Users are able to have automatic generation of coregistered multi-frequency images as the software generates polarimetric and/or interferometric SAR data processing in ground and/or slant projection according to user processing requests for one of the 12 radar modes.

Chu, Anhua↗
DOE OSTI2014

Simulation of the temperature distribution in the selective beam melting process for polymer material

In the present contribution the temperature distribution in the selective beam melting process for polymer materials is simulated to better understand the influence of process parameters on the properties of the produced part. The basis for the developed simulation tool is the nonlinear heat equation including temperature dependent functions for the heat capacity and the heat conduction which were obtained by experimental measurements. The effect of latent heat occurring in the process is also taken into account. The heat equation is discretized in time and space where a Runge-Kutta method of Radau IIA type is used for time integration. An adaptive finite element method is applied for the discretization in space and the model is implemented into the finite element library deal.II. The heat and cooling rate as important process parameters are simulated for different beam velocities. The ability for computing these process parameters makes the simulation tool suited for optimizing the process management of selective beam melting plants.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
NASA NTRS1982

Control structures for high speed processors

A special processor was designed to function as a Reed Solomon decoder with throughput data rate in the Mhz range. This data rate is significantly greater than is possible with conventional digital architectures. To achieve this rate, the processor design includes sequential, pipelined, distributed, and parallel processing. The processor was designed using a high level language register transfer language. The RTL can be used to describe how the different processes are implemented by the hardware. One problem of special interest was the development of dependent processes which are analogous to software subroutines. For greater flexibility, the RTL control structure was implemented in ROM. The special purpose hardware required approximately 1000 SSI and MSI components. The data rate throughput is 2.5 megabits/second. This data rate is achieved through the use of pipelined and distributed processing. This data rate can be compared with 800 kilobits/second in a recently proposed very large scale integration design of a Reed Solomon encoder.

Maki, G. K.↗
DOE OSTI2011

Tolerating Correlated Failures for Generalized Cartesian Distributions via Bipartite Matching

Faults are expected to play an increasingly important role in how algorithms and applications are designed to run on future extreme-scale systems. A key ingredient of any approach to fault tolerance is effective support for fault tolerant data storage. A typical application execution consists of phases in which certain data structures are modified while others are read-only. Often, read-only data structures constitute a large fraction of total memory consumed. Fault tolerance for read-only data can be ensured through the use of checksums or parities, without resorting to expensive in-memory duplication or checkpointing to secondary storage. In this paper, we present a graph-matching approach to compute and store parity data for read-only matrices that are compatible with fault tolerant linear algebra (FTLA). Typical approaches only support blocked data distributions with each process holding one block with the parity located on additional processes. The matrices are assumed to be blocked by a cartesian grid with each block assigned to a process. We consider a generalized distribution in which each process can be assigned arbitrary blocks. We also account for the fact that multiple processes might be part of the same failure unit, say an SMP node. The flexibility enabled by our novel application of graph matching extends fault tolerance support to data distributions beyond those supported by prior work. We evaluate the matching implementations and cost to compute the parity and recover lost data, demonstrating the low overhead incurred by our approach.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2015

Alternatives to the 15% Rule

The third solicitation of the California Solar Initiative (CSI) Research, Development, Demonstration and Deployment (RD&D) Program established by the California Public Utility Commission (CPUC) is supporting the Electric Power Research Institute (EPRI), National Renewable Energy Laboratory (NREL), and Sandia National Laboratories (SNL) with collaboration from Pacific Gas and Electric (PG&E), Southern California Edison (SCE), and San Diego Gas and Electric (SDG&E), in research to improve the Utility Application Review and Approval process for interconnecting distributed energy resources to the distribution system. Currently this process is the most time - consuming of any step on the path to generating power on the distribution system. This CSI RD&D solicitation three project has completed the tasks of collecting data from the three utilities, clustering feeder characteristic data to attain representative feeders, detailed modeling of 16 representative feeders, analysis of PV impacts to those feeders, refinement of current screening processes, and validation of those suggested refinements. In this report each task is summarized to produce a final summary of all components of the overall project.

Broderick, Robert Joseph↗
DOE OSTI2025

Restoring Historic Forest Disturbance Frequency Would Partially Mitigate Droughts in the Central Sierra Nevada Mountains

Forest thinning and prescribed fire are expected to improve the climate resilience and water security of forests in the western U.S., but few studies have directly modeled the hydrological effects of multi-decadal landscape-scale forest disturbance. By updating a distributed process-based hydrological model (DHSVM) with vegetation maps from a distributed forest ecosystem model (LANDIS-II), we simulate the water resource impacts of forest management scenarios targeting partial or full restoration of the pre-colonial disturbance return interval in the central Sierra Nevada mountains. In a fully restored disturbance regime that includes fire, thinning, and insect mortality, reservoir inflow increases by 4%–9% total and 8%–14% in dry years. At sub-watershed scales (10–100 km2), thinning dense forests can increase streamflow by >20% in dry years. In a thinner forest, increased understory transpiration compensates for decreased overstory transpiration. Consequentially, 73% of streamflow gains are attributable to decreased overstory rain and snow interception loss. Thinner forests can increase headwater peak flows, but reservoir-scale peak flows are almost exclusively influenced by climate. Uncertainty in future precipitation causes high uncertainty in future water yield, but the additional water yield attributable to forest disturbance is about five times less sensitive to annual precipitation uncertainty. This partial decoupling of the streamflow disturbance response from annual precipitation makes disturbance especially valuable for water supply during dry years. Our study can increase confidence in the water resource benefits of restoring historic forest disturbance frequencies in the central Sierra Nevada mountains, and our modeling framework is widely applicable to other forested mountain landscapes.

Boardman, Eli N. [University of Nevada, Reno, NV (↗
DOE OSTI2017

SGR-like behaviour of the repeating FRB 121102

Fast radio bursts (FRBs) are millisecond-duration radio signals occurring at cosmological distances. However the physical model of FRBs is mystery, many models have been proposed. Here we study the frequency distributions of peak flux, fluence, duration and waiting time for the repeating FRB 121102. The cumulative distributions of peak flux, fluence and duration show power-law forms. The waiting time distribution also shows power-law distribution, and is consistent with a non-stationary Poisson process. These distributions are similar as those of soft gamma repeaters (SGRs). We also use the statistical results to test the proposed models for FRBs. These distributions are consistent with the predictions from avalanche models of slowly driven nonlinear dissipative systems.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1992

Science data processing in the Mission to Planet Earth era

The data-processing systems developed to support NASA's Mission to Planet Earth (MPE) are described in an overview of the system architectures. The MPE program is discussed in terms of flight segments and data types to examine the required elements of the information systems. The data-processing segments are described for the Atmospheric Laboratory for Applications and Science, the Tropical Rainfall Measuring Mission, the Earth Observing System, and the Geostationary Earth Observatory. The data and information systems for the separate segments provide some redundant processing services. Distributed active archive centers are employed for each segment composed of three subelements: (1) a product-generation system, (2) a data archive and distribution system, and (3) an information management system. The data processing design for the MPE is expected to facilitate the understanding of the entire earth system on a global scale.

Goodman, H. M.↗