Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “DISTRIBUTED DATA PROCESSING”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

EOS ground data systems: A description and interface overview

The Earth Observing System (EOS) is planned as a space-based measurement system, earth-science research program, and data and information system (EOSDIS). It will consist of several high data rate spacecraft with multiple earth sensing instruments which provide investigators with a thorough, longterm view of the earth's environment. Up to seven spacecraft may be supported at once, either in operational, checkout, or testing phases; and the average data rate from the EOS satellites in orbit at any one time is expected to be from 18 to 60 Mbps. Providing the data processing and flight operations support for EOS will be the EOSDIS Core System (ECS). The ECS will command and control the spacecraft; process and store the EOS data; provide access to the data for years; and support researchers. The data processing aspects of the ECS consist of a collection of Distributed Active Archive Centers (DAAC's) which perform the product generation, data archive and distribution, and information management services. Flight operations aspects will be provided by the EOS Operations Center, by instrument control centers, and by widely distributed instrument support terminals. The communications and system management aspects will be provided by the EOSDIS Science Network and the System Management Center. In addition to the EOS satellite data, other data sets from earlier earth science missions are also to be added to designated DAAC's. Other ground data systems which will provide support to EOS for acquiring, transporting, processing, and distributing the transformed spacecraft data are currently being defined or are being upgraded for the EOS era. These systems include the Space Network consisting of the Tracking and Data Relay Satellite System (TDRSS), the TDRSS Ground Terminals, and the Network Control Center as well as the night Dynamics Facility, the EOS Data and Operations System, and EOS Communications. This paper briefly describes data handling by the ECS, the support data systems, their interfaces, and their roles.

Smith, Gene↗

A Systematic Kernel Function Procedure for Determining Aerodynamic Forces on Oscillating or Steady Finite Wings at Subsonic Speeds

Details are given of a numerical solution of the integral equation which relates oscillatory or steady lift and downwash distributions in subsonic flow. The procedure has been programmed for the IBM 704 electronic data processing machine and yields the pressure distribution and some of its integrated properties for a given Mach number and frequency and for several modes of oscillation in from 3 to 4 minutes, results of several applications are presented.

Watkins, Charles E.↗

A Parallel Ghosting Algorithm for The Flexible Distributed Mesh Database

Critical to the scalability of parallel adaptive simulations are parallel control functions including load balancing, reduced inter-process communication and optimal data decomposition. In distributed meshes, many mesh-based applications frequently access neighborhood information for computational purposes which must be transmitted efficiently to avoid parallel performance degradation when the neighbors are on different processors. This article presents a parallel algorithm of creating and deleting data copies, referred to as ghost copies, which localize neighborhood data for computation purposes while minimizing inter-process communication. The key characteristics of the algorithm are: (1) It can create ghost copies of any permissible topological order in a 1D, 2D or 3D mesh based on selected adjacencies. (2) It exploits neighborhood communication patterns during the ghost creation process thus eliminating all-to-all communication. (3) For applications that need neighbors of neighbors, the algorithm can create n number of ghost layers up to a point where the whole partitioned mesh can be ghosted. Strong and weak scaling results are presented for the IBM BG/P and Cray XE6 architectures up to a core count of 32,768 processors. The algorithm also leads to scalable results when used in a parallel super-convergent patch recovery error estimator, an application that frequently accesses neighborhood data to carry out computation.

Mubarak, Misbah↗

Cardea: Providing Support for Dynamic Resource Access in a Distributed Computing Environment

The environment framing the modem authorization process span domains of administration, relies on many different authentication sources, and manages complex attributes as part of the authorization process. Cardea facilitates dynamic access control within this environment as a central function of an inter-operable authorization framework. The system departs from the traditional authorization model by separating the authentication and authorization processes, distributing the responsibility for authorization data and allowing collaborating domains to retain control over their implementation mechanisms. Critical features of the system architecture and its handling of the authorization process differentiate the system from existing authorization components by addressing common needs not adequately addressed by existing systems. Continuing system research seeks to enhance the implementation of the current authorization model employed in Cardea, increase the robustness of current features, further the framework for establishing trust and promote interoperability with existing security mechanisms.

Lepro, Rebekah↗

Waiting-time distributions of magnetic discontinuities: Clustering or Poisson process?

Using solar wind data from the Advanced Composition Explorer spacecraft, with the support of Hall magnetohydrodynamic simulations, the waiting-time distributions of magnetic discontinuities have been analyzed. A possible phenomenon of clusterization of these discontinuities is studied in detail. We perform a local Poisson's analysis in order to establish if these intermittent events are randomly distributed or not. Possible implications about the nature of solar wind discontinuities are discussed.

79 ASTRONOMY AND ASTROPHYSICS↗

Recommendations for a service framework to access astronomical archives

There are a large number of astronomical archives and catalogs on-line for network access, with many different user interfaces and features. Some systems are moving towards distributed access, supplying users with client software for their home sites which connects to servers at the archive site. Many of the issues involved in defining a standard framework of services that archive/catalog suppliers can use to achieve a basic level of interoperability are described. Such a framework would simplify the development of client and server programs to access the wide variety of astronomical archive systems. The primary services that are supplied by current systems include: catalog browsing, dataset retrieval, name resolution, and data analysis. The following issues (and probably more) need to be considered in establishing a standard set of client/server interfaces and protocols: Archive Access - dataset retrieval, delivery, file formats, data browsing, analysis, etc.; Catalog Access - database management systems, query languages, data formats, synchronous/asynchronous mode of operation, etc.; Interoperability - transaction/message protocols, distributed processing mechanisms (DCE, ONC/SunRPC, etc), networking protocols, etc.; Security - user registration, authorization/authentication mechanisms, etc.; Service Directory - service registration, lookup, port/task mapping, parameters, etc.; Software - public vs proprietary, client/server software, standard interfaces to client/server functions, software distribution, operating system portability, data portability, etc. Several archive/catalog groups, notably the Astrophysics Data System (ADS), are already working in many of these areas. In the process of developing StarView, which is the user interface to the Space Telescope Data Archive and Distribution Service (ST-DADS), these issues and the work of others were analyzed. A framework of standard interfaces for accessing services on any archive system which would benefit archive user and supplier alike is proposed.

Travisano, J. J.↗

Distributed coherence directory subsystem with exclusive data regions

A processing system includes a first set of one or more processing units including a first processing unit, a second set of one or more processing units including a second processing unit, and a memory having an address space shared by the first and second sets. The processing system further includes a distributed coherence directory subsystem having a first coherence directory to support a first subset of one or more address regions of the address space and a second coherence directory to support a second subset of one or more address regions of the address space. In some implementations, the first coherence directory is implemented in the system so as to have a lower access latency for the first set, whereas the second coherence directory is implemented in the system so as to have a lower access latency for the second set.

97 MATHEMATICS AND COMPUTING↗

Distributed coherence directory subsystem with exclusive data regions

A processing system includes a first set of one or more processing units including a first processing unit, a second set of one or more processing units including a second processing unit, and a memory having an address space shared by the first and second sets. The processing system further includes a distributed coherence directory subsystem having a first coherence directory to support a first subset of one or more address regions of the address space and a second coherence directory to support a second subset of one or more address regions of the address space. In some implementations, the first coherence directory is implemented in the system so as to have a lower access latency for the first set, whereas the second coherence directory is implemented in the system so as to have a lower access latency for the second set.

Eckert, Yasuko↗

Takes Electric or Magnetic field data through Inversion process a 2D Distributon

Program images 2D distributions in electrical conductivity for geophysical applications. The program can treat surface based and cross well measurement geometries, including inductive and grounded source antennas in the quasi-static limit. The algorithm using Krylov iterative methods to solve for the predicted data and model sensitivities. The model update is achieved using a Gauss-newton optimization process for stability. A new line search capability is now included in the algorithm to insure global convergence of the inversion iteration.

Newman, Gregory↗

Kepler Data Analysis: Non-Gaussian Noise and Fourier Gaussian Process Analysis of Stellar Variability

We develop a statistical analysis model of Kepler stellar flux data in the presence of planet transits, non-Gaussian noise, and stellar variability. We first develop a model for the Kepler noise probability distribution in the presence of outliers, which make the noise probability distribution non-Gaussian. We develop a signal likelihood analysis based on this probability distribution, in which we model the signal as a sum of the star variability and planetary transits. We argue that these components need to be modeled together if optimal signal is to be extracted from the data. For the stellar variability model we develop an optimal Gaussian process analysis using a Fourier-based Wiener filter approach, where the power spectrum is non-parametric and learned from the data. We develop high dimensional optimization of the objective function, where we jointly optimize all the model parameters, including thousands of star variability modes, and planet transit parameters. We apply the method to Kepler-90 data and show that it gives a better match to the stellar variability than the existing methods, and robustly handles noise outliers. As a consequence, the planet radii have a higher value than what the existing methods give, including splines and celerite.

79 ASTRONOMY AND ASTROPHYSICS↗

Scattering of a laser beam on a wet blood smear and measurement of red cell size distribution

We report an automated laser system that allows the red cell size distribution to be measured. Experiments are performed on laser light scattering by a suspension of oriented red blood cells (a wet blood smear). Based on an analysis of the angular distribution of light intensity in the diffraction pattern, we have restored the red cell size distribution. The average diameter of a red blood cell is determined with an error of less than 1%, and the spread of red blood cells in size – with an error of about 20%. We discuss the problems of photometry and processing of diffraction patterns, preparing blood samples and data processing algorithms, including methods for solving the inverse scattering problem. (laser biophotonics)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Training site statistics from Landsat and Seasat satellite imagery registered to a common map base

Landsat and Seasat satellite imagery and training site boundary coordinates were registered to a common Universal Transverse Mercator map base in the Newport Beach area of Orange County, California. The purpose was to establish a spatially-registered, multi-sensor data base which would test the use of Seasat synthetic aperture radar imagery to improve spectral separability of channels used for land use classification of an urban area. Digital image processing techniques originally developed for the digital mosaics of the California Desert and the State of Arizona were adapted to spatially register multispectral and radar data. Techniques included control point selection from imagery and USGS topographic quadrangle maps, control point cataloguing with the Image Based Information System, and spatial and spectral rectifications of the imagery. The radar imagery was pre-processed to reduce its tendency toward uniform data distributions, so that training site statistics for selected Landsat and pre-processed Seasat imagery indicated good spectral separation between channels.

Clark, J.↗

ERTS-1 data collection system: Status and performance

The Data Collection System flown on the first Earth Resources Technology Satellite (ERTS-1) relays earth resources data from remotely located in-situ sensors to Goddard Space Flight Center. Data is received at Goddard at least twice each day from every sensor installation and is distributed to users (who operate the sensors and transmitters) by mail and teletype. The system consists of a data formatting and transmitting unit, called the Data Collection Platform (DCP), a receiver and a retransmitter aboard ERTS-1; and receiving, demodulating and decoding equipment located at the Goldstone, California and Goddard data acquisition stations. Data is transmitted from the data acquisition stations to the ERTS Control Center at Goddard, then to the NASA (ERTS) Data Processing Facility (NDPF) where it is processed and distributed to users. Experience to date indicates that the design of the ERTS-1 Data Collection System is adequate for operational use for 50% of the users and, with minor modifications, could meet the requirements of 75%. Some users will have to augment the system by other data collection techniques to meet their operational requirements.

Painter, J. E.↗

Application of Sequential Design of Experiments (SDoE) to Large Pilot-Scale Solvent-Based CO2 Capture Process at Technology Centre Mongstad (TCM)

The United States Department of Energy’s Carbon Capture Simulation for Industry Impact (CCSI2) program has developed a framework for sequential design of experiments (SDoE) that aims to maximize knowledge gained from budget- and schedule-limited pilot scale testing. SDoE was applied to the planning and execution of campaigns for testing CO2 capture systems at pilot-scale in order to optimally allocate resources available for the testing. In this methodology, a stochastic process model is developed by quantifying the parametric uncertainty in submodels of interest; for a solvent-based CO2 capture system, these may include physical properties and equipment performance submodels (e.g., mass transfer, interfacial area). This uncertainty is propagated through the full process model, over variable operating conditions, for estimating the resulting uncertainty in key model outputs (e.g., percentage of CO2 capture, solvent regeneration energy requirement). In developing a data collection plan, the predicted output uncertainty is incorporated into an algorithm that seeks simultaneously to select process operating conditions for which the predicted uncertainty is relatively high and to ensure that the entire space of operation is well represented. This test plan is then used to guide operation of the pilot plant at varying steady-state conditions, with resulting process data incorporated into the existing model using Bayesian inference to refine parameter distributions. The updated stochastic model, with reduced parametric uncertainty from data collected, is then used to guide additional data collection, thus the sequential nature of the experimental design. The SDoE process was implemented at the pilot test unit (12 MWe in scale) at Norway’s Technology Centre Mongstad (TCM) in a summer 2018 test campaign with aqueous monoethanolamine (MEA). During the test campaign, the varied operating conditions included the flowrates of circulated solvent, flue gas, and reboiler steam and the CO2 concentration in the flue gas. The process data were used to update probability distributions of mass transfer and interfacial area parameters of a stochastic process model developed by the CCSI2 team. Two iterations of the SDoE process were executed, resulting in the uncertainty in model predicted CO2 capture percentage decreasing by an average of 58.0 ± 4.7% over the full input space of interest. This work demonstrates the potential of the SDoE process for model refinement through reduction in process model parametric uncertainty, and ultimately risk in scale-up, in CO2 capture technology performance.

carbon capture↗

Permanent Source - Distributed Acoustic Sensing (PESO-DAS) v1

The SOV/DAS software program focuses on seismic monitoring and data processing of permanent seismic sources Surface Orbital Vibrators (SOVs) and fiber-optics sensing Distributed Acoustic Sensing (DAS). Its key features include automated data processing of the continuous seismic monitoring data acquired with DAS, and output of processed shot gathers and QC plots. The software supports timelapse seismic for long-term reservoir monitoring, and is used for monitoring of geological carbon storage sites, geothermal reservoirs, and oil and gas, and in general subsurface resource management.

dos Santos Maia Correa, Julia [Lawrence Berkeley N↗

Sensing Electrical Networks Securely & Economically (SENSE)

The growing adoption of distributed energy resources (DERs) like battery energy storage systems and roof top solar/PV and the rapid penetration of electric vehicles (EVs), the electric grid is undergoing a major transformation with elevated stress on legacy grid assets. Despite a lot of expenditure to address these challenges, both in dollars and manpower, utilities have not been able to receive the value that was promised. The gains have been most visible at the transmission and substation level, especially where the main objective was improving operational and economic efficiency for the utility. Improving visibility and control at a few select points enhances the existing and established paradigm of centralized command and control. With changing load patterns, load types and the overall transition to an “active grid”, the centralized control and coordination paradigm gets challenged. To address the challenges, a new architecture and mechanism is needed, one that supports decentralized control and decision making, extracting value streams at the grid edge, particularly as the changes are fueled by transitions occurring in the distribution system. To address this, a communications and data processing platform, “GAMMA” was developed and demonstrated through the project. At the heart of the platform, are distributed, intelligent edge nodes with sensing and compute capabilities, that can record and analyze information locally. They are embedded in sensors and actuators specific to different distribution system applications. Phase 1 of the project focused on developing novel sensor technology that can be used for monitoring utility pole top distribution transformers. The sensors were designed with the objective of being low-cost, communicating with the GAMMA cloud using novel “delay-tolerant” networking using Bluetooth and a secure mobile application. They were non-intrusive in nature so that they can be installed quickly in the field, resulting in overall low cost of deployment and operations. Following the successful completion of Phase 1, the team manufactured 100 units for a field demonstration in Phase 2. The field demonstration was carried out on two real feeder systems with the local utility partner. In total, 100 sensors were installed and operated over a period of 6 months in the state of Georgia. The platform is operational end to end, with the cloud infrastructure deployed on a distributed, serverless environment that can serve multiple data streams, an analytics engine and a portal to securely view the data from multiple assets. The data collected through the GAMMA Mobile Phone app showcased the viability of the novel delay tolerant networking architecture, and the data processing algorithms developed through the course of the project, were successful in extracting important information about the overall network, improving the utility’s visibility and situational awareness in the distribution feeder.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Confocal (micro)-XRF for 3D anlaysis of elements distribution in hot environmental particles

Studies on the fate and transport of radioactive contaminates in the environment are often constrained by a lack of knowledge on the elemental distribution and general behavior of particulate bound radionuclides contained in hot particles. A number of hot particles were previously isolated from soil samples collected at former U.S. nuclear test sites in the Marshall Islands and characterized using non-destructive techniques [1]. The present investigation at HASYLAB is a part of larger research program at ITU regarding the characterization of environmental radioactive particles different locations and source-terms. Radioactive particles in the environment are formed under a number of different release scenarios and, as such, their physicochemical properties may provide a basis for identifying source-term specific contamination regimes. Consequently, studies on hot particles are not only important in terms of studying the elemental composition and geochemical behavior of hot particles but may also lead to advances in assessing the long-term impacts of radioactive contamination on the environment. Six particles isolated from soil samples collected at the Marshall Islands were studied. The element distribution in the particles was determined by confocal {micro}-XRF analysis using the ANKA FLUO beam line. The CRL (compound refractive lens) was used to focus the exciting beam and the polycapillary half lens to collimate the detector. The dimensions of confocal spot were measured by 'knife edge scanning' method with thin gold structure placed at Si wafer. The values of 3.1 x 1.4 x 18.4 {micro}m were achieved if defined as FWHMs of measured L?intensity profiles and when the19.1 keV exciting radiation was used. The collected XRF spectra were analyzed offline with AXIL [2] software to obtain net intensities of element characteristic lines.Further data processing and reconstruction of element distribution was done with the software 'R' [3] dedicated for statistical calculations. In figure 1 the distributions of Pu, Fe and Ti obtained for one of the studied hot particles are presented. The strongest signal was recorded for plutonium; the signals from iron and titanium are respectively 14 and 38 times less. It means that Pu is the most abundant of the observed elements. However, since the light elements are not detectable with the applied measurement conditions, it cannot be definitely stated if plutonium is the main element present in the sample. The isosurfaces are calculated at 20 % of maximum intensity for each element. Please note that the isosurfaces on the drawing are transparent. Changes in the spatial distribution of Pu, Fe, and Ti within the particle are shown in Fig. 2a, 2b, and 2c. Distinct elemental patterns are clearly visible at the higher concentration levels. The distributions of Cr, Cu, and Pb were also reconstructed but the results are not presented here. As it is shown in Fig. 1, the correlation between elements is good at low concentrations but the maxima of concentrations are not strongly correlated (see Fig. 2.). In general, the particle is inhomogeneous in terms of its elemental composition. Similar inhomogeneities were found for other particles with Pu identified as a major element in three of the six particles examined.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Expert system decision support for low-cost launch vehicle operations

Progress in assessing the feasibility, benefits, and risks associated with AI expert systems applied to low cost expendable launch vehicle systems is described. Part one identified potential application areas in vehicle operations and on-board functions, assessed measures of cost benefit, and identified key technologies to aid in the implementation of decision support systems in this environment. Part two of the program began the development of prototypes to demonstrate real-time vehicle checkout with controller and diagnostic/analysis intelligent systems and to gather true measures of cost savings vs. conventional software, verification and validation requirements, and maintainability improvement. The main objective of the expert advanced development projects was to provide a robust intelligent system for control/analysis that must be performed within a specified real-time window in order to meet the demands of the given application. The efforts to develop the two prototypes are described. Prime emphasis was on a controller expert system to show real-time performance in a cryogenic propellant loading application and safety validation implementation of this system experimentally, using commercial-off-the-shelf software tools and object oriented programming techniques. This smart ground support equipment prototype is based in C with imbedded expert system rules written in the CLIPS protocol. The relational database, ORACLE, provides non-real-time data support. The second demonstration develops the vehicle/ground intelligent automation concept, from phase one, to show cooperation between multiple expert systems. This automated test conductor (ATC) prototype utilizes a knowledge-bus approach for intelligent information processing by use of virtual sensors and blackboards to solve complex problems. It incorporates distributed processing of real-time data and object-oriented techniques for command, configuration control, and auto-code generation.

Szatkowski, G. P.↗