Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Distributed Processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

An Overview of the Challenges With and Proposed Solutions for the Ingest and Distribution Processes for Airborne Data Management

The current data management practices for NASA airborne field projects have successfully served science team data needs over the past 30 years to achieve project science objectives, however, users have discovered a number of issues in terms of data reporting and format. The ICARTT format, a NASA standard since 2010, is currently the most popular among the airborne measurement community. Although easy for humans to use, the format standard is not sufficiently rigorous to be machine-readable. This makes data use and management tedious and resource intensive, and also create problems in Distributed Active Archive Center (DAAC) data ingest procedures and distribution. Further, most DAACs use metadata models that concentrate on satellite data observations, making them less prepared to deal with airborne data.

Beach, Aubrey↗

A distributed processing high data rate multiport wind-tunnel pressure measurement system

A multiport pressure measurement system has been developed for the high data rates and the in situ calibration of electronically scanned pressure (ESP) sensors. The system employs a stand-alone microcomputer, connected to a host computer, for data acquisition and preprocessing. The host computer provides several operational modes. Before each run the in situ calibration of each sensor is automatically performed. Using up to a maximum of 14 data acquisition and control units (DACU's), the system may be expanded from 16 to 10,752 pressure ports. Each DACU can make 20,000 measurements per second, average data, and perform statistical analyses before transferring data to the central unit. The system may be introduced into existing facilities and requires little user orientation.

Juanarena, D.↗

An application of distributed processing - In the TDRSS ground communication fault isolation and monitoring system

A computer interface has been designed for the Fault Isolation and Monitoring System, a system providing qualitative and quantitative assessment of the communications between the Tracking and Data Relay Satellite System Ground Segment and NASA's Network Control Center. The functional requirements for the interface and the design philosophy are discussed, as are the methods and protocol used to implement the operator support software required to configure the monitoring system and to display and report the results of the analysis. The system relies on the use of intelligent terminals, with the human interface removed from the host computer.

Waddell, R. L., Jr.↗

Theories of Simplification and Scaling of Spatially Distributed Processes

The problem of scaling is at the heart of ecological theory, the essence of understanding and of the development of a predictive capability. The description of any system depends on the spatial, temporal, and organizational perspective chosen; hence it is essential to understand not only how patterns and dynamics vary with scale, but also how patterns at one scale are manifestations of processes operating at other scales. Evolution has shaped the characteristics of species in ways that result in scale displacement: Each species experiences the environment at its own unique set of spatial and temporal scales and interfaces the biota through unique assemblages of phenotypes. In this way, coexistence becomes possible, and biodiversity is enhanced. By averaging over space, time, and biological interactions, a genotype filters variation at fine scales and selects the arena in which it will face the vicissitudes of nature. Variation at finer scales is then noise, of minor importance to the survival and dynamics of the species, and consequently of minor importance in any attempt at description. In attempting to model ecological interactions in space, contributors throughout this book have struggled with a trade-off between simplification and "realistic" complexity and detail. Although the challenge of simplification is widely recognized in ecology, less appreciated is the intertwining of scaling questions and scaling laws with the process of simplification. In the context of this chapter simplification will in general mean the use of spatial or ensemble means and low-order moments to capture more detailed interactions by integrating over given areas. In this way, one can derive descriptions of the system at different spatial scales, which provides the essentials for the extraction of scaling laws by examination of how system properties vary with scale.

Levin, Simon A.↗

NISAR L-SAR Digital Electronics Subsystem - A Multichannel Distributed Processing System with Synchronous Timing Control for Digital Beam Forming and Multiple Echo Tracking

The NASA-ISRO Synthetic Aperture Radar (NISAR) L-band SAR instrument employs multiple digital channels to optimize resolution while keeping a large swath on a single pass. High-speed digitization with fine synchronization and digital beam forming are necessary in order to facilitate this new technique called SweepSAR. An architecture employing multiple FPGA based digital signal processors has been conceived to facilitate digital calibration on an individual channel basis as well as digital signal processing to optimize the receive signal. On-board processing and data compression has been implemented to reduce the volume of data in order to satisfy the operational requirements of near global coverage for the desired science targets. A novel command and timing architecture was developed to manage this complex system while providing detailed control of individual channel receive window timing required for digital beam forming. The NISAR L-band Digital Electronics Subsystem is the combination of the hardware, firmware and software components architected and implemented to operate this radar and return the desired quantity and quality of data for the science community.

Chuang, Chung-Lun↗

Vacillation Made Easy: Distribution, Re-distribution, and Un-distribution of DOPL-based Processing

Distributed Objects Protocol Layer, or DOPL, Provides a simple and general data communication abstraction that can support the distribution of C++ applications software functionality among an arbitrary collection of processors. The purposed of the abstraction is to minimize the cost of revising processing distribution decisions throughout the software development cycle, including after software has beed delivered to users.

Vacillation↗

Forced guidance and distribution of practice in sequential information processing.

Distribution of practice and forced guidance were used in a sequential information-processing task in an attempt to increase the capacity of human information-processing mechanisms. A reaction time index of the psychological refractory period was used as the response measure. Massing of practice lengthened response times while forced guidance shortened them. Interpretation was in terms of load reduction upon the response-selection stage of the information-processing system.-

Decker, L. R.↗

Overview of the distributed image processing infrastructure to produce the Legacy Survey of Space and Time

The Vera C. Rubin Observatory is preparing to execute the most ambitious astronomical survey ever attempted, the Legacy Survey of Space and Time (LSST). Currently the final phase of construction is under way in the Chilean Andes, with the Observatory’s ten-year science mission scheduled to begin in 2025. Rubin’s 8.4-meter telescope will nightly scan the southern hemisphere collecting imagery in the wavelength range 320–1050 nm covering the entire observable sky every 4 nights using a 3.2 gigapixel camera, the largest imaging device ever built for astronomy. Automated detection and classification of celestial objects will be performed by sophisticated algorithms on high-resolution images to progressively produce an astronomical catalog eventually composed of 20 billion galaxies and 17 billion stars and their associated physical properties. In this article we present an overview of the system currently being constructed to perform data distribution as well as the annual campaigns which reprocess the entire image dataset collected since the beginning of the survey. These processing campaigns will utilize computing and storage resources provided by three Rubin data facilities (one in the US and two in Europe). Each year a Data Release will be produced and disseminated to science collaborations for use in studies comprising four main science pillars: probing dark matter and dark energy, taking inventory of solar system objects, exploring the transient optical sky and mapping the Milky Way. Also presented is the method by which we leverage some of the common tools and best practices used for management of large-scale distributed data processing projects in the high energy physics and astronomy communities. We also demonstrate how these tools and practices are utilized within the Rubin project in order to overcome the specific challenges faced by the Observatory.

79 ASTRONOMY AND ASTROPHYSICS↗

Optical processing for distributed sensors in control of flexible spacecraft

A recent potential of distributed image processing is discussed. Applications in the control of flexible spacecraft are emphasized. Devices are currently being developed at NASA and in universities and industries that allow the real-time processing of holographic images. Within 5 years, it is expected that, in real-time, one may add or subtract holographic images at optical accuracy. Images are stored and processed in crystal mediums. The accuracy of their storage and processing is dictated by the grating level of laser holograms. It is far greater than that achievable using current analog-to-digital, pixel oriented, image digitizing and computing techniques. Processors using image processing algebra can conceptually be designed to mechanize Fourier transforms, least square lattice filters, and other complex control system operations. Thus, actuator command inputs derived from complex control laws involving distributed holographic images can be generated by such an image processor. Plans are revealed for the development of a Conjugate Optics Processor for control of a flexible object.

Montgomery, Raymond C.↗

Performance Analysis of Data Processing in Distributed File Systems with Near Data Processing

In the era of big data, the escalating volume and velocity of data generation pose significant challenges in data processing. Traditional systems like Spark and Hadoop manage the increasing amount and velocity of data by improving data placement and processing speeds. However, they face inherent limitations due to the essential data movement required for processing. In this paper, we explore the Skyhook framework, a novel extension of the Ceph distributed system, which significantly reduces the need for data movement. We present an extensive case study using the Skyhook framework, applying it with the TPC-H and K-means clustering algorithms. More specifically, we leverage the TPC-H benchmark to distinguish between CPU-intensive and I/O-intensive tasks. We explore the integration of K-means clustering into SQL, coupled with a near-data processing system to offload the computational burden of the K-means clustering algorithm to storage nodes. We conduct a comprehensive performance evaluation of distributed data processing applications across three processing approaches: traditional layout (baseline), optimized layout, and near-data processing. Additionally, we introduce the use of the FIO tool to simulate real-world system workloads, enabling the measurement of performance metrics such as average latency and CPU utilization. Our research is a significant advance in understanding how to optimize data processing systems to meet the demands of the modern data landscape.

Hou, Shiyue↗

Standard services for the capture, processing, and distribution of packetized telemetry data

Standard functional services for the capture, processing, and distribution of packetized data are discussed with particular reference to the future implementation of packet processing systems, such as those for the Space Station Freedom. The major functions are listed under the following major categories: input processing, packet processing, and output processing. A functional block diagram of a packet data processing facility is presented, showing the distribution of the various processing functions as well as the primary data flow through the facility.

Stallings, William H.↗

Techniques for collective operations in distributed systems

Various embodiments are generally directed to techniques for collective operations among compute nodes in a distributed processing set, such as by utilizing ring sets and local sets of the distributed processing set. In some embodiments, a ring set may include a subset of the distributed processing set in which each compute node is connected to a network with a separate router. In various embodiments, a local set may include a subset of the distributed processing set in which each compute node is connected to a network with a common router. In one or more embodiments, each compute node in a distributed processing set may belong to one ring set and one local set.

Langer, Akhil↗