Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,189 records · Page 66

Development of a multipurpose smart recorder for general aviation aircraft

An intelligent flight recorder, called the Smart Recorder, was fabricated and installed on a King Air aircraft used in standard commercial charter service. This recorder was used for collection of data toward two objectives: (1) the characterization of the typical environment encountered by the aircraft; and (2) research in the area of trend monitoring. Data processing routines and data presentation formats were defined that are applicable to commuter size aircraft. The feasibility of a cost-effective, multipurpose recorder for general aviation aircraft was successfully demonstrated. Implementation of on-board environmental data processing increased the number of flight hours that could be stored on a single data cartridge and simplified the data management problem by reducing the volume of data to be processed in the laboratory. Trend monitoring algorithms showed less variability in the trend plots when compared against plots of manual data.

White, J. H.↗

Collection, processing and dissemination of data for the national solar demonstration program

A national solar data system developed for the DOE by IBM provides for automatic gathering, conversion, transfer, and analysis of demonstration site data. NASA requirements for this system include providing solar site hardware, engineering, data collection, and analysis. The specific tasks include: (1) solar energy system design/integration; (2) developing a site data acquisition subsystem; (3) developing a central data processing system; (4) operating the test facility at Marshall Space Flight Center; (5) collecting and analyzing data. The systematic analysis and evaluation of the data from the National Solar Data System is reflected in a monthly performance report and a solar energy system performance evaluation report.

Day, R. E.↗

SAM 2 and SAGE data management and processing

The data management and processing supplied by ST Systems Corporation (STX) for the Stratospheric Aerosol Measurement 2 (SAM 2) and Stratospheric Aerosol and Gas Experiment (SAGE) experiments for the years 1983 to 1986 are described. Included are discussions of data validation, documentation, and scientific analysis, as well as the archival schedule met by the operational reduction of SAM 2 and SAGE data. Work under this contract resulted in the archiving of the first seven years of SAM 2 data and all three years of SAGE data. A list of publications and presentations supported was also included.

Osborn, M. T.↗

Importance of Data Management in a Long-term Biological Monitoring Program

The long-term Biological Monitoring and Abatement Program (BMAP) has always needed to collect and retain high-quality data on which to base its assessments of ecological status of streams and their recovery after remediation. Its formal quality assurance, data processing, and data management components all contribute to this need. The Quality Assurance Program comprehensively addresses requirements from various institutions, funders, and regulators, and includes a data management component. Centralized data management began a few years into the program. An existing relational database was adapted and extended to handle biological data. Data modeling enabled the program's database to process, store, and retrieve its data. The data base's main data tables and several key reference tables are described. One of the most important related activities supporting long-term analyses was the establishing of standards for sampling site names, taxonomic identification, flagging, and other components. There are limitations. Some types of program data were not easily accommodated in the central systems, and many possible data-sharing and integration options are not easily accessible to investigators. The implemented relational database supports the transmittal of data to the Oak Ridge Environmental Information System (OREIS) as the permanent repository. From our experience we offer data management advice to other biologically oriented long-term environmental sampling and analysis programs.

54 ENVIRONMENTAL SCIENCES↗

Processing incommensurately modulated protein diffraction data with Eval15

Data processing of an incommensurately modulated profilin–actin crystal is described. Recent challenges in biological X-ray crystallography include the processing of modulated diffraction data. A modulated crystal has lost its three-dimensional translational symmetry but retains long-range order that can be restored by refining a periodic modulation function. The presence of a crystal modulation is indicated by an X-ray diffraction pattern with periodic main reflections flanked by off-lattice satellite reflections. While the periodic main reflections can easily be indexed using three reciprocal-lattice vectors a*, b*, c*, the satellite reflections have a non-integral relationship to the main lattice and require a q vector for indexing. While methods for the processing of diffraction intensities from modulated small-molecule crystals are well developed, they have not been applied in protein crystallography. A recipe is presented here for processing incommensurately modulated data from a macromolecular crystal using the Eval program suite. The diffraction data are from an incommensurately modulated crystal of profilin–actin with single-order satellites parallel to b*. The steps taken in this report can be used as a guide for protein crystallographers when encountering crystal modulations. To our knowledge, this is the first report of the processing of data from an incommensurately modulated macromolecular crystal.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Low-cost data analysis systems for processing multispectral scanner data

A research-oriented data analysis system was developed which is used for evaluating complex remote sensor systems and for development of techniques for application of remotely sensed data. Some modular hardware components were developed which may be added to one's existing facilities to establish a low-cost data analysis system for processing multispectral scanner data. Software modules which are compatible with small general purpose digital computers process and analyze remote sensor data, and convert it to information needed by users. The software modules are written in FORTRAN IV language for ease of transfer to other computer systems. The basic hardware and software system requirements are defined for some low-cost data analysis systems consisting of an image display system, a small general purpose digital computer, and an output recording device. The hardware modules consist of: a LANDSAT MSS data reformatting program; a series of spectral pattern recognition programs required to generate surface classification maps and tabular information; programs to convert computer generated maps from image space to a geographically referenced base; programs to extract data and irregularly shaped areas and to produce thematic maps of the designated areas; and programs to tabulate acreages of selected classification categories. Some off-the-shelf, inexpensive digital image display systems are described.

Whitley, S. L.↗

Seasat low-rate data system

The Seasat low-rate data system, an end-to-end data-processing and data-distribution system for the four low-rate sensors (radar altimeter, Seasat-A scatterometer system, scanning multichannel microwave radiometer, and visible and infrared radiometer) carried aboard the satellite, is discussed. The function of the distributed, nonreal-time, magnetic-tape system is to apply necessary calibrations, corrections, and conversions to yield geophysically meaningful products from raw telemetry data. The algorithms developed for processing data from the different sensors are described, together with the data catalogs compiled.

Brown, J. W.↗

Developing processing techniques for Skylab data

The author has identified the following significant results. The effects of misregistration and the scan-line-straightening algorithm on multispectral data were found to be: (1) there is greatly increased misregistration in scan-line-straightening data over conic data; (2) scanner caused misregistration between any pairs of channels may not be corrected for in scan-line-straightened data; and (3) this data will have few pure field center pixels than will conic data. A program SIMSIG was developed implementing the signature simulation model. Data processing stages of the experiment were carried out, and an analysis was made of the effects of spatial misregistration on field center classification accuracy. Fifteen signatures originally used for classifying the data were analyzed, showing the following breakdown: corn (4 signatures), trees (2), brush (1), grasses, weeds, etc. (5), bare soil (1), soybeans (1), and alfalfa (1).

Nalepka, R. F.↗

Challenges in Development of Online Visualization and Analysis Tools for Satellite Data

Over the years, various online visualization and analysis tools have been developed to facilitate satellite data access and help scientific users around the world to conduct research and develop applications (e.g., data product evaluation, what-if questions, etc.). For those who are new to satellite data products, using them can be a daunting task due to many obstacles in data processing such as data formats, complex data structures, special software packages, unfamiliar terminology, etc., especially when one is not sure whether a dataset is suitable for his/er research project. Even for experienced users, developing software for data processing and analysis can be a costly and time-consuming task. Online visualization tools can overcome many of these difficulties and allow users to focus on scientific questions. For example, Giovanni (the Geospatial Interactive Online Visualization and Analysis Infrastructure, https://giovanni.gsfc.nasa.gov), developed by the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), allows access over 1900 satellite and model variables in 82 measurement groups of 8 disciplines without downloading data and software. Main features include basic functions for data analysis and visualization, data provenance, output data in different formats (ASCII, NetCDF, GeoTIFF), and more. Over the years, ~1700 peer-reviewed publications in different disciplines have been benefited from Giovanni in research activities (e.g. initial investigation, what-if questions, product evaluation). Despite the success of online visualization and analysis tools, challenges and new opportunities still exist and more can be done with new requirements and technology. Examples are: a) how to increase the efficiency of dataset search by enhancing intuitive aspects; b) how to facilitate interdisciplinary research; c) how to provide data quality information; d) how to engage users to participate in data quality assessment; and more. NASA Earth Observing System Data and Information System (EOSDIS) satellite-based data products are processed at various levels ranging from Level 0 to Level 4. While most users use data products at higher levels (Level-3 and 4), products at lower levels are still important for case studies, algorithm development, ground validation, etc. In this presentation, we will use Giovanni as an example to present and discuss challenges and near-future opportunities for satellite data online visualization and analysis tools.

Liu, Zhong↗

Processing Contexts for Experimental HEP Data

This document provides, for those not closely associated with the experimental High Energy Physics (HEP) community, an introduction to data input and output requirements for a variety of data processing tasks. Examples in it are drawn from the art event processing framework, and from experiments and projects using art, most notably the LArSoft and NuTools projects.

97 MATHEMATICS AND COMPUTING↗

Geologic mapping of the Ladakh Himalaya by computer processing of Landsat data

Computer processed Landsat digital data and field studies have been integrated to make a geologic map of the Indus Suture in the Ladakh Himalaya. This coordinated approach has been successful at locating and identifying the areal extent of the major rock bodies in a 2500 square kilometer area, much of which is inaccessable for conventional field geologic studies.

Francica, J. R.↗

Data reduction through optimized scalar quantization for more compact neural networks

Raw data generation for several existing and planned large physics experiments now exceeds TB/s rates, generating untenable data sets in very little time. Those data often demonstrate high dimensionality while containing limited information. Meanwhile, Machine Learning algorithms are now becoming an essential part of data processing and data analysis. Those algorithms can be used offline for post processing and post data analysis, or they can be used online for real time processing providing ultra low latency experiment monitoring. Both use cases would benefit from data throughput reduction while preserving relevant information: one by reducing the offline storage requirements by several orders of magnitude and the other by allowing ultra fast online inferencing with low complexity Machine Learning models. Moreover, reducing the data source throughput also reduces material cost, power and data management requirements. In this work we demonstrate optimized nonuniform scalar quantization for data source reduction. This data reduction allows lower dimensional representations while preserving the relevant information of the data, thus enabling high accuracy Tiny Machine Learning classifier models for online fast inferences. We demonstrate this approach with an initial proof of concept targeting the CookieBox, an array of electron spectrometers used for angular streaking, that was developed for LCLS-II as an online beam diagnostic tool. We used the Lloyd-Max algorithm with the CookieBox dataset to design an optimized nonuniform scalar quantizer. Optimized quantization lets us reduce input data volume by 69% with no significant impact on inference accuracy. When we tolerate a 2% loss on inference accuracy, we achieved 81% of input data reduction. Finally, the change from a 7-bit to a 3-bit input data quantization reduces our neural network size by 38%.

97 MATHEMATICS AND COMPUTING↗

Study of the internal structure, instabilities, and magnetic fields in the dense Z-pinch

Z-pinches are sources of hot dense plasma which generates powerful x-ray bursts and can been applied to various areas of high-energy-density physics (HEDP). The 26-MA Z machine is at the forefront of many of these applications, but important aspects of HEDP have been studied on generators at the 1 MA current level. Recent development of laser diagnostics and upgrade of the Leopard laser at Nevada Terawatt Facility (NTF) give new opportunities for the dense Z-pinch study. The goal of this project is the investigation of the internal structure of the stagnated Z pinch including sub-mm and micron-scale instabilities, plasma dynamics, magnetic fields, and hot spots formation and initiation. New plasma diagnostics will be developed for this project. A 3D structure and instabilities of the pinch will be compared with 3D MHD and spectroscopic modeling and theoretical analysis. The structure and dynamics of stagnated Z pinches has been studied with x-ray self-radiation diagnostics which derive a temperature map of the pinch with a spatial resolution of 70-150 µm. The regular laser diagnostics at 532 nm does not penetrate in the dense pinch due to strong absorption and refraction in trailing plasma. Recent experiments at NTF showed that shadowgraphy at the UV wavelength of 266 nm unfolds a fine structure of the stagnated Z-pinch with unprecedented detail. We propose to develop laser UV diagnostics for Z pinches with a spatial resolution <5 μm to study the small-scale plasma structures, implement two-frame shadowgraphy/interferometry, and develop methods for investigation of strong magnetic fields. New diagnostics will help to understand better basic physical processes in Z pinches. A 3D internal structure of the pinch and characteristic instabilities will be studied in wire arrays with different configurations and compared with 3D MHD simulations and analytical models. Mechanisms of “enhanced heating” of Z-pinch plasma will be studied. Fast dynamics of stagnated plasma will be studied to estimate its contribution to the Doppler broadening of x-ray lines. Development of “necks” and “hot spots” will be studied with high-resolution UV diagnostics, an x-ray streak camera, and x-ray spectroscopy. Laser initiation of hot spots in Z pinches will be tested. A Faraday rotation diagnostic at 266 nm will be applied to 1-10 MG magnetic fields. For magnetic fields B>20 MG, suggested in micropinches, Cotton-Mouton and cutoff diagnostics will be applied. A picosecond optical Kerr shutter will be tested to increase a sensitivity of UV methods for application at multi-MA Z pinches. The proposal is based on the experimental capability of NTF. The Zebra generator produces 1-1.7 MA Z-pinches with electron plasma density of 10 20 -10 21 cm -3 , electron temperature of 0.5-1 keV, and magnetic fields >10 MG. The Leopard laser was upgraded to energy of 90-J at 0.8 ns. This regime will be used for laser initiation of hot spots. A further upgrade to energy of 250-J is suggested for laser-Z-pinch interaction. A picosecond regime will be used for optical gating. A 10-TW Tomcat laser at NTF is available for the high energy UV laser probing of the Z-pinch. Two graduate students will develop new optical and x-ray diagnostics, carry out experiments, and process experimental data. Other students will be involved in the design and fabrication of loads, supporting regular optical and x-ray diagnostics, and data processing. The new plasma diagnostics may be applied to HEDP experiments at NTF and other multi-MA generators. The feasibility of the research plan is based on the experience of the scientific team in Z-pinch plasma physics, laser physics, development of new plasma diagnostics, and the experimental capability of NTF. The experimental group of Dr. V. V. Ivanov (UNR) collaborates with a group for Z pinch MHD modeling of Dr. J. P. Chittenden (Imperial College, London), and theoretical group of Dr. D. D. Ryutov (LLNL). The suggested research ideas are supported by preliminary experiments.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Parallel integrated frame synchronizer chip

A parallel integrated frame synchronizer which implements a sequential pipeline process wherein serial data in the form of telemetry data or weather satellite data enters the synchronizer by means of a front-end subsystem and passes to a parallel correlator subsystem or a weather satellite data processing subsystem. When in a CCSDS mode, data from the parallel correlator subsystem passes through a window subsystem, then to a data alignment subsystem and then to a bit transition density (BTD)/cyclical redundancy check (CRC) decoding subsystem. Data from the BTD/CRC decoding subsystem or data from the weather satellite data processing subsystem is then fed to an output subsystem where it is output from a data output port.

Ghuman, Parminder Singh↗

APS Data Management System

As the capabilities of modern X-ray detectors and acquisition technologies increase, so do the data rates and volumes produced at synchrotron beamlines. This brings into focus a number of challenges related to managing data at such facilities, including data transfer, near real-time data processing, automated processing pipelines, data storage, handling metadata and remote user access to data. The Advanced Photon Source Data Management System software is designed to help beamlines deal with these issues. Finally, this paper presents the system architecture and describes its components and functionality; the system's current usage is discussed, examples of its use have been provided and future development plans are outlined.

97 MATHEMATICS AND COMPUTING↗

A fast, programmable hardware architecture for the processing of spaceborne SAR data

The development of high-throughput SAR processors (HTSPs) for the spaceborne SARs being planned by NASA, ESA, DFVLR, NASDA, and the Canadian Radarsat Project is discussed. The basic parameters and data-processing requirements of the SARs are listed in tables, and the principal problems are identified as real-operations rates in excess of 2 x 10 to the 9th/sec, I/O rates in excess of 8 x 10 to the 6th samples/sec, and control computation loads (as for range cell migration correction) as high as 1.4 x 10 to the 6th instructions/sec. A number of possible HTSP architectures are reviewed; host/array-processor (H/AP) and distributed-control/data-path (DCDP) architectures are examined in detail and illustrated with block diagrams; and a cost/speed comparison of these two architectures is presented. The H/AP approach is found to be adequate and economical for speeds below 1/200 of real time, while DCDP is more cost-effective above 1/50 of real time.

Bennett, J. R.↗

Experiment specific processing of residual acceleration data

To date, most Spacelab residual acceleration data collection projects have resulted in data bases that are overwhelming to the investigator of low-gravity experiments. This paper introduces a simple passive accelerometer system to measure low-frequency accelerations. Model responses for experiments using actual acceleration data are produced and correlations are made between experiment response and the accelerometer time history in order to test the idea that recorded acceleration data and experimental responses can be usefully correlated. Spacelab 3 accelerometer data are used as input to a variety of experiment models, and sensitivity limits are obtained for particular experiment classes. The modeling results are being used to create experiment-specific residual acceleration data processing schemes for interested investigators.

Rogers, Melissa J. B.↗