Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30
All sourcesNASA NTRSDOE OSTI
NASA NTRS2001

SIMBIOS Project Data Processing and Analysis Results

The Sensor Intercomparison and Merger for Biological and Interdisciplinary Oceanic Studies (SIMBIOS) Project is concerned with ocean color satellite sensor data intercomparison and merger for biological and interdisciplinary studies of the global oceans. Imagery from different ocean color sensors can now be processed by a single software package using the same algorithms, adjusted by different sensor spectral characteristics, and the same ancillary meteorological and environmental data. This enables cross-comparison and validation of the data derived from satellite sensors and, consequently, creates continuity in ocean color information on both the temporal and spatial scale. The next step in this process is the integration of in situ ocean and atmospheric parameters to enable cross-validation and further refinement of the ocean color methodology. The SIMBIOS Project Office accomplishments during 2000 year are summarized under satellite data processing, data product validation, SeaWiFS Bio-Optical Archive and Storage System (SeaBASS) database, supporting services, sun photometers and calibration activities, and calibration round robins. These accomplishments are described.

Ainsworth, Ewa↗
NASA NTRS1983

NASA/NOAA implementation of the USAID-sponsored satellite ground station and data processing facility for Bangladesh

A description is given of a project to transfer multiple environmental satellite data reception, processing, and interpretation capabilities from the U.S. to Bangladesh. The goal of the project is to improve the management of resources related primarily to agriculture, water development, forestry, and fisheries. It is also hoped to improve the existing cyclone/storm surge warning system. An account is given of the interagency and international cooperation underlying the project. The remote-sensing installation in Dhaka, Bangladesh, is described, and the most likely system applications are summarized. Attention is also given to the special requirements concerning this type of technology transfer, and an assessment is made of the project's practical value to Bangladesh.

Dodge, J. C.↗
NASA NTRS1974

Potential capabilities for compression of information of certain data processing systems

This article undertakes to study a generalized block diagram of a data collection and processing system of a spacecraft in which a number of sensors or outputs of scientific instruments are cyclically interrogated by a commutator, methods of writing the supplementary information in a frame on the example of a certain hypothetical telemetry system, and the influence of statistics of number of active channels in a frame on frame compression factor. The separation of the data compression factor of the collection and processing system of spacecraft into two parts used in this work allows determination of the compression factor of an active frame depending not only on the statistics of activity of channels in the telemetry frame, but also on the method of introduction of the additional address and time information to each frame.

Khodarev, Y. K.↗
DOE OSTI2013

Removal of Radiocesium from Food by Processing: Data Collected after the Fukushima Daiichi Nuclear Power Plant Accident - 13167

Removal of radiocesium from food by processing is of great concern following the accident of TEPCO's Fukushima Daiichi Nuclear Power Plant accident. Foods in markets are monitored and recent monitoring results have shown that almost all food materials were under the standard limit concentration levels for radiocesium (Cs-134+137), that is, 100 Bq kg{sup -1} in raw foods, 50 Bq kg{sup -1} in baby foods, and 10 Bq kg{sup -1} in drinking water; those food materials above the limit cannot be sold. However, one of the most frequently asked questions from the public is how much radiocesium in food would be removed by processing. Hence, information about radioactivity removal by processing of food crops native to Japan is actively sought by consumers. In this study, the food processing retention factor, F{sub r}, which is expressed as total activity in processed food divided by total activity in raw food, is reported for various types of corps. For white rice at a typical polishing yield of 90-92% from brown rice, the F{sub r} value range was 0.42-0.47. For leafy vegetable (indirect contamination), the average F{sub r} values were 0.92 (range: 0.27-1.2) after washing and 0.55 (range: 0.22-0.93) after washing and boiling. The data for some fruits are also reported. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2017

A Pipeline for Large Data Processing Using Regular Sampling for Unstructured Grids

Large simulation data requires a lot of time and computational resources to compute, store, analyze, visualize, and run user studies. Today, the largest cost of a supercomputer is not hardware but maintenance, in particular energy consumption. Our goal is to balance energy consumption and cognitive value of visualizations of resulting data. This requires us to go through the entire processing pipeline, from simulation to user studies. To reduce the amount of resources, data can be sampled or compressed. While this adds more computation time, the computational overhead is negligible compared to the simulation time. We built a processing pipeline at the example of regular sampling. The reasons for this choice are two-fold: using a simple example reduces unnecessary complexity as we know what to expect from the results. Furthermore, it provides a good baseline for future, more elaborate sampling methods. We measured time and energy for each test we did, and we conducted user studies in Amazon Mechanical Turk (AMT) for a range of different results we produced through sampling.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2000

Prototyping Mid-Infrared Detector Data Processing Algorithms

Over the past year, much progress has been accomplished to complete this study. The last data collection segment was completed and all data was analyzed. The data from the Functional Mobility Course were presented at a scientific meeting. The entire study will be presented at the National Student Researcher's Forum in May.

data processing↗
NASA NTRS1978

Application of the informational reference system OZhUR to the automated processing of data from satellites of the Kosmos series

The structure and potential of the information reference system OZhUR designed for the automated data processing systems of scientific space vehicles (SV) is considered. The system OZhUR ensures control of the extraction phase of processing with respect to a concrete SV and the exchange of data between phases.The practical application of the system OZhUR is exemplified in the construction of a data processing system for satellites of the Cosmos series. As a result of automating the operations of exchange and control, the volume of manual preparation of data is significantly reduced, and there is no longer any need for individual logs which fix the status of data processing. The system Ozhur is included in the automated data processing system Nauka which is realized in language PL-1 in a binary one-address system one-state (BOS OS) electronic computer.

Pokras, V. M.↗
NASA NTRS2011

Framework for Integrating Science Data Processing Algorithms Into Process Control Systems

A software framework called PCS Task Wrapper is responsible for standardizing the setup, process initiation, execution, and file management tasks surrounding the execution of science data algorithms, which are referred to by NASA as Product Generation Executives (PGEs). PGEs codify a scientific algorithm, some step in the overall scientific process involved in a mission science workflow. The PCS Task Wrapper provides a stable operating environment to the underlying PGE during its execution lifecycle. If the PGE requires a file, or metadata regarding the file, the PCS Task Wrapper is responsible for delivering that information to the PGE in a manner that meets its requirements. If the PGE requires knowledge of upstream or downstream PGEs in a sequence of executions, that information is also made available. Finally, if information regarding disk space, or node information such as CPU availability, etc., is required, the PCS Task Wrapper provides this information to the underlying PGE. After this information is collected, the PGE is executed, and its output Product file and Metadata generation is managed via the PCS Task Wrapper framework. The innovation is responsible for marshalling output Products and Metadata back to a PCS File Management component for use in downstream data processing and pedigree. In support of this, the PCS Task Wrapper leverages the PCS Crawler Framework to ingest (during pipeline processing) the output Product files and Metadata produced by the PGE. The architectural components of the PCS Task Wrapper framework include PGE Task Instance, PGE Config File Builder, Config File Property Adder, Science PGE Config File Writer, and PCS Met file Writer. This innovative framework is really the unifying bridge between the execution of a step in the overall processing pipeline, and the available PCS component services as well as the information that they collectively manage.

Mattmann, Chris A.↗
DOE OSTI2018

Verification of an Algorithm for Processing Data from Multifrequency Lidar Sensing of Aerosols

We consider an algorithm for processing lidar signals, which for a lidar path with constant qualitative aerosol characteristics (particle size distribution in each aerosol mode, complex refractive index of the particles) lets us obtain a concentration profile for the fine aerosol component without using additional a priori information. The algorithm was verified based on lidar data from the Institute of Physics (National Academy of Sciences of Belarus). The vertical volume concentration profile for fine particles obtained by our algorithm is quite consistent with the results of its independent retrieval, based on integrated processing of lidar and sun photometer data.

42 ENGINEERING↗
NASA NTRS1972

A computer program for Moessbauer data processing

A computer program to analyze Mossbauer data is presented in detail. The least-squares curve fitting techniques described apply to single line spectra, single hyperfine spectra, or when the constituent spectra are separated well enough to let the individual absorption peaks stand alone. The present program is not adapted for complex spectra resulting from the existence of several local environments in the absorber iron alloy. Sample problems are presented to aid the user in setting up and running the program. The program is written in FORTRAN 4 language for the Control Data 6000 series digital computer with the SCOPE 3.0 operating system and requires approximately 115,000 octal locations of core storage. A typical case with one absorption peak runs in 20 seconds, and a typical problem with six absorption peaks requires 50 seconds.

Howser, L. M.↗
NASA NTRS1978

Data processing for water monitoring system

Water monitoring data acquisition system is structured about central computer that controls sampling and sensor operation, and analyzes and displays data in real time. Unit is essentially separated into two systems: computer system, and hard wire backup system which may function separately or with computer.

Monford, L.↗
NASA NTRS1978

Future timing accuracy requirements and procedures for data processing

Timing accuracy requirements for satellite experiment data are discussed. Although time accuracies of 100 milliseconds were sufficient when OSO-3, 4, 5 were launched in the mid-60s, time accuracies of 100 microseconds are necessary for OSO-8, HEAO-A, and Seasat, and it is thought likely that accuracies of 10 microseconds will become routine in the 1980s. An approach to the problem of identifying the sources of spacecraft timing errors - from the onboard counters to the final tagging of data - is considered.

Smith, G. A.↗
DOE OSTI2020

Offsite Data Processing for the GlueX Experiment

The Thomas Jefferson National Accelerator Facility (JLab) 12GeV accelerator upgrade completed in 2015 is now producing data at volumes unprecedented for the lab. The resources required to process this data now exceed the capacity of the onsite farm necessitating the use of offsite computing resources for the first time in the history of JLab. GlueX is now utilizing NERSC and PSC for raw data production. Details of the workflow are presented.

Lawrence, David↗
DOE OSTI2023

Accelerating Machine Learning Inference with GPUs in ProtoDUNE Data Processing

Abstract We study the performance of a cloud-based GPU-accelerated inference server to speed up event reconstruction in neutrino data batch jobs. Using detector data from the ProtoDUNE experiment and employing the standard DUNE grid job submission tools, we attempt to reprocess the data by running several thousand concurrent grid jobs, a rate we expect to be typical of current and future neutrino physics experiments. We process most of the dataset with the GPU version of our processing algorithm and the remainder with the CPU version for timing comparisons. We find that a 100-GPU cloud-based server is able to easily meet the processing demand, and that using the GPU version of the event processing algorithm is two times faster than processing these data with the CPU version when comparing to the newest CPUs in our sample. The amount of data transferred to the inference server during the GPU runs can overwhelm even the highest-bandwidth network switches, however, unless care is taken to observe network facility limits or otherwise distribute the jobs to multiple sites. We discuss the lessons learned from this processing campaign and several avenues for future improvements.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

CMS Tier-0 data processing during the detector commissioning in Run 3

The CMS Tier-0 system is responsible for the prompt processing and distribution of the data collected by the CMS Experiment. A number of upgrades were implemented during the long shutdown 2 of the Large Hadron Collider, which improved the performance and reliability of the system. In this report, these upgrades are discussed and a more detailed description of the Tier-0 system is given. The experience of the data taking during Run 3 detector commissioning as well as the performance of the system are highlighted.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Colorado State University (CSU) X-Band Precipitation Radar Plan Position Indicator Data Processed with Corrected Moments in Antenna Coordinates (CMAC) Value-Added Product Report

In 2010 the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility procured 3- and 5-cm wavelength radars for documenting the macrophysical, microphysical, and dynamical structure of precipitating systems. To maximize the scientific impact, ARM supported the development of an application chain to correct for various phenomena in order to retrieve the “point” values of moments of the radar spectrum and polarimetric measurements. We have now used the lessons learned from the processing of the 3- and 5-cm wavelength radars obtained by ARM to help process X-band radar data from the Surface Atmospheric Integrated Field Laboratory (SAIL) field campaign. This report details the motivation, science, and progress to date as well as charting a path forward.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2010

Data processing of absorption spectra from photoionized plasma experiments at Z

We discuss the processing of x-ray absorption spectra from photoionized plasma experiments at Z. The data was recorded with an imaging spectrometer equipped with two elliptically bent potassium acid phthalate (KAP) crystals. Both time-integrated and time-resolved data were recorded. In both cases, the goal is to obtain the transmission spectra for quantitative analysis of plasma conditions.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗