Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,585 records · Page 88

Permanent Source - Distributed Acoustic Sensing (PESO-DAS) v1

The SOV/DAS software program focuses on seismic monitoring and data processing of permanent seismic sources Surface Orbital Vibrators (SOVs) and fiber-optics sensing Distributed Acoustic Sensing (DAS). Its key features include automated data processing of the continuous seismic monitoring data acquired with DAS, and output of processed shot gathers and QC plots. The software supports timelapse seismic for long-term reservoir monitoring, and is used for monitoring of geological carbon storage sites, geothermal reservoirs, and oil and gas, and in general subsurface resource management.

dos Santos Maia Correa, Julia [Lawrence Berkeley N↗

Validation of the ERBE scanner scene identification methodology: Analysis with Nimbus-7 ERB data

Maximum Likelihood Estimation (MLE) procedure for scene identification currently being utilized in the ERBE scanner data processing stream is applied to the Nimbus-7 ERB Scanner data for the month of June 1979. The Earth radiation budget parameters derived using MLE method show very good agreement with the values provided using sorting into angular bins (SAB) method. Results of the fields on different spatial scales are presented. A satellite zenith angle study indicates that the MLE procedure considerably improves the scene selection over the method of bispectral thresholds applied in the Nimbus-7 ERB data processing. Agreement with SAB results improved further when the observations were cut off at 75% in satellite zenith. Sampling constraints, however require that the cut-off angle should not be lower than 70%. Quantitative details about the reliability of the scene identification are also presented.

Vermury, S.↗

SETI prototype system for NASA's Sky Survey microwave observing project - A progress report

Two complementary search strategies, a Targeted Search and a Sky Survey, are part of NASA's SETI microwave observing project scheduled to begin in October of 1992. The current progress in the development of hardware and software elements of the JPL Sky Survey data processing system are presented. While the Targeted Search stresses sensitivity allowing the detection of either continuous or pulsed signals over the 1-3 GHz frequency range, the Sky Survey gives up sensitivity to survey the 99 percent of the sky that is not covered by the Targeted Search. The Sky Survey spans a larger frequency range from 1-10 GHz. The two searches will deploy special-purpose digital signal processing equipment designed and built to automate the observing and data processing activities. A two-million channel digital wideband spectrum analyzer and a signal processor system will serve as a prototype for the SETI Sky Survey processor. The design will permit future expansion to meet the SETI requirement that the processor concurrently search for left and right circularly polarized signals.

Klein, M. J.↗

Science Goal Driven Observing: A Step Towards Maximizing Science Returns and Spacecraft Autonomy

While recent missions have made great strides in the ability to autonomously monitor and react to changing health and physical status of spacecraft, little progress has been made in responding quickly to science driven events. Also, the new generation of space-based telescopes will generate data at an unprecedented rate. Yet, while on-board data processing and storage capability will increase rapidly, bandwidth for downloading data will not increase as fast and can become a significant cost of a science program. For observations of inherently variable targets and targets of opportunity, the ability to recognize early if an observation will not meet the science goals, and react accordingly, can have a major positive impact on the overall scientific returns of an observatory and on its operational costs. If the observatory can reprioritize the schedule to focus on alternate targets, discard uninteresting observations prior to downloading, or download them at a reduced resolution its overall efficiency will be dramatically increased. We are investigating and developing tools for a science goal monitoring (SGM) system. The SGM will have an interface to help capture higher-level science goals from the scientists and translate them into a flexible observing strategy that SGM can execute and monitor. SGM will then monitor the incoming data stream and interface with data processing systems to recognize significant events. When an event occurs, the system will use the science goals given it to reprioritize observations, and react appropriately and/or communicate with ground systems - both human and machine - for confirmation and/or further high priority analyses.

Jones, Jeremy↗

Science Goal Driven Observing: A Step Towards Maximizing Science Returns and Spacecraft Autonomy

In the coming decade, the drive to increase the scientific returns on capital investment and to reduce costs will force automation to be implemented in many of the scientific tasks that have traditionally been manually overseen. Thus, spacecraft autonomy will become an even greater part of mission operations. While recent missions have made great strides in the ability to autonomously monitor and react to changing health and physical status of spacecraft, little progress has been made in responding quickly to science driven events. The new generation of space-based telescopes/observatories will see deeper, with greater clarity, and they will generate data at an unprecedented rate. Yet, while onboard data processing and storage capability will increase rapidly, bandwidth for downloading data will not increase as fast and can become a significant bottleneck and cost of a science program. For observations of inherently variable targets and targets of opportunity, the ability to recognize early if an observation will not meet the science goals of variability or minimum brightness, and react accordingly, can have a major positive impact on the overall scientific returns of an observatory and on its operational costs. If the observatory can reprioritize the schedule to focus on alternate targets, discard uninteresting observations prior to downloading, or download them at a reduced resolution its overall efficiency will be dramatically increased. We are investigating and developing tools for a science goal monitoring (SGM) system. The SGM will have an interface to help capture higher-level science goals from scientists and translate them into a flexible observing strategy that SGM can execute and monitor. SGM will then monitor the incoming data stream and interface with data processing systems to recognize significant events. When an event occurs, the system will use the science goals given it to reprioritize observations, and react appropriately and/or communicate with ground systems - both human and machine - for confirmation and/or further high priority analyses.

Koratkar, Anuradha↗

Checkpointing in speculative versioning caches

Mechanisms for generating checkpoints in a speculative versioning cache of a data processing system are provided. The mechanisms execute code within the data processing system, wherein the code accesses cache lines in the speculative versioning cache. The mechanisms further determine whether a first condition occurs indicating a need to generate a checkpoint in the speculative versioning cache. The checkpoint is a speculative cache line which is made non-speculative in response to a second condition occurring that requires a roll-back of changes to a cache line corresponding to the speculative cache line. The mechanisms also generate the checkpoint in the speculative versioning cache in response to a determination that the first condition has occurred.

97 MATHEMATICS AND COMPUTING↗

Atmospheric Radiation Measurement Climate Research Facility Operations Quarterly Report October 1-December 31, 2016

Individual datastreams from instrumentation at the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) Climate Research Facility fixed and mobile research observatories (sites) are collected and routed to the ARM Data Center (ADC). The Data Management Facility (DMF), a component of the ADC, executes datastream processing in near-real time. Processed data are then delivered approximately daily to the ARM Data Archive, also a component of the ADC, where they are made freely available to the research community. For each instrument, ARM calculates the ratio of the actual number of processed data records received daily at the ARM Data Archive to the expected number of data records. DOE requires national user facilities to report time-based operating data.

54 ENVIRONMENTAL SCIENCES↗

Atmospheric Radiation Measurement Climate Research Facility Operations Quarterly Report April 1-June 30, 2017

Individual datastreams from instrumentation at the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) Climate Research Facility fixed and mobile research observatories (sites) are collected and routed to the ARM Data Center (ADC). The Data Management Facility (DMF), a component of the ADC, executes datastream processing in near-real time. Processed data are then delivered approximately daily to the ARM Data Archive, also a component of the ADC, where they are made freely available to the research community. For each instrument, ARM calculates the ratio of the actual number of processed data records received daily at the ARM Data Archive to the expected number of data records. DOE requires national user facilities to report time-based operating data. The requirements involve: Actual hours of operation (ACTUAL)—24 hours per day, 91 days or 2184 hours for this quarter Estimated maximum operation or uptime target (TARGET) Variance (VARIANCE), which is equal to (1–[ACTUAL/TARGET]) TARGET and VARIANCE numbers account for unplanned downtime. Differences in TARGET performance reflect the complexity of local logistics and the frequency of extreme weather events. It is impractical to measure TARGET for each instrument or datastream. Data availability reported here refers to the average of the individual, continuous datastreams received by the ARM Data Archive. Therefore, data availability is directly related to individual instrument uptime expressed in hours. Data not at the ARM Data Archive are caused by downtime (scheduled or unplanned) of the individual instruments. Missing data caused by scheduled downtime are not included in the metrics. Thus, the average percentage of data in the ARM Data Archive represents the average percentage of the time the instruments were operating for the quarter.

Aerosol↗

Atmospheric Radiation Measurement Climate Research Facility Operations Quarterly Report January 1-March 31, 2017

Individual datastreams from instrumentation at the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) Climate Research Facility fixed and mobile research observatories (sites) are collected and routed to the ARM Data Center (ADC). The Data Management Facility (DMF), a component of the ADC, executes datastream processing in near-real time. Processed data are then delivered approximately daily to the ARM Data Archive, also a component of the ADC, where they are made freely available to the research community. For each instrument, ARM calculates the ratio of the actual number of processed data records received daily at the ARM Data Archive to the expected number of data records. DOE requires national user facilities to report time-based operating data. The requirements involve: Actual hours of operation (ACTUAL)—24 hours per day, 90 days or 2160 hours for this quarter Estimated maximum operation or uptime target (TARGET) Variance (VARIANCE), which is equal to (1–[ACTUAL/TARGET]) TARGET and VARIANCE numbers account for unplanned downtime. Differences in TARGET performance reflect the complexity of local logistics and the frequency of extreme weather events. It is impractical to measure TARGET for each instrument or datastream. Data availability reported here refers to the average of the individual, continuous datastreams received by the ARM Data Archive. Therefore, data availability is directly related to individual instrument uptime expressed in hours. Data not at the ARM Data Archive are caused by downtime (scheduled or unplanned) of the individual instruments. Missing data caused by scheduled downtime are not included in the metrics. Thus, the average percentage of data in the ARM Data Archive represents the average percentage of the time the instruments were operating for the quarter.

Eastern North Atlantic, Southern Great Plains, Nor↗

Portal dosimetry for VMAT using integrated images obtained during treatment

Purpose: Portal dosimetry provides an accurate and convenient means of verifying dose delivered to the patient. A simple method for carrying out portal dosimetry for volumetric modulated arc therapy (VMAT) is described, together with phantom measurements demonstrating the validity of the approach. Methods: Portal images were predicted by projecting dose in the isocentric plane through to the portal image plane, with exponential attenuation and convolution with a double-Gaussian scatter function. Appropriate parameters for the projection were selected by fitting the calculation model to portal images measured on an iViewGT portal imager (Elekta AB, Stockholm, Sweden) for a variety of phantom thicknesses and field sizes. This model was then used to predict the portal image resulting from each control point of a VMAT arc. Finally, all these control point images were summed to predict the overall integrated portal image for the whole arc. The calculated and measured integrated portal images were compared for three lung and three esophagus plans delivered to a thorax phantom, and three prostate plans delivered to a homogeneous phantom, using a gamma index for 3% and 3 mm. A 0.6 cm{sup 3} ionization chamber was used to verify the planned isocentric dose. The sensitivity of this method to errors in monitor units, field shaping, gantry angle, and phantom position was also evaluated by means of computer simulations. Results: The calculation model for portal dose prediction was able to accurately compute the portal images due to simple square fields delivered to solid water phantoms. The integrated images of VMAT treatments delivered to phantoms were also correctly predicted by the method. The proportion of the images with a gamma index of less than unity was 93.7% ± 3.0% (1SD) and the difference between isocenter dose calculated by the planning system and measured by the ionization chamber was 0.8% ± 1.0%. The method was highly sensitive to errors in monitor units and field shape, but less sensitive to errors in gantry angle or phantom position. Conclusions: This method of predicting integrated portal images provides a convenient means of verifying dose delivered using VMAT, with minimal image acquisition and data processing requirements.

61 RADIATION PROTECTION AND DOSIMETRY↗

Cell-Detection Technique for Automated Patch Clamping

A unique and customizable machinevision and image-data-processing technique has been developed for use in automated identification of cells that are optimal for patch clamping. [Patch clamping (in which patch electrodes are pressed against cell membranes) is an electrophysiological technique widely applied for the study of ion channels, and of membrane proteins that regulate the flow of ions across the membranes. Patch clamping is used in many biological research fields such as neurobiology, pharmacology, and molecular biology.] While there exist several hardware techniques for automated patch clamping of cells, very few of those techniques incorporate machine vision for locating cells that are ideal subjects for patch clamping. In contrast, the present technique is embodied in a machine-vision algorithm that, in practical application, enables the user to identify good and bad cells for patch clamping in an image captured by a charge-coupled-device (CCD) camera attached to a microscope, within a processing time of one second. Hence, the present technique can save time, thereby increasing efficiency and reducing cost. The present technique involves the utilization of cell-feature metrics to accurately make decisions on the degree to which individual cells are "good" or "bad" candidates for patch clamping. These metrics include position coordinates (x,y) in the image plane, major-axis length, minor-axis length, area, elongation, roundness, smoothness, angle of orientation, and degree of inclusion in the field of view. The present technique does not require any special hardware beyond commercially available, off-the-shelf patch-clamping hardware: A standard patchclamping microscope system with an attached CCD camera, a personal computer with an imagedata- processing board, and some experience in utilizing imagedata- processing software are all that are needed. A cell image is first captured by the microscope CCD camera and image-data-processing board, then the image data are analyzed by software that implements the present machine-vision technique. This analysis results in the identification of cells that are "good" candidates for patch clamping (see figure). Once a "good" cell is identified, a patch clamp can be effected by an automated patchclamping apparatus or by a human operator. This technique has been shown to enable reliable identification of "good" and "bad" candidate cells for patch clamping. The ultimate goal in further development of this technique is to combine artificial-intelligence processing with instrumentation and controls in order to produce a complete "turnkey" automated patch-clamping system capable of accurately and reliably patch clamping cells with a minimum intervention by a human operator. Moreover, this technique can be adapted to virtually any cellular-analysis procedure that includes repetitive operation of microscope hardware by a human.

McDowell, Mark↗

LET Spectrum Measurements In CR-39 PNTD With AFM

Energetic protons, neutrons, and heavy ions undergoing collisions with target nuclei of varying Z can produce residual heavy recoil fragments via intra-nuclear cascade/evaporation reactions. The particles produced in these non-elastic collisions generally have such extremely short range ({approx}<10 {mu}m) that they cannot be directly observed by conventional detection methods including CR-39 plastic nuclear track detector (PNTD) that has been chemically etched for analysis by standard visible light microscopy. However, high-LET recoil fragments having range on the order of several cell diameters can be produced in tissue during radiotherapy using proton and carbon beams. We have developed a method to analyze short-range, high-LET tracks in CR-39 plastic nuclear track detector (PNTD) using short duration chemical etching ({approx}<1 {mu}m) following by automated atomic force microscope (AFM) scanning. The post-scan data processing used in this work was based on semi-automated matrix analysis opposed to traditional grey-scale image analysis. This method takes advantage of the 3-D data obtained via AFM to achieve robust discrimination of nuclear tracks from other features inherently present in the post-etch detector surface. Through automation of AFM scanning, sufficient AFM scan frames were obtained to attain an LET spectrum spanning the LET range from 200-1500 keV/{mu}m. In addition to our experiments, simulations were carried out with the Monte Carlo transport code, FLUKA. To demonstrate this method, CR-39 PNTD was exposed to the proton therapy beam at Loma Linda University Medical Center (LLUMC) at 60 and 230 MeV. Additionally, detectors were exposed to 1 GeV protons at the NASA Space Radiation Laboratory (NSRL) at Brookhaven National Laboratory (BNL). For these exposures CR-39 PNTD, Al and Cu target foils were used between detector layers.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Petabyte Class Storage at Jefferson Lab (CEBAF)

By 1997, the Thomas Jefferson National Accelerator Facility will collect over one Terabyte of raw information per day of Accelerator operation from three concurrently operating Experimental Halls. When post-processing is included, roughly 250 TB of raw and formatted experimental data will be generated each year. By the year 2000, a total of one Petabyte will be stored on-line. Critical to the experimental program at Jefferson Lab (JLab) is the networking and computational capability to collect, store, retrieve, and reconstruct data on this scale. The design criteria include support of a raw data stream of 10-12 MB/second from Experimental Hall B, which will operate the CEBAF (Continuous Electron Beam Accelerator Facility) Large Acceptance Spectrometer (CLAS). Keeping up with this data stream implies design strategies that provide storage guarantees during accelerator operation, minimize the number of times data is buffered allow seamless access to specific data sets for the researcher, synchronize data retrievals with the scheduling of postprocessing calculations on the data reconstruction CPU farms, as well as support the site capability to perform data reconstruction and reduction at the same overall rate at which new data is being collected. The current implementation employs state-of-the-art StorageTek Redwood tape drives and robotics library integrated with the Open Storage Manager (OSM) Hierarchical Storage Management software (Computer Associates, International), the use of Fibre Channel RAID disks dual-ported between Sun Microsystems SMP servers, and a network-based interface to a 10,000 SPECint92 data processing CPU farm. Issues of efficiency, scalability, and manageability will become critical to meet the year 2000 requirements for a Petabyte of near-line storage interfaced to over 30,000 SPECint92 of data processing power.

Chambers, Rita↗

A Statistical Framework for Operational lnfrasound Monitoring [Slides]

Historically, much infrasound research has been event-based, with known events providing the ground-truth required to inform the search for associated signals. For monitoring nuclear explosions in the atmosphere or underground, reliable techniques are required for operational infrasound data processing that effectively minimize both false alarms and missed detections. A difficulty in working with infrasound data is to adequately account for dynamic variations in the atmosphere, which occur over a variety of temporal and spatial scales. However, contrary to one's intuition, it is not necessary to have a high fidelity atmospheric model in order to perform robust detection, association and location. We present detection, association and location algorithms that assume no a priori knowledge of the atmosphere; however, where knowledge is available we show how it can be used to reduce the associated uncertainties. Rather than exporting seismic techniques to the problem of infrasound monitoring, our techniques were developed from the ground-up to properly account for the unique considerations of atmospheric acoustics. In contrast with other routinely used infrasound detectors, we utilize a contextual detection hypothesis that adaptively accounts for temporally variable correlated ambient noise. Our location scheme allows for the location of infrasound events without any meteorological data through a Bayesian framework. We demonstrate the application of the techniques presented here for a series of ground-truth events, and for routine data processing of large amounts of regional infrasound data.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Influence of technology on magnetic tape storage device characteristics

There are available today many data storage devices that serve the diverse application requirements of the consumer, professional entertainment, and computer data processing industries. Storage technologies include semiconductors, several varieties of optical disk, optical tape, magnetic disk, and many varieties of magnetic tape. In some cases, devices are developed with specific characteristics to meet specification requirements. In other cases, an existing storage device is modified and adapted to a different application. For magnetic tape storage devices, examples of the former case are 3480/3490 and QIC device types developed for the high end and low end segments of the data processing industry respectively, VHS, Beta, and 8 mm formats developed for consumer video applications, and D-1, D-2, D-3 formats developed for professional video applications. Examples of modified and adapted devices include 4 mm, 8 mm, 12.7 mm and 19 mm computer data storage devices derived from consumer and professional audio and video applications. With the conversion of the consumer and professional entertainment industries from analog to digital storage and signal processing, there have been increasing references to the 'convergence' of the computer data processing and entertainment industry technologies. There has yet to be seen, however, any evidence of convergence of data storage device types. There are several reasons for this. The diversity of application requirements results in varying degrees of importance for each of the tape storage characteristics.

Gniewek, John J.↗

Use of the Tool to Support Renewable Energy Auctions Processes (RE Data Explorer)

Renewable energy auctions are now a common competitive approach to procure low-cost renewable power around the world. Ensuring a successful auction process increasingly depends on the capabilities of auction designers and participants to identify actionable and defensible insights from large data sets (on renewable energy resources and complementary data) to both attract potential investors and address stakeholder concerns. The Renewable Energy (RE) Data Explorer is a user-friendly geospatial analysis tool for analyzing renewable energy potential and informing decisions. Developed by the National Renewable Energy Laboratory (NREL) and supported by the U.S. Agency for International Development (USAID), RE Data Explorer performs visualization and analysis of renewable energy potential that can be customized for different scenarios. RE Data Explorer can support prospecting, integrated planning, policymaking, and other decision-making activities to accelerate renewable energy deployment. The broader RE Explorer website provides guidance and information to link the RE Data Explorer geospatial analysis tool to key decision areas. This document provides information on how the RE Data Explorer can be used to support renewable energy auction processes.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Feature Analysis, Tracking, and Data Reduction: An Application to Multiphase Reactor Simulation MFiX-Exa for In-Situ Use Case

As we enter the exascale computing regime, powerful supercomputers continue to produce much higher amounts of data than what can be stored for offline data processing. To utilize such high compute capabilities on these machines, much of the data processing needs to happen in situ, when the full high-resolution data is available at the supercomputer memory. In this article, we discuss our MFiX-Exa simulation, which models multiphase flow by tracking a very large number of particles through the simulation domain. In one of the use cases, the carbon particles interact with air to produce carbon dioxide bubbles from the reactor. These bubbles are of primary interest to the domain experts for these simulations. For this particle-based simulation, we propose a streaming technique that can be deployed in situ to efficiently identify the bubbles, track them over time, and use them to down-sample the data with minimal loss in these features.

97 MATHEMATICS AND COMPUTING↗

The Seasat algorithm development facility at JPL

The Seasat-A spacecraft, scheduled for launch in May 1978, will produce a global ocean data set covering a one-year nominal mission. Because this is a proof-of-concept mission, data processing algorithms are expected to evolve as the data base grows. To support the evolution and evaluation of algorithms, and to experiment with various techniques for processing the data, an algorithm development facility (ADF) is being developing. The ADF will provide access to the data base and to highly modularized processing programs. The processing programs will be subject to easy and frequent modification by a remote user community of sensor managers and experiment teams, who will use this capability to evaluate the overall performance of the sensors and the algorithms using surface truth data. The ADF concepts of software standardization and interface control are expected to have general applicability for adaptive data processing systems.

Brown, J. W.↗