Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

Upper Atmosphere Research Satellite (UARS) science data processing center implementation history

NASA-Goddard is responsible for the development of a ground system for the Upper Atmosphere Research Satellite (UARS) observatory, whose launch is scheduled for 1991. This ground system encompasses a dedicated Central Data Handling Facility (CDHF); attention is presently given to the management of software systems design and implementation phases for CDHF by the UARS organization. Also noted are integration and testing activities performed following software deliveries to the CDHF. The UARS project has an obvious requirement for a powerful and flexible data base management system; an off-the-shelf commercial system has been incorporated.

Herring, Ellen L.↗

Alaska Satellite Facility ASF5 SAR Data Processing System Overview

The Alaska SAR Facility (ASF) situated at the University of Alaska Fairbanks (UAF) is currently undergoing an extensive development effort to increase its capabilities in handling new sensors and in the areas of throughput, data handling, archive, and distribution [15].

SAR↗

Arrangements for communicating and processing data in a computing system

Systems and methods for reducing data movement in a computer system. The systems and methods use information or knowledge about the structure of an algorithm, operations to be executed at a receiving processing unit, variables or subsets or groups of variables in a distributed algorithm, or other forms of contextual information, for reducing the number of bits transmitted from at least one transmitting processing unit to at least one receiving processing unit or storage device.

Gonzalez, Juan Guillermo↗

GUC CSU X-Band Precipitation Radar Plan Position Indicator data processed with Corrected Moments in Antenna Coordinates

For the Surface Atmosphere Integrated Field Laboratory (SAIL) campaign, Corrected Moments in Antenna Coordinates (CMAC) is a set of algorithms and code that does corrections to CSU X-Precipitation Radar PPI data. Additionally, CMAC adds calculations of derived snowfall rates to the original data in order to provide precipitation estimates for the campaign.

54 ENVIRONMENTAL SCIENCES↗

Initial operation and data processing on a system for real-time evaluation of Thomson scattering signals on the Large Helical Device

A scalable system for real-time analysis of electron temperature and density based on signals from the Thomson scattering diagnostic, initially developed for and installed on the NSTX-U experiment, was recently adapted for the Large Helical Device and operated for the first time during plasma discharges. During its initial operation run, it routinely recorded and processed signals for four spatial points at the laser repetition rate of 30 Hz, well within the system’s rated capability for 60 Hz. We present examples of data collected from this initial run and describe subsequent adaptations to the analysis code to improve the fidelity of the temperature calculations.

47 OTHER INSTRUMENTATION↗

Initial operation and data processing on a system for real-time evaluation of Thomson scattering signals on the Large Helical Device

A scalable system for real-time analysis of electron temperature and density based on signals from the Thomson scattering diagnostic, initially developed for and installed on the NSTX-U experiment, was recently adapted for the Large Helical Device (LHD) and operated for the first time during plasma discharges. During its initial operation run, it routinely recorded and processed signals for four spatial points at the laser repetition rate of 30 Hz, well within the system's rated capability for 60 Hz. We present examples of data collected from this initial run and describe subsequent adaptations to the analysis code to improve the fidelity of the temperature calculations.

Thomson scattering, real-time, LHD, plasma diagnos↗

Summary of shuttle data processing and aerodynamic performance comparisons for the first 11 flights

NASA Space Shuttle aerodynamic and aerothermodynamic research is but one part of the most comprehensive end-to-end flight test program ever undertaken considering: the extensive pre-flight experimental data base development; the multitude of spacecraft and remote measurements taken during entry flight; the complexity of the Orbiter aerodynamic configuration; the variety of flight conditions available across the entire speed regime; and the efforts devoted to flight data reduction throughout the aerospace community. Shuttle entry flights provide a wealth of research quality data, in essence a veritable flying wind tunnel, for use by researchers to verify and improve the operational capability of the Orbiter and provide data for evaluations of experimental facilities as well as computational methods. This final report merely summarizes the major activities conducted by the AMA, Inc. under NASA Contract NAS1-16087 as part of that interesting research. Investigators desiring more detailed information can refer to the glossary of AMA publications attached herein as Appendix A. Section I provides background discussion of software and methodology development to enable Best Estimate Trajectory (BET) generation. Actual products generated are summarized in Section II as tables which completely describe the post-flight products available from the first three-year Shuttle flight history. Summary results are presented in Section III, with longitudinal performance comparisons included as Appendices for each of the flights.

Findlay, J. T.↗

The real-time data processing and acquisition system for Project 8 Phase II

In Phase II of the Project 8 neutrino mass experiment, electrons from the decays of tritium or 83m Kr are detected via their ≈26 GHz cyclotron radiation while contained within a circular waveguide. The signal from a given electron is characterized as a brief chirp, lasting ≲10 ms and changing in frequency by ≲1 MHz/ms. To detect these signals, the Project 8 collaboration developed a Data Acquisition (DAQ) system tailored to the signal properties. The DAQ is responsible for simultaneously selecting up to three 100 MHz-wide frequency windows to study, detect, and trigger on likely signals from different electron kinetic energies, and for writing the relevant data to disk. Finally, we describe the Phase II DAQ system in detail and address how the system was used for data-taking operations.

Data acquisition↗

EXD HME MicroCT Data Acquisition, Processing and Data Request Overview

This document is a short summary of the steps required for MicroCT evaluation of a specimen. This includes data acquisition through image analysis, for the EXD HME program. Expected outputs for each stage are provided. Data shall be shipped to LLNL as described herein.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Interactive imaging and data processing

Image processing method is capable of contrast enhancement, noise filtering, and photometric distortion removal in near real time. System uses digital image integration and digital video recorder as image buffer. Each frame of data is entered into memory; registers provide readout of stored TV frame.

Alsberg, H.↗

Rock Valley Accelerated Weight Drop Seismic Data Processing and Picking of P-wave and S-wave Arrival Times

Rock Valley, in the southern end of the Nevada National Security Site, hosts a fault system that was responsible for a shallow (< 3 km below surface ) magnitude 3.7 earthquake in May 1993. In order to better understand this system, seismic properties of the shallow subsurface need to be better constrained. In April and May of 2021, accelerated weight drop (AWD) active-source seismic data were recorded in order to measure P- and S-wave travel-times for the area. This report describes the processing and phase picking of the recorded seismic waveforms. In total, we picked 7,982 P-wave arrivals at offsets up to ~2500 m, and 4,369 S-wave arrivals at offsets up to ~2200 m. These travel-time picks can be inverted for shallow P-wave and S-wave velocity structure in future studies.

58 GEOSCIENCES↗

EdgeAI: Machine learning via direct attached accelerator for streaming data processing at high shot rate x-ray free-electron lasers

We present a case for low batch-size inference with the potential for adaptive training of a lean encoder model. We do so in the context of a paradigmatic example of machine learning as applied in data acquisition at high data velocity scientific user facilities such as the Linac Coherent Light Source-II x-ray Free-Electron Laser. We discuss how a low-latency inference model operating at the data acquisition edge can capitalize on the naturally stochastic nature of such sources. We simulate the method of attosecond angular streaking to produce representative results whereby simulated input data reproduce high-resolution ground truth probability distributions. By minimizing the mean-squared error between the decoded output of the latent representation and the ground truth distributions, we ensure that the encoding layers and resulting latent representation maintains full fidelity for any downstream task, be it classification or regression. We present throughput results for data-parallel inference of various batch sizes, some with throughput exceeding 100 k images per second. We also show in situ training below 10 s per epoch for the full encoder–decoder model as would be relevant for streaming and adaptive real-time data production at our nation’s scientific light sources.

97 MATHEMATICS AND COMPUTING↗

Planck 2015 results: VIII. High Frequency Instrument data processing: Calibration and maps

This paper describes the processing applied to the cleaned, time-ordered information obtained from the Planck High Frequency Instrument (HFI) with the aim of producing photometrically calibrated maps in temperature and (for the first time) in polarization. The data from the entire 2.5-year HFI mission include almost five full-sky surveys. HFI observes the sky over a broad range of frequencies, from 100 to 857 GHz. To obtain the best accuracy on the calibration over such a large range, two different photometric calibration schemes have been used. The 545 and 857 GHz data are calibrated using models of planetary atmospheric emission. The lower frequencies (from 100 to 353 GHz) are calibrated using the time-variable cosmological microwave background dipole, which we call the orbital dipole. This source of calibration only depends on the satellite velocity with respect to the solar system. Using a CMB temperature of T CMB = 2.7255 ± 0.0006 K, it permits an independent measurement of the amplitude of the CMB solar dipole (3364.3 ± 1.5 μK), which is approximatively 1σ higher than the WMAP measurement with a direction that is consistent between the two experiments. We describe the pipeline used to produce the maps of intensity and linear polarization from the HFI timelines, and the scheme used to set the zero level of the maps a posteriori. We also summarize the noise characteristics of the HFI maps in the 2015 Planck data release and present some null tests to assess their quality. Lastly, we discuss the major systematic effects and in particular the leakage induced by flux mismatch between the detectors that leads to spurious polarization signal.

79 ASTRONOMY AND ASTROPHYSICS↗

JANA2 Framework for Event Based and Triggerless Data Processing

Development of the second generation JANA2 multi-threaded event processing framework is ongoing through an LDRD initiative grant at Jefferson Lab. The framework is designed to take full advantage of all cores on modern many-core compute nodes. JANA2 efficiently handles both traditional hardware triggered event data and streaming data in online triggerless environments. Development is being done in conjunction with the Electron Ion Collider development. Anticipated to be the next large scale Nuclear Physics facility constructed. The core framework is written in modern C++ but includes an integrated Python interface. The status of development and summary of the more interesting features are presented.

Lawrence, David↗

Simulating the Impacts of Disturbances on Forest Carbon Cycling in North America: Processes, Data, Models, and Challenges

Disturbances disrupt the forest structures and alter forest resources, substrate availability, or the physical environment. Understanding disturbances and their impacts is critical for a better quantification of North American carbon dynamics. We reviewed the status and major challenges in simulating the impacts of disturbances on forest carbon cycling in North America from the perspectives of process understanding, disturbance characterization, and modeling, and found some major issues. First, we do not have adequate continentally-consistent disturbance databases to support the NACP missions. Community effort, in collaborating with the modeling community, should be designated to systematically define international standards for disturbance databases with explicit inclusion of uncertainty measurements, adequate spatial and temporal resolutions, and explicit and quantifiable linkages with model simulations. Second, there is a need to develop effective and comprehensive process-based procedures or algorithms that can be used to quantify the immediate and long-term impacts of disturbances on forest succession, soils, microclimate, and cycles of carbon, water, and nutrients. These algorithms should be evaluated not only on the carbon cycle but also on the simulations of vegetation succession, alterations of soil and microclimate, and water and nutrients dynamics because adequate simulations of carbon dynamics rely on the correct quantification of the changes of soil and vegetation conditions. Third, the scaling challenges have rarely been addressed at the continental scale. We do not understand which processes and properties at a given temporal or spatial scales are critical while others can be simplified when we try to balance the North American carbon budget. Previous and current model simulations at the continental scale did not incorporate a full suite of disturbances information (because they do not exist as described above), and therefore provided little insight on the relative importance of various disturbances at the continent and regional scales on the carbon cycle. Fourth, our capability of simulating the occurrences and severity of disturbances under climate change and management futures are very limited. Fifth, uncertainty exists in every step of the effort to simulating the impacts of disturbances on carbon dynamics. Procedures are needed to quantify the uncertainty of model inputs or data layers, model parameters, and model structures, and their impacts on model simulations. Working together, modelers and data layer developers can identify the most uncertain areas and develop working hypotheses to reduce the uncertainty.

54 ENVIRONMENTAL SCIENCES↗

Data Processing for High-Contrast Imaging with the James Webb Space Telescope

The James Webb Space Telescope (JWST) will probe circumstellar environments at an unprecedented sensitivity.However, the performance of high-contrast imaging instruments is limited by the residual light from the star at close separations (<2-3”), where the incidence of exoplanets increases rapidly. There is currently no solution to get rid of the residual light down to the photon noise level at those separations, which may prevent some crucial discoveries. JWST’s debut is planned for October 2021 for a baseline mission lifetime of only five years. Thus,it is crucial to find a solution to this problem before its launch. We are further developing and implementing an innovative approach of post-processing built on a Bayesian framework that provides a more robust determination of faint astrophysical structures around a bright source. This approach uses a model of high-contrast imaging instrument that takes advantage of prior information, such as data from wavefront sensing (WFS) operations on JWST, to estimate simultaneously instrumental aberrations and the circumstellar environment. With this approach, our goal is to further improve the contrast gain over the contrast that can be achieved with JWST instruments, starting with NIRCam imaging and coronagraphic imaging. This work will pave the way for the future space-based high-contrast imaging instruments such as the Nancy Grace Roman Space Telescope Coronagraph Instrument (Roman CGI). This technique will be crucial to make the best use of the telemetry data that will be collected during the CGI operations.

Jewell, Jeffrey B.↗

Application of Reconfigurable Computing Technology to Multi-KiloHertz Micro-Laser Altimeter (MMLA) Data Processing

The Multi-KiloHertz Micro-Laser Altimeter (MMLA) is an aircraft based instrument developed by NASA Goddard Space Flight Center with several potential spaceflight applications. This presentation describes how reconfigurable computing technology was employed to perform MMLA signal extraction in real-time under realistic operating constraints. The MMLA is a "single-photon-counting" airborne laser altimeter that is used to measure land surface features such as topography and vegetation canopy height. This instrument has to date flown a number of times aboard the NASA P3 aircraft acquiring data at a number of sites in the Mid-Atlantic region. This instrument pulses a relatively low-powered laser at a very high rate (10 kHz) and then measures the time-of-flight of discrete returns from the target surface. The instrument then bins these measurements into a two-dimensional array (vertical height vs. horizontal ground track) and selects the most likely signal path through the array. Return data that does not correspond to the selected signal path are classified as noise returns and are then discarded. The MMLA signal extraction algorithm is very compute intensive in that a score must be computed for every possible path through the two dimensional array in order to select the most likely signal path. Given a typical array size with 50 x 6, up to 33 arrays must be processed per second. And for each of these arrays, roughly 12,000 individual paths must be scored. Furthermore, the number of paths increases exponentially with the horizontal size of the array, and linearly with the vertical size. Yet, increasing the horizontal and vertical sizes of the array offer science advantages such as improved range, resolution, and noise rejection. Due to the volume of return data and the compute intensive signal extraction algorithm, the existing PC-based MMLA data system has been unable to perform signal extraction in real-time unless the array is limited in size to one column, This limits the ability of the MMLA to operate in environments with sparse signal returns and a high number of noise return. However, under an IR&D project, an FPGA-based, reconfigurable computing data system has been developed that has been demonstrated to perform real-time signal extraction under realistic operating constraints. This reconfigurable data system is based on the commercially available Firebird Board from Annapolis Microsystems. This PCI board consists of a Xilinx Virtex 2000E FPGA along with 36 MB of SRAM arranged in five separately addressable banks. This board is housed in a rackmount PC with dual 850MHz Pentium processors running the Windows 2000 operating system. This data system performs all signal extraction in hardware on the Firebird, but also runs the existing "software based" signal extraction in tandem for comparison purposes. Using a relatively small amount of the Virtex XCV2000E resources, the reconfigurable data system has demonstrated to improve performance improvement over the existing software based data system by an order of magnitude. Performance could be further improved by employing parallelism. Ground testing and a preliminary engineering test flight aboard the NASA P3 has been performed, during which the reconfigurable data system has been demonstrated to match the results of the existing data system.

Powell, Wesley↗