Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “DATA PROCESSING”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32

North Slope of Alaska XSAPR b1 Data Processing Report: April 2024-April 2025

The North Slope of Alaska (NSA) atmospheric observatory, operated by the U.S. Department of Energy (DOE)’s Atmospheric Radiation Measurement (ARM) User Facility, is a measurement site in the Arctic that has been collecting crucial atmospheric data for more than 25 years. The central facility located in Utqiaġvik, Alaska (formerly known as Barrow) hosts a suite of instruments that are used to better understand arctic processes, which are often not well represented in earth system models. The NSA site sits only a few kilometers from the Arctic Ocean, which also makes it a prime location to study complex ocean-atmosphere-ice interactions. Arctic cloud and precipitation processes are also of scientific interest, and remote-sensing instruments including radars are a key component of the NSA instrument suite. One of the radars at NSA is the X-band Scanning ARM Precipitation Radar (XSAPR). This report evaluates one year of recent XSAPR data from April 2024 through April 2025 and details the process of generating b1-level data. This analysis marks the first effort by ARM staff to quality-control NSA XSAPR data with the goal of routinely producing b1-level data in the future depending on radar operations.

54 ENVIRONMENTAL SCIENCES↗

TRACER Radar b1 Data Processing: Corrections, Calibrations, and Processing Report

The U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility deployed the first ARM Mobile Facility (AMF1) to Houston, Texas for the Tracking Aerosol Convection Interactions Experiment (TRACER) field campaign. The TRACER campaign was conducted from October 1, 2021 to September 30, 2022, with an intensive operational period (IOP) from June 1 to September 30, 2022. To investigate the life cycles of convective cells in the polluted and humid urban environment of Houston, ARM deployed cloud and precipitation radars, including the C-band Scanning ARM Precipitation Radar (CSAPR2), the X/Ka-band Scanning ARM Cloud Radar (SACR), and the Ka-band ARM Zenith cloud Radar (KAZR), as shown in Figure 1. This report presents an analysis of radar data quality, hardware calibrations, and radar data corrections.

54 ENVIRONMENTAL SCIENCES↗

ICESat-2 Atmospheric Channel Description, Data Processing and First Results

The Advanced Topographic Laser Altimeter System (ATLAS) was launched aboard the Ice Cloud and land-Elevation Satellite-2 (ICESat-2) satellite in September 2018. ATLAS is a single wavelength (532 nm) lidar system designed to acquire high resolution measurements of the earth's surface while also obtaining atmospheric backscatter from molecules, clouds, and aerosols. Because ATLAS is optimized for altimetry, the atmospheric data acquired is unique in many respects and requires non-standard analysis techniques. For example, the high repetition rate laser limits the vertical extent of the profiles to just 14 km and causes atmospheric scattering from above 15 km to be added to the scattering in the lower 0–14 km profile. In addition, the limited vertical range of the acquired profiles renders it difficult to compute the magnitude of the solar background and hinders the application of standard calibration techniques. Despite these limitations, methods have been developed to successfully produce data products that have value to the atmospheric community for cloud and aerosol research and are currently available at the National Snow and Ice Data Center (NSIDC). In this paper we describe the ICESat-2 atmospheric channel and the methods used to process the ATLAS raw photon count data to obtain calibrated backscatter and higher level products such as layer heights and type, blowing snow, column optical depth and apparent surface reflectance.

Stephen P Palm↗

Fixed-Site KAZR b1 Data Processing: Corrections, Calibrations, and Processing Report

The U.S. Department of Energy’s (DOE) Atmospheric Radiation Measurement (ARM) User Facility operates three fixed-site observatories: Eastern North Atlantic (ENA), North Slope of Alaska (NSA), and Southern Great Plains (SGP). Each fixed site has a wide variety of atmospheric instrumentation that has been collecting data for at least 10 years (NSA and SGP over 25 years). Each site is unique because it represents a different climate state. The environment at ENA is characterized by marine stratocumulus clouds and one of the key scientific areas of focus is the interaction of these clouds with aerosols. At NSA the focus is on arctic climate and cloud and radiative processes in a high-latitude environment. SGP represents a mid-latitude, mid-continent climate that experiences environmental cycles on diurnal and seasonal time scales. The ARM observatories are all meant to improve understanding of atmospheric processes that can then be better incorporated into weather and climate models. Another common thread between the fixed sites is the focus on cloud processes. Each site is equipped with at least one radar that provides continuous remote-sensing observations of clouds and precipitation. This report details the analysis of a1-level radar data at the fixed sites and the process for generating b1-level data. While b1-level data have been produced for ARM campaigns at the mobile facilities, this is the first analysis led by ARM radar mentors to correct data at the fixed sites. In particular, we focus on calibrations and corrections of the Ka-band ARM Zenith Radars (KAZRs) at ENA, NSA, and SGP. Ongoing and future work will involve corrections applied to other fixed-site radars.

54 ENVIRONMENTAL SCIENCES↗

ExaFEL: extreme-scale real-time data processing for X-ray free electron laser science

ExaFEL is an HPC-capable X-ray Free Electron Laser (XFEL) data analysis software suite for both Serial Femtosecond Crystallography (SFX) and Single Particle Imaging (SPI) developed in collaboration with the Linac Coherent Lightsource (LCLS), Lawrence Berkeley National Laboratory (LBNL) and Los Alamos National Laboratory. ExaFEL supports real-time data analysis via a cross-facility workflow spanning LCLS and HPC centers such as NERSC and OLCF. Our work therefore constitutes initial path-finding for the US Department of Energy's (DOE) Integrated Research Infrastructure (IRI) program. We present the ExaFEL team's 7 years of experience in developing real-time XFEL data analysis software for the DOE's exascale supercomputers. We present our experiences and lessons learned with the Perlmutter and Frontier supercomputers. Furthermore we outline essential data center services (and the implications for institutional policy) required for real-time data analysis. Finally we summarize our software and performance engineering approaches and our experiences with NERSC's Perlmutter and OLCF's Frontier systems. This work is intended to be a practical blueprint for similar efforts in integrating exascale compute resources into other cross-facility workflows.

59 BASIC BIOLOGICAL SCIENCES↗

North Slope of Alaska XSAPR b1 Data Processing Report: May 2025-April 2026

The U.S. Department of Energy’s Atmospheric Radiation Measurement (ARM) User Facility operates an X-band Scanning ARM Precipitation Radar (XSAPR) at the North Slope of Alaska (NSA) atmospheric observatory in Utqiaġvik. This radar provides year-round dual-polarization measurements of snow and ice in an arctic environment. Over the past few years, there has been greater focus on the NSA XSAPR, and recent efforts by ARM staff have resulted in quality-controlled, b-level data (Rocque et al. 2026b). This report outlines the processing of the second set of b-level data released for this radar from May 2025 through April 2026 following similar methods from Rocque et al. (2026b).

54 ENVIRONMENTAL SCIENCES↗

Alaska Synthetic Aperture Radar (SAR) Facility science data processing architecture

The paper describes the architecture of the Alaska SAR Facility (ASF) at Fairbanks, being developed to generate science data products for supporting research in sea ice motion, ice classification, sea-ice-ocean interaction, glacier behavior, ocean waves, and hydrological and geological study areas. Special attention is given to the individual substructures of the ASF: the Receiving Ground Station (RGS), the SAR Processor System, and the Interactive Image Analysis System. The SAR data will be linked to the RGS by the ESA ERS-1 and ERS-2, the Japanese ERS-1, and the Canadian Radarsat.

Hilland, Jeffrey E.↗

Five-Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Data Processing, Sky Maps, and Basic Results

The Wilkinson Microwave Anisotropy Probe (WMAP) is a Medium-Class Explorer (MIDEX) satellite aimed at elucidating cosmology through full-sky observations of the cosmic microwave background (CMB). The WMAP full-sky maps of the temperature and polarization anisotropy in five frequency bands provide our most accurate view to date of conditions in the early universe. The multi-frequency data facilitate the separation of the CMB signal from foreground emission arising both from our Galaxy and from extragalactic sources. The CMB angular power spectrum derived from these maps exhibits a highly coherent acoustic peak structure which makes it possible to extract a wealth of information about the composition and history of the universe. as well as the processes that seeded the fluctuations. WMAP data have played a key role in establishing ACDM as the new standard model of cosmology (Bennett et al. 2003: Spergel et al. 2003; Hinshaw et al. 2007: Spergel et al. 2007): a flat universe dominated by dark energy, supplemented by dark matter and atoms with density fluctuations seeded by a Gaussian, adiabatic, nearly scale invariant process. The basic properties of this universe are determined by five numbers: the density of matter, the density of atoms. the age of the universe (or equivalently, the Hubble constant today), the amplitude of the initial fluctuations, and their scale dependence. By accurately measuring the first few peaks in the angular power spectrum, WMAP data have enabled the following accomplishments: Showing the dark matter must be non-baryonic and interact only weakly with atoms and radiation. The WMAP measurement of the dark matter density puts important constraints on supersymmetric dark matter models and on the properties of other dark matter candidates. With five years of data and a better determination of our beam response, this measurement has been significantly improved. Precise determination of the density of atoms in the universe. The agreement between the atomic density derived from WMAP and the density inferred from the deuterium abundance is an important test of the standard big bang model. Determination of the acoustic scale at redshift z = 1090. Similarly, the recent measurement of baryon acoustic oscillations (BAO) in the galaxy power spectrum (Eisenstein et al. 2005) has determined the acoustic scale at redshift z approx. 0.35. When combined, these standard rulers accurately measure the geometry of the universe and the properties of the dark energy. These data require a nearly flat universe dominated by dark energy consistent with a cosmological constant. Precise determination of the Hubble Constant, in conjunction with BAO observations. Even when allowing curvature (Omega(sub 0) does not equal 1) and a free dark energy equation of state (w does not equal -1), the acoustic data determine the Hubble constant to within 3%. The measured value is in excellent agreement with independent results from the Hubble Key Project (Freedman et al. 2001), providing yet another important consistency test for the standard model. Significant constraint of the basic properties of the primordial fluctuations. The anti-correlation seen in the temperature/polarization (TE) correlation spectrum on 4deg scales implies that the fluctuations are primarily adiabatic and rule out defect models and isocurvature models as the primary source of fluctuations (Peiris et al. 2003).

Weiland, J.L.↗

Data processing assessment for the Lunar Geoscience Observer imaging spectrometer

On the Lunar Geoscience Observer project, a Visible and Infrared Mapping Spectrometer instrument has been proposed. This instrument will have science data input rates in the hundreds of kilobits per second (kbps) and an average telemetry output data rate of 4 kbps. Techniques that can be used to reduce the throughput of the instrument are editing, summing and averaging, data compression, data preprocessing, pattern recognition and snapshot data taking. Due to instrument limitations in the buffer memory size and processing speeds, a careful selection of the available techniques must be made.

Irigoyen, R. E.↗

Utah FORGE: Seismic DAS and Geophone Borehole Data Processing and 3D Imaging of Vp/Vs Ratio in the 2024 Stimulated Reservoir

This dataset includes a final report and a 3D velocity model derived from seismic DAS and geophone borehole data collected during the April 2024 stimulation of the reservoir at Utah FORGE. The report details the processing of over 50,000 P- and S-wave travel times used in a tomographic inversion to estimate the Vp/Vs ratio, revealing anomalies adjacent to wells 16A and 16B that may be associated with injected fracturing fluids. Additionally, Wadati analysis of more than 27,000 pairs of differential P- and S-wave travel times supports this interpretation with a high Vp/Vs estimate of 1.86, averaged over the dimensions of the earthquake cluster. The accompanying data file provides a 3D model of P- and S-wave velocities and Vp/Vs ratios, structured with spatial coordinates and velocity values.

15 GEOTHERMAL ENERGY↗

WormBase in 2022—data, processes, and tools for analyzing Caenorhabditis elegans

WormBase (www.wormbase.org) is the central repository for the genetics and genomics of the nematode Caenorhabditis elegans. We provide the research community with data and tools to facilitate the use of C. elegans and related nematodes as model organisms for studying human health, development, and many aspects of fundamental biology. Throughout our 22-year history, we have continued to evolve to reflect progress and innovation in the science and technologies involved in the study of C. elegans. We strive to incorporate new data types and richer data sets, and to provide integrated displays and services that avail the knowledge generated by the published nematode genetics literature. Here, we provide a broad overview of the current state of WormBase in terms of data type, curation workflows, analysis, and tools, including exciting new advances for analysis of single-cell data, text mining and visualization, and the new community collaboration forum. Concurrently, we continue the integration and harmonization of infrastructure, processes, and tools with the Alliance of Genome Resources, of which WormBase is a founding member.

59 BASIC BIOLOGICAL SCIENCES↗

Development of multiple source data processing for structural analysis at a regional scale

Various image processing techniques developed for enhancement and extraction of linear features, of interest to the structural geologist, from digital remote sensing, geologic, and gravity data, are presented. These techniques include: (1) automatic detection of linear features and construction of rose diagrams from Landsat MSS data; (2) enhancement of principal structural directions using selective filters on Landsat MSS, Spacelab panchromatic, and HCMM NIR data; (3) directional filtering of Spacelab panchromatic data using Fast Fourier Transform; (4) detection of linear/elongated zones of high thermal gradient from thermal infrared data; and (5) extraction of strong gravimetric gradients from digitized Bouguer anomaly maps. Processing results can be compared to each other through the use of a geocoded database to evaluate the structural importance of each lineament according to its depth: superficial structures in the sedimentary cover, or deeper ones affecting the basement. These image processing techniques were successfully applied to achieve a better understanding of the transition between Provence and the Pyrenees structural blocks, in southeastern France, for an improved structural interpretation of the Mediterranean region.

Carrere, Veronique↗

Severe storms measurement system real time data processing and displays

The objectives of the system are to provide the system operator with real time system performance check and to provide data recording of all SSMS data. Meteorologists are provided with real time indication of meteorological data measurements including aid for directing flight profiles in real time and aid for directing SSMS operations. A day-to-day feedback is provided to meteorologists, system operators, and flight crews for flight planning on subsequent flight tests days.

Jeffreys, H. B.↗

SAR correlation technique - An algorithm for processing data with large range walk

This paper presents an algorithm for synthetic aperture radar (SAR) azimuth correlation with extraneously large range migration effect which can not be accommodated by the existing frequency domain interpolation approach used in current SEASAT SAR processing. A mathematical model is first provided for the SAR point-target response in both the space (or time) and the frequency domain. A simple and efficient processing algorithm derived from the hybrid algorithm is then given. This processing algorithm enables azimuth correlation by two steps. The first step is a secondary range compression to handle the dispersion of the spectra of the azimuth response along range. The second step is the well-known frequency domain range migration correction approach for the azimuth compression. This secondary range compression can be processed simultaneously with range pulse compression. Simulation results provided here indicate that this processing algorithm yields a satisfactory compressed impulse response for SAR data with large range migration.

Jin, M.↗

Fixed-Site KAZR b1 Data Processing Report: 2025

The U.S. Department of Energy’s Atmospheric Radiation Measurement (ARM) User Facility has been operating Ka-band ARM Zenith Radars (KAZRs) at each of its permanent observatories for at least the past 10 years. Data collected by the KAZRs is used to explore various cloud processes in different climatological regimes including marine stratocumulus clouds at the Eastern North Atlantic (ENA) site, arctic clouds at the North Slope of Alaska (NSA) site, and mid-latitude continental clouds at the Southern Great Plains (SGP) site.

54 ENVIRONMENTAL SCIENCES↗

Functional design for operational earth resources ground data processing

The author has identified the following significant results. Study emphasis was on developing a unified concept for the required ground system, capable of handling data from all viable acquisition platforms and sensor groupings envisaged as supporting operational earth survey programs. The platforms considered include both manned and unmanned spacecraft in near earth orbit, and continued use of low and high altitude aircraft. The sensor systems include both imaging and nonimaging devices, operated both passively and actively, from the ultraviolet to the microwave regions of the electromagnetic spectrum.

Baldwin, C. J.↗