SEARCH · Engineering Papers

Results for “Raw Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

All sources NASA NTRS DOE OSTI

NASA NTRS1993

Data processing and calibration for tunable diode laser harmonic absorption spectrometers

Data processing and calibration methods are described for tunable diode laser absorption spectrometers which produce harmonic absorption spectra as raw data for measuring gas mixing ratios down to parts-per-trillion levels at a variety of pressures. The methods, which take advantage of modern computer speed, memory, and data storage capabilities, are applicable to the detection of weakly absorbing gases in quantitative industrial monitoring, in addition to aircraft and balloon atmospheric measurements for which they were designed. Algorithms for calibration and data analysis, including rejection of erroneous spectra, variation of effective integration time, spectral alignment prior to averaging, and plotting and archiving of results, have been tested on actual stratospheric laser spectra recorded by the Aircraft Laser Infrared Absorption Spectrometer (ALIAS) spectrometer in numerous flights of NASA's ER-2 aircraft.

May, Randy D.↗

NASA NTRS2019

The Joint ESA/NASA Galileo/GPS Receiver Onboard the ISS – the GARISS Project

ESA and NASA conducted a joint Galileo/GPS space receiver experiment on-board the International Space Station (ISS). The objectives (Enderle 2017) of the joint project were to demonstrate the robustness of a combined Galileo/GPS waveform uploaded to NASA hardware already operating in the challenging space environment - the SCaN (Space Communications and Navigation) software defined radio (SDR) testbed (FPGA) - on-board the ISS. These activities data included the analysis of the Galileo/GPS signal and on-board Position/Velocity/Time (PVT) performance, processing of the Galileo/GPS raw data (code- and carrier phase) for Precise Orbit Determination (POD), and validate the added value of a space-borne dual GNSS receiver compared to a single-system GNSS receiver operating under the same conditions. This paper will provide a general overview of the Galileo/GPS experiment – called GARISS - on-board the ISS, describe design, test and validation and also the operations of the experiment. Further, the various analysis conducted in the con is joint project and also the results obtained will be presented with a focus on the (Precise) Orbit Determination results.

Enderle, Werner↗

NASA NTRSDate not supplied

Introduction to the JPSS-2 Advanced Technology Microwave Sounder (ATMS) Government Calibration Data Book (GCDB)

The third Advanced Technology Microwave Sounder (ATMS) is an instrument onboard the Joint Polar Satellite System (JPSS), JPSS-2 (renamed NOAA-21 in orbit) mission. This report is to introduce the JPSS-2 Government Calibration Data Book (J2 GCDB) for ATMS, SN 304. This J2 GCDB document contains key information generated during the calibration testing campaign that is driving parameters for radiometric performance. This document also contains supporting data that augments the calibration results. The values in this document are utilized by ATMS’s calibration packet which is, in turn, an integral component in the interpretation of science data. The calibration data in this report was collected from tests such as shelf-level testing, antenna testing, instrument thermal vacuum (TVAC) testing; satellite TVAC testing; and JPSS-2 post-launch tests. JPSS-2 was launched on November 10, 2022. In the subsequent years, the Government will release an ATMS GCDB for each JPSS mission. We expect that all public users can download these ATMS GCDBs from the NOAA operational Integrated Calibration and Validation System (ICVS) website, see more discussions below. The goal of this GCDB is to demonstrate how to characterize ATMS measurements using JPSS-2 ATMS on-orbit operational data and to provide relevant explanations. This document serves as a primary public domain reference for calibrating operational ATMS Raw Data Records (RDR) science data, as used in the current operational Interface Data Processing Segment (IDPS) system. This same RDR science data is distributed through direct broadcast (DB) to DB users for use in their ground processing systems. This J2 GCDB provides the results of the ATMS system radiometric calibration, the antenna flat reflector emissivity [1], the antenna pattern measurements, the antenna pattern corrected brightness temperature [2], the brightness temperature of the lunar disk [3], Lunar Intrusion (LI) correction algorithm [4], receiver spectral parameters, and mechanical alignment on-orbit pointing results, and the striping effect appeared significantly in S-NPP on-orbit radiance data when the data are compared to the Radiative Transfer Model (RTM) simulation in numerical weather prediction (NWP) system [5]. It also provides the parameters required for conversion of telemetry counts to engineering units, for radiometric calibration, and for antenna beam geo-location. Moreover, it provides JPSS-2 ATMS Spectral Response Functions data, some additional information related to ATMS on-orbit performance, on-orbit lunar intrusion correction parameters and Earth contamination bias, and on how to derive ATMS RDR, antenna Temperature Data Records (TDR), and Sensor Data Records (SDR). Furthermore, an introduction of NOAA operational Integrated Calibration and Validation System (ICVS) website and services is added in this J2 GCDB. This ICVS hosts a long-term monitoring system which allows to visualization and comparison of data from JPSS missions, NOAA legacy Polar Operational Environmental Satellites (POES), and Geostationary Operational Environmental Satellites (GOES). From NOAA Comprehensive Large Array-data Stewardship System (CLASS), the public users can download all JPSS ATMS data products for all JPSS missions.

Microwave Sounder↗

DOE OSTI2022

Maintaining Trust in Reduction: Preserving the Accuracy of Quantities of Interest for Lossy Compression

As the growth of data sizes continues to outpace computational resources, there is a pressing need for data reduction techniques that can significantly reduce the amount of data and quantify the error incurred in compression. Compressing scientific data presents many challenges for reduction techniques since it is often on non-uniform or unstructured meshes, is from a high-dimensional space, and has many Quantities of Interests (QoIs) that need to be preserved. To illustrate these challenges, we focus on data from a large scale fusion code, XGC. XGC uses a Particle-In-Cell (PIC) technique which generates hundreds of PetaBytes (PBs) of data a day, from thousands of timesteps. XGC uses an unstructured mesh, and needs to compute many QoIs from the raw data, f.One critical aspect of the reduction is that we need to ensure that QoIs derived from the data (density, temperature, flux surface averaged momentums, etc.) maintain a relative high accuracy. We show that by compressing XGC data on the high-dimensional, nonuniform grid on which the data is defined, and adaptively quantizing the decomposed coefficients based on the characteristics of the QoIs, the compression ratios at various error tolerances obtained using a multilevel compressor (MGARD) increases more than ten times. We then present how to mathematically guarantee that the accuracy of the QoIs computed from the reduced f is preserved during the compression. We show that the error in the XGC density can be kept under a user-specified tolerance over 1000 timesteps of simulation using the mathematical QoI error control theory of MGARD, whereas traditional error control on the data to be reduced does not guarantee the accuracy of the QoIs.

Gong, Qian↗

NASA NTRS1975

Hypersonic research engine project. Phase 2: Aerothermodynamic Integration Model (AIM) data reduction computer program, data item no. 54.16

The data reduction program used to analyze the performance of the Aerothermodynamic Integration Model is described. Routines to acquire, calibrate, and interpolate the test data, to calculate the axial components of the pressure area integrals and the skin function coefficients, and to report the raw data in engineering units are included along with routines to calculate flow conditions in the wind tunnel, inlet, combustor, and nozzle, and the overall engine performance. Various subroutines were modified and used to obtain species concentrations and transport properties in chemical equilibrium at each of the internal and external engine stations. It is recommended that future test plans include the configuration, calibration, and channel assignment data on a magnetic tape generated at the test site immediately before or after a test, and that the data reduction program be designed to operate in a batch environment.

Gaede, A. E.↗

NASA NTRS1981

Delineation of soil temperature regimes from HCMM data

Supplementary data including photographs as well as topographic, geologic, and soil maps were obtained and evaluated for ground truth purposes and control point selection. A study area (approximately 450 by 450 pixels) was subset from LANDSAT scene No. 2477-17142. Geometric corrections and scaling were performed. Initial enhancement techniques were initiated to aid control point selection and soils interpretation. The SUBSET program was modified to read HCMM tapes and HCMM data were reformated so that they are compatible with the ORSER system. Initial NMAP products of geometrically corrected and scaled raw data tapes (unregistered) of the study were produced.

Day, R. L.↗

NASA NTRS1999

The Design of a Remote Sensing Data Acquisition Campaign for Precision Agriculture and Some Early Results

In the 1970s NASA and the Department of Agriculture attempted to use the new Landsat MSS system for agricultural purposes. The program had relatively little success. With the advent of differential GPS, yield monitors on harvest equipment and higher spatial resolution remote sensing systems it seemed likely the situation should be reexamined. Therefore, a campaign of data acquisition involving remote sensing and other modalities with dependent research was assembled and funded by the Space Grant Consortia in Alabama and Georgia. The design of the remote sensing data acquisition was driven by the biology and physics of the crop system and limited by the available sensor platforms. Major parameters included crop stage, spatial resolution, seasonal and daily weather conditions, and which portion of the EM spectrum would actually capture the most discriminating information. Joint visible and Near IR with Thermal IR would permit use of existing indices, such as greenness, as well as phenomena driven by the plant' s evapotranspiration. Spatial resolution in the 2-5 meter range was chosen, avoiding many complexities caused by aliasing crop row spacing at, higher resolutions yet finer than the harvester's tightest recording rate. This dictates use of an airborne system. Use of an airborne system also makes scheduling around weather much simpler than use of satellite data. Active video calibration was recognized as essential if quantitative measures were ever to be obtained or reproduced. The system would also have to have onboard geoOF1 Based on these elements 3 data acquisitions have been flown. Seven flight lines were flown twice in 1998 and 16 lines flown in 1999. Total raw data is several GBytes. All of the data has now been geometrically corrected and some preliminary analysis accomplished. The thermal bands have an extremely high correlation with yield. For one@test case with corn, correlation in excess of 0.86 was obtained from a data acquisition two months prior to harvest! Soil images show significant within field variation in clay, soil brightness and emissivity. Light wind has been found to effect the reflectance and temperature of broad leaf crops, including soybeans, cotton and peanuts. Clearly, this work has already demonstrated some very important results. With continued development of the remote sensing technology there is good reason to believe this research will soon be able to help the individual farmer.

Rickmanl, D.↗

NASA NTRS2002

Description of Data Archiving Activities

Simmons, K. E.↗

NASA NTRS2002

Description of Data Archiving Associated With the NASA Goddard Grant NAGS-9590

Data restoration and archiving activities for this project have resulted in the restoration of 100% of the original Mariner 9 raw data set as well as many of the secondary analysis data sets. These data sets have been submitted to the Planetary Data System (PDS) Atmospheric Node, along with their PDS labels and descriptive metadata. In addition, a useful visualization and analysis tool has also been developed which allows the user to compare these Mariner 1971 Ultraviolet spectral data with several choices of related data sets: Mariner 9 images, USGS geologic data, MGS MOLA topography, Viking images (Viking MDIM) and thermal inertia data (MGS TES).

Simmons, K. E.↗

NASA NTRS2002

Characterizing the Oxidizing Properties of Mars' Polar Regions

This project had two primary goals. The first was to restore and archive the Ultraviolet Spectrometer (UVS) data from the 1971 Mariner 9 (MM71) mission to Mars. The second was to use this revised data set to analyze data of Mars' polar regions to look for and map out the ozone (03) and hydrogen peroxide (H2O2,) features. Data restoration and archiving activities for this project have resulted in the restoration of 100% of the original Mariner 9 raw data set as well as many of the secondary analysis data sets. These data sets have been submitted to the Planetary Data System (PDS) Atmospheric Node, long with their PDS labels and descriptive metadata.

Hendrix, Amanda↗

NASA NTRS2024

Single Drop Cytometry Onboard the International Space Station

Real-time lab analysis is needed to support clinical decision making and research on human missions to the Moon and Mars. Powerful laboratory instruments, such as flow cytometers, are generally too cumbersome for spaceflight. Here, we show that scant test samples can be measured in microgravity, by a trained astronaut, using a miniature cytometry-based analyzer, the rHEALTH ONE, modified specifically for spaceflight. The base device addresses critical spaceflight requirements including minimal resource utilization and alignment-free optics for surviving rocket launch. To fully enable reduced gravity operation onboard the space station, we incorporated bubble-free fluidics, electromagnetic shielding, and gravity-independent sample introduction. We show microvolume flow cytometry from 10 μL sample drops, with data from five simultaneous channels using 10 μs bin intervals during each sample run, yielding an average of 72 million raw data points in approximately 2 minutes. We demonstrate the device measures each test sample repeatably, including correct identification of a sample that degraded in transit to the International Space Station. This approach can be utilized to further our understanding of spaceflight biology and provide immediate, actionable diagnostic information for management of astronaut health without the need for Earth-dependent analysis.

Daniel J. Rea↗

NASA NTRS1984

Utilization of spaceborne SAR data for mapping

Recent developments in automated processing of digital SEASAT SAR imagery have made feasible the generation of large-scale high-resolution maps. Standard preprocessing of raw data into digital images results in geometrically distorted imagery. Computer algorithms have been developed for unsupervised pixel location, geometric rectification, and mosaicking of multiple-image frames without ground control points. These algorithms utilize knowledge of the spacecraft trajectory data, the imaging geometry, and the coherent properties of the sensor to generate the required processing parameters. This paper discusses the advantages as well as the inherent limitations of this technique, analyzes the associated errors, and presents results using SEASAT SAR imagery. Also discussed are the results of the recent shuttle imaging radar (SIR-A) experiment as well as a follow-on experiment (SIR-B) planned for 1984.

Curlander, J. C.↗

NASA NTRS1986

Space Research Data Management in the National Aeronautics and Space Administration

Space related scientific research has passed through a natural evolutionary process. The task of extracting the meaningful information from the raw data is highly involved and will require data processing capabilities that do not exist today. The results are presented of a three year examination of this subject, using an earlier report as a starting point. The general conclusion is that there are areas in which NASA's data management practices can be improved and recommends specific actions. These actions will enhance NASA's ability to extract more of the potential data and to capitalize on future opportunities.

Ludwig, G. H.↗

DOE OSTI2021

Parallelizing the Unpacking and Clustering of Detector Data for Reconstruction of Charged Particle Tracks on Multi-core CPUs and Many-core GPUs

We present results from parallelizing the unpacking and clustering steps of the raw data from the silicon strip modules for reconstruction of charged particle tracks. Throughput is further improved by concurrently processing multiple events using nested OpenMP parallelism on CPU or CUDA streams on GPU. The new implementation along with earlier work in developing a parallelized and vectorized implementation of the combinatoric Kalman filter algorithm has enabled efficient global reconstruction of the entire event on modern computer architectures. We demonstrate the performance of the new implementation on Intel Xeon and NVIDIA GPU architectures.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2022

Real-Time Interactive 4D-STEM Phase-Contrast Imaging From Electron Event Representation Data: Less computation with the right representation

The arrival of direct electron detectors (DED) with high frame-rates in the field of scanning transmission electron microscopy has enabled many experimental techniques that require collection of a full diffraction pattern at each scan position, a field which is subsumed under the name four dimensional-scanning transmission electron microscopy (4D-STEM). DED frame rates approaching 100 kHz require data transmission rates and data storage capabilities that exceed commonly available computing infrastructure. Current commercial DEDs allow the user to make compromises in pixel bit depth, detector binning or windowing to reduce the per-frame file size and allow higher frame rates. This change in detector specifications requires decisions to be made before data acquisition that may reduce or lose information that could have been advantageous during data analysis. The 4D Camera, a DED with 87 kHz frame-rate developed at Lawrence Berkeley National Laboratory, reduces the raw data to a linear-index encoded electron event representation (EER). Here we show with experimental data from the 4D Camera that linear-index encoded EER and its direct use in 4D-STEM phase contrast imaging methods enables real-time, interactive phase-contrast from large-area 4D-STEM datasets. Furthermore, we detail the computational complexity advantages of the EER and the necessary computational steps to achieve real-time interactive ptychography and center-of-mass differential phase contrast using commonly available hardware accelerators.

4D-STEM↗

DOE OSTI2025

Dataset for manuscript "Equipartition and the temperature of maximum density of TIP4P/2005 water"

We simulate TIP4P/2005 water in the temperature range of 257 K to 318 K with time-steps 0.25, 0.50, 1.00, 2.00, and 4.00 fs. The density-temperature behavior obtained using 0.25 or 0.50 fs are in excellent agreement with each other but differ from those obtained using time-steps that have been shown earlier to lead to a breakdown of equipartition. The temperature of maximum density (TMD) is 277.15 K with time-step 0.25 or 0.50 fs, but is shifted to progressively lower values for longer time-steps, a trend that holds for different thermostat/barostat combinations. Enhancing the water-water dispersion interaction, as has been recommended for simulating disordered proteins in TIP4P/2005, degrades the description of the liquid-vapor phase envelope. We present a simple physically transparent reasoning to highlight the separation of the time-scales between translational and rotational motion. We also develop a metric, Chi, that we term the equipartition anomaly, to detect equipartition violations in simulations that include molecules that are treated as rigid objects. Calculating Chi is shown to be straightforward and sensitive to equipartition violations. A key takeaway from this study is that using sufficiently short time-steps (less than or equal to 0.5 fs) to preserve equipartition is essential for obtaining meaningful liquid water properties and for producing reliable simulation data, as correct-ensemble sampling is fundamental to ensure reproducibility across codes and simulation alogrithms. The included dataset provides the raw data used in the preparation of the graphs noted in the manuscript.

36 MATERIALS SCIENCE↗

DOE OSTI2023

Carbon dioxide (CO2) flux, amplicon sequencing and liquid chromatography–mass spectrometry (LC-MS) data for pyrogenic organic matter (PYOM) amended soil incubations in lab, Madison, WI, 2021-22

This dataset comprises soil-pyrogenic organic matter (PyOM) incubation experiments conducted in a laboratory setting. The focus was on measuring carbon dioxide (CO2) flux emitted in the headspace of incubation jars over a one-month period. The aim was to estimate carbon mineralization from two different carbon fractions in PyOM, as well as carbon mineralization from soil organic carbon (SOC). Bacterial and fungal community profiles were tracked at various time points during the incubation to observe changes in the overall community and specific responders to PyOM. LC-MS analysis of soil samples was also performed to monitor changes in the soil's chemical composition.The provided dataset includes processed CO2 flux measurements obtained from the Picarro-multiplexer measurement setup for each sample incubation jar. This data is available in the "CO2Flux.csv" file. Additionally, the dataset includes CO2 flux data partitioned to estimate mean carbon mineralization from the two PyOM carbon fractions, bulk PyOM, and SOC. The cumulative carbon mineralization data is provided in "cml_respired.csv," while the rate of carbon mineralization data is in "rate_respired.csv." The file "cml_respired_lastcyc.csv" contains cumulative carbon mineralization data for the PyOM carbon fractions, bulk PyOM, and SOC throughout the entire incubation period.For the LC-MS analysis, the raw data can be found in the "20220721_NZ_PeakHeights_FinalAnalysis.csv" file, while sample metadata is provided in "20220721_NZpilot_Metadata.csv". Processed LC-MS data is available in the file "20220721_NZ_FINAL_msdat_sub3.csv". Lastly, the dataset includes the relative abundance data for bacterial genera that exhibited a significant positive response to the addition of PyOM produced at 350 degrees Celsius, which can be found in "resp_genera_350.csv".

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

COMBLE Radar b1 Processing: Corrections, Calibrations, and Processing Report

The U.S. Department of Energy’s (DOE) Atmospheric Radiation Measurement (ARM) user facility recently concluded its Cold-Air Outbreaks in the Marine Boundary Layer Experiment (COMBLE), with its campaign emphasis on marine boundary-layer clouds and mixed-phase clouds during cold-air outbreaks. The COMBLE campaign featured the deployment of the first ARM Mobile Facility (AMF1) to northern Scandinavia (Andenes, Norway), including its standard complement of ARM cloud radars. In keeping with user demands stemming from the previous AMF Cloud, Aerosol, and Complex Terrain Interactions (CACTI) field campaign in Argentina, a post-campaign radar mentor effort was initiated for COMBLE. This activity was intended to improve the usability of the ARM cloud radar data sets in response to overall demands for calibrated, corrected data sets for downstream studies and retrieval applications. In addition to the terrain complexities previously important to CACTI data sets (e.g., clutter designation and/or removal), COMBLE presented new challenges to existing ARM radar mentor capabilities. These included the extension of existing methodologies (e.g., relative calibration adjustment [RCA] target techniques) to frozen environments and the potential issues with their applicability when considering mixed-phase precipitation conditions. As in the previous CACTI documentation (Hardin et al. 2020), the overall calibration and conditioning process in ARM nomenclature is referred to as generating a “b1” datastream. For the radars, these “b1” standards refer to a datastream that has been calibrated (and cross-calibrated), with effort to deliver the highest-quality (well-characterized) data possible. The “b1” radar mentor reporting (this current document) is intended to detail (i) the status/quality of the original “a1” (raw) data sets during the COMBLE AMF campaign, (ii) the corrections and calibrations that are applied to generate the b1 datastreams available on ARM’s Data Discovery, and (iii) the details of the applied methods, e.g., how radar offset/calibration numbers were determined.

54 ENVIRONMENTAL SCIENCES↗