Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data versions”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Ozone depletion at northern and southern latitudes derived from January 1979 to December 1991 Total Ozone Mapping Spectrometer data

An extended version of the Nimbus 7/TOMS ozone data set from the period January 1, 1979 to December 31, 1991 is presented. It is shown that the ozone-trend data indicate that regions of enhanced ozone depletion rates have formed at middle and high latitudes during recent years. The seasonal dependence and geographical extent of the enhanced ozone-depletion rates for the Northern and Southern hemispheres are examined. The variability of the long-term ozone trend determination is discussed via consideration of the differences among 11-, 12-, and 13-yr trend calculations. The effects of the Mount Pinatubo eruption and other volcanic eruptions on the TOMS equatorial zonal average ozone measurements, and its influence on long-term trend determinations are discussed. On the basis of a determination of the aerosol phase function using TOMS data, the effect of stratospheric aerosols on determination of ozone amounts from TOMS are shown to be less than 1 percent.

Herman, J. R.↗

Usability of an Updated Version of the Supplemental Data Service Provider-Consolidated Dashboard for Supporting Uncrewed Aircraft System Traffic Management

The Supplemental Data Service Provider-Consolidated Dashboard (SDSP-CD) is a preflight planning user interface (UI) that serves to aid operators when drafting routes for small uncrewed aircraft systems (sUASs). The primary function of the SDSP-CD is to identify hazards that an sUAS may encounter along a proposed flight path and assess the severity of these risks. A usability study was conducted on an updated version of the SDSP-CD to determine if the most recent iterations made to the system improved objective performance and subjective user experience. There are two main components of the SDSP-CD interface: (1) the dashboard and (2) the interactive map. The dashboard provides users with hazard and vehicle limitations for each sUAS in their fleet while the map contains a graphical representation of each vehicle’s route, hazard details, and geographic information. A series of preflight risk-assessment questions and tasks were developed to examine how participants interact with the updated version of the SDSP-CD. Additionally, a new service that measures vertiport congestion was developed and included as one of the services that was tested. In the present study, participants were trained to use the SDSP-CD and then completed two simulated scenarios during which they performed a variety of tasks, responded to questions, and completed surveys. The two scenarios developed for the present study were the Package Delivery and Hurricane Preparation scenarios. The Package Delivery scenario involved a fleet of four sUASs delivering low-stakes items (e.g., lunches and snacks) to people in a fictitious city. The Hurricane Preparation scenario involved a fleet of 11 sUASs delivering a range of supplies (from medicine to boardgames) to employees stranded at an office park due to road closures caused by an impending hurricane. Participants assumed the role of a fleet manager during both scenarios and were responsible for managing the sUASs in their fleet. Questions included those with objectively correct responses, open-ended strategy responses, and subjective user experience feedback. It was found that participants were largely successful at using the SDSP-CD interface to answer questions with objectively correct responses. Additionally, participants were able to use reasoning and logic based on the information available in the SDSP-CD to determine the cause of various risks and what actions they would consider taking. Finally, although participants reported that there were elements of the UI that could be improved, overall feedback pertaining to user experience suggested that the SDSP-CD concept is viable.

usability testing↗

The CDF software package

The concepts that are fundamental to the new Common Data Format are outlined. With Pilot Climate Data System (PCDS) Version 4.0, the Common Data Format (CDF) will supersede the Climate Data File (also CDF) or earlier versions. This new format incorporates generalizations in both design and terminology that make it applicable to multidisciplinary data sets. Furthermore, the new CDF will be made available to programmers as a software package that shields them from the low-level details of file formats. The CDF interface routines create an abstract conceptual environment for the scientific programmer. The principle concept for visualizing a CDF is known as the basic grid. A basic grid is an n-dimensional block by means of which a CDF is constructed. The size of the block may vary from one CDF to another, but is consistent within any individual CDF. Thus, the basic grid serves as a fundamental uniform building block for a CDF. The number of grid dimensions and the size of each dimension are chosen by the scientist/programmer to represent the patterns by which data are structured. The uniform grid structure appears to the programmer to be propagated into each record for each variable. The CDF stores a variable value for each lattice point of the grid for each record. These data values are inserted and retrieved simply by specifying the variable's identifier, a record number, and the indices that specify the lattice point of interest.

Wilson, C. E.↗

CALIPSO IIR Version 2 Level 1b Calibrated Radiances: Analysis and Reduction of Residual Biases in the Northern Hemisphere

Version 2 of the Level 1b calibrated radiances of the Imaging Infrared Radiometer (IIR) on board the Cloud-Aerosol Lidar and Infrared Satellite Observation (CALIPSO) satellite has been released recently. This new version incorporates corrections of small but systematic seasonal calibration biases previously revealed in Version 1 data products mostly north of 30° N. These biases – of different amplitudes in the three IIR channels 8.65 µm (IIR1), 10.6 µm (IIR2), and 12.05 µm (IIR3) – were made apparent by a striping effect in images of IIR inter-channel brightness temperature differences (BTDs) and through seasonal warm biases of nighttime IIR brightness temperatures in the 30–60° N latitude range. The latter were highlighted through observed and simulated comparisons with similar channels of the Moderate Resolution Imaging Spectroradiometer (MODIS) on board the Aqua spacecraft. To characterize the calibration biases affecting Version 1 data, a semi-empirical approach is developed, which is based on the in-depth analysis of the IIR internal calibration procedure in conjunction with observations such as statistical comparisons with similar MODIS/Aqua channels. Two types of calibration biases are revealed: an equalization bias affecting part of the individual IIR images and a global bias affecting the radiometric level of each image. These biases are observed only when the temperature of the instrument increases, and they are found to be functions of elapsed time since night-to-day transition, regardless of the season. Correction coefficients of Version 1 radiances could thus be defined and implemented in the Version 2 code. As a result, the striping effect seen in Version 1 is significantly attenuated in Version 2. Systematic discrepancies between nighttime and daytime IIR–MODIS BTDs in the 30–60° N latitude range in summer are reduced from 0.2 K in Version 1 to 0.1 K in Version 2 for IIR1–MODIS29. For IIR2–MODIS31 and IIR3–MODIS32, they are reduced from 0.4 K to close to zero, except for IIR3–MODIS32 in June, where the night-minus-day difference is around −0.1 K.

Garnier, Anne↗

CROCUS High-Frequency Measurements of CO₂, H₂O, Wind, and Temperature at University of Illinois Chicago

As of April 9, 2026: this dataset is currently being versioned to include data up to March 31, 2026. Once the versioning process is complete, new data files will be available for access. The dataset metadata will also be updated to reflect the data availability of the new data being versioned. Raw atmospheric measurements collected at the University of Illinois Chicago (UIC) as part of the Community Research on Climate and Urban Science (CROCUS) project. The data includes high-frequency measurements of carbon dioxide (CO₂) concentration, water vapor (H₂O) concentration, wind speed (U, V, W components), temperature, and atmospheric pressure. These raw data are recorded by the LI-7500DS Open Path CO₂/H₂O Analyzer and a sonic anemometer at a 10 Hz acquisition frequency, providing the necessary inputs for calculating fluxes of CO₂, H₂O, heat, and momentum. In addition to gas concentration measurements, the dataset includes diagnostic information from the instruments, including absorptance, sample and reference signals, and diagnostic values. The data were collected to study urban atmospheric conditions and contribute to flux calculations for urban climate research. These measurements form the basis for calculating 30-minute average fluxes of key atmospheric variables using the eddy covariance method. This dataset provides critical raw input data for researchers interested in atmospheric fluxes, urban air quality, and the interaction between the urban environment and atmospheric processes. The data is part of the U.S. Department of Energy’s Biological and Environmental Research (BER) program, under the CROCUS Urban Integrated Field Laboratory (UIFL) project.

54 ENVIRONMENTAL SCIENCES↗

Standardizing Interfaces for External Access to Data and Processing for the NASA Ozone Product Evaluation and Test Element (PEATE)

NASA's traditional science data processing systems have focused on specific missions, and providing data access, processing and services to the funded science teams of those specific missions. Recently NASA has been modifying this stance, changing the focus from Missions to Measurements. Where a specific Mission has a discrete beginning and end, the Measurement considers long term data continuity across multiple missions. Total Column Ozone, a critical measurement of atmospheric composition, has been monitored for'decades on a series of Total Ozone Mapping Spectrometer (TOMS) instruments. Some important European missions also monitor ozone, including the Global Ozone Monitoring Experiment (GOME) and SCIAMACHY. With the U.S.IEuropean cooperative launch of the Dutch Ozone Monitoring Instrument (OMI) on NASA Aura satellite, and the GOME-2 instrumental on MetOp, the ozone monitoring record has been further extended. In conjunction with the U.S. Department of Defense (DoD) and the National Oceanic and Atmospheric Administration (NOAA), NASA is now preparing to evaluate data and algorithms for the next generation Ozone Mapping and Profiler Suite (OMPS) which will launch on the National Polar-orbiting Operational Environmental Satellite System (NPOESS) Preparatory Project (NPP) in 2010. NASA is constructing the Science Data Segment (SDS) which is comprised of several elements to evaluate the various NPP data products and algorithms. The NPP SDS Ozone Product Evaluation and Test Element (PEATE) will build on the heritage of the TOMS and OM1 mission based processing systems. The overall measurement based system that will encompass these efforts is the Atmospheric Composition Processing System (ACPS). We have extended the system to include access to publically available data sets from other instruments where feasible, including non-NASA missions as appropriate. The heritage system was largely monolithic providing a very controlled processing flow from data.ingest of satellite data to the ultimate archive of specific operational data products. The ACPS allows more open access with standard protocols including HTTP, SOAPIXML, RSS and various REST incarnations. External entities can be granted access to various modules within the system, including an extended data archive, metadata searching, production planning and processing. Data access is provided with very fine grained access control. It is possible to easily designate certain datasets as being available to the public, or restricted to groups of researchers, or limited strictly to the originator. This can be used, for example, to release one's best validated data to the public, but restrict the "new version" of data processed with a new, unproven algorithm until it is ready. Similarly, the system can provide access to algorithms, both as modifiable source code (where possible) and fully integrated executable Algorithm Plugin Packages (APPs). This enables researchers to download publically released versions of the processing algorithms and easily reproduce the processing remotely, while interacting with the ACPS. The algorithms can be modified allowing better experimentation and rapid improvement. The modified algorithms can be easily integrated back into the production system for large scale bulk processing to evaluate improvements. The system includes complete provenance tracking of algorithms, data and the entire processing environment. The origin of any data or algorithms is recorded and the entire history of the processing chains are stored such that a researcher can understand the entire data flow. Provenance is captured in a form suitable for the system to guarantee scientific reproducability of any data product it distributes even in cases where the physical data products themselves have been deleted due to space constraints. We are currently working on Semantic Web ontologies for representing the various provenance information. A new web site focusing on consolidating informaon about the measurement, processing system, and data access has been established to encourage interaction with the overall scientific community. We will describe the system, its data processing capabilities, and the methods the community can use to interact with the standard interfaces of the system.

Tilmes, Curt A.↗

Soil Moisture Active/Passive (SMAP) L-Band Microwave Radiometer Post-Launch Calibration Upgrade

Current performance and existing problems in SMAP radiometer L1B_TB version 3 data product are described. The post-launch calibration algorithm has been updated by calibrating the three calibration parameters (the equivalent noise temperature of the noise diode, the offset of the reference load, and the antenna gain) jointly by using the global ocean and CS with both 110o and 180o pitch maneuvers after the reflector emissivity is calibrated. The results show that both calibration drift during eclipse season and bias over CS are removed. The RMSDs of the calibration drift over both the global ocean and CS are less than 0.1 K, and the goals of the calibration algorithm upgrade are achieved for coming L1B_TB version 4 data release.

Validation↗

Soil Moisture Active/Passive (SMAP) L-Band Microwave Radiometer Post-Launch Calibration Revisit: Approach and Performance

The soil moisture active passive (SMAP) microwave radiometer is a fully-polarimetric L -band radiometer flown on the SMAP satellite in a 6 AM /6 PM sun-synchronous orbit at 685-km altitude. After the SMAP L1B_TB data product version 4 was released in 2018, the radiometer has undergone further calibration and validation. The goal is to reduce the difference between antenna temperature of ascending and descending orbits during the eclipse, and to reduce the dips in the calibration drift over the cold sky (CS) during the eclipse seasons in 2017 and 2018. The postlaunch calibration algorithm has been revisited by retrieving all of the calibration parameters simultaneously with two different options for the hot calibration source (the global ocean, or the radiometer internal reference load). The performance of the two options are compared here. The option with the radiometer internal reference load has been chosen by the SMAP science team for data release version 5. In addition, a correction offset is applied to the input signal to account for offsets during the early-mission stages with the SMAP synthetic aperture radar transmitter operating alongside the radiometer.

calibration↗

Monthly Oceanic Rainfall from TRMM Microwave Imager (TMI) Data

We evaluated the performance of the Tropical Rainfall Measuring Mission (TRMM) Microwave Imager (TMI) at-launch algorithm for monthly oceanic rain rate using two years (January 1998 - December 1999) of TMI data. The TMI at-launch algorithm is based on Wilheit et al.'s technique for estimating monthly oceanic rainfall that relies on histograms of multichannel microwave measurements. Comparisons with oceanic monthly rain rates derived from the Defense Meteorological Satellite Program (DMSP) F-13 and F-14 Special Sensor Microwave Imager (SSM/I) data show the average rain rates over the TRMM region (between 400S and 40N) are 3.0, 2.85 and 2.89 mm/day, respectively for F-13, F-14 and TMI. Based on the latest version of TB data (version 5), both rainrate and freezing height derived from TMI are similar to those from the F-13 and F-14 SSM/I data. However, regionally the differences are statistically significant at the 95% confidence. Three hourly monthly rainrates are also computed from 3-hourly TB histograms to examine the diurnal cycle of precipitation. Over most of the oceanic TRMM area, a distinct early morning rainfall peak is found. A harmonic analysis shows that the amplitude of the 12h harmonic is significant and comparable to that of the 24h harmonic.

Chang, Alfred T. C.↗

Validation of CALIPSO Lidar Observations Using Data From the NASA Langley Airborne High Spectral Resolution Lidar

This poster focuses on preliminary comparisons of data from the Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) instrument on the Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO) spacecraft with data acquired by the NASA Langley Airborne High Spectral Resolution Lidar (HSRL). A series of 20 aircraft validation flights was conducted from 14 June through 27 September 2006, under both day and night lighting conditions and a variety of aerosol and cloud conditions. This poster presents comparisons of CALIOP measurements of attenuated backscatter at 532 and 1064 nm and depolarization at 532 nm with near coincident measurements from the Airborne HSRL as a preliminary assessment of CALIOP calibration accuracy. Note that the CALIOP data presented here are the pre-release version. These data have known artifacts in calibration which have been corrected in the December 8 CALIPSO data release which was not available at the time the comparisons were conducted for this poster. The HSRL data are also preliminary. No artifacts are known to exist; however, refinements in calibration and algorithms are likely to be implemented before validation comparisons are made final.

Hostetler, Chris↗

Impact of Assimilating AIRS Cloud-Cleared Radiances on Atmospheric Dynamics and Boundary Layer Height at High Latitudes

High latitude weather forecasts, on scales ranging from mesoscale to synoptic, present difficulties due, in part, to the sparsity of conventional observations. In addition, the prevalence of extended low-level stratus cloud cover limits the use of infrared data, which are operationally assimilated only in areas unaffected by clouds. Use of cloud-cleared AIRS (Atmospheric Infrared Sounder) radiances (AIRS CCR), allows the assimilation of infrared information in cloudy regions, permitting data ingestion in regions usually undersampled. This study explores the sensitivity of planetary boundary layer height and related atmospheric dynamics to the assimilation of these data in the Goddard Earth Observing System (GEOS, version 5) data assimilation and forecast system during the boreal fall 2014 season using observing system experiments (OSEs). Examined here are comparisons between the current, operational approach of assimilating AIRS clear-sky radiances against the assimilation of CCR. Assimilation of hyperspectral infrared information from AIRS over the Arctic region slightly modifies the lower midtropospheric temperature structure, which in turn contributes to adjustments in geopotential height, affecting the baroclinic instability properties over the entire hemisphere and explaining the overall improvement in global forecast skill.

McGrath-Spangler, E. L.↗

Comparison of TOMS, SBW & SBUV/2 Version 8 Total Column Ozone Data with Data from Groundstations

The Nimbus-7 and Earth Probe Total Ozone Mapping Spectrometer (TOMS) data as well as SBUV and SBUV/2 data have been reprocessed with a new retrieval algorithm (Version 8) and an updated calibration procedure. An overview will be presented systematically comparing ozone values to an ensemble of Brewer and Dobson spectrophotometers. The comparisons were made as a function of latitude, solar zenith angle, reflectivity and total ozone. Results show that the accuracy of the TOMS retrieval has been improved when aerosols are present in the atmosphere, when snow/ice and sea glint are present, and when ozone in the northern hemisphere is extremely low. TOMS overpass data are derived from the single TOMS best match measurement, almost always located within one degree of the ground station and usually made within an hour of local noon. The Version 8 Earth Probe TOMS ozone values have decreased by an average of about 1% due to a much better understanding of the calibration of the instrument. N-7 SBUV as well as the series of NOAA SBUV/2 column ozone values have also been processed with the Version 8 algorithm and have been compared to values from an ensemble of groundstations. Results show that the SBW column ozone values agree well with the groundstations and the datasets are useful for trend studies.

Labow, G. J.↗

EP/TOMS Science Data Processing Programmer's Guide. Version 1.9

This EP/TOMS Programmer's Guide provides detailed information concerning the data, software, operations, and maintenance of the EP/TOMS Science Data Processing System. This system was developed for the NASA Goddard Space Flight Center (GSFC), Laboratory for Atmospheres, Atmospheric Chemistry Branch (Code 916) by SSAI. The description of the EP/TOMS Science Data Processing System starts with an overall system perspective (Section 3). A description of all data files ingested, stored, and/or produced follows in Section 4. Detailed descriptions of each major software subsystem are in Section 5. Section 6 presents processing procedures. Section 7 presents maintenance procedures. Procedures for updating this document are included in Section 7.

Source record↗

Arctic shrub root traits, northern Alaska, summer 2017 (Version 2.0)

This data package contains root trait data collected from 170 plots of rapidly expanding shrub genera (Alnus, Betula, and Salix) and a widespread sedge (Eriophorum vaginatum) along a latitudinal and temperature gradient in northern Alaska. The trait data were collected in July 2017 and include root architecture (root diameter and branching patterns), mycorrhizal colonization (%), nitrogen concentration (%), delta 15N (per mil), and vertical root biomass. These raw data support a submitted manuscript that examines the distribution and interspecific variations of absorptive root traits of shrubs and graminoids across the graminoid-dominated nutrient-poor arctic tundra and reveals how deciduous shrub expansion affects plant nutrient acquisition strategies in tundra ecosystems. Data are presented by site (n=5) and patch (shrub or sedge plot) in separate csv files. The location data are provided in the “plot coordinates” file; all other files contain the data in the file title. Detailed methods are in Chen et al. (2020).2023/07/20 Update: The latest version of this dataset publication is version 2.0. The latest version of the data package was updated to include the alder nodule biomass dataset (alder nodule biomass.csv) and associated metadata (metadata_alder nodule biomass.csv). The name of the previous metadata file was updated (metadata_ root traits and biomass.csv ) to distinguish it from the new metadata file.

54 ENVIRONMENTAL SCIENCES↗

Monthly Quality-filtered Aggregation of NOAA Climate Data Record (CDR) of AVHRR (Version 5) and VIIRS (Version 1) Leaf Area Index (LAI) and Fraction of Absorbed Photosynthetically Active Radiation (FAPAR)

This dataset contains gridded monthly Leaf Area Index (LAI) derived from the daily NOAA Climate Data Record (CDR) of AVHRR (Version 5) and VIIRS (Version 1) Leaf Area Index (LAI) and Fraction of Absorbed Photosynthetically Active Radiation (FAPAR). This data record spans from 1981 to 2024 using data from NOAA polar orbiting satellites: NOAA-7, -9, -11, -14, -16, -17, -18, -19 and S-NPP. The data are projected on a 0.05 degree x 0.05 degree global grid, as in the original CDR. The original CDR is one of the Land Surface CDR products produced by the NASA Goddard Space Flight Center (GSFC) and the University of Maryland (UMD), which is accompanied by algorithm documentation, data flow diagram and source code for the NOAA CDR Program. This dataset is in the netCDF-4 file format following ACDD and CF Conventions. This dataset has applied quality assurance information to only include "OK" data from the original CDR in the monthly aggregation.

Vermote, Eric [NASA Goddard Space Flight Center (G↗

High Performance Access to Archival Data Stored in HDF4 and HDF5 on Cloud Object Stores Without Reformatting the Files

Cloud computing offers numerous advantages for users of extensive Earth science data collections. These benefits encompass direct online access to data files and granules from any location, scalable access supporting parallel computing workflows, and flexible computing tools enabling innovative experimentation with processing techniques. However, older archival file formats designed for distinct computing systems hinder efficient access to decade-long time-series data when compared to data stored in modern cloud-optimized formats like Web Object Stores (WOS), exemplified by Amazon Web Services’ Simple Storage Service (S3). We describe DMR++ (Dataset Metadata Response plus plus), a technology facilitating efficient access to HDF5 (Hierarchical Data Format, version 5) and HDF4 files stored on WOS systems without requiring data reformatting. DMR++ achieves performance comparable to technologies like Zarr while preserving the original file structure, a substantial benefit considering the vast quantity of archival files held by organizations such as NASA. Moreover, DMR++ typically outperforms cloud-optimized versions of HDF5. Essentially an XML (Extensible Markup Language) document usually stored alongside the described data, DMR++ can also be generated on-the-fly but is generally created during data staging to the WOS. Archival files that use HDF4/5 often store large arrays of numerical data. The data in these files is often compressed, typically reducing their size by a factor of four or more. To achieve efficient access to portions of those arrays, they are 'chunked' into smaller sub-arrays, each individually compressed. The chunk size is a compromise, where spinning disks can efficiently access data in smaller chunks while S3 favors larger chunks. A simple optimization of aggregating smaller chunks that are stored adjacently, transferring them in a single access and then individually decompressing them will improve performance. NASA data pose an additional challenge: special Application Programmer Interface (API) libraries are often needed to compute some variables. These libraries are incompatible with WOS environments. Our solution involves storing computed values in the DMR++ document or a companion file, making them accessible like other variables and eliminating the need for specialized APIs. We outline specific optimizations for both satellite grid and swath data stored in HDF4-EOS2 (Earth Observing System).

James Gallagher↗

Status of the Shuttle SBUV (SSBUV) calibration of the NOAA SBUV/2 operational ozone sounders and the detection of trends

The Shuttle Solar Backscatter Ultraviolet (SSBUV) experiment has flown four times since October 1989. The purpose of SSBUV is to perform calibration checks of the SBUV ozone sounding instruments on the Nimbus and NOAA satellites in order to remove calibration drift so that ozone trends in the middle stratosphere can be accurately derived. Calibration checks are performed by comparing coincident observations between SSBUV and the satellite instruments. Regular flights of about once per year and maintenance of the SSBUV calibration to 1 percent from flight to flight are the major challenges for SSBUV. To date the required flight frequency has been met and instrument calibration is known to about 1-2 percent for the first three flights. The first comparisons showed 30 percent differences between SSBUV and the original archived Nimbus SBUV data, but considerably smaller differences with the new SBUV 'Version 6' data. Differences between SSBUV and SBUV/2 instruments on NOAA-11 and NOAA-9 were of the order of 5-10 percent respectively. These differences have not been accounted for in the present NOAA data set since they contain initial calibration biases as well as long term instrument drift. With subsequent SSBUV comparisons, the satellite calibration can be corrected, which will then allow an accurate estimate of ozone trends in the upper stratosphere. In this initial study, 1989 Nimbus-7 SBUV data have been corrected using SSBUV observations and then compared to SBUV data for 1980. This comparison then leads to an ozone trend of 7 percent in the upper stratosphere over the tropics for the period 1980 to 1989.

Hilsenrath, Ernest↗