Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data product”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,657 records · Page 92

Maps of the Magellanic clouds from combined South Pole Telescope and Planck data

Here, we present maps of the Large and Small Magellanic Clouds from combined South Pole Telescope (SPT) and Planck data. Both instruments are designed to make measurements of the cosmic microwave background but are sensitive to any source of millimeter-wave (mm-wave) emission. The Planck satellite observes in nine mm-wave bands, while the SPT data used in this work were taken with the three-band SPT-SZ camera. The SPT-SZ bands correspond closely to three of the nine Planck bands, namely those centered at 1.4, 2.1, and 3.0 mm. The angular resolution of the Planck data in these bands ranges from 5 to 10 arcmin, while the SPT resolution in these bands ranges from 1.0 to 1.7 arcmin. The combined maps take advantage of the high resolution of the SPT data and the long-timescale stability of the space-based Planck observations to deliver high signal-to-noise and robust brightness measurements on scales from the size of the maps down to ~1 arcmin. In each of the three bands, we first calibrate and color-correct the SPT data to match the Planck data, then we use noise estimates from each instrument and knowledge of each instrument's beam, or point-spread function, to make the inverse-variance-weighted combination of the two instruments' data as a function of angular scale. Furthermore, we create maps assuming a range of underlying emission spectra (for the color correction) and at a range of final resolutions. We perform several consistency tests on the combined maps and estimate the expected noise in measurements of features in the maps. Finally, we compare the maps of the Large Magellanic Cloud (LMC) from this work to maps from the Herschel HERITAGE survey, finding general consistency between the datasets. Furthermore, the broad wavelength coverage provides evidence of different emission mechanisms at work in different environments in the LMC.

79 ASTRONOMY AND ASTROPHYSICS↗

An inconsistency in aviation emissions between CMIP5 and CMIP6 and the implications for short-lived species and their radiative forcing

We report on an inconsistency in the latitudinal distribution of aviation emissions between the data products of phases 5 and 6 of the Coupled Model Intercomparison Project (CMIP). Emissions in the CMIP6 data occur at higher latitudes than in the CMIP5 data for all scenarios, years, and emitted species. A comparative simulation with the chemistry–climate model ECHAM/MESSy Atmospheric Chemistry (EMAC) reveals that the difference in nitrogen oxide emission distribution leads to reduced overall ozone changes due to aviation in the CMIP6 scenarios because in those scenarios the distribution of emissions is partly shifted towards the chemically less active higher latitudes. The radiative forcing associated with aviation ozone is 7.6 % higher, and the decrease in methane lifetime is 5.7 % larger for the year 2015 when using the CMIP5 latitudinal distribution of emissions compared to when using the CMIP6 distribution. We do not find a statistically significant difference in the radiative forcing associated with aviation aerosol emissions. In total, future studies investigating the effects of aviation emissions on ozone and climate should consider the inconsistency reported here.

54 ENVIRONMENTAL SCIENCES↗

Use of remote sensing techniques for inventorying and planning utilization of land resources in South Dakota

The basic procedures for interpreting remote sensing imagery to rapidly develop general soils and land use inventories were developed and utilized in Pennington County, South Dakota. These procedures and remote sensing data products were illustrated and explained to many user groups, some of whom are interested in obtaining similar data. The general soils data were integrated with land soils data supplied by the county director of equalization to prepare a land value map. A computer print-out of this map indicating a land value for each quarter section is being used in tax reappraisal of Pennington County. The land use data provided the land use planners with the present use of land in Pennington County. Additional uses of remote sensing applications are also discussed including tornado damage assessment, hail damage evaluation, and presentation of soil and land value information on base maps assembled from ERTS-1 imagery.

Myers, V. I.↗

Weather data dissemination to aircraft

Documentation exists that shows weather to be responsible for approximately 40 percent of all general aviation accidents with fatalities. Weather data products available on the ground are becoming more sophisticated and greater in number. Although many of these data are critical to aircraft safety, they currently must be transmitted verbally to the aircraft. This process is labor intensive and provides a low rate of information transfer. Consequently, the pilot is often forced to make life-critical decisions based on incomplete and outdated information. Automated transmission of weather data from the ground to the aircraft can provide the aircrew with accurate data in near-real time. The current National Airspace System Plan calls for such an uplink capability to be provided by the Mode S Beacon System data link. Although this system has a very advanced data link capability, it will not be capable of providing adequate weather data to all airspace users in its planned configuration. This paper delineates some of the important weather data uplink system requirements, and describes a system which is capable of meeting these requirements. The proposed system utilizes a run-length coding technique for image data compression and a hybrid phase and amplitude modulation technique for the transmission of both voice and weather data on existing aeronautical Very High Frequency (VHF) voice communication channels.

Mcfarland, Richard H.↗

Earth Radiation Budget Experiment (ERBE) validation

During the past 4 years, data from the Earth Radiation Budget Experiment (ERBE) have been undergoing detailed examination. There is no direct source of groundtruth for the radiation budget. Thus, this validation effort has had to rely heavily upon intercomparisons between different types of measurements. The ERBE SCIENCE Team chose 10 measures of agreement as validation criteria. Late in August 1988, the Team agreed that the data met these conditions. As a result, the final, monthly averaged data products are being archived. These products, their validation, and some results for January 1986 are described. Information is provided on obtaining the data from the archive.

Barkstrom, Bruce R.↗

Calibration of the ER-2 meteorological measurement system

The Meteorological Measurement System (MMS) on the high altitude ER-2 aircraft was developed specifically for atmospheric research. The MMS provides accurate measurements of pressure, temperature, wind vector, position (longitude, latitude, altitude), pitch, roll, heading, angle of attack, angle of sideslip, true airspeed, aircraft eastward velocity, northward velocity, vertical acceleration, and time, at a sample rate of 5/s. MMS data products are presented in the form of either 5 or 1 Hz time series. The 1 Hz data stream, generally used by ER-2 investigators, is obtained from the 5 Hz data stream by filtering and desampling. The method of measurement of the meteorological parameters is given and the results of their analyses are discussed.

Bowen, Stuart W.↗

Calibration of NASA/JPL DC-8 SAR data

The paper describes a number of improvements in calibration of NASA/JPL DC-8 SAR (synthetic aperture radar) data, intended to make calibrated data from the system available to the majority of the investigators. The improvements include a move to a better site for calibration of the system at the start of each campaign season, the release of software to allow users to calibrate their data, the supply of trihedral corner reflectors and instructions on how to deploy them, and the setting up of an archive of calibrated data. Analysis of the calibration performance of the DC-8 SAR over a number of sites during 1990 suggests that the system is sufficiently stable to allow calibration of the standard data products without the presence of calibration devices within the scene. The limiting factor on DC-8 SAR data calibration would now appear to be the knowledge of the altitude of the aircraft, which determines the relationship between the measured slant range coordinates and the antenna pattern in elevation.

Freeman, A.↗

Chandra Serendipitous and Cycle 1 Targeted Surveys

A team led by scientists at the Chandra X-ray Center (CXC, formally known as the AXAF Science Center) is developing plans for a Serendipitous Survey using a selected subset of Chandra observations starting with Cycle 1. This survey will include two parts: (1) for sources sufficiently bright to be identified in available sky surveys (V approximately < 21), probable optical identifications and related imaging data will be, provided with the X-ray data as part of the Chandra data products. (2) at fainter flux X-ray source identifications will be determined from publically available, archival data and new optical imaging observations. We estimate that this survey will yield approximately 2500 source identifications in Cycle 1 down to X-ray flux levels approximately 10(exp -15) erg/sq cm.s and covering an area of sky approximately 10 sq degs. Optical spectroscopy and radio imaging will also be obtained for a subset of these sources. We are exploring appropriate ways to involve interested Chandra observers as well as other scientists in this survey project. A general overview of the various surveys which comprise a portion of the Chandra Cycle 1 GTO and GO programs and are not covered elsewhere in these proceedings will also be presented.

Wilkes, Belinda↗

BOREAS RSS-10 TOMS Circumpolar One-Degree PAR Images

The Boreal Ecosystem-Atmosphere Study (BOREAS) Remote Sensing Science (RSS)-10 team investigated the magnitude of daily, seasonal, and yearly variations of Photosynthetically Active Radiation (PAR) from ground and satellite observations. This data set contains satellite estimates of surface-incident PAR (400-700 nm, MJ/sq m) at one-degree spatial resolution. The spatial coverage is circumpolar from latitudes of 41 to 66 degrees north. The temporal coverage is from May through September for years 1979 through 1989. Eleven-year statistics are also provided: (1) mean, (2) standard deviation, and (3) coefficient of variation for 1979-89. The PAR estimates were derived from the global gridded ultraviolet reflectivity data product (average of 360, 380 nm) from the Nimbus-7 Total Ozone Mapping Spectrometer (TOMS). Image mask data are provided for identifying the boreal forest zone, and ocean/land and snow/ice-covered areas. The data are available as binary image format data files. The PAR data are available from the Earth Observing System Data and Information System (EOSDIS) Oak Ridge National Laboratory (ORNL) Distributed Active Archive Center (DAAC). The data files are available on a CD-ROM (see document number 20010000884).

Dye, Dennis G.↗

Applications for ICESat-2 Data

NASA;s Ice, Cloud, and Land Elevation Satellite-2 (ICESat-2) mission, scheduled to launch no later than April 2018 (and currently slated for October 2017), is being developed to continue the multiyear observations of the earths surface elevation, ice, and clouds started by ICESat. To increase the use of the satellite data after launch, the ICESat-2 mission invested in an applications program aimed at innovatively applying the data in a variety of fields. The program provides a framework for building a broad and well-defined user community during the prelaunch period to maximize the use of data products after launch and to provide early insight into the range of potential uses of the mission data. Ideas and research on how altimetry data will be used for decision making arise from the end users; there-fore, the ICESat-2 mission is extending itself through its applications program.

Brown, Molly E.↗

Generating Essential Climate Variables from Multiple Satellite Hyperspectral Remote Sensors

Hyperspectral observations from satellite-based sensors provide high information content for the Earth’s atmospheric and surface properties. Traditionally, long-term climate products are derived by performing spatial and temporal averaging of level-2 satellite products. There are two shortcomings of this approach. First, it is a time-consuming process to generate level-2 data products since modern hyperspectral satellite sensors have millions of observations each day with thousands of spectral channels for each observation. Secondly, differences in level-2 retrieval algorithms can lead to errors in the fused multi-satellite data. We have developed a radiometrically consistent spectral fingerprinting method, which overcomes the above-mentioned shortcomings, to derive climate change signals from multiple satellite sensors using spatiotemporally averaged level-1 data. We have applied this method to data collected from Atmospheric Infrared Sounder (AIRS) on Aqua satellite and Cross-track Infrared Sounder (CrIS) on SNPP and NOAA20 and generated decade-long climate data records for atmospheric temperature, water vapor, cloud, trace gases, and surface skin temperature. A key component to this work is a set of observational-based radiative kernels produced from CrIS level-1 data using a single field of view (SFOV) optimal estimation retrieval algorithm. Only limited CrIS level-1 data (e.g., 1-2 years of data) are needed to the derive radiative kernels. Our Principal Component-based Radiative Model (PCRTM) enables us to perform SFOV retrievals under all sky conditions and provides radiative kernels (including those for clouds) needed by the spectral fingerprinting method. In this presentation, we will describe the basic methodology, the details of the algorithm, and results from NASA Aqua AIRS and Suomi-NPP CrIS data. The method can be applied to study future hyperspectral remote sensors such as CLARREO (Climate Absolute Radiance and Refractivity Observatory) Pathfinder (CPF), Tropospheric Emissions: Monitoring of Pollution (TEMPO), Surface Biology and Geology (SBG), Atmosphere Observing System (AOS).

Xu Liu↗

Terra and Aqua MODIS Collection 7 Level 1B Algorithm

MODIS continues to be an important instrument for NASA’s Earth Observing System (EOS). Terra and Aqua MODIS have produced more than 22 and 20 years of global datasets that have significantly helped scientists better understand the Earth’s systems respectively. The MODIS Level-1B (L1B) algorithms use the uncalibrated, geolocated Earth scene observations as input and convert the instrument response into calibrated reflectance and radiance, which are used to generate the downstream science products. The sustained calibration and characterization activities undertaken by the MODIS Characterization Support Team have resulted in several upgrades to the L1B algorithms in order to maintain accurate calibration in the data products. In this paper, we present an overview of the L1B algorithm designated as Collection 7. Various algorithm enhancements both in the reflective bands and thermal bands characterization, are currently under science testing and evaluation. Once applied in data processing (projected in early 2023), they are expected to manifest in improved science products, both in terms of radiometric accuracy and long-term stability.

MODIS↗

Future Challenges for Nuclear Data Research in Fission

I describe some high priority research areas in nuclear fission, where applications in nuclear reactor technologies and in modeling criticality in general are demanding higher accuracies in our databases. Here, we focus on fission cross sections, fission neutron spectra, and fission product data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Micropulse Lidar Cloud Mask (MPLCMASK) Value-Added Product for the Fast-Switching Polarized Micropulse Lidar Technical Report

Lidar backscattered signal is a useful tool for identifying vertical cloud structure in the atmosphere in optically thin clouds. Cloud boundaries derived from lidar signals are a necessary input for popular ARM data products, such as the Active Remote Sensing of Clouds (ARSCL) product. An operational cloud boundary algorithm (Wang and Sassen 2001) has been implemented for use with the ARM Micropulse Lidar (MPL) systems. In addition to retrieving cloud boundaries above 500 m, the value-added product (VAP) named Micropulse Lidar Cloud Mask (MPLCMASK) applies lidar-specific corrections (i.e., range-square, background, deadtime, and overlap) as described in Campbell et al. (2002) to the measured backscattered lidar. Depolarization ratio is computed using the methodology developed by Flynn et al. (2007) for polarization-capable MPL systems. The cloud boundaries output from MPLCMASK will be the primary lidar cloud mask for input to the ARSCL product and will be applied to all MPL systems, including historical data sets.

54 ENVIRONMENTAL SCIENCES↗

Global Monitoring of Precipitation on Monthly and Shorter Time Scales Utilizing Low-Orbit and Geosynchronous Satellite Observations

A satellite-based system to monitor global precipitation on monthly and shorter time scales is described. The monitoring system is based primarily on the Global Precipitation Climatology Project (GPCP) global, monthly, 2.5 degree by 2.5 degree latitude-longitude product which utilizes precipitation estimates from low-orbit microwave sensors (SSM/I) and geosynchronous IR sensors and raingauge information over land. The low-orbit microwave estimates are used to adjust or correct the geosynchronous IR estimates, thereby maximizing the utility of the more physically-based microwave estimates and the finer time sampling of the geosynchronous observations. Information from raingauges is blended into the analyses over land. This globally complete, monthly product is available from January 1986 to the present, with an extension back to January 1979 underway using non-SSM/I data. The monthly GPCP merged data product described in the previous paragraph is available a few (2-4) months after the end of the month. An analysis based solely on low-orbit microwave (SSM/1) data and the Goddard Profiling (GPROF) algorithm is used to bring the global monitoring up to real time. Anomalies from climatological means are produced from both the GPCP and GPROF fields to monitor the evolution of global precipitation, including the calculation of ENSO precipitation indices for real-time (five- day running means) climate monitoring and comparison with previous ENSO anomalies. The long-term climatology of the global precipitation field and the time and space variations thereof will be discussed, including the variations associated with the 1997- 1998 ENSO. The GPCP fields will also be compared to analyses based on the recently launched Tropical Rain Measuring Mission (TRMM). On an even shorter time scale, a new daily, 1 degree x 1 degree latitude-longitude global analysis has been developed starting in January 1997 utilizing low-orbit microwave and geosynchronous IR information using a similar method as is used to produce the monthly GPCP product. Retaining the overall small bias of the monthly product the daily product will allow greater utilization in the hydrology and other science communities.

Adler, Robert↗

Mitigating Catastrophic Forgetting in Deep Learning in a Streaming Setting Using Historical Summary

Recent advancements in scientific equipment and the adaptation of electronics and the Internet of Things (IoT) in our everyday lives resulted in large and complex data production at a high rate. Making meaningful and timely knowledge discovery at a modest cost from this big data is difficult for computing power and storage limitations. Training deep learning models incrementally in a streaming setting can help us with overcoming these limitations. However, in a well-known phenomenon named catastrophic forgetting, incrementally trained models increasingly perform poorly on the past data. To mitigate catastrophic forgetting in training in a streaming setting, we propose constructing a historical summary over time and use the summary with newly arrived data during incremental training. We propose various data summarization techniques such as random sampling, micro clustering, coreset computation, and Auto Encoders to counteract catastrophic forgetting. We built a pipeline for incremental training with a historical summary for training deep learning models for streaming data. We demonstrate the effectiveness of historical summary in mitigating catastrophic forgetting using three case studies involving three different deep learning applications: an Artificial Neural Network (ANN) for classification task on MNIST dataset, a language model (RNN-LM) on the WikiText2 dataset, and a Convolutional Neural Network (CNN), ResNet50 to classify the ImageNet dataset. Through the training of the models, we observe that catastrophic forgetting is evident in ANN and CNN but not in an RNN. For the first task, our method recovers up to 47.9% lost accuracy due to catastrophic forgetting. For the third task, the historical summary recovers classification accuracy by up to 25%. For the second task, though there is not proof of catastrophic forgetting, the training performance (PPL) improves by up to 26% with historical summary.

Dash, Sajal↗

The ARM Data-oriented Metrics and Diagnostics Package for Climate Models - A New Tool for Evaluating Climate Models with Field Data

The U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) program User Facility produces ground-based long-term continuous unique measurements for atmospheric state, precipitation, turbulent fluxes, radiation, aerosol, cloud and the land surface, which are collected at multiple sites. These comprehensive datasets have been widely used to calibrate climate models and are proven to be invaluable for climate model development and improvement. This article introduces an evaluation package to facilitate the use of ground-based ARM measurements in climate model evaluation. The ARM data-oriented metrics and diagnostics package (ARM-DIAGS) includes both ARM observational datasets and a Python-based analysis toolkit for computation and visualization. The observational datasets are compiled from multiple ARM data products and specifically tailored for use in climate model evaluation. In addition, ARM-DIAGS also includes simulation data from models participating the Coupled Model Inter-comparison Project (CMIP), which will allow climate-modeling groups to compare a new, candidate version of their model to existing CMIP models. The analysis toolkit is designed to make the metrics and diagnostics quickly available to the model developers.

54 ENVIRONMENTAL SCIENCES↗

RC-SFA Data Management Templates and Guidance for Standardized, Reusable AI-Ready Data Packages

This data package provides templates and supporting documentation developed by the River Corridor Science Focus Area (RC-SFA; https://www.pnnl.gov/projects/river-corridor) to communicate its approach to managing and publishing AI-ready data. The package is intended to help data users and data producers understand the structures, metadata practices, and quality-control approaches that support consistent, reusable, and machine-actionable data products across RC-SFA studies. Rather than focusing on a single experimental dataset, this package documents the data management framework used to make RC-SFA data easier to find, ingest, navigate, and interpret. The materials in this package reflect RC-SFA practices for standardized data package organization, including the use of a human- and machine-readable README, file-level metadata, data dictionaries, descriptive file naming, method identifiers, and automated and review-based quality assurance procedures. Together, these components illustrate how RC-SFA extends FAIR data principles toward AI-readiness by prioritizing deep metadata, consistency across data packages, and support for informed downstream reuse by both humans and computational tools. This dataset is comprised of (1) readme; (2) presentation slides with an overview of RC-SFA approach and guidance; (3) document of RC-SFA best practices; (4) data dictionary (dd); (5) file level metadata (flmd); and a subfolder containing templates for dd and flmd. All files are .csv and .pdf. For details on how to navigate data packages generated by this project, see https://data.ess-dive.lbl.gov/portals/PNNLRiverCorridorSFA/About.

AI-readiness↗