Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data product”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,585 records · Page 88

Planck 2018 results - IV. Diffuse component separation

We present full-sky maps of the cosmic microwave background (CMB) and polarized synchrotron and thermal dust emission, derived from the third set of Planck frequency maps. These products have significantly lower contamination from instrumental systematic effects than previous versions. The methodologies used to derive these maps follow closely those described in earlier papers, adopting four methods (Commander, NILC, SEVEM, and SMICA) to extract the CMB component, as well as three methods (Commander, GNILC, and SMICA) to extract astrophysical components. Our revised CMB temperature maps agree with corresponding products in the Planck 2015 delivery, whereas the polarization maps exhibit significantly lower large-scale power, reflecting the improved data processing described in companion papers; however, the noise properties of the resulting data products are complicated, and the best available end-to-end simulations exhibit relative biases with respect to the data at the few percent level. Using these maps, we are for the first time able to fit the spectral index of thermal dust independently over 3° regions. We derive a conservative estimate of the mean spectral index of polarized thermal dust emission of β d = 1.55 ± 0.05, where the uncertainty marginalizes both over all known systematic uncertainties and different estimation techniques. For polarized synchrotron emission, we find a mean spectral index of β s = -3.1 ± 0.1, consistent with previously reported measurements. We note that the current data processing does not allow for construction of unbiased single-bolometer maps, and this limits our ability to extract CO emission and correlated components. The foreground results for intensity derived in this paper therefore do not supersede corresponding Planck 2015 products. For polarization the new results supersede the corresponding 2015 products in all respects.

79 ASTRONOMY AND ASTROPHYSICS↗

Synthesis of ARM User Facility Surface Rainfall Datasets to Construct a Best Estimate Value Added Product (PrecipBE)

Surface precipitation measurements are essential for Earth system model (ESM) evaluation and understanding cloud processes. An ever-growing need for robust, temporally evolving, and easy-to-use statistical datasets provides motivation for a baseline ground-based precipitation properties data product. The U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility operates an extensive suite of precipitation instruments with various sensitivities and operating mechanisms, which render the decision of which instrument to use based on one or more fixed thresholds challenging and prone to errors and bias. Using a long-term instrument inter-comparison from a unique per-precipitation event perspective, rather than instantaneous sample comparison, we demonstrate that ARM rainfall-measuring instruments are generally consistent with each other at the statistical level. Inter-instrument deviations at the single event level can be large, especially for specific rainfall event properties such as maximum precipitation rates. A machine-learning (ML) analysis using a random forest regressor indicates that in some cases, depending on instrument, local site climatology, and/or specific deployment configuration, certain atmospheric state variables influence the measured quantities in an unpredictable manner. Thus, a-priori weighting of different instruments does not necessarily lead to more accurate and less biased synthesis of instrument data. These results motivate the design of the ARM precipitation best-estimate (PrecipBE) value-added product, which incorporates all valid precipitation data while considering data quality and other instrument limitations. PrecipBE consists of time series and tabular statistics datasets in an easy-to-use and insightful per-precipitation event format. It provides a large set of precipitation event properties supplemented with ancillary data from ARM datasets that correspond to the detected precipitation events. We describe the PrecipBE algorithm and demonstrate its use via the examination of a single-day output as well as a long-term trend analysis of precipitation events at the ARM Southern Great Plains (SGP) site, covering more than 30 years of data. The trend analysis tentatively suggests a long-term temporal tendency for mainly shorter and less intense precipitation events at the SGP site, but a long-term increase in annual rainfall by more than 36 mm (5 %) per decade. This rainfall trend is catalyzed primarily by more extreme event properties of relatively rare, intense precipitation events, with event total and 1 min maximum precipitation rate at a 1 year timeframe increasing up to 5 mm and 9 mm h −1 (several percent) per decade, respectively. While the currently available PrecipBE datasets (at https://adc.arm.gov/discovery/, last access: 8 December 2025) cover rainfall from multiple ARM deployments up to March 2025, PrecipBE is planned to be expanded to include solid-phase precipitation and will soon become an operational product with a several-day lag from real-time. We invite the ARM user community to leverage this new product and welcome user feedback to further enhance the dataset.

Silber, Israel [Pacific Northwest National Laborat↗

Have Heat Waves Become More Intense and Frequent in North America in the Past 40 Years?

Extreme events, especially heat waves, have seemingly become more frequent and intense in the past decades worldwide, likely associated with global warming. This study uses the extreme detection indices product derived from the NASA Modern-Era Retrospective analysis for Research and Applications version 2 (MERRA-2) data to address whether heat waves have become more intense and frequent in North America in the past 40 years. We also examine in-depth the recent heat wave in June 2023 in Canada and the associated drought and wildfire events and compare them with previous years. We use additional data products in this study for cross-validation, including surface temperature from Phase 2 of the North American Land Data Assimilation System (NLDAS 2.0) and Atmospheric Infrared Sounder (AIRS) version 7, with a shorter data latency, only a few days. In addition, we will demonstrate how to efficiently conduct long-term time-series data analysis, which involves a large volume of data, using data services developed at NASA GES DISC, such as Giovanni, datarod, and Thematic Real-time Environmental Distributed Data Services (THREDDS) Data Server (TDS). These services can be used to visualize and explore extreme events, and to download only the data that is of interest.

Xiaohua Pan↗

Performance Analysis of Airborne Photon-Counting Lidar Data in Preparation for the ICESat-2 Mission

Two airborne photon-counting laser altimeters have been deployed in direct support of National Aeronautics and Space Adminsitration (NASA's) upcoming Ice, Cloud, and land Elevation Satellite-2 (ICESat-2) mission. Multiple Altimeter Beam Experimental Lidar (MABEL) was developed specifically for ICESat-2 testing and development. MABEL data are used to simulate key aspects of the ICESat-2 measurement strategy and are critical to the development of the algorithms for geophysical data-product generation. Slope Imaging Multipolarization Photon-counting Lidar (SIMPL) is a NASA Goddard Space Flight Center instrument that has also been deployed in support of ICESat-2 performance discovery. Both instruments are photon-counting, small footprint laser altimeters that sample in both the 532- and 1064-nm wavelengths. And both instruments serve as a proxy for ICESat-2 operational performance and error assessment and a basis for the development of potential validation strategies. This paper provides an overview of how data from MABEL and SIMPL overflights have specifically provided the foundation for understanding the quality of ICESat-2 data and how we can plan to evaluate ICESat-2 products through comparison with other modalities of lidar data and/or groundtruth locations using ground fiducials.

MABEL↗

Development and Testing of Nuclear Data Libraries for Improved Energy Deposition Modeling - Paper 144

Accurate calculations of local energy deposition rates require the presence of gamma production data (GPD) in the nuclear data library used by radiation transport codes such as MCNP5, MONACO, or Denovo. The lack of GPD in the underlying nuclear data library can cause significant over-prediction of local heat generation rates with a corresponding under-prediction of heat generation rates away from a region of interest. To address this concern, continuous energy (CE) and multigroup (MG) cross section libraries with additional GPD have been created. Both ACE- and AMPX-formatted CE libraries, as well as ANISN- and AMPX-formatted MG libraries, have been created and are undergoing verification and validation (V and V) testing. A hybrid data set consisting of cross-section evaluations from five different nuclear data repositories has been developed. This hybrid data set, referred to as GPD-Rev0, is intended to support enhanced energy deposition calculations. Code-specific libraries in CE ACE, CE AMPX, MG AMPX, and MG ANISN formats have been created from the GPD-Rev0 data set. V and V testing has demonstrated that these various code-specific libraries are performing well for the intended applications. Localized over- and under-predictions of HFIR heating rates have been addressed without adversely affecting the prediction of other key operating parameters. (authors)

61 RADIATION PROTECTION AND DOSIMETRY↗

Global-Scale Comparison of Passive (SMOS) and Active (ASCAT) Satellite Based Microwave Soil Moisture Retrievals with Soil Moisture Simulations (MERRA-Land)

Global surface soil moisture (SSM) datasets are being produced based on active and passive microwave satellite observations and simulations from land surface models (LSM). This study investigates the consistency of two global satellite-based SSM datasets based on microwave remote sensing observations from the passive Soil Moisture and Ocean Salinity (SMOS;SMOSL3 version 2.5) and the active Advanced Scatterometer (ASCAT; version TUWien- WARP 5.5) with respect to LSM SSM from the MERRA-Land data product. The relationship between the global-scale SSM products was studied during the 2010-2012 period using (1) a time series statistics (considering both original SSM data and anomalies), (2) a space-time analysis using Hovmoller diagrams, and (3) a triple collocation error model. The SMOSL3 and ASCAT retrievals are consistent with the temporal dynamics of modeled SSM (correlation R (is) greater than 0.70 for original SSM) in the transition zones between wet and dry climates, including the Sahel, the Indian subcontinent, the Great Plains of North America, eastern Australia, and southeastern Brazil. Over relatively dense vegetation covers, a better consistency with MERRA-Land was obtained with ASCAT than with SMOSL3. However, it was found that ASCAT retrievals exhibit negative correlation versus MERRA-Land in some arid regions (e.g., the Sahara and the Arabian Peninsula). In terms of anomalies, SMOSL3 better captures the short term SSM variability of the reference dataset (MERRA-Land) than ASCAT over regions with limited radio frequency interference (RFI) effects (e.g., North America, South America, and Australia). The seasonal and latitudinal variations of SSM are relatively similar for the three products, although the MERRALand SSM values are generally higher and their seasonal amplitude is much lower than for SMOSL3 and ASCAT. Both SMOSL3 and ASCAT have relatively comparable triple collocation errors with similar spatial error patterns: (i) lowest errors in arid regions (e.g., Sahara and Arabian Peninsula), due to the very low natural variability of soil moisture in these areas, and Central America, and (ii) highest errors over most of the vegetated regions (e.g., northern Australia, India, central Asia, and South America). However, the ASCAT SSM product is prone to larger random errors in some regions (e.g., north-western Africa, Iran, and southern South Africa). Vegetation density was found to be a key factor to interpret the consistency with MERRA-Land between the two remotely sensed products (SMOSL3 and ASCAT) which provides complementary information on SSM. This study shows that both SMOS and ASCAT have thus a potential for data fusion into long-term data records.

ASCAT↗

JPSS Science Data Services for the Direct Readout Community

The Suomi National Polar-orbiting Partnership (S-NPP) and Joint Polar Satellite System (JPSS) High Rate Data (HRD) link provides Direct Broadcast data to users in real-time, utilizing their own remote field terminals. The Field Terminal Support (FTS) provides the resources needed to support the Direct Readout communities by providing software, documentation, and periodic updates to enable them to produce data products from SNPP and JPSS. The FTS distribution server will also provide the necessary ancillary and auxiliary data needed for processing the broadcasts, as well as making orbital data available to assist in locating the satellites of interest. In addition, the FTS provides development support for the algorithm and software through GSFC Direct Readout Laboratory (DRL) International Polar Orbiter Processing Package (IPOPP) and University of Wisconsin (UWISC) Community Satellite Processing Package (CSPP), to enable users to integrate the algorithms into their remote terminals. The support the JPSS Program provides to the institutions developing and maintaining these two software packages, will demonstrate the ability to produce ready-to-use products from the HRD link and provide risk reduction effort at a minimal cost. This paper discusses the key functions and system architecture of FTS.

Data Processing↗

Addressing and Presenting Quality of Satellite Data via Web-Based Services

With the recent attention to climate change and proliferation of remote-sensing data utilization, climate model and various environmental monitoring and protection applications have begun to increasingly rely on satellite measurements. Research application users seek good quality satellite data, with uncertainties and biases provided for each data point. However, different communities address remote sensing quality issues rather inconsistently and differently. We describe our attempt to systematically characterize, capture, and provision quality and uncertainty information as it applies to the NASA MODIS Aerosol Optical Depth data product. In particular, we note the semantic differences in quality/bias/uncertainty at the pixel, granule, product, and record levels. We outline various factors contributing to uncertainty or error budget; errors. Web-based science analysis and processing tools allow users to access, analyze, and generate visualizations of data while alleviating users from having directly managing complex data processing operations. These tools provide value by streamlining the data analysis process, but usually shield users from details of the data processing steps, algorithm assumptions, caveats, etc. Correct interpretation of the final analysis requires user understanding of how data has been generated and processed and what potential biases, anomalies, or errors may have been introduced. By providing services that leverage data lineage provenance and domain-expertise, expert systems can be built to aid the user in understanding data sources, processing, and the suitability for use of products generated by the tools. We describe our experiences developing a semantic, provenance-aware, expert-knowledge advisory system applied to NASA Giovanni web-based Earth science data analysis tool as part of the ESTO AIST-funded Multi-sensor Data Synergy Advisor project.

Leptoukh, Gregory↗

GENESIS: GPS Environmental and Earth Science Information System

This presentation reviews the GPS ENvironmental and Earth Science Information System (GENESIS). The objectives of GENESIS are outlined (1) Data Archiving, searching and distribution for science data products derived from Space borne TurboRogue Space Receivers for GPS science and other ground based GPS receivers, (2) Data browsing using integrated visualization tools, (3) Interactive web/java-based data search and retrieval, (4) Data subscription service, (5) Data migration from existing GPS archived data, (6) On-line help and documentation, and (7) participation in the WP-ESIP federation. The presentation reviews the products and services of Genesis, and the technology behind the system.

Hajj, George↗

Standardizing an End-to-end Accounting Service

Currently there are no space system standards available for space agencies to accomplish end-to-end accounting. Such a standard does not exist for spacecraft operations nor for tracing the relationship between the mission planning activities, the command sequences designed to perform those activities, the commands formulated to initiate those activities and the mission data and specifically the mission data products created by those activities. In order for space agencies to cross-support one another for data accountability/data tracing and for inter agency spacecraft to interoperate with each other, an international CCSDS standard for end-to-end data accountability/tracing needs to be developed. We will first describe the end-to-end accounting service model and functionality that supports the service. This model will describe how science plans that are ultimately transformed into commands can be associated with the telemetry products generated as a result of their execution. Moreover, the interaction between end-to-end accounting and service management will be explored. Finally, we will show how the standard end-to-end accounting service can be applied to a real life flight project i.e., the Mars Reconnaissance Orbiter project.

recommendations↗

Creation of learning kits

A learning kit is an essential part of any remote sensing workshop, course, or in-house training program to provide the "hands-on" experience of working with remotely sensed imagery. This is the objective of laboratory and field exercises as well as the reason behind the production of imagery/map kits. The way in which these learning kits (containing conventional remotely sensed and collateral data products) are put together is described and some concerns that influence the creation of learning kits are discussed. These include budgetary constraints, number of imagery types, and number of collateral data types.

Stow, D. A.↗

Enhancing Seismic Calibration Research Through Software Automation and Scientific Information Management

The National Nuclear Security Administration (NNSA) Ground-Based Nuclear Explosion Monitoring Research and Development (GNEMRD) Program at LLNL continues to make significant progress enhancing the process of deriving seismic calibrations and performing scientific integration, analysis, and information management with software automation tools. Our tool efforts address the problematic issues of very large datasets and varied formats encountered during seismic calibration research. New information management and analysis tools have resulted in demonstrated gains in efficiency of producing scientific data products and improved accuracy of derived seismic calibrations. In contrast to previous years, software development work this past year has emphasized development of automation at the data ingestion level. This change reflects a gradually-changing emphasis in our program from processing a few large data sets that result in a single integrated delivery, to processing many different data sets from a variety of sources. The increase in the number of sources had resulted in a large increase in the amount of metadata relative to the final volume of research products. Software developed this year addresses the problems of: (1) Efficient metadata ingestion and conflict resolution; (2) Automated ingestion of bulletin information; (3) Automated ingestion of waveform information from global data centers; and (4) Site Metadata and Response transformation required for certain products. This year, we also made a significant step forward in meeting a long-standing goal of developing and using a waveform correlation framework. Our objective for such a framework is to extract additional calibration data (e.g. mining blasts) and to study the extent to which correlated seismicity can be found in global and regional scale environments.

58 GEOSCIENCES↗

Status of Validation Program for Tropical Rainfall Measuring Mission (TRMM)

The Tropical Rainfall Measuring Mission (TRMM) is in its sixth year of operation. This successful research mission, a joint U.S./Japan effort, has become-a key element in the routine monitoring of global precipitation. The package of rain measuring instrumentation, including the first meteorological radar in space, continues to function perfectly, and with the increase in orbital altitude (from 350 km to 400 km) the mission will hopefully continue for a number of years. The validation effort has been a combination of routine use of 1) ground-based radar and raingauge measurements for comparison with the satellite-based estimates, 2) the use of field experiment data for evaluation of the satellite data products and investigation of some of the assumptions in the satellite retrievals, and 3) use of other comparison data sets, including atoll and buoy gauges over ocean and research and operational gauge data sets over land. The status of the program will be described along with "lessons learned". Near term plans for improved validation products and new thrusts related to validation of TRMM-based multi-satellite products that extend into middle latitudes will be outlined.

Adler, Robert↗

De-noising drift chambers in CLAS12 using convolutional auto encoders

Modern Nuclear Physics experimental setups run experiments with higher beam intensity resulting in increased noise in detector components used for particle track reconstruction. Increased uncorrelated signals (noise) result in decreased particle reconstruction efficiency. In this paper, we investigate the usage of Machine Learning, specifically Convolutional Neural Network Auto-Encoders (CAE), for de-noising raw hits from drift chambers in the CLAS12 detector. To the best of our knowledge, this is the first time CAE is employed to perform such an operation in this field. During the de-noising phase, it is important to remove as much noise as possible while retaining the valid hits to avoid losing crucial information about the experiment. Here, we show that using CAE, it is possible to remove noise hits while retaining up to 94% of valid tracks for a beam current of 110nA while for lower beam currents (45-55nA), we get up to 98% efficiency. Studies on experimental conditions with increasing noise show that CAE performs better than conventional tracking algorithms in isolating hits belonging to tracks. Specifically, the de-noising algorithm results in tracking efficiency improvements greater than 15%, in real data production procedures with nominal conditions, and up to two times better efficiency in synthetically generated data with high luminosity conditions (90-110nA), indicating that machine learning can lead to significantly shorter times for conducting physics experiments.

97 MATHEMATICS AND COMPUTING↗

THE UDF05 FOLLOW-UP OF THE HUBBLE ULTRA DEEP FIELD. III. THE LUMINOSITY FUNCTION AT z {approx} 6

In this paper, we present a derivation of the rest-frame 1400 A luminosity function (LF) at redshift six from a new application of the maximum likelihood method by exploring the five deepest Hubble Space Telescope/Advanced Camera for Surveys (HST/ACS) fields, i.e., the Hubble Ultra Deep Field, two UDF05 fields, and two Great Observatories Origins Deep Survey fields. We work on the latest improved data products, which makes our results more robust than those of previous studies. We use unbinned data and thereby make optimal use of the information contained in the data set. We focus on the analysis to a magnitude limit where the completeness is larger than 50% to avoid possibly large errors in the faint end slope that are difficult to quantify. We also take into account scattering in and out of the dropout sample due to photometric errors by defining for each object a probability that it belongs to the dropout sample. We find the best-fit Schechter parameters to the z {approx} 6 LF are {alpha} = 1.87 {+-} 0.14, M{sub *} = -20.25 {+-} 0.23, and {phi}{sub *} = 1.77{sup +0.62}{sub -0.49} x 10{sup -3} Mpc{sup -3}. Such a steep slope suggests that galaxies, especially the faint ones, are possibly the main sources of ionizing photons in the universe at redshift six. We also combine results from all studies at z {approx} 6 to reach an agreement in the 95% confidence level that -20.45 < M{sub *} < -20.05 and -1.90 < {alpha} < -1.55. The luminosity density has been found not to evolve significantly between z {approx} 6 and z {approx} 5, but considerable evolution is detected from z {approx} 6 to z {approx} 3.

79 ASTRONOMY AND ASTROPHYSICS↗

Profiling the Usage of an Extreme-Scale Archival Storage System

Profiling the archival storage system in scientific computing environments has received much less attention compared to the parallel file system, but is equally important since it stores the final data products safely, for a long duration. In this paper, we analyze eight years worth of data transfer logs for accessing the archival file system (HPSS) in the Oak Ridge Leadership Computing Facility (OLCF), which has been hosting the world's largest supercomputers and file systems. Our analysis encompasses about 135 million data transfer activities to the 80 PB High Performance Storage System (HPSS), between 2010 and 2017. We analyze the logs from several dimensions, including studying the workload characteristics (e.g., access patterns, frequency of accesses and temporal behavior), file system characteristics (e.g., directory depth, file system scaling trends, file types), and scientific user behavior (e.g., domain-specific usage and organization). Based on the analysis, we derive insights into the future evolution of the archive in terms of provisioning, desired features and functionality from the archive software, role and right sizing of the archive tiers, quota management, and the importance of smart and efficient metadata and storage management. We believe our study will prove useful for both operating current archival storage and better provisioning future systems.

Sim, Hyogi↗

radkit v1.2

The radkit software suite (python) consists of three primary libraries: stark, trajan, and curie. The trajan library provides the tools to analyze and manipulate data from lidar and inertial measurement unit (IMU) devices as well as trajectories from algorithms such as simultaneous localization and mapping (SLAM). These components allow reading and writing standard data formats, performing rigid affine transformations, discretizing three-dimensional space, and visualizing data products. The curie library comprises a standard set of object-oriented tools for radiation data and analysis in the following modules: (1) listmode and binmode data classes with methods for manipulation, plotting, slicing and file IO; (2) radiological/nuclear source detection/identification analysis results; (3) source encounters of correlated analyses and (4) energy-dependent angular detector response functions. The stark package provides low-level tools that are leveraged by both curie and trajan. The tools are flexible for offline analysis as well as performant for real-time integrations. The radkit libraries have associated Robot Operating System packages for use in real-time and robotic systems.

Joshi, Tenzing↗

radkit base v1.6

The radkit (base) software suite (python) consists of three primary libraries: stark, trajan, and curie. The trajan library provides the tools to analyze and manipulate data from lidar and inertial measurement unit (IMU) devices, cameras, as well as trajectories from algorithms such as simultaneous localization and mapping (SLAM). These components allow reading and writing standard data formats, performing rigid affine transformations, discretizing three-dimensional space, and visualizing data products. The curie library comprises a standard set of object-oriented tools for radiation data and analysis in the following modules: (1) listmode and binmode data classes with methods for manipulation, plotting, slicing and file IO; (2) radiological/nuclear source detection/identification analysis results; (3) source encounters of correlated analyses and (4) energy-dependent angular detector response functions. The stark package provides low-level tools that are leveraged by both curie and trajan. The tools are flexible for offline analysis as well as performant for real-time integrations.

Salathe, Marco [Lawrence Berkeley National Laborat↗