Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “datasets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Data Quality Challenges for Analysis Ready Data (ARD)

Data quality plays a critical role in research and applications. The Earth Science Information Partners (ESIP) Information Quality Cluster (IQC) defines four aspects of information quality: Science, Product, Stewardship, and Services. The ESIP IQC has become internationally recognized as an authoritative and responsive resource of information and guidance to data producers and distributors on how to implement data quality standards and best practices for their science data systems, datasets, and data/metadata dissemination services. In recent years, cloud computing environments have provided scale-up capabilities such as data archives and services, enabling interdisciplinary science and applications. More value-added products are expected from data service providers, including Analysis Ready Data (ARD). ARD refers to data that has been preprocessed into a form that allows immediate analysis by the end user, processed to a minimum set of requirements and provides interoperability over time and across multiple datasets. Once a dataset has been developed from its original form to produce ARD, what quality characteristics should the derived dataset or ARD possess? Also, is it safe to assume that the quality of the ARD is consistent with the quality of the source data, or are there special attributes to an ARD that would warrant a secondary, independent quality assessment? What provenance (also called “data lineage”) information needs to be included in ARD? It is important to answer these questions, especially given the ease of use of ARD, and the consequent temptation by users to trust ARD without understanding the limitations or possible variations in quality compared to the source data. In this presentation, we will discuss data quality challenges for ARD products and services and introduce IQC for participation.

data quality↗
NASA NTRS2023

Assessment of the Performance of the Atmospheric Correction Algorithm MAJA for Sentinel-2 Surface Reflectance Estimates

The correction of atmospheric effects on optical remote sensing products is an essential component of Analysis Ready Data (ARD) production lines. The MAJA processor aims at providing accurate time series of surface reflectances over land for satellite missions, such as Sentinel-2, Venμs, and Landsat 8. The Centre d’Études Spatiales de la Biosphère (CESBIO) and the Centre National d’Études Spatiales (CNES) share a common effort to maintain, validate, and improve the MAJA processor, using state-of-the-art ground measurement sites, and participating in processor inter-comparisons, such as the Atmospheric Correction Intercomparison Exercise (ACIX). While contributing to the second ACIX-II Land validation exercise, it was found that the candidate MAJA dataset could not adequately be compared to the main reference dataset. MAJA reflectances were corrected for adjacency and topography effects while the reference dataset was not, excluding MAJA from a part of the performance metrics of the exercise. The first part of the following study aims at providing complementary performance assessment to ACIX-II by reprocessing MAJA surface reflectances without adjacency nor topographic correction, allowing for an un-biased full resolution comparison with the reference Sentinel-2 dataset. The second part of the study consists of validating MAJA against surface reflectance measurements time series of up to five years acquired at three automated stations. Both approaches provide extensive insights on the quality of MAJA Sentinel-2 Level 2 products.

ROSAS↗
NASA NTRS2024

Summarizing Multiple Aspects of Triple Collocation Analysis in a Single Diagram

With the ongoing expansion of global observation networks, it is expected that we shall routinely analyze records of geophysical variables such as temperature from multiple collocated instruments. Validating datasets in this situation is not a trivial task because every observing system has its own bias and noise. Triple collocation is a general statistical framework to estimate the error characteristics in three or more observational-based datasets. In a triple colocation analysis, several metrics are routinely reported but traditional multiple-panel plots are not the most effective way to display information. A new formula of error variance is derived for connecting the key terms in the triple collocation theory. A diagram based on this formula is devised to facilitate triple collocation analysis of any data from observations, as illustrated using three aerosol optical depth datasets from the recent Aerosol Cloud meTeorology Interactions oVer the western ATlantic Experiment (ACTIVATE). An observational-based skill score is also derived to evaluate the quality of three datasets by taking into account both error variance and correlation coefficient. Several applications are discussed and sample plotting routines are provided.

triple collocation↗
NASA NTRSDate not supplied

Towards Understanding Data Requirements for Developing Automatic Speech Recognition Systems for Air Traffic Control

In recent years, the application of automatic speech recognition has gained popularity across diverse industries, including aviation. Given the many applications focusing on transcribing air traffic control and management communication, this paper explores the training of OpenAI's Whisper model across multiple existing public and private air traffic control voice datasets in an effort to improve robustness. Combining roughly 60+ hours of various air traffic datasets, our goal is to train a unified Whisper model and expect an average word error rate reduction across testing datasets. Furthermore, this work aims to understand the data quantity requirements for achieving state-of-the art results by comprehensively training Whisper on varying dataset sizes. This work has the potential to improve automatic speech recognition performance across the domain, improve understanding of the quantity of data required by an aviation speech recognition system, and lastly provide metrics to compare and improve upon in future research.

ATC↗
NASA NTRSDate not supplied

Increasing Discovery and Usability of Earth Science Satellite Data with My NASA Data

For 20 years, the My NASA Data project at NASA Langley Research Center has developed innovative approaches to increase the use of NASA’s satellite data by learners. My NASA Data offers a variety of authentic Earth Science datasets and a data visualization tool, eliminating the need for educators and/or learners to obtain specialized knowledge of GIS data formats and software to access and use authentic Earth Science data. While there is no shortage of available data, as federal government agencies such as NASA house petabytes of freely accessible Earth Science datasets, much of the data are only available for download and visualization in specialized formats and software, limiting their accessibility to educators and learners, especially those in primary and secondary school. Using the Google Earth Engine platform, the My NASA Data team has recently reinvented their data visualization tool, called the Earth System Data Explorer (ESDE). The ESDE gives users the capability to explore over 60 Earth Science satellite datasets in a multitude of formats such as maps, graphs, and data table Its new and improved user interface design was developed based on the preferences of educators, whom the My NASA Data project has over 20 years’ experience working with. Earth Science and GIS Subject Matter Experts (SMEs) structured the data in a professional and scientific manner. During Fiscal Year 2023, the My NASA Data website received over 1 million digital engagements, with over one-third being visitors to the data visualization tool. These metrics highlight the interest in a visualization tool that is simple and free to use with reliable and trusted datasets. The ESDE empowers users to readily relate and analyze NASA Earth Science data within their area of interest. The team used a user-centered design (UCD) framework to receive and incorporate feedback into the application’s design. Core requested features include the ability to create time series graphs, comparative analysis of maps, and download the data as CSV file. Responses indicate that advances in data visualization tools such as the ESDE make authentic Earth Science data more accessible. This presentation will cover how the My NASA Data project develops tools to enhance data discovery and accessibility, as well as how SME and user suggestions are incorporated.

Desiray Wilson↗
NASA NTRS2025

An Efficient GPU-Accelerated Multi-Source Global Fit Pipeline for LISA Data Analysis

The large-scale analysis task of deciphering gravitational wave signals in the LISA data stream will be difficult, requiring a large amount of computational resources and extensive development of computational methods. Its high dimensionality, multiple model types, and complicated noise profile require a global fit to all parameters and input models simultaneously. In this work, we detail our global fit algorithm, called “Erebor,” designed to accomplish this challenging task. It is capable of analysing current state-of-the-art datasets and then growing into the future as more pieces of the pipeline are completed and added. We describe our pipeline strategy, the algorithmic setup, and the results from our analysis of the LDC2A Sangria dataset, which contains Massive Black Hole Binaries, compact Galactic Binaries, and a parameterized noise spectrum whose parameters are unknown to the user. The Erebor algorithm includes three unique and very useful contributions: GPU acceleration for enhanced computational efficiency; ensemble MCMC sampling with multiple MCMC walkers per temperature for better mixing and parallelized sample creation; and special online updates to reversible-jump (or trans-dimensional) sampling distributions to ensure sampler mixing and accurate initial estimates for detectable sources in the data. We recover posterior distributions for all 15 (6) of the injected MBHBs in the LDC2A training (hidden) dataset. We catalog ∼12000 Galactic Binaries (∼8000 as high confidence detections) for both the training and hidden datasets. All of the sources and their posterior distributions are provided in publicly available catalogs.

LISA global fit↗
NASA NTRS2025

Efficient GPU-Accelerated MultiSource Global Fit Pipeline for LISA Data Analysis

The large-scale analysis task of deciphering gravitational-wave signals in the LISA data stream will be difficult, requiring a large amount of computational resources and extensive development of computational methods. Its high dimensionality, multiple model types, and complicated noise profile require a global fit to all parameters and input models simultaneously. In this work, we detail our global fit algorithm, called “Erebor,” designed to accomplish this challenging task. It is capable of analyzing current state-of-the-art datasets and then growing into the future as more pieces of the pipeline are completed and added. We describe our pipeline strategy, the algorithmic setup, and the results from our analysis of the LDC2A Sangria dataset, which contains massive black hole binaries, compact galactic binaries, and a parametrized noise spectrum whose parameters are unknown to the user. The Erebor algorithm includes three unique and very useful contributions: GPU acceleration for enhanced computational efficiency; ensemble Markov Chain Monte Carlo (MCMC) sampling with multiple MCMC walkers per temperature for better mixing and parallelized sample creation; and special online updates to reversible-jump (or transdimensional) sampling distributions to ensure sampler mixing and accurate initial estimates for detectable sources in the data.We recover posterior distributions for all 15 (6) of the injected massive black hole binaries (MBHB) in the LDC2A training (hidden) dataset. We catalog ∼12000 galactic binaries (∼8000 as high confidence detections) for both the training and hidden datasets. All of the sources and their posterior distributions are provided in publicly available catalogs.

LISA↗
NASA NTRSDate not supplied

NASA POWER: Providing Analysis-Ready, Cloud-Optimized Data for AI /ML Training and Applications in Earth Science

As global demand for sustainable development grows, the integration of Earth Observation (EO) data into decision making frameworks has become a primary objective for the scientific community. The NASA Prediction of Worldwide Energy Resources (POWER) project serves as a bridge between NASA EO data and the specialized needs of the renewable energy, sustainable infrastructure and agroclimatology communities. In this poster presentation we will present an overview of POWER data products and services along with its use in diverse research to decision-making workflows. By providing over 40 years of high-resolution historical, hourly and daily solar and meteorological data, POWER transforms satellite observations and global model reanalysis into actionable, Analysis-Ready Dataset (ARD). Currently, the project delivers over 250 industry-friendly parameters to the users from different NASA datasets like CERES SYN1Deg, MERRA-2, and IMERG alongside downscaled CMIP6 climate model data, fulfilling over 16 million requests from 50,000 unique users monthly. To ensure data quality and traceability, these parameters are rigorously validated against the ground-based observations from the Baseline Surface Radiation Network (BSRN) and the Global Surface Summary of the Day (GSOD) – these results will be discussed in the presentation. A newly introduced web-based PaRameter Uncertainty ViEwer (PRUVE) tool will be presented that provides an online validation platform to the users that benchmarks satellite-based and assimilation data products against these surface measurements. To reduce technical barriers to data adoption, POWER data is accessible through RESTful APIs, ESRI ArcGIS Image Services, a web-based Data Access Viewer tool, allowing users to visualize, validate and apply the dataset. For efficient data delivery POWER data is cloud-optimized into Zarr datastore accessible through NASA managed Amazon S3 ensures high-performance allowing users to integrate EO directly into operational pipelines. These customized services will be presented. Use cases from application will be presented from the energy sector - such as for design of generation systems, performance monitoring of solar power plants, in infrastructure sector- optimizing building energy efficiency and thermal comfort, in agriculture – such as driving crop simulation and yield forecasting models to enable climate resilient farming. Furthermore, the shift toward machine learning (ML) in EO research that has positioned POWER as a key provider for training datasets which will be discussed. Use-cases will be presented to showcase how NASA data is enabling the development of predictive tools for climate variability and resource management. The poster will present POWER’s future plans including technology development to enhance data traceability and reproducibility and improving I/O performance to support the rapid integration of new EO products, ensuring that POWER remains a robust scalable backend for the evolving landscape of AI-driven Earth Science. Additionally, POWER is developing an AI Agent and an MCP-Server to enable industry AI-Agentic workflows.

Neha Khadka↗
NASA NTRS2021

Evaluation of Clouds, Radiation, and Precipitation in CMIP6 Models Using Global Weather States Derived from ISCCP-H Cloud Property Data

A clustering methodology is applied to cloud optical depth cloud top pressure (TAU-PC) histograms from the new, 1-degree resolution, ISCCP-H dataset, to derive an updated global Weather State (WS) dataset. Then, PC-TAU histograms from current-climate CMIP6 model simulations are assigned to the ISCCP-H WSs along with their concurrent radiation and precipitation properties, to evaluate model cloud, radiation, and precipitation properties in the context of the Weather States. The new ISCCP-H analysis produces WSs that are very similar to those previously found in the lower resolution ISCCP-D dataset. The main difference lies in the splitting of the ISCCP-D thin stratocumulus WS between the ISCCP-H shallow cumulus and stratocumulus WSs, which results in the reduction by one of the total WS number. The evaluation of the CMIP6 models against the ISCCP-H Weather States, shows that, in the ensemble mean, the models are producing an adequate representation of the frequency and geographical distribution of the WSs, with measurable improvements compared to the WSs derived for the CMIP5 ensemble. However, the frequency of shallow cumulus clouds continues to be underestimated, and, in some WSs the good agreement of the ensemble mean with observations comes from averaging models that significantly overpredict and underpredict the ISCCP-H WS frequency. In addition, significant biases exist in the internal cloud properties of the model WSs, such as the model underestimation of cloud fraction in middle-top clouds and secondarily in midlatitude storm and stratocumulus clouds, that result in an underestimation of cloud SW cooling in those regimes.

Clouds↗
NASA NTRS2022

Improved representation of agricultural land use and crop management for large-scale hydrological impact simulation in Africa using SWAT+

To date, most regional and global hydrological models either ignore the representation of cropland or consider crop cultivation in a simplistic way or in abstract terms without any management practices. Yet, the water balance of cultivated areas is strongly influenced by applied management practices (e.g. planting, irrigation, fertilization, and harvesting). The SWAT+ (Soil and Water Assessment Tool) model represents agricultural land by default in a generic way, where the start of the cropping season is driven by accumulated heat units. However, this approach does not work for tropical and subtropical regions such as sub-Saharan Africa, where crop growth dynamics are mainly controlled by rainfall rather than temperature. In this study, we present an approach on how to incorporate crop phenology using decision tables and global datasets of rainfed and irrigated croplands with the associated cropping calendar and fertilizer applications in a regional SWAT+ model for northeastern Africa. We evaluate the influence of the crop phenology representation on simulations of leaf area index (LAI) and evapotranspiration (ET) using LAI remote sensing data from Copernicus Global Land Service (CGLS) and WaPOR (Water Productivity through Open access of Remotely sensed derived data) ET data, respectively. Results show that a representation of crop phenology using global datasets leads to improved temporal patterns of LAI and ET simulations, especially for regions with a single cropping cycle. However, for regions with multiple cropping seasons, global phenology datasets need to be complemented with local data or remote sensing data to capture additional cropping seasons. In addition, the improvement of the cropping season also helps to improve soil erosion estimates, as the timing of crop cover controls erosion rates in the model. With more realistic growing seasons, soil erosion is largely reduced for most agricultural hydrologic response units (HRUs), which can be considered as a move towards substantial improvements over previous estimates. We conclude that regional and global hydrological models can benefit from improved representations of crop phenology and the associated management practices. Future work regarding the incorporation of multiple cropping seasons in global phenology data is needed to better represent cropping cycles in areas where they occur using regional to global hydrological models.

crop phenology↗
NASA NTRS1987

Evolution of the Southern Oscillation as observed by the Nimbus-7 ERB experiment

The Nimbus-7 satellite has been in a 955-km, sun-synchronous orbit since October 1978. The Earth Radiation Budget (ERB) experiment has taken approximately 8 years of high-quality data during this time, of which seven complete years have been archived at the National Space Science Data Center. A final reprocessing of the wide-field-of-view channel dataset is underway. Error analyses indicate a long-term stability of 1 percent better over the length of the data record. As part of the validation of the ERB measurements, the archived 7-year Nimbus-7 ERB dataset is examined for the presence and accuracy of interannual variations including the Southern Oscillation signal. Zonal averages of broadband outgoing longwave radiation indicate a terrestrial response of more than 2 years to the oceanic and atmospheric manifestations of the 1982-83 El Nino/Southern Oscillation (ENSO) event, especially in the tropics. This signal is present in monthly and seasonal averages and is shown here to derive primarily from atmospheric responses to adjustments in the Pacific Ocean. The calibration stability of this dataset thus provides a powerful new tool to examine the physics of the ENSO phenomena.

Ardanuy, Philip E.↗
NASA NTRS1989

Minutes of the CD-ROM Workshop

The workshop described in this document had two goals: (1) to establish guidelines for the CD-ROM as a tool to distribute datasets; and (2) to evaluate current scientific CD-ROM projects as an archive. Workshop attendees were urged to coordinate with European groups to develop CD-ROM, which is already available at low cost in the U.S., as a distribution medium for astronomical datasets. It was noted that NASA has made the CD Publisher at the National Space Science Data Center (NSSDC) available to the scientific community when the Publisher is not needed for NASA work. NSSDC's goal is to provide the Publisher's user with the hardware and software tools needed to design a user's dataset for distribution. This includes producing a master CD and copies. The prerequisite premastering process is described, as well as guidelines for CD-ROM construction. The production of discs was evaluated. CD-ROM projects, guidelines, and problems of the technology were discussed.

King, Joseph H.↗
NASA NTRS1992

Physical interpretation of thermal and reflected data on Martian surface units

None of the available Viking Orbiter Infrared Thermal Mapper's thermal datasets can be uniquely interpreted in isolation from other data in terms of variations of a single, simple physical parameter of the martian surface. Other thermal datasets of a target area, thermal observations of adjacent materials, and visible and near-infrared observations of the same region can often sufficiently constrain interpretations to obtain one that is nearly unique. The major datasets, their derived information, and their ambiguities are given.

Strickland, Edwin L., III↗
NASA NTRS1991

Assessment of surface penetration with polarimetric radar

An airborne P-, L-, and C-band polarimetric radar dataset acquired over the Atchafalaya Bay study site was used to assess its surface penetration capabilities. The dataset was decompressed and reformatted to form a three-wavelength and three-polarization nine-channel dataset. All nine channels were filtered for speckle noise removal, using the 7-by-7 local-statistics moving-window filtering. Significant smoothing of data was obtained so that the data can be classified using the SRCH and M234 ELAS programs. Preliminary assessment of the PLC images indicated that the radar waves penetrated muddy water. Therefore the radar can measure the water depth and can be used to map the submerged sediments. A statistical analysis of the digital data provided insight on the depth of muddy water penetration.

Wu, Shih-Tseng↗
NASA NTRS1991

Examining several Southern Ocean data sets

Several datasets regarding the ocean in the Southern Hemisphere are combined into a coregistered format to analyze the use of the data in multidisciplinary research. The datasets are described detailing bathymetric climatological data on surface pigment concentration, eddy-kinetic-energy measurements, surface wind-stress magnitudes, sea-surface temperatures, surface densities, and nitrate concentrations. The data are combined in a common projection which facilitates the comparison of the fields, and the combined data yield insights regarding such phenomena as bottom topography, surface heat and moisture fluxes, and divergences in flow. The number of available datasets is shown to be good, and the data can be used to develop working hypotheses on the relationships between physical and biogeochemical processes.

Mcclain, Charles R.↗
NASA NTRS1993

Tensoral: A system for post-processing turbulence simulation data

Many computer simulations in engineering and science -- and especially in computational fluid dynamics (CFD) -- produce huge quantities of numerical data. These data are often so large as to make even relatively simple post-processing of this data unwieldy. The data, once computed and quality-assured, is most likely analyzed by only a few people. As a result, much useful numerical data is under-utilized. Since future state-of-the-art simulations will produce even larger datasets, will use more complex flow geometries, and will be performed on more complex supercomputers, data management issues will become increasingly cumbersome. My goal is to provide software which will automate the present and future task of managing and post-processing large turbulence datasets. My research has focused on the development of these software tools -- specifically, through the development of a very high-level language called 'Tensoral'. The ultimate goal of Tensoral is to convert high-level mathematical expressions (tensor algebra, calculus, and statistics) into efficient low-level programs which numerically calculate these expressions given simulation datasets. This approach to the database and post-processing problem has several advantages. Using Tensoral the numerical and data management details of a simulation are shielded from the concerns of the end user. This shielding is carried out without sacrificing post-processor efficiency and robustness. Another advantage of Tensoral is that its very high-level nature lends itself to portability across a wide variety of computing (and supercomputing) platforms. This is especially important considering the rapidity of changes in supercomputing hardware.

Dresselhaus, Eliot↗
NASA NTRS1993

Flux measurements using the BATSE spectroscopic detectors

Among the Compton Gama-Ray Observatory instruments, the BATSE Spectroscopic Detectors (SD) have the distinction of being able to detect photons of energies less than about 20 keV. This is an interesting energy range for the examination of low mass X-ray binaries (LMXB's). In fact, Sco X-1, the prototype LMXB, is easily seen even in the raw BATSE spectroscopic data. The all-sky coverage afforded by these detectors offers a unique opportunity to monitor this source over time periods never before possible. The aim of this investigation was to test a number of ways in which both continous and discrete flux measurements can be obtained using the BATSE spectroscopic datasets. A instrumental description of a SD can be found in the Compton Workshop of Apr. 1989, this report will deal only with methods which can be used to analyze its datasets. Many of the items discussed below, particularly in regard to the earth occultation technique, have been developed, refined, and applied by the BATSE team to the reduction of BATSE LAD data. Code written as part of this project utilizes portions of that work. The following discussions will first address issues related to the reduction of SD datasets using the earth occultation technique. It will then discuss methods for the recovery of the flux history of strong sources while they are above the earth's limb. The report will conclude with recommended reduction procedures.

Mcnamara, Bernard↗
NASA NTRS1994

Modeling tropical Pacific sea surface temperature with satellite-derived solar radiative forcing

Two independent datasets for the solar radiation at the surface derived from satellites are compared. The data derived from the Earth Radiation Budget Experiment (ERBE) is for the net solar radiation at the surface whereas the International Satellite Cloud Climatology Project (ISCCP) data is for the downward flux only and was corrected with a space- and time-varying albedo. The ISCCP net flux is at all times higher than the ERBE flux. The difference can be divided into an offset that decreases with latitude and another component that correlates with high tropical cloud cover. With this latter exception the two datasets provide spatial patterns of solar flux that are very similar. A tropical Pacific Ocean model is forced with these two datasets and observed climatological winds. The upward heat flux is parameterized taking into account separately the longwave radiative, latent, and sensible heat fluxes. Best fit values for the uncertain parameters are found using an optimization procedure that seeks to minimize the difference between model and observed SST by varying the parameters within a reasonable range of uncertainty. The SST field the model produces with the best fit parameters is the best the model can do. If the differences between the model and data are larger than can be accounted for by remaining uncertainties in the heat flux parameterization and forcing data then the ocean model must be held to be at fault. Using this method of analysis, a fundamental model fault is identified. Inadequate treatment of mixed layer/entrainment processes in upwelling regions of the eastern tropical Pacific leads to a large and seasonally varying error in the model SST. Elsewhere the model SST is insufficiently different from observed to be able to identify model errors.

Seager, Richard↗