Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “validation dataset”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

Communicating Metrics of Land Surface Temperature Variability Using Multi-sensor Machine Learning

Land surface temperature (LST) is a key climate observable used to detect changes in the Earth’s surface energy budget that influence carbon and water cycles. Land surface temperature exhibits strong diurnal variability, which geostationary satellites can observe at scale thanks to their temporal resolution. Due to anthropogenic climate and land use changes, the surface energy balance has been considerably modified and may be described by changes in diurnal temperature range and extremes. Using high performance computing and datasets from the NASA Earth Exchange, we exploit co-located, co-temporal observations from low-earth orbit (LEO) and geostationary (GEO) sensors to develop a deep learning-based method for LEO-to-GEO algorithm emulation. Our model is trained to predict MODIS Terra LST from GOES-16 thermal bands and achieves validation error <2K. Application of the model to unseen times of day (observed by MODIS Aqua) and a new GEO sensor (Himawari-8) observing an unseen spatial domain, demonstrate the generalization of the deep learning model across space, time and spectra. Further, time series clustering approaches are examined with the objective of identifying key indicators of change in diurnal cycling and extremes on a continental scale. Communicating LST variability observed by geostationary satellites can have impacts in multiple disciplines, from understanding of snow, vegetation and soil dynamics, to recognizing trends in heat events relevant to human health.

Kate Duffy↗

LEO Sensor to GEO Sensor Algorithm Transfer Models for Land Surface Temperature

Land surface temperature (LST) is a key climate observable used to detect changes in the Earth’s surface energy budget that influence carbon and water cycles. Land surface temperature exhibits strong diurnal variability, which geostationary satellites can observe at scale thanks to their temporal resolution. Due to anthropogenic climate and land use changes, the surface energy balance has been considerably modified and may be described by changes in diurnal temperature range and extremes. Using high performance computing and datasets from the NASA Earth Exchange, we exploit co-located, co-temporal observations from low-earth orbit (LEO) and geostationary (GEO) sensors to develop a deep learning-based method for LEO-to-GEO algorithm emulation. Our model is trained to predict MODIS Terra LST from GOES-16 thermal bands and achieves validation error <2K. Application of the model to unseen times of day (observed by MODIS Aqua) and a new GEO sensor (Himawari-8) observing an unseen spatial domain, demonstrate the generalization of the deep learning model across space, time and spectra. Communicating diurnal LST variability observed by geostationary satellites can have impacts in multiple disciplines, from understanding of snow, vegetation and soil dynamics, to recognizing trends in heat events relevant to human health.

Kate Marie Duffy↗

Uncertainty Management in Remote Sensing of Climate Data. Summary of A Workshop

Great advances have been made in our understanding of the climate system over the past few decades, and remotely sensed data have played a key role in supporting many of these advances. Improvements in satellites and in computational and data-handling techniques have yielded high quality, readily accessible data. However, rapid increases in data volume have also led to large and complex datasets that pose significant challenges in data analysis (NRC, 2007). Uncertainty characterization is needed for every satellite mission and scientists continue to be challenged by the need to reduce the uncertainty in remotely sensed climate records and projections. The approaches currently used to quantify the uncertainty in remotely sensed data, including statistical methods used to calibrate and validate satellite instruments, lack an overall mathematically based framework.

Remote sensing↗

An Approach to Monitoring Mangrove Extents Through Time-Series Comparison of JERS-1 SAR and ALOS PALSAR Data

Between 2007 and 2010, Japan's Advanced Land Observing Satellite (ALOS) Phased Arrayed L-band Synthetic Aperture Radar (PALSAR) captured dual polarization HH and HV data across the tropics and sub-tropics. A pan tropical dataset of Japanese Earth Resources Satellite (JERS-1) SAR (HH) data was also acquired between 1995 and 1998. The provision of these comparable cloud-free datasets provided an opportunity for observing changes in the extent of coastal mangroves over more than a decade. Focusing on nine sites distributed through the tropics, this paper demonstrates how these data can be used to backdate and update existing baseline maps of mangrove extent. The benefits of integrating dense timeseries of Landsat sensor data for both validating assessments of change and determining the causes of change are outlined. The approach is evaluated for wider application across the geographical range of mangroves in order to advance the development of JAXA's Global Mangrove Watch (GMW) program.

ALOS PALSAR DATA↗

Single-Turnover Variable Chlorophyll Fluorescence as a Tool for Assessing Phytoplankton Photosynthesis and Primary Productivity: Opportunities, Caveats and Recommendations

Phytoplankton photosynthetic physiology can be investigated through single-turnover variable chlorophyll fluorescence (ST-ChlF) approaches, which carry unique potential to autonomously collect data at high spatial and temporal resolution. Over the past decades, significant progress has been made in the development and application of ST-ChlF methods in aquatic ecosystems, and in the interpretation of the resulting observations. At the same time, however, an increasing number of sensor types, sampling protocols, and data processing algorithms have created confusion and uncertainty among potential users, with a growing divergence of practice among different research groups. In this review, we assist the existing and upcoming user community by providing an overview of current approaches and consensus recommendations for the use of ST-ChlF measurements to examine in-situ phytoplankton productivity and photo-physiology. We argue that a consistency of practice and adherence to basic operational and quality control standards is critical to ensuring data inter-comparability. Large datasets of inter-comparable and globally coherent ST-ChlF observations hold the potential to reveal large-scale patterns and trends in phytoplankton photo-physiology, photosynthetic rates and bottom-up controls on primary productivity. As such, they hold great potential to provide invaluable physiological observations on the scales relevant for the development and validation of ecosystem models and remote sensing algorithms.

variable chlorophyll fluorescence↗

Retrieval of Aerosol Optical Properties From GOCI-II Observations: Continuation of Long-Term Geostationary Aerosol Monitoring Over East Asia

Since the Geostationary Ocean Color Imager (GOCI) was successfully launched in 2010, the GOCI Yonsei aerosol retrieval (YAER) algorithm has been continuously updated to retrieve hourly aerosol optical properties. GOCI-II has 4 more channels including UV, finer spatial resolution (250 m), and daily full disk coverage as compared to GOCI, and was launched in February 2020, onboard the GEO-KOMPSAT-2B (GK-2B) satellite. In this study, we extended the YAER algorithm to GOCI-II data based on its improved performance in many aspects and present the first results of aerosol optical properties retrieved from GOCI-II data. Utilizing the overlapping period between the GOCI-II and GOCI in geostationary Earth orbit, we present GOCI-II aerosol retrievals for high aerosol-loading cases over East Asia and show that these have a consistent spatial distribution with those from GOCI. Furthermore, GOCI-II provides AOD at an even higher spatial resolution, revealing finer changes in aerosol concentrations. Validation results for one year data show that the GOCI-II AOD has a correlation coefficient of 0.83 and a ratio within the expected error (EE) of 59.4 % when compared with the aerosol robotic network (AERONET) data. We compared statistical metrics for the GOCI and GOCI-II AODs to assess the consistency between the two datasets. In addition, it was found that there is a strong correlation between the two datasets from the comparison of gridded GOCI and GOCI-II AOD products. It is expected that data from GOCI-II will continue long-term aerosol records with high accuracy that can be used to address air-quality issues over East Asia.

AOD↗

Iced Aircraft Flight Data for Flight Simulator Validation

NASA is developing and validating technology to incorporate aircraft icing effects into a flight training device concept demonstrator. Flight simulation models of a DHC-6 Twin Otter were developed from wind tunnel data using a subscale, complete aircraft model with and without simulated ice, and from previously acquired flight data. The validation of the simulation models required additional aircraft response time histories of the airplane configured with simulated ice similar to the subscale model testing. Therefore, a flight test was conducted using the NASA Twin Otter Icing Research Aircraft. Over 500 maneuvers of various types were conducted in this flight test. The validation data consisted of aircraft state parameters, pilot inputs, propulsion, weight, center of gravity, and moments of inertia with the airplane configured with different amounts of simulated ice. Emphasis was made to acquire data at wing stall and tailplane stall since these events are of primary interest to model accurately in the flight training device. Analyses of several datasets are described regarding wing and tailplane stall. Key findings from these analyses are that the simulated wing ice shapes significantly reduced the C , max, while the simulated tail ice caused elevator control force anomalies and tailplane stall when flaps were deflected 30 deg or greater. This effectively reduced the safe operating margins between iced wing and iced tail stall as flap deflection and thrust were increased. This flight test demonstrated that the critical aspects to be modeled in the icing effects flight training device include: iced wing and tail stall speeds, flap and thrust effects, control forces, and control effectiveness.

Ratvasky, Thomas P.↗

Windsat Validation Using Seawinds, Windrad and POLSCAT Measurements

Global mapping of near surface ocean wind vectors is crucial for many oceanographic and atmospheric studies. The US Navy together with the National Polar Orbiting Environmental Satellite System (NPOESS) launched the Windsat with multi-frequency polarimetric radiometers in January 2003 to demonstrate the passive polarimetry for large spatial coverage of ocean surface wind vector measurements from space. We derived the geophysical model function (GMF) for Windsat polarimetric brightness temperature measurements using six months of matchup dataset. The Windsat GMF was compared with the aircraft radiometer and radar measurements and the SeaWinds scatterometer winds with good agreement up to about 20 m/s wind speed.

scatterometer↗

Provenance in Data Interoperability for Multi-Sensor Intercomparison

As our inventory of Earth science data sets grows, the ability to compare, merge and fuse multiple datasets grows in importance. This requires a deeper data interoperability than we have now. Efforts such as Open Geospatial Consortium and OPeNDAP (Open-source Project for a Network Data Access Protocol) have broken down format barriers to interoperability; the next challenge is the semantic aspects of the data. Consider the issues when satellite data are merged, cross-calibrated, validated, inter-compared and fused. We must match up data sets that are related, yet different in significant ways: the phenomenon being measured, measurement technique, location in space-time or quality of the measurements. If subtle distinctions between similar measurements are not clear to the user, results can be meaningless or lead to an incorrect interpretation of the data. Most of these distinctions trace to how the data came to be: sensors, processing and quality assessment. For example, monthly averages of satellite-based aerosol measurements often show significant discrepancies, which might be due to differences in spatio- temporal aggregation, sampling issues, sensor biases, algorithm differences or calibration issues. Provenance information must be captured in a semantic framework that allows data inter-use tools to incorporate it and aid in the intervention of comparison or merged products. Semantic web technology allows us to encode our knowledge of measurement characteristics, phenomena measured, space-time representation, and data quality attributes in a well-structured, machine-readable ontology and rulesets. An analysis tool can use this knowledge to show users the provenance-related distrintions between two variables, advising on options for further data processing and analysis. An additional problem for workflows distributed across heterogeneous systems is retrieval and transport of provenance. Provenance may be either embedded within the data payload, or transmitted from server to client in an out-of-band mechanism. The out of band mechanism is more flexible in the richness of provenance information that can be accomodated, but it relies on a persistent framework and can be difficult for legacy clients to use. We are prototyping the embedded model, incorporating provenance within metadata objects in the data payload. Thus, it always remains with the data. The downside is a limit to the size of provenance metadata that we can include, an issue that will eventually need resolution to encompass the richness of provenance information required for daata intercomparison and merging.

Lynnes, Chris↗

The Trans-Heliospheric Survey - Radial Trends in Plasma Parameters Across the Heliosphere

Context. Though the solar wind is characterized by spatial and temporal variability across a wide range of scales, long-term averages of in situ measurements have revealed clear radial trends: changes in average values of basic plasma parameters (e.g., density, temperature, and speed) and a magnetic field with a distance from the Sun. Aims. To establish our current understanding of the solar wind's average expansion through the heliosphere, data from multiple spacecraft needed to be combined and standardized into a single dataset. Methods. In this study, data from twelve heliospheric and planetary spacecraft - Parker Solar Probe (PSP), Helios 1 and 2, Mariner 2 and 10, Ulysses, Cassini, Pioneer 10 and 11, New Horizons, and Voyager 1 and 2 - were compiled into a dataset spanning over three orders of magnitude in heliocentric distance. To avoid introducing artifacts into this composite dataset, special attention was given to the solar cycle, spacecraft heliocentric elevation, and instrument calibration. Results. The radial trend in each parameter was found to be generally well described by a power-law fit, though up to two break points were identified in each fit. Conclusions. These radial trends are publicly released here to benefit research groups in the validation of global heliospheric simulations and in the development of new deep-space missions such as Interstellar Probe.

Bennett A Maruca↗

Multi-frequency, multi-polarization SAR and radiometer sea ice classification

Microwave remotely sensed data were acquired simultaneously in March 1988 over Beaufort, Chukchi, and Bering Sea ice using the JPL multifrequency, polarimetric synthetic aperture radar (SAR), and multifrequency dual-polarization GSFC radiometer. The experiment was conducted as a series of coordinated underflights of the DMSP SSM/I satellite radiometer to validate ice products derived from its radiance values. Concurrent flights by an NRL P-3 aircraft enabled overlapping high-resolution, single-frequency images to be acquired over the same surfaces using a Ka-band scanning microwave radiometer. Precise coregistration to an accuracy of 100 m, +/- 25 m enables comparison of temporally and spatially coincident active and passive microwave datasets. Three-channel polarimetric SAR data are compared with dual-polarized radiometer data at several SSM/I frequencies, showing backscatter signatures to be highly correlated with radiometric temperatures. Further comparisons are used to evaluate ice concentration retrievals and to show how multiparameter datasets can be used to resolve ambiguities present in identifying certain sea ice forms with a single microwave instrument.

Drinkwater, Mark R.↗

Biases in the In Situ Measurement of Particulate Organic Carbon and Its Effect on the Calibration and Validation of Ocean Color Sensors

Particulate organic carbon (POC) plays an oversize role, relative to its standing stock in the global carbon (C) cycle. Accurate measurement of POC is central to understanding the ocean C flux and its sensitivity to climate forcing. POC is a standard NASA ocean color data product, which lacks a consensus, quality-assured measurement protocol for satellite validation. Thus, algorithms based on field measurements lacking verified uncertainties have limited applicability towards climate data records. Different sampling and filtration protocols, and blank corrections, introduce biases in the magnitude of POC measured from the field. A significant filter blank attributable to dissolved organic C (DOC) adsorption that, until recently has been seldom corrected for, likely has introduced biases in POC global datasets.

Chaves, Joaquín E.↗

PPDIST, global 0.1° daily and 3-hourly precipitation probability distribution climatologies for 1979–2018

We introduce the Precipitation Probability DISTribution (PPDIST) dataset, a collection of global high-resolution (0.1°) observation-based climatologies (1979–2018) of the occurrence and peak intensity of precipitation (P) at daily and 3-hourly time-scales. The climatologies were produced using neural networks trained with daily P observations from 93,138 gauges and hourly P observations (resampled to 3-hourly) from 11,881 gauges worldwide. Mean validation coefficient of determination (R^(2)) values ranged from 0.76 to 0.80 for the daily P occurrence indices, and from 0.44 to 0.84 for the daily peak P intensity indices. The neural networks performed significantly better than current state-of-the-art reanalysis (ERA5) and satellite (IMERG) products for all P indices. Using a 0.1 mm 3 per h threshold, P was estimated to occur 12.2%, 7.4%, and 14.3% of the time, on average, over the global, land, and ocean domains, respectively. The highest P intensities were found over parts of Central America, India, and Southeast Asia, along the western equatorial coast of Africa, and in the intertropical convergence zone.

Hylke E. Beck↗

AI Curation Methods for NASA Scientific Data

The NASA Open Science Data Repository (OSDR) serves as a central hub for sharing and accessing NASA's vast collection of scientific data, supporting researchers across diverse fields. To enhance the efficiency, accuracy, and accessibility of this data, we are leveraging advanced artificial intelligence (AI) techniques as part of the AI for Curation project. By integrating large language models (LLMs) into our data curation workflow, we aim to streamline the entire process—from data submission to user interaction. This initiative focuses on improving key areas, including data ingestion, curation, and user engagement with curated datasets, impacting multiple domains and a wide user base. First, we are developing tools that can automatically parse data in various formats, using LLMs to convert unstructured data into structured, standardized formats. This reduces the manual effort required for curation, allowing curators to focus on more critical scientific analyses. Additionally, AI and machine learning (ML) models are being implemented to automate data validation and verification, ensuring the highest standards of data quality and reliability. Finally, we are creating a conversational AI agent to interact with the curated scientific studies in OSDR, helping users easily navigate the repository and access relevant data. By enhancing data discoverability and accessibility, these advancements will foster new research opportunities and promote the principles of open science.

Walter Alvarado↗

A Predictive Approach to Eliminating Errors in Software Code

NASA s Metrics Data Program Data Repository is a database that stores problem, product, and metrics data. The primary goal of this data repository is to provide project data to the software community. In doing so, the Metrics Data Program collects artifacts from a large NASA dataset, generates metrics on the artifacts, and then generates reports that are made available to the public at no cost. The data that are made available to general users have been sanitized and authorized for publication through the Metrics Data Program Web site by officials representing the projects from which the data originated. The data repository is operated by NASA s Independent Verification and Validation (IV&V) Facility, which is located in Fairmont, West Virginia, a high-tech hub for emerging innovation in the Mountain State. The IV&V Facility was founded in 1993, under the NASA Office of Safety and Mission Assurance, as a direct result of recommendations made by the National Research Council and the Report of the Presidential Commission on the Space Shuttle Challenger Accident. Today, under the direction of Goddard Space Flight Center, the IV&V Facility continues its mission to provide the highest achievable levels of safety and cost-effectiveness for mission-critical software. By extending its data to public users, the facility has helped improve the safety, reliability, and quality of complex software systems throughout private industry and other government agencies. Integrated Software Metrics, Inc., is one of the organizations that has benefited from studying the metrics data. As a result, the company has evolved into a leading developer of innovative software-error prediction tools that help organizations deliver better software, on time and on budget.

Source record↗

Lake Anna Water Resources: Using NASA Earth Observations to Identify Algal Event Risk Factors in Lake Anna and Help Inform Future Management Practices

Lake Anna is a man-made reservoir and popular recreation destination that spans over 13,000 acres-9,600 public and 3,400 private-in the Piedmont region of Virginia. The Lake has recently seen a rise in documented harmful algal blooms (HABs), which pose a variety of community and ecological concerns and are often exacerbated by anthropogenic factors, such as excess nutrient loads from agricultural runoff. NASA DEVELOP has partnered with the Virginia Department of Environmental Quality (DEQ) to help monitor cyanobacteria and nutrient pollution indicators across Lake Anna. The team utilized Earth observations (EO) and in situ ancillary data to identify and monitor algal bloom trends. The team used Landsat 8 Operational Land Imager (OLI), Landsat 9 OLI-2, Sentinel-2 Multispectral Instrument (MSI), and Sentinel-3 Ocean and Land Color Instrument (OLCI) to analyze water quality variables such as chlorophyll-a, turbidity, surface temperature, and cyanobacteria. Due to the lack of comprehensive in situ data and historic HAB event records, our ability to compare and validate EOs was limited. Additionally, deficient spatial resolutions, along with a geographically complicated shoreline, accentuated the spatial constraints we faced in our analysis. After examining EOs, our results indicated conditions conducive to the formation of HABs within the upper reaches of Lake Anna. Yet, spatially dependent limiting factors may have also influenced where these phenomena developed. When used in concert with existing in situ datasets, NASA EOs provide relevant stakeholders with more comprehensive analyses with which to engage in enhanced monitoring and watershed management.

cyanobacteria↗

Statistical Evaluation of Combined Daily Gauge Observations and Rainfall Satellite Estimations over Continental South America

This paper describes a comprehensive assessment of a new high-resolution, high-quality gauge-satellite based analysis of daily precipitation over continental South America during 2004. This methodology is based on a combination of additive and multiplicative bias correction schemes in order to get the lowest bias when compared with the observed values. Inter-comparisons and cross-validations tests have been carried out for the control algorithm (TMPA real-time algorithm) and different merging schemes: additive bias correction (ADD), ratio bias correction (RAT) and TMPA research version, for different months belonging to different seasons and for different network densities. All compared merging schemes produce better results than the control algorithm, but when finer temporal (daily) and spatial scale (regional networks) gauge datasets is included in the analysis, the improvement is remarkable. The Combined Scheme (CoSch) presents consistently the best performance among the five techniques. This is also true when a degraded daily gauge network is used instead of full dataset. This technique appears a suitable tool to produce real-time, high-resolution, high-quality gauge-satellite based analyses of daily precipitation over land in regional domains.

Vila, Daniel↗

Use of ILTV Control Laws for LaNCETS Flight Research

A report discusses the Lift and Nozzle Change Effects on Tail Shock (LaNCETS) test to investigate the effects of lift distribution and nozzle-area ratio changes on tail shock strength of an F-15 aircraft. Specific research objectives are to obtain inflight shock strength for multiple combinations of nozzle-area ratio and lift distribution; compare results with preflight prediction tools; and update predictive tools with flight results. The objectives from a stability and control perspective are to ensure adequate aircraft stability for the changes in lift distribution and plume shape, and ensure manageable transient from engaging and disengaging the ILTV research control laws. In order to change the lift distribution and plume shape of the F-15 aircraft, a decade-old Inner Loop Thrust Vectoring (ILTV) research control law was used. Flight envelope expansion was performed for the test configuration and flight conditions prior to the probing test points. The approach for achieving the research objectives was to utilize the unique capabilities of NASA's NF-15B-837 aircraft to allow the adjustment of the nozzle-area ratio and/or canard positions by engaging the ILTV research control laws. The ILTV control laws provide the ability to add trim command biases to canard positions, nozzle area ratios, and thrust vectoring through the use of datasets. Datasets consist of programmed test inputs (PTIs) that define trims to change the nozzle-area ratio and/or canard positions. The trims are applied as increments to the normally commanded positions. A LaNCETS non-linear, six-degrees-of-freedom simulation capable of realtime pilot-in-the-loop, hardware-in-the-loop, and non-real-time batch support was developed and validated. Prior to first flight, extensive simulation analyses were performed to show adequate stability margins with the changes in lift distribution and plume shape. Additionally, engagement/disengagement transient analysis was also performed to show manageable transients.

Moua, Cheng↗