Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “validation dataset”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

OC6 Phase Ia - Nonlinear hydrodynamic loading validation dataset

Two validation campaigns were examined within the Offshore Code Comparison Collaboration, Continued, with Correlation and unCertainty (OC6) Phase 1 project to examine the modeling tools' underprediction of loads and motion of a floating wind semisubmersible (semi) at their surge and pitch natural frequencies. These campaigns were performed at the Maritime Research Institute Netherlands (MARIN) in 2017 and 2018. The load cases (LC) considered include: LC1 – Load measurements across semi under current loading; LC2 - Load measurements across semi under forced surge oscillation; LC3 – Load measurements across semi under wave loading, while held fixed; LC4 – Free-decay motion measurements in surge, pitch, and heave; and LC5 – Motion measurements under wave loading. Details on the results from the OC6 Phase Ia project can be found in the reference, “OC6 Phase 1: Investigating the underprediction of low-frequency hydrodynamic loads and responses of floating wind turbines”, J Phys: Conf Series 1618 032033.

17 WIND ENERGY↗
DOE OSTI2024

A globally sampled high-resolution hand-labeled validation dataset for evaluating surface water extent maps

Effective monitoring of global water resources is increasingly critical due to climate change and population growth. Advancements in remote sensing technology, specifically in spatial, spectral, and temporal resolutions, are revolutionizing water resource monitoring, leading to more frequent and high-quality surface water extent maps using various techniques such as traditional image processing and machine learning algorithms. However, satellite imagery datasets contain trade-offs that result in inconsistencies in performance, such as disparities in measurement principles between optical (e.g., Sentinel-2) and radar (e.g., Sentinel-1) sensors and differences in spatial and spectral resolutions among optical sensors. Therefore, developing accurate and robust surface water mapping solutions requires independent validations from multiple datasets to identify potential biases within the imagery and algorithms. However, high-quality validation datasets are expensive to build, and few contain information on water resources. For this purpose, we introduce a globally sampled, high-spatial-resolution dataset labeled using 3 m PlanetScope imagery. Our surface water extent dataset comprises 100 images, each with a size of 1024×1024 pixels, which were sampled using a stratified random sampling strategy covering all 14 biomes. We highlighted urban and rural regions, lakes, and rivers, including braided rivers and coastal regions. We evaluated two surface water extent mapping methods using our dataset – Dynamic World, based on Sentinel-2, and the NASA IMPACT model, based on Sentinel-1. Dynamic World achieved a mean intersection over union (IoU) of 72.16 % and F1 score of 79.70 %, while the NASA IMPACT model had a mean IoU of 57.61 % and F1 score of 65.79 %. Performance varied substantially across biomes, highlighting the importance of evaluating models on diverse landscapes to assess their generalizability and robustness. Our dataset can be used to analyze satellite products and methods, providing insights into their advantages and drawbacks. Our dataset offers a unique tool for analyzing satellite products, aiding the development of more accurate and robust surface water monitoring solutions. The dataset can be accessed via https://doi.org/10.25739/03nt-4f29.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRSDate not supplied

Cross-Measurement Comparisons for a CFD Validation Dataset on Mach 2.5 Axisymmetric Turbulent Shock-Wave/Boundary-Layer Interactions

Experimental data for a shock-wave/boundary-layer interaction has been collected using multiple measurement techniques. Unfortunately, diversity of methods for acquisition begets an aggregation of data which does not directly quantify the same properties of the flowfield. The objective in this paper was to (a) present the collection of flowfield measurements in one venue in a format more usable for those validating CFD models against the data, (b) evaluate the degree to which the experimental data support each other, and (c) highlight the differences and relative advantages/shortcomings of each measurement techniques. To present the various measured quantities into common format, CFD results from a companion paper also submitted for presentation at this meeting are utilized. For the case where the boundary layer remains attached, there is agreement between the various measurements as well as with Reynolds-averaged Navier-Stokes simulation solutions. As the impinging shock strength is increased beyond the point of separating the boundary layer, the congruity of the data wanes. Generally, agreement among the measurements exceeds the degree to which the CFD solutions agree with experiments. This suggests that unmodeled physical phenomena, such as transient motion of the reflected shock and separation bubble, give rise to the discrepancies observed in the computational results.

Shock-wave Boundary-layer interaction↗
NASA NTRS1993

The effects of cloud inhomogeneities upon radiative fluxes, and the supply of a cloud truth validation dataset

A series of cloud and sea ice retrieval algorithms are being developed in support of the Advanced Spaceborne Thermal Emission and Reflection Radiometer (ASTER) Science Team objectives. These retrievals include the following: cloud fractional area, cloud optical thickness, cloud phase (water or ice), cloud particle effective radius, cloud top heights, cloud base height, cloud top temperature, cloud emissivity, cloud 3-D structure, cloud field scales of organization, sea ice fractional area, sea ice temperature, sea ice albedo, and sea surface temperature. Due to the problems of accurately retrieving cloud properties over bright surfaces, an advanced cloud classification method was developed which is based upon spectral and textural features and artificial intelligence classifiers.

Welch, Ronald M.↗
NASA NTRS1994

The effects of cloud inhomogeneities upon radiative fluxes, and the supply of a cloud truth validation dataset

With the growing awareness and debate over the potential changes associated with global climate change, the polar regions are receiving increased attention. Global cloud distributions can be expected to be altered by increased greenhouse forcing. Owing to the similarity of cloud and snow-ice spectral signatures in both the visible and infrared wavelengths, it is difficult to distinguish clouds from surface features in the polar regions. This work is directed towards the development of algorithms for the ASTER and HIRIS science/instrument teams. Special emphasis is placed on a wide variety of cloud optical property retrievals, and especially retrievals of cloud and surface properties in the polar regions.

Source record↗
NASA NTRS1996

The effects of cloud inhomogeneities upon radiative fluxes, and the supply of a cloud truth validation dataset

The ASTER polar cloud mask algorithm is currently under development. Several classification techniques have been developed and implemented. The merits and accuracy of each are being examined. The classification techniques under investigation include fuzzy logic, hierarchical neural network, and a pairwise histogram comparison scheme based on sample histograms called the Paired Histogram Method. Scene adaptive methods also are being investigated as a means to improve classifier performance. The feature, arctan of Band 4 and Band 5, and the Band 2 vs. Band 4 feature space are key to separating frozen water (e.g., ice/snow, slush/wet ice, etc.) from cloud over frozen water, and land from cloud over land, respectively. A total of 82 Landsat TM circumpolar scenes are being used as a basis for algorithm development and testing. Numerous spectral features are being tested and include the 7 basic Landsat TM bands, in addition to ratios, differences, arctans, and normalized differences of each combination of bands. A technique for deriving cloud base and top height is developed. It uses 2-D cross correlation between a cloud edge and its corresponding shadow to determine the displacement of the cloud from its shadow. The height is then determined from this displacement, the solar zenith angle, and the sensor viewing angle.

Welch, Ronald M.↗
DOE OSTI2024

Searching for new physics at μ → e facilities with μ + and π + decays at rest

We investigate the ability of μ → e facilities, Mu2e and COMET, to probe, or discover, new physics with their detector validation datasets. The validation of the detector response may be performed using a dedicated run with μ + , collecting data below the Michel edge, E e ≲ 52 MeV ; an alternative strategy using π + → e + ν e may also be considered. We focus primarily on a search for a monoenergetic e + produced via two-body decays μ + → e + X or π + → e + X , with X a light new physics particle. Mu2e can potentially explore new parameter space beyond present astrophysical and laboratory constraints for a set of well motivated models including axionlike particles with flavor violating couplings ( μ + → e + a ), massive Z ′ bosons ( μ + → Z ′ e + ), and heavy neutral leptons ( π + → e + N ). The projected sensitivities presented herein can be achieved in a matter of days. Published by the American Physical Society 2024

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Detection of surface water temperature variations of Mongolian lakes benefiting from the spatially and temporally gap-filled MODIS data

Lakes provide critical water resources for human activities and ecosystems, particularly in the Mongolian Plateau (MP), which is characterized by a dry climate and a harsh environment. As a region that is sensitive to anthropogenic warming, tracking lake surface water temperature (LSWT) changes in Mongolian lakes is crucial for understanding the consequences of a warming climate on lake ecosystems. However, the long-term monitoring of LSWT is restricted by the spatiotemporal gaps in the raw imagery of remote sensing-based land surface temperature (LST), e.g., the commonly used Moderate Resolution Imaging Spectroradiometer (MODIS) LST products. This study applied an improved gap-filling method by utilizing the discrete cosine transform-based penalized least squares (DCT-PLS) strategy in the spatial domain combined with the linear interpolation (LI) algorithm in the temporal domain. The method was applied to fill gaps in the LSWT imagery of 12 representative lakes across MP. The randomly sampled high-quality MODIS LSWT values in the spatial and temporal domains were excavated as false data gaps and considered “virtual true” validation datasets. The spatial validation results showed that the estimated LSWT for all the lake cases were comparable with the “virtual true” LSWT values, with the average values of the coefficient of determination, mean absolute error, mean square error, and root mean square error being 0.98, 0.38 °C, 0.45 °C, and 0.59 °C, respectively. Meanwhile, the error of nighttime LSWT results was relatively lower than that of daytime LSWT. For temporal interpolation validation, the LI algorithm exhibited relatively better performance and could more objectively indicate the variation in LSWT. Benefiting from the spatially and temporally well-constrained data, we analyzed the interannual and intra-annual change characteristics of the LSWTs of the 12 lakes. The long-term variations of annual and seasonal mean LSWTs in the 12 selected lakes exhibited no evident trends in 2000–2020, while presented apparent interannual fluctuations. The slight changes in the average LSWTs of the 12 selected lakes were in excellent synchronization with the surrounding LST derived from the reanalysis datasets, confirming the widely reported phenomenon of “global warming hiatus” that occurred in the early 21st century. This study improves the understanding of the LSWT variations in Mongolian lakes in response to global climate change. It has the potential to provide an effective approach for monitoring LSWT changes in other large-scale studies.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Curation of Ground-Truth Validated Benchmarking Datasets for Fault Detection & Diagnostics Tools

Fault detection and diagnostics (FDD) analytical tools for heating, ventilation and air conditioning (HVAC) systems represent one of the most active areas of smart building technology development. A diversity of techniques is used for FDD analytics, spanning physical models, black box, and rule-based approaches, and researchers continuously strive to develop improved algorithms. With FDD algorithm numbers now in the hundreds, there is a need for performance evaluation of these algorithms in order to assess improvements, improve costeffectiveness, and to prioritize investment in the further development of these technologies. A persistent challenge of FDD advance has been the lack of common datasets to benchmark the performance accuracy of FDD algorithms. This paper summarizes the successful curation of HVAC operational data, paired with validated ground-truth information regarding the presence and absence of faults. The current dataset, consisting of both simulation and experimental data, will evolve to include a larger set of HVAC systems with the objective of creating the largest publicly available dataset to be used by FDD developers, users, and researchers to compare and contrast performance accuracy across FDD algorithms, helping to drive improvements that will spur greater market adoption of FDD tools. Furthermore, in order to avoid previously observed issues with contributed datasets and ensure high quality and consistency of future submissions, the development of data validation and ground-truth assessment protocol is detailed in this study.

Casillas, Armando↗
DOE OSTI2026

Multi-omics data resource: Data package 25 (Pck025)

This data package comprises omics datasets from human pancreatic islets treated with IL-1β + IFNγ or with estrogen (E2) for 18 h. Two RNA-seq datasets are available: the first is a discovery dataset involving human islets treated with or without IL-1β + IFNγ for 18 hours; the second is a validation dataset, where human islets are treated with or without IL-1β + IFNγ or E2 for 18 hours. DIA proteomic analysis was performed on the same validation dataset samples. Data contributors: Kiersten L. Webster, Sarah Tersey & Raghavendra G. Mirmir: Kovler Diabetes Center and Department of Medicine, The University of Chicago, Chicago, IL, 60637, USA. Soumyadeep Sarkar, Raghavendra Mirmira, Ernesto S. Nakayasu: Biological Sciences Division, Pacific Northwest National Laboratory, Richland, WA, 99354, USA. Data repository: RNA-seq: GSE310965 Proteomics: MSV000101892 Publication: PMID 41279069

Sarkar, Soumyadeep [Pacific Northwest National Lab↗
DOE OSTI2020

A Pattern-Recognition-Based Ensemble Data Imputation Framework for Sensors from Building Energy Systems

Building operation data are important for monitoring, analysis, modeling, and control of building energy systems. However, missing data is one of the major data quality issues, making data imputation techniques become increasingly important. There are two key research gaps for missing sensor data imputation in buildings: the lack of customized and automated imputation methodology, and the difficulty of the validation of data imputation methods. In this paper, a framework is developed to address these two gaps. First, a validation data generation module is developed based on pattern recognition to create a validation dataset to quantify the performance of data imputation methods. Second, a pool of data imputation methods is tested under the validation dataset to find an optimal single imputation method for each sensor, which is termed as an ensemble method. The method can reflect the specific mechanism and randomness of missing data from each sensor. The effectiveness of the framework is demonstrated by 18 sensors from a real campus building. The overall accuracy of data imputation for those sensors improves by 18.2% on average compared with the best single data imputation method.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
NASA NTRS2017

Mapping 2000 2010 Impervious Surface Change in India Using Global Land Survey Landsat Data

Understanding and monitoring the environmental impacts of global urbanization requires better urban datasets. Continuous field impervious surface change (ISC) mapping using Landsat data is an effective way to quantify spatiotemporal dynamics of urbanization. It is well acknowledged that Landsat-based estimation of impervious surface is subject to seasonal and phenological variations. The overall goal of this paper is to map 200-02010 ISC for India using Global Land Survey datasets and training data only available for 2010. To this end, a method was developed that could transfer the regression tree model developed for mapping 2010 impervious surface to 2000 using an iterative training and prediction (ITP) approach An independent validation dataset was also developed using Google Earth imagery. Based on the reference ISC from the validation dataset, the RMSE of predicted ISC was estimated to be 18.4%. At 95% confidence, the total estimated ISC for India between 2000 and 2010 is 2274.62 +/- 7.84 sq km.

Wang, Panshi↗
DOE OSTI2020

Comparison of linear regression, k-nearest neighbour and random forest methods in airborne laser-scanning-based prediction of growing stock

Abstract In this study, for five sites around the world, we look at the effects of different model types and variable selection approaches on forest yield modelling performances in an area-based approach (ABA). We compared ordinary least squares regression (OLS), k-nearest neighbours (kNN) and random forest (RF). Our objective was to test if there are systematic differences in accuracy between OLS, kNN and RF in ABA predictions of growing stock volume. The analyses are based on a 5-fold cross-validation at five study sites: an eucalyptus plantation, a temperate forest and three different boreal forests. Two completely independent validation datasets were also available for two of the boreal sites. For the kNN, we evaluated multiple measures of distance including Euclidean, Mahalanobis, most similar neighbour (MSN) and an RF-based distance metric. The variable selection approaches we examined included a heuristic approach (for OLS, kNN and RF), exhaustive search among all combinations (OLS only) and all variables together (RF only). Performances varied by model type and variable selection approaches among sites. OLS and RF had similar accuracies and were more efficient than any of the kNN variants. Variable selection did not affect RF performance. Heuristic and exhaustive variable selection performed similarly for OLS. kNN fared the poorest amongst model types, and kNN with RF distance was prone to overfitting when compared with a validation dataset. Additional caution is therefore required when building kNN models for volume prediction though ABA, being preferable instead to opt for models based on OLS with some variable selection, or RF with all variables together.

Cosenza, Diogo N.↗
NASA NTRS2001

Extraction of Airport Features from High Resolution Satellite Imagery for Design and Risk Assessment

The LPA Group, consisting of 17 offices located throughout the eastern and central United States is an architectural, engineering and planning firm specializing in the development of Airports, Roads and Bridges. The primary focus of this ARC project is concerned with assisting their aviation specialists who work in the areas of Airport Planning, Airfield Design, Landside Design, Terminal Building Planning and design, and various other construction services. The LPA Group wanted to test the utility of high-resolution commercial satellite imagery for the purpose of extracting airport elevation features in the glide path areas surrounding the Columbia Metropolitan Airport. By incorporating remote sensing techniques into their airport planning process, LPA wanted to investigate whether or not it is possible to save time and money while achieving the equivalent accuracy as traditional planning methods. The Affiliate Research Center (ARC) at the University of South Carolina investigated the use of remotely sensed imagery for the extraction of feature elevations in the glide path zone. A stereo pair of IKONOS panchromatic satellite images, which has a spatial resolution of 1 x 1 m, was used to determine elevations of aviation obstructions such as buildings, trees, towers and fence-lines. A validation dataset was provided by the LPA Group to assess the accuracy of the measurements derived from the IKONOS imagery. The initial goal of this project was to test the utility of IKONOS imagery in feature extraction using ERDAS Stereo Analyst. This goal was never achieved due to problems with ERDAS software support of the IKONOS sensor model and the unavailability of imperative sensor model information from Space Imaging. The obstacles encountered in this project pertaining to ERDAS Stereo Analyst and IKONOS imagery will be reviewed in more detail later in this report. As a result of the technical difficulties with Stereo Analyst, ERDAS OrthoBASE was used to derive aviation obstruction measurements for this project. After collecting ancillary data such as GPS locations, South Carolina Geodetic Survey and Aero Dynamics ground survey points to set up the OrthoBASE Block File, measurements were taken of the various glide path obstructions and compared to the validation dataset. This process yielded the following conclusions: The IKONOS stereo model in conjunction with Imagine OrthoBASE can provide The LPA Group with a fast and cost efficient method for assessing aviation obstructions. Also, by creating our own stereo model we achieved any accuracy better currently available commercial products.

Robinson, Chris↗
NASA NTRS2021

Australian tidal currents – assessment of a barotropic model (COMPAS v1.3.0 rev6631) with an unstructured grid

While the variations of tidal range are large and fairly well known across Australia (less than 1 m near Perth but more than 14 m in King Sound), the properties of the tidal currents are not. We describe a new regional model of Australian tides and assess it against a validation dataset comprising tidal height and velocity constituents at 615 tide gauge sites and 95 current meter sites. The model is a barotropic implementation of COMPAS, an unstructured-grid primitive-equation model that is forced at the open boundaries by TPXO9v1. The mean absolute error (MAE) of the modelled M2 height amplitude is 8.8 cm, or 12 % of the 73 cm mean observed amplitude. The MAE of phase (10°), however, is significant, so the M2 mean magnitude of vector error (MMVE, 18.2 cm) is significantly greater. The root sum square over the eight major constituents is 26 % of the observed amplitude. We conclude that while the model has skill at height in all regions, there is definitely room for improvement (especially at some specific locations). For the M2 major axis velocity amplitude, the MAE across the 95 current meter sites, where the observed amplitude ranges from 0.1 to 156 cm s −1 , is 6.9 cm s −1 , or 22 % of the 31.7 cm s −1 observed mean. This nationwide average result is encouraging, but it conceals a very large regional variation. Relative errors of the tidal current amplitudes on the narrow shelves of New South Wales (NSW) and Western Australia exceed 100 %, but tidal currents are weak and negligible there compared to non-tidal currents, so the tidal errors are of little practical significance. Looking nationwide, we show that the model has predictive value for much of the 79 % of Australia's shelf seas where tides are a major component of the total velocity variability. In descending order this includes the Bass Strait, the Kimberley to Arnhem Land, and southern Great Barrier Reef regions. There is limited observational evidence to confirm that the model is also valuable for currents in other regions across northern Australia. We plan to commence publishing “unofficial” tidal current predictions for chosen regions in the near future based on both our COMPAS model and the validation dataset we have assembled.

Tidal currents↗