Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Ground truth”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Investigations using data from LANDSAT 2

The author has identified the following significant results. Ground truth data collected in coastal areas confirm the sedimentation base line at five fathom depth and less. Forestry ground truth at Supati in Sunderbasn was found to conform with stratifications in aerial photos and in some satellite imagery.

Hossain, A.↗

Secondary error analysis: The evaluation of analyst dot labeling

The author has identified the following significant results. From this examination of 25 test segments using Al labeling and ground truth labeling, the PCC on type 1 dots was found to be signficantly better for both types of ground truth labeled procedures than the PCC obtained using Al labeling. No significant difference in the PCC was found for type 2 dots. However, in all three treatments, the type 2 dots included pixels which fell on boundaries or were mixed pixels. This accounted for all PCC2 values being equally low. The proportion estimates achieved in these classifications showed no significant differences between procedures.

Havens, K. A.↗

Land use and land cover mapping: City of Palm Bay, Florida

Two different computer systems were compared for use in making land use and land cover maps. The Honeywell 635 with the LANDSAT signature development program (LSDP) produced a map depicting general patterns, but themes were difficult to classify as specific land use. Urban areas were unclassified. The General Electric Image 100 produced a map depicting eight land cover categories classifying 68 percent of the total area. Ground truth, LSDP, and Image 100 maps were all made to the same scale for comparison. LSDP agreed with the ground truth 60 percent and 64 percent within the two test areas compared and Image 100 was in agreement 70 percent and 80 percent.

Barile, D. D.↗

Ohio River main stem study - The role of geographic information systems and remote sensing in flood damage assessments

The Pittsburgh District, Corps of Engineers, has conducted feasibility analyses of various procedures for performing flood damage assessments along the main stem of the Ohio River. Procedures using traditional, although highly automated, techniques and those based on geographic information systems have been evaluated at a test site, the City of New Martinsville, Wetzel County, WV. The flood damage assessments of the test site developed from an automated, conventional structure-by-structure appraisal served as the ground truth data set. A geographic information system was developed for the test site which includes data on hydraulic reach, ground and reference flood elevations, and land use/cover. Damage assessments were made using land use mapping developed from an exhaustive field inspection of each tax parcel. This ground truth condition was considered to provide the best comparison of flood damages to the conventional approach. Also, four land use/cover data sets were developed from Thematic Mapper Simulator (TMS) and Landsat-4 Thematic Mapper (TM) data. One of these was also used to develop a damage assessment of the test site. This paper presents the comparative absolute and relative accuracies of land use/cover mapping and flood damage assessments, and the recommended role of geographic information systems aided by remote sensing for conducting flood damage assessments and updates along the main stem of the Ohio River.

Edwardo, H. A.↗

Glaciological studies in the central Andes using AIRSAR/TOPSAR

The interaction of climate and topography in mountainous regions is dramatically expressed in the spatial distribution of glaciers and snowcover. Monitoring existing alpine glaciers and snow extent provides insight into the present mountain climate system and how it is changing, while mapping the positions of former glaciers as recorded in landforms such as cirques and moraines provide a record of the large past climate change associated with the last glacial maximum. The Andes are an ideal mountain range in which to study the response of snow and ice to past and present climate change. Their expansive latitudinal extent offers the opportunity to study glaciers in diverse climate settings from the tropical glaciers of Peru and Bolivia to the ice caps and tide-water glaciers of sub-polar Patagonia. SAR has advantages over traditional passive remote sensing instruments for monitoring present snow and ice and differentiating moraine relative ages. The cloud penetrating ability of SAR is indispensable for perennially cloud covered mountains. Snow and ice facies can be distinguished from SAR's response to surface roughness, liquid water content and grain size distribution. The combination of SAR with a coregestered high-resolution DEM (TOPSAR) provides a promising tool for measuring glacier change in three dimensions, thus allowing ice volume change to be measured directly. The change in moraine surface roughness over time enables SAR to differentiate older from younger moraines. Polarimetric SAR data have been used to distinguish snow and ice facies and relatively date moraines. However, both algorithms are still experimental and require ground truth verification. We plan to extend the SAR classification of snow and ice facies and moraine age beyond the ground truth sites to throughout the Cordillera Real to provide a regional view of past and present snow and ice. The high resolution DEM will enhance the SAR moraine dating technique by discriminating relative ages based on moraine slope degradation.

Forster, Richard R.↗

A Systematic Approach for Real-Time Operator Functional State Assessment

A task overload condition often leads to high stress for an operator, causing performance degradation and possibly disastrous consequences. Just as dangerous, with automated flight systems, an operator may experience a task underload condition (during the en-route flight phase, for example), becoming easily bored and finding it difficult to maintain sustained attention. When an unexpected event occurs, either internal or external to the automated system, the disengaged operator may neglect, misunderstand, or respond slowly/inappropriately to the situation. In this paper, we discuss an approach for Operator Functional State (OFS) monitoring in a typical aviation environment. A systematic ground truth finding procedure has been designed based on subjective evaluations, performance measures, and strong physiological indicators. The derived OFS ground truth is continuous in time compared to a very sparse estimation of OFS based on an expert review or subjective evaluations. It can capture the variations of OFS during a mission to better guide through the training process of the OFS assessment model. Furthermore, an OFS assessment model framework based on advanced machine learning techniques was designed and the systematic approach was then verified and validated with experimental data collected in a high fidelity Boeing 737 simulator. Preliminary results show highly accurate engagement/disengagement detection making it suitable for real-time applications to assess pilot engagement.

Zhang, Guangfan↗

AVE/VAS experiment: Synoptic summary and preliminary results

The AVE/VAS ground truth field experiment was conducted during the Spring of 1982 severe storms and weather research program. The experiment consisted of acquiring correlative ground truth measurements of rawinsonde data, corresponding to the time and space resolutions of VAS sounding data. The objectives of the AVE/VAS experiment are: (1) to acquire four dimensional data sets of the actual atmospheric structure down to the mesoscale; (2) to provide measurements for quantitative comparisons between ground based and VAS-derived atmospheric parameters; (3) to evaluate the impact of VAS data on diagnostic analysis of structural features and dynamical processes important to the development of mesoscale phenomena; (4) to evaluate the impact of VAS data on numerical model simulations, nowcasting, and other mesoscale forecasting systems.

Jedlovec, G. J.↗

EdgeAI: Machine learning via direct attached accelerator for streaming data processing at high shot rate x-ray free-electron lasers

We present a case for low batch-size inference with the potential for adaptive training of a lean encoder model. We do so in the context of a paradigmatic example of machine learning as applied in data acquisition at high data velocity scientific user facilities such as the Linac Coherent Light Source-II x-ray Free-Electron Laser. We discuss how a low-latency inference model operating at the data acquisition edge can capitalize on the naturally stochastic nature of such sources. We simulate the method of attosecond angular streaking to produce representative results whereby simulated input data reproduce high-resolution ground truth probability distributions. By minimizing the mean-squared error between the decoded output of the latent representation and the ground truth distributions, we ensure that the encoding layers and resulting latent representation maintains full fidelity for any downstream task, be it classification or regression. We present throughput results for data-parallel inference of various batch sizes, some with throughput exceeding 100 k images per second. We also show in situ training below 10 s per epoch for the full encoder–decoder model as would be relevant for streaming and adaptive real-time data production at our nation’s scientific light sources.

97 MATHEMATICS AND COMPUTING↗

Analysis of usefulness of ERTS-1 MSS data in detecting and measuring coastal marshes

The author has identified the following significant results. The usefulness of ERTS-1 data in detecting and measuring coastal marshes has been analyzed. The data chosen for study was taken over the Houston Area Test Site on August 29, 1972. A study site was selected which contained marshes of varying size. Using a computerized clustering algorithm which groups areas of spectral homogeneity, it was possible to distinguish twenty-five classes or features. To determine the total acreage of the marshes, the pure picture elements were counted. Using a technique developed by the team, the boundary picture elements were also counted. Ground truth was provided from rectified, enlarged, and scaled high altitude aircraft photography acquired during the same time frame. Comparison of the ground truth coverage depicted by the aircraft photography to the clustering acreage displayed from the ERTS-1 data showed a percentage of accuracy ranging from 89% to 99% for determining areal extent of coastal marshes.

Erb, R. B.↗

Measuring and distinguishing compositional and maturity properties of lunar soils by remote VIS-NIR spectroscopy

Space weathering on the lunar surface affects the spectra/optical character of an exposed lunar soil in three ways: the reflectance is reduced, absorption band depths are reduced, and a red-sloped continuum is created and increased with exposure. As a result, the spectrum of a lunar soil is dependent upon both the degree of exposure at the lunar surface and the original composition. It is critical to the remote analysis of lunar soils to differentiate between the optical effects of maturity and the effects of composition. In the laboratory, it is possible to determine and consequently distinguish the degree of exposure, or soil maturity, as measured by parameters such as I(sub s)/FeO (e.g., 1; mature defined as I(sub s)/FeO greater than or equal to 60), and the composition, as measured by various chemical and petrographical techniques. Lunar soils returned by the Apollo missions provide important ground truth for developing methods for remotely measuring the maturity and the concentration of Fe-bearing minerals in lunar soil. The ground truth spectral data analyzed are from the John Adams lunar soil spectra collection. Soils collected from or near highland terrains are emphasized in the discussion. The mineralogical makeup of mare soils results in behavior somewhat different from highland soils.

Fischer, Erich M.↗

A novel conditional generative model for efficient ensemble forecasts of state variables in large-scale geological carbon storage

Integrating monitoring data to efficiently update reservoir pressure and CO 2 plume distribution forecasts presents a significant challenge in geological carbon storage (GCS) applications. Inverse modeling techniques are commonly used to fuse observational data and refine reservoir model parameters, thereby improving state variable forecasts. However, these techniques often rely on linear or Gaussian assumptions, which can limit their effectiveness in accurately predicting state variables. Moreover, simulating large-scale three-dimensional (3D) GCS problems is computationally expensive, making iterative runs in inverse problems prohibitive. To address these challenges, we propose a conditional generative model utilizing the score-based diffusion method for real-time 3D pressure and saturation field distribution predictions. Our approach involves solving the score function with a mini-batch-based Monte Carlo estimator to generate labeled data. This data is subsequently employed to train a fully connected neural network, enabling it to learn the conditional sample generator within a supervised learning framework. This method enables the rapid generation of a large ensemble of predictions, facilitating comprehensive uncertainty quantification of state variables. Here we applied our method to forecast the dynamic 3D distributions of pressure and saturation fields over a 30-year injection period. The statistical assessment with low root mean square error (RMSE) values demonstrates that our method can accurately predict the spatiotemporal distributions of both pressure and saturation fields. Moreover, the developed conditional generative model shows high computational efficiency by generating 100 ensemble forecasts of 3D state variables in less than 10 min. The consistency between ensemble averages and ground truth values further illustrates the model’s capability to capture state variable dynamics during the CO 2 plume injection process. Notably, the ground truth values fall within the ensemble forecasts, indicating that our uncertainty quantification effectively captures variability and potential noise in the observations. Thus, the developed conditional generative model proves to be a more efficient, accurate, and practical tool for GCS applications, facilitating timely risk analysis and informed decision-making.

58 GEOSCIENCES↗

Machine learning predictions of near-surface permafrost extent at Teller 27, Teller 47, and the Kougarok 64 Hillslope sites on the Seward Peninsula, Alaska: Supporting Data

Geophysical surveys were conducted at the NGEE Arctic Teller mile marker 27 site, Teller mile marker 47 site, and Kougarok mile marker 64 site during the summers of 2018, 2019, and 2021. Additional data was collected at Teller mile marker 47 during September 2021 and August 2022. These surveys were used to identify locations of near-surface permafrost during the period of maximum seasonal thaw depth for ground truth data used in machine learning predictions of near-surface permafrost extent at each site. This dataset contains CSV files of ground truth observations of near-permafrost presence or absence for each site, where PF = 1 indicates permafrost presence and PF = 0 indicates permafrost absence. The dataset also includes 2 sets of binary rasters (WGS84 UTM zone 3) of permafrost extent for each site using 1) all of the training data and 2) the transferred model. For both sets of rasters, 0 = non-permafrost and 1 = permafrost. Included are 6 *.tif files and 5 *.csv files that include a data dictionary (dd.csv) and file-level metadata (flmd.csv). This dataset is in support of the paper "Machine learning-derived high-resolution maps of near-surface permafrost for three watersheds on the Seward Peninsula, Alaska" that is in review (May 2023). The Next-Generation Experiments: Arctic (NGEE Arctic), a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

Label Identification from Statistical Tabulation (LIST) temporal extendability study

The author has identified the following significant results. The most apparent contributors to the problem of poor temporal extension of LIST are the drastic changes in the brightness keys and an inadequate set of AI responses in Phase 3. The brightness trajectories change drastically from Phase 3 to the transition year (TY). Removing brightness channels from the discriminant does not completely correct the lack of extendability. Removing brightness increases the accuracy of the extension from Phase 3 to TY from 57.7 percent to 64.18 percent. The removal of the Al keys increases accuracy to 65.76 percent. Although the latter increase appears insignificant when compared to the first, the removal of only the Al keys increased accuracy to 63.58 percent. Proper weighting of the responses explains 73.8 percent of the ground truth labels but only 56.7 percent of the Al labels. By contrast, the TY responses which were weighted to explain the TY ground truth labels fared equally well, explaining 73.6 percent of those labels and 87.1 percent of the Al labels.

Dennis, T. B.↗

Meteorological radar methods for validating space observations of precipitation

Meteorological approaches to verification of space measurements of rainfall are examined; validation of Tropical Rainfall Measuring Mission (TRMM) observations is expected to depend significantly on ground-based radars. Two methods of comparison are initially contemplated. TRMM rainfall data over time periods of a month for large areas (500 x 500 km) are averaged and compared with similarly averaged ground truth measurements. Both the rainfall and height distribution data from TRMM are compared with the instantaneous values observed at one or more 'ground truth' stations and from airborne radar and radiometers as available.

Thiele, Otto W.↗

Late diagenetic indicators of buried oil and gas. 2: Direct detection experiment at Cement and Garza fields, Oklahoma and Texas, using enhanced LANDSAT 1 and 2 images

The author has identified the following significant results. The Cement oil field, Oklahoma, was a test site for an experiment designed to evaluate LANDSAT's capability to detect an alteration zone in surface rocks caused by hydrocarbon microseepage. Loss of iron and impregnation of sandstone by carbonate cements and replacement of gypsum by calcite were the major alteration phenomena at Cement. The bedrock alterations were partially masked by unaltered overlying beds, thick soils, and dense natural and cultivated vegetation. Interpreters, biased by detailed ground truth, were able to map the alteration zone subjectively using a magnified, filtered, and sinusoidally stretched LANDSAT composite image; other interpreters, unbiased by ground truth data, could not duplicate that interpretation.

Donovan, T. J.↗

Effects of spatial sampling of satellite data on derived surface solar irradiance

The effect of different spatial sampling of satellite observations on retrieved surface solar irradiance was studied. The results indicate that sampled (8-km resolution) and areally averaged (50-km resolution) visible brightness is highly correlated; the correlation has a regional, seasonal, and diurnal dependence. Using the two different resolutions of satellite observations, retrieved surface solar irradiance was computed for a whole annual cycle. On the average, the results differed by about 8-9 percent. Therefore, to validate satellite methods against ground truth to an accuracy which exceeds 8-9 percent of the mean, attention should be given to the type of satellite data and ground truth used in the validation process.

Pinker, R. T.↗

A Convolutional Neural Network for Enhancement of Multi-Scale Localization in Granular Metallic Representative Unit Cells

A convolutional neural network was used to enhance the localization of strain and stress for a generalized method of cells model of a metallic microstructure. Enhanced shear strains, measured in terms of the linear regression coefficients as a function of ground truth strains, were improved from inaccurate and uncorrelated (slope=0.003, Rsq=0.000) to accurate and well correlated (slope=0.890, Rsq=0.882) relative to ground truth (slope=1.0, Rsq=1.0). In applying the convolutional neural network, a convolutional stride of 1.0 (padding=’same’) was only modestly effective while strides of 2 or 3 were more effective yet at higher cost. Additional convolutional layers were generally more expensive than additional dense layers, often with limited benefit. The accuracy of enhanced localized shear strains and stress is expected to yield benefits for damage progression models, especially in the context of hierarchical multi-scale methods where the generalized method of cells is applied at the intermediate scale.

Machine Learning↗

Severe storm electricity

Severe storms and lightning were measured with a NASA U2 and ground based facilities, both fixed base and mobile. Aspects of this program are reported. The following results are presented: (1) ground truth measurements of lightning for comparison with those obtained by the U2. These measurements include flash type identification, electric field changes, optical waveforms, and ground strike location; (2) simultaneous extremely low frequency (ELF) waveforms for cloud to ground (CG) flashes; (3) the CG strike location system (LLP) using a combination of mobile laboratory and television video data are assessed; (4) continued development of analog-to-digital conversion techniques for processing lightning data from the U2, mobile laboratory, and NSSL sensors; (5) completion of an all azimuth TV system for CG ground truth; (6) a preliminary analysis of both IC and CG lightning in a mesocyclone; and (7) the finding of a bimodal peak in altitude lightning activity in some storms in the Great Plains and on the east coast. In the forms on the Great Plains, there was a distinct class of flash what forms the upper mode of the distribution. These flashes are smaller horizontal extent, but occur more frequently than flashes in the lower mode of the distribution.

Rust, W. D.↗