Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Ground truth”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Reconstructing PM 2.5 Data Record for the Kathmandu Valley Using a Machine Learning Model

This paper presents a method for reconstructing the historical hourly concentrations of particulate matter 2.5 (PM2.5) over the Kathmandu Valley from 1980 to the present. The method uses a machine learning model that is trained using PM2.5 readings from US Embassy (Phora Durbar) as a ground truth, and the meteorological data from Modern-Era Retrospective Analysis for Research and Applications v2 (MERRA2) as input. The Extreme Gradient Boosting (XGBoost) model acquires a credible 10-fold cross-validation (CV) score of ~83.4%, an r2-score of ~84%, a Root Mean Square Error (RMSE) of ~15.82 µg/m3, and a Mean Absolute Error (MAE) of ~10.27 µg/m3. Further demonstrating the model's applicability to years other than those for which truth values are unavailable, the multiple cross-test with an unseen data set offered r2-scores for 2018, 2019, and 2020 ranging from 56% to 67%. The model-predicted data agrees with true values and indicates that MERRA2 underestimates PM2.5 over the region. It strongly agrees with ground-based evidence showing substantially higher mass concentrations in the dry pre- and post-monsoon seasons than in the monsoon months. It also shows a strong anti-correlation between PM2.5 concentration and humidity. The results also demonstrate that none of the years fulfilled the annual mean air quality index (AQI) standards set by the World Health Organization (WHO).

machine learning↗

Severe storm electricity

During FY-85, Researchers conducted a field program and analyzed data. The field program incorporated coordinated measurements made with a NASA U2. Results include the following: (1) ground truth measurements of lightning for comparison with those obtained by the U2; (2) analysis of dual-Doppler radar and dual-VHF lightning mapping data from a supercell storm; (3) analysis of synoptic conditions during three simultaneous storm systems on 13 May 1983 when unusually large numbers of positive cloud-to-ground (+CG) flashes occurred; (4) analysis of extremely low frequency (ELF) wave forms; and (5) an assessment of a cloud -ground strike location system using a combination of mobile laboratory and fixed-base TV video data.

Rust, W. D.↗

Ground Testing of the MISSE-16 Materials

The harsh space environment imposes very stringent requirements upon spacecraft materials, especially those located on exterior surfaces of space objects in low Earth orbit (LEO). As humankind moves from space exploration to space commercialization, these materials may have to last for 15–20 years without considerable degradation of their optical, electrical, mechanical, and thermal properties. Operational requirements dictate that these materials continue to function according to expectations. Hence, we must understand the effects of the space environment on materials currently in use as well as on untested materials. For the years, the Materials International Space Station Experiment Flight Facility (MISSE-FF) have flown many different materials to investigate the effect of LEO space weather exposure on the performance and durability of materials and devices. The MISSE-16 scientific team members plan to launch fifteen different novel and well-characterized spacecraft-relevant materials to the LEO environment for a duration of six months during the MISSE-16 mission. Changes in spectral reflectivity will be measured throughout the mission as the samples are exposed to the space environment. The same chemical damage the produces changes in optical reflectance also causes changes in numerous other physical properties such as electrical conductivity, mechanical strength, and chemical reactivity. Correlation of the changes in each of these properties as a function of radiation type, flux, and fluence allows various material properties to be inferred from one experimentally tractable measurement: color change. Flying identical test fixtures on the ram, zenith, and wake positions of the MISSE-FF, collecting spectrally resolved images of the materials, and concomitantly measuring the ambient space environment allows deconvolution of the material effects which occur as a result of exposure to neutral atomic oxygen (AO), unfiltered solar ultraviolet (UV) radiation, and electrons. The flight experiment will function as a ground truth reference for our team’s ongoing laboratory-based space weather-material interactions experiments. Comparison of the MISSE-16 data with extensive testing of “flight-duplicate” samples under simulated space weather conditions will enable development of chemical models for prediction of material degradation. This paper discusses preliminary results from the ground test campaign including measurements of UV/VIS/IR reflectance spectra, bidirectional reflectance distribution function (BRDF), surface potential decay, and surface morphology under electron and AO exposure.

Elena A. Plis↗

Probabilistic Forecasting of Ground Magnetic Perturbation Spikes at Mid-Latitude Stations

The prediction of large fluctuations in the ground magnetic field (dB/dt) is essential for preventing damage from Geomagnetically Induced Currents. Directly forecasting these fluctuations has proven difficult, but accurately determining the risk of extreme events can allow for the worst of the damage to be prevented. Here we trained Convolutional Neural Network models for eight mid-latitude magnetometers to predict the probability that dB/dt will exceed the 99th percentile threshold 30–60 min in the future. Two model frameworks were compared, a model trained using solar wind data from the Advanced Composition Explorer (ACE) satellite, and another model trained on both ACE and SuperMAG ground magnetometer data. The models were compared to examine if the addition of current ground magnetometer data significantly improved the forecasts of dB/dt in the future prediction window. A bootstrapping method was employed using a random split of the training and validation data to provide a measure of uncertainty in model predictions. The models were evaluated on the ground truth data during eight geomagnetic storms and a suite of evaluation metrics are presented. The models were also compared to a persistence model to ensure that the model using both datasets did not over-rely on dB/dt values in making its predictions. Overall, we find that the models using both the solar wind and ground magnetometer data had better metric scores than the solar wind only and persistence models, and was able to capture more spatially localized variations in the dB/dt threshold crossings.

Michael Coughlan↗

Field Observations of Soil Moisture Variability across Scales

In this study, over 36,000 ground-based soil moisture measurements collected during the SGP97, SGP99, SMEX02, and SMEX03 field campaigns were analyzed to characterize the behavior of soil moisture variability across scales. The field campaigns were conducted in Oklahoma and Iowa in the central USA. The Oklahoma study region is sub-humid with moderately rolling topography, while the Iowa study region is humid with low-relief topography. The relationship of soil moisture standard deviation, skewness and the coefficient of variation versus mean moisture content was explored at six distinct extent scales, ranging from 2.5 m to 50 km. Results showed that variability generally increases with extent scale. The standard deviation increased from 0.036 cm3/cm3 at the 2.5-m scale to 0.071 cm3/cm3 at the 50-km scale. The log standard deviation of soil moisture increased linearly with the log extent scale, from 16 m to 1.6 km, indicative of fractal scaling. The soil moisture standard deviation versus mean moisture content exhibited a convex upward relationship at the 800-m and 50-km scales, with maximum values at mean moisture contents of roughly 0.17 cm3/cm3 and 0.19 cm3/cm3, respectively. An empirical model derived from the observed behavior of soil moisture variability was used to estimate uncertainty in the mean moisture content for a fixed number of samples at the 800-m and 50-km scales, as well as the number of ground-truth samples needed to achieve 0.05 cm3/cm3 and 0.03 cm3/cm3 accuracies. The empirical relationships can also be used to parameterize surface soil moisture variations in land surface and hydrological models across a range of scales. To our knowledge, this is the first study to document the behavior of soil moisture variability over this range of extent scales using ground-based measurements. Our results will contribute not only to efficient and reliable satellite validation, but also to better utilization of remotely sensed soil moisture products for enhanced modeling and prediction.

Famiglietti, James S.↗

A comparison of airborne and ground-based radar observations with rain gages during the CaPE experiment

The vicinity of KSC, where the primary ground truth site of the Tropical Rainfall Measuring Mission (TRMM) program is located, was the focal point of the Convection and Precipitation/Electrification (CaPE) experiment in Jul. and Aug. 1991. In addition to several specialized radars, local coverage was provided by the C-band (5 cm) radar at Patrick AFB. Point measurements of rain rate were provided by tipping bucket rain gage networks. Besides these ground-based activities, airborne radar measurements with X- and Ka-band nadir-looking radars on board an aircraft were also recorded. A unique combination data set of airborne radar observations with ground-based observations was obtained in the summer convective rain regime of central Florida. We present a comparison of these data intending a preliminary validation. A convective rain event was observed simultaneously by all three instrument types on the evening of 27 Jul. 1991. The high resolution aircraft radar was flown over convective cells with tops exceeding 10 km and observed reflectivities of 40 to 50 dBZ at 4 to 5 km altitude, while the low resolution surface radar observed 35 to 55 dBZ echoes and a rain gage indicated maximum surface rain rates exceeding 100 mm/hr. The height profile of reflectivity measured with the airborne radar show an attenuation of 6.5 dB/km (two way) for X-band, corresponding to a rainfall rate of 95 mm/hr.

Satake, Makoto↗

A comparison of airborne and ground-based radar observations with rain gages during the CaPE experiment

The vicinity of KSC, where the primary ground truth site of the Tropical Rainfall Measuring Mission (TRMM) program is located, was the focal point of the Convection and Precipitation/Electrification (CaPE) experiment in July and Aug. 1991. In addition to several specialized radars, local coverage was provided by the C-band (5 cm) radar at Patrick AFB. Point measurements of rain rate were provided by tipping bucket rain gage networks. Besides these ground-based activities, airborne radar measurements with X- and Ka-band nadir-looking radars on board an aircraft were also recorded. A unique combination data set of airborne radar observations with ground-based observations was obtained in the summer convective rain regime of central Florida. We present a comparison of these data intending a preliminary validation. A convective rain event was observed simultaneously by all three instrument types on the evening of 27 July 1991. The high resolution aircraft radar was flown over convective cells with tops exceeding 10 km and observed reflectivities of 40 to 50 dBZ at 4 to 5 km altitude, while the low resolution surface radar observed 35 to 55 dBZ echoes and a rain gage indicated maximum surface rain rates exceeding 100 mm/hr. The height profile of reflectivity measured with the airborne radar show an attenuation of 6.5 dB/km (two way) for X-band, corresponding to a rainfall rate of 95 mm/hr.

Satake, Makoto↗

A technique for correcting ERTS data for solar and atmospheric effects

The author has identified the following significant results. Based on processing ERTS CCTs and ground truth measurements collected on Michigan test site for January through June 1973 the following results are reported: (1) atmospheric transmittance varies from: 70 to 85% in band 4, 77 to 90% in band 5, 80 to 94% in band 6, and 84 to 97% in band 7 for one air mass; (2) a simple technique was established to determine atmospheric scattering seen by ERTS-1 from ground-based measurements of sky radiance. For March this scattering was found to be equivalent to that produced by a target having a reflectance of 11% in band 4, 5% in band 5, 3% in band 6, and 1% in band 7; (3) computer ability to classify targets under various atmospheric conditions was determined. Classification accuracy on some targets (i.e. bare soil, tended grass, etc.) hold up even under the most severe atmospheres encountered, while performance on other targets (trees, urban, rangeland, etc.) degrades rapidly when atmospheric conditions change by the smallest amount.

Rogers, R. H.↗

Evaluation of ERTS-1 imagery for mapping Quaternary deposits and landforms in the Great Plains and Midwest

The author has identified the following significant results. Maps of 1:1 million scale exemplifying the first phase of investigation were prepared for ten study areas (mostly 1 deg x 2 deg in area): 2 in Kansas, 1 in Missouri-Kansas, 2 in Nebraska, 1 in South Dakota, 3 in Illinois, and 1 in Iowa-Illinois (a total of 13 such maps, covering about 97,000 sq. mi., since the start of the project). Collection of all pertinent published geologic-terrain data also has been completed for all the study areas for which these first-phase maps have been made. The ground truth data are being used in combination with additional interpretation of the repetitive ERTS-1 images of most of these study areas to prepare enhanced information maps at 1:500,000. For areas that have not been mapped at 1:500,000 or larger scales, the maps will provide the first moderately detailed information on landform features and surficial materials. Much of the information mapped is significant for exploration and development of ground water (and locally petroleum) and for applications in engineering and environmental geology, and land use patterns as indicated by tone and texture on the images. Numerous moraines have been identified; also, the trends of parts of ancient filled valleys have been identified. Valley alinement appears controlled by faults or other structural lineaments.

Morrison, R. B.↗

How Well Do Multisatellite Products Capture the Space–Time Dynamics of Precipitation? Part I: Five Products Assessed via a Wavenumber–Frequency Decomposition

As more global satellite-derived precipitation products become available, it is imperative to evaluate them more carefully for providing guidance as to how well precipitation space–time features are captured for use in hydrologic modeling, climate studies, and other applications. Here we propose a space–time Fourier spectral analysis and define a suite of metrics that evaluate the spatial organization of storm systems, the propagation speed and direction of precipitation features, and the space–time scales at which a satellite product reproduces the variability of a reference “ground-truth” product (“effective resolution”). We demonstrate how the methodology relates to our physical intuition using the case study of a storm system with rich space–time structure. We then evaluate five high-resolution multisatellite products (CMORPH, GSMaP, IMERG-Early, IMERG-Final, and PERSIANN-CCS) over a period of 2 years over the southeastern United States. All five satellite products show generally consistent space–time power spectral density when compared to a reference ground gauge–radar dataset (GV-MRMS), revealing agreement in terms of average morphology and dynamics of precipitation systems. However, a deficit of spectral power at wavelengths shorter than 200 km and periods shorter than 4 h reveals that all satellite products are excessively “smooth.” The products also show low levels of spectral coherence with the gauge–radar reference at these fine scales, revealing discrepancies in capturing the location and timing of precipitation features. From the space–time spectral coherence, the IMERG-Final product shows superior ability in resolving the space–time dynamics of precipitation down to 200-km and 4-h scales compared to the other products.

Clement Guilloteau↗

An analysis of mesoscale VAS retrievals using statistical structure functions

Mesoscale sounding data from a truth rawinsonde network and a VAS from March 6-7, 1982 are statistically studied. The parameters of temperature, geopotential height, and mixing ratio at 850, 700, 500, 300, and 200 mb levels, and thickness and precipitable water are examined. The VAS retrieval gradients derived from a physical algorithm and from a regression technique are analyzed; the analysis reveals that both techniques have similar error characteristics and capabilities for calculating gradients of mesoscale temperature and geopotential height. Ground-truth rawinsonde data and VAS retrievals are compared; it is observed that VAS data describes weaker gradients than rawinsonde data.

Fuelberg, H. E.↗

Measurement of surface microtopography using helicopter-mounted stereo film cameras and two stereo matching techniques

A common problem in acquiring ground-truth data for use in microwave interaction modeling is the capture of surface roughness data that are both sampled at distances comparable to a fraction of the wavelength and extensive enough to represent the surface statistics in at least one resolution cell of the microwave remote sensor used. A technique has been developed for acquiring the necessary photogrammetric data using twin 70-mm film cameras mounted on a helicopter boom. The apparatus is described, and the accuracy with which ground surface roughness can be characterized using this device is estimated. Both standard and cross-correlation methods were used for data reduction. Stereogrammetry is compared with a completely automated image-matching technique. Dense disparity images were generated from the helicopter stereo pairs. Using interior orientation parameters supplied by the camera manufacturers, and assuming that exterior orientation parameters remain constant between control target and test field photography, an extremely dense DEM (digital elevation model) for a test field has been derived. Results are compared, and accuracy estimates are presented.

Wall, S. D.↗

Measuring Small Debris - What You Can't See Can Hurt You

While modeling gives us a tool to better understand the Earth orbit debris environment, it is measurements that give us "ground truth" about what is happening in space. Assets that can detect orbital debris remotely from the surface of the Earth, such as radars and telescopes, give us a statistical view of how debris are distributed in space, how they are being created, and how they are evolving over time. In addition, in situ detectors in space are giving us a better picture of how the small particle environment is actually damaging spacecraft today. IN addition, simulation experiments on the ground help us to understand what we are seeing in orbit. This talk will summarize the history of space debris measurements, how it has changed our view of the Earth orbit environment, and how we are designing the experiments of tomorrow.

Matney, Mark↗

Comparison of column water vapor measurements using downward-looking near-infrared and infrared imaging systems and upward-looking microwave radiometers

Remote soundings of precipitable water vapor from three systems are compared with each other and with ground truth from radiosondes. Ancillary data from a mesoscale network of surface observing stations and from wind-profiling radars are also used in the analysis. The three remote-sounding techniques are: (a) a reflectance technique using spectral data collected by the Airborne Visible-Infrared Imaging Spectrometer; (b) an emission technique using Visible-Infrared Spin Scan Radiometer Atmospheric Sounder (VAS) data acquired from the NOAA's GOES; and (c) a microwave technique using data from a limited network of three ground-based dual-channel microwave radiometers. The data were taken over the Front Range of eastern Colorado on 22-23 March 1990. The generally small differences between the three types of remote-sounding measurements are consistent with the horizontal and temporal resolutions of the instruments. The microwave and optical reflectance measurements agreed to within 0.1 cm; comparisons of the microwave data with radiosondes were also either as good or explainable. The largest differences between the VAS and the microwave radiometer at Elbert were between 0.4 and 0.5 cm and appear to be due to variable terrain within the satellite footprint.

Gao, Bo-Cai↗

High Flying Interns: NASA's Student Airborne Research Program

The NASA Student Airborne Research Program is an annual summer internship for upper-level undergraduate STEM majors. Each summer since 2009, we have competitively selected ~30 undergraduates from colleges and universities across the United States for this unique airborne research experience. In all past summers, students flew onboard a NASA research aircraft where they assisted in the operation of remote sensing and in situ instrumentation to study the Earth, ocean, and atmosphere. Students also participated in field trips where they acquired data to ground-truth and complement the airborne data. After their flights and field trips, students then spent the rest of summer developing individual research projects using the data they collected as well as data from previous year SARP flights, other NASA airborne campaigns, and NASA satellite data. This summer, we adapted the program to be entirely online. Each of the 28 undergraduate students still completed an individual research project using data from previous SARP flights as well as publicly available data from other airborne campaigns, satellites, and/or ground stations. Students were mentored remotely by five university faculty members, five graduate students, and several additional scientists and engineers from NASA. In order to preserve some aspects of the hands-on research experience, we also shipped each student a box of twenty-four Whole Air Sampling canisters identical to what they would have used to collect air samples onboard the NASA aircraft. Instead, each student collected ground samples near their home starting in mid-April through July. The goal of this sampling was to attempt to characterize the impacts of pandemic-related changes in emissions with time across the United States. The results of that ground sampling are being presented in scientific sessions in this meeting. In addition, students also measured PM2.5 and aerosol optical depth from June through August using sensors provided by the Citizen-Enabled Aerosol Measurements for Satellites (CEAMS) at Colorado State University. We will discuss strategies we employed to conduct research online, the unexpected opportunities that arose, and lessons learned.

STEM disciplines↗

The mixture problem in computer mapping of terrain: Improved techniques for establishing spectral signature, atmospheric path radiance, and transmittance

The results of LANDSAT and Skylab research programs on the effects of the atmosphere on computer mapping of terrain include: (1) the concept of a ground truth map needs to be drastically revised; (2) the concept of training areas and test areas is not as simple as generally thought because of the problem of pixels that represent a mixture of terrain classes; (3) this mixture problem needs to be more widely recognized and dealt with by techniques of calculating spectral signatures of mixed classes, or by other methods; (4) atmospheric effects should be considered in computer mapping of terrain and in monitoring changes; and (5) terrain features may be used as calibration panels on the ground, from which atmospheric conditions can be determined and monitored. Results are presented of a test area in mountainous terrain of south-central Colorado for which an initial classification was made using simulated mixture-class spectral signatures and actual LANDSAT-1-MSS data.

Smedes, H. W.↗

Application of Low-Cost Fine Particulate Mass Monitors to Convert Satellite Aerosol Optical Depth Measurements to Surface Concentrations in North America and Africa

Low-cost particulate mass sensors provide opportunities to assess air quality at unprecedented spatial and temporal resolutions. Established traditional monitoring networks have limited spatial resolution and are simply absent in many major cities across sub-Saharan Africa (SSA). Satellites provide snapshots of regional air pollution but require ground-truthing. Low-cost monitors can supplement and extend data coverage from these sources worldwide, providing a better overall air quality picture. We investigate the utility of such a multi-source data integration approach using two case studies. First, in Pittsburgh, Pennsylvania, both traditional monitoring and dense low-cost sensor networks are compared with satellite aerosol optical depth (AOD) data from NASA's MODIS system, and a linear conversion factor is developed to convert AOD to surface fine particulate matter mass concentration (as PM2.5). With 10 or more ground monitors in Pittsburgh, there is a 2-fold reduction in surface PM2.5 estimation mean absolute error compared to using only a single ground monitor. Second, we assess the ability of combined regional-scale satellite retrievals and local-scale low-cost sensor measurements to improve surface PM2.5 estimation at several urban sites in SSA. In Rwanda, we find that combining local ground monitoring information with satellite data provides a 40 % improvement in surface PM2.5 estimation accuracy with respect to using low-cost ground monitoring data alone. A linear AOD-to-surface-PM2.5 conversion factor developed in Kigali, Rwanda, did not generalize well to other parts of SSA and varied seasonally for the same location, emphasizing the need for ongoing and localized ground-based monitoring, which can be facilitated by low-cost sensors. Overall, we find that combining ground-based low-cost sensor and satellite data, even without including additional meteorological or land use information, can improve and expand spatiotemporal air quality data coverage, especially in data-sparse regions.

AOD↗

Refinement of Protocols for Measuring the Apparent Optical Properties of Seawater

Ocean color satellite missions, like the Sea-viewing Wide Field-of-view Sensor (SeaWiFS) or the Moderate Resolution Imaging Spectroradiometer (MODIS) projects, are tasked with acquiring a global ocean color data set, validating and monitoring the accuracy and quality of the data, processing the radiometric data into geophysical units using a set of atmospheric and bio-optical algorithms, and distributing the final products to the scientific community. The long-standing requirement of the SeaWiFS Project, for example, is to produce spectral water-leaving radiances, LW(lambda), to within 5% absolute (lambda denotes wavelength) and chlorophyll a concentrations to within 35% (Hooker and Esaias 1993), and most ocean color sensors have the same or similar requirements. Although a diverse set of activities are required to ensure the accuracy requirements are met (Hooker and McClain 2000), the perspective here is with field observations. The accurate determination of upper ocean apparent optical properties (AOPs) is essential for the vicarious calibration of ocean color data and the validation of the derived data products, because the sea-truth measurements are used to evaluate the satellite observations (Hooker and McClain 2000). The uncertainties with in situ AOP measurements have various sources: a) the sampling procedures used in the field, including the environmental conditions encountered; b) the absolute characterization of the radiometers in the laboratory; c) the conversion of the light signals to geophysical units in a processing scheme, and d) the stability of the radiometers in the harsh environment they are subjected to during transport and use. Assuming ideal environmental conditions, so this aspect can be neglected, the SeaWiFS ground-truth uncertainty budget can only be satisfied if each uncertainty is on the order of 1-2%, or what is generally referred to as 1% radiometry. In recent years, progress has been made in estimating the magnitude of some of these uncertainties and in defining procedures for minimizing them. For the SeaWiFS Project, the first step was to convene a workshop to draft the SeaWiFS Ocean Optics Protocols (hereafter referred to as the Protocols). The Protocols initially adhered to the Joint Global Ocean Flux Study (JGOFS) sampling procedures (JGOFS 1991) and defined the standards for optical measurements to be used in SeaWiFS calibration and validation activities (Mueller and Austin 1992). Over time, the Protocols were revised (Mueller and Austin 1995), and then recurringly updated on essentially an annual basis (Mueller 2000, 2002, and 2003) as part of the Sensor Inter-comparison and Merger for Biological and Interdisciplinary Oceanic Studies (SIMBIOS) project. 98

Hooker, Stanford B.↗