Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Ground truth”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

1,578 records · Page 88
All sourcesNASA NTRSDOE OSTI
NASA NTRS1972

Use of ERTS imagery in air pollution and marine biology studies, tasks 1 through 3

There are no author-identified significant results in this report. The general suitability of ERTS imagery in detecting ground originated air pollution has proved to be excellent. The quality and resolution exceeded expectations and has permitted in some instances location of point sources to within a thousand feet. Suitable techniques have not yet been developed for determining or measuring area and line sources of air pollution. A major problem has been cloud cover that has persisted over the area of primary interest, the Chesapeake Bay. Work has been completed on mounting the shipboard transmissometer which will be used for investigations to relate the chlorophyll and suspended sediment content in the waters of the Lower Chesapeake Bay to ERTS-1 imagery. Water sampling, plankton analysis, and preparations for sea collection of water truth along the eastern continental shelf of the U.S. have been completed for use in comparisons with ERTS-1 data.

Copeland, G. E.↗
NASA NTRS1994

Characterizing the wake vortex signature for an active line of sight remote sensor

A recurring phenomenon, described as a wake vortex, develops as an aircraft approaches the runway to land. As the aircraft moves along the runway, each of the wing tips generates a spiraling and expanding cone of air. During the lifetime of this turbulent event, conditions exist over the runway which can be hazardous to following aircraft, particularly when a small aircraft is following a large aircraft. Left to themselves, these twin vortex patterns will converge toward each other near the center of the runway, harmlessly dissipating through interaction with each other or by contact with the ground. Unfortunately, the time necessary to disperse the vortex is often not predictable, and at busy airports can severely impact terminal area productivity. Rudimentary methods of avoidance are in place. Generally, time delays between landing aircraft are based on what is required to protect a small aircraft. Existing ambient wind conditions can complicate the situation. Reliable detection and tracking of a wake vortex hazard is a major technical problem which can significantly impact runway productivity. Landing minimums could be determined on the basis of the actual hazard rather than imposed on the basis of a worst case scenario. This work focuses on using a windfield description of a wake vortex to generate line-of-sight Doppler velocity truth data appropriate to an arbitrarily located active sensor such as a high resolution radar or lidar. The goal is to isolate a range Doppler signature of the vortex phenomenon that can be used to improve detection. Results are presented based on use of a simplified model of a wake vortex pattern. However, it is important to note that the method of analysis can easily be applied to any vortex model used to generate a windfield snapshot. Results involving several scan strategies are shown for a point sensor with a range resolution of 1 to 4 meters. Vortex signatures presented appear to offer potential for detection and tracking.

Heil, Robert Milton↗
NASA NTRS2004

Effect of Clouds on Optical Imaging of the Space Shuttle During the Ascent Phase: A Statistical Analysis Based on a 3D Model

Clouds are highly effective in obscuring optical images of the Space Shuttle taken during its ascent by ground-based and airborne tracking cameras. Because the imagery is used for quick-look and post-flight engineering analysis, the Columbia Accident Investigation Board (CAIB) recommended the return-to-flight effort include an upgrade of the imaging system to enable it to obtain at least three useful views of the Shuttle from lift-off to at least solid rocket booster (SRB) separation (NASA 2003). The lifetimes of individual cloud elements capable of obscuring optical views of the Shuttle are typically 20 minutes or less. Therefore, accurately observing and forecasting cloud obscuration over an extended network of cameras poses an unprecedented challenge for the current state of observational and modeling techniques. In addition, even the best numerical simulations based on real observations will never reach "truth." In order to quantify the risk that clouds would obscure optical imagery of the Shuttle, a 3D model to calculate probabilistic risk was developed. The model was used to estimate the ability of a network of optical imaging cameras to obtain at least N simultaneous views of the Shuttle from lift-off to SRB separation in the presence of an idealized, randomized cloud field.

FROM↗
NASA NTRS2009

Sonic Boom Research at NASA Dryden: Objectives and Flight Results from the Lift and Nozzle Change Effects on Tail Shock (LaNCETS) Project

The principal objective of the Supersonics Project is to develop and validate multidisciplinary physics-based predictive design, analysis and optimization capabilities for supersonic vehicles. For aircraft, the focus will be on eliminating the efficiency, environmental and performance barriers to practical supersonic flight. Previous flight projects found that a shaped sonic boom could propagate all the way to the ground (F-5 SSBD experiment) and validated design tools for forebody shape modifications (F-5 SSBD and Quiet Spike experiments). The current project, Lift and Nozzle Change Effects on Tail Shock (LaNCETS) seeks to obtain flight data to develop and validate design tools for low-boom tail shock modifications. Attempts will be made to alter the shock structure of NASA's NF-15B TN/837 by changing the lift distribution by biasing the canard positions, changing the plume shape by under- and over-expanding the nozzles, and changing the plume shape using thrust vectoring. Additional efforts will measure resulting shocks with a probing aircraft (F-15B TN/836) and use the results to validate and update predictive tools. Preliminary flight results are presented and are available to provide truth data for developing and validating the CFD tools required to design low-boom supersonic aircraft.

Moes, Timothy R.↗
NASA NTRS2011

Sensitivity of C-Band Polarimetric Radar-Based Drop Size Distribution Measurements to Maximum Diameter Assumptions

The estimation of rain drop size distribution (DSD) parameters from polarimetric radar observations is accomplished by first establishing a relationship between differential reflectivity (Z(sub dr)) and the central tendency of the rain DSD such as the median volume diameter (D0). Since Z(sub dr) does not provide a direct measurement of DSD central tendency, the relationship is typically derived empirically from rain drop and radar scattering models (e.g., D0 = F[Z (sub dr)] ). Past studies have explored the general sensitivity of these models to temperature, radar wavelength, the drop shape vs. size relation, and DSD variability. Much progress has been made in recent years in measuring the drop shape and DSD variability using surface-based disdrometers, such as the 2D Video disdrometer (2DVD), and documenting their impact on polarimetric radar techniques. In addition to measuring drop shape, another advantage of the 2DVD over earlier impact type disdrometers is its ability to resolve drop diameters in excess of 5 mm. Despite this improvement, the sampling limitations of a disdrometer, including the 2DVD, make it very difficult to adequately measure the maximum drop diameter (D(sub max)) present in a typical radar resolution volume. As a result, D(sub max) must still be assumed in the drop and radar models from which D0 = F[Z(sub dr)] is derived. Since scattering resonance at C-band wavelengths begins to occur in drop diameters larger than about 5 mm, modeled C-band radar parameters, particularly Z(sub dr), can be sensitive to D(sub max) assumptions. In past C-band radar studies, a variety of D(sub max) assumptions have been made, including the actual disdrometer estimate of D(sub max) during a typical sampling period (e.g., 1-3 minutes), D(sub max) = C (where C is constant at values from 5 to 8 mm), and D(sub max) = M*D0 (where the constant multiple, M, is fixed at values ranging from 2.5 to 3.5). The overall objective of this NASA Global Precipitation Measurement Mission (GPM/PMM Science Team)-funded study is to document the sensitivity of DSD measurements, including estimates of D0, from C-band Z(sub dr) and reflectivity to this range of D(sub max) assumptions. For this study, GPM Ground Validation 2DVD's were operated under the scanning domain of the UAHuntsville ARMOR C-band dual-polarimetric radar. Approximately 7500 minutes of DSD data were collected and processed to create gamma size distribution parameters using a truncated method of moments approach. After creating the gamma parameter datasets the DSD's were then used as input to a T-matrix model for computation of polarimetric radar moments at C-band. All necessary model parameterizations, such as temperature, drop shape, and drop fall mode, were fixed at typically accepted values while the D(sub max) assumption was allowed to vary in sensitivity tests. By hypothesizing a DSD model with D(sub max) (fit) from which the empirical fit to D0 = F[Z(sub dr)] was derived via non-linear least squares regression and a separate reference DSD model with D(sub max) (truth), bias and standard error in D0 retrievals were estimated in the presence of Z(sub dr) measurement error and hypothesized mismatch in D(sub max) assumptions. Although the normalized standard error for D0 = F[Z(sub dr)r] can increase slightly (as much as from 11% to 16% for all 7500 DSDs) when the D(sub max) (fit) does not match D(sub max) (truth), the primary impact of uncertainty in D(sub max) is a potential increase in normalized bias error in D0 (from 0% to as much as 10% over all 7500 DSDs, depending on the extent of the mismatch between D(sub max) (fit) and D(sub max) (truth)). For DSDs characterized by large Z(sub dr) (Z(sub dr) > 1.5 to 2.0 dB), the normalized bias error for D0 estimation at C-band is sometimes unacceptably large (> 10%), again depending on the extent of the hypothesized D(sub max) mismatch. Modeled errors in D0 retrievals from Z(sub dr) at C-band are demonstrated in detail and comparedo similar modeled retrieval errors at S-band and X-band where the sensitivity to D(sub max) is expected to be less. The impact of D(sub max) assumptions to the retrieval of other DSD parameters such as Nw, the liquid water content normalized intercept parameter, are also explored. Likely implications for DSD retrievals using C-band polarimetric radar for GPM are assessed by considering current community knowledge regarding D(sub max) and quantifying the statistical distribution of Z(sub dr) from ARMOR over a large variety of meteorological conditions. Based on these results and the prevalence of C-band polarimetric radars worldwide, a call for more emphasis on constraining our observational estimate of D(sub max) within a typical radar resolution volume is made

Carey, Lawrence D.↗
NASA NTRS2016

New Methods for Retrieval of Chlorophyll Red Fluorescence from Hyperspectral Satellite Instruments: Simulations and Application to GOME-2 and SCIAMACHY

Global satellite measurements of solar-induced fluorescence (SIF) from chlorophyll over land and ocean have proven useful for a number of different applications related to physiology, phenology, and productivity of plants and phytoplankton. Terrestrial chlorophyll fluorescence is emitted throughout the red and far-red spectrum, producing two broad peaks near 683 and 736nm. From ocean surfaces, phytoplankton fluorescence emissions are entirely from the red region (683nm peak). Studies using satellite-derived SIF over land have focused almost exclusively on measurements in the far red (wavelengths greater than 712nm), since those are the most easily obtained with existing instrumentation. Here, we examine new ways to use existing hyperspectral satellite data sets to retrieve red SIF (wavelengths less than 712nm) over both land and ocean. Red SIF is thought to provide complementary information to that from the far red for terrestrial vegetation. The satellite instruments that we use were designed to make atmospheric trace-gas measurements and are therefore not optimal for observing SIF; they have coarse spatial resolution and only moderate spectral resolution (0.5nm). Nevertheless, these instruments, the Global Ozone Monitoring Instrument 2 (GOME-2) and the SCanning Imaging Absorption spectroMeter for Atmospheric CHartographY (SCIAMACHY), offer a unique opportunity to compare red and far-red terrestrial SIF at regional spatial scales. Terrestrial SIF has been estimated with ground-, aircraft-, or satellite-based instruments by measuring the filling-in of atmospheric andor solar absorption spectral features by SIF. Our approach makes use of the oxygen (O2) gamma band that is not affected by SIF. The SIF-free O2 gamma band helps to estimate absorption within the spectrally variable O2 B band, which is filled in by red SIF. SIF also fills in the spectrally stable solar Fraunhofer lines (SFLs) at wavelengths both inside and just outside the O2 B band, which further helps to estimate red SIF emission. Our approach is then an extension of previous approaches applied to satellite data that utilized only the filling-in of SFLs by red SIF. We conducted retrievals of red SIF using an extensive database of simulated radiances covering a wide range of conditions. Our new algorithm produces good agreement between the simulated truth and retrievals and shows the potential of the O2 bands for noise reduction in red SIF retrievals as compared with approaches that rely solely on SFL filling. Biases seen with existing satellite data, most likely due to instrumental artifacts that vary in time, space, and with instrument, must be addressed in order to obtain reasonable results. Our 8-year record of red SIF observations over land with the GOME-2 allows for the first time reliable global mapping of monthly anomalies. These anomalies are shown to have similar spatiotemporal structure as those in the far red, particularly for drought-prone regions. There is a somewhat larger percentage response in the red as compared with the far red for these areas that are drought sensitive. We also demonstrate that good-quality ocean fluorescence line height retrievals can be achieved with GOME-2, SCIAMACHY, and similar instruments by utilizing the full complement of radiance measurements that span the red SIF emission feature.

spatiotemporal structure↗
NASA NTRS1995

GPS as an orbit determination subsystems

This paper evaluates the use of Global Positioning System (GPS) receivers as a primary source of tracking data for low-Earth orbit satellites. GPS data is an alternative to using range, azimuth, elevation, and range-rate (RAER) data from the Air Force Satellite Control Network antennas, the Space Ground Link System (SGLS). This evaluation is applicable to missions such as Skipper, a joint U.S. and Russian atmosphere research mission, that will rely on a GPS receiver as a primary tracking data source. The Detachment 2, Space and Missile Systems Center's Test Support Complex (TSC) conducted the evaluation based on receiver data from the Space Test Experiment Platform Mission O (STEP-O) and Advanced Photovoltaic and Electronics Experiments (APEX) satellites. The TSC performed orbit reconstruction and prediction on the STEP-0 and APEX vehicles using GPS receiver navigation solution data, SGLS RAER data, and SGLS anglesonly (azimuth and elevation) data. For the STEP-O case, the navigation solution based orbits proved to be more accurate than SGLS RAER based orbits. For the APEX case, navigation solution based orbits proved to be less accurate than SGLS RAER based orbits for orbit prediction, and results for orbit reconstruction were inconclusive due to the lack of a precise truth orbit. After evaluating several different GPS data processing methods, the TSC concluded that using GPS navigation solution data is a viable alternative to using SGLS RAER data.

Fennessey, Richard↗
NASA NTRS1993

Investigation of the role of thermal boundary layer processes in initiating convection under the NASA SPACE Field Program

The current NWS ground based network is not sufficient to capture the dynamic or thermodynamic structure leading to the initiation and organization of air mass moist convective events. Under this investigation we intend to use boundary layer mesoscale models (McNider and Pielke, 1981) to examine the dynamic triggering of convection due to topography and surface thermal contrasts. VAS and MAN's estimates of moisture will be coupled with the dynamic solution to provide an estimate of the total convective potential. Visible GOES images will be used to specify incoming insolation which may lead to surface thermal contrasts and JR skin temperatures will be used to estimate surface moisture (via the surface thermal inertia) (Weizel and Chang, 1988) which can also induce surface thermal contrasts. We will use the SPACE-COHMEX data base to evaluate the ability of the joint mesoscale model satellite products to show skill in predicting the development of air mass convection. We will develop images of model vertical velocity and satellite thermodynamic measures to derive images of predicted convective potential. We will then after suitable geographic registration carry out a pixel by pixel correlation between the model/satellite convective potential and the 'truth' which are the visible images. During the first half of the first year of this investigation we have concentrated on two aspects of the project. The first has been in generating vertical velocity fields from the model for COHMEX case days. We have taken June 19 as the first case and have run the mesoscale model at several different grid resolutions. We are currently developing the composite model/satellite convective image. The second aspect has been the attempted calibration of the surface energy budget to provide the proper horizontal thermal contrasts for convective initiation. We have made extensive progress on this aspect using the FIFE data as a test data set. The calibration technique looks very promising.

Mcnider, Richard T.↗
DOE OSTI2020

Accounting for Training Data Error in Machine Learning Applied to Earth Observations

Remote sensing, or Earth Observation (EO), is increasingly used to understand Earth system dynamics and create continuous and categorical maps of biophysical properties and land cover, especially based on recent advances in machine learning (ML). ML models typically require large, spatially explicit training datasets to make accurate predictions. Training data (TD) are typically generated by digitizing polygons on high spatial-resolution imagery, by collecting in situ data, or by using pre-existing datasets. TD are often assumed to accurately represent the truth, but in practice almost always have error, stemming from (1) sample design, and (2) sample collection errors. The latter is particularly relevant for image-interpreted TD, an increasingly commonly used method due to its practicality and the increasing training sample size requirements of modern ML algorithms. TD errors can cause substantial errors in the maps created using ML algorithms, which may impact map use and interpretation. Despite these potential errors and their real-world consequences for map-based decisions, TD error is often not accounted for or reported in EO research. Here we review the current practices for collecting and handling TD. We identify the sources of TD error, and illustrate their impacts using several case studies representing different EO applications (infrastructure mapping, global surface flux estimates, and agricultural monitoring), and provide guidelines for minimizing and accounting for TD errors. To harmonize terminology, we distinguish TD from three other classes of data that should be used to create and assess ML models: training reference data, used to assess the quality of TD during data generation; validation data, used to iteratively improve models; and map reference data, used only for final accuracy assessment. We focus primarily on TD, but our advice is generally applicable to all four classes, and we ground our review in established best practices for map accuracy assessment literature. EO researchers should start by determining the tolerable levels of map error and appropriate error metrics. Next, TD error should be minimized during sample design by choosing a representative spatio-temporal collection strategy, by using spatially and temporally relevant imagery and ancillary data sources during TD creation, and by selecting a set of legend definitions supported by the data. Furthermore, TD error can be minimized during the collection of individual samples by using consensus-based collection strategies, by directly comparing interpreted training observations against expert-generated training reference data to derive TD error metrics, and by providing image interpreters with thorough application-specific training. We strongly advise that TD error is incorporated in model outputs, either directly in bias and variance estimates or, at a minimum, by documenting the sources and implications of error. TD should be fully documented and made available via an open TD repository, allowing others to replicate and assess its use. To guide researchers in this process, we propose three tiers of TD error accounting standards. Finally, we advise researchers to clearly communicate the magnitude and impacts of TD error on map outputs, with specific consideration given to the likely map audience.

58 GEOSCIENCES↗
NASA NTRSDate not supplied

Digitizing Named Entities Found Within Letters of Agreement

Letters of Agreement (LOAs) are text-based air traffic control documents that contain procedures and actions agreed upon by the different parties, typically two or more FAA facilities, that are subject to an agreement. The documents contain among other things generic constraints, which are explicit and implicit combinations of procedures that limit a flight’s trajectory and affects pilot actions. For example, a controller may be required, to assign a specific altitude to an aircraft crossing the boundary between two airspaces. Although LOA generic constraints directly impact the trajectory of an aircraft, they are not currently available in a digital form that can be used for (or directly ingested into automated) flight planning. Instead, the constraints are manually input into an onboard or ground based system. LOA documents are primarily stored at a controlling facility and the generic constraints are implemented by experienced air traffic controllers and pilots primarily using voice instructions. This increases the workload of the controllers, likelihood of error (e.g., due to noisy communication) and makes it impractical for implementation with unmanned aircraft. Therefore, steps must be taken to make existing constraints machine interpretable to enable e.g., automated handoffs which in turn would reduce controller workload. With recent advances in natural language processing, especially the rise in digitization of text documents (e.g., medical documents) and automated extraction of information therein, it is now possible to extract flight specific constraints from LOAs. The goal of this work is to digitize named entities through a combination of natural language processing tasks: named entity disambiguation, toponym resolution, and numeric parsing to extract general constraint components contained within LOAs, herein referred to as Entity Enhancement (EE). Starting with a small list of named entities (e.g., ARTCC, Tower, Altitude and Speed), EE can extract the named entities while simultaneously converting the string-based output into a digital format using an ensemble of processes like rule-based gazetteers and syntactic-lexical patterns. The digital format contains a diverse set of information based on the entity label in question, ranging from standardized facility names to units of measure (e.g., feet) and other numeric information. Upon validating our approach using a truth dataset, we show an overall F1-Score of 0.71 for the extraction process. Looking beyond entity enhancement, we are also working towards the goal of completely digitizing the general constraints by performing EE and fitting them into a standardized exchange model (XM) such as the Aeronautical Information Exchange Model (AIXM). This will allow for easy distribution and dissemination of LOA constraints to air users, better searchability within documents, and enable ingestion into automated flight planning. Finally, we show a preliminary version of the proposed XM architecture and demonstrate how the model can be populated from the EE output.

Stephen S. B. Clarke↗
NASA NTRS2012

EnKF OSSE Experiments Assessing the Impact of HIRAD Wind Speed and HIWRAP Radial Velocity Data on Analysis of Hurricane Karl (2010)

Previous studies (e.g., Zhang et al. 2009, Weng et al. 2011) have shown that radial velocity data from airborne and ground-based radars can be assimilated into ensemble Kalman filter (EnKF) systems to produce accurate analyses of tropical cyclone vortices, which can reduce forecast intensity error. Recently, wind speed data from SFMR technology has also been assimilated into the same types of systems and has been shown to improve the forecast intensity of mature tropical cyclones. Two instruments that measure these properties were present during the NASA Genesis and Rapid Intensification Processes (GRIP) field experiment in 2010 which sampled Hurricane Karl, and will next be co-located on the same aircraft for the subsequent NASA HS3 experiment. The High Altitude Wind and Rain Profiling Radar (HIWRAP) is a conically scanning Doppler radar mounted upon NASAs Global Hawk unmanned aerial vehicle, and the usefulness of its radial velocity data for assimilation has not been previously examined. Since the radar scans from above with a fairly large fixed elevation angle, it observes a large component of the vertical wind, which could degrade EnKF analyses compared to analyses with data taken from lesser elevation angles. The NASA Hurricane Imaging Radiometer (HIRAD) is a passive microwave radiometer similar to SFMR, and measures emissivity and retrieves hurricane surface wind speeds and rain rates over a much wider swath. Thus, this study examines the impact of assimilating simulated HIWRAP radial velocity data into an EnKF system, simulated HIRAD wind speed, and HIWRAP+HIRAD with the Weather Research and Forecasting (WRF) model and compares the results to no data assimilation and also to the Truth from which the data was simulated for both instruments.

Albers, Cerese↗
NASA NTRS2016

Wind Information Uplink to Aircraft Performing Interval Management Operations

Interval Management (IM) is an ADS-B-enabled suite of applications that use ground and flight deck capabilities and procedures designed to support the relative spacing of aircraft (Barmore et al., 2004, Murdoch et al. 2009, Barmore 2009, Swieringa et al. 2011; Weitz et al. 2012). Relative spacing refers to managing the position of one aircraft to a time or distance relative to another aircraft, as opposed to a static reference point such as a point over the ground or clock time. This results in improved inter-aircraft spacing precision and is expected to allow aircraft to be spaced closer to the applicable separation standard than current operations. Consequently, if the reduced spacing is used in scheduling, IM can reduce the time interval between the first and last aircraft in an overall arrival flow, resulting in increased throughput. Because IM relies on speed changes to achieve precise spacing, it can reduce costly, low-altitude, vectoring, which increases both efficiency and throughput in capacity-constrained airspace without negatively impacting controller workload and task complexity. This is expected to increase overall system efficiency. The Flight Deck Interval Management (FIM) equipment provides speeds to the flight crew that will deliver them to the achieve-by point at the controller-specified time, i.e., assigned spacing goal, after the target aircraft crosses the achieve-by point (Figure 1.1). Since the IM and target aircraft may not be on the same arrival procedure, the FIM equipment predicts the estimated times of arrival (ETA) for both the IM and target aircraft to the achieve-by point. This involves generating an approximate four-dimensional trajectory for each aircraft. The accuracy of the wind data used to generate those trajectories is critical to the success of the IM operation. There are two main forms of uncertainty in the wind information used by the FIM equipment. The first is the accuracy of the forecast modeling done by the weather provider. This is generally a global environmental prediction obtained from a weather model such as the Rapid Refresh (RAP) from the National Centers for Environmental Prediction (NCEP). The weather forecast data will have errors relative to the actual, or truth, winds that the aircraft will encounter. The second source of uncertainty is that only a small subset of the forecast data can be uplinked to the aircraft for use by the FIM equipment. This results in loss of additional information. The Federal Aviation Administration (FAA) and RTCA are currently developing standards for the communication of wind and atmospheric data to the aircraft for use in NextGen operations. This study examines the impact of various wind forecast sampling methods on IM performance metrics to inform the standards development.

Ahmad, Nashat N.↗