Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

OLTARIS: On-Line Tool for the Assessment of Radiation in Space

The On-Line Tool for the Assessment of Radiation In Space (OLTARIS) is a World Wide Web based tool that assesses the effects of space radiation to humans in items such as spacecraft, habitats, rovers, and spacesuits. This document explains the basis behind the interface and framework used to input the data, perform the assessment, and output the results to the user as well as the physics, engineering, and computer science used to develop OLTARIS. The physics is based on the HZETRN2005 and NUCFRG2 research codes. The OLTARIS website is the successor to the SIREST website from the early 2000 s. Modifications have been made to the code to enable easy maintenance, additions, and configuration management along with a more modern web interface. Over all, the code has been verified, tested, and modified to enable faster and more accurate assessments. The next major areas of modification are more accurate transport algorithms, better uncertainty estimates, and electronic response functions. Improvements in the existing algorithms and data occur continuously and are logged in the change log section of the website.

Singleterry, Robert C., Jr.↗

Ten Years of Cloud Optical and Microphysical Retrievals from MODIS

The MODIS cloud optical properties algorithm (MOD06/MYD06 for Terra and Aqua MODIS, respectively) has undergone extensive improvements and enhancements since the launch of Terra. These changes have included: improvements in the cloud thermodynamic phase algorithm; substantial changes in the ice cloud light scattering look up tables (LUTs); a clear-sky restoral algorithm for flagging heavy aerosol and sunglint; greatly improved spectral surface albedo maps, including the spectral albedo of snow by ecosystem; inclusion of pixel-level uncertainty estimates for cloud optical thickness, effective radius, and water path derived for three error sources that includes the sensitivity of the retrievals to solar and viewing geometries. To improve overall retrieval quality, we have also implemented cloud edge removal and partly cloudy detection (using MOD35 cloud mask 250m tests), added a supplementary cloud optical thickness and effective radius algorithm over snow and sea ice surfaces and over the ocean, which enables comparison with the "standard" 2.1 11m effective radius retrieval, and added a multi-layer cloud detection algorithm. We will discuss the status of the MOD06 algorithm and show examples of pixellevel (Level-2) cloud retrievals for selected data granules, as well as gridded (Level-3) statistics, notably monthly means and histograms (lD and 2D, with the latter giving correlations between cloud optical thickness and effective radius, and other cloud product pairs).

Platnick, Steven↗

UV Absorption Cross Sections of Nitrous Oxide (N2O) and Carbon Tetrachloride (CCl4) Between 210 and 350 K and the Atmospheric Implications

Absorption cross sections of nitrous oxide (N2O) and carbon tetrachloride (CCl4) are reported at five atomic UV lines (184.95, 202.548, 206.200, 213.857, and 228.8 nm) at 27 temperatures in the range 210-350 K. In addition, UV absorption spectra of CCl4 are reported between 200-235 nm as a function of temperature (225-350 K). The results from this work are critically compared with results from earlier studies. For N2O, the present results are in good agreement with the current JPL recommendation enabling a reduction in the estimated uncertainty in the N2O atmospheric photolysis rate. For CCl4, the present cross section results are systematically greater than the current recommendation at the reduced temperatures most relevant to stratospheric photolysis. The new cross sections result in a 5-7% increase in the modeled CCl4 photolysis loss, and a slight decrease in the stratospheric lifetime, from 51 to 50 years, for present day conditions. The corresponding changes in modeled inorganic chlorine and ozone in the stratosphere are quite small. A CCl4 cross section parameterization for use in 37 atmospheric model calculations is presented.

Carlon, Nabilah Rontu↗

Simulation Studies for a Space-Based CO2 Lidar Mission

We report results of initial space mission simulation studies for a laser-based, atmospheric CO2 sounder, which are based on real-time carbon cycle process modelling and data analysis. The mission concept corresponds to the Active Sensing of CO2 Emissions over Nights, Days and Seasons (ASCENDS) recommended by the US National Academy of Sciences' Decadal Survey. As a pre-requisite for meaningful quantitative evaluation, we employ a CO2 model that has representative spatial and temporal gradients across a wide range of scales. In addition, a relatively complete description of the atmospheric and surface state is obtained from meteorological data assimilation and satellite measurements. We use radiative transfer calculations, an instrument model with representative errors and a simple retrieval approach to quantify errors in 'measured' CO2 distributions, which are a function of mission and instrument design specifications along with the atmospheric/surface state. Uncertainty estimates based on the current instrument design point indicate that a CO2 laser sounder can provide data consistent with ASCENDS requirements and will significantly enhance our ability to address carbon cycle science questions. Test of a dawn/dusk orbit deployment, however, shows that diurnal differences in CO2 column abundance, indicative of plant photosynthesis and respiration fluxes, will be difficult to detect

Kawa, S. R.↗

An Example Crossover Experiment for Testing New Vicarious Calibration Techniques for Satellite Ocean Color Radiometry

Vicarious calibration of ocean color satellites involves the use of accurate surface measurements of water-leaving radiance to update and improve the system calibration of ocean color satellite sensors. An experiment was performed to compare a free-fall technique with the established MOBY measurement. We found in the laboratory that the radiance and irradiance instruments compared well within their estimated uncertainties for various spectral sources. The spectrally averaged differences between the NIST values for the sources and the instruments were less than 2.5% for the radiance sensors and less than 1.5% for the irradiance sensors. In the field, the sensors measuring the above-surface downwelling irradiance performed nearly as well as they had in the laboratory, with an average difference of less than 2%. While the water-leaving radiance, L(sub w) calculated from each instrument agreed in almost all cases within the combined instrument uncertainties (approximately 7%), there was a relative bias between the two instrument classes/techniques that varied spectrally. The spectrally averaged (400 nm to 600 nm) difference between the two instrument classes/techniques was 3.1 %. However the spectral variation resulted in the free fall instruments being 0.2% lower at 450 nm and 5.9% higher at 550 nm. Based on the analysis of one matchup, the bias in the L(sub w), was similar to that observed for L(sub u)(1 m) with both systems, indicating the difference did not come from propagating L(sub u)(1 m) to L(sub w).

Voss, Kenneth J.↗

Metrics for Offline Evaluation of Prognostic Performance

Prognostic performance evaluation has gained significant attention in the past few years. Currently, prognostics concepts lack standard definitions and suffer from ambiguous and inconsistent interpretations. This lack of standards is in part due to the varied end-user requirements for different applications, time scales, available information, domain dynamics, etc. to name a few. The research community has used a variety of metrics largely based on convenience and their respective requirements. Very little attention has been focused on establishing a standardized approach to compare different efforts. This paper presents several new evaluation metrics tailored for prognostics that were recently introduced and were shown to effectively evaluate various algorithms as compared to other conventional metrics. Specifically, this paper presents a detailed discussion on how these metrics should be interpreted and used. These metrics have the capability of incorporating probabilistic uncertainty estimates from prognostic algorithms. In addition to quantitative assessment they also offer a comprehensive visual perspective that can be used in designing the prognostic system. Several methods are suggested to customize these metrics for different applications. Guidelines are provided to help choose one method over another based on distribution characteristics. Various issues faced by prognostics and its performance evaluation are discussed followed by a formal notational framework to help standardize subsequent developments.

Saxena, Abhinav↗

Comparison of Test and Finite Element Analysis for Two Full-Scale Helicopter Crash Tests

Finite element analyses have been performed for two full-scale crash tests of an MD-500 helicopter. The first crash test was conducted to evaluate the performance of a composite deployable energy absorber under combined flight loads. In the second crash test, the energy absorber was removed to establish the baseline loads. The use of an energy absorbing device reduced the impact acceleration levels by a factor of three. Accelerations and kinematic data collected from the crash tests were compared to analytical results. Details of the full-scale crash tests and development of the system-integrated finite element model are briefly described along with direct comparisons of acceleration magnitudes and durations for the first full-scale crash test. Because load levels were significantly different between tests, models developed for the purposes of predicting the overall system response with external energy absorbers were not adequate under more severe conditions seen in the second crash test. Relative error comparisons were inadequate to guide model calibration. A newly developed model calibration approach that includes uncertainty estimation, parameter sensitivity, impact shape orthogonality, and numerical optimization was used for the second full-scale crash test. The calibrated parameter set reduced 2-norm prediction error by 51% but did not improve impact shape orthogonality.

Annett, Martin S.↗

GLGM-3: A Degree-ISO Lunar Gravity Model from the Historical Tracking Data of NASA Moon Orbiters

In preparation for the radio science experiment of the Lunar Reconnaissance Orbiter (LRO) mission, we analyzed the available radio tracking data of previous NASA lunar orbiters. Our goal was to use these historical observations in combination with the new low-altitude data to be obtained by LRO. We performed Precision Orbit Determination on trajectory arcs from Lunar Orbiter 1 in 1966 to Lunar Prospector in 1998, using the GEODYN II program developed at NASA Goddard Space Flight Center. We then created a set of normal equations and solved for the coefficients of a spherical harmonics expansion of the lunar gravity potential up to degree and order 150. The GLGM-3 solution obtained with a global Kaula constraint (2.5 x 10(exp -4)/sq l) shows good agreement with model LP150Q from the Jet Propulsion Laboratory, especially over the nearside. The levels of data fit with both gravity models are very similar (Doppler RMS of approx.0.2 and approx. 1-2 mm/s in the nominal and extended phases, respectiVely). Orbit overlaps and uncertainties estimated from the covariance matrix also agree well. GLGM-3 shows better correlation with lunar topography and admittance over the nearside at high degrees of expansion (l > 100), particularly near the poles. We also present three companion solutions, obtained with the same data set but using alternate inversion strategies that modify the power law constraint and expectation of the individual spherical harmonics coefficients. We give a detailed discussion of the performance of this family of gravity field solutions in terms of observation fit, orbit quality, and geophysical consistency.

Mazarico, E.↗

Vertical Crustal Motion Derived from Satellite Altimetry and Tide Gauges, and Comparisons with DORIS Measurements

A somewhat unorthodox method for determining vertical crustal motion at a tide-gauge location is to difference the sea level time series with an equivalent time series determined from satellite altimetry, To the extent that both instruments measure an identical ocean signal, the difference will be dominated by vertical land motion at the gauge. We revisit this technique by analyzing sea level signals at 28 tide gauges that are colocated with DORIS geodetic stations. Comparisons of altimeter-gauge vertical rates with DORIS rates yield a median difference of 1.8 mm/yr and a weighted root-mean-square difference of2.7 mm/yr. The latter suggests that our uncertainty estimates, which are primarily based on an assumed AR(l) noise process in all time series, underestimates the true errors. Several sources of additional error are discussed, including possible scale errors in the terrestrial reference frame to which altimeter-gauge rates are mostly insensitive, One of our stations, Male, Maldives, which has been the subject of some uninformed arguments about sea-level rise, is found to have almost no vertical motion, and thus is vulnerable to rising sea levels. Published by Elsevier Ltd. on behalf of COSPAR.

Ray, R. D.↗

Improvements in Night-Time Low Cloud Detection and MODIS-Style Cloud Optical Properties from MSG SEVIRI

The MODIS cloud optical properties algorithm (MOD06IMYD06 for Terra and Aqua MODIS, respectively) slated for production in Data Collection 6 has been adapted to execute using available channels on MSG SEVIRI. Available MODIS-style retrievals include IR Window-derived cloud top properties, using the new Collection 6 cloud top properties algorithm, cloud optical thickness from VISINIR bands, cloud effective radius from 1.6 and 3.7Jlm and cloud ice/water path. We also provide pixel-level uncertainty estimate for successful retrievals. It was found that at nighttime the SEVIRI cloud mask tends to report unnaturally low cloud fraction for marine stratocumulus clouds. A correction algorithm that improves detection of such clouds has been developed. We will discuss the improvements to nighttime low cloud detection for SEVIRI and show examples and comparisons with MODIS and CALIPSO. We will also show examples of MODIS-style pixel-level (Level-2) cloud retrievals for SEVIRI with comparisons to MODIS.

Wind, Galina (Gala)↗

Land Surface Verification Toolkit (LVT) - A Generalized Framework for Land Surface Model Evaluation

Model evaluation and verification are key in improving the usage and applicability of simulation models for real-world applications. In this article, the development and capabilities of a formal system for land surface model evaluation called the Land surface Verification Toolkit (LVT) is described. LVT is designed to provide an integrated environment for systematic land model evaluation and facilitates a range of verification approaches and analysis capabilities. LVT operates across multiple temporal and spatial scales and employs a large suite of in-situ, remotely sensed and other model and reanalysis datasets in their native formats. In addition to the traditional accuracy-based measures, LVT also includes uncertainty and ensemble diagnostics, information theory measures, spatial similarity metrics and scale decomposition techniques that provide novel ways for performing diagnostic model evaluations. Though LVT was originally designed to support the land surface modeling and data assimilation framework known as the Land Information System (LIS), it also supports hydrological data products from other, non-LIS environments. In addition, the analysis of diagnostics from various computational subsystems of LIS including data assimilation, optimization and uncertainty estimation are supported within LVT. Together, LIS and LVT provide a robust end-to-end environment for enabling the concepts of model data fusion for hydrological applications. The evolving capabilities of LVT framework are expected to facilitate rapid model evaluation efforts and aid the definition and refinement of formal evaluation procedures for the land surface modeling community.

Kumar, Sujay V.↗

Calibration of Airframe and Occupant Models for Two Full-Scale Rotorcraft Crash Tests

Two full-scale crash tests of an MD-500 helicopter were conducted in 2009 and 2010 at NASA Langley's Landing and Impact Research Facility in support of NASA s Subsonic Rotary Wing Crashworthiness Project. The first crash test was conducted to evaluate the performance of an externally mounted composite deployable energy absorber under combined impact conditions. In the second crash test, the energy absorber was removed to establish baseline loads that are regarded as severe but survivable. Accelerations and kinematic data collected from the crash tests were compared to a system integrated finite element model of the test article. Results from 19 accelerometers placed throughout the airframe were compared to finite element model responses. The model developed for the purposes of predicting acceleration responses from the first crash test was inadequate when evaluating more severe conditions seen in the second crash test. A newly developed model calibration approach that includes uncertainty estimation, parameter sensitivity, impact shape orthogonality, and numerical optimization was used to calibrate model results for the second full-scale crash test. This combination of heuristic and quantitative methods was used to identify modeling deficiencies, evaluate parameter importance, and propose required model changes. It is shown that the multi-dimensional calibration techniques presented here are particularly effective in identifying model adequacy. Acceleration results for the calibrated model were compared to test results and the original model results. There was a noticeable improvement in the pilot and co-pilot region, a slight improvement in the occupant model response, and an over-stiffening effect in the passenger region. This approach should be adopted early on, in combination with the building-block approaches that are customarily used, for model development and test planning guidance. Complete crash simulations with validated finite element models can be used to satisfy crash certification requirements, thereby reducing overall development costs.

Annett, Martin S.↗

A Study of Global Cirrus Cloud Morphology with AIRS Cloud-clear Radiances (CCRs)

Version 6 (V6) AIRS cloud-clear radiances (CCR) are used to derive cloud-induced radiance (Tcir=Tb-CCR) at the infrared frequencies of weighting functions peaked in the middle troposphere. The significantly improved V 6 CCR product allows a more accurate estimation of the expected clear-sky radiance as if clouds are absent. In the case where strong cloud scattering is present, the CCR becomes unreliable, which is reflected by its estimated uncertainty, and interpolation is employed to replace this CCR value. We find that Tcir derived from this CCR method are much better than other methods and detect more clouds in the upper and lower troposphere as well as in the polar regions where cloud detection is particularly challenging. The cloud morphology derived from the V6 test month, as well as some artifacts, will be shown.

Wu, Dong L.↗

Greenhouse Gas Concentration Data Recovery Algorithm for a Low Cost, Laser Heterodyne Radiometer

The goal of a coordinated effort between groups at GWU and NASA GSFC is the development of a low-cost, global, surface instrument network that continuously monitors three key carbon cycle gases in the atmospheric column: carbon dioxide (CO2), methane (CH4), carbon monoxide (CO), as well as oxygen (O2) for atmospheric pressure profiles. The network will implement a low-cost, miniaturized, laser heterodyne radiometer (mini-LHR) that has recently been developed at NASA Goddard Space Flight Center. This mini-LHR is designed to operate in tandem with the passive aerosol sensor currently used in AERONET (a well established network of more than 450 ground aerosol monitoring instruments worldwide), and could be rapidly deployed into this established global network. Laser heterodyne radiometry is a well-established technique for detecting weak signals that was adapted from radio receiver technology. Here, a weak light signal, that has undergone absorption by atmospheric components, is mixed with light from a distributed feedback (DFB) telecommunications laser on a single-mode optical fiber. The RF component of the signal is detected on a fast photoreceiver. Scanning the laser through an absorption feature in the infrared, results in a scanned heterodyne signal io the RF. Deconvolution of this signal through the retrieval algorithm allows for the extraction of altitude contributions to the column signal. The retrieval algorithm is based on a spectral simulation program, SpecSyn, developed at GWU for high-resolution infrared spectroscopies. Variations io pressure, temperature, composition, and refractive index through the atmosphere; that are all functions of latitude, longitude, time of day, altitude, etc.; are modeled using algorithms developed in the MODTRAN program developed in part by the US Air Force Research Laboratory. In these calculations the atmosphere is modeled as a series of spherically symmetric shells with boundaries specified at defined altitudes. Temperature, pressure, and species mixing ratios are defined at these boundaries. Between the boundaries, temperature is assumed to vary linearly with altitude while pressure (and thus gas density) vary exponentially. The observed spectrum at the LHR instrument will be the integration of the contributions along this light path. For any absorption measurement the signal at a particular spectral frequency is a linear combination of spectral line contributions from several species. For each species that might absorb in a spectral region, we have pre-calculated its contribution as a function of temperature and pressure. The integrated path absorption spectrum can then by calculated using the initial sun angle (from location, date, and time) and assumptions about pressure and temperature profiles from an atmospheric model. The modeled spectrum is iterated to match the experimental observation using standard multilinear regression techniques. In addition to the layer concentrations, the numerical technique also provides uncertainty estimates for these quantities as well as dependencies on assumptions inherent in the atmospheric models.

Miller, J. Houston↗

Autonomous Rover Traverse and Precise Arm Placement on Remotely Designated Targets

This software controls a rover platform to traverse rocky terrain autonomously, plan paths, and avoid obstacles using its stereo hazard and navigation cameras. It does so while continuously tracking a target of interest selected from 10 20 m away. The rover drives and tracks the target until it reaches the vicinity of the target. The rover then positions itself to approach the target, deploys its robotic arm, and places the end effector instrument on the designated target to within 2-3-cm accuracy of the originally selected target. This software features continuous navigation in a fairly rocky field in an outdoor environment and the ability to enable the rover to avoid large rocks and traverse over smaller ones. Using point-and-click mouse commands, a scientist designates targets in the initial imagery acquired from the rover s mast cameras. The navigation software uses stereo imaging, traversability analysis, path planning, trajectory generation, and trajectory execution. It also includes visual target tracking of a designated target selected from 10 m away while continuously navigating the rocky terrain. Improvements in this design include steering while driving, which uses continuous curvature paths. There are also several improvements to the traversability analyzer, including improved data fusion of traversability maps that result from pose estimation uncertainties, dealing with boundary effects to enable tighter maneuvers, and handling a wider range of obstacles. This work advances what has been previously developed and integrated on the Mars Exploration Rovers by using algorithms that are capable of traversing more rock-dense terrains, enabling tight, thread-the-needle maneuvers. These algorithms were integrated on the newly refurbished Athena Mars research rover, and were fielded in the JPL Mars Yard. Forty-three runs were conducted with targets at distances ranging from 5 to 15 m, and a success rate of 93% was achieved for placement of the instrument within 2-3 cm of the target.

Nesnas, Issa A.↗

Towards Validation of an Adaptive Flight Control Simulation Using Statistical Emulation

Traditional validation of flight control systems is based primarily upon empirical testing. Empirical testing is sufficient for simple systems in which a.) the behavior is approximately linear and b.) humans are in-the-loop and responsible for off-nominal flight regimes. A different possible concept of operation is to use adaptive flight control systems with online learning neural networks (OLNNs) in combination with a human pilot for off-nominal flight behavior (such as when a plane has been damaged). Validating these systems is difficult because the controller is changing during the flight in a nonlinear way, and because the pilot and the control system have the potential to co-adapt in adverse ways traditional empirical methods are unlikely to provide any guarantees in this case. Additionally, the time it takes to find unsafe regions within the flight envelope using empirical testing means that the time between adaptive controller design iterations is large. This paper describes a new concept for validating adaptive control systems using methods based on Bayesian statistics. This validation framework allows the analyst to build nonlinear models with modal behavior, and to have an uncertainty estimate for the difference between the behaviors of the model and system under test.

He, Yuning↗

Development and Calibration of a System-Integrated Rotorcraft Finite Element Model for Impact Scenarios

Two full-scale crash tests of an MD-500 helicopter were conducted in 2009 and 2010 at NASA Langley's Landing and Impact Research Facility in support of NASA s Subsonic Rotary Wing Crashworthiness Project. The first crash test was conducted to evaluate the performance of an externally mounted composite deployable energy absorber (DEA) under combined impact conditions. In the second crash test, the energy absorber was removed to establish baseline loads that are regarded as severe but survivable. The presence of this energy absorbing device reduced the peak impact acceleration levels by a factor of three. Accelerations and kinematic data collected from the crash tests were compared to a system-integrated finite element model of the test article developed in parallel with the test program. In preparation for the full-scale crash test, a series of sub-scale and MD-500 mass simulator tests were conducted to evaluate the impact performances of various components and subsystems, including new crush tubes and the DEA blocks. Parameters defined for the system-integrated finite element model were determined from these tests. Results from 19 accelerometers placed throughout the airframe were compared to finite element model responses. The model developed for the purposes of predicting acceleration responses from the first crash test was inadequate when evaluating more severe conditions seen in the second crash test. A newly developed model calibration approach that includes uncertainty estimation, parameter sensitivity, impact shape orthogonality, and numerical optimization was used to calibrate model results for the full-scale crash test without the DEA. This combination of heuristic and quantitative methods identified modeling deficiencies, evaluated parameter importance, and proposed required model changes. The multidimensional calibration techniques presented here are particularly effective in identifying model adequacy. Acceleration results for the calibrated model were compared to test results and the original model results. There was a noticeable improvement in the pilot and copilot region, a slight improvement in the occupant model response, and an over-stiffening effect in the passenger region. One lesson learned was that this approach should be adopted early on, in combination with the building-block approaches that are customarily used, for model development and pretest predictions. Complete crash simulations with validated finite element models can be used to satisfy crash certification requirements, potentially reducing overall development costs.

Annett, Martin S.↗

Examining the Impact of Overlying Aerosols on the Retrieval of Cloud Optical Properties from Passive Remote Sensing

Haywood et al. (2004) show that an aerosol layer above a cloud can cause a bias in the retrieved cloud optical thickness and effective radius. Monitoring for this potential bias is difficult because space ]based passive remote sensing cannot unambiguously detect or characterize aerosol above cloud. We show that cloud retrievals from aircraft measurements above cloud and below an overlying aerosol layer are a means to test this bias. The data were collected during the Intercontinental Chemical Transport Experiment (INTEX-A) study based out of Portsmouth, New Hampshire, United States, above extensive, marine stratus cloud banks affected by industrial outflow. Solar Spectral Flux Radiometer (SSFR) irradiance measurements taken along a lower level flight leg above cloud and below aerosol were unaffected by the overlying aerosol. Along upper level flight legs, the irradiance reflected from cloud top was transmitted through an aerosol layer. We compare SSFR cloud retrievals from below ]aerosol legs to satellite retrievals from the Moderate Resolution Imaging Spectroradiometer (MODIS) in order to detect an aerosol ]induced bias. In regions of small variation in cloud properties, we find that SSFR and MODIS-retrieved cloud optical thickness compares within the uncertainty range for each instrument while SSFR effective radius tend to be smaller than MODIS values (by 1-2 microns) and at the low end of MODIS uncertainty estimates. In regions of large variation in cloud properties, differences in SSFR and MODIS ]retrieved cloud optical thickness and effective radius can reach values of 10 and 10 microns, respectively. We include aerosols in forward modeling to test the sensitivity of SSFR cloud retrievals to overlying aerosol layers. We find an overlying absorbing aerosol layer biases SSFR cloud retrievals to smaller effective radii and optical thickness while nonabsorbing aerosols had no impact.

Coddington, O. M.↗