Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty Quantification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

Probabilistic Structural Analysis and Reliability Using NESSUS With Implemented Material Strength Degradation Model

This project included both research and education objectives. The goal of this project was to advance innovative research and education objectives in theoretical and computational probabilistic structural analysis, reliability, and life prediction for improved reliability and safety of structural components of aerospace and aircraft propulsion systems. Research and education partners included Glenn Research Center (GRC) and Southwest Research Institute (SwRI) along with the University of Texas at San Antonio (UTSA). SwRI enhanced the NESSUS (Numerical Evaluation of Stochastic Structures Under Stress) code and provided consulting support for NESSUS-related activities at UTSA. NASA funding supported three undergraduate students, two graduate students, a summer course instructor and the Principal Investigator. Matching funds from UTSA provided for the purchase of additional equipment for the enhancement of the Advanced Interactive Computational SGI Lab established during the first year of this Partnership Award to conduct the probabilistic finite element summer courses. The research portion of this report presents the cumulation of work performed through the use of the probabilistic finite element program, NESSUS, Numerical Evaluation and Structures Under Stress, and an embedded Material Strength Degradation (MSD) model. Probabilistic structural analysis provided for quantification of uncertainties associated with the design, thus enabling increased system performance and reliability. The structure examined was a Space Shuttle Main Engine (SSME) fuel turbopump blade. The blade material analyzed was Inconel 718, since the MSD model was previously calibrated for this material. Reliability analysis encompassing the effects of high temperature and high cycle fatigue, yielded a reliability value of 0.99978 using a fully correlated random field for the blade thickness. The reliability did not change significantly for a change in distribution type except for a change in distribution from Gaussian to Weibull for the centrifugal load. The sensitivity factors determined to be most dominant were the centrifugal loading and the initial strength of the material. These two sensitivity factors were influenced most by a change in distribution type from Gaussian to Weibull. The education portion of this report describes short-term and long-term educational objectives. Such objectives serve to integrate research and education components of this project resulting in opportunities for ethnic minority students, principally Hispanic. The primary vehicle to facilitate such integration was the teaching of two probabilistic finite element method courses to undergraduate engineering students in the summers of 1998 and 1999.

Bast, Callie C.↗

Sensitivity of Assimilated Tropical Tropospheric Ozone to the Meteorological Analyses

Tropical tropospheric ozone fields from two different experiments performed with an off-line ozone assimilation system developed in NASA's Data Assimilation Office (DAO) are examined. Assimilated ozone fields from the two experiments are compared with the collocated ozone profiles from the Southern Hemispheric Additional Ozonesondes (SHADOZ) network. Results are presented for 1998. The ozone assimilation system includes a chemistry-transport model, which uses analyzed winds from the Goddard Earth Observing System (GEOS) Data Assimilation System (DAS). The two experiments use wind fields from different versions of GEOS DAS: an operational version of the GEOS-2 system and a prototype of the GEOS-4 system. While both versions of the DAS utilize the Physical-space Statistical Analysis System and use comparable observations, they use entirely different general circulation models and data insertion techniques. The shape of the annual-mean vertical profile of the assimilated ozone fields is sensitive to the meteorological analyses, with the GEOS-4-based ozone being closest to the observations. This indicates that the resolved transport in GEOS-4 is more realistic than in GEOS-2. Remaining uncertainties include quantification of the representation of sub-grid-scale processes in the transport calculations, which plays an important role in the locations and seasons where convection dominates the transport.

Hayashi, Hiroo↗

Use of In Situ and Airborne Multiangle Data to Assess MODIS- and Landsat-based Estimates of Surface Albedo

The quantification of uncertainty of global surface albedo data and products is a critical part of producing complete, physically consistent, and decadal land property data records for studying ecosystem change. A current challenge in validating satellite retrievals of surface albedo is the ability to overcome the spatial scaling errors that can contribute on the order of 20% disagreement between satellite and field-measured values. Here, we present the results from an uncertain ty analysis of MODerate Resolution Imaging Spectroradiometer (MODIS) and Landsat albedo retrievals, based on collocated comparisons with tower and airborne multi-angular measurements collected at the Atmospheric Radiation Measurement Program s (ARM) Cloud and Radiation Testbed (CART) site during the 2007 Cloud and Land Surface Interaction Campaign (CLAS33 IC 07). Using standard error propagation techniques, airborne measurements obtained by NASA s Cloud Absorption Radiometer (CAR) were used to quantify the uncertainties associated with MODIS and Landsat albedos across a broad range of mixed vegetation and structural types. Initial focus was on evaluating inter-sensor consistency through assessments of temporal stability, as well as examining the overall performance of satellite-derived albedos obtained at all diurnal solar zenith angles. In general, the accuracy of the MODIS and Landsat albedos remained under a 10% margin of error in the SW(0.3 - 5.0 m) domain. However, results reveal a high degree of variability in the RMSE (root mean square error) and bias of albedos in both the visible (0.3 - 0.7 m) and near-infrared (0.3 - 5.0 m) broadband channels; where, in some cases, retrieval uncertainties were found to be in excess of 20%. For the period of CLASIC 07, the primary factors that contributed to uncertainties in the satellite-derived albedo values include: (1) the assumption of temporal stability in the retrieval of 500 m MODIS BRDF values over extended periods of cloud-contaminated observations; and (2) the assumption of spatial 45 and structural uniformity at the Landsat (30 m) pixel scale.

Roman, Miguel O.↗

Global Burned Area and Biomass Burning Emissions from Small Fires

In several biomes, including croplands, wooded savannas, and tropical forests, many small fires occur each year that are well below the detection limit of the current generation of global burned area products derived from moderate resolution surface reflectance imagery. Although these fires often generate thermal anomalies that can be detected by satellites, their contributions to burned area and carbon fluxes have not been systematically quantified across different regions and continents. Here we developed a preliminary method for combining 1-km thermal anomalies (active fires) and 500 m burned area observations from the Moderate Resolution Imaging Spectroradiometer (MODIS) to estimate the influence of these fires. In our approach, we calculated the number of active fires inside and outside of 500 m burn scars derived from reflectance data. We estimated small fire burned area by computing the difference normalized burn ratio (dNBR) for these two sets of active fires and then combining these observations with other information. In a final step, we used the Global Fire Emissions Database version 3 (GFED3) biogeochemical model to estimate the impact of these fires on biomass burning emissions. We found that the spatial distribution of active fires and 500 m burned areas were in close agreement in ecosystems that experience large fires, including savannas across southern Africa and Australia and boreal forests in North America and Eurasia. In other areas, however, we observed many active fires outside of burned area perimeters. Fire radiative power was lower for this class of active fires. Small fires substantially increased burned area in several continental-scale regions, including Equatorial Asia (157%), Central America (143%), and Southeast Asia (90%) during 2001-2010. Globally, accounting for small fires increased total burned area by approximately by 35%, from 345 Mha/yr to 464 Mha/yr. A formal quantification of uncertainties was not possible, but sensitivity analyses of key model parameters caused estimates of global burned area increases from small fires to vary between 24% and 54%. Biomass burning carbon emissions increased by 35% at a global scale when small fires were included in GFED3, from 1.9 Pg C/yr to 2.5 Pg C/yr. The contribution of tropical forest fires to year-to-year variability in carbon fluxes increased because small fires amplified emissions from Central America, South America and Southeast Asia-regions where drought stress and burned area varied considerably from year to year in response to El Nino-Southern Oscillation and other climate modes.

Randerson, J. T.↗

Advanced Methods for Determining Prediction Uncertainty in Model-Based Prognostics with Application to Planetary Rovers

Prognostics is centered on predicting the time of and time until adverse events in components, subsystems, and systems. It typically involves both a state estimation phase, in which the current health state of a system is identified, and a prediction phase, in which the state is projected forward in time. Since prognostics is mainly a prediction problem, prognostic approaches cannot avoid uncertainty, which arises due to several sources. Prognostics algorithms must both characterize this uncertainty and incorporate it into the predictions so that informed decisions can be made about the system. In this paper, we describe three methods to solve these problems, including Monte Carlo-, unscented transform-, and first-order reliability-based methods. Using a planetary rover as a case study, we demonstrate and compare the different methods in simulation for battery end-of-discharge prediction.

prognosis↗

Remaining Useful Life Estimation in Prognosis: An Uncertainty Propagation Problem

The estimation of remaining useful life is significant in the context of prognostics and health monitoring, and the prediction of remaining useful life is essential for online operations and decision-making. However, it is challenging to accurately predict the remaining useful life in practical aerospace applications due to the presence of various uncertainties that affect prognostic calculations, and in turn, render the remaining useful life prediction uncertain. It is challenging to identify and characterize the various sources of uncertainty in prognosis, understand how each of these sources of uncertainty affect the uncertainty in the remaining useful life prediction, and thereby compute the overall uncertainty in the remaining useful life prediction. In order to achieve these goals, this paper proposes that the task of estimating the remaining useful life must be approached as an uncertainty propagation problem. In this context, uncertainty propagation methods which are available in the literature are reviewed, and their applicability to prognostics and health monitoring are discussed.

Uncertainty Quantification↗

Modeling Errors in Daily Precipitation Measurements: Additive or Multiplicative?

The definition and quantification of uncertainty depend on the error model used. For uncertainties in precipitation measurements, two types of error models have been widely adopted: the additive error model and the multiplicative error model. This leads to incompatible specifications of uncertainties and impedes intercomparison and application.In this letter, we assess the suitability of both models for satellite-based daily precipitation measurements in an effort to clarify the uncertainty representation. Three criteria were employed to evaluate the applicability of either model: (1) better separation of the systematic and random errors; (2) applicability to the large range of variability in daily precipitation; and (3) better predictive skills. It is found that the multiplicative error model is a much better choice under all three criteria. It extracted the systematic errors more cleanly, was more consistent with the large variability of precipitation measurements, and produced superior predictions of the error characteristics. The additive error model had several weaknesses, such as non constant variance resulting from systematic errors leaking into random errors, and the lack of prediction capability. Therefore, the multiplicative error model is a better choice.

Modeling↗

Construction of Polarimetric Radar-Based Reference Rain Maps for the Iowa Flood Studies Campaign

The Global Precipitation Measurement (GPM) Mission Iowa Flood Studies (IFloodS) campaign was conducted in central and northeastern Iowa during the months of April-June, 2013. Specific science objectives for IFloodS included quantification of uncertainties in satellite and ground-based estimates of precipitation, 4-D characterization of precipitation physical processes and associated parameters (e.g., size distributions, water contents, types, structure etc.), assessment of the impact of precipitation estimation uncertainty and physical processes on hydrologic predictive skill, and refinement of field observations and data analysis approaches as they pertain to future GPM integrated hydrologic validation and related field studies. In addition to field campaign archival of raw and processed satellite data (including precipitation products), key ground-based platforms such as the NASA NPOL S-band and D3R Ka/Ku-band dual-polarimetric radars, University of Iowa X-band dual-polarimetric radars, a large network of paired rain gauge platforms, and a large network of 2D Video and Parsivel disdrometers were deployed. In something of a canonical approach, the radar (NPOL in particular), gauge and disdrometer observational assets were deployed to create a consistent high-quality distributed (time and space sampling) radar-based ground "reference" rainfall dataset, with known uncertainties, that could be used for assessing the satellite-based precipitation products at a range of space/time scales. Subsequently, the impact of uncertainties in the satellite products could be evaluated relative to the ground-benchmark in coupled weather, land-surface and distributed hydrologic modeling frameworks as related to flood prediction. Relative to establishing the ground-based "benchmark", numerous avenues were pursued in the making and verification of IFloodS "reference" dual-polarimetric radar-based rain maps, and this study documents the process and results as they pertain specifically to efforts using the NPOL radar dataset. The initial portions of the "process" involved dual-polarimetric quality control procedures which employed standard phase and correlation-based approaches to removal of clutter and non-meteorological echo. Calculation of a scale-adaptive KDP was accomplished using the method of Wang and Chandrasekar (2009; J. Atmos. Oceanic Tech.). A dual-polarimetric blockage algorithm based on Lang et al. (2009; J. Atmos. Oceanic Tech.) was then implemented to correct radar reflectivity and differential reflectivity at low elevation angles. Next, hydrometeor identification algorithms were run to identify liquid and ice hydrometeors. After the quality control and data preparation steps were completed several different dual-polarimetric rain estimation algorithms were employed to estimate rainfall rates using rainfall scans collected approximately every two to three minutes throughout the campaign. These algorithms included a polarimetrically-tuned Z-R algorithm that adjusts for drop oscillations (via Bringi et al., 2004, J. Atmos. Oceanic Tech.), and several different hybrid polarimetric variable approaches, including one that made use of parameters tuned to IFloodS 2D Video Disdrometer measurements. Finally, a hybrid scan algorithm was designed to merge the rain rate estimates from multiple low level elevation angle scans (where blockages could not be appropriately corrected) in order to create individual low-level rain maps. Individual rain maps at each time step were subsequently accumulated over multiple time scales for comparison to gauge network data. The comparison results and overall error character depended strongly on rain event type, polarimetric estimator applied, and range from the radar. We will present the outcome of these comparisons and their impact on constructing composited "reference" rainfall maps at select time and space scales.

Radar↗

Probabilistic 21st and 22nd Century Sea-Level Projections at a Global Network of Tide-Gauge Sites

Sea-level rise due to both climate change and non-climatic factors threatens coastal settlements, infrastructure, and ecosystems. Projections of mean global sea-level (GSL) rise provide insufficient information to plan adaptive responses; local decisions require local projections that accommodate different risk tolerances and time frames and that can be linked to storm surge projections. Here we present a global set of local sea-level (LSL) projections to inform decisions on timescales ranging from the coming decades through the 22nd century. We provide complete probability distributions, informed by a combination of expert community assessment, expert elicitation, and process modeling. Between the years 2000 and 2100, we project a very likely (90% probability) GSL rise of 0.5–1.2 m under representative concentration pathway (RCP) 8.5, 0.4–0.9 m under RCP 4.5, and 0.3–0.8 m under RCP 2.6. Site-to-site differences in LSL projections are due to varying non-climatic background uplift or subsidence, oceanographic effects, and spatially variable responses of the geoid and the lithosphere to shrinking land ice. The Antarctic ice sheet (AIS) constitutes a growing share of variance in GSL and LSL projections. In the global average and at many locations, it is the dominant source of variance in late 21st century projections, though at some sites oceanographic processes contribute the largest share throughout the century. LSL rise dramatically reshapes flood risk, greatly increasing the expected number of “1-in-10” and “1-in-100” year events.

sea level↗

Unlocking the Full Potential of Earth Observation During the 2015 Texas Flood Disaster

Intense rainfall during late April and early May 2015 in Texas and Oklahoma led to widespread and sustained flooding in several river basins. Texas state agencies relevant to emergency response were activated when severe weather then ensued for 6 weeks from 8 May until 19 June following Tropical Storm Bill. An international team of scientists and flood response experts assembled and collaborated with decision-making authorities for user-driven high-resolution satellite acquisitions over the most critical areas; while experimental automated flood mapping techniques provided daily ongoing monitoring. This allowed mapping of flood inundation from an unprecedented number of spaceborne and airborne images. In fact, a total of 27,174 images have been ingested to the USGS Hazards Data Distribution System (HDDS) Explorer, except for the SAR images used. Based on the Texas flood use case, we describe the success of this effort as well as the limitations in fulfilling the needs of the decision-makers, and reflect upon these. In order to unlock the full potential for Earth observation data in flood disaster response, we suggest in a call for action(i) stronger collaboration from the onset between agencies, product developers, and decision-makers;(ii) quantification of uncertainties when combining data from different sources in order to augment information content; (iii) include a default role for the end-user in satellite acquisition planning; and(iv) proactive assimilation of methodologies and tools into the mandated agencies.

Texas↗

Climate Reanalysis: Progress and Future Prospects

Reanalysis is the process whereby an unchanging data assimilation system is used to provide a consistent reprocessing of observations, typically spanning an extended segment of the historical data record. The process relies on an underlying model to combine often-disparate observations in a physically consistent manner, enabling production of gridded data sets for a broad range of applications including the study of historical weather events, preparation of climatologies, business sector development and, more recently, climate monitoring. Over the last few decades, several generations of reanalyses of the global atmosphere have been produced by various operational and research centers, focusing more or less on the period of regular conventional and satellite observations beginning in the mid to late twentieth century. There have also been successful efforts to extend atmospheric reanalyses back to the late nineteenth and early twentieth centuries, using mostly surface observations. Much progress has resulted from (and contributed to) advancements in numerical weather prediction, especially improved models and data assimilation techniques, increased computing capacity, the availability of new observation types and efforts to recover and improve the quality of historical ones. The recent extension of forecast systems that allow integrated modeling of meteorological, oceanic, land surface, and chemical variables provide the basic elements for coupled data assimilation. This has opened the door to the development of a new generation of coupled reanalyses of the Earth system, or integrated Earth system analyses (IESA). Evidence so far suggests that this approach can improve the analysis of currently uncoupled components of the Earth system, especially at their interface, and lead to increased predictability. However, extensive analysis coupling as envisioned for IESA, while progressing, still presents significant challenges. These include model biases that can be exacerbated when coupled, component systems with different physical characteristics and different spatial and temporal scales, and component observations in different media with different spatial and temporal frequencies and different latencies. Quantification of uncertainty in reanalyses is also a critical challenge and is important for expanding their utility as a tool for climate change assessment. This talk provides a brief overview of the progress of reanalysis development during recent decades, and describes remaining challenges in the progression toward coupled Earth system reanalyses.

IES↗

Use of In Situ and Airborne Multiangle Data to Assess MODIS and Landsat-Based Estimates of Directional Reflectance and Albedo

The quantification of uncertainty in satellite-derived global surface albedo products is a critical aspect in producing complete, physically consistent, and decadal land property data records for studying ecosystem change. A challenge in validating albedo measurements acquired from space is the ability to overcome the spatial scaling errors that can produce disagreements between satellite and field-measured values. Here, we present the results from an accuracy assessment of MODIS and Landsat-TM albedo retrievals, based on collocated comparisons with tower and airborne Cloud Absorption Radiometer (CAR) measurements collected during the 2007 Cloud and Land Surface Interaction Campaign (CLASIC). The initial focus was on evaluating intersensor consistency through comparisons of intrinsic bidirectional reflectance estimates. Local and regional assessments were then performed to obtain estimates of the resulting scaling uncertainties, and to establish the accuracy of albedo reconstructions during extended periods of precipitation. In general, the satellite derived estimates met the accuracy requirements established for the high-quality MODIS operational albedos at 500 m (the greater of 0.02 units or +/-10% of surface measured values). However, results reveal a high degree of variability in the root-mean-square error (RMSE) and bias of MODIS visible (0.3-0.7 μm) and Landsat-TM shortwave (0.3-5.0 μm) albedos; where, in some cases, retrieval uncertainties were found to be in excess of 15%. Results suggest that an overall improvement in MODIS shortwave albedo retrieval accuracy of 7.8%, based on comparisons between MODIS and CAR albedos, resulted from the removal of sub-grid scale mismatch errors when directly scaling-up the tower measurements to the MODIS satellite footprint.

biosphere↗

NESC Peer Review of Exploration Systems Development (ESD) Integrated Vehicle Modal Test, Model Correlation, Development Flight Instrumentation (DFI) and Flight Loads Readiness; Uncertainty Propagation for Model Validation Sub-task

This report details a sub-task (regarding Uncertainty Propagation for Model Validation) from a NASA Engineering and Safety Center assessment that is a multi-year activity spanning the complete development of the Space Launch System integrated vehicle structural dynamic models, and the development of the certification of flight readiness for the Artemis 1 and Artemis 2 vehicles and their variants.

Exploration Systems Development; Development Fligh↗

Applicability of a Framework for Estimating Performance and Associated Uncertainty for Modified Aircraft Configurations

As improvements are made to the accuracy and reliability of modeling and simulation techniques, certification by analysis becomes a more attractive alternative compared to traditional aircraft flight testing. Certification by analysis is especially cost-effective when one considers modifications to a previously certified aircraft. However, it is important that the models and methods used are applicable and accurate throughout the intended use domain. A framework for estimating the performance and associated uncertainty was introduced in an earlier paper. The factors and limitations of this framework for estimating the performance and associated model form uncertainty are explored to determine the range of applicability of the framework, particularly with respect to model form, process and sensor noise, and quality of available flight test data. This paper focuses on the general limitations and applicability of the framework and not the applicability of the individual methods to a range of modified configurations, which requires a large number of modified configurations and is an area for future work. The effects of these factors on the performance and uncertainty results are demonstrated using NASA’s Generic Transport Model aircraft.

uncertainty quantification↗

Flow Characterization of the NASA Langley Unitary Plan WindTunnel, Test Section 2: Computational Results

Flow in the empty Unitary Planform Wind Tunnel at the NASA Langley Research Center issimulated with computational fluid dynamics methods. The objectives are to assess CFD’s truepredictive capability and to generate flow-field maps upstream of the tunnel’s test section foruse in associated vehicle tests. Multiple CFD solvers, grid adaption methods, and turbulencemodels are used by five teams doing the simulations. The simulation domain is as large aspractical: from the start of the settling chamber, just downstream of the last set of turningvanes, to well downstream of the test section. Simulations are done at three Mach numbers andseveral Reynolds numbers that cover most of the tunnel’s operating range. The sensitivity ofthe CFD solutions to simulation process details, including turbulence model, spatial resolutionand settling-chamber inflow velocity profile, is characterized. Significant sensitivities in somedetails of the predicted test section flow are described. CFD predicts that details of flow inthe settling chamber can affect the flow in the test section. Turning of the flow through thetunnel contraction and past nozzle-block hardware generates streamwise vortices, some ofwhich survive into the core of the test section, principally at low Mach number. Preliminarycomparisons to experimental measurements are given. The major flow characteristics andthe dynamical vortices predicted by CFD exist in the experiment. Several details in CFD andexperiment are observed to differ, including the effects of the vortices and features that appearto be Mach waves in the test section. Sensitivity to grid resolution and turbulence modelingis noted in the vortices; no potential cause for the differences in Mach waves has yet beenidentified in the CFD sensitivity studies.

wind tunnel↗