Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
NASA NTRS1972

Derivation of mission fluences from flux models: Propagation of uncertainties

The calculation of fluences from the flux models for spacecraft designers, and the propagation of uncertainties in the flux models to larger uncertainties in the final answer are discussed. Ionization and displacement damage in silicon, fluence, and a fluence of an equivalent energy are considered. Data in graph form are presented on stopping power and range curves for electrons and protons in silicon, relative electron and proton damage in silicon, and electron fluences expressed as 3 MeV equivalent and proton fluences expressed as 20 MeV equivalent for flybys in Jupiter's magnetic equatorial plane. It is concluded that the problem includes the uncertainty in peak flux, which has an immediate linear effect; uncertainty in the spatial distribution of the flux which gives great divergency between the upper-limit model and the nominal model and in the case of protons, may preclude any mission planning in order to make the situation better; and the uncertainty in the energy spectrum both in shape and energy location of the peak, if any, and which has little importance for mission planning if the spectrum is fairly constant.

Barengoltz, J.↗
NASA NTRSDate not supplied

Uncertainty Quantification of CFD Model Assumptions Against Sonic Boom Noise Prediction of a Commercial Supersonic Transport

This paper presents the results of uncertainty modeling of sonic boom noise generation from commercial supersonic transport considering the Spalart-Allmaras (SA) turbulence modeling parameters as well as Mach number, angle of attack and altitude. Sample generation and analysis for this uncertainty model was performed by UQPCE, which is a software package developed at the NASA Langley Research Center. To build the uncertainty model, 42 cases of sonic boom noise calculation were performed. Computation of the ground noise can be briefly summarized in two steps. First, the near field pressure waveforms are sampled from CFD calculation using the NASA Langley’s FUN3D solver. Second, this information is passed to an atmospheric propagation code, sBOOM, which solves an augmented Burger’s equation and simulates how the near field waveforms will change while passing through the atmosphere. The ground signature is further processed to obtain the perceived loudness, PLdB. Having a high spatial resolution near the shockwave in the CFD calculation is critical in sonic boom noise prediction. Because the variation in the input parameters for the current uncertainty quantification (UQ) study is likely to lead to change in shock location, angle and strength, the grid adaptation for shock capturing is independently applied for each condition. The final mesh used in the CFD calculation consists of approximately 420 million cells. The pressure signatures are sampled at three, four and five body lengths away from the aircraft to make sure the three dimensional effects around the aircraft are resolved. The results of the UQ analysis shows that within the three aleatory variables, the angle of attack had the most impact against ground noise, followed by the altitude and the Mach number. Between the two SA model parameters, the Kármán constant (𝜅) was significantly more important than the turbulent Prandtl number (𝜎), but these two parameters were only marginally significant in the overall prediction variance in ground noise. The UQ procedure explained in this paper can be widely applied to other model parameters.

Uncertainty Quantification↗
NASA NTRSDate not supplied

Uncertainty Quantification of CFD Model Assumptions Against Sonic Boom Noise Prediction of a Commercial Supersonic Transport

This paper presents the results of uncertainty modeling of sonic boom noise generation from commercial supersonic transport considering the Spalart-Allmaras (SA) turbulence modeling parameters as well as Mach number, angle of attack and altitude. Sample generation and analysis for this uncertainty model was performed by UQPCE, which is a software package developed at the NASA Langley Research Center. To build the uncertainty model, 42 cases of sonic boom noise calculation were performed. Computation of the ground noise can be briefly summarized in two steps. First, the near field pressure waveforms are sampled from CFD calculation using the NASA Langley’s FUN3D solver. Second, this information is passed to an atmospheric propagation code, sBOOM, which solves an augmented Burger’s equation and simulates how the near field waveforms will change while passing through the atmosphere. The ground signature is further processed to obtain the perceived loudness, PLdB. Having a high spatial resolution near the shock wave in the CFD calculation is critical in sonic boom noise prediction. Because the variation in the input parameters for the current uncertainty quantification (UQ) study is likely to lead to change in shock location, angle and strength, the grid adaptation for shock capturing is independently applied for each condition. The final mesh used in the CFD calculation consists of approximately 420 million cells. The pressure signatures are sampled at three, four and five body lengths away from the aircraft to make sure the three dimensional effects around the aircraft are resolved. The results of the UQ analysis shows that within the three aleatory variables, the angle of attack had the most impact against ground noise, followed by the altitude and the Mach number. Between the two SA model parameters, the Kármán constant (𝜅) was significantly more important than the turbulent Prandtl number (𝜎), but these two parameters were only marginally significant in the overall prediction variance in ground noise. The UQ procedure explained in this paper can be widely applied to other model parameters.

Uncertainty Quantifications↗
NASA NTRS2011

Uncertainty Analysis via Failure Domain Characterization: Polynomial Requirement Functions

This paper proposes an uncertainty analysis framework based on the characterization of the uncertain parameter space. This characterization enables the identification of worst-case uncertainty combinations and the approximation of the failure and safe domains with a high level of accuracy. Because these approximations are comprised of subsets of readily computable probability, they enable the calculation of arbitrarily tight upper and lower bounds to the failure probability. A Bernstein expansion approach is used to size hyper-rectangular subsets while a sum of squares programming approach is used to size quasi-ellipsoidal subsets. These methods are applicable to requirement functions whose functional dependency on the uncertainty is a known polynomial. Some of the most prominent features of the methodology are the substantial desensitization of the calculations from the uncertainty model assumed (i.e., the probability distribution describing the uncertainty) as well as the accommodation for changes in such a model with a practically insignificant amount of computational effort.

Crespo, Luis G.↗
NASA NTRS2014

Mars Entry Atmospheric Data System Modeling, Calibration, and Error Analysis

The Mars Science Laboratory (MSL) Entry, Descent, and Landing Instrumentation (MEDLI)/Mars Entry Atmospheric Data System (MEADS) project installed seven pressure ports through the MSL Phenolic Impregnated Carbon Ablator (PICA) heatshield to measure heatshield surface pressures during entry. These measured surface pressures are used to generate estimates of atmospheric quantities based on modeled surface pressure distributions. In particular, the quantities to be estimated from the MEADS pressure measurements include the dynamic pressure, angle of attack, and angle of sideslip. This report describes the calibration of the pressure transducers utilized to reconstruct the atmospheric data and associated uncertainty models, pressure modeling and uncertainty analysis, and system performance results. The results indicate that the MEADS pressure measurement system hardware meets the project requirements.

Karlgaard, Christopher D.↗
NASA NTRS1996

Performance Robustness of Manipulator Collision Controller

In this paper, we propose that the manipulator impact control problem be approached from a stochastic optimal control perspective. The reason is that not only is such approach be able to model uncertainties in contact environment, force sensing, as well as manipulator dynamics, the controllers obtained is optimally robust in terms of performance. This result is verified by analyses and simulations.

model uncertainties contact environment force sens↗
NASA NTRSDate not supplied

Probing Sensitivity of Discharge Characteristics to Model Selection using Uncertainty Quantification in an aprotic Li-Oxygen Battery

Currently, there are several models in the literature, such as kinetic models, microstructural models, and mass transport models that describe a Li-air battery's discharge behavior. Many of these models are calibrated and tested at low current densities and cannot be easily transferred to high current densities. Even at low current densities, there is no quantitative method for a researcher to choose a reaction kinetic model such as classical Butler-Volmer and its derivatives, and modified Marcus-Hush-Chidsey, a resistance model for lithium peroxide such as electron transport via tunneling or linear resistivity, a surface coverage model (lithium peroxide growth) such as partial coverage or full coverage, and mass transport model (discussed in Ref. [1]). Also, it is time-consuming to test different models at high current density (1C) due to a lack of well-tested models and well-calibrated model parameters. For this presentation, we will develop an analytical model, which acts as a surrogate model for a sophisticated finite element model to predict discharge time and discharge voltage. Next, we use an uncertainty quantifying technique called reduced-order stochastic optimization [2, 3] to determine the uncertainty in model parameters for rate kinetics, lithium peroxide resistivity, and parasitic resistance. Finally, a finite element simulation is performed to determine the error introduced by the surrogate model and its influence on the uncertainty in the model parameters.

M Mehta↗
NASA NTRS2015

Inconsistent Strategies to Spin up Models in CMIP5: Implications for Ocean Biogeochemical Model Performance Assessment

During the fifth phase of the Coupled Model Intercomparison Project (CMIP5) substantial efforts were made to systematically assess the skill of Earth system models. One goal was to check how realistically representative marine biogeochemical tracer distributions could be reproduced by models. In routine assessments model historical hindcasts were compared with available modern biogeochemical observations. However, these assessments considered neither how close modeled biogeochemical reservoirs were to equilibrium nor the sensitivity of model performance to initial conditions or to the spin-up protocols. Here, we explore how the large diversity in spin-up protocols used for marine biogeochemistry in CMIP5 Earth system models (ESMs) contributes to model-to-model differences in the simulated fields. We take advantage of a 500-year spin-up simulation of IPSL-CM5A-LR to quantify the influence of the spin-up protocol on model ability to reproduce relevant data fields. Amplification of biases in selected biogeochemical fields (O2, NO3, Alk-DIC) is assessed as a function of spin-up duration. We demonstrate that a relationship between spin-up duration and assessment metrics emerges from our model results and holds when confronted with a larger ensemble of CMIP5 models. This shows that drift has implications for performance assessment in addition to possibly aliasing estimates of climate change impact. Our study suggests that differences in spin-up protocols could explain a substantial part of model disparities, constituting a source of model-to- model uncertainty. This requires more attention in future model intercomparison exercises in order to provide quantitatively more correct ESM results on marine biogeochemistry and carbon cycle feedbacks.

histories↗
NASA NTRS2022

Remote sensing-based vegetation and soil moisture constraints reduce irrigation estimation uncertainty

Understanding the human water footprint and its impact on the hydrological cycle is essential to inform water management under climate change. Despite efforts in estimating irrigation water withdrawals in earth system models, uncertainties and discrepancies exist within and across modeling systems conditioned by model structure, irrigation parameterization, and the choice of input datasets. Achieving model reliability could be much more challenging for data-sparse regions, given limited access to ground truth for parameterization and validation. Here, we demonstrate the potential of utilizing remotely sensed vegetation and soil moisture observations in constraining irrigation estimation in the Noah-MP land surface model. Results indicate that the two constraints together can effectively reduce model sensitivity to the choice of irrigation parameterization by 7%–43%. It also improves the characterization of the spatial patterns of irrigation and its impact on evapotranspiration and surface soil moisture by correcting for vegetation conditions and irrigation timing. This study highlights the importance of utilizing remotely sensed soil moisture and vegetation measurements in detecting irrigation signals and correcting for vegetation growth. Integrating the two remote sensing datasets into the model provides an effective and less feature engineered approach to constraining the uncertainty of irrigation modeling. Such strategies can be potentially transferred to other modeling systems and applied to regions across the globe.

Wanshu Nie↗
NASA NTRS2001

The NO(x)-HNO3 System in the Lower Stratosphere: Insights from In Situ Measurements and Implications of the J(HNO3)-[OH] Relationship

During the 1997 Photochemistry of Ozone Loss in the Arctic Region in Summer (POLARIS) mission, simultaneous in situ observations of NOx and HOx radicals, their precursors, and the radiation field were obtained in the lower stratosphere. We use these observations to evaluate the primary mechanisms that control NOx-HNO3 exchange and to understand their control over the partitioning between NO2 and HNO3 in regions of continuous sunlight. We calculate NOx production (PNOx) and loss (LNOx) in a manner directly constrained by the in situ measurements and current rate constant recommendations, using approaches for representing albedo, overhead O3 and [OH] that reduce model uncertainty. We find a consistent discrepancy of 18% between modeled rates of NOx production and loss (LNOx = 1.18P(sub NOx)), which is within the measurement uncertainty of +/- 27%. The partitioning between NOx production processes is [HNO3 + OH (41 +/- 2)%; HNO3 + hv (59 +/- 2)%] and between NOx loss processes is [NO2 + OH, 90% to >97%; BrONO2 + H2O, 10% to <3%]. The steady-state description of NOx-HNO3 exchange reveals the significant influence of the tight correlation between the photolysis rate of HNO3 and [OH] established by in situ measurements throughout the lower stratosphere. Parametrizing this relationship, we find: (1) the steady-state value of [NO2](sub 24h-avg)/[HNO3] in the continuously sunlit, lower stratosphere is a function only of temperature and number density; and (2) the partitioning of NOx production between HNO3 + OH and HNO3 + hv is nearly constant throughout most of the lower stratosphere. We describe a methodology (functions of latitude, day, temperature, and pressure) for accurately predicting the steady-state value of [NO2](sub 24h-avg)/[HNO3] and the partitioning of NOx production within these regions. The results establish a metric to compare observations of [NO2](sub 24h-avg)/[HNO3] within the continuously sunlit region and provide a simple diagnostic for evaluating the accuracy of models that attempt to describe the coupled NOx-HOx photochemistry in the lower stratosphere.

Perkins, K. K.↗
NASA NTRS2005

Orbital Debris Shape and Orientation Effects on Ballistic Limits

The SPHC hydrodynamic code was used to evaluate the effects of orbital debris particle shape and orientation on penetration of a typical spacecraft dual-wall shield. Impacts were simulated at near-normal obliquity at 12 km/sec. Debris cloud characteristics and damage potential are compared with those from impacts by spherical projectiles. Results of these simulations indicate the uncertainties in the predicted ballistic limits due to modeling uncertainty and to uncertainty in the impactor orientation.

Evans, Steven W.↗
NASA NTRSDate not supplied

A Framework for Evaluating Climate Model Performance Metrics

The CMIP5 archive contains future climate projections from over 50 models provided by dozens of modeling centers from around the world. Individual model projections, however, are subject to biases created by structural model uncertainties. As a result, ensemble averaging of multiple models is often used to add value to model projections: consensus projections have been shown to consistently outperform individual models. Previous reports for the IPCC establish climate change projections based on an equal-weighted average of all model projections. However, certain models reproduce climate processes better than other models. Should models be weighted based on performance? Unequal ensemble averages have previously been constructed using a variety of mean state metrics. What metrics are most relevant for constraining future climate projections? This project develops a framework for systematically testing metrics in models to identify optimal metrics for unequal weighting multi-model ensembles. A unique aspect of this project is the construction and testing of climate process-based model evaluation metrics. A climate process-based metric is defined as a metric based on the relationship between two physically related climate variables?e.g., outgoing longwave radiation and surface temperature. Metrics are constructed using high-quality Earth radiation budget data from NASA's Clouds and Earth's Radiant Energy System (CERES) instrument and surface temperature data sets. It is found that regional values of tested quantities can vary significantly when comparing weighted and unweighted model ensembles. For example, one tested metric weights the ensemble by how well models reproduce the time-series probability distribution of the cloud forcing component of reflected shortwave radiation. The weighted ensemble for this metric indicates lower simulated precipitation (up to .7 mm/day) in tropical regions than the unweighted ensemble: since CMIP5 models have been shown to overproduce precipitation, this result could indicate that the metric is effective in identifying models which simulate more realistic precipitation. Ultimately, the goal of the framework is to identify performance metrics for advising better methods for ensemble averaging models and create better climate predictions.

Noel C Baker↗
NASA NTRSDate not supplied

Magnetohydrodynamics (MHD) Aerocapture System for Enabling Faster-Larger Planetary Science & Human Exploration Missions

Since our completing the NIAC Phase I NIAC on this Advanced Aerocapture System, NASA Langley Research Center has funded or supported a number of studies and code enhancements through its Center Innovation Fund (CIF) and NASA’s NSTGRO and Internship Programs to mature the analysis capabilities and quantify the merits of the MHD Aerocapture System technology. These efforts have resulted in a plug and play analysis capability for assessing MHD aerocapture system performance for arrival at many planetary bodies of interest. Our efforts have especially focused on the potential mass savings for improving the capacity for science observations at Neptune and Triton. A re-cent Forbes article published “‘Orbital mechanics is probably going to decide for us whether we go to Uranus or Neptune because we need to flyby Jupiter,’ said Kunio Sayanagi at Hampton University, Virginia, who also worked on the Neptune Odyssey proposal…. Exactly when a mission can be sent to Uranus, or Neptune, depends on the relative position of Jupiter, which can help give a spacecraft a gravitational slingshot. That drastically shortens the cruise phase.” [1] Since shortening the cruise phase is important for these science missions, any mass savings enabled by the MHD Aerocapture System could be reallocated to increasing Thermal Protection System mass to allow faster arrival speeds and/or for onboarding additional payloads such as science instruments, batteries, or propellant for conducting more science for longer durations in the desired orbits. The analysis steps and codes for conducting trades and sizing vehicles for aerocapture are as follows: Step 1 is to conduct aeroheating analysis using LAURA of the selected entry vehicle shape to identify locations on the forebody where ionization and flow velocity are sufficient for producing Lo-rentz forces. LAURA is a multiblock structured grid finite-volume CFD solver developed at the NASA Langley Research Center. [2] LAURA has been used for aerothermal analysis support of the entry, de-scent and landing (EDL) phase of interplanetary missions over the last three decades [3-7]. Step 2 is to port the LAURA results into CFDWARP to calcu-late electrical and thermal conductivities of ionized flow for sizing MHD patch system and calculating Lorentz forces needed for controls analysis. CFDWARP is a CFD code that uses advanced nu-merical methods that enable the simulation of the full coupling between the aerodynamics, the magne-tohydrodynamics, and the non-neutral plasma sheaths. CFDWARP has the unique capability to simulate efficiently the non-neutral sheaths (near the electrodes) in coupled form with the quasi-neutral bulk MHD flow [8-11]. Step 3 is to link re-sults from LAURA and CFDWARP into POST2 for calculating entry trajectories and comparing MHD control results with other aerodynamic control strategies. The Program to Optimize Simulated Tra-jectories II (POST2) is a generalized point mass, discrete parameter targeting and optimization pro-gram. POST2 provides the capability to target and optimize point mass trajectories for multiple pow-ered or un-powered vehicles near an arbitrary rotat-ing, oblate planet [12]. Step 4: TPS sizing was per-formed using the Fully Implicit Ablation and Ther-mal-response code (FIAT) tool which computes the transient one-dimensional thermal response and surface thermochemistry of a multilayer stackup of thermal protection, bonding, and structural materi-als subject to aeroheating on one surface [13]. The sizing and margining methodology used was based on the approach documented by Mahzari and Milos [14] for the dual-layered heatshield for extreme entry environment technology (DL-HEEET) TPS concept. TPS analysis utilizes trajectory information from POST2. Using this step-wise plug and play MHD Aerocapture performance assessment process, our analysis targets a Neptune aerocapture trajectory that will place the spacecraft in an observation orbit for Triton. [15]. Magnetohydrodynamic (MHD) control of a 4.5-meter diameter MSL-style capsule resulted in TPS mass savings of nearly 2000 kg when using an MHD system mass of under 200 kg. The flight path for a vehicle using the MHD control strategy has a much lower heat rate and heat load compared to the conventional aerodynamic aerocapture strategies known as bank angle con-trolled (BAC) and direct force controlled (DFC). Both BAC and DFC have heat rates significantly greater than 1500 W/cm2 typically used as an upper limit for PICA. Thus, DL-HEEET TPS concept was required for the BAC and DFC control strategies. However, considering the more benign environ-ments for the MHD case, additional TPS concepts with improved mass efficiency were also assessed. PICA was considered for the MHD controlled strat-egy since the maximum heat rate was well within the limits (<1500 W/cm2) of PICA. TPS sizing re-sulted in a significant mass reduction. The PICA layer for this sizing case was about 7.8 cm. As a point of reference, the Mars 2020 mission, which used this same PICA concept, had a PICA thickness of 3.18 cm [16]. The trajectories used for the TPS sizing originat-ed from the POST2 simulations. The current, I, to an electromagnet configuration can be manipulated to allow for active control of the vehicle. Manipula-tion of the current, I, changes the magnetic field, B, which affects the Lorentz force and therefore the MHD drag force on the vehicle. Our analysis in-cluded both open-loop and close-loop control. Closed-loop control will enable improved overall performance when taking into account mission level uncertainties, such as interplanetary delivery errors and atmospheric modeling uncertainties. The open-loop and closed-loop MHD control cases do not dip as deep into the atmosphere as the aerodynamic cases. Three types of aerodynamic-only approach-es are investigated: bank angle modulation (BAM), director force control (DFC), and Drag Modulated. BAM and DFC make use of vehicle aerodynamic angles to steer the vehicle. Thus, changing the aer-odynamic forces acting on the vehicle for control, aerodynamic drag modulated case requires a vary-ing drag area to modulate the drag force. The MHD drag modulated case modulates MHD generated drag force that adds to the aerodynamic drag. This higher atmospheric activation of drag forces by the MHD patch results in significantly less heat flux on the vehicle. The MHD technology will enable shorter cruise times and deceleration of larger payloads for increasing the capacity for science at the Ice Giants or for returning astronauts to Earth from cislunar space or from Mars. The purpose of this presentation is to provide more details about this work and to highlight plans for further research and development including a flight demonstration.

R. W. Moses↗
NASA NTRSDate not supplied

Uncertainty Quantification using Deep Ensembles for Decision Making in Cyber-Physical-Human Systems

In this paper and its companion, Differential Equation Approximation Using Gradient-Boosted Quantile Regression, Robison et al., we examine an approach to quantifying model uncertainty with the aim of increasing the trustworthiness of computational models in human-machine interactions. In Differential Equation Approximation Using Gradient-Boosted Quantile Regression, we focus on gradient-boosted decision trees, while in this one, we give more details about deep ensembles. Uncertainty quantification is crucial for building trustworthy autonomous decision-making agents in human-machine teams. There are two types of uncertainties: aleatoric and epistemic. The former is related to the inherent stochasticity (noise) of the process, whereas the latter is associated with the lack of knowledge or representation capability of models, such as neural networks. By lack of knowledge, we mean the model’s inability to accurately predict outputs for all possible inputs. The aleatory uncertainty can be estimated fairly easily with, for example, filters, whereas epistemic uncertainty is challenging to compute. This paper uses deep ensembles to quantify both aleatory and epistemic uncertainty. It can act as an uncertainty-aware surrogate transition model for decision-making frameworks. "Uncertainty-aware" means that the surrogate transition model should make predictions along with confidence in those predictions. In the context of decision-making, the transition models are ordinary differential equations (ODEs). Since ODEs can be simulated to make one-step or multi-step predictions, a good surrogate model for them should perform reasonably well in both modes. In a multi-step approach, the trajectory sampling method TS∞ was used to propagate uncertainty over multiple steps. The cartpole dynamical system was selected to demonstrate the ability of deep ensembles as good surrogate transition models for decision-making frameworks. The deep ensembles modeled the dynamics of cartpole ODEs and made uncertainty-aware predictions in single-step and multi-step transition modes.

CPH systems↗
NASA NTRS1993

A layered approach to structural control system design for the JPL phase B testbed

This paper describes our efforts in structural control experiments for a flexible precision structure using both passive and active control. Specifically, a layered structural control approach utilizing passive viscous dampers, colocated and noncolocated active control is used. The passive dampers and active colocated control loops are used to enhance stability and robustness and the noncolocated multivariable controller is designed with respect to a partially controlled structure to further improve the performance. Our approach to the multivariable design problem requires not only a state space model description of the plant, but also an accompanying uncertainty model. To support the multivariable robust control design development, a significant effort in system identification was undertaken. The process of identification and identified results are discussed. Noncolocated controllers are designed using the H(infinity)/mu-synthesis methodology. The order of the controller is typically large, hence, model reduction is performed for practical digital implementation on a real-time control system developed at JPL. Finally, experimental results are presented and some of lessons are discussed.

Chu, Cheng-Chih↗
NASA NTRS2021

Climate model projections from the Scenario Model Intercomparison Project (ScenarioMIP) of CMIP6

The Scenario Model Intercomparison Project (ScenarioMIP) defines and coordinates the main set of future climate projections, based on concentration-driven simulations, within the Coupled Model Intercomparison Project phase 6 (CMIP6). This paper presents a range of its outcomes by synthesizing results from the participating global coupled Earth system models. We limit our scope to the analysis of strictly geophysical outcomes: mainly global averages and spatial patterns of change for surface air temperature and precipitation. We also compare CMIP6 projections to CMIP5 results, especially for those scenarios that were designed to provide continuity across the CMIP phases, at the same time highlighting important differences in forcing composition, as well as in results. The range of future temperature and precipitation changes by the end of the century (2081–2100) encompassing the Tier 1 experiments based on the Shared Socioeconomic Pathway (SSP) scenarios (SSP1-2.6, SSP2-4.5, SSP3-7.0 and SSP5-8.5) and SSP1-1.9 spans a larger range of outcomes compared to CMIP5, due to higher warming (by close to 1.5 °C) reached at the upper end of the 5 %–95 % envelope of the highest scenario (SSP5-8.5). This is due to both the wider range of radiative forcing that the new scenarios cover and the higher climate sensitivities in some of the new models compared to their CMIP5 predecessors. Spatial patterns of change for temperature and precipitation averaged over models and scenarios have familiar features, and an analysis of their variations confirms model structural differences to be the dominant source of uncertainty. Models also differ with respect to the size and evolution of internal variability as measured by individual models' initial condition ensemble spreads, according to a set of initial condition ensemble simulations available under SSP3-7.0. These experiments suggest a tendency for internal variability to decrease along the course of the century in this scenario, a result that will benefit from further analysis over a larger set of models. Benefits of mitigation, all else being equal in terms of societal drivers, appear clearly when comparing scenarios developed under the same SSP but to which different degrees of mitigation have been applied. It is also found that a mild overshoot in temperature of a few decades around mid-century, as represented in SSP5-3.4OS, does not affect the end outcome of temperature and precipitation changes by 2100, which return to the same levels as those reached by the gradually increasing SSP4-3.4 (not erasing the possibility, however, that other aspects of the system may not be as easily reversible). Central estimates of the time at which the ensemble means of the different scenarios reach a given warming level might be biased by the inclusion of models that have shown faster warming in the historical period than the observed. Those estimates show all scenarios reaching 1.5 °C of warming compared to the 1850–1900 baseline in the second half of the current decade, with the time span between slow and fast warming covering between 20 and 27 years from present. The warming level of 2 °C of warming is reached as early as 2039 by the ensemble mean under SSP5-8.5 but as late as the mid-2060s under SSP1-2.6. The highest warming level considered (5 °C) is reached by the ensemble mean only under SSP5-8.5 and not until the mid-2090s.d-2090s.

Scenario Model Intercomparison Project (ScenarioMI↗
NASA NTRS2005

Uncertainty Evaluation of Computational Model Used to Support the Integrated Powerhead Demonstration Project

NASA and the U.S. Air Force are working on a joint project to develop a new hydrogen-fueled, full-flow, staged combustion rocket engine. The initial testing and modeling work for the Integrated Powerhead Demonstrator (IPD) project is being performed by NASA Marshall and Stennis Space Centers. A key factor in the testing of this engine is the ability to predict and measure the transient fluid flow during engine start and shutdown phases of operation. A model built by NASA Marshall in the ROCket Engine Transient Simulation (ROCETS) program is used to predict transient engine fluid flows. The model is initially calibrated to data from previous tests on the Stennis E1 test stand. The model is then used to predict the next run. Data from this run can then be used to recalibrate the model providing a tool to guide the test program in incremental steps to reduce the risk to the prototype engine. In this paper, they define this type of model as a calibrated model. This paper proposes a method to estimate the uncertainty of a model calibrated to a set of experimental test data. The method is similar to that used in the calibration of experiment instrumentation. For the IPD example used in this paper, the model uncertainty is determined for both LOX and LH flow rates using previous data. The successful use of this model is then demonstrated to predict another similar test run within the uncertainty bounds. The paper summarizes the uncertainty methodology when a model is continually recalibrated with new test data. The methodology is general and can be applied to other calibrated models.

Steele, W. G.↗
NASA NTRSDate not supplied

Towards an Optimal Estimation Retrieval of Cirrus Cloud Optical and Microphysical Properties Using Hyperspectral Shortwave Instruments and A Fast Radiative Transfer Algorithm

Cirrus cloud retrieval products (here, cloud optical depth, effective particle size, and cloud top height) are important inputs into numerical weather and climate models. Uncertainties in such retrieval products, as a matter of course, propagate downstream, impacting model calculations. Improvements in high-quality global cirrus cloud optical and microphysical data products from satellite observations are needed to understand and reduce retrieval uncertainties. Hyperspectral shortwave instruments produce high-resolution and information-dense spectra, thus offering the opportunity to reduce uncertainties in retrieval products. We are in the process of developing a retrieval that uses the very fast Principal Component Radiative Transfer Model in the solar spectral region (PCRTM-Solar) in the forward model calculations. This retrieval will use measured reflectances from the NASA Earth Surface Mineral Dust Source Investigation (EMIT) and the forthcoming Climate Absolute Radiance and Refractivity Observatory Pathfinder (CLARREO-Pathfinder) instruments. In this manuscript we present progress towards a reference retrieval employing a widely used, verified, accurate, yet computationally slower radiative transfer modeling technique. The reference retrieval, while too slow for using the complete hyperspectral measurement, will allow us to study the behavior of retrieval products and help us verify results from our in-development fast retrieval. Both retrievals will use the optimal estimation retrieval framework. In this manuscript we present results from an uncertainty analysis considering three uncertainty sources for a cirrus cloud retrieval in the form of error covariance matrices: reflectance uncertainty due to water vapor, the reflectance uncertainty due to ice crystal scattering assumptions, and the instrument measurement uncertainty. Results show that the uncertainty due to habit selection is the largest, while that due to water vapor is at most 0.6% relative to channel reflectance. As a first step, the retrieval is being designed for single layer ice clouds over open ocean water.

Cirrus cloud↗