Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error impact analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Assimilation of Cloud- and Land-Affected TOVS/ATOVS Level 1B Radiances in DAO's Next Generation Finite-Volume Data Assimilation System

The Physical-space/Finite-volume Data Assimilation System (fvDAS) is the next generation global atmospheric data assimilation system in development at the Data Assimilation Office (DAO) at NASA's Goddard Space Flight Center. It is based on a new finite-volume general circulation model jointly developed by NASA and NCAR, and on the Physical-Space Statistical Analysis System (PSAS) developed at the DAO. In this talk we will focus on the assimilation of data from the (Advanced) TIROS Operational Vertical Sounder (ATOVS), with emphasis on the impact of cloud- and land-affected level 1B radiances. Recently, it has been shown that the use of observations from satellite-borne microwave and infrared radiometers in data assimilation systems consistently increases forecast skill. Considerable effort has been expended over the past two decades, particularly with the (Advanced) TIROS Operational Vertical Sounder (ATOVS), to achieve this result. The positive impact on forecast skill has resulted from improvements in quality control algorithms, systematic error correction schemes, and more sophisticated data assimilation algorithms. Despite these advances, there are still many issues regarding the use of satellite data in data assimilation systems that remain unresolved. In particular, most operational centers still do not assimilate cloud- and land-affected TOVS data. In this study, we evaluate the impact of assimilating cloud-and land-affected TOVS/ATOVS level 1B data in DAO's next generation fvDAS, using a 1D variational scheme. We will discuss the impact of these data on both tropospheric and stratospheric forecasts, as well as on the general aspects of the earth climate system.

Joiner, J.↗

Sensitivity of the Assimilated Ozone in the UTLS to Model and Data Selection Changes

This presentation will discuss the sensitivity of assimilated ozone fields in the upper troposphere and lower stratosphere (UTLS) to a number of factors, focusing mainly on aspects of data selection and the prediction model. This is important, because assimilation represents an attempt to construct our best estimates of the true ozone field; however, inaccuracies in the UTLS ozone distribution translate into an uncertainty in factors such as the calculated radiative forcing of climate or the inferred stratosphere-troposphere exchange (STE) of ozone. The 3D ozone data assimilation system, from NASA's Global Modeling and Assimilation Office (GMAO), combines observations of total ozone column and stratospheric profiles with predictions from an off-line, parameterized chemistry and transport model (pCTM) to produce six-hourly, global analyses. The first experiments discussed assimilate ozone retrievals from the Earth-Probe Total Ozone Mapping Spectrometer (EPTOMS) and stratospheric profiles from the Solar Backscatter UltraViolet/2 (SBUV/2) instrument. The SBUV/2 ozone data have a coarse vertical resolution, with increased uncertainty below the ozone maximum, and TOMS provides only total ozone columns. Thus, the assimilated ozone profiles in the UTLS region are only weakly constrained by the incoming SBUV and TOMS data. Consequently, the assimilated ozone distribution should be sensitive to changes in inputs to the statistical analysis scheme. Sensitivity studies have been conducted to examine the responses to TOMS and SBUV/2 data selection, modifications of the forecast and observation error covariance models, and the model formulation (turning off chemistry or using different wind analyses in the pCTM). The second set of experiments includes an additional data type: ozone retrieved from infrared limb-emission by MIPAS on Envisat. These data offer not only improved vertical resolution in the stratosphere, but also give measurements in the polar night. Comparisons of the assimilated ozone fields from both sets of experiments with independent observations, primarily ozone sondes, are used to determine the impact of each of these changes. It is shown that many of the changes have a significant impact on the UTLS ozone estimates. Implications for interpretation of STE and radiative forcing of climate are discussed.

Pawson, Steven↗

A Statistical Theory of Bidirectionality

Original concepts related to the quantification and assessment of bidirectionality in strain-gage balances were introduced by Ulbrich in 2012. These concepts are extended here in three ways: 1) the metric originally proposed by Ulbrich is normalized, 2) a categorical variable is introduced in the regression analysis to account for load polarity, and 3) the uncertainty in both normalized and non-normalized bidirectionality metrics is quantified. These extensions are applied to four representative balances to assess the bidirectionality characteristics of each. The paper is tutorial in nature, featuring reviews of certain elements of regression and formal inference. Principal findings are that bidirectionality appears to be a common characteristic of most balance outputs and that unless it is taken into account, it is likely to consume the entire error budget of a typical balance calibration experiment. Data volume and correlation among calibration loads are shown to have a significant impact on the precision with which bidirectionality metrics can be assessed.

DeLoach, Richard↗

LightForce Photon-Pressure Collision Avoidance: Efficiency Assessment on an Entire Catalogue of Space Debris

The potential to perturb debris orbits using photon pressure from ground-based lasers has been confirmed by independent research teams. Two useful applications of this scheme are protecting space assets from impacts with debris and stabilizing the orbital debris environment, both relying on collision avoidance rather than de-orbiting debris. This paper presents the results of a new assessment method to analyze the efficiency of the concept for collision avoidance. Earlier research concluded that one ground based system consisting of a 10 kW class laser, directed by a 1.5 m telescope with adaptive optics, can prevent a significant fraction of debris-debris collisions in low Earth orbit. That research used in-track displacement to measure efficiency and restricted itself to an analysis of a limited number of objects. As orbit prediction error is dependent on debris object properties, a static displacement threshold should be complemented with another measure to assess the efficiency of the scheme. In this paper we present the results of an approach using probability of collision. Using a least-squares fitting method, we improve the quality of the original TLE catalogue in terms of state and co-state accuracy. We then calculate collision probabilities for all the objects in the catalogue. The conjunctions with the highest risk of collision are then engaged by a simulated network of laser ground stations. After those engagements, the perturbed orbits are used to re-assess the collision probability in a 20 minute window around the original conjunction. We then use different criteria to evaluate the utility of the laser-based collision avoidance scheme and assess the number of base-line ground stations needed to mitigate a significant number of high probability conjunctions. Finally, we also give an account how a laser ground station can be used for both orbit deflection and debris tracking.

laser↗

Two Topics in Seasonal Streamflow Forecasting: Soil Moisture Initialization Error and Precipitation Downscaling

Continental-scale offline simulations with a land surface model are used to address two important issues in the forecasting of large-scale seasonal streamflow: (i) the extent to which errors in soil moisture initialization degrade streamflow forecasts, and (ii) the extent to which the downscaling of seasonal precipitation forecasts, if it could be done accurately, would improve streamflow forecasts. The reduction in streamflow forecast skill (with forecasted streamflow measured against observations) associated with adding noise to a soil moisture field is found to be, to first order, proportional to the average reduction in the accuracy of the soil moisture field itself. This result has implications for streamflow forecast improvement under satellite-based soil moisture measurement programs. In the second and more idealized ("perfect model") analysis, precipitation downscaling is found to have an impact on large-scale streamflow forecasts only if two conditions are met: (i) evaporation variance is significant relative to the precipitation variance, and (ii) the subgrid spatial variance of precipitation is adequately large. In the large-scale continental region studied (the conterminous United States), these two conditions are met in only a somewhat limited area.

Koster, Randal↗

T2M Forecasts at Subseasonal Leads: Do Different Soil Moisture Initial States Have Different Impacts?

Soil moisture (W) helps control evapotranspiration (ET), and ET variations can in turn have a distinct impact on 2-m air temperature (T2M), given that increases in evaporative cooling encourage reduced temperatures. Soil moisture is accordingly linked to T2M, and realistic soil moisture initialization has, in previous studies, been shown to improve the skill of subseasonal T2M forecasts. The relationship between soil moisture and evapotranspiration, however, is distinctly nonlinear, with ET tending to increase with soil moisture in drier conditions and to be insensitive to soil moisture variations in wetter conditions. Here, through an extensive analysis of subseasonal forecasts produced with a state-of-the-art seasonal forecast system, this nonlinearity is shown to imprint itself on T2M forecast error in the conterminous United States in two unique ways: (i) the T2M forecast bias (relative to independent observations) induced by a negative precipitation bias tends to be larger for dry initializations, and (ii) on average, the unbiased root-mean-square error (ubRMSE) tends to be larger for dry initializations. Such findings can aid in the identification of forecasts of opportunity; taken a step further, they suggest a pathway for improving bias correction and uncertainty estimation in subseasonal T2M forecasts by conditioning each on initial soil moisture state.

2-meter Temperature↗

Impact of mismodeled idle engine performance on calculation and tracking of optimal 4-D descent trajectories

Advanced flight management systems are being developed which are capable of calculating optimal 3-D and 4-D flight trajectories for arbitrary fuel and time costs. These systems require mathematical models of airplane performance in order to compute the optimal profiles. Mismodeled idle engine characteristics can result in descent trajectories requiring excessive throttle and/or speedbrake activity in order to achieve the desired end conditions. This paper evaluates the cost and fuel penalties, trajectory variations, and flight control requirements associated with typical idle engine modeling errors for a twin-jet transport airplane. Variations in idle power setting, thrust, fuel flow, and surge bleed operation were evaluated for a cruise/descent flight segment. The results of this analysis provide insight into the penalties associated with uncertainties in idle engine performance and suggest methods of modeling which minimize these penalties.

Williams, D. H.↗

Probabilistic high cycle fatigue failure analysis with application to liquid propellant rocket engines

A probabilistic high cycle fatigue (HCF) failure analysis of a welded duct in a rocket engine of the Space Shuttle main engine class is described. A state-of-the-art HCF failure prediction method was used in a Monte Carlo simulation to generate a distribution of failure lives. A stochastic stress/life model is used for material characterization, and a composite stress history is generated for accurately deriving the stress cycles for the fatigue-damage calculations. The HCF failure model expresses fatigue life as a function of stochastic parameters including environment, loads, material properties, geometry, and model specification errors. A series of HCF failure life analyses were performed to study the impact of a fixed parameter and to assess the importance of each stochastic input parameter through marginal analyses.

Sutharshana, S.↗

Exploring Unstructured Mesh Adaptation for Hybrid Reynolds-Averaged Navier–Stokes/Large Eddy Simulation

Mesh adaptation methods for the Reynolds-averaged Navier–Stokes (RANS) equations are rapidly maturing and beginning to impact the design of aerospace vehicles. RANS turbulence modeling improvements have slowed and may stagnate. Wall-modeled large eddy simulation (LES) and hybrid RANS/LES (HRLES) may provide an improved modeling capability but require specialized expertise to construct appropriate meshes and are considered be too ex-pensive for routine practical use. The realization of the CFD Vision 2030 Study includes improving geometry linkage, mesh generation/adaptation, and turbulence modeling/resolving methods for automated management of errors and uncertainties of physics-based, predictive modeling that can set the stage for ensuring a vehicle is in compliance with a regulation or specification (i.e., certification or qualification by analysis). An exploration of mesh adaptation for HRLES is performed to document synergies and challenges between mesh adaptation and HRLES. Vortex breakdown over a delta wing is examined to show the improvement of HRLES over RANS turbulence modeling approaches. A high lift configuration is shown to demonstrate complex geometry capability. Research and development opportunities are identified to advocate for continuing investments that may allow HRLES to enter routine practical use as a tool for aerospace vehicle analysis and design.

Michael A Park↗

The seasonal response of the Held-Suarez climate model to prescribed ocean temperature anomalies. II - Dynamical analysis

The heating associated with equatorial, subtropical, and midlatitude ocean temperature anamolies in the Held-Suarez climate model is analyzed. The local and downstream response to the anomalies is analyzed, first by examining the seasonal variation in heating associated with each ocean temperature anomaly, and then by combining knowledge of the heating with linear dynamical theory in order to develop a more comprehensive explanation of the seasonal variation in local and downstream atmospheric response to each anomaly. The extent to which the linear theory of propagating waves can assist the interpretation of the remote cross-latitudinal response of the model to the ocean temperature anomalies is considered. Alternative hypotheses that attempt to avoid the contradictions inherent in a strict application of linear theory are investigated, and the impact of sampling errors on the assessment of statistical significance is also examined.

Phillips, T. J.↗

The Effect of Geocenter Motion on Jason-2 and Jason-1 Orbits and the Mean Sea Level

We have investigated the impact of geocenter motion on Jason-2 orbits. This was accomplished by computing a series of Jason-1, Jason-2 GPS-based and SLR/DORIS-based orbits using ITRF2008 and the IGS repro1 framework based on the most recent GSFC standards. From these orbits, we extract the Jason-2 orbit frame translational parameters per cycle by the means of a Helmert transformation between a set of reference orbits and a set of test orbits. The fitted annual and seasonal terms of these time-series are compared to two different geocenter motion models. Subsequently, we included the geocenter motion corrections in the POD process as a degree-1 loading displacement correction to the tracking network. The analysis suggested that the GSFC's Jason-2 std0905 GPS-based orbits are closely tied to the center of mass (CM) of the Earth whereas the SLR/DORIS std0905 orbits are tied to the center of figure (CF) of the ITRF2005 (Melachroinos et al., 2012). In this study we extend the investigation to the centering of the GPS constellation and the way those are tied in the Jason-1 and Jason-2 POD process. With a new set of standards, we quantify the GPS and SLR/DORIS-based orbit centering during the Jason-1 and Jason-2 inter-calibration period and how this impacts the orbit radial error over the globe, which is assimilated into mean sea level (MSL) error, from the omission of the full term of the geocenter motion correction.

Melachroinos, Stavros A.↗

Insight and Evidence Motivating the Simplification of Dual-Analysis Hybrid Systems into Single-Analysis Hybrid Systems

Many hybrid data assimilation systems currently used for NWP employ some form of dual-analysis system approach. Typically a hybrid variational analysis is responsible for creating initial conditions for high-resolution forecasts, and an ensemble analysis system is responsible for creating sample perturbations used to form the flow-dependent part of the background error covariance required in the hybrid analysis component. In many of these, the two analysis components employ different methodologies, e.g., variational and ensemble Kalman filter. In such cases, it is not uncommon to have observations treated rather differently between the two analyses components; recentering of the ensemble analysis around the hybrid analysis is used to compensated for such differences. Furthermore, in many cases, the hybrid variational high-resolution system implements some type of four-dimensional approach, whereas the underlying ensemble system relies on a three-dimensional approach, which again introduces discrepancies in the overall system. Connected to these is the expectation that one can reliably estimate observation impact on forecasts issued from hybrid analyses by using an ensemble approach based on the underlying ensemble strategy of dual-analysis systems. Just the realization that the ensemble analysis makes substantially different use of observations as compared to their hybrid counterpart should serve as enough evidence of the implausibility of such expectation. This presentation assembles numerous anecdotal evidence to illustrate the fact that hybrid dual-analysis systems must, at the very minimum, strive for consistent use of the observations in both analysis sub-components. Simpler than that, this work suggests that hybrid systems can reliably be constructed without the need to employ a dual-analysis approach. In practice, the idea of relying on a single analysis system is appealing from a cost-maintenance perspective. More generally, single-analysis systems avoid contradictions such as having to choose one sub-component to generate performance diagnostics to another, possibly not fully consistent, component.

Todling, Ricardo↗

CRYOGENIC UPPER STAGE SYSTEM SAFETY

NASA s Exploration Initiative will require development of many new systems or systems of systems. One specific example is that safe, affordable, and reliable upper stage systems to place cargo and crew in stable low earth orbit are urgently required. In this paper, we examine the failure history of previous upper stages with liquid oxygen (LOX)/liquid hydrogen (LH2) propulsion systems. Launch data from 1964 until midyear 2005 are analyzed and presented. This data analysis covers upper stage systems from the Ariane, Centaur, H-IIA, Saturn, and Atlas in addition to other vehicles. Upper stage propulsion system elements have the highest impact on reliability. This paper discusses failure occurrence in all aspects of the operational phases (Le., initial burn, coast, restarts, and trends in failure rates over time). In an effort to understand the likelihood of future failures in flight, we present timelines of engine system failures relevant to initial flight histories. Some evidence suggests that propulsion system failures as a result of design problems occur shortly after initial development of the propulsion system; whereas failures because of manufacturing or assembly processing errors may occur during any phase of the system builds process, This paper also explores the detectability of historical failures. Observations from this review are used to ascertain the potential for increased upper stage reliability given investments in integrated system health management. Based on a clear understanding of the failure and success history of previous efforts by multiple space hardware development groups, the paper will investigate potential improvements that can be realized through application of system safety principles.

Smith, R. Kenneth↗

AIRS Impact on the Analysis and Forecast Track of Tropical Cyclone Nargis in a Global Data Assimilation and Forecasting System

Tropical cyclones in the northern Indian Ocean pose serious challenges to operational weather forecasting systems, partly due to their shorter lifespan and more erratic track, compared to those in the Atlantic and the Pacific. Moreover, the automated analyses of cyclones over the northern Indian Ocean, produced by operational global data assimilation systems (DASs), are generally of inferior quality than in other basins. In this work it is shown that the assimilation of Atmospheric Infrared Sounder (AIRS) temperature retrievals under partial cloudy conditions can significantly impact the representation of the cyclone Nargis (which caused devastating loss of life in Myanmar in May 2008) in a global DAS. Forecasts produced from these improved analyses by a global model produce substantially smaller track errors. The impact of the assimilation of clear-sky radiances on the same DAS and forecasting system is positive, but smaller than the one obtained by ingestion of AIRS retrievals, possibly due to poorer coverage.

Reale, O.↗

Homogeneity of a Global Multisatellite Soil Moisture Climate Data Record

Climate Data Records (CDR) that blend multiple satellite products are invaluable for climate studies, trend analysis and risk assessments. Knowledge of any inhomogeneities in the CDR is therefore critical for making correct inferences. This work proposes a methodology to identify the spatiotemporal extent of the inhomogeneities in a 36-year, global multisatellite soil moisture CDR as the result of changing observing systems. Inhomogeneities are detected at up to 24 percent of the tested pixels with spatial extent varying with satellite changeover times. Nevertheless, the contiguous periods without inhomogeneities at changeover times are generally longer than 10 years. Although the inhomogeneities have measurable impact on the derived trends, these trends are similar to those observed in ground data and land surface reanalysis, with an average error less than 0.003 cubic meters per cubic meter per year. These results strengthen the basis of using the product for long-term studies and demonstrate the necessity of homogeneity testing of multisatellite CDRs in general.

CDR↗

Satellite characterization of global stratospheric sulfate aerosols released by Tonga volcano

Large volcanic eruptions create an enhanced layer of sulfate aerosols in the stratosphere. These sulfuric acid droplets persist for many months, altering the climate and stratospheric chemistry. Sulfate aerosols scatter sunlight back to space, cooling the surface of the Earth and absorb outgoing thermal radiation, heating the stratosphere. The calculation of the climate impact of sulfate aerosols depends on their physical properties such as droplet size and chemical composition. These properties are not well known, and this uncertainty contributes to the errors in climate model predictions. Here we derive the first empirical formula that predicts the composition of stratospheric sulfate aerosols from volcanic eruptions from the air temperature and water vapor pressure. Measurements of atmospheric infrared transmittance of the Hunga Tonga-Hunga Ha'apai sulfate aerosol plume by the Atmospheric Chemistry Experiment (ACE) satellite were analyzed to determine composition (weight percent of sulfuric acid) and median particle radius. These data are supplemented by measurements of the Raikoke and Nabro eruptions. Our analysis allows the properties of volcanic aerosols in the stratosphere to be predicted reliably in atmospheric models.

P Bernath↗

A Neural Network/Acoustic Emission Analysis of Impact Damaged Graphite/Epoxy Pressure Vessels

Acoustic emission (AE) signal analysis has been used to measure the effects of impact damage on burst pressure in 5.75 inch diameter, inert propellant filled, filament wound pressure vessels. The AE data were collected from fifteen graphite/epoxy pressure vessels featuring five damage states and three resin systems. A burst pressure prediction model was developed by correlating the AE amplitude (frequency) distribution, generated during the first pressure ramp to 800 psig (approximately 25% of the average expected burst pressure for an undamaged vessel) to known burst pressures using a four layered back propagation neural network. The neural network, trained on three vessels from each resin system, was able to predict burst pressures with a worst case error of 5.7% for the entire fifteen bottle set.

Walker, James L.↗

Three Decades of Precision Orbit Determination Progress, Achievements, Future Challenges and its Vital Contribution to Oceanography and Climate Research

Although satellite altimetry has been around for thirty years, the last fifteen beginning with the launch of TOPEX/Poseidon (TP) have yielded an abundance of significant results including: monitoring of ENS0 events, detection of internal tides, determination of accurate global tides, unambiguous delineation of Rossby waves and their propagation characteristics, accurate determination of geostrophic currents, and a multi-decadal time series of mean sea level trend and dynamic ocean topography variability. While the high level of accuracy being achieved is a result of both instrument maturity and the quality of models and correction algorithms applied to the data, improving the quality of the Climate Data Records produced from altimetry is highly dependent on concurrent progress being made in fields such as orbit determination. The precision orbits form the reference frame from which the radar altimeter observations are made. Therefore, the accuracy of the altimetric mapping is limited to a great extent by the accuracy to which a satellite orbit can be computed. The TP mission represents the first time that the radial component of an altimeter orbit was routinely computed with an accuracy of 2-cm. Recently it has been demonstrated that it is possible to compute the radial component of Jason orbits with an accuracy of better than 1-cm. Additionally, still further improvements in TP orbits are being achieved with new techniques and algorithms largely developed from combined Jason and TP data analysis. While these recent POD achievements are impressive, the new accuracies are now revealing subtle systematic orbit error that manifest as both intra and inter annual ocean topography errors. Additionally the construction of inter-decadal time series of climate data records requires the removal of systematic differences across multiple missions. Current and future efforts must focus on the understanding and reduction of these errors in order to generate a complete and consistent time series of improved orbits across multiple missions and decades required for the most stringent climate-related research. This presentation discusses the POD progress and achievements made over nearly three decades, and presents the future challenges, goals and their impact on altimetric derived ocean sciences.

Luthcke, Scott↗