Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error impact analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

The impact of Doppler lidar wind observations on a single-level meteorological analysis

Through the use of observation operators, modern data assimilation systems have the capability to ingest observations of quantities that are not themselves model variables, but are mathematically related to those variables. An example of this are the so-called LOS (line of sight) winds that a Doppler wind Lidar can provide. The model - or data assimilation system - needs information about both components of the horizontal wind vectors, whereas the observations in this case only provide the projection of the wind vector onto a given direction. The analyzed value is then calculated essentially based on a comparison between the observation itself and the model-simulated value of the observed quantity. However, in order to assess the expected impact of such an observing system, it is important to examine the extent to which a meteorological analysis can be constrained by the LOS winds. The answer to this question depends on the fundamental character of the atmospheric flow fields that are analyzed, but more importantly it also depends on the real and assumed error covariance characteristics of these fields. A single-level wind analysis system designed to explore these issues has been built at the NASA Data Assimilation Office. In this system, simulated wind observations can be evaluated in terms of their impact on the analysis quality under various assumptions about their spatial distribution and error characteristics and about the error covariance of the background fields. The basic design of the system will be presented along with experimental results obtained with it. In particular, the value of simultaneously measuring LOS winds along two different directions for a given location will be discussed.

Riishojgaard, L. P.↗

A study for systematic errors of the GLA forecast model in tropical regions

From the sensitivity studies performed with the Goddard Laboratory for Atmospheres (GLA) analysis/forecast system, it was revealed that the forecast errors in the tropics affect the ability to forecast midlatitude weather in some cases. Apparently, the forecast errors occurring in the tropics can propagate to midlatitudes. Therefore, the systematic error analysis of the GLA forecast system becomes a necessary step in improving the model's forecast performance. The major effort of this study is to examine the possible impact of the hydrological-cycle forecast error on dynamical fields in the GLA forecast system.

Chen, Tsing-Chang↗

Maneuver Reconstruction, Tracking Scheduling, and Bias Estimation in the Near Rectilinear Halo Orbit (NRHO)

NASA’s Gateway program will build a crew-tended station in an Earth-Moon Near Rectilinear Halo Orbit (NRHO) to support deep space missions to the lunar surface and heliocentric space. The station in the NRHO will be tracked by the Deep Space Network (DSN) with 2-way radiometric tracking data to produce an estimated state that is utilized to target Orbit Maintenance Maneuvers (OMMs). However, the tracking data is corrupted with measurement noise and range bias, which results in state estimation error and OMM execution error. This paper reports on analysis performed to improve the geometry of the tracking data problem with the inclusion of cross-hemispheric partner sites and explores the performance impact of handovers between partner sites and DSN sites. The OMM execution error is estimated directly using a Batch Least Squares (BLS) process, and the range bias estimation is analyzed among both original DSN sites and a combined DSN + partner sites scenario.

Clark P Newman↗

An Analysis of Grid Operator Survey Responses: Inexperience, Workload and Fatigue in the Control Room

Although a wide array of tools and technologies have been developed over the last decade to support power grid operators, deployment of these tools has been less successful. One reason for unsuccessful deployment may be an inadequate understanding of the factors that contribute to operator error in the control room. An analysis of operators’ current vulnerabilities may provide the baseline understanding needed to inform new technology integration. In an attempt to learn more about these vulnerabilities and their perceived impact on human error we collected and analyzed survey data from 20 electric grid control room operators. We asked survey respondents to consider the various operator, technology and interaction vulnerabilities that may arise during work in the control room and record their attitudes and experiences toward each. Results suggest operator inexperience, high mental workload and fatigue are the most common vulnerabilities experienced during a shift. Survey results were analyzed to explore these vulnerabilities in greater depth.

Inexperience, Workload, Fatigue↗

Modeling and Control of Airport Queueing Dynamics under Severe Flow Restrictions

Based on field observations and interviews with controllers at BOS and EWR, we identify the closure of local departure fixes as the most severe class of airport departure restrictions. A set of simple queueing dynamics and traffic rules are developed to model departure traffic under such restrictions. The validity of the proposed model is tested via Monte Carlo simulation against 10 hours of actual operations data collected during a case-study at EWR on June 29,2000. In general, the model successfully reproduces the aggregate departure congestion. An analysis of the average error over 40 simulation runs indicates that flow-rate restrictions also significantly impact departure traffic; work is underway to capture these effects. Several applications and what-if scenarios are discussed for future evaluation using the calibrated model.

Carr, Francis↗

Note on the Effect of Horizontal Gradients for Nadir-Viewing Microwave and Infrared Sounders

Passive microwave and infrared nadir sounders such as the Advanced Microwave Sounding Unit A (AMSU-A) and the Atmospheric InfraRed Sounder (AIRS), both flying on NASA s EOS Aqua satellite, provide information about vertical temperature and humidity structure that is used in data assimilation systems for numerical weather prediction and climate applications. These instruments scan cross track so that at the satellite swath edges, the satellite zenith angles can reach approx. 60 deg. The emission path through the atmosphere as observed by the satellite is therefore slanted with respect to the satellite footprint s zenith. Although radiative transfer codes currently in use at operational centers use the appropriate satellite zenith angle to compute brightness temperature, the input atmospheric fields are those from the vertical profile above the center of the satellite footprint. If horizontal gradients are present in the atmospheric fields, the use of a vertical atmospheric profile may produce an error. This note attempts to quantify the effects of horizontal gradients on AIRS and AMSU-A channels by computing brightness temperatures with accurate slanted atmospheric profiles. We use slanted temperature, water vapor, and ozone fields from data assimilation systems. We compare the calculated slanted and vertical brightness temperatures with AIRS and AMSU-A observations. We show that the effects of horizontal gradients on these sounders are generally small and below instrument noise. However, there are cases where the effects are greater than the instrument noise and may produce erroneous increments in an assimilation system. The majority of the affected channels have weighting functions that peak in the upper troposphere (water vapor sensitive channels) and above (temperature sensitive channels) and are unlikely t o significantly impact tropospheric numerical weather prediction. However, the errors could be significant for other applications such as stratospheric analysis. Gradients in ozone and tropospheric temperature appear to be well captured by the analyses. In contrast, gradients in upper stratospheric and mesospheric temperature as well as upper tropospheric humidity are less well captured. This is likely due in part to a lack of data to specify these fields accurately in the analyses. Advanced new sounders, like AIRS, may help to better specify these fields in the future.

Joiner, J.↗

Uncertainty of Observation Impact Estimation in an Adjoint Model Investigated with an Observing System Simulation Experiment

Adjoint models are often used to estimate the impact of different observations on short-term forecast skill. A common difficulty with the evaluation of short term forecast quality is the choice of verification fields. The use of self-analysis fields for verification is typical but incestuous, and introduces uncertainty due to biases and errors in the analysis field. In this study, an observing system simulation experiment (OSSE) is used to explore the uncertainty in adjoint model estimations of observation impact. The availability of the true state for verification in the OSSE framework in the form of the Nature Run allows calculation of the observation impact without the uncertainties present in self-analysis verification. These impact estimates are compared to estimates calculated using self-analysis verification. The Global Earth Observing System version 5 (GEOS-5) forecast model with Gridpoint Statistical Interpolation (GSI) is used with the National Aeronautics and Space Administration Global Modeling and Assimilation Office (NASA/GMAO) OSSE capability. The adjoint model includes moist processes, with total wet energy selected as the norm for evaluation of observation impacts. The results show that there are measurable but small discrepancies in the adjoint model estimation of observation impact. In general, observations of temperature and winds tend to have overestimated impacts with self-analysis verification, while observations of humidity and moisture-affected observations tend to have underestimated impacts. The small magnitude of the differences in impact estimates supports the robustness of the adjoint method of estimating observation impacts.

N C Prive↗

Introductory guide to backgrounds in XPS spectra and their impact on determining peak intensities

Photoelectron and Auger peaks are central to most of the important uses of x-ray photoelectron spectroscopy (XPS), and thus, they receive the most attention in many types of analysis. Quantitative chemical analysis using XPS requires the assessment of the intensities of the photoemission peaks of the elements detected. Determination of peak intensities requires separation of the photoelectron peak signals from the background on which the peaks rest. For the determination of peak area intensities, the background is subtracted from overall signal intensity. The spectral background is also critical when peak fitting is used to determine intensities of overlapping peaks, and the model of background used in this process can impact the results. In addition to the impact on quantitative analysis, information about the depth distribution of elements in the near surface region can often be obtained by visual inspection of the background and quantified using appropriate modeling. Here, this introductory guide provides some basic information about backgrounds in the XPS analysis, describes the types of background models that are commonly used, suggests some of their strengths and weaknesses, and provides examples of their use and misuse. Although the fundamental nature of some components of the background signals in XPS is not understood, indicating that none of the models in use are fully correct and the area is subject to active research, appropriate good practices have been established for most routine analysis. The guide describes good practices, identifies errors that frequently appear in the literature, and uses examples to demonstrate the impacts of background selections on determinations of peak intensities.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Analysis of Integrated Vapor Transport Biases

Abstract High-fidelity analyses and forecasts of integrated vapor transport (VT) are central to the study of Earth’s hydrological cycle as well as high-impact phenomena such as monsoons and atmospheric rivers. The impact of the in-line analysis correction-based additive inflation (ACAI) on IVT biases and forecast errors is examined within the Navy Earth System Prediction Capability (Navy ESPC) global coupled system. The ACAI technique uses atmospheric analysis corrections from the data assimilation system to approximate model bias and as a representation of stochastic model error to simultaneously reduce systematic and random errors and improve ensemble performance. ACAI reduces the global average magnitude of the 7- and 14-day IVT bias by 16%–17% during Northern Hemisphere summer, reaching 70% reductions in some tropical regions. The global average IVT bias reduction is similar to the bias reduction for low-level wind speed bias and considerably smaller than the bias reduction in total precipitable water. The localized regions where ACAI increases IVT bias occur where the control IVT biases change sign and structure with increasing forecast lead time, such as the South Asian monsoon region. Substituting analyzed wind or moisture fields for the forecast fields when calculating the forecast IVT confirms that, on average, wind errors dominate the IVT error calculation in the tropics, although wind and moisture error contributions are comparable in the extratropics. The existence of regions where using either analyzed winds or analyzed moisture increases IVT bias or mean absolute error reveals areas with compensating errors.

Reynolds, Carolyn A.↗

Integrated Modeling Activities for the James Webb Space Telescope: Optical Jitter Analysis

This is a continuation of a series of papers on the integrated modeling activities for the James Webb Space Telescope(JWST). Starting with the linear optical model discussed in part one, and using the optical sensitivities developed in part two, we now assess the optical image motion and wavefront errors from the structural dynamics. This is often referred to as "jitter: analysis. The optical model is combined with the structural model and the control models to create a linear structural/optical/control model. The largest jitter is due to spacecraft reaction wheel assembly disturbances which are harmonic in nature and will excite spacecraft and telescope structural. The structural/optic response causes image quality degradation due to image motion (centroid error) as well as dynamic wavefront error. Jitter analysis results are used to predict imaging performance, improve the structural design, and evaluate the operational impact of the disturbance sources.

Hyde, T. Tupper↗

FEA-Based Failure Analysis of Post-Buckled Composite Multi-Hat Stiffened Panel Under Static Compression

The aerospace industry uses composite multi-hat stiffened panels for skins because of their high strength-to-weight and stiffness-to-weight ratios. However, laminated composites with initial flaws are susceptible to delamination under buckling loads. The goal is to ensure damage initiation occurs past the buckled state, only stable damage progression at loads below the ultimate compressive load, and debonding failure past the ultimate compressive load. This approach reduces weight and addresses a potential design review for future aircraft repairs. The need exists to better understand damage initiation and growth mechanisms in composite structures while assisting in the design, analysis, and sustainment methods. Teflon inserts simulate damage defects during manufacturing, while barely visible impact helps capture human error during manufacturing. This work shows the interaction between the skin-stringer and ply-ply separations at the post-buckled state for both defect events using Abaqus Virtual Crack Closure Technique (VCCT). The initial configuration for the Teflon case was to leave the Teflon region unbonded, and the initial impact damage region approximation came from the experimental data and was considered the initial configuration. When compared against the experimental data produced through the NASA Advanced Composites Project (ACP), the present model captured damage transition from skin-hat to ply1-ply2. The model validations were within ~5% of the experimental data.

composite↗

Full circle mechanical dynamic characterization including experimental modal analysis and finite element analysis

During operation, it was observed that a specific mechanical system experienced undesirable vibration and it became necessary to understand and mitigate this phenomenon. This document investigates the tools, methodology, and results of the dynamic characterization of the system. The characterization makes use of the experimental modal analysis (EMA) methods of single input multiple output (SIMO) and single input single output (SISO). The validity of the theory of reciprocity is confirmed to minimize measurement error, cost, and time of repeat testing. Finite element analysis (FEA) is used in choosing transducer and modal impact locations to adequately characterize the system. Single degree of freedom (SDOF) and multiple degree of freedom (MDOF) curve fitting is used to fully characterize the system’s mode shapes and natural frequencies. The EMA characterization results are used to modify and validate the FEA model so that FEA can be used to model potential structural modifications to the system to mitigate the undesirable vibration. Structural modifications are chosen, implemented, and their effectiveness is quantified using EMA. Finally, a qualitative evaluation of the methodology of FEA validation by EMA and tuning of the model to match the experimental results is discussed.

42 ENGINEERING↗

Analysis and Forecast of Two Storms Characterized by Extreme Deepening Rates

Between 25 and 27 December 1999 two very intense cyclones, named Lothar and Martin, swept across northern and western France causing substantial life and property loss. In this work, the finite volume general circulation model and data assimilation system (fvDAS) developed at the Data Assimilation Office of the NASA Goddard Space and Flight Center is being used to investigate these storms. In the first part of this article the dynamics of the storms is analyzed, and some important mechanisms are unveiled. The second part describes a set of eleven data assimilation experiments to study the impact of different data types on the automated analyses. Cloud-track winds provided by EUMETSAT and surface winds from QuikSCAT are being used. These data are assimilated with a range of different parameter settings of the forecast error covariance model. The results show that generally the additional wind data set have positive impacts on the analyses: particularly, the analysis of Lothar can be slightly improved by using the Eumetsat winds, and the analysis of Martin can be strongly improved by using the full-resolution QuikSCAT winds with a more localized influence. The third part of this article is focused on the forecast of Lothar which is very well predicted in the 1-5 day range by the fvDAS system.

Reale, Oreste↗

The Analysis and Design of Low Boom Configurations Using CFD and Numerical Optimization Techniques

The use of computational fluid dynamics (CFD) for the analysis of sonic booms generated by aircraft has been shown to increase the accuracy and reliability of predictions. CFD takes into account important three-dimensional and nonlinear effects that are generally neglected by modified linear theory (MLT) methods. Up to the present time, CFD methods have been primarily used for analysis or prediction. Some investigators have used CFD to impact the design of low boom configurations using trial and error methods. One investigator developed a hybrid design method using a combination of Modified Linear Theory (e.g. F-functions) and CFD to provide equivalent area due to lift driven by a numerical optimizer to redesign or modify an existing configuration to achieve a shaped sonic boom signature. A three-dimensional design methodology has not yet been developed that completely uses nonlinear methods or CFD. Constrained numerical optimization techniques have existed for some time. Many of these methods use gradients to search for the minimum of a specified objective function subject to a variety of design variable bounds, linear and nonlinear constraints. Gradient based design optimization methods require the determination of the objective function gradients with respect to each of the design variables. These optimization methods are efficient and work well if the gradients can be obtained analytically. If analytical gradients are not available, the objective gradients or derivatives with respect to the design variables must be obtained numerically. To obtain numerical gradients, say, for 10 design variables, might require anywhere from 10 to 20 objective function evaluations. Typically, 5-10 global iterations of the optimizer are required to minimize the objective function. In terms of using CFD as a design optimization tool, the numerical evaluation of gradients can require anywhere from 100 to 200 CFD computations per design for only 10 design variables. If one CFD computation requires an hour of computational time on a Cray computer, one can see that the use of constrained numerical optimization quickly becomes impractical.Hence, in order to practically couple a numerical design optimization technique with a CFD method, the CFD method must be extremely efficient with running times on the order of only minutes. The CFD Euler code developed under NASA sponsorship and referred to as MIM3D-SB for the most part fulfills these efficiency requirements. Analysis of wing- body configurations can be computed in a matter of a few minutes. The present study will concentrate on the feasibility of the use of this CFD code in conjunction with a numerical design optimization technique for the sonic boom reduction of candidate HSCT configurations. A preliminary supersonic aircraft design system has been established that utilizes the numerical design optimization code NPSOL developed at Stanford University coupled with the supersonic NUM3D-SB CFD code. Many questions still need to be answered in regard to using CFD and numerical optimizers as design tools. There are difficulties related to both the CFD codes and the numerical optimizers. Numerical optimizers can converge to a local minima rather than a global minima. This behavior is largely a function of the initial guess in the design space. The optimizer also is searching for a minimum of the function in terms of its derivative without any regard to the actual function value. Numerically (i.e. CFD) determined gradients can also generate spurious numerical local minima. In addition, for the sonic boom problem, grid fineness will also determine the accuracy of the final design solution. Design optimization methods work well on problems defined by continuous objective functions. The sonic boom signature design problem is not necessarily defined by a continuous objective function. The signature can have a variety of shapes; i.e. from N-wave to multiple shocks. The far-field or ground signature may not transition continuously from one shape to another and hence, may exhibit discontinuous behavior. This is also a source of difficulty in using design optimization methods.In the following sections, several low boom and one reference aircraft configuration will be analyzed to predict their sonic boom signature characteristics. Modifications to some of these designs will also be presented to demonstrate the feasibility of using CFD as a design tool and to demonstrate the feasibility of designing shaped sonic boom signatures. Design modifications to some configurations will be presented to demonstrate the feasibility of achieving shaped signatures with reduced levels and not necessarily to represent realistic or aerodynamically efficient design modifications. Fuselage volume or camber are used as design variables in order to have a minimal effect on the primary wing aerodynamics. The paper will also seek to demonstrate whether a hybrid or ramped signature is feasible to achieve. For the low-boom configurations, the CFD predicted signatures will be compared qualitatively to their MLT design signatures.

Siclari, Michael J.↗

Model wall and recovery temperature effects on experimental heat transfer data analysis

Basic analytical procedures are used to illustrate, both qualitatively and quantitatively, the relative impact upon heat transfer data analysis of certain factors which may affect the accuracy of experimental heat transfer data. Inaccurate knowledge of adiabatic wall conditions results in a corresponding inaccuracy in the measured heat transfer coefficient. The magnitude of the resulting error is extreme for data obtained at wall temperatures approaching the adiabatic condition. High model wall temperatures and wall temperature gradients affect the level and distribution of heat transfer to an experimental model. The significance of each of these factors is examined and its impact upon heat transfer data analysis is assessed.

Throckmorton, D. A.↗

Single-Band VLBI Absolute Astrometry

The ionospheric path delay impacts single-band very long baseline interferometry (VLBI) group delays, which limits their applicability for absolute astrometry. I consider two important cases: when observations are made simultaneously in two bands, but delays in only one band are available for a subset of observations and when observations are made at one band design. I developed optimal procedures of data analysis for both cases using Global Navigation Satellite System (GNSS) ionosphere maps, provided a stochastic model that describes ionospheric errors, and evaluated their impact on source position estimates. I demonstrate that the stochastic model is accurate at a level of 15%. I found that using GNSS ionospheric maps as is introduces serious biases in estimates of declination and I developed a procedure that almost eliminates them. I found serendipitously that GNSS ionospheric maps have multiplicative errors and have to be scaled by 0.85 in order to mitigate the declination bias. A similar scale factor was found in comparison of the vertical total electron content from satellite altimetry against GNSS ionospheric maps. I favor interpretation of this scaling factor as a manifestation of the inadequacy of the thin shell model of the ionosphere. I showed that we are able to model the ionospheric path delay to the extent that no noticeable systematic errors emerge and we are able to assess adequately the contribution of the ionosphere-driven random errors on source positions. This makes single-band absolute astrometry a viable option that can be used for source position determination.

Radio astrometry↗

Investigation of the Potential for Lidar & Polarimeter Combined Aerosol Retrievals Using Various Instrument Combinations

As a scientific community, we are motivated to achieve better observational capabilities for aerosols, to reduce uncertainties about aerosol’s role in climate. Encouraged by the National Academies Decadal Survey, many are looking to the synergy of lidar and polarimeter as a means of achieving improved measurements. Polarimetric observations of total-column radiances have excellent sensitivity to aerosol size distribution and absorption properties. Active lidar measurements have fewer wavelengths and view angles and therefore more limited sensitivity to aerosol microphysical properties such as complex refractive index. Yet the advantage of vertically resolved profiles is game-changing, especially given that models contain significant uncertainty about the vertical distribution of aerosol and that polarimeter and other passive retrievals must make assumptions about vertical distribution which can impact performance. To optimize the synergy, a joint polarimeter + lidar mission requires a joint retrieval. However, the exact instruments that will be launched on a future satellite are unknown, and the capabilities of polarimeters and lidars cover a large range. In this study, we perform information content analysis for a range of nominal instrument combinations. The methodology is ideal for assessing the impact of measurements and a priori information (assumptions and constraints) with respect to the desired retrieval products, and for comparing measurement systems. It has advantages that make it useful in advance of or in parallel with retrieval development, such as producing quantitatively useful comparisons even for retrieval scenarios that are significantly underdetermined and therefore impossible to retrieve without significant assumptions, and it is not impacted by retrieval-specific sources of error such as incomplete or incorrect convergence which can complicate the interpretation of a retrieval performance analysis. Here, we will derive the expected uncertainty in retrieved aerosol concentration, effective radius, fine mode fraction and single scattering albedo, for a combination of a polarimeter with various grades of lidar, from an elastic backscatter lidar, similar to the pathfinder CALIOP on the CALIPSO satellite, to a multi-wavelength high spectral resolution lidar.

Sharon P Burton↗

Observing System Simulation Experiments Investigating Atmospheric Motion Vectors and Radiances from a Constellation of 4-5 μm Infrared Sounders

A set of Observing System Simulation Experiments (OSSEs) was performed to investigate the utility of a constellation of passive infrared spectrometers, strategically designed with the aim of deriving the three-dimensional retrievals of the horizontal wind via atmospheric motion vectors (AMVs) from instruments with the spectral resolution of an infrared sounder. The instrument and constellation designs were performed in the context of the Midwave Infrared Sounding of Temperature and humidity in a Constellation for Winds, or MISTiC Winds. The Global Modeling and Assimilation Office OSSE system, which includes a full suite of operational meteorological observations, served as the control. To illustrate the potential impact of this observing strategy, two experiments were performed by adding the new simulated observations to the control. First, perfect (error-free) simulated AMVs and radiances were assimilated. Second, the data were made imperfect by adding realistic modeled errors to the AMVs and radiances that were assimilated. The experimentation showed beneficial impacts on both the mass and wind fields, as based on analysis verification, forecast verification, and the assessment of the observations using the Forecast Sensitivity to Observation Impact (FSOI) metric. In all variables and metrics, the impacts of the imperfect observations were smaller than those of the perfect observations, though much of the positive benefit was retained. The FSOI metric illustrated two key points. First, the largest impacts were seen in the middle troposphere AMVs, which is a targeted capability of the constellation strategy. Second, the addition of modeled errors showed that the assimilation system was unable to fully exploit the 4.3 μm carbon dioxide absorption radiances.

Will McCarty↗