Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error impact analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Scaling Observation Error for Optimal Assimilation of CCI SST Data into a Regional HYCOM EnOI System

South Africa currently possesses no operational ocean forecasting system for the purpose of predicting ocean state variables including temperature,salinity and velocity. Substantial initial efforts towards this goal have been made and resulted in a system using a regional Hybrid Coordinate Ocean Model (HYCOM) along with the Ensemble Optimal Interpolation (EnOI)assimilation scheme. Assimilating only sea surface temperature (SST) observations from the Operational Sea Surface Temperature and Sea Ice Analysis (OSTIA) product into the system resulted in a degraded forecast. Aiming to address this, Climate Change Initiative (CCI) SSTs are assimilated into the system in an effort to improve the forecast skill. Observation errors in the assimilated product are used in the EnOI to determine whether more confidence should be placed in the model or observations in producing the analysis, but overconfidence in observations can shock the model and result in failure. To tweak the impact of the assimilation, a scaling factor is applied in the assimilation code. A scaling factor of 25 was found to produce a favourable result with lowest mean root mean square error (RMSE;1.098°C) between the model and observations over time. Postulating the error to be overconfident, a floor value is introduced in order to set a minimum value for the observation error thereby reducing confidence in the observations. These experiments fared less favourably with a floor value of 0.5 and a scaling factor of 15 producing the best mean RMSE (1.118°C).

Luyt, Hermann↗

Analysis of estimation algorithms for CDTI and CAS applications

Estimation algorithms for Cockpit Display of Traffic Information (CDTI) and Collision Avoidance System (CAS) applications were analyzed and/or developed. The algorithms are based on actual or projected operational and performance characteristics of an Enhanced TCAS II traffic sensor developed by Bendix and the Federal Aviation Administration. Three algorithm areas are examined and discussed. These are horizontal x and y, range and altitude estimation algorithms. Raw estimation errors are quantified using Monte Carlo simulations developed for each application; the raw errors are then used to infer impacts on the CDTI and CAS applications. Applications of smoothing algorithms to CDTI problems are also discussed briefly. Technical conclusions are summarized based on the analysis of simulation results.

Goka, T.↗

Self-Calibration of BICEP1 Three-Year Data and Constraints on Astrophysical Polarization Rotation

Cosmic microwave background (CMB) polarimeters aspire to measure the faint B-mode signature predicted to arise from inflationary gravitational waves. They also have the potential to constrain cosmic birefringence, rotation of the polarization of the CMB arising from parity-violating physics, which would produce nonzero expectation values for the CMB's temperature to B-mode correlation (TB) and E-mode to B-mode correlation (EB) spectra. However, instrumental systematic effects can also cause these TB and EB correlations to be nonzero. In particular, an overall miscalibration of the polarization orientation of the detectors produces TB and EB spectra which are degenerate with isotropic cosmological birefringence, while also introducing a small but predictable bias on the BB spectrum. We find that BICEP1 three-year spectra, which use our standard calibration of detector polarization angles from a dielectric sheet, are consistent with a polarization rotation of alpha = −2.77deg +/- 0.86deg (statistical) +/- 1.3deg (systematic). We have revised the estimate of systematic error on the polarization rotation angle from the two-year analysis by comparing multiple calibration methods. We also account for the (negligible) impact of measured beam systematic effects. We investigate the polarization rotation for the BICEP1 100 GHz and 150 GHz bands separately to investigate theoretical models that produce frequency-dependent cosmic birefringence. We find no evidence in the data supporting either of these models or Faraday rotation of the CMB polarization by the Milky Way galaxy's magnetic field. If we assume that there is no cosmic birefringence, we can use the TB and EB spectra to calibrate detector polarization orientations, thus reducing bias of the cosmological B-mode spectrum from leaked E-modes due to possible polarization orientation miscalibration. After applying this "self-calibration" process, we find that the upper limit on the tensor-to-scalar ratio decreases slightly, from r < 0.70 to r < 0.65 at 95% confidence.

three-year↗

Sulfur and Oxygen Isotopic Analysis of a Cosmic Symplectite from a Comet Wild 2 Stardust Terminal Particle

Introduction: Analyses of comet 81P/Wild 2 samples re-turned from the Stardust mission have uncovered surprising simi-larities to meteoritic material, including the identification of inner solar system grains [1-3]. The TEM characterization of terminal particle (TP) 4 from Stardust track #147 revealed an assemblage consisting of symplectically intergrown pentlandite and nanocrys-talline maghemite coexisting with high-Ca pyroxene [4]. Mineral-ogically similar cosmic symplectites (COS) containing pentlandite and magnetite in the primitive Acfer 094 meteorite are highly de-pleted in 16O (17O, 18O ~ 180 per mille) [5-7]. This isotopic signature is proposed to record alteration with primordial solar nebula water. Conversely, the normal O isotopic composition of the Stardust COS indicates alteration by a different aqueous reservoir, perhaps on the comet [8]. In this study, we analyzed the Wild 2 COS for S isotopes to further constrain its origin. Experimental: Thin sections of TP4 (12 m) were produced and their mineralogy was thoroughly characterized by TEM. Two of the sections were analyzed for O isotopes by isotopic imaging in the JSC NanoSIMS 50L. The sample in one of the slices was completely consumed. The remaining material in the adjacent slice was analyzed simultaneously for 16O, 32S, 33S, 34S, and 56Fe16O in electron multipliers using a Cs+ primary ion beam. Quasi-simulta-neous arrival (QSA) can have a significant effect on S isotopic ra-tios when using electron multipliers, resulting in undercounting of 32S [9]. Canyon Diablo troilite (CDT) was measured numerous times to deduce a correction factor for QSA and ensure measure-ment reproducibility. Isotopic ratios are reported relative to CDT. Results and Discussion: The Wild 2 COS is enriched in the heavy S isotopes relative to CDT (33S = 6.5 +/- 1.6 per mille; 34S = 5.1 +/- 0.7 per mille; 1). The degree of 33S enrichment indicates mass-inde-pendent fractionation (MIF) with 33S = 3.9 +/- 1.7 per mille. MIF of S has been observed in some chondrules (33S up to 0.11per mille) [10], but this effect has not been identified in sulfides from carbonaceous chondrites [11] or IDPs [12]. S isotopic analysis of Stardust impact craters also did not reveal MIF or anomalies, save for one potential 32S-rich presolar sulfide [13]. Measurement errors on these impact craters were much larger than those in this study, however. MIF of S has been proposed to result from heterogeneities in the solar neb-ula from nucleosynthetic components [14] or photochemical irra-diation of solar nebula gas [10]. Presolar SiC grains are observed to have 32S enrichments [15, 16] contrary to the S isotopic compo-sition of the cometary COS. The S isotopic composition more likely reflects irradiation of nebular gas.

Nguyen, A. N.↗

Revised estimates of NO 2 reductions during the COVID-19 lockdowns using updated TROPOMI NO 2 retrievals and model simulations

The TROPOspheric Monitoring Instrument (TROPOMI) observed unprecedented declines in NO 2 vertical column densities (VCD) over the world's most densely populated cities during the 2020 COVID-19 lockdowns. These favorable changes in NO 2 air quality were correlated with sharp reductions in traffic volume and economic activity during the lockdowns. In this comprehensive global study, we provide revised estimates of the declines in anthropogenic emissions for 36 megacities using a novel methodology for disentangling the anthropogenic emissions from the meteorological transport and natural variability. We further quantify the uncertainty associated with changes in the a priori profile shape information during the lockdowns due to reduced emissions. Satellite NO 2 retrieval techniques calculate an air mass factor that requires a priori NO 2 profile shape information representative of the local atmosphere. This information, which is typically obtained from a chemical transport model (CTM), was not available for the early studies. This study also accounts for the satellite sampling errors resulting from the selective sampling of non-cloudy scenes during the study period. For our analysis, we used CTM simulations that were generated with and without COVID-impacted emissions. We perform retrievals of tropospheric NO 2 columns with the NASA NO 2 algorithm, and then use observed and simulated data to disentangle the meteorological transport from the contribution due anthropogenic emissions. We found that the meteorological transport was most significant source of variability ranging between −35% and 22% of the change total tropospheric VCD. We also find that not accounting for changes in the a priori NO 2 profile shape information during the lockdowns resulted in systematic retrieval errors that were up to 12% of the estimated decline, and the elimination of cloud contaminated scenes resulted in sampling errors that in general ranged between varied ±15%.

NO2↗

ERTS-1 flood hazard studies in the Mississippi River Basin

The Spring 1973 Mississippi River flood was investigated using remotely sensed data from ERTS-1. Both manual and automatic analyses of the data indicate that ERTS-1 is extremely useful as a regional tool for flood and floodplain management. The maximum error of such flood area measurements is conservatively estimated to be less than five percent. Change detection analysis indicates that the flood had major impacts on soil moisture, land pattern stability, and vegetation stress. Flood hazard identification was conducted using photointerpretation techniques in three study areas along the Mississippi River using pre-flood ERTS-1 imagery down to 1:100,000 scale. Flood prone area boundaries obtained from ERTS-1 were generally in agreement with flood hazard maps produced by the U.S. Army Corps of Engineers and the U.S. Geological Survey although the latter are somewhat more detailed because of their larger scale. Initial results indicate that ERTS-1 digital mapping of the flood-prone areas can be performed at least 1:62,500 which is comparable to conventional flood hazard map scales.

Rango, A.↗

Dynamic Analyses of the Proposed Habitable Exoplanet Astrophysics Facility

The proposed Habitable Exoplanet (HabEx) astrophysics facility is one of four large such facilities being proposed to the 2020 decadal. It is a large telescope that is sensitive to ultraviolet, optical, and near-infrared photons. The proposed design’s overall length is on the order of 17.2 m and its maximum cross section is on the order of 5.25 X 5.25 m. The primary mirror is 4 m in diameter. A transient dynamic analysis was performed to estimate the order of magnitude of ring down time after moving the telescope and pointing at a new target for science planning purposes. Without uncertainty factors, results from a simple re-pointing maneuver indicate that primary to secondary mirror LOS errors are on the order of 10-4 pico-m after 5 minutes. Also, a frequency response analysis was performed to predict the impact of planned micro-thruster vibrations on required stability. Based on provided noise level associated with the micro-thrusters and loading assumptions and without uncertainty factors, the assessed vibrations do not impact predicted performance requirements.

Knight, J. Brent↗

Using OSSEs to Evaluate the Impacts of Geostationary Infrared Sounders

An observing system simulation experiment (OSSE) was performed to assess the impact of assimilating hyperspectral infrared (IR) radiances from geostationary orbit on numerical weather prediction, with a focus on the proposed sounder on board the Geostationary Extended Observations (GeoXO) program’s central satellite. Infrared sounders on a geostationary platform would fill several gaps left by IR sounders on polar-orbiting satellites, and the increased temporal resolution would allow the observation of weather phenomena evolution. The framework for this OSSE was the Global Modeling and Assimilation Office (GMAO) OSSE system, which includes a full suite of meteorological observations. The experiment additionally assimilated four identical IR sounders from geostationary orbit to create a “ring” of vertical profiling observations. Based on the experimentation, assimilation of the IR sounders provided a beneficial impact on the analyzed mass and wind fields, particularly in the tropics, and produced an error reduction in the initial 24–48 h of the subsequent forecasts. Specific attention was paid to the impact of the GeoXO Sounder (GXS) over the contiguous United States (CONUS) as this is a region that is well-observed and as such difficult to improve. The forecast sensitivity to observation impact (FSOI) metric, computed across all four synoptic times over the CONUS, reveals that the GXS had the largest impact on the 24-h forecast error of the assimilated hyperspectral infrared satellite radiances as measured using a moist energy error norm. Based on this analysis, the proposed GXS has the potential to improve numerical weather prediction globally and over the CONUS.

OSSE↗

Uncertainty Analysis of the CE-22 Advanced Nozzle Test Facility

This paper presents methods and results of a detailed measurement uncertainty analysis that was performed for the Advanced Nozzle Test Facility, CE-22, located at the NASA Glenn Research Center. Results for the uncertainty in thrust and flow coefficients, in addition to other variables of interest, are provided. Results are presented separately as random uncertainty (characterizing errors inherent to instrument or measurement environment, impacting repeatability), systematic uncertainty (capturing inaccuracies due to measurement process, calibration, installation effects or other sources which may introduce bias), and total combined uncertainty. The statistical methods and engineering judgments used to estimate elemental uncertainties are described. The analysis tool MANTUS (Measurement Analysis Tool for Uncertainty in Systems) was used to quantify instrumentation system uncertainty, and statistical analysis and engineering judgment were used to quantify other random and systematic uncertainty sources. The Monte Carlo method was used to propagate systematic and random elemental uncertainties to determine the uncertainties of various calculated variables of interest.

data quality↗

Quantifying Uncertainty of Landing and Takeoff Noise for Commercial Supersonic Aircraft

Of the many challenges faced by manufacturers attempting to offer supersonic travel to the public, the uncertainty in predicting the noise of these aircraft in airport operations has an immediate impact. No noise regulation exists in FAA or ICAO for certifying such aircraft, as these organization require solid data, usually from existing aircraft. Manufacturers are taking large risks to design a vehicle not knowing whether it will be allowed to fly. A partial solution to this conundrum is to use physics-based simulations to provide the “data” used to calibrate system-level prediction methods, carefully documenting the uncertainty of the method for application to supersonic aircraft. A close look at the accuracy of empirical prediction methods points to areas where improvements need to be made if noise studies of supersonic aircraft are to be useful. As NASA embarks on a focused research program to improve predictions of noise from the noise-dominant propulsion noise of commercial supersonic aircraft, this paper documents the work done to baseline the uncertainties found in today’s noise prediction methods. A relatively simplistic method was developed, summarizing the error of the empirical methods on a component basis and following their impact on the total aircraft during landing and takeoff operations using Monte Carlo analysis. By this method it is found that current empirical noise prediction methods have an uncertainty of 1.5 EPNdB cumulative for propulsion noise of a representative conventional subsonic passenger aircraft. When applied to likely near-term supersonic commercial aircraft, the uncertainty is 7.6 EPNdB cumulative, a difference that must be reduced if the prediction methods are to guide decision makers.

Airport noise↗

Modeling in the State Flow Environment to Support Launch Vehicle Verification Testing for Mission and Fault Management Algorithms in the NASA Space Launch System

Analysis methods and testing processes are essential activities in the engineering development and verification of the National Aeronautics and Space Administration's (NASA) new Space Launch System (SLS). Central to mission success is reliable verification of the Mission and Fault Management (M&FM) algorithms for the SLS launch vehicle (LV) flight software. This is particularly difficult because M&FM algorithms integrate and operate LV subsystems, which consist of diverse forms of hardware and software themselves, with equally diverse integration from the engineering disciplines of LV subsystems. M&FM operation of SLS requires a changing mix of LV automation. During pre-launch the LV is primarily operated by the Kennedy Space Center (KSC) Ground Systems Development and Operations (GSDO) organization with some LV automation of time-critical functions, and much more autonomous LV operations during ascent that have crucial interactions with the Orion crew capsule, its astronauts, and with mission controllers at the Johnson Space Center. M&FM algorithms must perform all nominal mission commanding via the flight computer to control LV states from pre-launch through disposal and also address failure conditions by initiating autonomous or commanded aborts (crew capsule escape from the failing LV), redundancy management of failing subsystems and components, and safing actions to reduce or prevent threats to ground systems and crew. To address the criticality of the verification testing of these algorithms, the NASA M&FM team has utilized the State Flow environment6 (SFE) with its existing Vehicle Management End-to-End Testbed (VMET) platform which also hosts vendor-supplied physics-based LV subsystem models. The human-derived M&FM algorithms are designed and vetted in Integrated Development Teams composed of design and development disciplines such as Systems Engineering, Flight Software (FSW), Safety and Mission Assurance (S&MA) and major subsystems and vehicle elements such as Main Propulsion Systems (MPS), boosters, avionics, Guidance, Navigation, and Control (GN&C), Thrust Vector Control (TVC), liquid engines, and the astronaut crew office. Since the algorithms are realized using model-based engineering (MBE) methods from a hybrid of the Unified Modeling Language (UML) and Systems Modeling Language (SysML), SFE methods are a natural fit to provide an in depth analysis of the interactive behavior of these algorithms with the SLS LV subsystem models. For this, the M&FM algorithms and the SLS LV subsystem models are modeled using constructs provided by Matlab which also enables modeling of the accompanying interfaces providing greater flexibility for integrated testing and analysis, which helps forecast expected behavior in forward VMET integrated testing activities. In VMET, the M&FM algorithms are prototyped and implemented using the same C++ programming language and similar state machine architectural concepts used by the FSW group. Due to the interactive complexity of the algorithms, VMET testing thus far has verified all the individual M&FM subsystem algorithms with select subsystem vendor models but is steadily progressing to assessing the interactive behavior of these algorithms with LV subsystems, as represented by subsystem models. The novel SFE applications has proven to be useful for quick look analysis into early integrated system behavior and assessment of the M&FM algorithms with the modeled LV subsystems. This early MBE analysis generates vital insight into the integrated system behaviors, algorithm sensitivities, design issues, and has aided in the debugging of the M&FM algorithms well before full testing can begin in more expensive, higher fidelity but more arduous environments such as VMET, FSW testing, and the Systems Integration Lab7 (SIL). SFE has exhibited both expected and unexpected behaviors in nominal and off nominal test cases prior to full VMET testing. In many findings, these behavioral characteristics were used to correct the M&FM algorithms, enable better test coverage, and develop more effective test cases for each of the LV subsystems. This has improved the fidelity of testing and planning for the next generation of M&FM algorithms as the SLS program evolves from non-crewed to crewed flight, impacting subsystem configurations and the M&FM algorithms that control them. SFE analysis has improved robustness and reliability of the M&FM algorithms by revealing implementation errors and documentation inconsistencies. It is also improving planning efficiency for future VMET testing of the M&FM algorithms hosted in the LV flight computers, further reducing risk for the SLS launch infrastructure, the SLS LV, and most importantly the crew.

Trevino, Luis↗

Assimilation of MODIS Dark Target and Deep Blue Observations in the Dust Aerosol Component of NMMB-MONARCH version 1.0

A data assimilation capability has been built for the NMMB-MONARCH chemical weather prediction system, with a focus on mineral dust, a prominent type of aerosol. An ensemble-based Kalman filter technique (namely the local ensemble transform Kalman filter - LETKF) has been utilized to optimally combine model background and satellite retrievals. Our implementation of the ensemble is based on known uncertainties in the physical parametrizations of the dust emission scheme. Experiments showed that MODIS AOD retrievals using the Dark Target algorithm can help NMMB-MONARCH to better characterize atmospheric dust. This is particularly true for the analysis of the dust outflow in the Sahel region and over the African Atlantic coast. The assimilation of MODIS AOD retrievals based on the Deep Blue algorithm has a further positive impact in the analysis downwind from the strongest dust sources of the Sahara and in the Arabian Peninsula. An analysis-initialized forecast performs better (lower forecast error and higher correlation with observations) than a standard forecast, with the exception of underestimating dust in the long-range Atlantic transport and degradation of the temporal evolution of dust in some regions after day 1. Particularly relevant is the improved forecast over the Sahara throughout the forecast range thanks to the assimilation of Deep Blue retrievals over areas not easily covered by other observational datasets.The present study on mineral dust is a first step towards data assimilation with a complete aerosol prediction system that includes multiple aerosol species.

atmospheric dust↗

Onboard Navigation Error Analysis for Aerocapture at Uranus

Capturing into an orbit around Uranus using aerocapture allows one to design a mission with faster interplanetary trajectories and less propellant requirements. Such an aerocapture mission would rely on the onboard Guidance, Navigation, and Control (GNC) subsystems to successfully capture into an orbit around Uranus. Uncertainty in the state information and the noise in the sensor measurements induce navigation errors in the guidance and control subsystems, which can affect the overall performance of the aerocapture mission at Uranus. Understanding the effect of these navigation errors on mission performance is essential. To this end, this work considers different sensors with varying quality to understand their impact on the overall mission performance. In addition, this paper studies the impact of the uncertainty in the initial states used to initialize the onboard navigation filter and understands their effect on mission performance. This paper also shows the onboard navigation errors obtained from the Linear Covariance (LinCov) analysis and uses them for verification and validation (V&V) of the results from Program to Optimize and Simulate Trajectories-II (POST2).

Pardha Sai Chadalavada↗

Onboard Navigation Error Analysis for Aerocapture at Uranus

Capturing into an orbit around Uranus using aerocapture allows one to design a mission with faster interplanetary trajectories and less propellant requirements. Such an aerocapture mission would rely on the onboard Guidance, Navigation, and Control (GNC) subsystems to successfully capture into an orbit around Uranus. Uncertainty in the state information and the noise in the sensor measurements induce navigation errors in the guidance and control subsystems, which can affect the overall performance of the aerocapture mission at Uranus. Understanding the effect of these navigation errors on mission performance is essential. To this end, this work considers different sensors with varying quality to understand their impact on the overall mission performance. In addition, this paper studies the impact of the uncertainty in the initial states used to initialize the onboard navigation filter and understands their effect on mission performance. This paper also shows the onboard navigation errors obtained from the Linear Covariance (LinCov) analysis and uses them for verification and validation (V\&V) of the results from Program to Optimize and Simulate Trajectories-II (POST2).

Aerocapture↗

Man-Machine Integration Design and Analysis System (MIDAS) v5: Augmentations, Motivations, and Directions for Aeronautics Applications

As automation and advanced technologies are introduced into transport systems ranging from the Next Generation Air Transportation System termed NextGen, to the advanced surface transportation systems as exemplified by the Intelligent Transportations Systems, to future systems designed for space exploration, there is an increased need to validly predict how the future systems will be vulnerable to error given the demands imposed by the assistive technologies. One formalized approach to study the impact of assistive technologies on the human operator in a safe and non-obtrusive manner is through the use of human performance models (HPMs). HPMs play an integral role when complex human-system designs are proposed, developed, and tested. One HPM tool termed the Man-machine Integration Design and Analysis System (MIDAS) is a NASA Ames Research Center HPM software tool that has been applied to predict human-system performance in various domains since 1986. MIDAS is a dynamic, integrated HPM and simulation environment that facilitates the design, visualization, and computational evaluation of complex man-machine system concepts in simulated operational environments. The paper will discuss a range of aviation specific applications including an approach used to model human error for NASA s Aviation Safety Program, and what-if analyses to evaluate flight deck technologies for NextGen operations. This chapter will culminate by raising two challenges for the field of predictive HPMs for complex human-system designs that evaluate assistive technologies: that of (1) model transparency and (2) model validation.

Gore, Brian F.↗

Subjective evaluation of the combined influence of satellite temperature sounding data and increased model resolution on numerical weather forecasting

The present evaluation is concerned with (1) the significance of prognostic differences resulting from the inclusion of satellite-derived temperature soundings, (2) how specific differences between the SAT and NOSAT prognoses evolve, and (3) comparison of two experiments using the Goddard Laboratory for Atmospheric Sciences general circulation model. The subjective evaluation indicates that the beneficial impact of sounding data is enhanced with increased resolution. It is suggested that satellite sounding data posses valuable information content which at times can correct gross analysis errors in data sparse regions.

Atlas, R.↗

An Overview of Atmospheric Composition OSSE Activities at NASA's Global Modeling and Assimilation Office

A model-based Observing System Simulation Experiment (OSSE) is a framework for numerical experimentation in which observables are simulated from fields generated by an earth system model, including a parameterized description of observational error characteristics. Simulated observations can be used for sampling studies, quantifying errors in analysis or retrieval algorithms, and ultimately being a planning tool for designing new observing missions. While this framework has traditionally been used to assess the impact of observations on numerical weather prediction, it has a much broader applicability, in particular to aerosols and chemical constituents. In this talk we will give a general overview of Observing System Simulation Experiments (OSSE) activities at NASA's Global Modeling and Assimilation Office, with focus on its emerging atmospheric composition component.

daSilva, Arlinda↗

System design impact of guidance and navigation analysis for a SEPS 1979 Encke flyby

Baseline guidance and navigation strategy for an ecliptic projection of the Encke flyby mission consider solar electric propulsion stage parameters in generating optimized and targeted trajectory control. Results show the Encke relative approach error to be dominated by ephemerical uncertainties, particularly the velocity components.

Hong, P.↗