Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “robust estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
NASA NTRS1991

Technical notes and correspondence: Stochastic robustness of linear time-invariant control systems

A simple numerical procedure for estimating the stochastic robustness of a linear time-invariant system is described. Monte Carlo evaluations of the system's eigenvalues allows the probability of instability and the related stochastic root locus to be estimated. This analysis approach treats not only Gaussian parameter uncertainties but non-Gaussian cases, including uncertain-but-bounded variation. Confidence intervals for the scalar probability of instability address computational issues inherent in Monte Carlo simulation. Trivial extensions of the procedure admit consideration of alternate discriminants; thus, the probabilities that stipulated degrees of instability will be exceeded or that closed-loop roots will leave desirable regions can also be estimated. Results are particularly amenable to graphical presentation.

Stengel, Robert F.↗
NASA NTRSDate not supplied

Quantifying radiation quality for space relevant radiation types: Fitting excess risk models to three combined HZE-irradiated mouse datasets

Radiation health risks are predominantly derived from low linear energy transfer (LET) terrestrial exposures; however, space radiation includes exposure to high-LET and high-charge, high-energy (HZE) particles. Accurately quantifying the differences in radiation quality between the space and terrestrial radiation environments is important for assessing and predicting health risks for astronauts. Weil et al. 2009 and 2014 used two different inbred mouse strains to study differences in hepatocellular carcinoma (HCC) tumorigenesis after exposures to low- and high- LET radiation. More recently, Edmundson et al. 2020 provided valuable new tumor data in outbred mice that were exposed to low- and high-LET radiation. The present study aims to rigorously investigate a relative biological effectiveness (RBE) factor by leveraging the HCC tumor data from Weil et al. 2009, Weil et al. 2014, and Edmundson et al. 2020. The three experiments were similarly designed, allowing the raw data to be combined into a pooled dataset to estimate excess relative risk (ERR) and excess absolute risk (EAR) models using Bayesian Poisson regression. These effect estimates from the pooled data provide greater power to calculate a data driven RBE. Extensive sensitivity analyses test the robustness of RBE estimates to various model assumptions. The following questions will be explored through the sensitivity analyses: • Is the shape of the dose response different for low-LET radiation and HZE radiation, indicating that RBE is a function of dose? • Does attained age modify the effect estimates differently for low-LET radiation and HZE radiation, indicating RBE is a function of attained age? • Are the effect estimates and RBE estimates different for inbred mouse strains and outbred mouse strains? • Do assumptions about differences in ERR models and EAR models change the estimated RBE? Additional studies would be needed to validate the findings from these exploratory analyses.

Lori J. Chappell↗
NASA NTRS1996

Design of Robust Adaptive Unbalance Response Controllers for Rotors with Magnetic Bearings

Experimental results have recently demonstrated that an adaptive open loop control strategy can be highly effective in the suppression of unbalance induced vibration on rotors supported in active magnetic bearings. This algorithm, however, relies upon a predetermined gain matrix. Typically, this matrix is determined by an optimal control formulation resulting in the choice of the pseudo-inverse of the nominal influence coefficient matrix as the gain matrix. This solution may result in problems with stability and performance robustness since the estimated influence coefficient matrix is not equal to the actual influence coefficient matrix. Recently, analysis tools have been developed to examine the robustness of this control algorithm with respect to structured uncertainty. Herein, these tools are extended to produce a design procedure for determining the adaptive law's gain matrix. The resulting control algorithm has a guaranteed convergence rate and steady state performance in spite of the uncertainty in the rotor system. Several examples are presented which demonstrate the effectiveness of this approach and its advantages over the standard optimal control formulation.

Knospe, Carl R.↗
NASA NTRS1988

Simulated performance of an order statistic threshold strategy for detection of narrowband signals

The application of order statistics to signal detection is becoming an increasingly active area of research. This is due to the inherent robustness of rank estimators in the presence of large outliers that would significantly degrade more conventional mean-level-based detection systems. A detection strategy is presented in which the threshold estimate is obtained using order statistics. The performance of this algorithm in the presence of simulated interference and broadband noise is evaluated. In this way, the robustness of the proposed strategy in the presence of the interference can be fully assessed as a function of the interference, noise, and detector parameters.

Satorius, E.↗
NASA NTRS1993

A Monte Carlo approach to the analysis of control system robustness

Stochastic robustness, a simple technique used to estimate the stability and performance robustness of linear, time-invariant systems, is described. The scalar probability of instability is introduced as a measure of stability robustness. Examples are given of stochastic performance robustness measures based on classical time-domain specifications. The relationship between stochastic robustness measures and control system design parameters is discussed. The technique is demonstrated by analyzing an LQG/LTR system designed for a flexible robot arm. It is concluded that the analysis of stochastic robustness offers a good alternative to existing robustness metrics.

Ray, Laura R.↗
NASA NTRSDate not supplied

Multi-Model Monte Carlo Estimators for Trajectory Simulation

Predicting landing radius and other quantities of interest (QoI) for entry, descent, andlanding (EDL) applications requires a viable uncertainty propagation method for quantifying the impact of uncertainties in aerodynamics, atmosphere, mass properties, etc. While standard Monte Carlo (MC) simulation is the de facto standard for producing robust and unbiasedstatistical estimators, it is often infeasible for expensive, high-fidelity models. Low-fidelity models are commonly constructed to replace the high-fidelity model in MC simulation for computational speedup, but at the expense of accuracy and unbiasedness. Emerging multi-model MC methods are bridging this gap by combining predictions from two or more modelsof varying fidelity and computational cost for efficient and unbiased uncertainty propagation.This works establishes a proof of concept for using multi-model MC to increase the speed and precision of trajectory simulation for EDL. It is shown that combining a high-fidelity EDL model with low-fidelity models (e.g., data-driven, reduced physics) in this manner has the potential to yield significant efficiency and accuracy gains for certain EDL QoIs versusa standard MC approach. Moreover, the unbiasedness of multi-model MC predictions ishighlighted by showing increased accuracy versus an approach that leverages a low-fidelity model alone.

James E Warner↗
NASA NTRSDate not supplied

ILRS Analysis Activities After the Adoption of ITRF2020

"The contribution of the International Laser Ranging Service (ILRS) to the most recent realization of the International Terrestrial Reference System (ITRS) was the result of an analysis strategy with two major modifications compared to the operational products: a modeling for stations long-term systematic errors (biases reported in the ILRS Data Handling File) and an updated model of the target signature error (satellite Centre of Mass model). Both refined models were used as input information for the ILRS contribution to the ITRF2020 (International Terrestrial Reference Frame 2020). Thereafter, the ILRS Analysis Standing Committee (ASC) focused its effort on implementing the new reference frame in its operational products, define a strategy to improve the ongoing monitoring of the systematic errors, compute the ILRS contribution to the planned ITRF2020 update, and to include LARES-2 among the considered satellites for the operational products. The ILRS ASC implemented the ITRF2020/SLRF2020 into all its official operational products (TRF, Earth Orientation Parameters, predicted and combined satellite orbits) and its impact was evaluated. The operational products benefit from the continuous monitoring of the station systematic errors and the frequent updates of the Data Handling File whenever a significant change in the station systematic error is observed. In the future, a change-point detection algorithm, jointly estimating the times and the number of discontinuities, will be implemented to detect potential new discontinuities in the range bias series. The inclusion of LARES-2 among the satellites whose data are operationally analyzed will furtherly increase the robustness of the estimated parameters. Finally, the ILRS ASC activities include the benchmarking of a new analysis center (CNES) which will formally begin its own contribution in 2024."

Satellite Laser Ranging↗
NASA NTRS2022

Bayesian Rules of Thumb: Robust Uncertainty Quantification in Early Project Cost Estimation

Systems engineers often make use of cost Rules ofThumb in order to estimate cost during early phases of projectformulation. These Rules of Thumb typically take the form ofa sequence of percentages over which a total cost is allocatedacross NASA WBS elements. Rules of Thumb can then be usedto extrapolate cost from one or more known WBS elements tothe remaining unknown WBS elements, assisting early projectformulation architecture studies (such as those in JPL’s Team Xand A Team).A number of issues can arise when generating and using costRules of Thumb. For example, many records of project costsconsist of incomplete data. Typical methods of dealing withincomplete cost allocation data include (a) ignoring missionswith incomplete data, or (b) taking averages of the non-zero percentagesacross missions, but both of these methods can result inbiased estimates if the existence of incomplete data correlateswith total mission cost or any particular WBS element. Anothercommon example is cost reported in one or more incorrect WBSelements. This is especially prevalent in smaller missions whereit is more common for engineers to perform tasks that fall underthe purview of multiple WBS elements.Furthermore, a Rule of Thumb estimate is typically reported asa point estimate; there is no reported uncertainty around thepercentages used to generate an allocation. Even in the rarecase in which confidence intervals around mean percentages areprovided, there may be positive or negative correlations betweenWBS elements which can skew estimates.Here we attempt to address these problems by formulatingprobabilistic Rules of Thumb in which a distribution of allocationschemes, rather than a single allocation scheme, is generated.We use a bootstrap imputation method to simultaneouslyaccount for uncertainty in the missing data while using allavailable information contained in the dataset. The imputeddatasets are then input into a multivariate Bayesian modelwhich accounts for correlations between WBS elements andproperly accounts for uncertainty in the final Rule of Thumbpercentages and predictions. We describe the mathematicalmodel and provides snippets of R code utilizing the brms(Bayesian Regression Models using Stan) package. To illustratethis model, we generate a Bayesian Level 2 WBS Cost Rule ofThumb for MIDEX (Medium-Class Explorers) missions withdata extracted from NASA’s CADRe. We then compare thismethod’s performance with the classical Rule of Thumb method.

Hooke, Melissa A↗
NASA NTRS2012

Evaluation of the Absolute Regional Temperature Potential

The Absolute Regional Temperature Potential (ARTP) is one of the few climate metrics that provides estimates of impacts at a sub-global scale. The ARTP presented here gives the time-dependent temperature response in four latitude bands (90-28degS, 28degS-28degN, 28-60degN and 60-90degN) as a function of emissions based on the forcing in those bands caused by the emissions. It is based on a large set of simulations performed with a single atmosphere-ocean climate model to derive regional forcing/response relationships. Here I evaluate the robustness of those relationships using the forcing/response portion of the ARTP to estimate regional temperature responses to the historic aerosol forcing in three independent climate models. These ARTP results are in good accord with the actual responses in those models. Nearly all ARTP estimates fall within +/-20%of the actual responses, though there are some exceptions for 90-28degS and the Arctic, and in the latter the ARTP may vary with forcing agent. However, for the tropics and the Northern Hemisphere mid-latitudes in particular, the +/-20% range appears to be roughly consistent with the 95% confidence interval. Land areas within these two bands respond 39-45% and 9-39% more than the latitude band as a whole. The ARTP, presented here in a slightly revised form, thus appears to provide a relatively robust estimate for the responses of large-scale latitude bands and land areas within those bands to inhomogeneous radiative forcing and thus potentially to emissions as well. Hence this metric could allow rapid evaluation of the effects of emissions policies at a finer scale than global metrics without requiring use of a full climate model.

Shindell, D. T.↗
NASA NTRS2012

Histogrammatic Method for Determining Relative Abundance of Input Gas Pulse

To satisfy the Major Constituents Analysis (MCA) requirements for the Vehicle Cabin Atmosphere Monitor (VCAM), this software analyzes the relative abundance ratios for N2, O2, Ar, and CO2 as a function of time and constructs their best-estimate mean. A histogram is first built of all abundance ratios for each of the species vs time. The abundance peaks corresponding to the intended measurement and any obfuscating background are then separated via standard peak-finding techniques in histogram space. A voting scheme is then used to include/exclude this particular time sample in the final average based on its membership to the intended measurement or the background population. This results in a robust and reasonable estimate of the abundance of trace components such as CO2 and Ar even in the presence of obfuscating backgrounds internal to the VCAM device. VCAM can provide a means for monitoring the air within the enclosed environments, such as the ISS (International Space Station), Crew Exploration Vehicle (CEV), a Lunar Habitat, or another vehicle traveling to Mars. Its miniature pre-concentrator, gas chromatograph (GC), and mass spectrometer can provide unbiased detection of a large number of organic species as well as MCA analysis. VCAM s software can identify the concentration of trace chemicals and whether the chemicals are on a targeted list of hazardous compounds. This innovation s performance and reliability on orbit, along with the ground team s assessment of its raw data and analysis results, will validate its technology for future use and development.

Mandrake, Lukas↗
NASA NTRS2015

Trend Estimates of AERONET-Observed and Model-Simulated AOTs Between 1993 and 2013

Recently, temporal changes in Aerosol Optical Thickness (AOT) have been investigated based on model simulations, satellite and ground-based observations. Most AOT trend studies used monthly or annual arithmetic means that discard details of the generally right-skewed AOT distributions. Potentially, such results can be biased by extreme values (including outliers). This study additionally uses percentiles (i.e., the lowest 5%, 25%, 50%, 75% and 95% of the monthly cumulative distributions fitted to Aerosol Robotic Network (AERONET)-observed and ECHAM/MESSy Atmospheric Chemistry (EMAC)-model simulated AOTs) that are less affected by outliers caused by measurement error, cloud contamination and occasional extreme aerosol events. Since the limited statistical representativeness of monthly percentiles and means can lead to bias, this study adopts the number of observations as a weighting factor, which improves the statistical robustness of trend estimates. By analyzing the aerosol composition of AERONET-observed and EMAC-simulated AOTs in selected regions of interest, we distinguish the dominant aerosol types and investigate the causes of regional AOT trends. The simulated and observed trends are generally consistent with a high correlation coefficient (R = 0.89) and small bias (slope+/-2(sigma) = 0.75 +/- 0.19). A significant decrease in EMAC-decomposed AOTs by water-soluble compounds and black carbon is found over the USA and the EU due to environmental regulation. In particular, a clear reversal in the AERONET AOT trend percentiles is found over the USA, probably related to the AOT diurnal cycle and the frequency of wildfires. In most of the selected regions of interest, EMAC-simulated trends are mainly attributed to the significant changes of the dominant aerosols; e.g., significant decrease in sea salt and water soluble compounds over Central America, increase in dust over Northern Africa and Middle East, and decrease in black carbon and organic carbon over Australia.

AERONET↗
NASA NTRS1990

Computer-aided-analysis of linear control system robustness

Stochastic robustness is a simple technique used to estimate the stability and performance robustness of linear, time-invariant systems. The use of high-speed graphics workstations and control system design software in stochastic robustness analysis is discussed and demonstrated. It is shown that stochastic robustness makes good use of modern computational and graphic tools, and it is easily implemented using commercial control system design and analysis software.

Stengel, Robert F.↗
NASA NTRS2007

[Space Weather Impact on the Electricity Market]

Forbes & St. Cyr (2004, hereafter "FISC") have provided evidence that the electricity market can be impacted by space weather. Our analysis indicated that the estimated market impact for PJM was 3.7 % or approximately $500 million dollars over the 19 month sample period. Kappenman has taken exception to this estimate and contends that we have exaggerated the magnitude of the problem that space weather poses to PJM. There are four specific issues: (1) he claims that we have ignored relevant literature; (2) he asserts that Dst is not an appropriate proxy for GICs in PJM; (3) he charges that our findings are inconsistent with the impact of the 17 September 2000 storm; and (4) he alleges that our discussion of October 2003 storms is misleading. In our article, we have explained our methodology, multivariate regression analysis, with a particular focus on how it compares to correlation analysis. We have also explained the limitations of our analysis. We noted that "...While the Dstlprice relationship was found to be robust, the precise estimate should be treated with a relatively high degree of caution given that econometric modeling is not an exact science as well as the fact that the measure of space weather may be a poor proxy for GICs" (paragraph 96). We have also noted that additional research using local magnetometer data are needed (paragraph 97). We did not claim that that our findings for PJM are representative of the impact of space weather on other power grids. On the contrary, we noted that ... "Only analysis of other power grids will tell. " (paragraph 97). Kappenman inaccurately asserts that we have indicated that our findings . . . "imply much higher total costs are likely across the US and elsewhere in the world." He also inaccurately asserts that we have claimed that " . . . Dst is the most suited proxy for GIC in the PJM grid.. ." Moreover, he inaccurately refers to our analysis as a correlation study that uses Dst as quasi-binary indicator.

SaintCyr, O. Chris↗
NASA NTRS2022

Present-Day and Future PM 2.5 and O 3 -Related Global and Regional Premature Mortality in the EVAv6.0 Health Impact Assessment Model

We used the EVAv6.0 system to estimate the present (2015) and future (2015–2050) global PM 2.5 and O 3 -related premature mortalities, using simulated surface concentrations from the GISS-E2.1-G Earth system model. The PM 2.5 -related global premature mortality is estimated to be 4.3 and 4.4 million by the non-linear and linear models, respectively. Ischemic heart diseases are found to be the leading cause of PM 2.5 -related premature deaths, contributing by 35% globally. Both long-term and short-term O 3 -related premature deaths are estimated to be around 1 million, globally. Overall, PM 2.5 and O 3 -related premature mortality leads to 5.3–5.4 million premature deaths, globally. The global burden of premature deaths is mainly driven by the Asian region, which in 2015 contributes by 75% of the total global premature deaths. An increase from 6.2% to 8% in the PM 2.5 relative risk as recommended by the WHO leads to an increase of PM 2.5 -related premature mortality by 28%, to 5.7 million. Finally, bias correcting the simulated PM 2.5 concentrations in 2015 leads to an increase of up to 73% in the global PM 2.5 -related premature mortality, leading to a total number of global premature deaths of up to 7.7 million, implying the necessity of bias correction to get more robust health burden estimates. PM 2.5 and O 3 -related premature mortality in 2050 decreases by up to 57% and 18%, respectively, due to emission reductions alone. However, the projected increase and aging of the population leads to increases of premature mortality by up to a factor of 2, showing that the population exposed to air pollution is more important than the level of air pollutants, highlighting that the population dynamics should be considered when setting up health assessment systems.

Premature mortality↗
NASA NTRS2004

Neural network uncertainty assessment using Bayesian statistics: a remote sensing application

Neural network (NN) techniques have proved successful for many regression problems, in particular for remote sensing; however, uncertainty estimates are rarely provided. In this article, a Bayesian technique to evaluate uncertainties of the NN parameters (i.e., synaptic weights) is first presented. In contrast to more traditional approaches based on point estimation of the NN weights, we assess uncertainties on such estimates to monitor the robustness of the NN model. These theoretical developments are illustrated by applying them to the problem of retrieving surface skin temperature, microwave surface emissivities, and integrated water vapor content from a combined analysis of satellite microwave and infrared observations over land. The weight uncertainty estimates are then used to compute analytically the uncertainties in the network outputs (i.e., error bars and correlation structure of these errors). Such quantities are very important for evaluating any application of an NN model. The uncertainties on the NN Jacobians are then considered in the third part of this article. Used for regression fitting, NN models can be used effectively to represent highly nonlinear, multivariate functions. In this situation, most emphasis is put on estimating the output errors, but almost no attention has been given to errors associated with the internal structure of the regression model. The complex structure of dependency inside the NN is the essence of the model, and assessing its quality, coherency, and physical character makes all the difference between a blackbox model with small output errors and a reliable, robust, and physically coherent model. Such dependency structures are described to the first order by the NN Jacobians: they indicate the sensitivity of one output with respect to the inputs of the model for given input data. We use a Monte Carlo integration procedure to estimate the robustness of the NN Jacobians. A regularization strategy based on principal component analysis is proposed to suppress the multicollinearities in order to make these Jacobians robust and physically meaningful.

Neural Networks (Computer)↗
NASA NTRSDate not supplied

Understanding Relationships Between Satellite, Model, and Ground-Based Surface Temperature Characterizations From Overcast to Clear Conditions in Support of Satellite Remote Sensing of Clouds and Radiation

Accurate and consistent global estimates of cloud coverage and their properties are fundamental to long-term Earth radiation budget (ERB) monitoring efforts like the Clouds and the Earth’s Radiant Energy System (CERES) project. Cloud detection algorithms often apply thresholding approaches to identify where clouds occur by comparing satellite-measured radiances with those that are expected under cloud-free conditions. In addition, once a cloud is detected, the derivation of cloud optical and microphysical properties also requires knowledge of the background radiances below the cloud. In the infrared, knowledge of the surface emissivity and the expected skin temperature under both cloudy and cloud-free conditions is needed. These traits are generally well known over the oceans. Over land, however, comparisons between satellite-derived land surface temperature (LST) with that characterized in numerical weather analyses reveal large differences in many parts of the world, often exceeding 5 K, which can lead to significant satellite cloud detection and cloud property retrieval errors. Furthermore, clouds have a dramatic influence on the LST, and therefore characterization of that model parameter also depends on the capability of the model to accurately resolve clouds. Thus, the LST characterized in models is, at times, a poor approximation for what would otherwise be observed, thereby impeding accurate satellite cloud retrievals. As a result, we seek to develop a more robust method for estimating the LST required for satellite cloud characterizations. This effort is accomplished through a combination of surface emission/air temperature relationship studies in all-sky conditions using ground measurement stations, along with deep neural network (DNN) estimates of expected LST under overcast and cloud-free conditions. We demonstrate that substituting DNN-predicted LST for that generated by numerical models can mitigate model-inherent diurnal dependencies and reduce overall bias and uncertainty relative to satellite/ground observations by 0.5–4 K and 0.5–2 K, respectively. It is expected that this work will lead to improved satellite cloud retrievals that enhance ERB monitoring efforts.

B Scarino↗
NASA NTRS1987

Characterization of fault recovery through fault injection on FTMP

The development of fault-injection procedures and statistical analysis techniques to characterize the fault recovery of fault-tolerant systems is described. Pin-level fault-injection was conducted on a fault-tolerant microprocessor computer in order to generate data to assess the utility of current fault-injection sampling methods. The validity of common reliability-modeling assumptions concerning the statistical distribution of recovery times is investigated. A multiple comparison analysis for detecting behavior variations, and a distribution fitting for determining the best fit for the data were conducted. It is observed that the detection behavior is not homogeneous across all data sets, and that none of the factors under experimental control can account for the observed groupings of behavior. It is determined that no single distribution fits all the data sets, and that stratified random sampling and statistically robust parameter-estimation techniques are required to characterize fault detection time.

Finelli, George B.↗
NASA NTRS1990

Investigation of air transportation technology at Princeton University, 1988-1989

The Air Transportation Technology Program at Princeton University, a program emphasizing graduate and undergraduate student research, proceeded along several avenues during the past year. A study of optimal trajectories for penetration of microbursts when encounter is unavoidable was conducted. The emphasis of current wind shear research is on developing an expert system for wind shear avoidance. A knowledge-based reconfigurable flight control system that is implemented with the Pascal programming language using parallel microprocessors was developed. This expert system could be considered a prototype for a failure-tolerant control system that can be constructed using existing hardware. Development of a real-time cockpit simulator continued during the year. The simulator provides a single-person crew station with both conventional and advanced control devices; it currently is programmed to simulate the Navion single-engine general aviation airplane. Alternatives for the air traffic control system giving particular attention to the institutional structure of the FAA are analyzed. A simple numerical procedure for estimating the stochastic robustness of control systems is being investigated. The revitalization of the general aviation industry is also discussed.

Stengel, Robert F.↗