SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Errors and previously implicit assumptions treated explicitly. Paper discusses errors in mathematical models of physical systems and problem of identifying model from system input and output. Problem approached by explicitly taking account of erroneous choices of model structure. Paper concerned specifically with linear or weakly nonlinear models.
An integrated approach to rotorcraft system identification is described. This approach consists of sequential application of (1) data filtering to estimate states of the system and sensor errors, (2) model structure estimation to isolate significant model effects, and (3) parameter identification to quantify the coefficient of the model. An input design algorithm is described which can be used to design control inputs which maximize parameter estimation accuracy. Details of each aspect of the rotorcraft identification approach are given. Examples of both simulated and actual flight data processing are given to illustrate each phase of processing. The procedure is shown to provide means of calibrating sensor errors in flight data, quantifying high order state variable models from the flight data, and consequently computing related stability and control design models.
Increasing adoption of the proposed tristructural isotropic (TRISO) particle fuel for both advanced and existing reactors makes it critical to assess and address any uncertainties and inadequacies of TRISO fission product release models. Model inadequacy stems from simplifications made to the computational model when compared to the experiments. The modeling and simulation efforts conducted using the BISON fuel performance code, along with the experimental campaigns carried out under the Advanced Gas Reactor Fuel Development and Qualification Program, afford a unique opportunity to conduct a rigorous modeling inadequacy assessment within the Bayesian uncertainty quantification (UQ) framework. Here, this study compares the standard Bayesian framework against the Kennedy-O'Hagan (KOH) framework, which explicitly represents modeling inadequacy, in regard to UQ for TRISO silver release models. For this purpose, both the traditional Arrhenius equation fitted to experimental data and the more advanced lower-length-scale (LLS)-informed model, which considers microstructure information, are independently considered. Applying the inverse UQ process on the AGR-2 and -3/4 datasets revealed modeling inadequacy to be the most dominant source of uncertainty. Experimental noise uncertainty is also significant; however, model parameter uncertainty can be considered negligible. Interestingly, both the Arrhenius equation and the LLS-informed model demonstrated similar levels of modeling inadequacy. For the forward predictive UQ, the KOH framework improved both the accuracy and quality of quantified uncertainties in comparison to the standard Bayesian framework. This is true for both the Arrhenius equation and the LLS-informed model. In comparing these modeling approaches, both demonstrated similar performance at the engineering scale, while the LLS-informed model expectedly outperformed the Arrhenius equation at the mesoscale. These conclusions highlight the importance of explicitly accounting for modeling inadequacy in the UQ process, and reinforce the need for continuous refinement of physics-based models in order to address the modeling inadequacy.
Soil moisture is an essential climate variable influencing land atmosphere interactions, an essential hydrologic variable impacting rainfall runoff processes, an essential ecological variable regulating net ecosystem exchange, and an essential agricultural variable constraining food security. Large-scale soil moisture monitoring has advanced in recent years creating opportunities to transform scientific understanding of soil moisture and related processes. These advances are being driven by researchers from a broad range of disciplines, but this complicates collaboration and communication. For some applications, the science required to utilize large-scale soil moisture data is poorly developed. In this review, we describe the state of the art in large-scale soil moisture monitoring and identify some critical needs for research to optimize the use of increasingly available soil moisture data. We review representative examples of 1) emerging in situ and proximal sensing techniques, 2) dedicated soil moisture remote sensing missions, 3) soil moisture monitoring networks, and 4) applications of large-scale soil moisture measurements. Significant near-term progress seems possible in the use of large-scale soil moisture data for drought monitoring. Assimilation of soil moisture data for meteorological or hydrologic forecasting also shows promise, but significant challenges related to model structures and model errors remain. Little progress has been made yet in the use of large-scale soil moisture observations within the context of ecological or agricultural modeling. Opportunities abound to advance the science and practice of large-scale soil moisture monitoring for the sake of improved Earth system monitoring, modeling, and forecasting.
Observations from recent soil moisture missions (e.g. SMOS) have been used in innovative data assimilation studies to provide global high spatial (i.e. 40 km) and temporal resolution (i.e. 3-days) soil moisture profile estimates from microwave brightness temperature observations. In contrast with microwave-based satellite missions that are only sensitive to near-surface soil moisture (0 - 5 cm), the Gravity Recovery and Climate Experiment (GRACE) mission provides accurate measurements of the entire vertically integrated terrestrial water storage column but, it is characterized by low spatial (i.e. 150,000 km2) and temporal (i.e. monthly) resolutions. Data assimilation studies have shown that GRACE-TWS primarily affects (in absolute terms) deeper moisture storages (i.e., groundwater). This work hypothesizes that unprecedented soil water profile accuracy can be obtained through the joint assimilation of GRACE terrestrial water storage and SMOS brightness temperature observations. A particular challenge of the joint assimilation is the use of the two different types of measurements that are relevant for hydrologic processes representing different temporal and spatial scales. The performance of the joint assimilation strongly depends on the chosen assimilation methods, measurement and model error spatial structures. The optimization of the assimilation technique constitutes a fundamental step toward a multi-variate multi-resolution integrative assimilation system aiming to improve our understanding of the global terrestrial water cycle.
The increasing use of tristructural isotropic (TRISO) particle fuel in both advanced and existing reactors necessitates a thorough evaluation of uncertainties and shortcomings in TRISO fission product release models. These inadequacies arise from the simplifications made in computational models compared to experimental data. Utilizing the BISON fuel performance code and experimental data from the Advanced Gas Reactor (AGR) program provides a unique chance to rigorously assess these inadequacies within a Bayesian uncertainty quantification (UQ) framework. This study contrasts the standard Bayesian framework with the Kennedy-O'Hagan (KOH) framework, which explicitly accounts for modeling inadequacies, in the context of UQ for TRISO silver release models. It examines both the traditional Arrhenius equation and a more advanced lower-length-scale (LLS)-informed model that incorporates microstructure information. The inverse UQ process applied to AGR-2 and AGR-3/4 datasets identified modeling inadequacy as the primary source of uncertainty, with experimental noise also being significant, while model parameter uncertainty was minimal. Both the Arrhenius and LLS-informed models showed similar levels of modeling inadequacy. For forward predictive UQ using the AGR-1 dataset, the KOH framework enhanced the accuracy and quality of quantified uncertainties by approximately 30% and 40%, respectively, compared to the standard Bayesian framework. This improvement was observed for both the Arrhenius and LLS-informed models. At the engineering scale, both models performed similarly, but the LLS-informed model outperformed the Arrhenius equation at the mesoscale. These findings underscore the importance of explicitly considering modeling inadequacy in the UQ process and highlight the need for ongoing refinement of physics-based models to address these shortcomings.
The primary research goal of the forthcoming NASA Quesst mission community test campaign is to collect representative community response data in support of the development of supersonic overflight noise certification standards. Beginning in 2026, NASA will fly the novel X-59 demonstrator aircraft over select communities in United States in order to demonstrate the possibility of low-noise supersonic flight over land and to collect objective measurements and subjective data on the perceptual experience of this new noise source. It is believed that a regression of a binary perceptual response (‘highly annoyed’ or ‘not’) on estimated noise levels (doses, measured in decibels) will provide a useful dose-response relationship for regulators. However, as these estimated doses will be subject to measurement error, naïve estimators of regression coefficients are inconsistent and slopes may be subject to attenuation bias. In this presentation, I contrast functional modeling of measurement error via simulation extrapolation (SIMEX) with structural Bayesian measurement error models. These methods are applied to available data collected during two NASA risk reduction studies in California in 2011 and Texas in 2018. I’ll conclude noting that in the presence of nonnegligible measurement errors, probabilities of annoyance may be overpredicted for low noise levels and underpredicted for high noise levels, therefore, methods of correcting for measurement error will be necessary to improve the utility of the dose-response relationship for policy-making purposes.
This document is motivated by likely needs of the Quesst mission community response tests, which will culminate in data collection and estimation of dose-response regression relationships for consideration by domestic and international aviation regulators. Furthermore, basic research questions evaluating interactions between rates of community annoyance, dose levels, and indicators of the presence of rattle, vibration, and startle hinge on hypothesis testing in the context of regression models. For a variety of reasons, noise doses may be known only imprecisely and may not reflect the actual level experienced by responding subjects. These differences between true dose and estimated dose, be they systematic or random, constitute covariate measurement error. Available statistics literature speaks to the impacts of measurement error on regression models, both in terms of bias in estimated coefficients and predicted values, and in terms of the loss of statistical power for hypothesis testing. Given the particulars of a categorical annoyance response variable and a continuous noise dose predictor variable subject to measurement error during testing, the emphasis of this report is on findings and methods pertinent to generalized linear (and mixed) models likely to be employed during the Quesst mission community tests. We reach the following conclusions: 1. Of four reviewed methods, structural Bayesian measurement error models and simulation extrapolation (SIMEX) may be the most readily applicable to Quesst mission community noise study objectives. 2. If warranted, a linear measurement model can help model systematic sources of measurement error that the classical measurement error does not. 3. For its ready implementation and small additional input requirements, simulation extrapolation may be ideally suited for addressing secondary research questions involving interactions between annoyance, noise dose, and other factors through hypothesis testing. 4. For their flexibility and ability to propagate uncertainty, structural Bayesian hierarchical models have great appeal for mission purposes; some care may be needed in developing appropriate probability models describing actual noise exposure during testing. An annotated bibliography logs additional papers and resources that may be of value to analysts in other projects and disciplines.
The contribution of rainfall forcing errors relative to model (structural and parameter) uncertainty in the prediction of soil moisture is investigated by integrating the NASA Catchment Land Surface Model (CLSM), forced with hydro-meteorological data, in the Oklahoma region. Rainfall-forcing uncertainty is introduced using a stochastic error model that generates ensemble rainfall fields from satellite rainfall products. The ensemble satellite rain fields are propagated through CLSM to produce soil moisture ensembles. Errors in CLSM are modeled with two different approaches: either by perturbing model parameters (representing model parameter uncertainty) or by adding randomly generated noise (representing model structure and parameter uncertainty) to the model prognostic variables. Our findings highlight that the method currently used in the NASA GEOS-5 Land Data Assimilation System to perturb CLSM variables poorly describes the uncertainty in the predicted soil moisture, even when combined with rainfall model perturbations. On the other hand, by adding model parameter perturbations to rainfall forcing perturbations, a better characterization of uncertainty in soil moisture simulations is observed. Specifically, an analysis of the rank histograms shows that the most consistent ensemble of soil moisture is obtained by combining rainfall and model parameter perturbations. When rainfall forcing and model prognostic perturbations are added, the rank histogram shows a U-shape at the domain average scale, which corresponds to a lack of variability in the forecast ensemble. The more accurate estimation of the soil moisture prediction uncertainty obtained by combining rainfall and parameter perturbations is encouraging for the application of this approach in ensemble data assimilation systems.
It is pointed out that large space antennae and other large space structures will play an important role in the coming decades as commercial applications of space become feasible. A investigation is conducted of the structural dynamics and the control properties for a 64-meter diameter center fed antenna. Attention is given to antenna configuration and structural dynamic porperties, the attitude and structural control system, disturbance assessment, hardware sizing, the construction of weighting matrices, and numerical results. It is found that structural uncertainties and model error can cause serious performance deterioration and can even destabilize the controllers. Flight test and in-orbit system identification of critical structural modes will insure performance and reduce risk for large space antenna missions.
A common set of statistical metrics has been used to summarize the performance of models or measurements- the most widely used ones being bias, mean square error, and linear correlation coefficient. They assume linear, additive, Gaussian errors, and they are interdependent, incomplete, and incapable of directly quantifying uncertainty. The authors demonstrate that these metrics can be directly derived from the parameters of the simple linear error model. Since a correct error model captures the full error information, it is argued that the specification of a parametric error model should be an alternative to the metrics-based approach. The error-modeling methodology is applicable to both linear and nonlinear errors, while the metrics are only meaningful for linear errors. In addition, the error model expresses the error structure more naturally, and directly quantifies uncertainty. This argument is further explained by highlighting the intrinsic connections between the performance metrics, the error model, and the joint distribution between the data and the reference.
Crop models are important tools for impact assessment of climate change, as well as for exploring management options under current climate. It is essential to evaluate the uncertainty associated with predictions of these models. We compare two criteria of prediction error; MSEP fixed, which evaluates mean squared error of prediction for a model with fixed structure, parameters and inputs, and MSEP uncertain( X), which evaluates mean squared error averaged over the distributions of model structure, inputs and parameters. Comparison of model outputs with data can be used to estimate the former. The latter has a squared bias term, which can be estimated using hindcasts, and a model variance term, which can be estimated from a simulation experiment. The separate contributions to MSEP uncertain (X) can be estimated using a random effects ANOVA. It is argued that MSEP uncertain (X) is the more informative uncertainty criterion, because it is specific to each prediction situation.
Neural network (NN) techniques have proved successful for many regression problems, in particular for remote sensing; however, uncertainty estimates are rarely provided. In this article, a Bayesian technique to evaluate uncertainties of the NN parameters (i.e., synaptic weights) is first presented. In contrast to more traditional approaches based on point estimation of the NN weights, we assess uncertainties on such estimates to monitor the robustness of the NN model. These theoretical developments are illustrated by applying them to the problem of retrieving surface skin temperature, microwave surface emissivities, and integrated water vapor content from a combined analysis of satellite microwave and infrared observations over land. The weight uncertainty estimates are then used to compute analytically the uncertainties in the network outputs (i.e., error bars and correlation structure of these errors). Such quantities are very important for evaluating any application of an NN model. The uncertainties on the NN Jacobians are then considered in the third part of this article. Used for regression fitting, NN models can be used effectively to represent highly nonlinear, multivariate functions. In this situation, most emphasis is put on estimating the output errors, but almost no attention has been given to errors associated with the internal structure of the regression model. The complex structure of dependency inside the NN is the essence of the model, and assessing its quality, coherency, and physical character makes all the difference between a blackbox model with small output errors and a reliable, robust, and physically coherent model. Such dependency structures are described to the first order by the NN Jacobians: they indicate the sensitivity of one output with respect to the inputs of the model for given input data. We use a Monte Carlo integration procedure to estimate the robustness of the NN Jacobians. A regularization strategy based on principal component analysis is proposed to suppress the multicollinearities in order to make these Jacobians robust and physically meaningful.
Continuum modeling of large space structures is extended to the problem of detecting construction errors in large space structures such as the proposed space station. First-order dynamic sensitivity equations for structures involving eigenfrequencies, modal masses, modal stiffnesses, and modal damping are presented. Matrix equations relating changes in element parameters to dynamic sensitivities are summarized. The sensitivity equations for the entire dynamical system are rearranged as a system of algebraic equations with unknowns of stiffness losses at selected locations. The feasibility of the formulation is numerically demonstrated on a simply-supported Euler-Bernouilli beam with simulated construction defects. The method is next extended to large space structures modelled as equivalent continua with simulated construction defects.
Inconsistencies in the calculation of the two anthropogenic land flux terms of the global carbon cycle are investigated. The two terms—the direct anthropogenic flux (caused by direct human disturbance in anthromes, currently a carbon source to the atmosphere) and the indirect anthropogenic flux (caused indirectly by human activities that lead to global change and affecting all biomes, currently an atmospheric carbon sink)—are typically calculated independently, resulting in inconsistent underlying assumptions. We harmonize the estimation of the two anthropogenic land flux terms by incorporating previous estimates of these inconsistencies. We recalculate the global carbon budget (GCB) and apply change-point analysis to the cumulative budget imbalance. Cumulative over 1850–2018 (1959–2018), harmonization results in a 13% lesser (4% greater) land use source from anthromes and a 20% (23%) lesser land sink. This recalculation yields a greater non-closure of the GCB, indicating a missing carbon sink averaging 0.65 Pg C year -1 since the early 20th century. The imbalance likely results from a combination of method discontinuity and structural errors in the assessment of the direct anthropogenic land use flux, greater ocean carbon uptake, structural errors in land models, and in how these land terms are quantified for the budget. We caution against overconfidence in considering the GCB a solved problem and recommend further study of methodological discontinuities in budget terms. We strongly recommend studies that quantify the direct and indirect anthropogenic land fluxes simultaneously to ensure consistency, with a deeper understanding of human disturbance and legacy effects in anthromes.
Paper introduces concept of near equivalence in probability between different parameters or mathematical models of physical system. One in series of papers, each establishes different part of rigorous theory of mathematical modeling based on concepts of structural error, identifiability, and equivalence. This installment focuses upon effects of additive structural errors on degree of bias in estimates parameters.
The design, analysis, and simulation of a control law that guarantees a fine pointing performance under external disturbances and model uncertainties are investigated. The authors examine the achievable performance and modeling errors for the control-structure interaction (CSI) evolutionary model structure and highlight the importance of accurate knowledge of structural frequencies and damping values for very lightly damped structures. Numerical results indicate that a limited but significant line-of-sight pointing performance robustness can be attained in spite of modeled structured and unstructured uncertainties in the system. The simulation results reported demonstrate typical performance levels, types of uncertainties and their magnitudes, and design tradeoffs for a realistic laboratory model of a large flexible space structure.
Small modeling errors in the finite element model will eventually induce errors in the structural flexibility and mass, thus propagating into unpredictable errors in the unsteady aerodynamics and the control law design. One of the primary objectives of the Multi Utility Technology Test-bed, X-56A aircraft, is the flight demonstration of active flutter suppression, and therefore in this study, the identification of the primary and secondary modes for the structural model tuning based on the flutter analysis of the X-56A aircraft. The ground vibration test-validated structural dynamic finite element model of the X-56A aircraft is created in this study. The structural dynamic finite element model of the X-56A aircraft is improved using a model tuning tool. In this study, two different weight configurations of the X-56A aircraft have been improved in a single optimization run. Frequency and the cross-orthogonality (mode shape) matrix were the primary focus for improvement, while other properties such as center of gravity location, total weight, and offdiagonal terms of the mass orthogonality matrix were used as constraints. The end result was a more improved and desirable structural dynamic finite element model configuration for the X-56A aircraft. Improved frequencies and mode shapes in this study increased average flutter speeds of the X-56A aircraft by 7.6% compared to the baseline model.