Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,333 records · Page 74

Estimating Subhourly Inverter Clipping Loss From Satellite-Derived Irradiance Data: Preprint

Photovoltaic system production simulations are conventionally run using hourly weather datasets. Hourly simulations are sufficiently accurate to predict the majority of long-term system behavior but cannot resolve high-frequency effects like inverter clipping caused by short-duration irradiance variability. Direct modeling of this subhourly clipping error is only possible for the few locations with high-resolution irradiance datasets. This paper describes a method of predicting the magnitude of this error using a machine learning model and 30-minute satellite irradiance data. The method predicts a correction for each 30-minute interval with the potential to roll up into 60-minute corrections to match an hourly energy model. The model is trained and validated at locations where the error can be directly simulated from 1-minute ground data. The validation shows low bias at most ground station locations. The model is also applied to gridded satellite irradiance to produce a heatmap of the estimated clipping error across the United States. Finally, the relative importance of each predictor satellite variable is retrieved from the model and discussed.

41 EE - Solar Energy Technologies Office (EE-4S)↗

Error analysis of a hybrid control drum worth model

This paper presents a perturbation-based model for control drum worth prediction which employs both physics-based and statistics-based components. Control drums, or control shims, are cylindrical in shape and span the axial length of the core. A portion of the cylinder is coated in neutron absorbing material and the drum can rotate to introduce the absorbing material to the body of the core to reduce reactivity. The model can be expensive to create due to the requirement for full-core Monte Carlo eigenvalue calculations. Therefore, it is important to analyze how the errors in Monte Carlo calculated k{sub eff} used for model training affect model performance. It was found that the error in predicted criticalities could average to 70 pcm in the most complex form of the model and 215 pcm in the simplest form of the model. Furthermore, it was found that the Monte Carlo uncertainty in quantities calculated with Serpent used to train the models had minimal impact on the error observed from the model. Lastly, one of the forms of the hybrid model could be trained in considerably less computational time if the Monte Carlo calculations were run to higher uncertainty in k{sub eff} with a small penalty to model performance.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

An Empirical State Error Covariance Matrix Orbit Determination Example

State estimation techniques serve effectively to provide mean state estimates. However, the state error covariance matrices provided as part of these techniques suffer from some degree of lack of confidence in their ability to adequately describe the uncertainty in the estimated states. A specific problem with the traditional form of state error covariance matrices is that they represent only a mapping of the assumed observation error characteristics into the state space. Any errors that arise from other sources (environment modeling, precision, etc.) are not directly represented in a traditional, theoretical state error covariance matrix. First, consider that an actual observation contains only measurement error and that an estimated observation contains all other errors, known and unknown. Then it follows that a measurement residual (the difference between expected and observed measurements) contains all errors for that measurement. Therefore, a direct and appropriate inclusion of the actual measurement residuals in the state error covariance matrix of the estimate will result in an empirical state error covariance matrix. This empirical state error covariance matrix will fully include all of the errors in the state estimate. The empirical error covariance matrix is determined from a literal reinterpretation of the equations involved in the weighted least squares estimation algorithm. It is a formally correct, empirical state error covariance matrix obtained through use of the average form of the weighted measurement residual variance performance index rather than the usual total weighted residual form. Based on its formulation, this matrix will contain the total uncertainty in the state estimate, regardless as to the source of the uncertainty and whether the source is anticipated or not. It is expected that the empirical error covariance matrix will give a better, statistical representation of the state error in poorly modeled systems or when sensor performance is suspect. In its most straight forward form, the technique only requires supplemental calculations to be added to existing batch estimation algorithms. In the current problem being studied a truth model making use of gravity with spherical, J2 and J4 terms plus a standard exponential type atmosphere with simple diurnal and random walk components is used. The ability of the empirical state error covariance matrix to account for errors is investigated under four scenarios during orbit estimation. These scenarios are: exact modeling under known measurement errors, exact modeling under corrupted measurement errors, inexact modeling under known measurement errors, and inexact modeling under corrupted measurement errors. For this problem a simple analog of a distributed space surveillance network is used. The sensors in this network make only range measurements and with simple normally distributed measurement errors. The sensors are assumed to have full horizon to horizon viewing at any azimuth. For definiteness, an orbit at the approximate altitude and inclination of the International Space Station is used for the study. The comparison analyses of the data involve only total vectors. No investigation of specific orbital elements is undertaken. The total vector analyses will look at the chisquare values of the error in the difference between the estimated state and the true modeled state using both the empirical and theoretical error covariance matrices for each of scenario.

Frisbee, Joseph H., Jr.↗

Integrated and spectral energetics of the GLAS general circulation model

Integrated and spectral error energetics of the Goddard Laboratory for Atmospheric Sciences (GLAS) general circulation model are compared with observations for periods in January 1975, 1976, and 1977. For two cases the model shows significant skill in predicting integrated energetics quantities out to two weeks, and for all three cases, the integrated monthly mean energetics show qualitative improvements over previous versions of the model in eddy kinetic energy and barotropic conversions. Fundamental difficulties remain with leakage of energy to the stratospheric level. General circulation model spectral energetics predictions are compared with the corresponding observational spectra on a day by day basis. Eddy kinetic energy can be correct while significant errors occur in the kinetic energy of wavenumber three. Single wavenumber dominance in eddy kinetic energy and the correlation of spectral kinetic and potential energy are demonstrated.

Tenenbaum, J.↗

Adaptive Modeling of the International Space Station Electrical Power System

Software simulations provide NASA engineers the ability to experiment with spacecraft systems in a computer-imitated environment. Engineers currently develop software models that encapsulate spacecraft system behavior. These models can be inaccurate due to invalid assumptions, erroneous operation, or system evolution. Increasing accuracy requires manual calibration and domain-specific knowledge. This thesis presents a method for automatically learning system models without any assumptions regarding system behavior. Data stream mining techniques are applied to learn models for critical portions of the International Space Station (ISS) Electrical Power System (EPS). We also explore a knowledge fusion approach that uses traditional engineered EPS models to supplement the learned models. We observed that these engineered EPS models provide useful background knowledge to reduce predictive error spikes when confronted with making predictions in situations that are quite different from the training scenarios used when learning the model. Evaluations using ISS sensor data and existing EPS models demonstrate the success of the adaptive approach. Our experimental results show that adaptive modeling provides reductions in model error anywhere from 80% to 96% over these existing models. Final discussions include impending use of adaptive modeling technology for ISS mission operations and the need for adaptive modeling in future NASA lunar and Martian exploration.

Thomas, Justin Ray↗

Fingerprints of external forcings on Sahel rainfall: aerosols, greenhouse gases, and model-observation discrepancies

Over the 20th and 21st centuries, both anthropogenic greenhouse gas increases and changes in anthropogenic aerosols have affected rainfall in the Sahel. Using multiple characteristics of Sahel precipitation, we construct a multivariate fingerprint that allows us to distinguish between the model-predicted responses to greenhouse gases and anthropogenic aerosols. Models project the emergence of a detectable signal of aerosol forcing in the middle of the 20th century and a detectable signal of greenhouse gas forcing at the beginning of the 21st. However, the signals of both aerosol and greenhouse gas forcing in observations emerge earlier and are stronger than in the models, far stronger in the case of aerosols. The similarity between the response to aerosol forcing and the leading mode of internal variability makes it difficult to attribute this model-observation discrepancy to errors in the forcing, errors in the forced response, model inability to capture the amplitude of internal variability, or some combination of these. For greenhouse gases, however, the forced response is distinct from internal variability as estimated by models, and the observations are largely commensurate with the model projections.

54 ENVIRONMENTAL SCIENCES↗

The design and analysis of single flank transmission error testor for loaded gears

Due to geometrical imperfections in gears and finite tooth stiffnesses, the motion transmitted from an input gear shaft to an output gear shaft will not have conjugate action. In order to strengthen the understanding of transmission error and to verify mathematical models of gear transmission error, a test stand that will measure the transmission error of a gear pair at operating loads, but at reduced speeds would be desirable. This document describes the design and development of a loaded transmission error tester. For a gear box with a gear ratio of one, few tooth meshing combinations will occur during a single test. In order to observe the effects of different tooth mesh combinations and to increase the ability to load test gear pairs with higher gear ratios, the system was designed around a gear box with a gear ratio of two.

Houser, D. R.↗

Five-Hole Flow Angle Probe Calibration for the NASA Glenn Icing Research Tunnel

A spring 1997 test section calibration program is scheduled for the NASA Glenn Research Center Icing Research Tunnel following the installation of new water injecting spray bars. A set of new five-hole flow angle pressure probes was fabricated to properly calibrate the test section for total pressure, static pressure, and flow angle. The probes have nine pressure ports: five total pressure ports on a hemispherical head and four static pressure ports located 14.7 diameters downstream of the head. The probes were calibrated in the NASA Glenn 3.5-in.-diameter free-jet calibration facility. After completing calibration data acquisition for two probes, two data prediction models were evaluated. Prediction errors from a linear discrete model proved to be no worse than those from a full third-order multiple regression model. The linear discrete model only required calibration data acquisition according to an abridged test matrix, thus saving considerable time and financial resources over the multiple regression model that required calibration data acquisition according to a more extensive test matrix. Uncertainties in calibration coefficients and predicted values of flow angle, total pressure, static pressure. Mach number. and velocity were examined. These uncertainties consider the instrumentation that will be available in the Icing Research Tunnel for future test section calibration testing.

Gonsalez, Jose C.↗

Synthesis and Assimilation Systems - Essential Adjuncts to the Global Ocean Observing System

Ocean assimilation systems synthesize diverse in situ and satellite data streams into four-dimensional state estimates by combining the various observations with the model. Assimilation is particularly important for the ocean where subsurface observations, even today, are sparse and intermittent compared with the scales needed to represent ocean variability and where satellites only sense the surface. Developments in assimilation and in the observing system have advanced our understanding and prediction of ocean variations at mesoscale and climate scales. Use of these systems for assessing the observing system helps identify the strengths of each observation type. Results indicate that the ocean remains under-sampled and that further improvements in the observing system are needed. Prospects for future advances lie in improved models and better estimates of error statistics for both models and observations. Future developments will be increasingly towards consistent analyses across components of the Earth system. However, even today ocean synthesis and assimilation systems are providing products that are useful for many applications and should be considered an integral part of the global ocean observing and information system.

Rienecker, Michele M.↗

Fingerprints of External Forcing Agents on Sahel Rainfall: Aerosols, Greenhouse Gases, and Model-Observation Discrepancies

Over the 20th and 21st centuries, both anthropogenic greenhouse gas increases and changes in anthropogenic aerosols have affected rainfall in the Sahel. Using multiple characteristics of Sahel precipitation, we construct a multivariate fingerprint that allows us to distinguish between the model-predicted responses to greenhouse gases and anthropogenic aerosols. Models project the emergence of a detectable signal of aerosol forcing in the middle of the 20th century and a detectable signal of greenhouse gas forcing at the beginning of the 21st. However, the signals of both aerosol and greenhouse gas forcing in observations emerge earlier and are stronger than in the models, far stronger in the case of aerosols. The similarity between the response to aerosol forcing and the leading mode of internal variability makes it difficult to attribute this model-observation discrepancy to errors in the forcing, errors in the forced response, model inability to capture the amplitude of internal variability, or some combination of these. For greenhouse gases, however, the forced response is distinct from internal variability as estimated by models, and the observations are largely commensurate with the model projections.

Sahel↗

Extending "Deep Blue" Aerosol Retrieval Coverage to Cases of Absorbing Aerosols Above Clouds: Sensitivity Analysis and First Case Studies

Cases of absorbing aerosols above clouds (AACs), such as smoke or mineral dust, are omitted from most routinely processed space-based aerosol optical depth (AOD) data products, including those from the Moderate Resolution Imaging Spectroradiometer (MODIS). This study presents a sensitivity analysis and preliminary algorithm to retrieve above-cloud AOD and liquid cloud optical depth (COD) for AAC cases from MODIS or similar sensors, for incorporation into a future version of the "Deep Blue" AOD data product. Detailed retrieval simulations suggest that these sensors should be able to determine AAC AOD with a typical level of uncertainty approximately 25-50 percent (with lower uncertainties for more strongly absorbing aerosol types) and COD with an uncertainty approximately10-20 percent, if an appropriate aerosol optical model is known beforehand. Errors are larger, particularly if the aerosols are only weakly absorbing, if the aerosol optical properties are not known, and the appropriate model to use must also be retrieved. Actual retrieval errors are also compared to uncertainty envelopes obtained through the optimal estimation (OE) technique; OE-based uncertainties are found to be generally reasonable for COD but larger than actual retrieval errors for AOD, due in part to difficulties in quantifying the degree of spectral correlation of forward model error. The algorithm is also applied to two MODIS scenes (one smoke and one dust) for which near-coincident NASA Ames Airborne Tracking Sun photometer (AATS) data were available to use as a ground truth AOD data source, and found to be in good agreement, demonstrating the validity of the technique with real observations.

aerosols above clouds↗

Simple model to investigate jet quenching and correlated errors for centrality-dependent nuclear modification factors in relativistic heavy-ion collisions

Here, we apply Bayesian techniques to compare a simple, empirical model for jet quenching in heavy-ion collisions to centrality-dependent jet R AA measured by ATLAS for Pb + Pb collisions at $\sqrt{s_{NN}}$ = 5.02 TeV. We find that the R AA values for central collisions are adequately described with a model for the mean p T -dependent jet energy loss using only two parameters. This model is extended by incorporating two-dimensional initial geometry information from TRENTo and compared to centrality-dependent R AA values. We find that the results are sensitive to the value of the jet-quenching formation time, τ ƒ , and that the optimal value of τ ƒ varies with the assumed path-length dependence of the energy loss. We construct a covariance error matrix for the data from the p T -dependent contributions to the ATLAS systematic errors and perform Bayesian calibrations for several different assumptions for the systematic error correlations. We show that the most-probable functions and $χ^2_d$ values are sensitive to assumptions made when fitting to correlated errors. This work demonstrates the utility of a simple model that can quickly demonstrate the constraining power of jet-quenching observables with corresponding uncertainties and guide future studies using more sophisticated models.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Atmospheric drag model calibrations for spacecraft lifetime prediction

Although solar activity prediction uncertainty normally dominates decay prediction error budget for near-Earth spacecraft, the effect of drag force modeling errors for given levels of solar activity needs to be considered. Two atmospheric density models, the modified Harris-Priester model and the Jacchia-Roberts model, to reproduce the decay histories of the Solar Mesosphere Explorer (SME) and Solar Maximum Mission (SMM) spacecraft in the 490- to 540-kilometer altitude range were analyzed. Historical solar activity data were used in the input to the density computations. For each spacecraft and atmospheric model, a drag scaling adjustment factor was determined for a high-solar-activity year, such that the observed annual decay in the mean semimajor axis was reproduced by an averaged variation-of-parameters (VOP) orbit propagation. The SME (SMM) calibration was performed using calendar year 1983 (1982). The resulting calibration factors differ by 20 to 40 percent from the predictions of the prelaunch ballistic coefficients. The orbit propagations for each spacecraft were extended to the middle of 1988 using the calibrated drag models. For the Jaccia-Roberts density model, the observed decay in the mean semimajor axis of SME (SMM) over the 4.5-year (5.5-year) predictive period was reproduced to within 1.5 (4.4) percent. The corresponding figure for the Harris-Priester model was 8.6 (20.6) percent. Detailed results and conclusions regarding the importance of accurate drag force modeling for lifetime predictions are presented.

Binebrink, A. L.↗

Observing System Simulation Experiments Investigating Atmospheric Motion Vectors and Radiances from a Constellation of 4–5-μm Infrared Sounders

A set of observing system simulation experiments (OSSEs) was performed to investigate the utility of a constellation of passive infrared spectrometers, strategically designed with the aim of deriving the three-dimensional retrievals of the horizontal wind via atmospheric motion vectors (AMVs) from instruments with the spectral resolution of an infrared sounder. The instrument and constellation designs were performed in the context of the Midwave Infrared Sounding of Temperature and humidity in a Constellation for Winds (MISTiC Winds). The Global Modeling and Assimilation Office OSSE system, which includes a full suite of operational meteorological observations, served as the control. To illustrate the potential impact of this observing strategy, two experiments were performed by adding the new simulated observations to the control. First, perfect (error free) simulated AMVs and radiances were assimilated. Second, the data were made imperfect by adding realistic modeled errors to the AMVs and radiances that were assimilated. The experimentation showed beneficial impacts on both the mass and wind fields, as based on analysis verification, forecast verification, and the assessment of the observations using the forecast sensitivity to observation impact (FSOI) metric. In all variables and metrics, the impacts of the imperfect observations were smaller than those of the perfect observations, although much of the positive benefit was retained. The FSOI metric illustrated two key points. First, the largest impacts were seen in the middle troposphere AMVs, which is a targeted capability of the constellation strategy. Second, the addition of modeled errors showed that the assimilation system was unable to fully exploit the 4.3-μm carbon dioxide absorption radiances.

Will McCarty↗

Initial investigations of an adaptive discrete-time controller for nonlinear time-varying robotic models

The objective of this paper is to design a discrete-time controller which forces y(t) = F(q(t),q'(t)) to follow a desired trajectory, when non-linearities may be uncertain. A self-tuning adaptive control algorithm is then developed that addresses three types of errors: (1) error due to model linearization; (2) errors due to controlling a time-varying plant; and (3) errors due to discretization.

Giang, S. S.↗

Observing System Simulation Experiments Investigating Atmospheric Motion Vectors and Radiances from a Constellation of 4-5 μm Infrared Sounders

A set of Observing System Simulation Experiments (OSSEs) was performed to investigate the utility of a constellation of passive infrared spectrometers, strategically designed with the aim of deriving the three-dimensional retrievals of the horizontal wind via atmospheric motion vectors (AMVs) from instruments with the spectral resolution of an infrared sounder. The instrument and constellation designs were performed in the context of the Midwave Infrared Sounding of Temperature and humidity in a Constellation for Winds, or MISTiC Winds. The Global Modeling and Assimilation Office OSSE system, which includes a full suite of operational meteorological observations, served as the control. To illustrate the potential impact of this observing strategy, two experiments were performed by adding the new simulated observations to the control. First, perfect (error-free) simulated AMVs and radiances were assimilated. Second, the data were made imperfect by adding realistic modeled errors to the AMVs and radiances that were assimilated. The experimentation showed beneficial impacts on both the mass and wind fields, as based on analysis verification, forecast verification, and the assessment of the observations using the Forecast Sensitivity to Observation Impact (FSOI) metric. In all variables and metrics, the impacts of the imperfect observations were smaller than those of the perfect observations, though much of the positive benefit was retained. The FSOI metric illustrated two key points. First, the largest impacts were seen in the middle troposphere AMVs, which is a targeted capability of the constellation strategy. Second, the addition of modeled errors showed that the assimilation system was unable to fully exploit the 4.3 μm carbon dioxide absorption radiances.

Will McCarty↗

Survey and Method for Determination of Trajectory Predictor Requirements

A survey of air-traffic-management researchers, representing a broad range of automation applications, was conducted to document trajectory-predictor requirements for future decision-support systems. Results indicated that the researchers were unable to articulate a basic set of trajectory-prediction requirements for their automation concepts. Survey responses showed the need to establish a process to help developers determine the trajectory-predictor-performance requirements for their concepts. Two methods for determining trajectory-predictor requirements are introduced. A fast-time simulation method is discussed that captures the sensitivity of a concept to the performance of its trajectory-prediction capability. A characterization method is proposed to provide quicker, yet less precise results, based on analysis and simulation to characterize the trajectory-prediction errors associated with key modeling options for a specific concept. Concept developers can then identify the relative sizes of errors associated with key modeling options, and qualitatively determine which options lead to significant errors. The characterization method is demonstrated for a case study involving future airport surface traffic management automation. Of the top four sources of error, results indicated that the error associated with accelerations to and from turn speeds was unacceptable, the error associated with the turn path model was acceptable, and the error associated with taxi-speed estimation was of concern and needed a higher fidelity concept simulation to obtain a more precise result

Rentas, Tamika L.↗