Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Error Modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

State of the Art in Large-Scale Soil Moisture Monitoring

Soil moisture is an essential climate variable influencing land atmosphere interactions, an essential hydrologic variable impacting rainfall runoff processes, an essential ecological variable regulating net ecosystem exchange, and an essential agricultural variable constraining food security. Large-scale soil moisture monitoring has advanced in recent years creating opportunities to transform scientific understanding of soil moisture and related processes. These advances are being driven by researchers from a broad range of disciplines, but this complicates collaboration and communication. For some applications, the science required to utilize large-scale soil moisture data is poorly developed. In this review, we describe the state of the art in large-scale soil moisture monitoring and identify some critical needs for research to optimize the use of increasingly available soil moisture data. We review representative examples of 1) emerging in situ and proximal sensing techniques, 2) dedicated soil moisture remote sensing missions, 3) soil moisture monitoring networks, and 4) applications of large-scale soil moisture measurements. Significant near-term progress seems possible in the use of large-scale soil moisture data for drought monitoring. Assimilation of soil moisture data for meteorological or hydrologic forecasting also shows promise, but significant challenges related to model structures and model errors remain. Little progress has been made yet in the use of large-scale soil moisture observations within the context of ecological or agricultural modeling. Opportunities abound to advance the science and practice of large-scale soil moisture monitoring for the sake of improved Earth system monitoring, modeling, and forecasting.

Review↗

Evaluating Model Parameterizations of Submicron Aerosol Scattering and Absorption with in situ Data from ARCTAS 2008

Accurate modeling of the scattering and absorption of ultraviolet and visible radiation by aerosols is essential for accurate simulations of atmospheric chemistry and climate. Closure studies using in situ measurements of aerosol scattering and absorption can be used to evaluate and improve models of aerosol optical properties without interference from model errors in aerosol emissions, transport, chemistry, or deposition rates. Here we evaluate the ability of four externally mixed, fixed size distribution parameterizations used in global models to simulate submicron aerosol scattering and absorption at three wavelengths using in situ data gathered during the 2008 Arctic Research of the Composition of the Troposphere from Aircraft and Satellites (ARCTAS) campaign. The four models are the NASA Global Modeling Initiative (GMI) Combo model, GEOS-Chem v9- 02, the baseline configuration of a version of GEOS-Chem with online radiative transfer calculations (called GC-RT), and the Optical Properties of Aerosol and Clouds (OPAC v3.1) package. We also use the ARCTAS data to perform the first evaluation of the ability of the Aerosol Simulation Program (ASP v2.1) to simulate submicron aerosol scattering and absorption when in situ data on the aerosol size distribution are used, and examine the impact of different mixing rules for black carbon (BC) on the results. We find that the GMI model tends to overestimate submicron scattering and absorption at shorter wavelengths by 10-23 percent, and that GMI has smaller absolute mean biases for submicron absorption than OPAC v3.1, GEOS-Chem v9-02, or GC-RT. However, the changes to the density and refractive index of BC in GCRT improve the simulation of submicron aerosol absorption at all wavelengths relative to GEOS-Chem v9-02. Adding a variable size distribution, as in ASP v2.1, improves model performance for scattering but not for absorption, likely due to the assumption in ASP v2.1 that BC is present at a constant mass fraction throughout the aerosol size distribution. Using a core-shell mixing rule in ASP overestimates aerosol absorption, especially for the fresh biomass burning aerosol measured in ARCTAS-B, suggesting the need for modeling the time-varying mixing states of aerosols in future versions of ASP.

Alvarado, Matthew J.↗

Subseasonal-to-Seasonal Hindcast Skill Assessment of Ridging Events Related to Drought Over the Western United States

Persistent atmospheric ridging events centered near the western United States are associated with widespread precipitation deficits and meteorological drought. Due to the relatively low skill of- dynamical models in forecasting precipitation on subseasonal‐to‐seasonal (S2S) time scales across this region, forecasts of ridging are explored in this study as a potential bridge for early warning drought prediction. To assess skill, we evaluate deterministic and probabilistic S2S hindcasts (out to 6 week lead time) of ridging events and geopotential height anomalies over the western United States in five ensemble hindcast systems. Prediction skill for ridging events is shown to be highly variable across models. For some models, longer‐time‐averaged patterns of geopotential height anomalies across the first 6 weeks can be skillfully simulated, when evaluated probabilistically against climatology. The most skillful models show modest skill in forecasting above normal ridging occurrences at lead times of Weeks 3–4 and Weeks 5–6,with some sensitivity to the specific ridge location and method for determining skill. Using the European Centre for Medium‐Range Weather Forecasts (ECMWF) model as a case study, longer lead time forecast busts are shown to often occur under extended periods of highly active La Nina‐like tropical convection. Model errors at simulating these tropical convection features may have a disproportionately large impact and degrade downstream forecasts over the western United States. Despite the documented model shortcomings, our results highlight an opportunity to target skillful ridging forecasts from dynamical models for improving early warning drought forecasting at S2S lead times.

S2S↗

Analysis and Reduction of Complex Networks Under Uncertainty

This effort was a collaboration with Youssef Marzouk of MIT, Omar Knio of Duke University (at the time at Johns Hopkins University) and Habib Najm of Sandia National Laboratories. The objective of this effort was to develop the mathematical and algorithmic capacity to analyze complex networks under uncertainty. Of interest were chemical reaction networks and smart grid networks. The statements of work for USC focused on the development of stochastic reduced models for uncertain networks. The USC team was led by Professor Roger Ghanem and consisted of one graduate student and a postdoc. The contributions completed by the USC team consisted of 1) methodology and algorithms to address the eigenvalue problem, a problem of significance in the stability of networks under stochastic perturbations, 2) methodology and algorithms to characterize probability measures on graph structures with random flows. This is an important problem in characterizing random demand (encountered in smart grid) and random degradation (encountered in infrastructure systems), as well as modeling errors in Markov Chains (with ubiquitous relevance!). 3) methodology and algorithms for treating inequalities in uncertain systems. This is an important problem in the context of models for material failure and network flows under uncertainty where conditions of failure or flow are described in the form of inequalities between the state variables.

97 MATHEMATICS AND COMPUTING↗

Success Stories in Control: Nonlinear Dynamic Inversion Control

NASA plays an important role in advancing the state of the art in flight control systems. In the case of Nonlinear Dynamic Inversion (NDI) NASA supported initial implementation of the theory in an aircraft and demonstration in a space vehicle. Dr. Dale Enns of Honeywell Aerospace Advanced Technology performed this work in cooperation with NASA and under NASA contract. Honeywell and Lockheed Martin were subsequently contracted by AFRL to create "Design Guidelines for Multivariable Control Theory". This foundational work directly contributed to the advancement of the technology and the credibility of the control law as a design option. As a result Honeywell collaborated with Lockheed Martin to produce a Nonlinear Dynamic Inversion controller for the X-35 and subsequently Lockheed Martin did the same for the production Lockheed Martin F-35 vehicle. The theory behind NDI is to use a systematic generalized approach to controlling a vehicle. Using general aircraft nonlinear equations of motion and onboard aerodynamic, mass properties, and engine models specific to the vehicle, a relationship between control effectors and desired aircraft motion can be formulated. Using this formulation a control combination is used that provides a predictable response to commanded motion. Control loops around this formulation shape the response as desired and provide robustness to modeling errors. Once the control law is designed it can be used on a similar class of vehicle with only an update to the vehicle specific onboard models.

Bosworth, John T.↗

Quantified uncertainty in thermodynamic modeling for materials design

Phase fractions, compositions and energies of the stable phases as a function of macroscopic composition, temperature, and pressure (X-T-P) are the principle correlations needed for the design of new materials and improvement of existing materials. They are the outcomes of thermodynamic modeling based on the CALculation of PHAse Diagrams (CALPHAD) approach. Here, the accuracy of CALPHAD predictions vary widely in X-T-P space due to experimental error, model inadequacy and unequal data coverage. In response, researchers have developed frameworks to quantify the uncertainty of thermodynamic property model parameters and propagate it to phase diagram predictions. In most previous studies, uncertainty was represented as intervals on phase boundaries (with respect to composition or temperature) and was unable to represent the uncertainty in invariant reactions or in the stability of phase regions. In this work, we propose a suite of tools that leverages samples from the multivariate model parameter distribution to represent uncertainty in forms that surpass previous limitations and are well suited to materials design. These representations include the distribution of phase diagrams and their features, as well as the dependence of phase stability and the distributions of phase fraction, composition, activity and Gibbs energy on X-T-P location - irrespective of the total number of components. Most critically, the new methodology allows the material designer to interrogate a certain composition and temperature domain and get in return the probability of different phases to be stable, which can positively impact materials design.

36 MATERIALS SCIENCE↗

Projecting GeoVisipedia Annotations onto Satellite Imagey with the PRISM Algorithm

GeoVisipedia is a new and novel approach to sharing knowledge about complex geospatial configurations such as facilities. GeoVisipieda annotates objects in facilities with wiki pages. Annotations are projected to and from facility imagery using the PRISM algorithm. This report describes how the PRISM algorithm uses image metadata and a 3D facility model to perform annotation projection. The report concludes with an illustration of the efficacy of the PRISM algorithm in projecting an annotation onto a stack, and a demonstration of the effects of modeling error.

3D geospatial models↗

Doubly-Differenced Measurements for Orbit Determinations

Report describes accurate method of determining orbit of low-altitude Earth satellite. Method insensitive to clock errors and provides continuous determination of orbit. Report examines effects of employing fewer ground stations, applying different solution strategies, and introducing fictitious thrust parameters to minimize geopotential modeling error - one of major error sources.

Wu, S. C.↗

Analysis/forecast experiments with a multivariate statistical analysis scheme using FGGE data

A three-dimensional, multivariate, statistical analysis method, optimal interpolation (OI) is described for modeling meteorological data from widely dispersed sites. The model was developed to analyze FGGE data at the NASA-Goddard Laboratory of Atmospherics. The model features a multivariate surface analysis over the oceans, including maintenance of the Ekman balance and a geographically dependent correlation function. Preliminary comparisons are made between the OI model and similar schemes employed at the European Center for Medium Range Weather Forecasts and the National Meteorological Center. The OI scheme is used to provide input to a GCM, and model error correlations are calculated for forecasts of 500 mb vertical water mixing ratios and the wind profiles. Comparisons are made between the predictions and measured data. The model is shown to be as accurate as a successive corrections model out to 4.5 days.

Baker, W. E.↗

Filter Tuning Using the Chi-Squared Statistic

The Goddard Space Flight Center (GSFC) Flight Dynamics Facility (FDF) performs orbit determination (OD) for the Aqua and Aura satellites. Both satellites are located in low Earth orbit (LEO), and are part of what is considered the A-Train satellite constellation. Both spacecraft are currently in the science phase of their respective missions. The FDF has recently been tasked with delivering definitive covariance for each satellite.The main source of orbit determination used for these missions is the Orbit Determination Toolkit developed by Analytical Graphics Inc. (AGI). This software uses an Extended Kalman Filter (EKF) to estimate the states of both spacecraft. The filter incorporates force modelling, ground station and space network measurements to determine spacecraft states. It also generates a covariance at each measurement. This covariance can be useful for evaluating the overall performance of the tracking data measurements and the filter itself. An accurate covariance is also useful for covariance propagation which is utilized in collision avoidance operations. It is also valuable when attempting to determine if the current orbital solution will meet mission requirements in the future.This paper examines the use of the Chi-square statistic as a means of evaluating filter performance. The Chi-square statistic is calculated to determine the realism of a covariance based on the prediction accuracy and the covariance values at a given point in time. Once calculated, it is the distribution of this statistic that provides insight on the accuracy of the covariance.For the EKF to correctly calculate the covariance, error models associated with tracking data measurements must be accurately tuned. Over estimating or under estimating these error values can have detrimental effects on the overall filter performance. The filter incorporates ground station measurements, which can be tuned based on the accuracy of the individual ground stations. It also includes measurements from the NASA space network (SN), which can be affected by the assumed accuracy of the TDRS satellite state at the time of the measurement.The force modelling in the EKF is also an important factor that affects the propagation accuracy and covariance sizing. The dominant force in the LEO orbit regime is the drag force caused by atmospheric drag. Accurate accounting of the drag force is especially important for the accuracy of the propagated state. The implementation of a box and wing model to improve drag estimation accuracy, and its overall effect on the covariance state is explored.The process of tuning the EKF for Aqua and Aura support is described, including examination of the measurement errors of available observation types (Doppler and range), and methods of dealing with potentially volatile atmospheric drag modeling. Predictive accuracy and the distribution of the Chi-square statistic, calculated based of the ODTK EKF solutions, are assessed versus accepted norms for the orbit regime.

Covariance Analysis↗

Rapid estimation of earthquake locations using waveform traveltimes

SUMMARY We introduce a new approach for locating earthquakes using arrival times derived from waveforms. The most costly computational step of the algorithm scales as the number of stations in the active seismographic network. In this approach, a variation on existing grid search methods, a series of full waveform simulations are conducted for all receiver locations, with sources positioned successively at each station. The traveltime field over the region of interest is calculated by applying a phase picking algorithm to the numerical wavefields produced from each simulation. An event is located by subtracting the stored traveltime field from the arrival time at each station. This provides a shifted and time-reversed traveltime field for each station. The shifted and time-reversed fields all approach the origin time of the event at the source location. The mean or median value at the source location thus approximates the event origin time. Measures of dispersion about this mean or median time at each grid point, such as the sample standard error and the average deviation, are minimized at the correct source position. Uncertainty in the event position is provided by the contours of standard error defined over the grid. An application of this technique to a synthetic data set indicates that the approach provides stable locations even when the traveltimes are contaminated by additive random noise containing a significant number of outliers and velocity model errors. It is found that the waveform-based method out-performs one based upon the eikonal equation for a velocity model with rapid spatial variations in properties due to layering. A comparison with conventional location algorithms in both a laboratory and field setting demonstrates that the technique performs at least as well as existing techniques.

58 GEOSCIENCES↗

A score-based diffusion model approach for adaptive learning of stochastic partial differential equation solutions

In this paper, we propose a novel framework for adaptively learning the time-evolving solutions of stochastic partial differential equations (SPDEs) using score-based diffusion models within a recursive Bayesian inference setting. SPDEs play a central role in modeling complex physical systems under uncertainty, but their numerical solutions often suffer from model errors and reduced accuracy due to incomplete physical knowledge and environmental variability. To address these challenges, we encode the governing physics into the score function of a diffusion model using simulation data and incorporate observational information via a likelihood-based correction in a reverse-time stochastic differential equation. This enables adaptive learning through iterative refinement of the solution as new data becomes available. To improve computational efficiency in high-dimensional settings, we introduce the ensemble score filter, a training-free approximation of the score function designed for real-time inference. Numerical experiments on benchmark SPDEs demonstrate the accuracy and robustness of the proposed method under sparse and noisy observations.

97 MATHEMATICS AND COMPUTING↗

GSFC OSTM, Jason-l and TOPEX POD Update

The OSTM (Jason-2) has been in orbit for three years (since June 2008), and the full suite of altimeter data from TOPEX/Poseidon, Jason-I and Jason-2 now span nearly twenty years since the launch of TOPEX in 1992. Issues that affect the stability of the orbits through time and the orbit accuracy include the reference frame, the radiation pressure models for the altimeter satellites and the fidelity of the dynamic force model, including time-variable gravity, as well as the performance of the individual tracking systems. We have conducted detailed analyses of the new ITRF2008 reference frame and find only a small effect on global mean sea level compared to ITRF2005, although we note an improvement in POD quality over the most recent time periods for Jason-2. In the past year we have developed a new time series of orbits for TOPEX/Poseidon, Jason-I, and Jason-2 based on the ITRF2008 reference frame using SLR and DORIS data and for Jason-2 using GPS data. In addition, we have continued to experiment with improvements to the radiation pressure model for the altimeter satellites in particular the Jason satellites since these nonconservative force model errors now rank as the most outstanding source of error on altimeter satellite POD. In the previous (ITRF2005-based) and current (ITRF2008-based) orbits we have relied on a simplified time-variable gravity (TVG) model, derived from GRACE solutions. We have recently experimented with improvements using higher fidelity TVG models (both temporally and spatially) and report on the results. We have computed a time series of GPS-only reduced-dynamic orbits at GSFC, and used these in conjunction with the SLR-DORIS dynamic and reduced-dynamic orbits to assess reference fiame stability with respect to the different tracking systems for both ITRF2005 and ITRF2008. We show through internal (GSFConly) and external comparisons (with other analysis centers) that the radial orbit accuracy for Jason-2 remains at I cm.

Lemoine, Frank G.↗

Advances in Land Data Assimilation at the NASA Goddard Space Flight Center

Research in land surface data assimilation has grown rapidly over the last decade. In this presentation we provide a brief overview of key research contributions by the NASA Goddard Space Flight Center (GSFC). The GSFC contributions to land assimilation primarily include the continued development and application of the Land Information System (US) and the ensemble Kalman filter (EnKF). In particular, we have developed a method to generate perturbation fields that are correlated in space, time, and across variables and that permit the flexible modeling of errors in land surface models and observations, along with an adaptive filtering approach that estimates observation and model error input parameters. A percentile-based scaling method that addresses soil moisture biases in model and observational estimates opened the path to the successful application of land data assimilation to satellite retrievals of surface soil moisture. Assimilation of AMSR-E surface soil moisture retrievals into the NASA Catchment model provided superior surface and root zone assimilation products (when validated against in situ measurements and compared to the model estimates or satellite observations alone). The multi-model capabilities of US were used to investigate the role of subsurface physics in the assimilation of surface soil moisture observations. Results indicate that the potential of surface soil moisture assimilation to improve root zone information is higher when the surface to root zone coupling is stronger. Building on this experience, GSFC leads the development of the Level 4 Surface and Root-Zone Soil Moisture (L4_SM) product for the planned NASA Soil-Moisture-Active-Passive (SMAP) mission. A key milestone was the design and execution of an Observing System Simulation Experiment that quantified the contribution of soil moisture retrievals to land data assimilation products as a function of retrieval and land model skill and yielded an estimate of the error budget for the SMAP L4_SM product. Terrestrial water storage observations from GRACE satellite system were also successfully assimilated into the NASA Catchment model and provided improved estimates of groundwater variability when compared to the model estimates alone. Moreover, satellite-based land surface temperature (LST) observations from the ISCCP archive were assimilated using a bias estimation module that was specifically designed for LST assimilation. As with soil moisture, LST assimilation provides modest yet statistically significant improvements when compared to the model or satellite observations alone. To achieve the improvement, however, the LST assimilation algorithm must be adapted to the specific formulation of LST in the land model. An improved method for the assimilation of snow cover observations was also developed. Finally, the coupling of LIS to the mesoscale Weather Research and Forecasting (WRF) model enabled investigations into how the sensitivity of land-atmosphere interactions to the specific choice of planetary boundary layer scheme and land surface model varies across surface moisture regimes, and how it can be quantified and evaluated against observations. The on-going development and integration of land assimilation modules into the Land Information System will enable the use of GSFC software with a variety of land models and make it accessible to the research community.

Reichle, Rolf↗

Analysis of Integrated Vapor Transport Biases

Abstract High-fidelity analyses and forecasts of integrated vapor transport (VT) are central to the study of Earth’s hydrological cycle as well as high-impact phenomena such as monsoons and atmospheric rivers. The impact of the in-line analysis correction-based additive inflation (ACAI) on IVT biases and forecast errors is examined within the Navy Earth System Prediction Capability (Navy ESPC) global coupled system. The ACAI technique uses atmospheric analysis corrections from the data assimilation system to approximate model bias and as a representation of stochastic model error to simultaneously reduce systematic and random errors and improve ensemble performance. ACAI reduces the global average magnitude of the 7- and 14-day IVT bias by 16%–17% during Northern Hemisphere summer, reaching 70% reductions in some tropical regions. The global average IVT bias reduction is similar to the bias reduction for low-level wind speed bias and considerably smaller than the bias reduction in total precipitable water. The localized regions where ACAI increases IVT bias occur where the control IVT biases change sign and structure with increasing forecast lead time, such as the South Asian monsoon region. Substituting analyzed wind or moisture fields for the forecast fields when calculating the forecast IVT confirms that, on average, wind errors dominate the IVT error calculation in the tropics, although wind and moisture error contributions are comparable in the extratropics. The existence of regions where using either analyzed winds or analyzed moisture increases IVT bias or mean absolute error reveals areas with compensating errors.

Reynolds, Carolyn A.↗

Error detection process - Model, design, and its impact on computer performance

An analytical model is developed for computer error detection processes and applied to estimate their influence on system performance. Faults in the hardware, not in the design, are assumed to be the potential cause of transition to erroneous states during normal operations. The classification properties and associated recovery methods of error detection are discussed. The probability of obtaining an unreliable result is evaluated, along with the resulting computational loss. Error detection during design is considered and a feasible design space is outlined. Extension of the methods to account for the effects of extant multiple faults is indicated.

Shin, K. G.↗

Extension to the dynamic modeling of the large angle magnetic suspension test fixture

The Large Angle Magnetic Suspension Test Fixture (LAMSTF) is a laboratory scale proof-of-concept system. The configuration is unique in that the electromagnets are mounted in a circular planar array. A mathematical model of the system had previously been developed, but was shown to have inaccuracies. These inaccuracies showed up in the step responses. Eddy currents were found to be the major cause of the modeling errors. In the original system, eddy currents existed in the aluminum baseplate, iron cores, and the sensor support frame. An attempt to include the eddy current dynamics in the system model is presented. The dynamics of a dummy sensor ring were added to the system. Adding the eddy current dynamics to the simulation improves the way it compares to the actual experiment. Also presented is a new method of determining the yaw angle of the suspended element. From the coil currents the yaw angle can be determined and the controller can be updated to suspend at the new current. This method has been used to demonstrate a 360 degree yaw angle rotation.

Foster, Lucas E.↗

Robust verification analysis

We introduce a new methodology for inferring the accuracy of computational simulations through the practice of solution verification. We demonstrate this methodology on examples from computational heat transfer, fluid dynamics and radiation transport. Our methodology is suited to both well- and ill-behaved sequences of simulations. Our approach to the analysis of these sequences of simulations incorporates expert judgment into the process directly via a flexible optimization framework, and the application of robust statistics. The expert judgment is systematically applied as constraints to the analysis, and together with the robust statistics guards against over-emphasis on anomalous analysis results. We have named our methodology Robust Verification. Our methodology is based on utilizing multiple constrained optimization problems to solve the verification model in a manner that varies the analysis' underlying assumptions. Constraints applied in the analysis can include expert judgment regarding convergence rates (bounds and expectations) as well as bounding values for physical quantities (e.g., positivity of energy or density). This approach then produces a number of error models, which are then analyzed through robust statistical techniques (median instead of mean statistics). This provides self-contained, data and expert informed error estimation including uncertainties for both the solution itself and order of convergence. Our method produces high quality results for the well-behaved cases relatively consistent with existing practice. The methodology can also produce reliable results for ill-behaved circumstances predicated on appropriate expert judgment. We demonstrate the method and compare the results with standard approaches used for both code and solution verification on well-behaved and ill-behaved simulations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗