Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,513 records · Page 84
All sourcesNASA NTRSDOE OSTI
NASA NTRS2014

Development, Validation, and Application of OSSEs at NASA-GMAO

The GMAO OSSE framework has two general classes of applications. One is to estimate the potential improvements to weather forecasting and analysis by using new proposed instruments that are not as yet built or deployed. This exploits the simulated nature of the OSSE. The other is to assess various aspects of the GMAO data assimilation system. This exploits the availability of truth provided by the OSSE. Two examples of the first class of application will be offered. One concerns deployment of constellations of passive MW sounders on small CUBESATs placed in very low orbits. The other concern is increasing the frequency of radiosonde observations to 4-times daily at all current stations. Several examples of the second class will also be presented. One is an estimation of analysis error characteristics. Another is a comparison between covariances directly determined from explicitly known background errors and those estimated by computing differences between lagged forecasts using the NMC-method prior to tuning. A third is a comparison of effects of model and observation errors on analysis and forecast skill. The last is an examination of spectra of forecast errors in a study of predictability. This latter is an ongoing study.

OSSE↗
NASA NTRS2021

Reducing Risk of InSight Surface Operations Through High-Fidelity Command Sequence Modeling

Simulating spacecraft behavior is crucial for the success of deep space missions, and failure to do so may result in damages to or the loss of the spacecraft. Many previous deep space missions have made use of ground-simulation of sequenced commanding, at speeds far greater than real time, to predict spacecraft state over time through the execution of onboard sequences. This type of modeling can be done at any fidelity, and most missions have opted to decrease fidelity to reduce cost and complexity. However, NASA’s Interior Exploration using Seismic Investigations, Geodesy and Heat Transport (InSight) mission expanded the scope of ground modeling considerably, which has led to numerous benefits over past implementations. This paper will discuss the process and products that InSight created, as well as the lessons learned from successfully operating the spacecraft on Mars. InSight is the first JPL mission to expand the scope of ground modeling to include the uplink of files from Earth to the spacecraft, rather than making the simplification that any command sequences already exist onboard the spacecraft. The advantages of modeling the uplink of files are numerous. First, it allows for accurate modeling of the onboard filesystem of the spacecraft at all points in time, meaning that all file loads and deletions throughout the mission are modeled at the exact moment they are predicted to actually happen. Second, operators can be more certain that dependencies between sequences are not broken due to the dynamic nature of the filesystem as files are deleted, copied, and uplinked. Lastly, spacecraft filesystem tracking allows for management of sequences prior to uplink, limiting the uplink to only new sequences. The onboard filesystem model became crucial to mission success, emphasizing the importance of investing in accurate models before the need for them arises. During daily tactical operations of a spacecraft on Mars, a model is only useful if the results can be interpreted quickly. In this fast-paced environment, it is essential that command products are modeled and reviewed, errors are found and diagnosed, and new command products are redelivered, remodeled, re-reviewed in a timely manner. It is impossible to review the entire model and therefore the results of the model must be condensed and presented in a fashion that is intuitive, easy-to-navigate, complete, and trustworthy. InSight developed a number of innovative sequence review products that are designed to provide operators with the information required to quickly assess the validity of command products and diagnose potential issues. Together, these products provide a complete, yet succinct picture of the command and sequence model to the operators and facilitate a quick assessment of all sequence command products. This paper will cover planning and sequencing innovations made during InSight surface operations, and will compare the tools, processes, and results to those on other missions. Additionally, the paper will cover the flexible, yet robust nature of the planning and sequencing system architecture and how that flexibility allowed for rapid development and response to the unpredictability of Mars.

Cloutier, Kyle↗
NASA NTRS2001

Estimates of M2 Tidal Energy Dissipation from TOPEX/Poseidon Altimeter Data

Most of the tidal energy dissipation in the ocean occurs in shallow seas, as has long been recognized. However, recent work has suggested that a significant fraction of the dissipation, perhaps 1 TW or more, occurs in the deep ocean. This paper builds further evidence for that conclusion. More than 6 years of data from the TOPEX/Poseidon satellite altimeter are used to map the tidal dissipation rate throughout the world ocean. The dissipation rate is estimated as a balance between the rate of working by tidal forces and the energy flux divergence, computed using currents derived by least squares fitting of the altimeter data and the shallow water equations. Such calculations require dynamical assumptions, in particular about the nature of dissipation. To assess sensitivity of dissipation estimates to input assumptions, a large suite of tidal inversions based on a wide range of drag parameterizations and employing both real and synthetic altimeter data are compared. These experiments and Monte Carlo error fields from a generalized inverse model are used to establish error uncertainties for the dissipation estimates. Owing to the tight constraints on tidal elevation fields provided by the altimeter, area integrals of the energy balance are remarkably insensitive to required dynamical assumptions. Tidal energy dissipation is estimated for all major shallow seas (excluding individual polar seas) and compared with previous model and data-based estimates. Dissipation in the open ocean is significantly tnhanced around major bathymetric features, in a manner consistent with simple theories the generation of baroclinic tides.

Egbert, Gary D.↗
DOE OSTI2024

The Method of Finite Averages: A rigorous upscaling methodology for heterogeneous porous media

Rigorous upscaling techniques offer accurate and computationally-efficient strategies for modeling the average behaviors of multi-physical, multiscale phenomena in geological porous media. However, such techniques often rely on a variety of methodological assumptions that prohibit their rigorous application to practical systems (e.g., systems involving heterogeneous porous media, system-scale boundary conditions, and fine-scale dynamics that are not diffusion-dominant). In this work, we aim to formulate an upscaling methodology with few methodological assumptions to provide high levels of model generality and foster the utilization of rigorously-derived upscaled models in practice. In particular, we introduce the Method of Finite Averages (MoFA), a novel upscaling methodology for rigorously modeling heterogeneous porous media and system-scale boundary conditions. We then detail MoFA’s implementation for the advective–diffusive transport of a single species and compare the methodology with classic numerical techniques, as well as other rigorous upscaling techniques, to highlight MoFA’s unique combination of rigor and generality. We then validate the derived model while demonstrating its benefits in three numerical experiments. The results suggest that (1.) the applicability and a priori error guarantees of MoFA models do not directly depend on system geometry, (2.) a model’s applicability and error guarantees can be can arbitrarily expanded and reduced, respectively, with further computational expense, and (3.) downscaling with MoFA provides an efficient strategy for generating accurate pore-scale solutions from upscaled results. Ultimately, the results evidence that upscaled models can be rigorously derived for heterogeneous porous media systems and resolved in a fraction of the time it takes to perform the equivalent pore-scale simulations.

58 GEOSCIENCES↗
DOE OSTI2023

Analyzing Hardware and Software Common Cause Failures in Digital Instrumentation and Control Systems using Dual Error Propagation Method

This paper develops a methodology for quantifying software common cause failures (CCFs) in digital instrumentation and control (I&C) systems of nuclear power plants. To support the transition of analog I&C systems to digital in nuclear power plants, probabilistic risk assessment (PRA) techniques are used. The hardware components of the I&C systems have reliability databases that can be used in the PRA studies. However, the failure data for redundant software components of the systems is sparse. Failure of components constitutes a CCF, wherein two or more components or systems fail due to a single shared cause and coupling mechanism. This paper proposes a quantification approach that can simultaneously model hardware and software components, incorporate the CCFs of software systems in the models, and bridge the gap between the failure quantification of models and the development of CCF parametric databases. We demonstrate the dual error propagation method (DEPM) by developing I&C systems failure models for a representative digital reactor trip system. The DEPM models are built to simulate the control and data flows within the systems and can accommodate failure states. By expanding DEPM to software CCFs, we generated alpha factor parameter estimates for each of the modeled error propagation mechanisms.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
NASA NTRS1995

A count probability cookbok: Spurious effects and the scaling model

We study the errors brought by finite volume effects and dilution effects on the practical determination of the count probability distribution function P(sub N)(n,l), which is the probability of having N objects in a cell of volume l cubed for a set of average number density n. Dilution effects are particularly revelant to the so-called sparse sampling strategy. This work is mainly done in the framework of the Bailan & Schaeffer scaling model, which assumes that the Q-body correlation functions obey the scaling relation Xi(sub Q)(lambda r(sub l),....lambda r(sub Q) = lambda(exp -(Q-1)gamma) Xi(sub Q)(r(sub 1),....r(sub Q)). We use three synthetic samples as references to perform our analysis: a fractal generated by a Rayleigh-Levy random walk with approximately 3 x 10(exp 4) objects, a sample dominated by a spherical power-law cluster with approximately 3 x 10(exp 4) objects and a cold dark matter (CDM) universe involving approximately 3 x 10(exp 5) matter particles.

Colombi, S.↗
DOE OSTI2025

Mesh-based super-resolution of fluid flows with multiscale graph neural networks

A graph neural network (GNN) approach is introduced in this work which enables mesh-based three-dimensional super-resolution of fluid flows. In this framework, the GNN is designed to operate not on the full mesh-based field at once, but on localized meshes of elements (or cells) directly. To facilitate mesh-based GNN representations in a manner similar to spectral (or finite) element discretizations, a baseline GNN layer (termed a message passing layer, which updates local node properties) is modified to account for synchronization of coincident graph nodes, rendering compatibility with commonly used element-based mesh connectivities. Furthermore, the architecture is multiscale in nature, and is comprised of a combination of coarse-scale and fine-scale message passing layer sequences (termed processors) separated by a graph unpooling layer. The coarse-scale processor embeds a query element (alongside a set number of neighboring coarse elements) into a single latent graph representation using coarse-scale synchronized message passing over the element neighborhood, and the fine-scale processor leverages additional message passing operations on this latent graph to correct for interpolation errors. Demonstration studies are performed using hexahedral mesh-based data from Taylor–Green Vortex and backward-facing step flow simulations at Reynolds numbers of 1600 and 3200. Through analysis of both global and local errors, the results ultimately show how the GNN is able to produce accurate super-resolved fields compared to targets in both coarse-scale and multiscale model configurations. Reconstruction errors for fixed architectures were found to increase in proportion to the Reynolds number. Geometry extrapolation studies on a separate cavity flow configuration show promising cross-mesh capabilities of the super-resolution strategy.

Backward-facing step↗
NASA NTRS1983

The influence of rain and clouds on a satellite dual frequency radar altimeter system operating at 13 and 35 GHz

The effects of inhomogeneous spatial attenuation resulting from clouds and rain on the altimeter estimate of the range to mean sea level are modelled. It is demonstrated that typical cloud and rain attenuation variability at commonly expected spatial scales can significantly degrade altimeter range precision. Rain cell and cloud scale sizes and attenuations are considered as factors. The model simulation of altimeter signature distortion is described, and the distortion of individual radar pulse waveforms by different spatial scales of attenuation is considered. Examples of range errors found for models of a single cloud, a rain cell, and cloud streets are discussed.

Walsh, E. J.↗
DOE OSTI2024

Relating flow resistance to equivalent roughness

Describing flow resistance using the physical properties of an underlying surface is a recalcitrant problem in overland flow models. If discharge measurements are available, an equivalent roughness (e.g., Manning’s n) can be calibrated to represent the effects of surface properties within the domain with a single numerical value. Alternatively, the flow resistance can be estimated from discharge and velocity measured at a point, typically a runoff plot outlet. However, such experimental estimates are often inconsistent with the equivalent roughness determined from calibration to discharge, even if both derive from the same dataset. For example, if Manning’s equation is used to parameterize flow resistance, the Manning’s n obtained by calibrating a model to discharge differs from the value of n calculated from measured flow and velocity at the hillslope outlet. Here, this discrepancy is resolved by deriving a correction factor relating experimentally-determined flow resistance to the equivalent roughness. The derived correction factor is tested for four commonly-used resistance formulations using 129 rainfall simulator experiments. The correction factor is necessary to reproduce measured velocities, and yields minor improvements in discharge prediction. Plain Language Summary: Accurate runoff prediction is needed for land and water management in dryland regions, where sporadic and limited rainfall necessitate efficient water use and drought mitigation strategies. The skill of runoff models is known to be hindered by out ability to estimate flow resistance, which is the quantity that describes how energy is lost from flowing water to the underlying surface. Typically, models represent flow resistance with an equivalent roughness, e.g., Manning’s n, that is adjusted until the model can reproduce available discharge observations at watershed scale. However, the flow resistance measured in plot-scale experiments (1–10 m) often exceeds equivalent roughness coefficients by a factor of 10. This means that the direct use of plot-scale experimental data to parameterize runoff models could cause errors in discharge and runoff velocity predictions. Here, we resolve these differences by deriving an analytic correction factor that relates flow resistance to the equivalent roughness required for models to reproduce experimental velocity and discharge data. This correction factor is tested using rainfall simulator data from 129 experiments performed in the US Southwest covering a wide range of precipitation intensities, soil textures and vegetation types. Use of the correction factor substantially improves model prediction of flow velocity, which is needed for reproducing the timing of flood events and the estimation of erosion.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Microsecond Molecular Dynamics Simulations of Proteins Using a Quasi-Equilibrium Solvation Shell Model

In this work, we describe the development and implementation of a quasi-equilibrium hydration shell model of biomolecular solvation with adaptive boundaries. Applying the model to microsecond-long molecular dynamics simulations of several protein systems of varying complexity, we find that the model simulation results are of comparable quality to those obtained from simulations of fully solvated systems, but at a reduced computational cost. We discuss the dominant sources of error in the model and outline directions for future improvements.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS1989

Total dose effect on soft error rate for dynamic metal-oxide-semiconductor memory cells

A simple model for the soft error rate for dynamic metal-oxide-semiconductor random access memories due to normal galactic radiation was devised and then used to calculate the rate of decrease of the single-event-upset rate with total radiation dose. The computation shows that the decrease in the soft error rate is less than 10 percent per day if the shielding is 0.5 g/sq cm and the spacecraft is in a geosynchronous orbit. The decrease is considerably less in a polar orbiting device.

Benumof, Reuben↗
NASA NTRS2006

A Comparison of Various Stress Rupture Life Models for Orbiter Composite Pressure Vessels and Confidence Intervals

In conjunction with a recent NASA Engineering and Safety Center (NESC) investigation of flight worthiness of Kevlar Ovenvrapped Composite Pressure Vessels (COPVs) on board the Orbiter, two stress rupture life prediction models were proposed independently by Phoenix and by Glaser. In this paper, the use of these models to determine the system reliability of 24 COPVs currently in service on board the Orbiter is discussed. The models are briefly described, compared to each other, and model parameters and parameter error are also reviewed to understand confidence in reliability estimation as well as the sensitivities of these parameters in influencing overall predicted reliability levels. Differences and similarities in the various models will be compared via stress rupture reliability curves (stress ratio vs. lifetime plots). Also outlined will be the differences in the underlying model premises, and predictive outcomes. Sources of error and sensitivities in the models will be examined and discussed based on sensitivity analysis and confidence interval determination. Confidence interval results and their implications will be discussed for the models by Phoenix and Glaser.

stress ratios↗
NASA NTRS2008

Forecasting Lightning Threat using Cloud-Resolving Model Simulations

Two new approaches are proposed and developed for making time and space dependent, quantitative short-term forecasts of lightning threat, and a blend of these approaches is devised that capitalizes on the strengths of each. The new methods are distinctive in that they are based entirely on the ice-phase hydrometeor fields generated by regional cloud-resolving numerical simulations, such as those produced by the WRF model. These methods are justified by established observational evidence linking aspects of the precipitating ice hydrometeor fields to total flash rates. The methods are straightforward and easy to implement, and offer an effective near-term alternative to the incorporation of complex and costly cloud electrification schemes into numerical models. One method is based on upward fluxes of precipitating ice hydrometeors in the mixed phase region at the-15 C level, while the second method is based on the vertically integrated amounts of ice hydrometeors in each model grid column. Each method can be calibrated by comparing domain-wide statistics of the peak values of simulated flash rate proxy fields against domain-wide peak total lightning flash rate density data from observations. Tests show that the first method is able to capture much of the temporal variability of the lightning threat, while the second method does a better job of depicting the areal coverage of the threat. Our blended solution is designed to retain most of the temporal sensitivity of the first method, while adding the improved spatial coverage of the second. Exploratory tests for selected North Alabama cases show that, because WRF can distinguish the general character of most convective events, our methods show promise as a means of generating quantitatively realistic fields of lightning threat. However, because the models tend to have more difficulty in predicting the instantaneous placement of storms, forecasts of the detailed location of the lightning threat based on single simulations can be in error. Although these model shortcomings presently limit the precision of lightning threat forecasts from individual runs of current generation models,the techniques proposed herein should continue to be applicable as newer and more accurate physically-based model versions, physical parameterizations, initialization techniques and ensembles of forecasts become available.

McCaul, Eugene W., Jr.↗
DOE OSTI2023

Simulating organic aerosol in Delhi with WRF-Chem using the volatility-basis-set approach: exploring model uncertainty with a Gaussian process emulator

The nature and origin of organic aerosol in the atmosphere remain unclear. The gas–particle partitioning of semi-volatile organic compounds (SVOCs) that constitute primary organic aerosols (POAs) and the multigenerational chemical aging of SVOCs are particularly poorly understood. The volatility basis set (VBS) approach, implemented in air quality models such as WRF-Chem (Weather Research and Forecasting model with Chemistry), can be a useful tool to describe emissions of POA and its chemical evolution. However, the evaluation of model uncertainty and the optimal model parameterization may be expensive to probe using only WRF-Chem simulations. Gaussian process emulators, trained on simulations from relatively few WRF-Chem simulations, are capable of reproducing model results and estimating the sources of model uncertainty within a defined range of model parameters. In this study, a WRF-Chem VBS parameterization is proposed; we then generate a perturbed parameter ensemble of 111 model runs, perturbing 10 parameters of the WRF-Chem model relating to organic aerosol emissions and the VBS oxidation reactions. This allowed us to cover the model's uncertainty space and to compare outputs from each run to aerosol mass spectrometer observations of organic aerosol concentrations and O:C ratios measured in New Delhi, India. The simulations spanned the organic aerosol concentrations measured with the aerosol mass spectrometer (AMS). However, they also highlighted potential structural errors in the model that may be related to unsuitable diurnal cycles in the emissions and/or failure to adequately represent the dynamics of the planetary boundary layer. While the structural errors prevented us from clearly identifying an optimized VBS approach in WRF-Chem, we were able to apply the emulator in the following two periods: the full period (1–29 May) and a subperiod period of 14:00–16:00 h LT (local time) on 1–29 May. The combination of emulator analysis and model evaluation metrics allowed us to identify plausible parameter combinations for the analyzed periods. We demonstrate that the methodology presented in this study can be used to determine the model uncertainty and to identify the appropriate parameter combination for the VBS approach and hence to provide valuable information to improve our understanding of OA production.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2006

Inspection and Verification of Domain Models with PlanWorks and Aver

When developing a domain model, it seems natural to bring the traditional informal tools of inspection and verification, debuggers and automated test suites, to bear upon the problems that will inevitably arise. Debuggers that allow inspection of registers and memory and stepwise execution have been a staple of software development of all sorts from the very beginning. Automated testing has repeatedly proven its considerable worth, to the extent that an entire design philosophy (Test Driven Development) has been developed around the writing of tests. Unfortunately, while not entirely without their uses, the limitations of these tools and the nature of the complexity of models and the underlying planning systems make the diagnosis of certain classes of problems and the verification of their solutions difficult or impossible. Debuggers provide a good local view of executing code, allowing a fine-grained look at algorithms and data. This view is, however, usually only at the level of the current scope in the implementation language, and the data-inspection capabilities of most debuggers usually consist of on-line print statements. More modem graphical debuggers offer a sort of tree view of data structures, but even this is too low-level and is often inappropriate for the kinds of structures created by planning systems. For instance, god or constraint networks are at best awkward when visualized as trees. Any any non-structural link between data structures, as through a lookup table, isn't captured at all. Further, while debuggers have powerful breakpointing facilities that are suitable for finding specific algorithmic errors, they have little use in the diagnosis of modeling errors.

Bedrax-Weiss, Tania↗
NASA NTRS2021

Physics-Based SNOWPACK Model Improves Representation of Near-Surface Antarctic Snow and Firn Density

Estimates of snow and firn density are required for satellite-altimetry-based retrievals of ice sheet mass balance that rely on volume-to-mass conversions. Therefore, biases and errors in presently used density models confound assessments of ice sheet mass balance and by extension ice sheet contribution to sea level rise. Despite this importance, most contemporary firn densification models rely on simplified semi-empirical methods, which are partially reflected by significant modeled density errors when compared to observations. In this study, we present a new drifting-snow compaction scheme that we have implemented into SNOWPACK, a physics-based land surface snow model. We show that our new scheme improves existing versions of SNOWPACK by increasing simulated near-surface (defined as the top 10 m) density to be more in line with observations (near-surface bias reduction from −44.9 to −5.4 kg m−3). Furthermore, we demonstrate high-quality simulation of near-surface Antarctic snow and firn density at 122 observed density profiles across the Antarctic ice sheet, as indicated by reduced model biases throughout most of the near-surface firn column when compared to two semi-empirical firn densification models (SNOWPACK mean bias=−9.7 kg m−3, IMAU-FDM mean bias=−32.5 kg m−3, GSFC-FDM mean bias=15.5 kg m−3). Notably, our analysis is restricted to the near surface where firn density is most variable due to accumulation and compaction variability driven by synoptic weather and seasonal climate variability. Additionally, the GSFC-FDM exhibits lower mean density bias from 7–10 m (SNOWPACK bias=−22.5 kg m−3, GSFC-FDM bias=10.6 kg m−3) and throughout the entire near surface at high-accumulation sites (SNOWPACK bias=−31.4 kg m−3, GSFC-FDM bias=−4.7 kg m−3). However, we found that the performance of SNOWPACK did not degrade when applied to sites that were not included in the calibration of semi-empirical models. This suggests that SNOWPACK may possibly better represent firn properties in locations without extensive observations and under future climate scenarios, when firn properties are expected to diverge from their present state.

Eric Keenan↗