Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “MODEL VALIDATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

Multi-scale dynamic modeling and validation of radial flow fixed bed contactors for post-combustion CO 2 capture using bench scale and pilot plant data

Here, in this work, a multi-scale model of a radial flow fixed bed contactor packed with a carbon sorbent is developed and validated with laboratory-scale and pilot plant scale dynamic data. For the lab scale system, the model results were compared with low, medium and high gas and sweep flowrates, yielding root mean square error (RMSE) of 0.80, 0.63, 0.96 CO 2 mol%, respectively, for the outlet CO 2 concentration profile considering the entire A-D cycle. For the bed outer temperature profile, maximum RMSE was found to be 5.5 °C considering all flowrates and entire A-D cycles. An experimental campaign was developed and applied to a pilot plant at Technology Center Mongstad (TCM), Norway. Approaches were developed for pre-processing of data including consideration of the effect of gas mixing, measurement delay, and determination of cyclic steady-state conditions. Considering profiles during A-D cycles for all test runs, it was found that the maximum RMSE for pressure drop, temperature for the outer section of the bed, temperature for the middle section of the bed, and outlet CO 2 concentration profile remained less than 1.5 mbar, 3.5 °C, 2.8 °C, and 1.3 CO 2 mol%, respectively. The validated model was used to perform sensitivity studies on several key design operating variables for the adsorption-desorption cycle. It was found that the flow rate and concentration of flue gas have dominant nonlinear effects on the breakthrough time while the desorption time was strongly affected by the sweep gas flowrate for the specific sorbent being evaluated in this study.

20 FOSSIL-FUELED POWER PLANTS↗

Heat Transfer Modeling and Validation for Optically Thick Alumina Fibrous Insulation

Combined radiation/conduction heat transfer through unbonded alumina fibrous insulation was modeled using the diffusion approximation for modeling the radiation component of heat transfer in the optically thick insulation. The validity of the heat transfer model was investigated by comparison to previously reported experimental effective thermal conductivity data over the insulation density range of 24 to 96 kg/cu m, with a pressure range of 0.001 to 750 torr (0.1 to 101.3 x 10(exp 3) Pa), and test sample hot side temperature range of 530 to 1360 K. The model was further validated by comparison to thermal conductivity measurements using the transient step heating technique on an insulation sample at a density of 144 kg/cu m over a pressure range of 0.001 to 760 torr, and temperature range of 290 to 1090 K.

Daryabeigi, Kamran↗

Validation of an Experimentally Derived Uncertainty Model

The results show that uncertainty models can be obtained directly from system identification data by using a minimum norm model validation approach. The error between the test data and an analytical nominal model is modeled as a combination of unstructured additive and structured input multiplicative uncertainty. Robust controllers which use the experimentally derived uncertainty model show significant stability and performance improvements over controllers designed with assumed ad hoc uncertainty levels. Use of the identified uncertainty model also allowed a strong correlation between design predictions and experimental results.

Lim, K. B.↗

Business Intelligence Modeling in Launch Operations

This technology project is to advance an integrated Planning and Management Simulation Model for evaluation of risks, costs, and reliability of launch systems from Earth to Orbit for Space Exploration. The approach builds on research done in the NASA ARC/KSC developed Virtual Test Bed (VTB) to integrate architectural, operations process, and mission simulations for the purpose of evaluating enterprise level strategies to reduce cost, improve systems operability, and reduce mission risks. The objectives are to understand the interdependency of architecture and process on recurring launch cost of operations, provide management a tool for assessing systems safety and dependability versus cost, and leverage lessons learned and empirical models from Shuttle and International Space Station to validate models applied to Exploration. The systems-of-systems concept is built to balance the conflicting objectives of safety, reliability, and process strategy in order to achieve long term sustainability. A planning and analysis test bed is needed for evaluation of enterprise level options and strategies for transit and launch systems as well as surface and orbital systems. This environment can also support agency simulation .based acquisition process objectives. The technology development approach is based on the collaborative effort set forth in the VTB's integrating operations. process models, systems and environment models, and cost models as a comprehensive disciplined enterprise analysis environment. Significant emphasis is being placed on adapting root cause from existing Shuttle operations to exploration. Technical challenges include cost model validation, integration of parametric models with discrete event process and systems simulations. and large-scale simulation integration. The enterprise architecture is required for coherent integration of systems models. It will also require a plan for evolution over the life of the program. The proposed technology will produce long-term benefits in support of the NASA objectives for simulation based acquisition, will improve the ability to assess architectural options verses safety/risk for future exploration systems, and will facilitate incorporation of operability as a systems design consideration, reducing overall life cycle cost for future systems. The future of business intelligence of space exploration will focus on the intelligent system-of-systems real-time enterprise. In present business intelligence, a number of technologies that are most relevant to space exploration are experiencing the greatest change. Emerging patterns of set of processes rather than organizational units leading to end-to-end automation is becoming a major objective of enterprise information technology. The cost element is a leading factor of future exploration systems.

Bardina, Jorge E.↗

Verifying and Validating Simulation Models

This presentation is a high-level discussion of the Verification and Validation (V&V) of computational models. Definitions of V&V are given to emphasize that “validation” is never performed in a vacuum; it accounts, instead, for the current state-of-knowledge in the discipline considered. In particular comparisons between physical measurements and numerical predictions should account for their respective sources of uncertainty. The differences between error (bias), aleatoric uncertainty (randomness) and epistemic uncertainty (ignorance, lack-of- knowledge) are briefly discussed. Four types of uncertainty in physics and engineering are discussed: 1) experimental variability, 2) variability and randomness, 3) numerical uncertainty and 4) model-form uncertainty. Statistical sampling methods are available to propagate, and analyze, variability and randomness. Numerical uncertainty originates from the truncation error introduced by the discretization of partial differential equations in time and space. Model-form uncertainty is introduced by assumptions often formulated to render a complex problem more tractable and amenable to modeling and simulation. The discussion concludes with high-level guidance to assess the “credibility” of numerical simulations, which stems from the level of rigor with which these various sources of uncertainty are assessed and quantified.

Mathematics & Computing(97)↗

Model Verification and Validation Concepts for a Probabilistic Fracture Assessment Model to Predict Cracking of Knife Edge Seals in the Space Shuttle Main Engine High Pressure Oxidizer

Physics-based models are routinely used to predict the performance of engineered systems to make decisions such as when to retire system components, how to extend the life of an aging system, or if a new design will be safe or available. Model verification and validation (V&V) is a process to establish credibility in model predictions. Ideally, carefully controlled validation experiments will be designed and performed to validate models or submodels. In reality, time and cost constraints limit experiments and even model development. This paper describes elements of model V&V during the development and application of a probabilistic fracture assessment model to predict cracking in space shuttle main engine high-pressure oxidizer turbopump knife-edge seals. The objective of this effort was to assess the probability of initiating and growing a crack to a specified failure length in specific flight units for different usage and inspection scenarios. The probabilistic fracture assessment model developed in this investigation combined a series of submodels describing the usage, temperature history, flutter tendencies, tooth stresses and numbers of cycles, fatigue cracking, nondestructive inspection, and finally the probability of failure. The analysis accounted for unit-to-unit variations in temperature, flutter limit state, flutter stress magnitude, and fatigue life properties. The investigation focused on the calculation of relative risk rather than absolute risk between the usage scenarios. Verification predictions were first performed for three units with known usage and cracking histories to establish credibility in the model predictions. Then, numerous predictions were performed for an assortment of operating units that had flown recently or that were projected for future flights. Calculations were performed using two NASA-developed software tools: NESSUS(Registered Trademark) for the probabilistic analysis, and NASGRO(Registered Trademark) for the fracture mechanics analysis. The goal of these predictions was to provide additional information to guide decisions on the potential of reusing existing and installed units prior to the new design certification.

Pai, Shantaram S.↗

Validating Irradiance Models for High-Latitude Vertical Bifacial Photovoltaic Systems

Bifacial photovoltaic systems oriented vertically facing east-west are an emerging design, targeting production in morning and afternoon hours and providing competitive annual energy yield to traditional south-tilted modules for high latitude locations. The accuracy of existing bifacial PV models when modules are oriented vertically has yet to be examined in detail. Here, we compare four bifacial PV irradiance models in ~150 locations between 15-80 degrees N on the utility-scale, finding higher inter-model deviations for vertical PV systems than south-tilted across all latitudes less than 75 degrees N. We validate model-predicted irradiance with test-site data collected in Golden, Colorado and Fairbanks, Alaska for E-W vertical and south-tilted arrays. View factor models agree with E-W vertical test-site data in Golden with RMSE=15%. Modelling error increases for the Alaskan test-site to RMSE values between 21-30%, driven in part by high albedo measurement uncertainty during snowy months.

bifacial↗

A GPU based high-resolution multilevel biomechanical head and neck model for validating deformable image registration

Purpose: Validating the usage of deformable image registration (DIR) for daily patient positioning is critical for adaptive radiotherapy (RT) applications pertaining to head and neck (HN) radiotherapy. The authors present a methodology for generating biomechanically realistic ground-truth data for validating DIR algorithms for HN anatomy by (a) developing a high-resolution deformable biomechanical HN model from a planning CT, (b) simulating deformations for a range of interfraction posture changes and physiological regression, and (c) generating subsequent CT images representing the deformed anatomy. Methods: The biomechanical model was developed using HN kVCT datasets and the corresponding structure contours. The voxels inside a given 3D contour boundary were clustered using a graphics processing unit (GPU) based algorithm that accounted for inconsistencies and gaps in the boundary to form a volumetric structure. While the bony anatomy was modeled as rigid body, the muscle and soft tissue structures were modeled as mass–spring-damper models with elastic material properties that corresponded to the underlying contoured anatomies. Within a given muscle structure, the voxels were classified using a uniform grid and a normalized mass was assigned to each voxel based on its Hounsfield number. The soft tissue deformation for a given skeletal actuation was performed using an implicit Euler integration with each iteration split into two substeps: one for the muscle structures and the other for the remaining soft tissues. Posture changes were simulated by articulating the skeletal structure and enabling the soft structures to deform accordingly. Physiological changes representing tumor regression were simulated by reducing the target volume and enabling the surrounding soft structures to deform accordingly. Finally, the authors also discuss a new approach to generate kVCT images representing the deformed anatomy that accounts for gaps and antialiasing artifacts that may be caused by the biomechanical deformation process. Accuracy and stability of the model response were validated using ground-truth simulations representing soft tissue behavior under local and global deformations. Numerical accuracy of the HN deformations was analyzed by applying nonrigid skeletal transformations acquired from interfraction kVCT images to the model’s skeletal structures and comparing the subsequent soft tissue deformations of the model with the clinical anatomy. Results: The GPU based framework enabled the model deformation to be performed at 60 frames/s, facilitating simulations of posture changes and physiological regressions at interactive speeds. The soft tissue response was accurate with a R{sup 2} value of >0.98 when compared to ground-truth global and local force deformation analysis. The deformation of the HN anatomy by the model agreed with the clinically observed deformations with an average correlation coefficient of 0.956. For a clinically relevant range of posture and physiological changes, the model deformations stabilized with an uncertainty of less than 0.01 mm. Conclusions: Documenting dose delivery for HN radiotherapy is essential accounting for posture and physiological changes. The biomechanical model discussed in this paper was able to deform in real-time, allowing interactive simulations and visualization of such changes. The model would allow patient specific validations of the DIR method and has the potential to be a significant aid in adaptive radiotherapy techniques.

60 APPLIED LIFE SCIENCES↗

Model Evaluation Report for LNG Dispersion on Fire Dynamics Simulator Version 6.5.3

This report is an assessment of the computational fluid dynamics (CFD) code Fire Dynamics Simulator (FDS), version 6.5.3, using the Model Evaluation Protocol (MEP) for Liquefied Natural Gas (LNG). The MEP consists of model validation and a scientific assessment that encompasses model information and model verification activities. Model validation entails comparison against various field and wind-tunnel trials for LNG and other dense gases with and without obstructions. The results indicate that FDS is generally over-predictive for most of the field scale dense gas releases and cases involving obstructions without requiring a safety factor of 2, however, since there are uncertainties in extrapolating to accident scales a safety factor of 2 (1/2 LFL criteria) may be appropriate. The results of this scientific assessment and prior verification efforts demonstrate the soundness of the numerical techniques and robustness of FDS. The validation results indicate that FDS is suitable for modeling dense gas dispersion with and without obstructions.

03 NATURAL GAS↗

CFD Validation Study of a Hypersonic Cone-Slice-Flap Configuration

Model validation is the process of determining the degree of accuracy between the real world and the model. The result of model validation can either be used to improve the model through calibration or quantify the model-form uncertainty. This work focuses on providing the model-form uncertainty through an area metric for a hypersonic cone-slice-flap geometry configuration given uncertainty in both the simulation and experimental data. A procedure will be presented that can give an accurate representation of the model-form uncertainty using a small number of high-fidelity runs. The work will also assess the impact between using different high-fidelity solvers and different turbulence models.The goal of performing this comparison is to provide a quantifiable measurement for the accuracy of each solver and turbulence model for this type of design. A low-fidelity analysis will also be performed to get a model-form uncertainty for the lower fidelity analysis. The two high-fidelty CFD solvers used are VULCAN-CFD and FUN3D and the low-fidelity results will come from Cart3D. The experimental data came from the 20-inch Mach 6Tunnel located at NASA Langley Research Center.

Laura M. White↗

CFD Validation Study of a Hypersonic Cone-Slice-Flap Configuration

Model validation is the process of determining the degree of accuracy between the real world and the model. The result of model validation can be used to either improve the model through calibration or quantify the model-form uncertainty. This work focuses on estimating the model-form uncertainty through an area metric for a hypersonic cone-slice-flap geometry configuration given the uncertainty in both the simulation and experimental data. A procedure that can give an accurate representation of the model-form uncertainty using a small number of high-fidelity runs is outlined. The work also assesses the impact of using different high-fidelity solvers and different turbulence models. The goal of performing this comparison is to provide a quantifiable measurement of the accuracy of each solver and turbulence model for this type of design. A low-fidelity analysis is also performed to get a model-form uncertainty for this type of analysis. The two high-fidelity CFD solvers used here are VULCAN-CFD and FUN3D, and the low-fidelity results comes from Cart3D.The experimental data comes from the 20-inch Mach 6 Tunnel located at NASA Langley Research Center. The work here shows that the models used tend to under-predict the drag and moment aerodynamic coefficients for this type of design leading to a model-form uncertainty estimate which can account for up to an 86% of the total uncertainty in the model predictions.

Laura M White↗

CFD validation for aerodynamic flows - Challenge for the '90's

The process of computational fluid dynamics (CFD) validation is described from two perspectives, numerical error validation and physical model validation. Errors associated with time and space discretization, grid refinement, numerical dissipation, and level of solution convergence, are all possible sources of numerical error. The second aspect of CFD code validation is associated with the governing equations and the physical models, e.g., chemistry and turbulence models. This type of validation requires comparisons with carefully conducted experiments and is the primary aspect of the validation process discussed in this paper. Examples of validation are shown for selected Reynolds-averaged Navier-Stokes codes for conditions from transonic through hypersonic. Since code applications are becoming more complex, it no longer suffices to use data from surface or integral quantities alone to provide the required validation. Flow field surveys and experimental boundary condition measurements are emerging as critical data that must be obtained for CFD code validation. Progress in the overall level of validation is shown to be improving. However, future challenges remain, some of which are enumerated.

Marvin, Joseph G.↗

Software Validation via Model Animation

This paper explores a new approach to validating software implementations that have been produced from formally-verified algorithms. Although visual inspection gives some confidence that the implementations faithfully reflect the formal models, it does not provide complete assurance that the software is correct. The proposed approach, which is based on animation of formal specifications, compares the outputs computed by the software implementations on a given suite of input values to the outputs computed by the formal models on the same inputs, and determines if they are equal up to a given tolerance. The approach is illustrated on a prototype air traffic management system that computes simple kinematic trajectories for aircraft. Proofs for the mathematical models of the system's algorithms are carried out in the Prototype Verification System (PVS). The animation tool PVSio is used to evaluate the formal models on a set of randomly generated test cases. Output values computed by PVSio are compared against output values computed by the actual software. This comparison improves the assurance that the translation from formal models to code is faithful and that, for example, floating point errors do not greatly affect correctness and safety properties.

Dutle, Aaron M.↗

Lightweight ZERODUR: Validation of Mirror Performance and Mirror Modeling Predictions

Upcoming spaceborne missions, both moderate and large in scale, require extreme dimensional stability while relying both upon established lightweight mirror materials, and also upon accurate modeling methods to predict performance under varying boundary conditions. We describe tests, recently performed at NASA's XRCF chambers and laboratories in Huntsville Alabama, during which a 1.2 m diameter, f/1.2988% lightweighted SCHOTT lightweighted ZERODUR(TradeMark) mirror was tested for thermal stability under static loads in steps down to 230K. Test results are compared to model predictions, based upon recently published data on ZERODUR(TradeMark). In addition to monitoring the mirror surface for thermal perturbations in XRCF Thermal Vacuum tests, static load gravity deformations have been measured and compared to model predictions. Also the Modal Response(dynamic disturbance) was measured and compared to model. We will discuss the fabrication approach and optomechanical design of the ZERODUR(TradeMark) mirror substrate by SCHOTT, its optical preparation for test by Arizona Optical Systems (AOS). Summarize the outcome of NASA's XRCF tests and model validations

technology↗

Magnetic Shield Design Modeling and Validation for SWOT Spacecraft Ka-Band Extended Interaction Klystron

Two Extended Interaction Klystrons (EIKs) containing strong permanent magnets were modeled magnetically in a representative spacecraft geometry using commercial finite element modeling techniques and were validated against measurements made at varying distances. Initial modeling results for the 63 A-m2 (amperes per square meter) dipole moment magnets showed that magnetic shields would be necessary in order to meet magnetic field requirements for the Surface Water and Ocean Topography (SWOT) spacecraft, which contains components that are susceptible to external DC (Direct Current) magnetic fields. JPL (Jet Propulsion Laboratory) and the EIK vendor proposed cold rolled steel and mu-metal as potential shield materials along with proposed thicknesses of 0.5 millimeters and 1.5 millimeters. Magnetic shields made from each of these materials were designed and modeled in software, taking high-field saturation into account. Prototype magnetic shields with these parameters were then built, measured with an existing EIK, and compared against modeling results. For single-axis field measurements along the dipole axis, modeling results were within 7 gauss of the measured values at 10 centimeters from the magnet, and converged to less than 1.5 gauss at distances greater than 14 centimeters from the magnet. Three-axis field measurements at locations of interest showed that model correlation improved to within 4 gauss at 11 centimeters and 2 gauss for distances ranging between 15 centimeters and 36 centimeters.

Gonzales, Edward↗

Magnetic Shield Design Modeling and Validation for SWOT Spacecraft Ka-Band Extended Interaction Klystron

Two Extended Interaction Klystrons (EIKs) containing strong permanent magnets were modeled magnetically in a representative spacecraft geometry using commercial finite element modeling techniques and were validated against measurements made at varying distances. Initial modeling results for the 63 A-m2 dipole moment magnets showed that magnetic shields would be necessary in order to meet magnetic field requirements for the Surface Water and Ocean Topography (SWOT) spacecraft, which contains components that are susceptible to external DC magnetic fields. JPL and the EIK vendor proposed cold rolled steel and mu-metal as potential shield materials along with proposed thicknesses of 0.5 mm and 1.5 mm. Magnetic shields made from each of these materials were designed and modeled in software, taking highfield saturation into account. Prototype magnetic shields with these parameters were then built, measured with an existing EIK, and compared against modeling results. For single-axis field measurements along the dipole axis, modeling results were within 7 gauss of the measured values at 10 cm from the magnet, and converged to less than 1.5 gauss at distances greater than 14 cm from the magnet. Three-axis field measurements at locations of interest showed that model correlation improved to within 4 gauss at 11 cm and 2 gauss for distances ranging between 15 cm and 36 cm.

Gonzales, Edward↗

Turbulence Measurements on a Wing-Fuselage Junction Model for CFD Validation

Current turbulence models, such as those employed in Reynolds-averaged Navier-Stokes CFD, are unable to reliably predict the onset and extent of the three-dimensional separated flow that typically occurs in wing fuselage junctions. To critically assess, as well as to improve upon, existing turbulence models, experimental validation-quality flow field data in the junction region is needed. To that end, NASA has developed a CFD validation experiment for a generic full-span wing-fuselage junction model at subsonic conditions. In this paper, we present and discuss sample results from this effort, with a focus on turbulence measurements in the separated corner flow of the wing-fuselage junction that were obtained with an internally mounted laser Doppler velocimetry (LDV) system. In addition, sample comparisons between the flow field measurements and representative CFD of our test case are presented and here, we highlight some of the key discrepancies.

Kegerise, Michael↗

Predictive LES Modeling and Validation of High-Pressure Turbulent Flames and Flashback in Hydrogen-enriched Gas Turbines

The overall objective of this project is to make advances in large-eddy simulation modeling of swirl-flame flashback at elevated pressure, where the reactants can be premixed or stratified, and composed of methane enriched with hydrogen. The modeling effort was conducted with a companion experimental validation effort that focused on high-speed measurements of flashback in a model swirl-flame combustor. The modeling effort focused on the development of manifold-based combustion model for flashback simulations. The main complexity in this configuration comes from the flames’ propagation through a stratified fuel-air mixture along with heat loss near the walls. For this purpose, a non-adiabatic flamelet model was developed and tested using canonical flow configurations. Further, extensive validation in premixed configurations is used to establish the model’s accuracy in capturing heat loss and flame propagation. Finally, the model was tested using the UT flame flashback experiment, and was shown to accurately capture the flame flashback process. The end products from this work are a) a full validated flameout-based approach for modeling flame flashback; b) a complete implementation of the model in the open source OpenFOAM framework, which has been made available to both industry and academia; c) an extensive suite of validation studies performed using the OpenFOAM solver. In addition, new techniques for flame modeling, subfilter modeling of scalars, and simulation of low Mach number flows were developed and tested. In the experimental validation effort, flashback was studied in a premixed and stratified swirl flame by using high-speed imaging diagnostics. Fuels tested included CH 4 enriched with H 2 , with H 2 enrichment up to 84% by volume. These flashback experiments are conducted at pressures ranging from 1 to 5 atm. A swirler-based fuel-injection system was used to create the fuel-air stratification in the radial direction. For the high-pressure measurements, an optically accessible elevated pressure chamber was used. The spatial distribution of the equivalence ratio under non-reacting conditions was characterized using planar laser-induced fluorescence with acetone as the fuel tracer. It was observed that fuel-air pockets were distributed across the mixing tube width, although in an average sense, the fuel-air mixture was radially stratified. The global behavior of upstream flame propagation was investigated for different levels of hydrogen-enrichment. For stratified hydrogen-rich flashback, the propagation path of the flame changed from the inner wall to outer wall, which was induced by the faster chemistry of stoichiometric mixtures that are frequently present near the outer wall. This behavior of hydrogen-rich flashback persists even at elevated pressures up to 5 atm, although the propagation of the flame occurs as a wide flame tongue as opposed to the acute-tipped flame structures present in the atmospheric cases. The end product of the experimental effort is greatly improved knowledge of flashback physics and a unique database that can be used for model validation.

08 HYDROGEN↗