Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Validation Studies”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Intent inferencing by an intelligent operator's associate - A validation study

In the supervisory control of a complex, dynamic system, one potential form of aiding for the human operator is a computer-based operator's associate. The design philosophy of the operator's associate is that of 'amplifying' rather than automating human skills. In particular, the associate possesses understanding and control properties. Understanding allows it to infer operator intentions and thus form the basis for context-dependent advice and reminders; control properties allow the human operator to dynamically delegate individual tasks or subfunctions to the associate. This paper focuses on the design, implementation, and validation of the intent inferencing function. Two validation studies are described which empirically demonstrate the viability of the proposed approach to intent inferencing.

Jones, Patricia M.↗

The Fast Scattering Code (FSC): Validation Studies and Program Guidelines

The Fast Scattering Code (FSC) is a frequency domain noise prediction program developed at the NASA Langley Research Center (LaRC) to simulate the acoustic field produced by the interaction of known, time harmonic incident sound with bodies of arbitrary shape and surface impedance immersed in a potential flow. The code uses the equivalent source method (ESM) to solve an exterior 3-D Helmholtz boundary value problem (BVP) by expanding the scattered acoustic pressure field into a series of point sources distributed on a fictitious surface placed inside the actual scatterer. This work provides additional code validation studies and illustrates the range of code parameters that produce accurate results with minimal computational costs. Systematic noise prediction studies are presented in which monopole generated incident sound is scattered by simple geometric shapes - spheres (acoustically hard and soft surfaces), oblate spheroids, flat disk, and flat plates with various edge topologies. Comparisons between FSC simulations and analytical results and experimental data are presented.

Tinetti, Ana F.↗

The 2006 Kennedy Space Center Range Reference Atmosphere Model Validation Study and Sensitivity Analysis to the Performance of the National Aeronautics and Space Administration's Space Shuttle Vehicle

The Kennedy Space Center (KSC) Range Reference Atmosphere (RRA) is a statistical model that summarizes wind and thermodynamic atmospheric variability from surface to 70 km. The National Aeronautics and Space Administration's (NASA) Space Shuttle program, which launches from KSC, utilizes the KSC RRA data to evaluate environmental constraints on various aspects of the vehicle during ascent. An update to the KSC RRA was recently completed. As part of the update, the Natural Environments Branch at NASA's Marshall Space Flight Center (MSFC) conducted a validation study and a comparison analysis to the existing KSC RRA database version 1983. Assessments to the Space Shuttle vehicle ascent profile characteristics were performed by JSC/Ascent Flight Design Division to determine impacts of the updated model to the vehicle performance. Details on the model updates and the vehicle sensitivity analyses with the update model are presented.

Burns, Lee↗

Physics validation studies for muon collider detector background simulations

Within the broad discipline of physics, the study of the fundamental forces of nature and the most basic constituents of the universe belongs to the field of particle physics. While frequently referred to as 'high-energy physics,' or by the acronym 'HEP,' particle physics is not driven just by the quest for ever-greater energies in particle accelerators. Rather, particle physics is seen as having three distinct areas of focus: the cosmic, intensity, and energy frontiers. These three frontiers all provide different, but complementary, views of the basic building blocks of the universe. Currently, the energy frontier is the realm of hadron colliders like the Tevatron at Fermi National Accelerator Laboratory (Fermilab) or the Large Hadron Collider (LHC) at CERN. While the LHC is expected to be adequate for explorations up to 14 TeV for the next decade, the long development lead time for modern colliders necessitates research and development efforts in the present for the next generation of colliders. This paper focuses on one such next-generation machine: a muon collider. Specifically, this paper focuses on Monte Carlo simulations of beam-induced backgrounds vis-a-vis detector region contamination. Initial validation studies of a few muon collider physics background processes using G4beamline have been undertaken and results presented. While these investigations have revealed a number of hurdles to getting G4beamline up to the level of more established simulation suites, such as MARS, the close communication between us, as users, and the G4beamline developer, Tom Roberts, has allowed for rapid implementation of user-desired features. The main example of user-desired feature implementation, as it applies to this project, is Bethe-Heitler muon production. Regarding the neutron interaction issues, we continue to study the specifics of how GEANT4 implements nuclear interactions. The GEANT4 collaboration has been contacted regarding the minor discrepancies in the neutron interaction cross sections for boron. While corrections to the data files themselves are simple to implement and distribute, it is quite possible, however, that coding changes may be required in G4beamline or even in GEANT4 to fully correct nuclear interactions. Regardless, these studies are ongoing and future results will be reflected in updated releases of G4beamline.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Image analysis algorithms for estimating porous media multiphase flow variables from computed microtomography data: a validation study

Image analysis of three-dimensional microtomographic image data has become an integral component of pore scale investigations of multiphase flow through porous media. This study focuses on the validation of image analysis algorithms for identifying phases and estimating porosity, saturation, solid surface area, and interfacial area between fluid phases from gray-scale X-ray microtomographic image data. The data used in this study consisted of (1) a two-phase high precision bead pack from which porosity and solid surface area estimates were obtained and (2) three-phase cylindrical capillary tubes of three different radii, each containing an air-water interface, from which interfacial area was estimated. The image analysis algorithm employed here combines an anisotropic diffusion filter to remove noise from the original gray-scale image data, a k-means cluster analysis to obtain segmented data, and the construction of isosurfaces to estimate solid surface area and interfacial area. Our method was compared with laboratory measurements, as well as estimates obtained from a number of other image analysis algorithms presented in the literature. Porosity estimates for the two-phase bead pack were within 1.5% error of laboratory measurements and agreed well with estimates obtained using an indicator kriging segmentation algorithm. Additionally, our method estimated the solid surface area of the high precision beads within 10% of the laboratory measurements, whereas solid surface area estimates obtained from voxel counting and two-point correlation functions overestimated the surface area by 20--40%. Interfacial area estimates for the air-water menisci contained within the capillary tubes were obtained using our image analysis algorithm, and using other image analysis algorithms, including voxel counting, two-point correlation functions, and the porous media marching cubes. Our image analysis algorithm, and other algorithms based on marching cubes, resulted in errors ranging from 1% to 20% of the analytical interfacial area estimates, whereas voxel counting and two-point correlation functions overestimated the analytical interfacial area by 20--40%. In addition, the sensitivity of the image analysis algorithms on the resolution of the microtomographic image data was investigated, and the results indicated that there was little or no improvement in the comparison with laboratory estimates for the resolutions and conditions tested.

58 GEOSCIENCES↗

Aircraft Wake Vortex Spacing System (AVOSS) Performance Update and Validation Study

An analysis has been performed on data generated from the two most recent field deployments of the Aircraft Wake VOrtex Spacing System (AVOSS). The AVOSS provides reduced aircraft spacing criteria for wake vortex avoidance as compared to the FAA spacing applied under Instrument Flight Rules (IFR). Several field deployments culminating in a system demonstration at Dallas Fort Worth (DFW) International Airport in the summer of 2000 were successful in showing a sound operational concept and the system's potential to provide a significant benefit to airport operations. For DFW, a predicted average throughput increase of 6% was observed. This increase implies 6 or 7 more aircraft on the ground in a one-hour period for DFW operations. Several studies of performance correlations to system configuration options, design options, and system inputs are also reported. The studies focus on the validation performance of the system.

Rutishauser, David K.↗

Expert system verification and validation study

Five workshops on verification and validation (V&V) of expert systems (ES) where taught during this recent period of performance. Two key activities, previously performed under this contract, supported these recent workshops (1) Survey of state-of-the-practice of V&V of ES and (2) Development of workshop material and first class. The first activity involved performing an extensive survey of ES developers in order to answer several questions regarding the state-of-the-practice in V&V of ES. These questions related to the amount and type of V&V done and the successfulness of this V&V. The next key activity involved developing an intensive hands-on workshop in V&V of ES. This activity involved surveying a large number of V&V techniques, conventional as well as ES specific ones. In addition to explaining the techniques, we showed how each technique could be applied on a sample problem. References were included in the workshop material, and cross referenced to techniques, so that students would know where to go to find additional information about each technique. In addition to teaching specific techniques, we included an extensive amount of material on V&V concepts and how to develop a V&V plan for an ES project. We felt this material was necessary so that developers would be prepared to develop an orderly and structured approach to V&V. That is, they would have a process that supported the use of the specific techniques. Finally, to provide hands-on experience, we developed a set of case study exercises. These exercises were to provide an opportunity for the students to apply all the material (concepts, techniques, and planning material) to a realistic problem.

French, Scott W.↗

304L Can Crush Validation Studies

Accurate prediction of ductile behavior of structural alloys up to and including failure is essential in component or system failure assessment, which is necessary for nuclear weapons alteration and life extensions programs of Sandia National Laboratories. Modeling such behavior requires computational capabilities to robustly capture strong nonlinearities (geometric and material), rate- dependent and temperature-dependent properties, and ductile failure mechanisms. This study's objective is to validate numerical simulations of a high-deformation crush of a stainless steel can. The process consists of identifying a suitable can geometry and loading conditions, conducting the laboratory testing, developing a high-quality Sierra/SM simulation, and then drawing comparisons between model and measurement to assess the fitness of the simulation in regards to material model (plasticity), finite element model construction, and failure model. Following previous material model calibration, a J 2 plasticity model with a microstructural BCJ failure model is employed to model the test specimen made of 304L stainless steel. Simulated results are verified and validated through mesh and mass-scaling convergence studies, parameter sensitivity studies, and a comparison to experimental data. The converged mesh and degree of mass-scaling are the mesh discretization with 140,372 elements, and a mass scaling with a target time increment of 1.0e-6 seconds and time step scale factor of 0.5, respectively. Results from the coupled thermal-mechanical explicit dynamic analysis are comparable to the experimental data. Simulated global force vs displacement (F/D) response predicts key points such as yield, ultimate, and kinks of the experimental F/D response. Furthermore, the final deformed shape of the can and field data predicted from the analysis are similar to that of the deformed can, as measured by 3D optical CMM scans and DIC data from the experiment.

36 MATERIALS SCIENCE↗

Assessment of Multi‐Ion Channel Block in a Phase I Randomized Study Design: Results of the Ci PA Phase I ECG Biomarker Validation Study

Balanced multi‐ion channel‐blocking drugs have low torsade risk because they block inward currents. The Comprehensive In Vitro Proarrhythmia Assay (Ci PA ) initiative proposes to use an in silico cardiomyocyte model to determine the presence of balanced block, and absence of heart rate corrected J‐T peak (J‐T peak c) prolongation would be expected for balanced blockers. This study included three balanced blockers in a 10‐subject‐per‐drug parallel design; lopinavir/ritonavir and verapamil met the primary end point of ΔΔJ‐T peak c upper bound < 10 ms, whereas ranolazine did not (upper bounds of 8.8, 6.1, and 12.0 ms, respectively). Chloroquine, a predominant blocker of the potassium channel encoded by the ether‐à‐go‐go related gene (hERG), prolonged ΔΔ QT c and ΔΔJ‐T peak c by ≥ 10 ms. In a separate crossover design, diltiazem (calcium block) did not shorten dofetilide‐induced Δ QT c prolongation, but shortened ΔJ‐T peak c and prolonged ΔT peak ‐T end . Absence of J‐T peak c prolongation seems consistent with balanced block; however, small sample size (10 subjects) may be insufficient to characterize concentration‐response in some cases.

59 BASIC BIOLOGICAL SCIENCES↗

Verification and Validation Studies for the LAVA CFD Solver

The verification and validation of the Launch Ascent and Vehicle Aerodynamics (LAVA) computational fluid dynamics (CFD) solver is presented. A modern strategy for verification and validation is described incorporating verification tests, validation benchmarks, continuous integration and version control methods for automated testing in a collaborative development environment. The purpose of the approach is to integrate the verification and validation process into the development of the solver and improve productivity. This paper uses the Method of Manufactured Solutions (MMS) for the verification of 2D Euler equations, 3D Navier-Stokes equations as well as turbulence models. A method for systematic refinement of unstructured grids is also presented. Verification using inviscid vortex propagation and flow over a flat plate is highlighted. Simulation results using laminar and turbulent flow past a NACA 0012 airfoil and ONERA M6 wing are validated against experimental and numerical data.

Validation↗

CTF Void Drift Validation Study

This milestone report is a summary of work performed in support of expansion of the validation and verification (V&V) matrix for the thermal-hydraulic subchannel code, CTF. The focus of this study is on validating the void drift modeling capabilities of CTF and verifying the supporting models that impact the void drift phenomenon. CTF uses a simple turbulent-diffusion approximation to model lateral cross-flow due to turbulent mixing and void drift. The void drift component of the model is based on the Lahey and Moody model. The models are a function of two-phase mass, momentum, and energy distribution in the system; therefore, it is necessary to correctly model the ow distribution in rod bundle geometry as a first step to correctly calculating the void distribution due to void drift.

97 MATHEMATICS AND COMPUTING↗

Extraction of tumor motion trajectories using PICCS-4DCBCT: A validation study

Purpose: As a counterpart of 4DCT in the treatment planning stage of radiotherapy treatment, 4D cone beam computed tomography (4DCBCT) method has been proposed to verify tumor motion trajectories before radiation therapy treatment delivery. Besides 4DCBCT acquisition using slower gantry rotation speed or multiple rotations, a new method using the prior image constrained compressed sensing (PICCS) image reconstruction method and the standard 1-min data acquisition were proposed. In this paper, the PICCS-4DCBCT method was combined with deformable registration to validate its capability in motion trajectory extraction using physical phantom data, simulated human subject data from 4DCT and in vivo human subject data. Methods: Two methods were used to validate PICCS-4DCBCT for the purpose of respiratory motion delineation. The standard 1-min gantry rotation Cone Beam CT acquisition was used for both methods. In the first method, 4DCBCT projection data of a physical motion phantom were acquired using an on-board CBCT acquisition system (Varian Medical Systems, Palo Alto, CA). Using a deformable registration method, the object motion trajectories were extracted from both FBP and PICCS reconstructed 4DCBCT images, and compared against the programmed motion trajectories. In the second method, using a clinical 4DCT dataset, Cone Beam CT projections were simulated by forward projection. Using a deformable registration method, the tumor motion trajectories were extracted from the reconstructed 4DCT and PICCS-4DCBCT images. The performance of PICCS-4DCBCT is assessed against the 4DCT ground truth. The breathing period was varied in the simulation to study its effect on motion extraction. For both validation methods, the root mean square error (RMSE) and the maximum of the errors (MaxE) were used to quantify the accuracy of the extracted motion trajectories. After the validation, a clinical dataset was used to demonstrate the motion delineation capability of PICCS-4DCBCT for human subjects. Results: In both validation studies, the RMSEs of the extracted motion trajectories from PICCS-4DCBCT images are less than 0.7 mm, and their MaxEs are less than 1 mm, for all three directions. In comparison, FBP-4DCBCT shows considerably larger RMSEs in the physical phantom based validation. PICCS-4DCBCT also shows insensitivity to the breathing period in the 4DCT based validation. For the in vivo human subject study, high quality 3D motion trajectory of the tumor was obtained from PICCS-4DCBCT images and showed consistency with visual observation. Conclusions: These results demonstrate accurate delineation of tumor motion trajectory can be achieved using PICCS-4DCBCT and the standard 1-min data acquisition.

61 RADIATION PROTECTION AND DOSIMETRY↗

Californium-252 production at the High Flux Isotope Reactor - I: Validation study using campaign data

This paper presents a series of 252 Cf production validation and code-to-code comparison studies performed based on data from the production campaigns at the High Flux Isotope Reactor (HFIR). These studies support efforts to convert HFIR from using highly enriched uranium (HEU) fuel to low-enriched uranium (LEU) fuel. HFIR must maintain its world-class performance and missions following this conversion, and because 252 Cf is a vital neutron-emitting radioisotope used for a variety of high-impact applications (e.g., reactor startup, cancer treatment), the ability to efficiently produce 252 Cf must be preserved. In this work, the HFIRCON, Shift, ORIGEN, and TCOMP codes were deployed, and several sets of data libraries were investigated to better understand the calculation codes and the data biases. As-loaded target composition data, as-run irradiation history data, and post-irradiation measurements from recent multi-cycle irradiation campaigns of the HEU core were used to validate and determine methodology biases. Further, the findings demonstrated a good agreement, with results falling within 3 standard deviations of measurements. This paper lays the ground work for the second paper, which evaluates and compares 252 Cf production and safety metrics with the HEU core and a proposed LEU core.

07 ISOTOPE AND RADIATION SOURCES↗

Hyper-X Stage Separation Trajectory Validation Studies

An independent twelve degree-of-freedom simulation of the X-43A separation trajectory was created with the Program to Optimize Simulated trajectories (POST II). This simulation modeled the multi-body dynamics of the X-43A and its booster and included the effect of two pyrotechnically actuated pistons used to push the vehicles apart as well as aerodynamic interaction forces and moments between the two vehicles. The simulation was developed to validate trajectory studies conducted with a 14 degree-of-freedom simulation created early in the program using the Automatic Dynamic Analysis of Mechanics Systems (ADAMS) simulation software. The POST simulation was less detailed than the official ADAMS-based simulation used by the Project, but was simpler, more concise and ran faster, while providing similar results. The increase in speed provided by the POST simulation provided the Project with an alternate analysis tool. This tool was ideal for performing separation control logic trade studies that required the running of numerous Monte Carlo trajectories.

Tartabini, Paul V.↗

CFD Validation Study of a Hypersonic Cone-Slice-Flap Configuration

Model validation is the process of determining the degree of accuracy between the real world and the model. The result of model validation can either be used to improve the model through calibration or quantify the model-form uncertainty. This work focuses on providing the model-form uncertainty through an area metric for a hypersonic cone-slice-flap geometry configuration given uncertainty in both the simulation and experimental data. A procedure will be presented that can give an accurate representation of the model-form uncertainty using a small number of high-fidelity runs. The work will also assess the impact between using different high-fidelity solvers and different turbulence models.The goal of performing this comparison is to provide a quantifiable measurement for the accuracy of each solver and turbulence model for this type of design. A low-fidelity analysis will also be performed to get a model-form uncertainty for the lower fidelity analysis. The two high-fidelty CFD solvers used are VULCAN-CFD and FUN3D and the low-fidelity results will come from Cart3D. The experimental data came from the 20-inch Mach 6Tunnel located at NASA Langley Research Center.

Laura M. White↗

CFD Validation Study of a Hypersonic Cone-Slice-Flap Configuration

Model validation is the process of determining the degree of accuracy between the real world and the model. The result of model validation can be used to either improve the model through calibration or quantify the model-form uncertainty. This work focuses on estimating the model-form uncertainty through an area metric for a hypersonic cone-slice-flap geometry configuration given the uncertainty in both the simulation and experimental data. A procedure that can give an accurate representation of the model-form uncertainty using a small number of high-fidelity runs is outlined. The work also assesses the impact of using different high-fidelity solvers and different turbulence models. The goal of performing this comparison is to provide a quantifiable measurement of the accuracy of each solver and turbulence model for this type of design. A low-fidelity analysis is also performed to get a model-form uncertainty for this type of analysis. The two high-fidelity CFD solvers used here are VULCAN-CFD and FUN3D, and the low-fidelity results comes from Cart3D.The experimental data comes from the 20-inch Mach 6 Tunnel located at NASA Langley Research Center. The work here shows that the models used tend to under-predict the drag and moment aerodynamic coefficients for this type of design leading to a model-form uncertainty estimate which can account for up to an 86% of the total uncertainty in the model predictions.

Laura M White↗

Validation study of RWM stability in DIII-D high- β N plasmas

The n = 1 (n is the toroidal mode number) resistive wall mode (RWM) stability is numerically investigated for two DIII-D high-β N discharges 176440 and 172461, utilizing the MARS-F (Liu et al 2000 Phys. Plasmas 7 3681) and MARS-K (Liu et al 2008 Phys. Plasmas 15 112503) codes. Systematic validation efforts are attempted, for the first time, for discharges with very slow or vanishing toroidal flow for a large fraction of the plasma volume. While gaining physics insights in accessing stable operation regime at β N exceeding the Troyon no-wall limit in these slow-rotation experiments, the predictive capability of fluid and non-perturbative magnetohydrodynamic-kinetic hybrid models for the RWM is further confirmed. The MARS-F fluid model, with a strong but numerically tunable viscosity mimicking ion Landau damping of parallel sound waves, finds complete stabilization of the n = 1 RWM in the considered DIII-D plasmas under the experimental flow conditions. Similarly, either full stabilization (for discharge 176440) or marginal stability (for discharge 172461) of the mode is computed by the MARS-K hybrid model, which is first-principle based without free model parameters. In particular, all drift kinetic resonances, including those of thermal and energetic particles, are found to synergistically act to marginally stabilize the RWM in discharge 172461. These MARS-F/K modeling results explain the experimentally observed stable operational regime in DIII-D, as far as the RWM stability is concerned. Extensive numerical sensitivity studies, with respect to the plasma toroidal flow speed as well as the radial location of the resistive wall, are also carried out to further support the validation study.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Validation Study of Unnotched Charpy and Taylor-Anvil Impact Experiments using Kayenta

Validation of a single computational model with multiple available strain-to-failure fracture theories is presented through experimental tests and numerical simulations of the standardized unnotched Charpy and Taylor-anvil impact tests, both run using the same material model (Kayenta). Unnotched Charpy tests are performed on rolled homogeneous armor steel. The fracture patterns using Kayenta’s various failure options that include aleatory uncertainty and scale effects are compared against the experiments. Other quantities of interest include the average value of the absorbed energy and bend angle of the specimen. Taylor-anvil impact tests are performed on Ti6Al4V titanium alloy. The impact speeds of the specimen are 321 m/s and 393 m/s. The goal of the numerical work is to reproduce the damage patterns observed in the laboratory. For the numerical study, the Johnson-Cook failure model is used as the ductile fracture criterion, and aleatory uncertainty is applied to rate-dependence parameters to explore its effect on the fracture patterns.

97 MATHEMATICS AND COMPUTING↗