Engineering PapersSearch

SEARCH · Engineering Papers

Results for “Validation Studies”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

CFD Validation Studies for Hypersonic Flow Prediction

A series of experiments to measure pressure and heating for code validation involving hypersonic, laminar, separated flows was conducted at the Calspan-University at Buffalo Research Center (CUBRC) in the Large Energy National Shock (LENS) tunnel. The experimental data serves as a focus for a code validation session but are not available to the authors until the conclusion of this session. The first set of experiments considered here involve Mach 9.5 and Mach 11.3 N2 flow over a hollow cylinder-flare with 30 degree flare angle at several Reynolds numbers sustaining laminar, separated flow. Truncated and extended flare configurations are considered. The second set of experiments, at similar conditions, involves flow over a sharp, double cone with fore-cone angle of 25 degrees and aft-cone angle of 55 degrees. Both sets of experiments involve 30 degree compressions. Location of the separation point in the numerical simulation is extremely sensitive to the level of grid refinement in the numerical predictions. The numerical simulations also show a significant influence of Reynolds number on extent of separation. Flow unsteadiness was easily introduced into the double cone simulations using aggressive relaxation parameters that normally promote convergence.

Gnoffo, Peter A.

Expert system verification and validation study. Delivery 3A and 3B: Trip summaries

Key results are documented from attending the 4th workshop on verification, validation, and testing. The most interesting part of the workshop was when representatives from the U.S., Japan, and Europe presented surveys of VV&T within their respective regions. Another interesting part focused on current efforts to define industry standards for artificial intelligence and how that might affect approaches to VV&T of expert systems. The next part of the workshop focused on VV&T methods of applying mathematical techniques to verification of rule bases and techniques for capturing information relating to the process of developing software. The final part focused on software tools. A summary is also presented of the EPRI conference on 'Methodologies, Tools, and Standards for Cost Effective Reliable Software Verification and Validation. The conference was divided into discussion sessions on the following issues: development process, automated tools, software reliability, methods, standards, and cost/benefit considerations.

French, Scott

Expert system verification and validation study. ES V/V guidelines/workshop conference summary

The intent of the workshop was to start moving research on the verification and validation (V&V) of knowledge based systems (KBSs) in the direction of providing tangible 'products' that a KBS developer could use. In the near term research will focus on identifying the kinds of experiences encountered during KBS development of 'real' KBSs. These will be stored in a repository and will serve as the foundation for the rest of the activities described here. One specific approach to be pursued is 'benchmarking'. With this approach, a KBS developer can use either 'canned' KBSs with seeded errors or existing KBSs with known errors to evaluate a given tool's ability to satisfactorily identify errors.

French, Scott W.

Lessons Learned from CFD Validation Study of Protuberance Heating

The objectives of this presentation are: (1) Share lessons learned from a recent exercise in CFD validation of protuberance heating (2) Impact of experimental data reduction assumptions and techniques on validation activity (3) Advanced data reduction techniques may provide useful data from non-typical test methods (4) Significance of the recovery factor for high-speed flows (5) Show typical results of the Lag turbulence model on protuberances (6) Introduce and inform the listener of a protuberance heating dataset which will soon be available for comparison

Oliver, Brandon

Expert system verification and validation study: ES V/V Workshop

The primary purpose of this document is to build a foundation for applying principles of verification and validation (V&V) of expert systems. To achieve this, some V&V as applied to conventionally implemented software is required. Part one will discuss the background of V&V from the perspective of (1) what is V&V of software and (2) V&V's role in developing software. Part one will also overview some common analysis techniques that are applied when performing V&V of software. All of these materials will be presented based on the assumption that the reader has little or no background in V&V or in developing procedural software. The primary purpose of part two is to explain the major techniques that have been developed for V&V of expert systems.

French, Scott

Expert system verification and validation study. Phase 2: Requirements identification. Delivery 1: Updated survey report

The purpose is to report the state-of-the-practice in Verification and Validation (V and V) of Expert Systems (ESs) on current NASA and Industry applications. This is the first task of a series which has the ultimate purpose of ensuring that adequate ES V and V tools and techniques are available for Space Station Knowledge Based Systems development. The strategy for determining the state-of-the-practice is to check how well each of the known ES V and V issues are being addressed and to what extent they have impacted the development of Expert Systems.

Source record

Expert system verification and validation study. Phase 2: Requirements Identification. Delivery 2: Current requirements applicability

The second phase of a task is described which has the ultimate purpose of ensuring that adequate Expert Systems (ESs) Verification and Validation (V and V) tools and techniques are available for Space Station Freedom Program Knowledge Based Systems development. The purpose of this phase is to recommend modifications to current software V and V requirements which will extend the applicability of the requirements to NASA ESs.

Source record

Validation Studies of RELAP5-3D for High-Temperature Gas-Cooled Reactor Analysis Using a Refined RELAP5-3D Model of the High Temperature Test Facility

RELAP5-3D has been used extensively for high-temperature gas-cooled reactor (HTGR) analysis, but such analysis lies outside the validation basis for the code. Oregon State University (OSU) and the United States Department of Energy’s (DOE) Advanced Reactor Technologies (ART) – Gas-cooled reactor campaign worked together to design and operate the High Temperature Test Facility (HTTF) at OSU to provide validation data for prismatic HTGR thermal hydraulics analysis. Work using a previous RELAP5-3D model of HTTF demonstrated the ability to reproduce trends in HTTF data but an inability to reproduce the values measured in multiple experiments within the uncertainty. It was hypothesized that a new model with a finer radial nodalization would perform better for HTTF analysis. In this paper, we present the development of that more refined model and analyze HTTF experiments PG-27 and PG-29, a pressurized (PCC) and depressurized conduction cooldown (DCC) transient. Comparing PG-27 results to experimental data shows a better prediction of steady state and transient temperatures; however, a deeper dive reveals that better transient temperature predictions are a result of better initial conditions. The transient temperature rise in the core is comparable between the two models, but the legacy model predicts temperatures in the reflectors better. The new model demonstrates the ability to predict unique temperatures in each sector of the core during PG-29, capturing the azimuthal asymmetry; however, the temperature predictions still differ from measured temperatures. One hypothesis is that differences between the assumed and actual power distribution leads to the underprediction of the individual block temperatures. These results suggest that gaps and uncertainties in the measured boundary conditions for the HTTF tests do not allow to fully validate RELAP5-3D for prismatic HTGR analyses. The authors suspect that some of the differences between predicted and measured temperatures may be a result of uncertainties associated with HTTF itself rather than RELAP5-3D. We demonstrated improved validation for steady-state analysis, but significantly improved transient performance has yet to be recognized.

22 - GENERAL STUDIES OF NUCLEAR REACTORS

A dynamic model for plant growth: validation study under changing temperatures

A dynamic simulation model to describe vegetative growth of plants, for which some functions and parameter values have been estimated previously by optimization search techniques and numerical experimentation based on data from constant temperature experiments, is validated under conditions of changing temperatures. To test the predictive capacity of the model, dry matter accumulation in the leaves, stems, and roots of tobacco plants (Nicotiana tabacum L.) was measured at 2- or 3-day intervals during a 5-week period when temperatures in controlled-environment rooms were programmed for changes at weekly and daily intervals and in ascending or descending sequences within a range of 14 to 34 degrees C. Simulations of dry matter accumulation and distribution were carried out using the programmed changes for experimental temperatures and compared with the measured values. The agreement between measured and predicted values was close and indicates that the temperature-dependent functional forms derived from constant-temperature experiments are adequate for modelling plant growth responses to conditions of changing temperatures with switching intervals as short as 1 day.

NASA Discipline Number 60-40

LA-8 Computational Analysis and Validation Studies Using FlightStream

With the emerging market of Urban Air Mobility and the associated unique new flight vehicles with the capability of vertical takeoff and landing, design tools need to be calibrated to assist in the development of these new flight vehicle concepts. Distributed electric propulsion (DEP) covers these vehicles with high-energy flow from the array of motors, which leads to extensive propulsion/airframe interaction effects. With limited experimental data of vehicles using DEP and vehicle operation across a large range of angles of attack, including post-stall conditions, there is a lack of validated design tools to advance new vehicle concepts that have blown wings and operate in multiple flight modes. Although some CFD tools can handle the integration of multiple propulsors and unique geometries, the computational time with a full vehicle is extraordinary. FlightStream, a surface vorticity flow solver that can run in a fraction of the time of other CFD methods, has been evaluated using the Langley Aerodrome No. 8 (LA-8) vehicle as a test case. The LA-8 vehicle is a DEP tandem tilt-wing research vehicle that was designed, built, and tested at NASA Langley Research Center. The LA-8 design features both high-performance and high-technical risks aspects. The vehicle has gone through extensive design of experiments wind tunnel testing in the NASA Langley 12-Foot Low-Speed Wind Tunnel in order to capture all modes of operation. In addition, the LA-8 vehicle has undergone wind tunnel testing with and without propellers, which contributes to the validation of FlightStream for aerodynamic performance in blown and unblown wing cases. This study shows that FlightStream can produce trends and magnitudes of the lift and drag coefficients similar to the data collected from the wind tunnel testing of LA-8. The test cases were both blown and unblown wing cases and with and without high lift control surface deflections.

Steven Curtis Geuther

Spacecraft charging modeling development and validation study

The effects of spacecraft charging are presented. Analytical models of the magnetospheric environment are used to show the charging interaction between the spacecraft and the plasma sheath, the discharge phenomena, and electromagnetic coupling from the discharge to spacecraft components. Ground tests to validate the models are described.

Odonnell, E. E.

An Overview of Mesoscale Aerosol Processes, Comparisons, and Validation Studies from DRAGON Networks

Over the past 24 years, the AErosol RObotic NETwork (AERONET) program has provided highly accurate remote-sensing characterization of aerosol optical and physical properties for an increasingly extensive geographic distribution including all continents and many oceanic island and coastal sites. The measurements and retrievals from the AERONET global network have addressed satellite and model validation needs very well, but there have been challenges in making comparisons to similar parameters from in situ surface and airborne measurements. Additionally, with improved spatial and temporal satellite remote sensing of aerosols, there is a need for higher spatial-resolution ground-based remote-sensing networks. An effort to address these needs resulted in a number of field campaign networks called Distributed Regional Aerosol Gridded Observation Networks (DRAGONs) that were designed to provide a database for in situ and remote-sensing comparison and analysis of local to mesoscale variability in aerosol properties. This paper describes the DRAGON deployments that will continue to contribute to the growing body of research related to meso- and microscale aerosol features and processes. The research presented in this special issue illustrates the diversity of topics that has resulted from the application of data from these networks.

Holben, Brent N.

Overview of the Exploration Exercise Device Validation Study Plans

The NASA has determined that a multi-functional exercise device will be developed for use as an exercise device during exploration missions. The device will allow for full body resistance and metabolic exercise necessary to minimize physiological losses during space flight and to maintain fitness necessary to perform critical mission tasks. Prior to implementation as an exercise device on an Exploration vehicle, there will be verification and validation testing completed to determine device efficacy at providing the necessary training stimuli to achieve desired goals. Because the exploration device will be new device that has yet be specified, specific Verification and Validation (V&V) protocols have yet to be developed. Upon delivery of an exploration exercise device training unit, stakeholders throughout NASA will develop V&V plans that include ground-based testing and testing on the International Space Station (ISS). Stakeholders will develop test protocols that include success criterion for the device. Ground tests will occur at NASA Johnson Space Station prior to flight testing. The intents of the ground tests are to allow crew, spaceflight medicine, science, engineering, Astronaut Strength, Conditioning, and Reconditioning staff, and others to gain experience in the best utilization of the device. The goal is to obtain an evidence base for recommending use of the device on the ISS. The developed protocol will be created to achieve multiple objectives, including determining if the device provides an adequate training stimulus for 5th - 95th percentile males and females, allows for exercise modalities that protect functional capability, and is robust and can withstand extensive human use. Although protocols are yet to be determined, current expectations include use of the device by test subjects and current crew in order to obtain quantitative and qualitative feedback. Information obtained during the ground tests may be used to influence device modifications during design iterations. Assuming successful ground tests, the device will be installed on the ISS for testing during space flight. Spaceflight testing is envisioned to include an activation and checkout (ACO) phase and a V&V phase. During the ACO phase, 1-2 crewmembers will exercise with the device to ensure proper function. ACO is expected to last multiple months because of the many modes and methods of exercise that need to be assessed. However, the goal is to complete the ACO as quickly as possible. Once successful ACO occurs, the crew will be free to use the device for normal exercise pending concurrence from stakeholders. V&V tests on the ISS will ideally consist of crew using the device for all of their exercise for an entire mission. Exercise prescriptions will be supplied that replicate expected prescriptions during exploration missions. Crew that are not enrolled in the V&V studies would be also free to use the device as their schedule permits. As experience is gained by users, exercise protocols could change. The intent of all V&V testing is to ensure that all have thorough understanding of experience at optimizing device capability

DeWitt, J. K.

A CFD Validation Study using Artemis 1 Orbital Slosh Test Data

Advancements in liquid propellant management science and technologies are key to increasing safety, decreasing cost, and increasing payload mass of NASA space missions. Liquid propellant usually comprises a large portion of the total mass of launch vehicles and spacecraft, so predicting and controlling the motion of it are important. Computational fluid dynamics (CFD) programs are critical to predicting slosh dynamics, but CFD programs require experimental validation with physically relevant test data before the results can be trusted. Low-gravity slosh test data is lacking, and most of what exists is inadequate for CFD validation. A potential slosh risk for Orion, and the lack of validated low-gravity slosh models, led to performing on-orbit slosh tests during the Artemis 1 mission to assess the impacts of slosh on the guidance, navigation, and control of Orion. This work details the validation of a coupled slosh-motion CFD model using the Orion orbital slosh test data set.

CFD

A CFD Validation Study Using Artemis 1 Orbital Slosh Test Data

Advancements in liquid propellant management science and technologies are key to increasing safety, decreasing cost, and increasing payload mass of NASA space missions. Liquid propellant usually comprises a large portion of the total mass of launch vehicles and spacecraft, so predicting and controlling the motion of it are important. Computational fluid dynamics (CFD) programs are critical to predicting slosh dynamics, but CFD programs require experimental validation with physically relevant test data before the results can be trusted. Low-gravity slosh test data is lacking, and most of what exists is inadequate for CFD validation. A potential slosh risk for Orion, and the lack of validated low-gravity slosh models, led to performing on-orbit slosh tests during the Artemis 1 mission to assess the impacts of slosh on the guidance, navigation, and control of Orion. This work details the validation of a coupled slosh-motion CFD model using the Orion orbital slosh test data set.

CFD

A Validation Study of the Performance Prediction Methodology of the Early Warning Metrics

Complex projects frequently experience delays and develop backlogs of their project control milestones during the acquisition and development lifecycles. In response, the National Aeronautics and Space Administration (NASA) Goddard Space Flight Center (GSFC) formed an independent group of Subject Matter Experts (SMEs) to monitor the execution performance of GSFC Flight projects and instruments that are under development. The SME team’s objective is to generate data driven performance-based indicators that quantify the degree to which projects are meeting their respective schedule and budget commitments. One of these performance-based indicators, the Early Warning Metrics, provides performance forecasts and insight to project performance relative to historical successful projects. Herein this paper describes the purpose and utility of the Early Warning Metrics. Additionally, the initial prediction method used in the creation of the metrics is described along with its validity and the validity of comparable prediction methods.

Holloman, Sherrica

Development of a Common Research Model for Applied CFD Validation Studies

The development of a wing/body/nacelle/pylon/horizontal-tail configuration for a common research model is presented, with focus on the aerodynamic design of the wing. Here, a contemporary transonic supercritical wing design is developed with aerodynamic characteristics that are well behaved and of high performance for configurations with and without the nacelle/pylon group. The horizontal tail is robustly designed for dive Mach number conditions and is suitably sized for typical stability and control requirements. The fuselage is representative of a wide/body commercial transport aircraft; it includes a wing-body fairing, as well as a scrubbing seal for the horizontal tail. The nacelle is a single-cowl, high by-pass-ratio, flow-through design with an exit area sized to achieve a natural unforced mass-flow-ratio typical of commercial aircraft engines at cruise. The simplicity of this un-bifurcated nacelle geometry will facilitate grid generation efforts of subsequent CFD validation exercises. Detailed aerodynamic performance data has been generated for this model; however, this information is presented in such a manner as to not bias CFD predictions planned for the fourth AIAA CFD Drag Prediction Workshop, which incorporates this common research model into its blind test cases. The CFD results presented include wing pressure distributions with and without the nacelle/pylon, ML/D trend lines, and drag-divergence curves; the design point for the wing/body configuration is within 1% of its max-ML/D. Plans to test the common research model in the National Transonic Facility and the Ames 11-ft wind tunnels are also discussed.

Vassberg, John C.