Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “verification & validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,027 records · Page 57

Assessment of a Hybrid Continuous/Discontinuous Galerkin Finite Element Code for Geothermal Reservoir Simulations

FALCON (“Fracturing And Liquid CONvection”) is a hybrid continuous / discontinuous Galerkin finite element geothermal reservoir simulation code based on the MOOSE (“Multiphysics Object-Oriented Simulation Environment”) framework being developed and used for multiphysics applications. In the present work, a suite of verification and validation (“V&V”) test problems for FALCON was defined to meet the design requirements, and solved to the interests of enhanced geothermal system (“EGS”) design. Furthermore, the intent for this test problem suite is to provide baseline comparison data that demonstrates the performance of the FALCON solution methods. The simulation problems vary in complexity from singly mechanical or thermo process, to coupled thermo-hydro-mechanical processes in geological porous media. Numerical results obtained by FALCON agreed well with either the available analytical solution or experimental data, indicating the verified and validated implementation of these capabilities in FALCON. Some form of solution verification has been attempted to identify sensitivities in the solution methods, where possible, and suggest best practices when using the FALCON code.

15 GEOTHERMAL ENERGY↗

NSRD-10: Leak Path Factor Guidance Using MELCOR

Estimates of the source term from a U.S. Department of Energy (DOE) nuclear facility requires that the analysts know how to apply the simulation tools used, such as the MELCOR code, particularly for a complicated facility that may include an air ventilation system and other active systems that can influence the environmental pathway of the materials released. DOE has designated MELCOR 1.8.5, an unsupported version, as a DOE ToolBox code in its Central Registry, which includes a leak-path-factor guidance report written in 2004 that did not include experimental validation data. To continue to use this MELCOR version requires additional verification and validations, which may not be feasible from a project cost standpoint. Instead, the recent MELCOR should be used. Without any developer support and lack of experimental data validation, it is difficult to convince regulators that the calculated source term from the DOE facility is accurate and defensible. This research replaces the obsolete version in the 2004 DOE leak path factor guidance report by using MELCOR 2.1 (the latest version of MELCOR with continuing modeling development and user support) and by including applicable experimental data from the reactor safety arena and from applicable experimental data used in the DOE-HDBK-3010. This research provides best practice values used in MELCOR 2.1 specifically for the leak path determination. With these enhancements, the revised leak-path-guidance report should provide confidence to the DOE safety analyst who would be using MELCOR as a source-term determination tool for mitigated accident evaluations.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Hyper-X Wind Tunnel Program

This paper provides an overview of NASA's focused hypersonic technology program, called the Hyper-X Program. The Hyper-X Program, a joint NASA Langley and Dryden program, is designed to move hypersonic, air breathing vehicle technology from the laboratory environment to the flight environment, the last stage preceding prototype development. The Hyper-X research vehicle will provide the first ever opportunity to obtain data on an airframe integrated scramjet (supersonic combustion ramjet) propulsion system at true flight conditions and the first opportunity for flight validation of experimental wind tunnel, numerical and analytical methods used for design of these vehicles. A substantial portion of the program is experimentally based, both for database development and performance validation. The program is now concentrating on Mach 7 vehicle development, verification and validation and flight test risk reduction. This paper concentrates on the aerodynamic and propulsion experimental programs. Wind tunnel testing of the flight engine and complete airframe integrated scramjet configuration flow-path is expected in 1998 and 1999, respectively, and flight test is planned for 2000.

McClinton, C. R.↗

NASA Advanced Composites Project

The recently-completed NASA Advanced Composites Project (ACP) successfully developed several new technologies aimed at reducing the timeline to design and certify composite aircraft structures. Advancements in the areas of manufacturing simulation, nondestructive inspection and advanced structural design and analysis methodologies were completed in late 2019 under the Advanced Composites Consortium (ACC) public/private partnership as well as NRA-funded university contracts. In the area of Structures, the ACC made significant improvements in rapid design tools for preliminary sizing of structure, along with developing detailed static and fatigue strength prediction methods and methods for modeling high energy impact events in composite structures. These new methodologies and toolsets were validated against a range of representative test data using a comprehensive verification and validation approach which has been published and is now used extensively on other programs. Specific new tool improvements supported by ACC include NASA’s CompDam code and Floating Node Method code. CompDam is now available from NASA as open source code. The team alsoworked on improved impact modeling using LS-Dyna™ and improved delamination modeling using Abaqus™. Rapid design tool improvements are available through Hypersizer. The ACC team released well over 50 publications documenting these method improvements, and the ACP recently received the prestigious NASA Group Achievement Award for their work.Typical Hat Stiffened Panel Test Article Used for Method Validation

ACC↗

Space Launch System: CLVTOPS Toolchain for SLS Liftoff Separation Analysis

This presentation showcases the unique technical capabilities of the CLVTOPS multi-body flight dynamics tool chain developed by Marshall Space Flight Center (MSFC) for analyzing NASA’s Space Launch System (SLS) liftoff events. The CLVTOPS tool chain integrates high-fidelity simulations, geometric algorithms, advanced data analytics, and post-flight telemetry to demonstrate positive clearance between separating bodies and inform design decisions that enhance mission reliability. Proper liftoff separation is crucial to the success of the launch vehicle’s mission; vehicle impacts with the launch tower and supporting components incur a heightened risk of mission failure. For liftoff analysis, the CLVTOPS tool chain enables the integration of vehicle, launch pad, and environmental input models for the investigation of key clearance effectors. Furthermore, a novel capability of the CLVTOPS tool chain allows for verification and validation of trajectory reconstruction via photogrammetric imagery analysis. The following sections will walk through the tool chain, SLS liftoff ground rules and assumptions, model integration, pre-flight verification, and post-flight validation of the Artemis I mission liftoff event.

CLVTOPS↗

Validation of Orthorectified Interferometric Radar Imagery and Digital Elevation Models

This work was performed under NASA's Verification and Validation (V&V) Program as an independent check of data supplied by EarthWatch, Incorporated, through the Earth Science Enterprise Scientific Data Purchase (SDP) Program. This document serves as the basis of reporting results associated with validation of orthorectified interferometric interferometric radar imagery and digital elevation models (DEM). This validation covers all datasets provided under the first campaign (Central America & Virginia Beach) plus three earlier missions (Indonesia, Red River: and Denver) for a total of 13 missions.

Smith Charles M.↗

Hanford Waste Treatment Plant LAB Facility Stack Effluent Monitoring: Sampling Probe Location Qualification Evaluation

The WTP LAB stack monitor locations were qualified using scale model stacks to mitigate the risk of identifying that sampling locations do not meet the qualification criteria on the full-scale stack. As required by the ANSI/HPS N13.1-1999 standard, the scale model and its sampling location were geometrically similar to the actual stack and the Reynolds numbers for both the actual and model stacks were >10,000. An additional criterion is that the DV of the full-scale stack must be between 1/6 DV and 6 DV of the scale model stack tests. Verification tests of the LAB stacks were performed at normal operating conditions. The maximum 6 DV value from the scale model testing determines the maximum conditions for which the full-scale stack may be operated and remain in compliance with the stack verification criterion. The remaining criteria for the stack verification to be considered valid involve the flow angle and velocity uniformity results. First, the flow angle at the full-scale stack must be = 20°. Second, the velocity uniformity at the full-scale stack must be = 20% COV. Finally, the velocity uniformity results for the actual and scale model stacks must agree within 5% COV. In general, these criteria were met through the full-scale stack tests at the LAB facility. Some specific items for each scale model and full-scale stack comparison should be noted in assessing the validity of the verification tests. The LB-C2 scale model stacks were performed with single fan operations at then-minimum flow conditions. These conditions resulted in DV values that were too low to meet the DV range criterion, and therefore are unable to be used in qualifying single fan operations on the full-scale stack. However, the single fan operations demonstrated COV values for velocity uniformity as well as flow angles that were comparable to the dual-fan operations at high flows. Overall, the test conditions and test results were within the range of acceptable values based on current design flow rates. Single fan operations are expected to only occur infrequently for maintenance needs and is therefore not a planned operating condition at this time. The LB-S1 scale model stacks were performed at three fan combinations, and in each combination, at least one test was performed at the then-minimum flow conditions as well as at then-maximum flow conditions. While the then-minimum flow conditions result in a DV range that is lower than the verification test DV value, and therefore does not meet the criterion, these tests are un-necessary for the verification test acceptance. The normal and maximum flow conditions from the scale model stack tests meet the DV range criterion, and the velocity uniformity test results compare favorably with the full-scale stack results. The LB-S2 scale model stacks were performed at nominally the same maximum flow condition; however, the 6 DV value for Fan A operation was slightly lower than the full-scale stack test DV. The COV values from the scale model stacks were comparable between the Fan A and Fan B results, and the overall test conditions are within the range of acceptable values. The stack verification is therefore considered acceptable for both Fan A and Fan B operations. The verification tests were performed at flows that were appreciably higher than the design conditions, and further elevated flow rates would be beyond the range of acceptable DV. Based on these stack verification test results, the three LAB filtered exhaust stacks meet the qualification criteria provided in the ANSI/HPS N13.1-1999 standard. Further changes to the system configuration or operating conditions that are outside the bounds described in this and the scale model test reports (Glissmeyer, Flaherty, and Piepel (2001), Glissmeyer and Geeting (2013)) may require additional tests and additional analyses to determine compliance with the standard.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Space Computing Systems Validation Challenges

To examine the challenges of spaceborne computing systems and the past, present and future approaches to verification and validation in hardware and software systems.

Commercial Orbital Transportation Services (COTS)↗

Hyper-X: Flight Validation of Hypersonic Airbreathing Technology

This paper provides an overview of NASA's focused hypersonic technology program, i.e. the Hyper-X program. This program is designed to move hypersonic, air breathing vehicle technology from the laboratory environment to the flight environment, the last stage preceding prototype development. This paper presents some history leading to the flight test program, research objectives, approach, schedule and status. Substantial experimental data base and concept validation have been completed. The program is concentrating on Mach 7 vehicle development, verification and validation in preparation for wind tunnel testing in 1998 and flight testing in 1999. It is also concentrating on finalization of the Mach 5 and 10 vehicle designs. Detailed evaluation of the Mach 7 vehicle at the flight conditions is nearing completion, and will provide a data base for validation of design methods once flight test data are available.

Rausch, Vincent L.↗

Integrating Human Factors into Crew Exploration Vehicle Design

With NASA's new Vision for Exploration to send humans beyond Earth orbit, it is critical to consider the human as a system that demands early and continuous user involvement, and an iterative prototype/test/redesign process. Addressing human-system interface issues early on can be very cost effective even cost reducing when performed early in the design and development cycle. To achieve this goal within Crew Exploration Vehicle (CEV) Project Office, human engineering (HE) team is formed. Key tasks are to apply HE requirements and guidelines to hardware/software, and provide HE design, analysis and evaluation of crew interfaces. Initial activities included many practice-orientated evaluations using low-fidelity CEV mock-ups. What follows is a description of such evaluations that focused on a HE requirement regarding Net Habitable Volume (NHV). NHV is defined as the total remaining pressurized volume available to on-orbit crew after accounting for the loss of volume due to deployed hardware and structural inefficiencies which decrease functional volume. The goal of the NHV evaluations was to develop requirements providing sufficient CEV NHV for crewmembers to live and perform tasks in support of mission goals. Efforts included development of a standard NHV calculation method using computer models and physical mockups, and crew/ stakeholder evaluations. Nine stakeholders and ten crewmembers participated in the unsuited evaluations. Six crewmembers also participated in a suited evaluation. The mock-up was outfitted with volumetric representation of sub-systems such as seats, and stowage bags. Thirteen scenarios were developed to represent mission/crew tasks and considered to be primary volume drivers (e.g., suit donning) for the CEV. Unsuited evaluations included a structured walkthrough of these tasks. Suited evaluations included timed donning of the existing launch and entry suit to simulate a contingency scenario followed by doffing/ stowing of the suits. All mockup evaluations were videotaped. Structured questionnaires were used to document user interface issues and volume impacts of layout configuration. Computer model and physical measures of the NHV agreed within 1 percent. This included measurement of the gross habitable volume, subtraction of intrusive volumes, and other non-habitable spaces. Calculation method developed was validated as a standard means of measuring NHV, and was recommended as a verification method for the NHV requirements. Evaluations confirmed that there was adequate volume for unsuited scenarios and suit donning/ doffing activity. Seats, suit design stowage and waste hygiene system noted to be critical volume drivers. The low-fidelity mock-up evaluations along with human modeling analysis generated discussions that will lead to high-level systems requirements and human-centered design decisions. This approach allowed HE requirements and operational concepts to evolve in parallel with engineering system concepts and design requirements. As the CEV design matures, these evaluations will continue and help with design decisions, and assessment, verification and validation of HE requirements.

Whitmore, Mihriban↗

Latent Pitfalls in Microstructure-Based Modeling for Thermally Aged 9Cr-1Mo-V Steel (Grade 91)

A case study was conducted on a mechanistic model development that predicted tensile strength deterioration with thermal aging of 9Cr-1Mo-V steel in supporting the 60-year design life expected for advanced nuclear reactors. For property prediction beyond practical testing times, mechanistic modeling is highly desired, as it taps into the physics of structure–property relationships and therefore can generate reliable results for extrapolation. Meanwhile, as mechanistic models are often complicated, reflecting the intricacy of microstructure and strengthening mechanisms, pitfalls that are difficult to detect often exist. Here, this paper discusses latent pitfalls that are common in mechanistic modeling or specific in this 9Cr-1Mo-V case development through using the American Society of Mechanical Engineers verification and validation in computational solid mechanics (ASME V&V 10) standard for evaluating credibility of modeling in materials engineering. Suggestions are also made for enhancing reliability of microstructure-based modeling.

36 MATERIALS SCIENCE↗

Plan to Verify and Validate Multi-Hazard Risk-Informed Margin Management Methods and Tools

This report describes the development plan for verification and validation (V&V) of multihazard risk informed margin management (RIMM) methods and tools. The plan will include using new INL developed tool sets coupled with the new multi-partner External Hazards Experimental Group (EHEG) coordinated by the Idaho National Laboratory (INL) within the Risk-Informed Safety Margin Characterization (RISMC) technical pathway of the Light Water Reactor Sustainability Program. The RISMC pathway is developing a suite of new tools and methods for advanced evaluation of facility risk. The RISMC toolkit, includes tools and methods focused on evaluation of risk from external hazards (e.g, seismic and flooding events), which have been shown to be dominant risk contributors in probabilistic risk assessments performed for operating nuclear power plants (NPPs). The external events activity (EEA) within the RISMC pathway is tasked with developing tools and methods focused on evaluation of multi-hazard external risk (e.g, seismic and flooding events). The EHEG will provide technical expertise and experimental large-scale testing data needed for development and validation of tools and methods in the RISMC toolkit for external hazard safety evaluations. The EEA within RISMC has two key elements: (1) an organizational and research framework provided by INL and (2) a coordinated group of university and national laboratory partners with the complementary expertise and experimental capabilities needed to conduct large-scale external hazard-focused experiments. This cooperative group will allow INL to leverage a range of existing capabilities to meet the unique needs of RISMC tool and method development. In addition, the capabilities of the EHEG could be used to address needs of other national laboratories. Currently, there is limited data available for development and validation of the tools and methods being developed in the RISMC Toolkit. The EHEG is being developed to obtain high quality, large-scale experimental data validation of RISMC tools and methods in a timely and cost-effective way. The group of universities and national laboratories that will eventually form the EHEG (which is ultimately expected to include both the initial participants and other universities and national laboratories that have been identified) have the expertise and experimental capabilities needed to both obtain and compile existing data archives and perform additional seismic and flooding experiments. The data developed by EHEG will be stored in databases within RISMC. These databases will be used to validate the advanced external hazard tools and methods. The numerical tools under development in RISMC are used to evaluate the impacts that external hazards have on nuclear power plants. These analysis tools will be used to advanced current risk calculation processes and reduce uncertainty in these calculations. To have confidence in the predictive capability of these numerical tools it is important to verify and validate them. To verify and validate numerical tools the user must understand what physics is being used to represent the problem (i.e. constitutive models used to represent the soil and structure), the numerical solver approach used (i.e. finite element), what data already exists that could be used to validate the tools, and what data is needed for validation.

31274↗

Application of industry-standard guidelines for the validation of avionics software

The application of industry standards to the development of avionics software is discussed, focusing on verification and validation activities. It is pointed out that the procedures that guide the avionics software development and testing process are under increased scrutiny. The DO-178A guidelines, Software Considerations in Airborne Systems and Equipment Certification, are used by the FAA for certifying avionics software. To investigate the effectiveness of the DO-178A guidelines for improving the quality of avionics software, guidance and control software (GCS) is being developed according to the DO-178A development method. It is noted that, due to the extent of the data collection and configuration management procedures, any phase in the life cycle of a GCS implementation can be reconstructed. Hence, a fundamental development and testing platform has been established that is suitable for investigating the adequacy of various software development processes. In particular, the overall effectiveness and efficiency of the development method recommended by the DO-178A guidelines are being closely examined.

Hayhurst, Kelly J.↗

Heat Pipe Cooled Microreactors

Microreactor technologies are required to provide reliable carbon-free power generation in remote applications. The heat pipe cooled microreactor concept in particular offers notable advantages due to the passive operation of heat pipes enabling increased reliability and simplicity in a more compact form factor. There is a significant need for experimental work to aid and expedite the deployment of heat pipe microreactors due to their unique technological characteristics. Thus, there has been increased interest in heat pipe experiments by numerous institutions in order to support these efforts. The present work is a comprehensive review of heat pipe experiments, describing instrumentation, methods, phenomena of interest, and recent developments. In addition, legacy work on the operation of high-temperature heat pipes under irradiation is reviewed and discussed. Furthermore, the verification and validation efforts for the flagship heat pipe simulation code Sockeye are reviewed and requirements for future experiments are outlined. Lastly, future directions are proposed for heat pipe experimentation.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

NEAMS Software V&V Plan for the MARMOT Software

In order to ensure the accuracy and quality of the microstructure based materials models being developed in conjunction with MARMOT simulations, MARMOT must undergo exhaustive verification and validation. Only after this process can we confidently rely on the MARMOT code to predict the microstructure evolution within the fuel. Therefore, in this report we lay out a V&V plan for the MARMOT code, highlighting where existing data could be used and where new data is required.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

WBS 2.2.1.402 - Wave-SPARC: Systematic Process & Analysis for Reaching Commercialization

Wave-SPARC is empowering the marine energy community with the tools necessary to achieve a significant improvement in techno-economic performance of wave generated grid power. A detailed systems engineering approach simultaneously balances around 100 cost and performance drivers (functional requirements and capabilities) of wave energy converters (WECs). Publicly accessible technology innovation and assessment methods and tools (new to the wave energy sector) have been delivered. They guide technology development trajectories to successful outcomes in less time, at less overall cost, and with less encountered risk. Through the use of these methods and tools along with proven structured inventive techniques the project continues to deliver high potential novel wave energy technology concepts for validation and subsequent development by industry. The intended outcomes are: (1) Invention, assessment, identification, verification and validation of novel and high techno-economic-potential WEC technology concepts to deliver high-confidence "seeds" for subsequent industrial development to full commercial application and economic viability (2) Development and delivery of WEC technology innovation and assessment methodologies and tools and provision of these as services and for free use by industry and the entire sector (3) International collaboration for global best practice alignment of assessment and innovation methods.

innovation↗

Rapid State Space Modeling Tool for Rectangular Wing Aeroservoelastic Studies

This paper introduces a modeling and simulation tool for aeroservoelastic analysis of rectangular wings with trailing edge control surfaces. The inputs to the code are planform design parameters such as wing span, aspect ratio and number of control surfaces. A doublet lattice approach is taken to compute generalized forces. A rational function approximation is computed. The output, computed in a few seconds, is a state space aeroservoelastic model which can be used for analysis and control design. The tool is fully parameterized with default information so there is little required interaction with the model developer. Although, all parameters can be easily modified if desired.The focus of this paper is on tool presentation, verification and validation. This process is carried out in stages throughout the paper. The rational function approximation is verified against computed generalized forces for a plate model. A model composed of finite element plates is compared to a modal analysis from commercial software and an independently conducted experimental ground vibration test analysis. Aeroservoelastic analysis is the ultimate goal of this tool. Therefore the flutter speed and frequency for a clamped plate are computed using V-g and V-f analysis. The computational results are compared to a previously published computational analysis and wind tunnel results for the same structure. Finally a case study of a generic wing model with a single control surface is presented. Verification of the state space model is presented in comparison to V-g and V-f analysis. This also includes the analysis of the model in response to a 1-cos gust.

Modeling and Simulation↗

Rapid State Space Modeling Tool for Rectangular Wing Aeroservoelastic Studies

This paper introduces a modeling and simulation tool for aeroservoelastic analysis of rectangular wings with trailing-edge control surfaces. The inputs to the code are planform design parameters such as wing span, aspect ratio, and number of control surfaces. Using this information, the generalized forces are computed using the doublet-lattice method. Using Roger's approximation, a rational function approximation is computed. The output, computed in a few seconds, is a state space aeroservoelastic model which can be used for analysis and control design. The tool is fully parameterized with default information so there is little required interaction with the model developer. All parameters can be easily modified if desired. The focus of this paper is on tool presentation, verification, and validation. These processes are carried out in stages throughout the paper. The rational function approximation is verified against computed generalized forces for a plate model. A model composed of finite element plates is compared to a modal analysis from commercial software and an independently conducted experimental ground vibration test analysis. Aeroservoelastic analysis is the ultimate goal of this tool, therefore, the flutter speed and frequency for a clamped plate are computed using damping-versus-velocity and frequency-versus-velocity analysis. The computational results are compared to a previously published computational analysis and wind-tunnel results for the same structure. A case study of a generic wing model with a single control surface is presented. Verification of the state space model is presented in comparison to damping-versus-velocity and frequency-versus-velocity analysis, including the analysis of the model in response to a 1-cos gust.

Modeling and Simulation↗