Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “verification & validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51

Use of Grid-Forming Medium-Voltage Power Electronics Hub in a Microgrid Setting

This paper presents the application of a new design of a multiport, modular, medium-voltage power electronics hub (M3PE-HUB) in a microgrid setting. The M3PE-HUB system was modeled in a digital real-time simulator (DRTS) and integrated into the Banshee microgrid test system. This paper presents the preliminary DRTS simulation-based results of the M3PE-HUB system connected in a test microgrid system. Verification and validation of the M3PE-HUB architecture and controls in the test microgrid setting are the primary contributions of this work. The results of the operation during the islanding and resynchronization process indicate the feasibility of the proposed architecture in a microgrid setting. This paper also presents results for a system reconfiguration use case where the M3PE-HUB was used to reconfigure the system under a fault condition.

grid forming↗

Verification of the Two-Fluid Model in the Spectral Element Code Nek-2P for Adiabatic Flow Conditions

The simulation of multiphase flow is a difficult physical, computational, and numerical problem. Sophisticated tools are necessary to provide results encompassing a wide range of physical phenomena. The development of these tools must be supported by rigorous analysis and ongoing efforts of verification and validation to ensure the accuracy of simulations. The Nek-2P multiphase code is being developed at Argonne with the general goal of simulating a wide range of multiphase flows and the primary goal of simulating boiling flows in LWR fuel assemblies. As part of this, there is an ongoing effort to verify the code and validate the underlying physical models. The objective of this work is to present recent results in the verification of Nek-2P. As a starting point, this work is focused on adiabatic flows for the sake of simplicity with the immediate next planned step to expand the effort to include heat and mass transfer. Details of the verification of the implemented mass fraction transport, momentum conservation, and pressure equations in Nek-2P are presented. Results of simulations are compared to analytic solutions when possible, however due to the complexity of multiphase flows, these are seldom available. To overcome this difficulty, an independent model is used to provide solutions for comparison.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Quantitative Analysis Guidance in Safety Software Validation

Quantitative analysis in software development has been a challenging topic over the years in safety software. While qualitative processes for vigorous safety software verification and validation (V and V) have been provided through standard such as IEEE 1012, quantitative analysis for V and V tasks such as correctness, completeness or accuracy evaluation have not been formally defined. In practice, there are quantitative analyses in terms of using software metrics. Many of these software metrics are useful in analyzing the test results. Some of them are used for providing guidance in code evaluation activities e.g. numbers of line of codes not exceeding certain limits, recursive calls are not allowed, etc. However, few can be used for providing quantitative analysis guidance for the V and V tasks such as completeness evaluation. AREVA Federal Services (AFS) has provided services for many nuclear projects in US. Through compliance with IEEE 1012, AFS V and V processes have provided vigorous qualitative processes ensuring quality level of the software products used in the project meeting the required nuclear software level. In addition, quantitative analysis is developed to provide structured validation framework ensuring 'zero defect' in the software products. This paper describes some aspects of the quantitative approaches using a sample safety application. (authors)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Agile machining and inspection thrust area team-on-machine probing / compatibility assessment of Parametric Technology Corporation (PTC) pro/CMM DMIS with Zeiss DMISEngine.

The charter goal of the Agile Machining and Inspection Thrust Area Team is to identify technical requirements, within the nuclear weapons complex (NWC), for Agile Machining and Inspection capabilities. During FY 2008, the team identified Parametric Technology Corporation (PTC) Pro/CMM as a software tool for use in off-line programming of probing routines--used for measurement--for machining and turning centers. The probing routine would be used for in-process verification of part geometry. The same Pro/CMM program used on the machine tool could also be employed for program validation / part verification using a coordinate measuring machine (CMM). Funding was provided to determine the compatibility of the Pro/CMM probing program with CMM software (Zeiss DMISEngine).

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Validation metrics for turbulent plasma transport

Developing accurate models of plasma dynamics is essential for confident predictive modeling of current and future fusion devices. In modern computer science and engineering, formal verification and validation processes are used to assess model accuracy and establish confidence in the predictive capabilities of a given model. This paper provides an overview of the key guiding principles and best practices for the development of validation metrics, illustrated using examples from investigations of turbulent transport in magnetically confined plasmas. Particular emphasis is given to the importance of uncertainty quantification and its inclusion within the metrics, and the need for utilizing synthetic diagnostics to enable quantitatively meaningful comparisons between simulation and experiment. As a starting point, the structure of commonly used global transport model metrics and their limitations is reviewed. An alternate approach is then presented, which focuses upon comparisons of predicted local fluxes, fluctuations, and equilibrium gradients against observation. The utility of metrics based upon these comparisons is demonstrated by applying them to gyrokinetic predictions of turbulent transport in a variety of discharges performed on the DIII-D tokamak [J. L. Luxon, Nucl. Fusion 42, 614 (2002)], as part of a multi-year transport model validation activity.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

The human factors verification at plant startup for the AP1000 Plant - 173

The Human Factors (HF) verification at plant startup is the final HF assessment for the AP1000{sup R} HF program and is performed using the as-built plant design. This HF verification has been implemented for the China AP1000 Standard Plant. The scope and objectives of the HF verification at plant startup met the requirements for Verification and Validation (V and V) as described in NUREG-0711, 'Human Factors Engineering Program Review Model'. The majority of the verifications have been completed. Overall, the results confirmed the adequacy of the China AP1000 Standard Plant operating procedures and operator training. A number of design issues were identified and were categorized as safety issues, operability and maintainability issues or minor issues. These issues are being addressed and tracked as site test deficiencies. Based on the current results, it can be concluded that the China AP1000 Standard Plant is safe, operable and maintainable, pending completion of the outstanding verifications and resolution of the identified issues. This paper will describe the overall strategy and discuss the lessons learned in respect to providing HF support to the startup activities for the AP1000 plant. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Stereotactic targeting and dose verification for age-related macular degeneration

Purpose: Validation of the targeting and dose delivery of the IRay low voltage age-related macular degeneration treatment system. Methods: Ten human cadaver eyes were obtained for this study and mounted in the IRay system. Using gel and vacuum, an I-Guide immobilization device was coupled to the eyes and radiochromic film was affixed to the posterior aspect of the globes. Three narrow x-ray beams were delivered through the pars plana to overlap on the predicted nominal fovea. A needle was placed through the center of the film's beam spot and into the eye to register the film and the inner retina. The process was performed three times for each of the ten eyes (30 simulated treatments; 90 individual beams). The globes were dissected to assess the targeting accuracy by measuring the distances from the needles to the fovea. The dose to the fovea was calculated from the radiochromic film. Results: X-ray targeting on the retina averaged 0.6{+-}0.4 mm from the fovea. Repeated treatments on the same eye showed a reproducibility of 0.4{+-}0.4 mm. The optic nerve was safely avoided, with the 90% isodose edge of the beam spot between 0.4 and 2.6 mm from the edge of the optic disk. Measured dose matched that prescribed. Conclusions: This study provides confidence that the IRay, with an average accuracy of 0.6 mm and a precision of 0.4 mm, can reliably treat most AMD lesions centered on the fovea. With the exception of motion, all sources of error are included.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Hyper-X Engine Design and Ground Test Program

The Hyper-X Program, NASA's focused hypersonic technology program jointly run by NASA Langley and Dryden, is designed to move hypersonic, air-breathing vehicle technology from the laboratory environment to the flight environment, the last stage preceding prototype development. The Hyper-X research vehicle will provide the first ever opportunity to obtain data on an airframe integrated supersonic combustion ramjet propulsion system in flight, providing the first flight validation of wind tunnel, numerical and analytical methods used for design of these vehicles. A substantial portion of the integrated vehicle/engine flowpath development, engine systems verification and validation and flight test risk reduction efforts are experimentally based, including vehicle aeropropulsive force and moment database generation for flight control law development, and integrated vehicle/engine performance validation. The Mach 7 engine flowpath development tests have been completed, and effort is now shifting to engine controls, systems and performance verification and validation tests, as well as, additional flight test risk reduction tests. The engine wind tunnel tests required for these efforts range from tests of partial width engines in both small and large scramjet test facilities, to tests of the full flight engine on a vehicle simulator and tests of a complete flight vehicle in the Langley 8-Ft. High Temperature Tunnel. These tests will begin in the summer of 1998 and continue through 1999. The first flight test is planned for early 2000.

Voland, R. T.↗

EMPHASIS(TM)/Nevada Unstructured FEM Implementation Version 2.1.1.

EMPHASIS TM /NEVADA is the SIERRA/NEVADA toolkit implementation of portions of the EMP HASIS TM code suite. The purpose of the toolkit i m- plementation is to facilitate coupling to other physics drivers such as radi a- tion transport as well as to better manage code design, implementation, co m- plexity, and important verification and validation processes. This document describes the theory and implementation of the unstructured finite - element method solver , associated algorithms, and selected verification and valid a- tion . Acknowledgement The author would like to recognize all of the ALEGRA team members for their gracious and willing support through this initial Nevada toolkit - implementation process. Although much of the knowledge needed was gleaned from document a- tion and code context, they were always willing to consult personally on some of the less obvious issues and enhancements necessary.

Turner, C. David↗

Systems usability case in stepwise control room validation - 125

We present a Systems Usability Case (SUC) approach enabling a requirement-based human factors evaluation of complex technical systems. The approach is especially suitable for stepwise verification and validation (V and V) of nuclear power plant (NPP) control room (CR) systems. A SUC is based on the Safety Case approach and on the Systems Usability (SU) construct. A series of V and V test activities carried throughout the design process and constructed according to SUC enables us to monitor how evaluation evidence is aggregated over variety of V and V steps and how the design solution is maturing towards a tool of a good quality and usability. The paper demonstrates an application of the SUC approach to real data from a stepwise CR validation. The results suggest that SUC has some clear advantages. It makes it easier to conduct the V and V activities in a more systematic fashion and it makes the reasoning process more explicit and transparent. Moreover, it enables building a longitudinal view of the progress of the design process. Most importantly, constructing the SUC enables monitoring of the fulfilment of the requirements from the human factors (i.e., SU) perspective. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Studies Related to the Oregon State University High Temperature Test Facility: Scaling, the Validation Matrix, and Similarities to the Modular High Temperature Gas-Cooled Reactor

The Oregon State University (OSU) High Temperature Test Facility (HTTF) is an integral experimental facility that will be constructed on the OSU campus in Corvallis, Oregon. The HTTF project was initiated, by the U.S. Nuclear Regulatory Commission (NRC), on September 5, 2008 as Task 4 of the 5 year High Temperature Gas Reactor Cooperative Agreement via NRC Contract 04-08-138. Until August, 2010, when a DOE contract was initiated to fund additional capabilities for the HTTF project, all of the funding support for the HTTF was provided by the NRC via their cooperative agreement. The U.S. Department of Energy (DOE) began their involvement with the HTTF project in late 2009 via the Next Generation Nuclear Plant project. Because the NRC interests in HTTF experiments were only centered on the depressurized conduction cooldown (DCC) scenario, NGNP involvement focused on expanding the experimental envelope of the HTTF to include steady-state operations and also the pressurized conduction cooldown (PCC). Since DOE has incorporated the HTTF as an ingredient in the NGNP thermal-fluids validation program, several important outcomes should be noted: 1. The reference prismatic reactor design, that serves as the basis for scaling the HTTF, became the modular high temperature gas-cooled reactor (MHTGR). The MHTGR has also been chosen as the reference design for all of the other NGNP thermal-fluid experiments. 2. The NGNP validation matrix is being planned using the same scaling strategy that has been implemented to design the HTTF, i.e., the hierarchical two-tiered scaling methodology developed by Zuber in 1991. Using this approach a preliminary validation matrix has been designed that integrates the HTTF experiments with the other experiments planned for the NGNP thermal-fluids verification and validation project. 3. Initial analyses showed that the inherent power capability of the OSU infrastructure, which only allowed a total operational facility power capability of 0.6 MW, is inadequate to permit steady-state operation at reasonable conditions. 4. To enable the HTTF to operate at a more representative steady-state conditions, DOE recently allocated funding via a DOE subcontract to HTTF to permit an OSU infrastructure upgrade such that 2.2 MW will become available for HTTF experiments. 5. Analyses have been performed to study the relationship between HTTF and MHTGR via the hierarchical two-tiered scaling methodology which has been used successfully in the past, e.g., APEX facility scaling to the Westinghouse AP600 plant. These analyses have focused on the relationship between key variables that will be measured in the HTTF to the counterpart variables in the MHTGR with a focus on natural circulation, using nitrogen as a working fluid, and core heat transfer. 6. Both RELAP5-3D and computational fluid dynamics (CD-Adapco’s STAR-CCM+) numerical models of the MHTGR and the HTTF have been constructed and analyses are underway to study the relationship between the reference reactor and the HTTF. The HTTF is presently being designed. It has ¼-scaling relationship to the MHTGR in both the height and the diameter. Decisions have been made to design the reactor cavity cooling system (RCCS) simulation as a boundary condition for the HTTF to ensure that (a) the boundary condition is well defined and (b) the boundary condition can be modified easily to achieve the desired heat transfer sink for HTTF experimental operations.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Fuzzy Logic Controller Stability Analysis Using a Satisfiability Modulo Theories Approach

While many widely accepted methods and techniques exist for validation and verification of traditional controllers, at this time no solutions have been accepted for Fuzzy Logic Controllers (FLCs). Due to the highly nonlinear nature of such systems, and the fact that developing a valid FLC does not require a mathematical model of the system, it is quite difficult to use conventional techniques to prove controller stability. Since safety-critical systems must be tested and verified to work as expected for all possible circumstances, the fact that FLC controllers cannot be tested to achieve such requirements poses limitations on the applications for such technology. Therefore, alternative methods for verification and validation of FLCs needs to be explored. In this study, a novel approach using formal verification methods to ensure the stability of a FLC is proposed. Main research challenges include specification of requirements for a complex system, conversion of a traditional FLC to a piecewise polynomial representation, and using a formal verification tool in a nonlinear solution space. Using the proposed architecture, the Fuzzy Logic Controller was found to always generate negative feedback, but inconclusive for Lyapunov stability.

Fuzzy Logic Controller↗

Fuzzy Logic Controller Stability Analysis Using a Satisfiability Modulo Theories Approach

While many widely accepted methods and techniques exist for validation and verification of traditional controllers, at this time no solutions have been accepted for Fuzzy Logic Controllers (FLCs). Due to the highly nonlinear nature of such systems, and the fact that developing a valid FLC does not require a mathematical model of the system, it is quite difficult to use conventional techniques to prove controller stability. Since safety-critical systems must be tested and verified to work as expected for all possible circumstances, the fact that FLC controllers cannot be tested to achieve such requirements poses limitations on the applications for such technology. Therefore, alternative methods for verification and validation of FLCs needs to be explored. In this study, a novel approach using formal verification methods to ensure the stability of a FLC is proposed. Main research challenges include specification of requirements for a complex system, conversion of a traditional FLC to a piecewise polynomial representation, and using a formal verification tool in a nonlinear solution space. Using the proposed architecture, the Fuzzy Logic Controller was found to always generate negative feedback, but inconclusive for Lyapunov stability.

Fuzzy Logic Controller↗

Towards a Theory for Integration of Mathematical Verification and Empirical Testing

From the viewpoint of a project manager responsible for the V&V (verification and validation) of a software system, mathematical verification techniques provide a possibly useful orthogonal dimension to otherwise standard empirical testing. However, the value they add to an empirical testing regime both in terms of coverage and in fault detection has been difficult to quantify. Furthermore, potential cost savings from replacing testing with mathematical verification techniques cannot be realized until the tradeoffs and synergies can be formulated. Integration of formal verification with empirical testing is also difficult because the idealized view of mathematical verification providing a correctness proof with total coverage is unrealistic and does not reflect the limitations imposed by computational complexity of mathematical techniques. This paper first describes a framework based on software reliability and formalized fault models for a theory of software design fault detection - and hence the utility of various tools for debugging. It then describes a utility model for integrating mathematical and empirical techniques with respect to fault detection and coverage analysis. It then considers the optimal combination of black-box testing, white-box (structural) testing, and formal methods in V&V of a software system. Using case studies from NASA software systems, it then demonstrates how this utility model can be used in practice.

Lowry, Michael↗

vvtools v. 1.0

Vvtools is a suite of testing tools, with a focus on reproducible verification and validation. They are written in pure Python, and contain a test harness and an automated process management tool. Users of vvtools can develop suites of verification and validation tests and run them on small to large high performance computing resources in an automated and reproducible way. The test harness enables complex processes to be performed in each test and even supports a one-level parent/child dependency between tests. It includes a built in capability to manage workloads requiring multiple processors and platforms that use batch queueing systems.

Drake, RichardR.↗

Architecture for Verifiable Software

Verifiable MDS Architecture (VMA) is a software architecture that facilitates the construction of highly verifiable flight software for NASA s Mission Data System (MDS), especially for smaller missions subject to cost constraints. More specifically, the purpose served by VMA is to facilitate aggressive verification and validation of flight software while imposing a minimum of constraints on overall functionality. VMA exploits the state-based architecture of the MDS and partitions verification issues into elements susceptible to independent verification and validation, in such a manner that scaling issues are minimized, so that relatively large software systems can be aggressively verified in a cost-effective manner.

Reinholtz, William↗

OC5 Project Phase Ib: Validation of hydrodynamic loading on a fixed, flexible cylinder for offshore wind applications

This paper summarizes the findings from Phase Ib of the Offshore Code Comparison, Collaboration, Continued with Correlation (OC5) project. OC5 is a project run under the International Energy Agency (IEA) Wind Research Task 30, and is focused on validating the tools used for modelling offshore wind systems through the comparison of simulated responses of select offshore wind systems (and components) to physical test data. For Phase Ib of the project, simulated hydrodynamic loads on a flexible cylinder fixed to a sloped bed were validated against test measurements made in the shallow water basin at the Danish Hydraulic Institute (DHI) with support from the Technical University of Denmark (DTU). The first phase of OC5 examined two simple cylinder structures (Phase Ia and Ib) to focus on validation of hydrodynamic models used in the various tools before moving on to more complex offshore wind systems and the associated coupled physics. As a result, verification and validation activities such as these lead to improvement of offshore wind modelling tools, which will enable the development of more innovative and cost-effective offshore wind designs.

17 WIND ENERGY↗

L(sub 1) Adaptive Flight Control System: Flight Evaluation and Technology Transition

Certification of adaptive control technologies for both manned and unmanned aircraft represent a major challenge for current Verification and Validation techniques. A (missing) key step towards flight certification of adaptive flight control systems is the definition and development of analysis tools and methods to support Verification and Validation for nonlinear systems, similar to the procedures currently used for linear systems. In this paper, we describe and demonstrate the advantages of L(sub l) adaptive control architectures for closing some of the gaps in certification of adaptive flight control systems, which may facilitate the transition of adaptive control into military and commercial aerospace applications. As illustrative examples, we present the results of a piloted simulation evaluation on the NASA AirSTAR flight test vehicle, and results of an extensive flight test program conducted by the Naval Postgraduate School to demonstrate the advantages of L(sub l) adaptive control as a verifiable robust adaptive flight control system.

Xargay, Enric↗