Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “verification & validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

Separability of Mesh Bias and Parametric Uncertainty for a Full System Thermal Analysis

When making computational simulation predictions of multiphysics engineering systems, sources of uncertainty in the prediction need to be acknowledged and included in the analysis within the current paradigm of striving for simulation credibility. A thermal analysis of an aerospace geometry was performed at Sandia National Laboratories. Here, for this analysis, a verification, validation, and uncertainty quantification (VVUQ) workflow provided structure for the analysis, resulting in the quantification of significant uncertainty sources including spatial numerical error and material property parametric uncertainty. It was hypothesized that the parametric uncertainty and numerical errors were independent and separable for this application. This hypothesis was supported by performing uncertainty quantification (UQ) simulations at multiple mesh resolutions, while being limited by resources to minimize the number of medium and high resolution simulations. In conclusion, based on this supported hypothesis, a prediction including parametric uncertainty and a systematic mesh bias is used to make a margin assessment that avoids unnecessary uncertainty obscuring the results and optimizes use of computing resources.

42 ENGINEERING↗

Cylindricity Error Evaluation Based on an Improved Harmony Search Algorithm

The cylindricity error is one of the basic form errors in mechanical parts, which greatly influences the assembly accuracy and service life of relevant parts. For the minimum zone method (MZM) in international standards, there is no specific formula to calculate the cylindricity error. Therefore, the evaluation methods of the cylindricity error under the MZM have been widely concerned by international scholars. To improve the evaluation accuracy and accelerate the iteration speed of the cylindricity, an improved harmony search (IHS) algorithm is proposed and applied to compute the cylindricity. On the basis of the standard harmony search algorithm, the logistic chaotic initialization is introduced into the generation of initial solution to improve the quality of solutions. During the iterative process, the global and local search capabilities are balanced by adopting the par and b w operators adaptively. After each iteration, the Cauchy mutation strategy is adopted to the best solution to further improve the calculation precision of the IHS algorithm. Finally, four test functions and three groups of cylindricity error examples were applied to validity verification of the IHS algorithm, the simulation test results show that the IHS algorithm has advantages of the computing accuracy and iteration speed compared with other traditional algorithms, and it is very effective for the application in the evaluation of the cylindricity error.

Yang, Yang↗

Center for Multiscale Plasma Dynamics: Report on Activities (UCLA/MIT), 2009-2010

The final 'phaseout' year of the CMPD ended July 2010; a no cost extension was requested until May 2011 in order to enable the MIT subcontract funds to be fully utilized. Research progress over this time included verification and validation activities for the BOUT and BOUT++ code, studies of spontaneous reconnection in the VTF facility at MIT, and studies of the interaction between Alfven waves and drift waves in LAPD. The CMPD also hosted the 6th plasma physics winter school in 2010 (jointly with the NSF frontier center the Center for Magnetic Self-Organization, significant funding came from NSF for this most recent iteration of the Winter School).

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

SAPHIRE 8 Volume 6 - Quality Assurance

The Systems Analysis Programs for Hands-on Integrated Reliability Evaluations (SAPHIRE) Version 8 is a software application developed for performing a complete probabilistic risk assessment using a personal computer running the Microsoft Windows™ operating system. SAPHIRE 8 is funded by the U.S. Nuclear Regulatory Commission (NRC). The role of the INL in this project is that of software developer and tester. This development takes place using formal software development procedures and is subject to quality assurance (QA) processes. The purpose of this document is to describe how the SAPHIRE software QA is performed for Version 8, what constitutes its parts, and limitations of those processes. In addition, this document describes the Independent Verification and Validation that was conducted for Version 8 as part of an overall QA process.

99 GENERAL AND MISCELLANEOUS↗

NNSA ASC Exascale Environment Planning, Applications Working Group, Report February 2011

The scope of the Apps WG covers three areas of interest: Physics and Engineering Models (PEM), multi-physics Integrated Codes (IC), and Verification and Validation (V&V). Each places different demands on the exascale environment. The exascale challenge will be to provide environments that optimize all three. PEM serve as a test bed for both model development and 'best practices' for IC code development, as well as their use as standalone codes to improve scientific understanding. Rapidly achieving reasonable performance for a small team is the key to maintaining PEM innovation. Thus, the environment must provide the ability to develop portable code at a higher level of abstraction, which can then be tuned, as needed. PEM concentrate their computational footprint in one or a few kernels that must perform efficiently. Their comparative simplicity permits extreme optimization, so the environment must provide the ability to exercise significant control over the lower software and hardware levels. IC serve as the underlying software tools employed for most ASC problems of interest. Often coupling dozens of physics models into very large, very complex applications, ICs are usually the product of hundreds of staff-years of development, with lifetimes measured in decades. Thus, emphasis is placed on portability, maintainability and overall performance, with optimization done on the whole rather than on individual parts. The exascale environment must provide a high-level standardized programming model with effective tools and mechanisms for fault detection and remediation. Finally, V&V addresses the infrastructure and methods to facilitate the assessment of code and model suitability for applications, and uncertainty quantification (UQ) methods for assessment and quantification of margins of uncertainty (QMU). V&V employs both PEM and IC, with somewhat differing goals, i.e., parameter studies and error assessments to determine both the quality of the calculation and to estimate expected deviations of simulations from experiments. The exascale environment must provide a performance envelope suitable both for capacity calculations (high through-put) and full system capability runs (high performance). Analysis of the results place shared demand on both the I/O as well as the visualization subsystems.

97 MATHEMATICS AND COMPUTING↗

Summary compilation of shell element performance versus formulation.

This document compares the finite element shell formulations in the Sierra Solid Mechanics code. These are finite elements either currently in the Sierra simulation codes Presto and Adagio, or expected to be added to them in time. The list of elements are divided into traditional two-dimensional, plane stress shell finite elements, and three-dimensional solid finite elements that contain either modifications or additional terms designed to represent the bending stiffness expected to be found in shell formulations. These particular finite elements are formulated for finite deformation and inelastic material response, and, as such, are not based on some of the elegant formulations that can be found in an elastic, infinitesimal finite element setting. Each shell element is subjected to a series of 12 verification and validation test problems. The underlying purpose of the tests here is to identify the quality of both the spatially discrete finite element gradient operator and the spatially discrete finite element divergence operator. If the derivation of the finite element is proper, the discrete divergence operator is the transpose of the discrete gradient operator. An overall summary is provided from which one can rank, at least in an average sense, how well the individual formulations can be expected to perform in applications encountered year in and year out. A letter grade has been assigned albeit sometimes subjectively for each shell element and each test problem result. The number of A's, B's, C's, et cetera assigned have been totaled, and a grade point average (GPA) has been computed, based on a 4.0-system. These grades, combined with a comparison between the test problems and the application problem, can be used to guide an analyst to select the element with the best shell formulation.

99 GENERAL AND MISCELLANEOUS↗

SAPHIRE 8 Quality Assurance Software Metrics Report

The purpose of this review of software metrics is to examine the quality of the metrics gathered in the 2010 IV&V and to set an outline for results of updated metrics runs to be performed. We find from the review that the maintenance of accepted quality standards presented in the SAPHIRE 8 initial Independent Verification and Validation (IV&V) of April, 2010 is most easily achieved by continuing to utilize the tools used in that effort while adding a metric of bug tracking and resolution. Recommendations from the final IV&V were to continue periodic measurable metrics such as McCabe's complexity measure to ensure quality is maintained. The four software tools used to measure quality in the IV&V were CodeHealer, Coverage Validator, Memory Validator, Performance Validator, and Thread Validator. These are evaluated based on their capabilities. We attempted to run their latest revisions with the newer Delphi 2010 based SAPHIRE 8 code that has been developed and was successful with all of the Validator series of tools on small tests. Another recommendation from the IV&V was to incorporate a bug tracking and resolution metric. To improve our capability of producing this metric, we integrated our current web reporting system with the SpiraTest test management software purchased earlier this year to track requirements traceability.

97 MATHEMATICS AND COMPUTING↗

High Level Requirements for the Nuclear Energy -- Knowledge Base for Advanced Modeling and Simulation (NE-KAMS)

The US Department of Energy, Office of Nuclear Energy (DOE-NE), has been tasked with the important mission of ensuring that nuclear energy remains a compelling and viable energy source in the U.S. The motivations behind this mission include cost-effectively meeting the expected increases in the power needs of the country, reducing carbon emissions and reducing dependence on foreign energy sources. In the near term, to ensure that nuclear power remains a key element of U.S. energy strategy and portfolio, the DOE-NE will be working with the nuclear industry to support safe and efficient operations of existing nuclear power plants. In the long term, to meet the increasing energy needs of the U.S., the DOE-NE will be investing in research and development (R&D) and working in concert with the nuclear industry to build and deploy new, safer and more efficient nuclear power plants. The safe and efficient operations of existing nuclear power plants and designing, licensing and deploying new reactor designs, however, will require focused R&D programs as well as the extensive use and leveraging of advanced modeling and simulation (M&S). M&S will play a key role in ensuring safe and efficient operations of existing and new nuclear reactors. The DOE-NE has been actively developing and promoting the use of advanced M&S in reactor design and analysis through its R&D programs, e.g., the Nuclear Energy Advanced Modeling and Simulation (NEAMS) and Consortium for Advanced Simulation of Light Water Reactors (CASL) programs. Also, nuclear reactor vendors are already using CFD and CSM, for design, analysis, and licensing. However, these M&S tools cannot be used with confidence for nuclear reactor applications unless accompanied and supported by verification and validation (V&V) and uncertainty quantification (UQ) processes and procedures which provide quantitative measures of uncertainty for specific applications. The Nuclear Energy Knowledge base for Advanced Modeling and Simulation (NE-KAMS) is being developed at the Idaho National Laboratory in conjunction with Bettis Laboratory, Sandia National Laboratories, Argonne National Laboratory, Utah State University and others with the objective of establishing a comprehensive and web-accessible knowledge base that will provide technical services and resources for V&V and UQ of M&S in nuclear energy sciences and engineering. The knowledge base will serve as an important resource for technical exchange and collaboration that will enable credible and reliable computational models and simulations for application to nuclear reactor design, analysis and licensing. NE-KAMS will serve as a valuable resource for the nuclear industry, academia, the national laboratories, the U.S. Nuclear Regulatory Commission (NRC) and the public and will help ensure the safe, economical and reliable operation of existing and future nuclear reactors. From its inception, NE-KAMS will directly support nuclear energy research, development and demonstration programs within the U.S. Department of Energy (DOE), including the CASL, NEAMS, Light Water Reactor Sustainability (LWRS), Small Modular Reactors (SMR), and Next Generation Nuclear Power Plant (NGNP) programs. These programs all involve M&S of nuclear reactor systems, components and processes, and it is envisioned that NE-KAMS will help to coordinate and facilitate collaboration and sharing of resources and expertise for V&V and UQ across these programs.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Advanced Instrumentation, Information and Control (II&C) Research and Development Facility Buildout and Project Execution of LWRS II&C Pilot Projects 1 and 3

The U.S. Department of Energy (DOE) is sponsoring research, development, and deployment on light water reactor sustainability (LWRS), in which the Idaho National Laboratory (INL) is working closely with nuclear utilities to develop technologies and solutions to help ensure the safe operational life extension of current reactors. As technologies are introduced that change the operation of the plant, the LWRS pilot projects can help identify their best-advanced uses and help demonstrate the safety of these technologies. In early testing of operator performance given these emerging technologies will ensure the safety and usability of systems prior to large-scale deployment and costly verification and validation at the plant. The aim of these collaborations, demonstrations, and approaches are intended to lessen the inertia that sustains the current status quo of today's II&C systems technology, and to motivate transformational change and a shift in strategy to a long-term approach to II&C modernization that is more sustainable. Research being conducted under Pilot Project 1 regards understanding the conditions and behaviors that can be modified, either through process improvements and/or technology deployment, to improve the overall safety and efficiency of outage control at nuclear facilities. The key component of the research in this pilot project is accessing the delivery of information that will allow researchers to simulate the control room, outage control center (OCC) information, and plant status data. The simulation also allows researchers to identify areas of opportunity where plant operating status and outage activities can be analyzed to increase overall plant efficiency. For Pilot Project 3 the desire is to demonstrate the ability of technology deployment and the subsequent impact on maximizing the 'Collective Situational Awareness' of the various stakeholders in a commercial nuclear power plant. Specifically, the desire is to show positive results in plant status control, information management, knowledge management, and 'Real-Time-Truth' as it relates to the current plant conditions. The following report includes two attachments; each attachment represents Pilot Project 1 and 3. The two attachments also provide a report on two distinct milestones that were completed and are described below: M3L11IN06030307 - Complete initiation of two pilot projects. Complete initiation of pilot projects on real-time configuration management and control to overcome limitations with existing permanent instrumentation and real-time awareness of plant configurations; two candidate projects that consider low-cost wireless technology for in situ configuration monitoring and candidate technologies and an information architecture for outage management and control will be initiated with utilities. M3L11IN06030309 - Complete data collection, R&D plans, and agreements needed to conduct the two pilot projects. Complete data collection conducted at pilot project utilities to support real-time configuration management and outage control center pilot studies conducted; R&D plan for pilot projects produced and needed agreements established to support R&D activities.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

A survey of Existing V&V, UQ and M&S Data and Knowledge Bases in Support of the Nuclear Energy - Knowledge base for Advanced Modeling and Simulation (NE-KAMS)

The Nuclear Energy - Knowledge base for Advanced Modeling and Simulation (NE-KAMS) is being developed at the Idaho National Laboratory in conjunction with Bettis Laboratory, Sandia National Laboratories, Argonne National Laboratory, Oak Ridge National Laboratory, Utah State University and others. The objective of this consortium is to establish a comprehensive knowledge base to provide Verification and Validation (V&V) and Uncertainty Quantification (UQ) and other resources for advanced modeling and simulation (M&S) in nuclear reactor design and analysis. NE-KAMS will become a valuable resource for the nuclear industry, the national laboratories, the U.S. NRC and the public to help ensure the safe operation of existing and future nuclear reactors. A survey and evaluation of the state-of-the-art of existing V&V and M&S databases, including the Department of Energy and commercial databases, has been performed to ensure that the NE-KAMS effort will not be duplicating existing resources and capabilities and to assess the scope of the effort required to develop and implement NE-KAMS. The survey and evaluation have indeed highlighted the unique set of value-added functionality and services that NE-KAMS will provide to its users. Additionally, the survey has helped develop a better understanding of the architecture and functionality of these data and knowledge bases that can be used to leverage the development of NE-KAMS.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Calibration of the Accuscan II IN Vivo System for High Energy Lung Counting

This report describes the April 2011 calibration of the Accuscan II HpGe In Vivo system for high energy lung counting. The source used for the calibration was a NIST traceable lung set manufactured at the University of Cincinnati UCLL43AMEU & UCSL43AMEU containing Am-241 and Eu-152 with energies from 26 keV to 1408 keV. The lung set was used in conjunction with a Realistic Torso phantom. The phantom was placed on the RMC II counting table (with pins removed) between the v-ridges on the backwall of the Accuscan II counter. The top of the detector housing was positioned perpendicular to the junction of the phantom clavicle with the sternum. This position places the approximate center line of the detector housing with the center of the lungs. The energy and efficiency calibrations were performed using a Realistic Torso phantom (Appendix I) and the University of Cincinnati lung set. This report includes an overview introduction and records for the energy/FWHM and efficiency calibration including performance verification and validation counting. The Accuscan II system was successfully calibrated for high energy lung counting and verified in accordance with ANSI/HPS N13.30-1996 criteria.

61 RADIATION PROTECTION AND DOSIMETRY↗

Calibration of the Accuscan II In Vivo System for Whole Body Counting

This report describes the April 2011 calibration of the Accuscan II HpGe In Vivo system for whole body counting. The source used for the calibration was a NIST traceable BOMAB manufactured by DOE as INL2006 BOMAB containing Eu-154, Eu-155, Eu-152, Sb-125 and Y-88 with energies from 27 keV to 1836 keV with a reference date of 11/29/2006. The actual usable energy range was 86.5 keV to 1597 keV on 4/21/2011. The BOMAB was constructed inside the Accuscan II counting 'tub' in the order of legs, thighs, abdomen, thorax/arms, neck, and head. Each piece was taped to the backwall of the counter. The arms were taped to the thorax. The phantom was constructed between the v-ridges on the backwall of the Accuscan II counter. The energy and efficiency calibrations were performed using the INL2006 BOMAB. The calibrations were performed with the detectors in the scanning mode. This report includes an overview introduction and records for the energy/FWHM and efficiency calibration including performance verification and validation counting. The Accuscan II system was successfully calibrated for whole body counting and verified in accordance with ANSI/HPS N13.30-1996 criteria.

61 RADIATION PROTECTION AND DOSIMETRY↗

WTEC Panel Report on International Assessment of Research and Development in Simulation-Based Engineering and Science

This WTEC panel report assesses the international research and development activities in the field of Simulation- Based Engineering and Science (SBE&S). SBE&S involves the use of computer modeling and simulation to solve mathematical formulations of physical models of engineered and natural systems. SBE&S today has reached a level of predictive capability that it now firmly complements the traditional pillars of theory and experimentation/observation. As a result, computer simulation is more pervasive today – and having more impact – than at any other time in human history. Many critical technologies, including those to develop new energy sources and to shift the cost-benefit factors in healthcare, are on the horizon that cannot be understood, developed, or utilized without simulation. A panel of experts reviewed and assessed the state of the art in SBE&S as well as levels of activity overseas in the broad thematic areas of life sciences and medicine, materials, and energy and sustainability; and in the crosscutting issues of next generation hardware and algorithms; software development; engineering simulations; validation, verification, and uncertainty quantification; multiscale modeling and simulation; and SBE&S education. The panel hosted a U.S. baseline workshop, conducted a bibliometric analysis, consulted numerous experts and reports, and visited 59 institutions and companies throughout East Asia and Western Europe to explore the active research projects in those institutions, the computational infrastructure used for the projects, the funding schemes that enable the research, the collaborative interactions among universities, national laboratories, and corporate research centers, and workforce needs and development for SBE&S.

97 MATHEMATICS AND COMPUTING↗

Development of a fourth generation predictive capability maturity model.

The Predictive Capability Maturity Model (PCMM) is an expert elicitation tool designed to characterize and communicate completeness of the approaches used for computational model definition, verification, validation, and uncertainty quantification associated for an intended application. The primary application of this tool at Sandia National Laboratories (SNL) has been for physics-based computational simulations in support of nuclear weapons applications. The two main goals of a PCMM evaluation are 1) the communication of computational simulation capability, accurately and transparently, and 2) the development of input for effective planning. As a result of the increasing importance of computational simulation to SNL s mission, the PCMM has evolved through multiple generations with the goal to provide more clarity, rigor, and completeness in its application. This report describes the approach used to develop the fourth generation of the PCMM.

Hills, Richard Guy↗

Light Water Reactor Sustainability Program Operator Performance Metrics for Control Room Modernization: A Practical Guide for Early Design Evaluation

As control rooms are modernized with new digital systems at nuclear power plants, it is necessary to evaluate the operator performance using these systems as part of a verification and validation process. There are no standard, predefined metrics available for assessing what is satisfactory operator interaction with new systems, especially during the early design stages of a new system. This report identifies the process and metrics for evaluating human system interfaces as part of control room modernization. The report includes background information on design and evaluation, a thorough discussion of human performance measures, and a practical example of how the process and metrics have been used as part of a turbine control system upgrade during the formative stages of design. The process and metrics are geared toward generalizability to other applications and serve as a template for utilities undertaking their own control room modernization activities.

99 GENERAL AND MISCELLANEOUS↗

MELCOR/CONTAIN LMR Implementation Report. FY14 Progress

This report describes the preliminary implementation of the sodium thermophysical properties and the design documentation for the sodium models of CONTAIN-LMR to be implemented into MELCOR 2.1. In the past year, the implementation included two separate sodium properties from two different sources. The first source is based on the previous work done by Idaho National Laboratory by modifying MELCOR to include liquid lithium equation of state as a working fluid to model the nuclear fusion safety research. To minimize the impact to MELCOR, the implementation of the fusion safety database (FSD) was done by utilizing the detection of the data input file as a way to invoking the FSD. The FSD methodology has been adapted currently for this work, but it may subject modification as the project continues. The second source uses properties generated for the SIMMER code. Preliminary testing and results from this implementation of sodium properties are given. In this year, the design document for the CONTAIN-LMR sodium models, such as the two condensable option, sodium spray fire, and sodium pool fire is being developed. This design document is intended to serve as a guide for the MELCOR implementation. In addition, CONTAIN-LMR code used was based on the earlier version of CONTAIN code. Many physical models that were developed since this early version of CONTAIN may not be captured by the code. Although CONTAIN 2, which represents the latest development of CONTAIN, contains some sodium specific models, which are not complete, the utilizing CONTAIN 2 with all sodium models implemented from CONTAIN-LMR as a comparison code for MELCOR should be done. This implementation should be completed in early next year, while sodium models from CONTAIN-LMR are being integrated into MELCOR. For testing, CONTAIN decks have been developed for verification and validation use.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Partial Support of Meetings of the Board on Mathematical Sciences and Their Applications (Final Report)

During the performance period, BMSA released the following major reports: Transforming Combustion Research through Cyberinfrastructure (2011); Assessing the Reliability of Complex Models: Mathematical and Statistical Foundations of Verification, Validation, and Uncertainty Quantification (2012); Fueling Innovation and Discovery: The Mathematical Sciences in the 21st Century (2012); Aging and the Macroeconomy: Long-Term Implications of an Older Population (2012); The Mathematical Sciences in 2025 (2013); Frontiers in Massive Data Analysis (2013); and Developing a 21st Century Global Library for Mathematics Research (2014).

97 MATHEMATICS AND COMPUTING↗

Design and Construction of Experiment for Direct Electron Irradiation of Uranyl Sulfate Solution: Bubble Formation and Thermal Hydraulics Studies

Argonne is assisting SHINE Medical Technologies in developing SHINE, a system for producing fission-product 99 Mo using a D/T-accelerator to produce fission in a non-critical target solution of aqueous uranyl sulfate. We have developed an experimental setup for studying thermal-hydraulics and bubble formation in the uranyl sulfate solution to simulate conditions expected in the SHINE target solution during irradiation. A direct electron beam from the linac accelerator will be used to irradiate a 20 L solution (sector of the solution vessel). Because the solution will undergo radiolytic decomposition, we will be able to study bubble formation and dynamics and effects of convection and temperature on bubble behavior. These experiments will serve as a verification/ validation tool for the thermal-hydraulic model. Utilization of the direct electron beam for irradiation allows homogeneous heating of a large solution volume and simplifies observation of the bubble dynamics simultaneously with thermal-hydraulic data collection, which will complement data collected during operation of the miniSHINE experiment. Irradiation will be conducted using a 30-40 MeV electron beam from the high-power linac accelerator. The total electron-beam power will be 20 kW, which will yield a power density on the order of 1 kW/L. The solution volume will be cooled on the front and back surfaces and central tube to mimic the geometry of the proposed SHINE solution vessel. Also, multiple thermocouples will be inserted into the solution vessel to map thermal profiles. The experimental design is now complete, and installation and testing are in progress.

Chemerisov, Sergey↗