SEARCH · Engineering Papers

Results for “verification and validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

All sources NASA NTRS DOE OSTI

NASA NTRS2006

Standardized Radiation Shield Design Methods: 2005 HZETRN

Research committed by the Langley Research Center through 1995 resulting in the HZETRN code provides the current basis for shield design methods according to NASA STD-3000 (2005). With this new prominence, the database, basic numerical procedures, and algorithms are being re-examined with new methods of verification and validation being implemented to capture a well defined algorithm for engineering design processes to be used in this early development phase of the Bush initiative. This process provides the methodology to transform the 1995 HZETRN research code into the 2005 HZETRN engineering code to be available for these early design processes. In this paper, we will review the basic derivations including new corrections to the codes to insure improved numerical stability and provide benchmarks for code verification.

Wilson, John W.↗

NASA NTRS2018

Global Ecosystem Dynamics Investigation (GEDI) Structural Verification Unit (SVU) Vibration Test

This presentation describes the vibration test campaign of the Structural Verification Unit for the Global Ecosystem Dynamics Investigation (GEDI) mission The Structural Verification Unit test campaign served multiple purposes including the qualification of the instrument primary structure, verification of the structure's stiffness, Aperture Control Mechanism assembly level verification, and validation of the control approach for protoflight instrument vibration testing. Testing included three axes of sine burst, random, and sine vibration excitation. This test sequence required a high number of response instrumentation sensors that included tri-axial accelerometers and tri-axial force gauges. Multiple response limiting methods that included acceleration, force, and moment measurements were used to ensure the safety of the flight hardware. The lessons and specific test details learned on the structural verification unit test campaign will reduce test risks for the upcoming instrument-level vibration tests.

Structural Verification Unit↗

DOE OSTI2023

High-Fidelity Numerical Investigation on Elucidating Sodium Heat Transfer Characteristics for 37-Pin Wire-Wrapped Fuel Bundle in the PLANDTL Facility

This study involved a Reynolds-averaged Navier-Stokes- (RANS-) based computational fluid dynamics (CFD) analysis of the 37-pin wire-wrapped fuel bundle of the PNC Plant dynamics test loop (PLANDTL) facility. Previously, mainly the hydrodynamic phenomena of the wire-wrapped fuel bundle were analyzed, but the present study additionally included heat transfer analysis through conjugate heat transfer. The main purpose of the study was to benchmark the experimental data of the PLANDTL 37-pin wire-wrapped fuel bundle to investigate the heat transfer phenomena. In addition, the aim was to verify the accuracy of the RANS-based CFD analysis method using the STAR-CCM+ simulation software in comparison with the experimental data. The grid used for verification was an innovative grid system consisting of hexahedra using Fortran-based code. The development of the RANS-based CFD methodology included grid sensitivity analysis, turbulence model sensitivity analysis, and turbulent Prandtl number sensitivity analysis. Information on the temperature, mass flow rate, and area of the CFD results for each subchannel was provided for the top of the heated section and is expected to serve as a reference for future studies aiming to perform the validation and verification of a PLANDTL facility. In addition, the dependence of the peak temperature on the azimuth angle of each pin was analyzed.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS1991

Rule groupings: An approach towards verification of expert systems

Knowledge-based expert systems are playing an increasingly important role in NASA space and aircraft systems. However, many of NASA's software applications are life- or mission-critical and knowledge-based systems do not lend themselves to the traditional verification and validation techniques for highly reliable software. Rule-based systems lack the control abstractions found in procedural languages. Hence, it is difficult to verify or maintain such systems. Our goal is to automatically structure a rule-based system into a set of rule-groups having a well-defined interface to other rule-groups. Once a rule base is decomposed into such 'firewalled' units, studying the interactions between rules would become more tractable. Verification-aid tools can then be developed to test the behavior of each such rule-group. Furthermore, the interactions between rule-groups can be studied in a manner similar to integration testing. Such efforts will go a long way towards increasing our confidence in the expert-system software. Our research efforts address the feasibility of automating the identification of rule groups, in order to decompose the rule base into a number of meaningful units.

Mehrotra, Mala↗

NASA NTRS2006

Point-to-Point! Validation of the Small Aircraft Transportation System Higher Volume Operations Concept

Described is the research process that NASA researchers used to validate the Small Aircraft Transportation System (SATS) Higher Volume Operations (HVO) concept. The four phase building-block validation and verification process included multiple elements ranging from formal analysis of HVO procedures to flight test, to full-system architecture prototype that was successfully shown to the public at the June 2005 SATS Technical Demonstration in Danville, VA. Presented are significant results of each of the four research phases that extend early results presented at ICAS 2004. HVO study results have been incorporated into the development of the Next Generation Air Transportation System (NGATS) vision and offer a validated concept to provide a significant portion of the 3X capacity improvement sought after in the United States National Airspace System (NAS).

Williams, Daniel M.↗

DOE OSTI2025

COMPUTATION FLUID DYNAMICS ANALYSIS FOR GENERIC SMALL MODULAR REACTOR CONTAINMENT SEPARATE EFFECTS TEST

It is desirable for fourth-generation Small Modular Reactors to be passively cooled in standard and accident operations. Passive Containment Cooling Systems can reject heat from the containment structure, without using pumps or blowers. The targeted design containment structure is a large, domed, stainless steel, cylindrical vessel. In a postulated Design Basis Accident, steam will flash inside containment. Steam condensation occurs on the inner containment wall and transfers heat through the steel containment into a large body of water known as the annular reservoir (AR) surrounding the vessel serving as the ultimate heat sink. Natural circulation drives the flow in the AR and heat will be released to the environment by evaporation of water. Unique containment geometry requires a separate effects test (SET) facility for the verification and validation of the computer code and evaluation model development and assessment for reactor licensing efforts. In this study, STAR-CCM+, a computational fluid dynamics (CFD) code was used to inform the decision-making process on the design of the SET. The CFD simulation modeled, a two-phase turbulent flow with fluid film development and heat transfer for different containment geometries. The Reactor Excursion and Leak Analysis Program will also be used in a code-to-code verification against the CFD results.

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗

DOE OSTI2021

Modeling of the High Temperature Test Facility Using RELAP-7

The High Temperature Test Facility (HTTF) at Oregon State University (OSU) is an electrically heated, helium cooled, experimental facility. The HTTF was modeled using RELAP-7 in both 1-D and 3-D for validation. Due to core symmetry, 1/6th of the HTTF core was modeled in 3-D using the coupled heat conduction and forced convection capabilities of RELAP-7. This served as a validation case for RELAP-7 and its capabilities to model advanced nuclear technologies such as high temperature gas-cooled reactors.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

NASA NTRS2010

Ares I-X Range Safety Simulation Verification and Analysis IV and V

NASA s ARES I-X vehicle launched on a suborbital test flight from the Eastern Range in Florida on October 28, 2009. NASA generated a Range Safety (RS) flight data package to meet the RS trajectory data requirements defined in the Air Force Space Command Manual 91-710. Some products included in the flight data package were a nominal ascent trajectory, ascent flight envelope trajectories, and malfunction turn trajectories. These data are used by the Air Force s 45th Space Wing (45SW) to ensure Eastern Range public safety and to make flight termination decisions on launch day. Due to the criticality of the RS data in regards to public safety and mission success, an independent validation and verification (IV&V) effort was undertaken to accompany the data generation analyses to ensure utmost data quality and correct adherence to requirements. Multiple NASA centers and contractor organizations were assigned specific products to IV&V. The data generation and IV&V work was coordinated through the Launch Constellation Range Safety Panel s Trajectory Working Group, which included members from the prime and IV&V organizations as well as the 45SW. As a result of the IV&V efforts, the RS product package was delivered with confidence that two independent organizations using separate simulation software generated data to meet the range requirements and yielded similar results. This document captures ARES I-X RS product IV&V analysis, including the methodology used to verify inputs, simulation, and output data for an RS product. Additionally a discussion of lessons learned is presented to capture advantages and disadvantages to the IV&V processes used.

Tarpley, Ashley↗

DOE OSTI2022

Continued Verification of MOOSE Structural Mechanics Tools for Modeling Core Bowing Phenomena in Fast Reactors

Under the U.S. Department of Energy Office of Nuclear Energy’s Advanced Modeling and Simulation (NEAMS) Program, an integrated multiphysics approach is being developed to model the core bowing phenomena important to liquid metal-cooled fast reactors. Core bowing is an important passive safety mechanism whereby increased power (which leads to temperature and flux gradients) influences the core to bow into less reactive configurations when the restraint system is properly designed. The phenomenon includes a complex interplay of radiation transport, duct temperature calculations involving fluid flow and heat transfer, and thermo-mechanical responses to the induced temperature and flux gradients. Structural material properties are also important to determining inelastic response to longer term flux gradients which cause irradiation creep and swelling. While core bowing provides a strong negative reactivity feedback when the restraint system is designed properly, it also results in additional forces between assemblies which increase the loads required to extricate them during refueling or control rod movement. Therefore, the restraint system must be designed with these tradeoffs in mind. The first stage of the work, which commenced in FY21 and continues through FY22, assesses thermo-mechanical modeling tools for producing core bowing predictions consistent with conventional tools. The Multiphysics Object Oriented Simulation Environment (MOOSE) Tensor Mechanics and Contact Modules are employed. This status report describes work on additional thermo-mechanical benchmark verification problems with increased complexity from the examples demonstrated in FY21. Several benchmark verification examples were selected from the IAEA verification and validation report. These examples involve clusters of ducts representative of a sector of a hexagonal reactor core which bow into each other and cause contact and load pad elevations, as well as single ducts subjected to irradiation fields undergoing swelling and subsequent bowing. The MOOSE-based results were compared to both IAEA benchmark participants’ results, analytic equations as available, and NUBOW-3D, a beam model code developed by Argonne National Laboratory. In every case, the MOOSE results agreed with other simulations results, providing additional verification basis of the tools for this particular physics application.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2022

Design of a Novel Information System for Semi-Automated Management of Cybersecurity in Industrial Control Systems

There is an urgent need in many critical infrastructure sectors, including the energy sector, for attaining detailed insights into cybersecurity features and compliance with cybersecurity requirements related to their Operational Technology (OT) deployments. Frequent feature changes of OT devices interfere with this need, posing a great risk to customers. One effective way to address this challenge is via a semi-automated cyber-physical security assurance approach, which enables verification and validation of the OT device cybersecurity claims against actual capabilities, both pre- and post-deployment. To realize this approach, this paper presents new methodology and algorithms to automatically identify cybersecurity-related claims expressed in natural language form in ICS device documents. Here, we developed an identification process that employs natural language processing (NLP) techniques with the goal of semi-automated vetting of detected claims against their device implementation. We also present our novel NLP components for verifying feature claims against relevant cybersecurity requirements. The verification pipeline includes components such as automated vendor identification, device document curation, feature claim identification utilizing sentiment analysis for conflict resolution, and reporting of features that are claimed to be supported or indicated as unsupported. Our novel matching engine represents the first automated information system available in the cybersecurity domain that directly aids the generation of ICS compliance reports.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

NASA NTRS2008

Towards Certification of a Space System Application of Fault Detection and Isolation

Advanced fault detection, isolation and recovery (FDIR) software is being investigated at NASA as a means to the improve reliability and availability of its space systems. Certification is a critical step in the acceptance of such software. Its attainment hinges on performing the necessary verification and validation to show that the software will fulfill its requirements in the intended setting. Presented herein is our ongoing work to plan for the certification of a pilot application of advanced FDIR software in a NASA setting. We describe the application, and the key challenges and opportunities it offers for certification.

Software verification↗

NASA NTRS2003

Modeling and Validation of Damped Plexiglas Windows for Noise Control

Windows are a significant path for structure-borne and air-borne noise transmission in general aviation aircraft. In this paper, numerical and experimental results are used to evaluate damped plexiglas windows for the reduction of structure-borne and air-borne noise transmitted into the interior of an aircraft. In contrast to conventional homogeneous windows, the damped plexiglas windows were fabricated using two or three layers of plexiglas with transparent viscoelastic damping material sandwiched between the layers. Transmission loss and radiated sound power measurements were used to compare different layups of the damped plexiglas windows with uniform windows of the same nominal thickness. This vibro-acoustic test data was also used for the verification and validation of finite element and boundary element models of the damped plexiglas windows. Numerical models are presented for the prediction of radiated sound power for a point force excitation and transmission loss for diffuse acoustic excitation. Radiated sound power and transmission loss predictions are in good agreement with experimental data. Once validated, the numerical models were used to perform a parametric study to determine the optimum configuration of the damped plexiglas windows for reducing the radiated sound power for a point force excitation.

Buehrle, Ralph D.↗

DOE OSTI2022

Development and verification of the pyIsoDep depletion package for nuclear thermal propulsion reactors

Nuclear thermal propulsion technology is currently being developed by the National Air and Space Administration for future manned Mars missions. There are multiple on-going activities to develop and enhance computational capabilities, single- and multi-physics, to advance the readiness level of this technology. The prediction of short-lived fission products is crucial to understand the reactivity penalty and the decay heat production during the different burnout stages of the vehicle. Generally, the solution entails coupled neutronic-depletion analysis. However, such simulations are somewhat expensive, especially if the duration of each engine burn is to be optimized. Therefore, there is a need to complement such high-fidelity techniques with time-efficient alternatives that do not require the sequential neutronic and depletion analysis. This paper details the methods and capabilities of pyIsoDep, an open-source code used for depletion analysis of nuclear thermal propulsion reactors. The package is general, in principle, and thus can be applied to any fission system, and can potentially be extended for fusion systems. The package was developed to provide a flexible and efficient alternative to pre-existing higher order depletion codes that could integrate well into mission and transient analysis of nuclear thermal propulsion reactors. Finally, this paper presents a validation and verification of pyIsoDep against analytical and Serpent-generated solutions. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

NASA NTRS1999

Synthetic Scene Generation of Stennis Target Range for the Calibration of Remote Sensing Systems

The validation and verification (V&V) target range developed at Stennis Space Center is a useful tool for the calibration of remote sensing systems. In this paper, we present an algorithm for generating synthetic scenes or digital models of this target range. The atmospheric radiative transfer code Modtran 4 is used in simulating at-sensor radiance for a given sensor. Software is developed to generate the scene with different spatial and spectral resolutions using the at-sensor radiance values. Synthetic scenes provide a cost-effective way for in-flight validation for the spatial and radiometric accuracy of the data. Other applications include mission planning, sensor simulation, and trade-off analysis in sensor design. The radiometric and spatial accuracy of the simulation is evaluated by comparing simulated scenes with AVIRIS acquired values.

Cao, Chang-Yong↗

NASA NTRS1982

An integrated user-oriented laboratory for verification of digital flight control systems: Features and capabilities

A Digital Flight Control Systems Verification Laboratory (DFCSVL) has been established at NASA Ames Research Center. This report describes the major elements of the laboratory, the research activities that can be supported in the area of verification and validation of digital flight control systems (DFCS), and the operating scenarios within which these activities can be carried out. The DFCSVL consists of a palletized dual-dual flight-control system linked to a dedicated PDP-11/60 processor. Major software support programs are hosted in a remotely located UNIVAC 1100 accessible from the PDP-11/60 through a modem link. Important features of the DFCSVL include extensive hardware and software fault insertion capabilities, a real-time closed loop environment to exercise the DFCS, an integrated set of software verification tools, and a user-oriented interface to all the resources and capabilities.

Defeo, P.↗

NASA NTRS2006

Simulating Visible/Infrared Imager Radiometer Suite Normalized Difference Vegetation Index Data Using Hyperion and MODIS

The success of MODIS (the Moderate Resolution Imaging Spectrometer) in creating unprecedented, timely, high-quality data for vegetation and other studies has created great anticipation for data from VIIRS (the Visible/Infrared Imager Radiometer Suite). VIIRS will be carried onboard the joint NASA/Department of Defense/National Oceanic and Atmospheric Administration NPP (NPOESS (National Polar-orbiting Operational Environmental Satellite System) Preparatory Project). Because the VIIRS instruments will have lower spatial resolution than the current MODIS instruments 400 m versus 250 m at nadir for the channels used to generate Normalized Difference Vegetation Index data, scientists need the answer to this question: how will the change in resolution affect vegetation studies? By using simulated VIIRS measurements, this question may be answered before the VIIRS instruments are deployed in space. Using simulated VIIRS products, the U.S. Department of Agriculture and other operational agencies can then modify their decision support systems appropriately in preparation for receipt of actual VIIRS data. VIIRS simulations and validations will be based on the ART (Application Research Toolbox), an integrated set of algorithms and models developed in MATLAB(Registerd TradeMark) that enables users to perform a suite of simulations and statistical trade studies on remote sensing systems. Specifically, the ART provides the capability to generate simulated multispectral image products, at various scales, from high spatial hyperspectral and/or multispectral image products. The ART uses acquired ( real ) or synthetic datasets, along with sensor specifications, to create simulated datasets. For existing multispectral sensor systems, the simulated data products are used for comparison, verification, and validation of the simulated system s actual products. VIIRS simulations will be performed using Hyperion and MODIS datasets. The hyperspectral and hyperspatial properties of Hyperion data will be used to produce simulated MODIS and VIIRS products. Hyperion-derived MODIS data will be compared with near-coincident MODIS collects to validate both spectral and spatial synthesis, which will ascertain the accuracy of converting from MODIS to VIIRS. MODIS-derived VIIRS data is needed for global coverage and for the generation of time series for regional and global investigations. These types of simulations will have errors associated with aliasing for some scene types. This study will help quantify these errors and will identify cases where high-quality, MODIS-derived VIIRS data will be available.

Ross, Kenton W.↗

NASA NTRS2014

LADEE Multi-Domain Simulation

The Lunar Atmosphere Dust Environment Explorer (LADEE) was a small explorer class spacecraft that was launched on Sept 7, 2013 and that was de-orbited and successfully impacted the Moons surface on April 17, 2014 after completing all of the mission objectives. The low-cost rapidly prototyped hardware design used for the spacecraft was extend to the development of the software base. To achieve this goal, a Model Based Design approach was utilized to develop the onboard flight software, and out of this development a model based multipurpose simulator was created of the LADEE spacecraft and its mission environment. This simulator extended the traditional function of propagating the vehicle's kinematic and rotational states and included the electrical and thermal states propagation. Traditionally, these domains are handled by domain specific high fidelity simulations that use the states histories from other domains as input. By reducing the fidelity and abstracting the relevant features being monitored and controlled by the flight software, it was possible to model the coupling across these domains resulting in more accurate overall system behavior. A faster than real-time workstation (WSIM) version of the LADEE simulator was used to develop and test the software control algorithms in the Simulink environment. To maximize the performance of the simulation, modeling knobs were introduced to reduce the resolution of the some of the domains models when the effects of that domain were not significant for the scope of that simulation. The automatic code generation feature in Simulink was used to port the simulation to several real-time environments to support Processor-in-the-Loop (PIL) and Hardware-in-the-Loop (HIL) testing, verification and validation. The real-time environment required that the design of each of the domain models be deterministic as possible in the time required to perform all of the calculations to update its states. The simulation interface was designed to be compatible with the command interface employed by the LADEE mission operation team. The WSIM, PIL, and HIL simulators thus used a common interface and thus were used for flight software testing, for mission operations personnel training (nominal and off-nominal operations) prior to the mission and to perform command sequence verification during the mission. This presentation will look at the modeling strategies used to create a common interface to the simulator and to model and couple multiple domains within the simulation, the results of those strategies, and the lessons learned.

Multi-Domain↗

DOE OSTI2023

SAS4A/SASSYS-1 Commercial Grade Dedication Example Report for a Generic Sodium Pool-Type Fast Reactor Application

In the U.S., a key component of the commercialization of advanced reactors is completion of a license application, which must ultimately be approved by the Nuclear Regulatory Commission (NRC). The approval of the license application by the NRC is contingent on satisfactory demonstration of the design basis and the response of the advanced reactor design to transient and accident scenarios using accepted codes and methods. This report describes the qualification and dedication requirements that the advanced reactor safety analysis system software SAS4A/SASSYS-1 are expected to need to fulfill to be used for sodium-cooled pool-type fast reactor licensing. The qualification and dedication requirements are identified through performance critical characteristics and evaluation model acceptance criteria representative of the advanced reactor design considered for licensing. This document captures, additionally, the verification process developed to demonstrate that the software fulfills the qualification and dedication requirements for a generic sodium-cooled pool-type fast reactor as part of the commercial grade dedication process. Like most software that has primarily existed in the research and development space, the most significant challenge facing SAS4A/SASSYS-1 for use in a licensing framework is the availability of a documentation basis describing the code pedigree. SAS4A/SASSYS-1 has been used for licensing of the fast flux test facility (FFTF) and the JOYO sodium-cooled fast reactor in Japan, as well as the design of the CRBR Plant. However, the historical verification and validation (V&V) activities supporting SAS4A/SASSYS-1 development do not align with modern software quality assurance (SQA) and V&V requirements. Two approaches to use of SAS4A/SASSYS-1 in a commercial licensing framework have been identified: commercial-grade dedication (CGD) and software qualification. The methods and requirements prescribed in the ASME NQA-1-2008/2009 Standard and Regulatory Guide 1.203 on the evaluation model development and assessment process (EMDAP) have been used as guidance to define the CGD and qualification processes, respectively. A qualification and dedication requirements matrix has been developed which utilizes fundamental software verification. In this process, software verification is defined as a software quality process aimed at defining software requirement specifications, developing software design documentation, and performing and documenting acceptance testing of the code against requirements. A key element of software qualification and dedication includes determination of software acceptance with respect to critical characteristics relevant to the functional requirements of the software. To assist with identification of cross-cutting transient phenomena and functional requirements, domestic SFR vendor designs have been reviewed to identify a reference SFR design. For this report, the reference design is defined as a pool-type reactor with metal alloy fuel, a liquid-metal intermediate heat transport system, and passive decay heat rejection systems. Given this reference, a series of high-level cross-cutting phenomena was identified for a general class of single-fault undercooling or reactivity insertion transients that scopes the design basis space, with the goal of assisting with prioritization of documentation development efforts for key transient models in SAS: 1) Reactivity feedback response prior to scram; 2) System-wide thermal inertia; 3) Transition in natural circulation flow regime in heat removal systems; 4) Decay heat generation; 5) Steady-state fuel characterization; 5) Clad/fuel behavior at elevated temperatures; 6) Point kinetics and decay heat; 7) Pump coastdown behavior; 8) Core flow redistribution in loss of forced convection; 9) Pool stratification. As a demonstration of CGD of SAS4A/SASSYS-1 for a sodium pool reactor, a software qualification and dedication gap analysis as it relates to code documentation has been performed. This effort leverages the framework established as part of the SAS4A/SASSYS-1 SQA Program. This CGD demonstration provides a framework that vendors can build upon to demonstrate the applicability of the SAS4A/SASSYS-1 software for licensing a sodium-cooled pool-type fast reactor.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗