Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “verification & validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,045 records · Page 58

Rapid State Space Modeling Tool for Rectangular Wing Aeroservoelastic Studies

This report introduces a modeling and simulation tool for aeroservoelastic analysis of rectangular wings with trailing-edge control surfaces. The inputs to the code are planform design parameters such as wing span, aspect ratio, and number of control surfaces. Using this information, the generalized forces are computed using the doublet-lattice method. Using Roger's approximation, a rational function approximation is computed. The output, computed in a few seconds, is a state space aeroservoelastic model which can be used for analysis and control design. The tool is fully parameterized with default information so there is little required interaction with the model developer. All parameters can be easily modified if desired. The focus of this report is on tool presentation, verification, and validation. These processes are carried out in stages throughout the report. The rational function approximation is verified against computed generalized forces for a plate model. A model composed of finite element plates is compared to a modal analysis from commercial software and an independently conducted experimental ground vibration test analysis. Aeroservoelastic analysis is the ultimate goal of this tool, therefore, the flutter speed and frequency for a clamped plate are computed using damping-versus-velocity and frequency-versus-velocity analysis. The computational results are compared to a previously published computational analysis and wind-tunnel results for the same structure. A case study of a generic wing model with a single control surface is presented. Verification of the state space model is presented in comparison to damping-versus-velocity and frequency-versus-velocity analysis, including the analysis of the model in response to a 1-cos gust.

Verification and Validation↗

NASA Space Observatory Precision Pointing Benchmark Problem Development

An interagency workshop in May 2021 on guidance, navigation, and control (GNC) verification and validation (V&V) methods and techniques identified needs for the formulation and public release of relevant V&V benchmark problems as a practical way forward for the discipline. A decision was made by the NASA Technical Fellow for GNC and the NASA Engineering and Safety Center (NESC) GNC Technical Discipline Team (TDT) to produce a benchmark problem focusing on the problem of space observatory precision pointing. This report contains the results of the NESC assessment.

NASA Engineering and Safety Center↗

Leveraging interpolation models and error bounds for verifiable scientific machine learning

Effective verification and validation techniques for modern scientific machine learning workflows are challenging to devise. Statistical methods are abundant and easily deployed, but often rely on speculative assumptions about the data and methods involved. Error bounds for classical interpolation techniques can provide mathematically rigorous estimates of accuracy, but often are difficult or impractical to determine computationally. Here, in this work, we present a best-of-both-worlds approach to verifiable scientific machine learning by demonstrating that (1) multiple standard interpolation techniques have informative error bounds that can be computed or estimated efficiently; (2) comparative performance among distinct interpolants can aid in validation goals; (3) deploying interpolation methods on latent spaces generated by deep learning techniques enables some interpretability for black-box models. We present a detailed case study of our approach for predicting lift-drag ratios from airfoil images. Code developed for this work is available in a public Github repository.

97 MATHEMATICS AND COMPUTING↗

Validation of transport models using additive flux minimization technique

A new additive flux minimization technique is proposed for carrying out the verification and validation (V and V) of anomalous transport models. In this approach, the plasma profiles are computed in time dependent predictive simulations in which an additional effective diffusivity is varied. The goal is to obtain an optimal match between the computed and experimental profile. This new technique has several advantages over traditional V and V methods for transport models in tokamaks and takes advantage of uncertainty quantification methods developed by the applied math community. As a demonstration of its efficiency, the technique is applied to the hypothesis that the paleoclassical density transport dominates in the plasma edge region in DIII-D tokamak discharges. A simplified version of the paleoclassical model that utilizes the Spitzer resistivity for the parallel neoclassical resistivity and neglects the trapped particle effects is tested in this paper. It is shown that a contribution to density transport, in addition to the paleoclassical density transport, is needed in order to describe the experimental profiles. It is found that more additional diffusivity is needed at the top of the H-mode pedestal, and almost no additional diffusivity is needed at the pedestal bottom. The implementation of this V and V technique uses the FACETS::Core transport solver and the DAKOTA toolkit for design optimization and uncertainty quantification. The FACETS::Core solver is used for advancing the plasma density profiles. The DAKOTA toolkit is used for the optimization of plasma profiles and the computation of the additional diffusivity that is required for the predicted density profile to match the experimental profile.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Dosimetric accuracy of a deterministic radiation transport based {sup 192}Ir brachytherapy treatment planning system. Part II: Monte Carlo and experimental verification of a multiple source dwell position plan employing a shielded applicator

Purpose: The aim of this work is the dosimetric validation of a deterministic radiation transport based treatment planning system (BRACHYVISION v. 8.8, referred to as TPS in the following) for multiple {sup 192}Ir source dwell position brachytherapy applications employing a shielded applicator in homogeneous water geometries. Methods: TPS calculations for an irradiation plan employing seven VS2000 {sup 192}Ir high dose rate (HDR) source dwell positions and a partially shielded applicator (GM11004380) were compared to corresponding Monte Carlo (MC) simulation results, as well as experimental results obtained using the VIP polymer gel-magnetic resonance imaging three-dimensional dosimetry method with a custom made phantom. Results: TPS and MC dose distributions were found in agreement which is mainly within {+-}2%. Considerable differences between TPS and MC results (greater than 2%) were observed at points in the penumbra of the shields (i.e., close to the edges of the ''shielded'' segment of the geometries). These differences were experimentally verified and therefore attributed to the TPS. Apart from these regions, experimental and TPS dose distributions were found in agreement within 2 mm distance to agreement and 5% dose difference criteria. As shown in this work, these results mark a significant improvement relative to dosimetry algorithms that disregard the presence of the shielded applicator since the use of the latter leads to dosimetry errors on the order of 20%-30% at the edge of the ''unshielded'' segment of the geometry and even 2%-6% at points corresponding to the potential location of the target volume in clinical applications using the applicator (points in the unshielded segment at short distances from the applicator). Conclusions: Results of this work attest the capability of the TPS to accurately account for the scatter conditions and the increased attenuation involved in HDR brachytherapy applications employing multiple source dwell positions and partially shielded applicators.

60 APPLIED LIFE SCIENCES↗

Assessment of Sensor Data Accuracy within Gazebo/ROS for High-Precision Autonomous In-Space Robotic Operations

Modeling high-precision in-space servicing, assembly, and manufacturing operations in a simulated environment is a critical step in the development of robotic systems that will be used to autonomously assemble large-scale structures in space. Limited facility size and high costs for manufacturing prototypes make it challenging to conduct full-scale operational testing under appropriate environmental conditions; therefore, testing in a modular, high-fidelity simulation environment is necessary for verification and validation of technology and architecture designs prior to launch. Several modeling and simulation environments exist both within NASA and industry that can be used to test robotic system design and operations, including the widely used commercial tool Gazebo integrated with Robotic Operating System software. Because the performance of autonomous robotic systems relies heavily on the quality of sensor input data, this paper focuses on assessing the accuracy of pose data from an optical sensor model in the Gazebo environment against the behavior of real hardware. The results of the tests will help developers using Gazebo for large-scale, high-precision simulation to account for modeling inaccuracies within their robotic control system algorithms.

simulation↗

Recent SCALE Activities Within the Nuclear Criticality Safety Program

The role of SCALE in the Department of Energy’s Nuclear Criticality Safety Program (NCSP) is defined according to the Five-Year Plan, and summarized as follows. 1. Sustain/improve SCALE NCS features through user driven enhancements, software quality assurance (SQA) and validation and verification (V&V). 2. Assure adaptability to various computing platforms and compilers. 3. Improve user interfaces/documentation consistent with modern engineering software. 4. Support responsive communication to SCALE criticality safety users through SCALE Newsletters, email notices, and updates on the SCALE website. 5. Modernize software infrastructure and capabilities to improve quality and reliability and to ensure long term sustainability of the NCS capabilities. This paper describes the specific activities which have been performed within each area above for the NCSP in the fiscal year (FY) 2018, from October 1, 2017, to September 30, 2018.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Benchmark problems in aerosol evolution: Comparison of some exact and DSMC results

Aerosols are generated in many normal or accident situations associated with the nuclear enterprise. For a good understanding and modeling of the nuclear source term, for example, good experimental data and computational programs relating to aerosol evolution are needed. In the past several years there has been an effort to explore use of the Direct Simulation Monte Carlo (DSMC) approach for such estimations to improve fidelity of computations to the actual physics and chemistry of the accidents. An integral part of these efforts has been verification and validation of the DSMC technique against other available results wherever possible. Herein this paper explores verification of DSMC against one existing and two new benchmark problems covering condensation, coagulation, deposition and two-component aerosols. The simulations compare well with the exact results, providing further confidence in the use of DSMC.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Operational Modal Analysis of the Artemis I Dynamic Rollout Test and Wet Dress Rehearsal

NASA has developed an expendable heavy lift launch vehicle capability, the Space Launch System (SLS), to support lunar and deep space exploration. The uncrewed Artemis I was the first flight of this new launch vehicle and tested critical systems for the upcoming crewed Artemis II flight to the moon. Accelerations were recorded at a multitude of locations on Artemis, the Mobile Launcher (ML), and the Crawler Transporter (CT)during the rollout of Artemis I from the Vehicle Assembly Building (VAB) to Launch Pad 39B March 2022 and is referred to as the Artemis I Dynamic Rollout Test (DRT). While Artemis I was at Launch Pad 39B, the Wet Dress Rehearsal (WDR) was performed to demonstrate launch readiness and acceleration measurements were also recorded. Finally, Artemis I rolled back from Launch Pad 39B to the VAB in April 2022, where acceleration measurements were also recorded and is referred to as the rollback portion of DRT. Because the forces during rollout and at the launch pad acting on Artemis I, the ML, and the CT are not directly measurable, Operational Modal Analysis (OMA) techniques, instead of traditional Experimental Modal Analysis (EMA) techniques, were used to identify modal characteristics. The OMA analysis of DRT and WDR directly builds upon the lessons learned from the OMA analysis of an earlier rollout of the ML from the VAB. DRT and WDR dynamic characteristics will be used to support SLS Integrated Modal Test finite element model correlation efforts and Exploration Ground System ML and CT finite element model verification and validation, which are part of the Building Block approach the Space Launch System program has implemented. The dynamic characteristics extracted from DRT as well as the rollout acceleration time histories themselves will be used in the development of generic rollout forcing functions that will provide refined estimates of the Artemis IV rollout forces, which will have the heavier and larger SLS Block 1B launch vehicle and Mobile Launcher 2 (ML-2). This paper briefly describes Artemis I, the ML, and the CT physical characteristics, DRT rollout/rollback and WDR data collection, the challenges in implementing OMA techniques due in part to the CT harmonics, and how these challenges were overcome to obtain the Artemis I DRT configuration and WDR configuration modal characteristics.

Apollo↗

Operational Modal Analysis of the Artemis I Dynamic Rollout Test and Wet Dress Rehearsal

NASA has developed an expendable heavy lift launch vehicle capability, the Space Launch System (SLS), to support lunar and deep space exploration. The uncrewed Artemis I was the first flight of this new launch vehicle and tested critical systems for the upcoming crewed Artemis II flight to the moon. Accelerations were recorded at a multitude of locations on Artemis, the Mobile Launcher (ML), and the Crawler Transporter (CT)during the rollout of Artemis I from the Vehicle Assembly Building (VAB) to Launch Pad 39B March 2022 and is referred to as the Artemis I Dynamic Rollout Test (DRT). While Artemis I was at Launch Pad 39B, the Wet Dress Rehearsal (WDR) was performed to demonstrate launch readiness and acceleration measurements were also recorded. Finally, Artemis I rolled back from Launch Pad 39B to the VAB in April 2022, where acceleration measurements were also recorded and is referred to as the rollback portion of DRT. Because the forces during rollout and at the launch pad acting on Artemis I, the ML, and the CT are not directly measurable, Operational Modal Analysis (OMA) techniques, instead of traditional Experimental Modal Analysis (EMA) techniques, were used to identify modal characteristics. The OMA analysis of DRT and WDR directly builds upon the lessons learned from the OMA analysis of an earlier rollout of the ML from the VAB. DRT and WDR dynamic characteristics will be used to support SLS Integrated Modal Test finite element model correlation efforts and Exploration Ground System ML and CT finite element model verification and validation, which are part of the Building Block approach the Space Launch System program has implemented. The dynamic characteristics extracted from DRT as well as the rollout acceleration time histories themselves will be used in the development of generic rollout forcing functions that will provide refined estimates of the Artemis IV rollout forces, which will have the heavier and larger SLS Block 1B launch vehicle and Mobile Launcher 2 (ML-2). This paper briefly describes Artemis I, the ML, and the CT physical characteristics, DRT rollout/rollback and WDR data collection, the challenges in implementing OMA techniques due in part to the CT harmonics, and how these challenges were overcome to obtain the Artemis I DRT configuration and WDR configuration modal characteristics.

Apollo↗

The NASA Hyper-X Program

This paper provides an overview of NASA's Hyper-X Program; a focused hypersonic technology effort designed to move hypersonic, airbreathing vehicle technology from the laboratory environment to the flight environment. This paper presents an overview of the flight test program, research objectives, approach, schedule and status. Substantial experimental database and concept validation have been completed. The program is currently concentrating on the first, Mach 7, vehicle development, verification and validation in preparation for wind-tunnel testing in 1998 and flight testing in 1999. Parallel to this effort the Mach 5 and 10 vehicle designs are being finalized. Detailed analytical and experimental evaluation of the Mach 7 vehicle at the flight conditions is nearing completion, and will provide a database for validation of design methods once flight test data are available.

Freeman, Delman C., Jr.↗

Structural Health Monitoring of Nuclear Spent Fuel Storage Facilities

Interim storage of spent nuclear fuel from reactor sites has gained additional importance and urgency for resolving waste-management-related technical issues. To ensure that nuclear power remains clean energy, monitoring has been identified by DOE as a high priority cross-cutting need, necessary to determine and predict the degradation state of the systems, structures, and components (SSCs) important to safety (ITS). Therefore, nondestructive structural condition monitoring becomes a need to be installed on existing or to be integrated into future storage system to quantify the state of health or to guarantee the safe operation of nuclear power plants (NPPs) during their extended life span. In this project, the lead university and the collaborating national laboratory teamed to develop a nuclear structural health monitoring (n-SHM) system based on in-situ piezoelectric sensing technologies that can monitor structural degradation and aging for nuclear spent fuel DCSS and similar structures. We also aimed to identify and quantify possible influences of nuclear spent fuel environment (temperature and radiation) to the piezoelectric sensor system and come up with adequate solutions and guidelines therefore. We have therefore developed analytical model for piezoelectric based n-SHM methods, with considerations of temperature and irradiation influence on the model of sensing and algorithms in acoustic emission (AE), guided ultrasonic waves (GUW), and electromechanical impedance spectroscopy (EMIS). On the other side, experimentally the temperature and irradiation influence on the piezoelectric sensors and sensing capabilities were investigated. Both short-term and long-term irradiation investigation with our collaborating national laboratory were performed. Moreover, we developed multi-modal sensing, validated in laboratory setup, and conducted the testing on the We performed multi-modal sensing development, verification and validation tests on very complex structures including a medium-scale vacuum drying chamber and a small-scale mockup canister available for the desired testing. Our work developed the potential candidate for long term structural health monitoring of spent fuel canister through piezoelectric wafer sensors and provided the sensing methodologies based on AE and GUW methodologies. It overall provides an innovative system and methodology for enhancing the safe operation of nuclear power plant. All major accomplishments planned in the original proposal were successfully achieved.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Active suspension design for a Large Space Structure ground test facility

The expected future high performance requirements for Large Space Structures (LSS) enforce technology innovations such as active vibration damping techniques e.g., by means of structure sensors and actuators. The implementation of new technologies like that requires an interactive and integrated structural and control design with an increased effort in hardware validation by ground testing. During the technology development phase generic system tests will be most important covering verification and validation aspects up to the preparation and definition of relevant space experiments. For many applications using advanced designs it is deemed necessary to improve existing testing technology by further reducing disturbances and gravity coupling effects while maintaining high performance reliability. A key issue in this context is the improvement of suspension techniques. The ideal ground test facility satisfying these requirements completely will never be found. The highest degree of reliability will always be obtained by passive suspension methods taking into account severe performance limitations such as non-zero rigid body modes, restriction of degrees of freedom of motion and frequency response limitations. Passive compensation mechanisms, e.g., zero-spring-rate mechanisms, either require large moving masses or they are limited with respect to low-frequency performance by friction, stiction or other non-linear effects. With active suspensions these limitations can be removed to a large extent thereby increasing the range of applications. Despite an additional complexity which is associated with a potential risk in reliability their development is considered promising due to the amazing improvement of real-time control technology which is still continuing.

Lange, Thomas J. H.↗

A highly reliable, high performance open avionics architecture for real time Nap-of-the-Earth operations

An Army Fault Tolerant Architecture (AFTA) has been developed to meet real-time fault tolerant processing requirements of future Army applications. AFTA is the enabling technology that will allow the Army to configure existing processors and other hardware to provide high throughput and ultrahigh reliability necessary for TF/TA/NOE flight control and other advanced Army applications. A comprehensive conceptual study of AFTA has been completed that addresses a wide range of issues including requirements, architecture, hardware, software, testability, producibility, analytical models, validation and verification, common mode faults, VHDL, and a fault tolerant data bus. A Brassboard AFTA for demonstration and validation has been fabricated, and two operating systems and a flight-critical Army application have been ported to it. Detailed performance measurements have been made of fault tolerance and operating system overheads while AFTA was executing the flight application in the presence of faults.

Harper, Richard E.↗

SU-D-BRC-03: Development and Validation of an Online 2D Dose Verification System for Daily Patient Plan Delivery Accuracy Check

Purpose: All plan verification systems for particle therapy are designed to do plan verification before treatment. However, the actual dose distributions during patient treatment are not known. This study develops an online 2D dose verification tool to check the daily dose delivery accuracy. Methods: A Siemens particle treatment system with a modulated scanning spot beam is used in our center. In order to do online dose verification, we made a program to reconstruct the delivered 2D dose distributions based on the daily treatment log files and depth dose distributions. In the log files we can get the focus size, position and particle number for each spot. A gamma analysis is used to compare the reconstructed dose distributions with the dose distributions from the TPS to assess the daily dose delivery accuracy. To verify the dose reconstruction algorithm, we compared the reconstructed dose distributions to dose distributions measured using PTW 729XDR ion chamber matrix for 13 real patient plans. Then we analyzed 100 treatment beams (58 carbon and 42 proton) for prostate, lung, ACC, NPC and chordoma patients. Results: For algorithm verification, the gamma passing rate was 97.95% for the 3%/3mm and 92.36% for the 2%/2mm criteria. For patient treatment analysis,the results were 97.7%±1.1% and 91.7%±2.5% for carbon and 89.9%±4.8% and 79.7%±7.7% for proton using 3%/3mm and 2%/2mm criteria, respectively. The reason for the lower passing rate for the proton beam is that the focus size deviations were larger than for the carbon beam. The average focus size deviations were −14.27% and −6.73% for proton and −5.26% and −0.93% for carbon in the x and y direction respectively. Conclusion: The verification software meets our requirements to check for daily dose delivery discrepancies. Such tools can enhance the current treatment plan and delivery verification processes and improve safety of clinical treatments.

60 APPLIED LIFE SCIENCES↗

Reactor Subsystem Simulation for Nuclear Hybrid Energy Systems

Nuclear Hybrid Energy Systems (NHES) could be a key part of the solution to achieving energy security, may provide reliable power availability even with increasing renewable energy penetration into the power grid, and may allow repurposing excess electricity in times of low demand. Incorporating a fission-based power source in a multi-output system (electricity and process heat) can offer significant advantages over carbon-based production sources, such as coal or natural gas, including reduction in atmospheric carbon emissions. In an integrated multi-output system, thermal energy from the nuclear reactor subsystem can be diverted to industrial applications in times of low electricity demand. High temperature, high quality heat from advanced reactor designs might be used for hydrogen production or synthetic fuel production (coal-to-liquid or natural gas-to-liquid processes). Low temperature heat from advanced reactor designs or the current and future fleet of light water reactors (LWRs) might be applied to desalination processes or be stored for later use in low temperature ammonia or hydrocarbon-based thermal cycles. The NHES research team is currently developing a dynamic simulation of an integrated hybrid energy system. A detailed simulation of proposed NHES architectures will allow initial computational demonstration of a tightly coupled NHES to identify key reactor subsystem requirements, identify candidate reactor technologies for a hybrid system, and identify key challenges to operation of the coupled system. This work will provide a baseline for later coupling of design-specific reactor models through industry collaboration. The modeling capability addressed in this report focuses on the reactor subsystem simulation. Many computational tools and methods are available for modeling a nuclear reactor, power conversion systems and associated process applications. One method is to develop a single program capable of modeling the entire system. Another is to combine two or more existing computer programs, each modeling a portion of the system for which it is validated, where the programs exchange information to compute the solution. The former method requires a lengthy development and verification and validation process. The latter method leverages industry standard software to reduce development and funding requirements. Preliminary system models have been developed by Idaho National Laboratory researchers and are currently being enhanced to assess integrated system performance given multiple sources (e.g., nuclear + wind) and multiple applications (i.e., electricity + process heat). Initial efforts to integrate a Fortran-based simulation of a small modular reactor (SMR) with the balance of plant model have been completed in FY12. This initial effort takes advantage of an existing SMR model developed at North Carolina State University to provide initial integrated system simulation for a relatively low cost. The SMR subsystem simulation details are discussed in this report.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A digital flight control system verification laboratory

A NASA/FAA program has been established for the verification and validation of digital flight control systems (DFCS), with the primary objective being the development and analysis of automated verification tools. In order to enhance the capabilities, effectiveness, and ease of using the test environment, software verification tools can be applied. Tool design includes a static analyzer, an assertion generator, a symbolic executor, a dynamic analysis instrument, and an automated documentation generator. Static and dynamic tools are integrated with error detection capabilities, resulting in a facility which analyzes a representative testbed of DFCS software. Future investigations will ensue particularly in the areas of increase in the number of software test tools, and a cost effectiveness assessment.

De Feo, P.↗

High-Resolution Gamma Spectrometry Data Set for High Burnup Pressurized Water Reactor Used Fuel

Over the past decade, considerable resources have been applied to investigate verification of used nuclear fuel assemblies for international safeguards. The opportunity to expand the available data used to validate these verification techniques was presented in 2016 by the High Burnup Spent Fuel Data Project, which made 25 high-burnup pressurized water reactor used fuel rods available for measurement in the Irradiated Fuels Examination Laboratory at Oak Ridge National Laboratory. With the support of the National Nuclear Security Administration Office of Nonproliferation and Arms Control, a 2017 campaign measured the 25 used fuel rods with a high-resolution gamma spectrometer. A planar high-purity germanium detector was used to provide high-efficiency across an energy range from 60 keV to 3 MeV. Gamma spectra of individual fuel rods were collected in 4.5 mm steps along the entire length of each rod. In addition, spectra were collected on select rods in rotational increments of 30 degrees to provide data on the distribution of fission products along the rod perimeter. The spectra are stored on a controlled-access website for use by others. This paper describes the measurement geometry, used fuel rod characteristics, example spectra, and preliminary analyses performed during the measurement campaign.

Smith, Susan↗