Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “verification & validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 937 records · Page 52

Computer Modeling and Simulation

Verification and validation of computer codes and models used in simulation are two aspects of the scientific practice of high importance and have recently been discussed by philosophers of science. While verification is predominantly associated with the correctness of the way a model is represented by a computer code or algorithm, validation more often refers to model’s relation to the real world and its intended use. It has been argued that because complex simulations are generally not transparent to a practitioner, the Duhem problem can arise for verification and validation due to their entanglement; such an entanglement makes it impossible to distinguish whether a coding error or model’s general inadequacy to its target should be blamed in the case of the model failure. I argue that in order to disentangle verification and validation, a clear distinction between computer modeling (construction of mathematical computer models of elementary processes) and simulation (construction of models of composite objects and processes by means of numerical experimenting with them) needs to be made. Holding on to that distinction, I propose to relate verification (based on theoretical strategies such as inferences) to modeling and validation, which shares the common epistemology with experimentation, to simulation. To explain reasons of their intermittent entanglement I propose a weberian ideal-typical model of modeling and simulation as roles in practice. I suggest an approach to alleviate the Duhem problem for verification and validation generally applicable in practice and based on differences in epistemic strategies and scopes

Pronskikh, V. S.↗

Phenomena Identification and Ranking Table (PIRT) for Fluoride High-Temperature Reactor (FHR) Neutronics

The deployment of Fluoride (salt-cooled) High Temperature Reactors (FHRs) has many potential benefits such as improved safety, improved economics, and a diversification of the energy portfolio because of its capability to supply industrial process heat. However, significant challenges remain before this class of reactors can be deployed, mostly related to its technology readiness. A recent study identified several areas in need of further development in order to advance the technology. These include the verification and validation of neutronics and thermal hydraulics modeling and simulation tools in support of design, safety analysis and licensing. The focus of this paper is to summarize the issues for verification and validation of neutronics tools. Current tools for neutronics analysis of LWRs are inadequate for the simulation of salt cooled reactors. The methodologies developed for the high temperature gas cooled reactors (HTGRs) have some relevance for FHRs because of the similarities between the two reactors such as graphite block structure, encapsulated fuel particles, and high operating temperatures. However, they are not sufficient for the accuracy desired of a code for licensing as they have a number of important differences neutronically, such as the use of liquid salt containing beryllium as a coolant and their unique fuel configuration.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Uncertainty and Sensitivity Analysis of Reactivity Insertion Accidents using BISON Fuel Performance Code

The development of Accident Tolerant Fuels (ATF) has expanded into a considerable research program in the wake of the events at the Japanese Fukushima Daiichi nuclear power plant in 2011. The ATF goal is to insert a test assembly into a commercial reactor by 2022. To support this, testing of the ATF design under off-normal conditions is needed to assess the 'enhanced accident tolerance' capability of the fuel rod design over standard UO{sub 2}-Zircaloy concepts. Transient testing capabilities are necessary for off-normal testing of events such as loss of coolant accidents (LOCA) and reactivity insertion accidents (RIA). A transient testing program has been developed to support the testing of ATF designs. The Transient Reactor Test (TREAT) facility has been chosen as the site to perform the transient testing of the ATF designs. TREAT is a versatile test facility capable of subjecting fuel specimens to various off-normal conditions. Historic TREAT experiments were performed in a variety of experimental test vehicles including static environment capsules, once-through flowing systems, and also recirculating flowing systems. The planned TREAT experiments will be operated under PWR conditions. Therefore, a static capsule vehicle is under development to handle required temperatures and pressures. The static capsule, termed the Static Environment Rodlet Transient Test Apparatus (SERTTA), will be used for irradiation tests in TREAT to subject ATF fuel rodlets to a range of power pulse conditions and environments. To aid in the design and analysis of future tests in TREAT, the fuel performance code BISON is being used. Fuel performance codes capable of accident modeling have been developed for some time and they have shown an ability to reproduce experimental results with some degree of adequacy, but they still require extensive verification and validation. Future experiments in TREAT will add to a limited database of past transient tests performed in transient reactors to support LWR systems. These tests can be used for future verification and validation of fuel performance codes. Understanding the impact of the uncertainty of influential parameters is critical for not only analyzing the results of the experiment but also for modeling and validation of codes. For example, uncertainties associated with the initial manufactured state of the sample, instrument measurements, material property models, and planned experiment conditions can provide important insight into model performance, experimental data, and play an important role in experimental design. The objective of this work is to perform an uncertainty and sensitivity analysis on a simplified RIA case of a standard UO{sub 2}-Zircaloy sample using expected nominal conditions in the SERTTA capsule in TREAT. The BISON fuel performance code is used in conjunction with DAKOTA (Design Analysis Kit for Optimization and Tera-scale Applications) to perform the uncertainty and sensitivity analysis. (authors)

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Psyche Hardware Abstraction Simulation Environment (PHASE): Development of High-Fidelity Downlink Model for Flight Software Performance Testing

NASA’s Katherine Johnson Independent Verification and Validation (IV&V) Independent Test Capability (ITC) Team develops high fidelity software-only simulations (or “digital-twins”) of NASA’s most critical missions that are then used for software verification and validation (V&V). One such digital-twin simulator nearing maturity is the Psyche Hardware Abstraction Simulation Environment (PHASE). PHASE utilizes an instruction set simulator along with ITC-developed avionics models. PHASE includes a newly-developed model of the telecom hardware with a high-fidelity downlink interface, capable of supporting reconfigurable downlink data rates and transmission modes. The different downlink transmission modes allow more processing to be ceded from software onto the telecom hardware. Thus, we are able to monitor the performance of the downlink software module in the time-partitioned OS and perform more realistic dynamic testing based on software’s resource utilization. This presentation will cover PHASE, avionics modeling, the downlink model, and its usage for flight software performance testing.

modeling↗

CFD Code Validation of Wall Heat Fluxes for a G02/GH2 Single Element Combustor

This paper puts forth the case for the need for improved injector design tools to meet NASA s Vision for Space Exploration goals. Requirements for this improved tool are outlined and discussed. The potential for Computational Fluid Dynamics (CFD) to meet these requirements is noted along with its current shortcomings, especially relative to demonstrated solution accuracy. The concept of verification and validation is introduced as the primary process for building and quantifying the confidence necessary for CFD to be useful as an injector design tool. The verification and validation process is considered in the context of the Marshall Space Flight Center (MSFC) Combustion Devices CFD Simulation Capability Roadmap via the Simulation Readiness Level (SRL) concept. The portion of the validation process which demonstrates the ability of a CFD code to simulate heat fluxes to a rocket engine combustor wall is the focus of the current effort. The FDNS and Loci-CHEM codes are used to simulate a shear coaxial single element G02/GH2 injector experiment. The experiment was conducted a t a chamber pressure of 750 psia using hot propellants from preburners. A measured wall temperature profile is used as a boundary condition to facilitate the calculations. Converged solutions, obtained from both codes by using wall functions with the K-E turbulence model and integrating to the wall using Mentor s baseline turbulence model, are compared to the experimental data. The initial solutions from both codes revealed significant issues with the wall function implementation associated with the recirculation zone between the shear coaxial jet and the chamber wall. The FDNS solution with a corrected implementation shows marked improvement in overall character and level of comparison to the data. With the FDNS code, integrating to the wall with Mentor s baseline turbulence model actually produce a degraded solution when compared to the wall function solution with the K--E model. The Loci-CHEM solution, produced by integrating to the wall with Mentor s baseline turbulence model, matches both the heat flux rise rate in the near injector region and the peak heat flux level very well. However, it moderately over predicts the heat fluxes downstream of the reattachment point. The Loci-CHEM solution achieved by integrating to the wall with Mentor s baseline turbulence model was clearly superior to the other solutions produced in this effort.

Lin, Jeff↗

Thermochemical Nonequilibrium Modeling in a Continuous-Galerkin, Finite-Element Framework

The presented work discusses the implementation, verification, and validation of Park's two-temperature model in a scalable, computational fluid dynamics (CFD) code developed at the US Department of Energy's Oak Ridge National Laboratory (ORNL). The implementation of Park's two-temperature model was verified through 0D test cases involving an adiabatic reactor and a nitrogen thermal bath. The implementation was then validated through comparisons with other validated CFD codes and experimental data on a hypersonic cylinder and double cones. These are standard benchmark test cases for thermochemical non-equilibrium (TCNE) modeling, and all data are shared publicly. The verification and validation results showed that ORNL's in-house CFD code could model complex, high-speed flow problems with and without TCNE modeling. This work is essential for future research involving 3D shock wave/boundary layer interactions (SBLIs).

Nutter, Nicole↗

DEVELOPMENT AND TESTING OF FAULT-DIAGNOSIS ALGORITHMS FOR REACTOR PLANT SYSTEMS

Argonne National Laboratory is further developing fault diagnosis algorithms for use by the operator of a nuclear plant to aid in improved monitoring of overall plant condition and performance. The objective is better management of plant upsets through more timely, informed decisions on control actions with the ultimate goal of improved plant safety, production, and cost management. Integration of these algorithms with visual aids for operators is taking place through a collaboration under the concept of an operator advisory system. This is a software entity whose purpose is to manage and distill the enormous amount of information an operator must process to understand the plant state, particularly in off-normal situations, and how the state trajectory will unfold in time. The fault diagnosis algorithms were exhaustively tested using computer simulations of twenty different faults introduced into the chemical and volume control system (CVCS) of a pressurized water reactor (PWR). The algorithms are unique in that each new application to a facility requires providing only the piping and instrumentation diagram (PID) and no other plant-specific information; a subject-matter expert is not needed to install and maintain each instance of an application. The testing approach followed accepted procedures for verifying and validating software. It was shown that the code satisfies its functional requirement which is to accept sensor information, identify process variable trends based on this sensor information, and then to return an accurate diagnosis based on chains of rules related to these trends. The validation and verification exercise made use of GPASS, a one-dimensional systems code, for simulating CVCS operation. Plant components were failed and the code generated the resulting plant response. Parametric studies with respect to the severity of the fault, the richness of the plant sensor set, and the accuracy of sensors were performed as part of the validation exercise. The background and overview of the software will be presented to give an overview of the approach. Following, the verification and validation effort using the GPASS code for simulation of plant transients including a sensitivity study on important parameters will be presented

Fault Diagnosis Algorithm↗

Overview of the Exploration Exercise Device Validation Study Plans

The NASA has determined that a multi-functional exercise device will be developed for use as an exercise device during exploration missions. The device will allow for full body resistance and metabolic exercise necessary to minimize physiological losses during space flight and to maintain fitness necessary to perform critical mission tasks. Prior to implementation as an exercise device on an Exploration vehicle, there will be verification and validation testing completed to determine device efficacy at providing the necessary training stimuli to achieve desired goals. Because the exploration device will be new device that has yet be specified, specific Verification and Validation (V&V) protocols have yet to be developed. Upon delivery of an exploration exercise device training unit, stakeholders throughout NASA will develop V&V plans that include ground-based testing and testing on the International Space Station (ISS). Stakeholders will develop test protocols that include success criterion for the device. Ground tests will occur at NASA Johnson Space Station prior to flight testing. The intents of the ground tests are to allow crew, spaceflight medicine, science, engineering, Astronaut Strength, Conditioning, and Reconditioning staff, and others to gain experience in the best utilization of the device. The goal is to obtain an evidence base for recommending use of the device on the ISS. The developed protocol will be created to achieve multiple objectives, including determining if the device provides an adequate training stimulus for 5th - 95th percentile males and females, allows for exercise modalities that protect functional capability, and is robust and can withstand extensive human use. Although protocols are yet to be determined, current expectations include use of the device by test subjects and current crew in order to obtain quantitative and qualitative feedback. Information obtained during the ground tests may be used to influence device modifications during design iterations. Assuming successful ground tests, the device will be installed on the ISS for testing during space flight. Spaceflight testing is envisioned to include an activation and checkout (ACO) phase and a V&V phase. During the ACO phase, 1-2 crewmembers will exercise with the device to ensure proper function. ACO is expected to last multiple months because of the many modes and methods of exercise that need to be assessed. However, the goal is to complete the ACO as quickly as possible. Once successful ACO occurs, the crew will be free to use the device for normal exercise pending concurrence from stakeholders. V&V tests on the ISS will ideally consist of crew using the device for all of their exercise for an entire mission. Exercise prescriptions will be supplied that replicate expected prescriptions during exploration missions. Crew that are not enrolled in the V&V studies would be also free to use the device as their schedule permits. As experience is gained by users, exercise protocols could change. The intent of all V&V testing is to ensure that all have thorough understanding of experience at optimizing device capability

DeWitt, J. K.↗

FOCAL Campaign I: Advanced Wind Turbine Control Strategies

Campaign I of the Floating Offshore-wind Controls Advanced Laboratory Experimental Program (FOCAL) aims to generate a dataset enabling the validation of aerodynamic performance of a scaled turbine mounted on a rigid tower in a fixed condition. The turbine considered in the FOCAL testing campaigns is the IEA-Wind 15MW Reference Wind Turbine. This scaled model is capable of simulating advanced blade-pitch control strategies in a high-quality wind field. The turbine is fully instrumented to record a variety of parameters in real time such as structural loads and dynamics. The test data considered was generated at the University of Maine's Harold Alfond Wind and Wave (W2) testing facility. The Load Cases (LC) considered in this testing campaign are as follows: LC 1.X - Constant wind and blade-pitch with varying rotor speeds LC 2.X - Constant wind and rotor speed with varying blade-pitch LC 3.X - Varying wind with active closed-loop control Detailed properties on the modeled system are found in the following reference: Lenfest E., Floating Offshore-wind Controls Advanced Laboratory (FOCAL) Experimental Program - Campaign I: 1:70 Model-scale Testing of the IEA-Wind 15MW Reference Turbine. UMaine ASCC Report Number 23-40-1183. Details on the results of the verification and validation are found in the following reference: Mendoza, Nicole et al., "Verification and Validation of Model-Scale Turbine Performance and Control for the IEA Wind 15 MW Reference Wind Turbine," Energies, vol. 15, no. 20, 2022, https://doi.org/10.3390/en15207649.

17 WIND ENERGY↗

NEAMS Experimental Support for Code Validation, INL FY2009

The goal is for all modeling and simulation tools to be demonstrated accurate and reliable through a formal Verification and Validation (V&V) process, especially where such tools are to be used to establish safety margins and support regulatory compliance, or to design a system in a manner that reduces the role of expensive mockups and prototypes. Whereas the Verification part of the process does not rely on experiment, the Validation part, on the contrary, necessitates as many relevant and precise experimental data as possible to make sure the models reproduce reality as closely as possible. Hence, this report presents a limited selection of experimental data that could be used to validate the codes devoted mainly to Fast Neutron Reactor calculations in the US. Emphasis has been put on existing data for thermal-hydraulics, fuel and reactor physics. The principles of a new “smart” experiment that could be used to improve our knowledge of neutron cross-sections are presented as well. In short, it consists in irradiating a few milligrams of actinides and analyzing the results with Accelerator Mass Spectroscopy to infer the neutron cross-sections. Finally, the wealth of experimental data relevant to Fast Neutron Reactors in the US should not be taken for granted and efforts should be put on saving these 30-40 years old data and on making sure they are validation-worthy, i.e. that the experimental conditions and uncertainties are well documented.

97 MATHEMATICS AND COMPUTING↗

Development of a Subcell Based Modeling Approach for Modeling the Architecturally Dependent Impact Response of Triaxially Braided Polymer Matrix Composites

Understanding the high velocity impact response of polymer matrix composites with complex architectures is critical to many aerospace applications, including engine fan blade containment systems where the structure must be able to completely contain fan blades in the event of a blade-out. Despite the benefits offered by these materials, the complex nature of textile composites presents a significant challenge for the prediction of deformation and damage under both quasi-static and impact loading conditions. The relatively large mesoscale repeating unit cell (in comparison to the size of structural components) causes the material to behave like a structure rather than a homogeneous material. Impact experiments conducted at NASA Glenn Research Center have shown the damage patterns to be a function of the underlying material architecture. Traditional computational techniques that involve modeling these materials using smeared homogeneous, orthotropic material properties at the macroscale result in simulated damage patterns that are a function of the structural geometry, but not the material architecture. In order to preserve heterogeneity at the highest length scale in a robust yet computationally efficient manner, and capture the architecturally dependent damage patterns, a previously-developed subcell modeling approach where the braided composite unit cell is approximated as a series of four adjacent laminated composites is utilized. This work discusses the implementation of the subcell methodology into the commercial transient dynamic finite element code LS-DYNA (Livermore Software Technology Corp.). Verification and validation studies are also presented, including simulation of the tensile response of straight-sided and notched quasi-static coupons composed of a T700/PR520 triaxially braided [0deg/60deg/-60deg] composite. Based on the results of the verification and validation studies, advantages and limitations of the methodology as well as plans for future work are discussed.

finite element method↗

Dynamic Stability Analysis Using Free-Flight CFD

Blunt body probes are the primary design for atmospheric entry. The blunted capsule shape, while desirable for the decreased forebody heating, typically experiences dynamic instability at low supersonic and transonic flight. At moderate to low supersonic conditions, the unsteady wake begins to adversely interact with the vehicle in free-flight resulting in attitude oscillations which can grow in time and result in tumbling. Understanding vehicle dynamics is thus important when considering vehicle entry design and guidance navigation and control (GN&C) considerations. Historically, dynamic stability has been carried out exclusively using experimental techniques. The wide range of experimental approaches provide reasonable coverage in Mach and dynamic pressure space for a given trajectory, however achieving flight similitude is often difficult or impossible. Advancements in Computational Fluid Dynamics (CFD) techniques allow for dynamic motion of the vehicle surface during the simulation with either forced/prescribed motion or free motion in response to fluid forces. Several examples of CFD software with the ability to simulate fluid dynamics and vehicle motion are available in literature. The Free-Flight CFD (FF-CFD) capability developed by NASA Ames within the US3D flow solver has shown extensive validation and verification (V&V) efforts from moderate to low supersonic flow across a range of vehicle architectures. The solver is able to simulate full rotational and translation motion resulting in full 6 degrees-of-freedom (DoF) motion. The validation and verification efforts the solver's ability to predict the motion of a ballistic range model as compared to experimental results. Similar to other computational capabilities in literature, FF-CFD relied on heritage data reduction methodologies and processes for reducing dynamic data into aerodynamic coefficients intended for use in design and trajectory codes. These heritage approaches, initially developed with the assumptions (and restrictions) of ground test facilities, resulted in the significant culling of the full 6-DoF dynamic data set to discrete values which are then fit using an aerodynamic model. Recent development of simulation and data reduction methodologies has resulted in an improved approach to FF-CFD simulations of vehicle dynamics which leverage the control of dynamic constraints within a simulation set-up. The presentation of this work will cover the constrained dynamic simulation approach for deriving dynamic coefficients for a Genesis capsule. The methodology will be outlined and a discussion of implications in motion restriction will be discussed. Finally, reconstructed vehicle trajectories using FF-CFD derived aerodynamic coefficients will be presented.

Joseph M Brock↗

Work Practice Simulation of Complex Human-Automation Systems in Safety Critical Situations: The Brahms Generalized berlingen Model

The transition from the current air traffic system to the next generation air traffic system will require the introduction of new automated systems, including transferring some functions from air traffic controllers to on­-board automation. This report describes a new design verification and validation (V&V) methodology for assessing aviation safety. The approach involves a detailed computer simulation of work practices that includes people interacting with flight-critical systems. The research is part of an effort to develop new modeling and verification methodologies that can assess the safety of flight-critical systems, system configurations, and operational concepts. The 2002 Ueberlingen mid-air collision was chosen for analysis and modeling because one of the main causes of the accident was one crew's response to a conflict between the instructions of the air traffic controller and the instructions of TCAS, an automated Traffic Alert and Collision Avoidance System on-board warning system. It thus furnishes an example of the problem of authority versus autonomy. It provides a starting point for exploring authority/autonomy conflict in the larger system of organization, tools, and practices in which the participants' moment-by-moment actions take place. We have developed a general air traffic system model (not a specific simulation of Überlingen events), called the Brahms Generalized Ueberlingen Model (Brahms-GUeM). Brahms is a multi-agent simulation system that models people, tools, facilities/vehicles, and geography to simulate the current air transportation system as a collection of distributed, interactive subsystems (e.g., airports, air-traffic control towers and personnel, aircraft, automated flight systems and air-traffic tools, instruments, crew). Brahms-GUeM can be configured in different ways, called scenarios, such that anomalous events that contributed to the Überlingen accident can be modeled as functioning according to requirements or in an anomalous condition, as occurred during the accident. Brahms-GUeM thus implicitly defines a class of scenarios, which include as an instance what occurred at Überlingen. Brahms-GUeM is a modeling framework enabling "what if" analysis of alternative work system configurations and thus facilitating design of alternative operations concepts. It enables subsequent adaption (reusing simulation components) for modeling and simulating NextGen scenarios. This project demonstrates that BRAHMS provides the capacity to model the complexity of air transportation systems, going beyond idealized and simple flights to include for example the interaction of pilots and ATCOs. The research shows clearly that verification and validation must include the entire work system, on the one hand to check that mechanisms exist to handle failures of communication and alerting subsystems and/or failures of people to notice, comprehend, or communicate problematic (unsafe) situations; but also to understand how people must use their own judgment in relating fallible systems like TCAS to other sources of information and thus to evaluate how the unreliability of automation affects system safety. The simulation shows in particular that distributed agents (people and automated systems) acting without knowledge of each others' actions can create a complex, dynamic system whose interactive behavior is unexpected and is changing too quickly to comprehend and control.

complex systems↗

J-2X Abort System Development

The J-2X is an expendable liquid hydrogen (LH2)/liquid oxygen (LOX) gas generator cycle rocket engine that is currently being designed as the primary upper stage propulsion element for the new NASA Ares vehicle family. The J-2X engine will contain abort logic that functions as an integral component of the Ares vehicle abort system. This system is responsible for detecting and responding to conditions indicative of impending Loss of Mission (LOM), Loss of Vehicle (LOV), and/or catastrophic Loss of Crew (LOC) failure events. As an earth orbit ascent phase engine, the J-2X is a high power density propulsion element with non-negligible risk of fast propagation rate failures that can quickly lead to LOM, LOV, and/or LOC events. Aggressive reliability requirements for manned Ares missions and the risk of fast propagating J-2X failures dictate the need for on-engine abort condition monitoring and autonomous response capability as well as traditional abort agents such as the vehicle computer, flight crew, and ground control not located on the engine. This paper describes the baseline J-2X abort subsystem concept of operations, as well as the development process for this subsystem. A strategy that leverages heritage system experience and responds to an evolving engine design as well as J-2X specific test data to support abort system development is described. The utilization of performance and failure simulation models to support abort system sensor selection, failure detectability and discrimination studies, decision threshold definition, and abort system performance verification and validation is outlined. The basis for abort false positive and false negative performance constraints is described. Development challenges associated with information shortfalls in the design cycle, abort condition coverage and response assessment, engine-vehicle interface definition, and abort system performance verification and validation are also discussed.

Santi, Louis M.↗

Calibration of the Accuscan II In Vivo System for I-125 Thyroid Counting

This report describes the March 2011 calibration of the Accuscan II HpGe In Vivo system for I-125 thyroid counting. The source used for the calibration was a DOE manufactured Am-241/Eu-152 source contained in a 22 ml vial BEA Am-241/Eu-152 RMC II-1 with energies from 26 keV to 344 keV. The center of the detector housing was positioned 64 inches from the vault floor. This position places the approximate center line of the detector housing at the center line of the source in the phantom thyroid tube. The energy and efficiency calibration were performed using an RMC II phantom (Appendix J). Performance testing was conducted using source BEA Am-241/Eu-152 RMC II-1 and Validation testing was performed using an I-125 source in a 30 ml vial (I-125 BEA Thyroid 002) and an ANSI N44.3 phantom (Appendix I). This report includes an overview introduction and records for the energy/FWHM and efficiency calibration including performance verification and validation counting. The Accuscan II system was successfully calibrated for counting the thyroid for I-125 and verified in accordance with ANSI/HPS N13.30-1996 criteria.

61 RADIATION PROTECTION AND DOSIMETRY↗

Advanced Software V&V for Civil Aviation and Autonomy

With the advances in high-computing platform (e.g., advanced graphical processing units or multi-core processors), computationally-intensive software techniques such as the ones used in artificial intelligence or formal methods have provided us with an opportunity to further increase safety in the aviation industry. Some of these techniques have facilitated building safety at design time, like in aircraft engines or software verification and validation, and others can introduce safety benefits during operations as long as we adapt our processes. In this talk, I will present how NASA is taking advantage of these new software techniques to build in safety at design time through advanced software verification and validation, which can be applied earlier and earlier in the design life cycle and thus help also reduce the cost of aviation assurance. I will then show how run-time techniques (such as runtime assurance or data analytics) offer us a chance to catch even more complex problems, even in the face of changing and unpredictable environments. These new techniques will be extremely useful as our aviation systems become more complex and more autonomous.

software assurance↗

OC6 Phase IV: Validation of CFD Models for Stiesdal TetraSpar Floating Offshore Wind Platform

ABSTRACT With only a few floating offshore wind turbine (FOWT) farms deployed anywhere in the world, FOWT technology is still in its infancy, building on a modicum of real‐world experience to advance the nascent industry. To support further development, engineers rely heavily on modeling tools to accurately portray the behavior of these complex systems under realistic environmental conditions. This reliance creates a need for verification and validation of such tools to improve reliability of load and dynamic response prediction and analysis capabilities of FOWT systems. The Offshore Code Comparison Collaboration, Continued with Correlation and unCertainty (OC6) project was created under the framework of the International Energy Agency to address this need and considers a three‐sided verification and validation between engineering level models, computational fluid dynamics (CFD), and experimental results. In this paper, a novel floating offshore wind platform, the Stiesdal TetraSpar, is simulated using CFD under the load conditions defined by Phase IV of the OC6 project. The comparison of these CFD results against the experimental results demonstrated the ability to predict the platform response to waves when imposing the measured wave signals as input. Although validation versus experiment was largely successful, the damping behavior was impacted by uncertainties likely originating from the mooring system and sensor umbilical cable. This extensive comparison effort with multiple CFD practitioners offers insight into best practices to achieve reliable results.

17 WIND ENERGY↗

A Survey of Formal Methods for Intelligent Swarms

Swarms of intelligent autonomous spacecraft, involving complex behaviors and interactions, are being proposed for future space exploration missions. Such missions provide greater flexibility and offer the possibility of gathering more science data than traditional single spacecraft missions. The emergent properties of swarms make these missions powerful, but simultaneously far more difficult to design, and to assure that the proper behaviors will emerge. These missions are also considerably more complex than previous types of missions, and NASA, like other organizations, has little experience in developing or in verifying and validating these types of missions. A significant challenge when verifying and validating swarms of intelligent interacting agents is how to determine that the possible exponential interactions and emergent behaviors are producing the desired results. Assuring correct behavior and interactions of swarms will be critical to mission success. The Autonomous Nano Technology Swarm (ANTS) mission is an example of one of the swarm types of missions NASA is considering. The ANTS mission will use a swarm of picospacecraft that will fly from Earth orbit to the Asteroid Belt. Using an insect colony analogy, ANTS will be composed of specialized workers for asteroid exploration. Exploration would consist of cataloguing the mass, density, morphology, and chemical composition of the asteroids, including any anomalous concentrations of specific minerals. To perform this task, ANTS would carry miniaturized instruments, such as imagers, spectrometers, and detectors. Since ANTS and other similar missions are going to consist of autonomous spacecraft that may be out of contact with the earth for extended periods of time, and have low bandwidths due to weight constraints, it will be difficult to observe improper behavior and to correct any errors after launch. Providing V&V (verification and validation) for this type of mission is new to NASA, and represents the cutting edge in system correctness, and requires higher levels of assurance than other (traditional) missions that use a single or small number of spacecraft that are deterministic in nature and have near continuous communication access. One of the highest possible levels of assurance comes from the application of formal methods. Formal methods are mathematics-based tools and techniques for specifying and verifying (software and hardware) systems. They are particularly useful for specifying complex parallel systems, such as exemplified by the ANTS mission, where the entire system is difficult for a single person to fully understand, a problem that is multiplied with multiple developers. Once written, a formal specification can be used to prove properties of a system (e.g., the underlying system will go from one state to another or not into a specific state) and check for particular types of errors (e.g., race or livelock conditions). A formal specification can also be used as input to a model checker for further validation. This report gives the results of a survey of formal methods techniques for verification and validation of space missions that use swarm technology. Multiple formal methods were evaluated to determine their effectiveness in modeling and assuring the behavior of swarms of spacecraft using the ANTS mission as an example system. This report is the first result of the project to determine formal approaches that are promising for formally specifying swarm-based systems. From this survey, the most promising approaches were selected and are discussed relative to their possible application to the ANTS mission. Future work will include the application of an integrated approach, based on the selected approaches identified in this report, to the formal specification of the ANTS mission.

Truszkowski, Walt↗