Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “solution verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

MFANS 2024 - Formally Proving Characteristics of Cyber-Physical Systems

Cyber-physical systems (CPS) are engineered systems that rely on the smooth integration of computational algorithms and physical elements. This integration presents new challenges for verifying that systems will behave as expected. The goal of this presentation is to present current challenges and potential solutions for the formal verification of cyber-physical systems. For cyber systems, formal methods refer to systematically rigorous mathematical techniques employed in the specification, development, analysis, and verification of both software and hardware systems. Recent advancements in computer science have yielded sophisticated tools specifically designed to address challenges associated with formal methods in complex systems. These tools leverage various foundational concepts such as logic, formal languages, program semantics, type systems, type theory, and automata theory. A notable achievement in the application of formal methods is the seL4 microkernel, claimed to be the first general-purpose operating-system kernel to be verified. Its proof implies the absence of bugs and guarantees that the kernel meets specifications. For physical systems, dynamic and control theory has a history of using rigorous analytic techniques to prove functional correctness. Lyapunov, optimal, classical, modern, and robust control theories all provide rigorous mathematical methods both to analyze system performance and to design controller that can be guaranteed to meet certain objectives. Recent computational techniques like level set theory and reachability analysis provide assertions that a system's state will avoid unsafe regions. Even though success has been independently achieved for cyber systems and physical systems, the integration of such systems creates new challenges. In particular, there is an obvious discrepancy between finite-state machines and infinite-state systems, resulting in different approaches for modeling and analyzing these system. While it is possible to simulate hybrid systems, this provides only a demonstration of a performance and not proof. For hybrid systems, current formal methods and system analysis approaches typically require a workarounds to work on hybrid systems like CPS. This paper will outline the state of the art and limits of current practice for formally verifying CPS and will identify possible research directions that require attention.

97 MATHEMATICS AND COMPUTING↗

Projected Impact of Compositional Verification on Current and Future Aviation Safety Risk

The projected impact of compositional verification research conducted by the National Aeronautic and Space Administration System-Wide Safety and Assurance Technologies on aviation safety risk was assessed. Software and compositional verification was described. Traditional verification techniques have two major problems: testing at the prototype stage where error discovery can be quite costly and the inability to test for all potential interactions leaving some errors undetected until used by the end user. Increasingly complex and nondeterministic aviation systems are becoming too large for these tools to check and verify. Compositional verification is a "divide and conquer" solution to addressing increasingly larger and more complex systems. A review of compositional verification research being conducted by academia, industry, and Government agencies is provided. Forty-four aviation safety risks in the Biennial NextGen Safety Issues Survey were identified that could be impacted by compositional verification and grouped into five categories: automation design; system complexity; software, flight control, or equipment failure or malfunction; new technology or operations; and verification and validation. One capability, 1 research action, 5 operational improvements, and 13 enablers within the Federal Aviation Administration Joint Planning and Development Office Integrated Work Plan that could be addressed by compositional verification were identified.

Reveley, Mary S.↗

Development, verification, and validation of comprehensive acoustic fluid-structure interaction capabilities in an open-source computational platform

The acoustic fluid-structure interaction (FSI) formulation is a practical numerical approach for the seismic analysis of fluid-filled tanks. However, there are no verification and validation studies reported in the literature that demonstrate the ability of an acoustic FSI numerical model to predict responses important to structural and mechanical design for intense translational and rotational earthquake inputs. Herein, an acoustic FSI formulation is implemented in the open-source Multiphysics Object-Oriented Simulation Environment (MOOSE), and is formally verified and validated using analytical solutions and code-to-code verification, and experimental data, respectively. The analytical solutions are for small amplitude, unidirectional seismic inputs. The code-to-code verification utilizes a previously verified and validated Arbitrary Lagrangian-Eulerian (ALE) numerical model in the commercial finite element code LS-DYNA. The validation studies utilize a comprehensive data set assembled from results of 3D earthquake-simulator tests of a fluid-filled vessel. The acoustic numerical model in MOOSE is verified and validated for hydrodynamic pressures and support reactions except for cases that involve significant convective response. For small amplitude inputs, numerically predicted wave heights match those of the analytical solutions. The numerical model is not verified and validated for wave height calculations under intense 3D seismic inputs. The run times for the acoustic FSI simulations in MOOSE are an order of magnitude, or more, shorter than for the corresponding ALE simulations in LS-DYNA. The utility of the MOOSE acoustic FSI implementation is demonstrated by seismic analysis of a building equipped with a fluid-filled, advanced nuclear reactor.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Review of analytical studies on seismic fluid-structure interaction of base-supported cylindrical tanks

Analytical solutions for seismic fluid-structure interaction (FSI) of tanks are used by analysts and engineers for a number of purposes, including preliminary sizing, risk assessment, and verification of numerical models. Analytical solutions for seismic FSI of tanks were first developed in the 1930s and have been extended and/or modified in the following nine decades to accommodate different seismic inputs and boundary conditions. This report reviews published analytical solutions for rigid and flexible, base-supported, cylindrical tanks subjected to unidirectional horizontal motion of a small amplitude. The studies parsed the fluid-structure (FSI) response into an impulsive and a convective component, and addressed frequencies of lateral motions of the tank (i.e., impulsive frequencies), hydrodynamic pressures, frequencies of waves (i.e., convective frequencies), wave heights, and reactions at the base. The solutions were categorized into exact and approximate solutions based on the methodologies used. Herein, FSI responses are calculated and compared for a range of tank dimensions using the analytical solutions from the different studies. The responses presented here are normalized to be unitless, and can be used for tanks with different dimensions and mechanical properties, and subjected to different input motions. A sample steel water tank is analyzed using the normalized solutions for two earthquake ground motions with different frequency contents. Ignoring tank flexibility may significantly underestimate seismic responses of the tank and its contained fluid. The approximate solutions, which have been widely used for decades, may not be sufficiently accurate in the modern era. Calculation errors in the reviewed studies are identified and corrected, and differences are quantified for the sample tank.

42 ENGINEERING↗

Design and execution of a verification, validation, and uncertainty quantification plan for a numerical model of left ventricular flow after LVAD implantation

Left ventricular assist devices (LVADs) are implantable pumps that act as a life support therapy for patients with severe heart failure. Despite improving the survival rate, LVAD therapy can carry major complications. Particularly, the flow distortion introduced by the LVAD in the left ventricle (LV) may induce thrombus formation. While previous works have used numerical models to study the impact of multiple variables in the intra-LV stagnation regions, a comprehensive validation analysis has never been executed. The main goal of this work is to present a model of the LV-LVAD system and to design and follow a verification, validation and uncertainty quantification (VVUQ) plan based on the ASME V&V40 and V&V20 standards to ensure credible predictions. The experiment used to validate the simulation is the SDSU cardiac simulator, a bench mock-up of the cardiovascular system that allows mimicking multiple operation conditions for the heart-LVAD system. The numerical model is based on Alya, the BSC’s in-house platform for numerical modelling. Alya solves the Navier-Stokes equation with an Arbitrary Lagrangian-Eulerian (ALE) formulation in a deformable ventricle and includes pressure-driven valves, a 0D Windkessel model for the arterial output and a LVAD boundary condition modeled through a dynamic pressure-flow performance curve. The designed VVUQ plan involves: (a) a risk analysis and the associated credibility goals; (b) a verification stage to ensure correctness in the numerical solution procedure; (c) a sensitivity analysis to quantify the impact of the inputs on the four quantities of interest (QoIs) (average aortic root flow $Q^{avg}_{Ao}$, maximum aortic root flow $Q^{max}_{Ao}$, average LVAD flow $Q^{avg}_{VAD}$, and maximum LVAD flow $Q^{max}_{VAD}$; (d) an uncertainty quantification using six validation experiments that include extreme operating conditions. Numerical code verification tests ensured correctness of the solution procedure and numerical calculation verification showed a grid convergence index (GCI)95% <3.3%. The total Sobol indices obtained during the sensitivity analysis demonstrated that the ejection fraction, the heart rate, and the pump performance curve coefficients are the most impactful inputs for the analysed QoIs. The Minkowski norm is used as validation metric for the uncertainty quantification. It shows that the midpoint cases have more accurate results when compared to the extreme cases. The total computational cost of the simulations was above 100 [core-years] executed in around three weeks time span in Marenostrum IV supercomputer. This work details a novel numerical model for the LV-LVAD system, that is supported by the design and execution of a VVUQ plan created following recognised international standards. We present a methodology demonstrating that stringent VVUQ according to ASME standards is feasible but computationally expensive.

59 BASIC BIOLOGICAL SCIENCES↗

Developing an intrinsically secure information barrier for arms control verification through machine learning

Near-term solutions are needed to allow for flexible engagement in future nuclear arms control discussions. This project developed a method for implementing an information barrier (IB) on commercial systems, shortening the research and development lifecycle for warhead verification technologies while offering improved and inherently flexible capabilities. The crux of the verification challenge remains the difficulty in developing an authenticatable IB which prevents sensitive host country information from inadvertent transmission to an inspector. Many concepts for IB’s rely on dedicated “trusted” processor modules developed with dedicated custom radiation detection systems and associated algorithms. Without a priori knowledge of the treaty item, the parameter space for measurements can be nearly infinite and robustness against spoofing without the ability to view sensitive data is key. This project has produced an unclassified framework capable of ingesting data from common gamma detectors and identifying the presence of weapons grade nuclear material at over 90% accuracy.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

A deterministic verification strategy for electrostatic particle-in-cell algorithms in arbitrary spatial dimensions using the method of manufactured solutions

As simulations of kinetic plasmas continue to increase in scope and complexity, a rigorous and straightforward method for verifying particle-in-cell (PIC) implementations is necessary to ensure their correctness. Here, in this paper, we present a deterministic method for the rigorous verification of multidimensional, multispecies, electrostatic particle-in-cell codes based on the method of manufactured solutions. Specifically, we prove that rigorous verification is possible through the exclusive examination of errors of grid quantities (i.e., moments and/or fields), allowing for a very light-weight and non-intrusive implementation in existing PIC codes. This is a marked improvement over earlier PIC verification approaches (only demonstrated with one species in 1D-1V), which rely on the comparison of cumulative distribution functions, and are invasive on the code base, introduce additional stochastic noise, are significantly more computationally expensive, and lack rigorous convergence properties. Interestingly, we show that different grid quantities feature different rates of convergence with the number of particles and mesh size, impacting the verification process. These theoretical results are confirmed numerically with a multi-species 2D-2V particle-in-cell code, including the ability of the method to detect order reduction due to an incorrect implementation.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Calculation of rotor impedance for use in design analysis of helicopter airframe vibrations

Excessive vibration is one of the most prevalent technical obstacles encountered in the development of new rotorcraft. The inability to predict these vibrations is primarily due to deficiencies in analysis and simulation tools. The Langley Rotorcraft Structural Dynamics Program was instituted in 1984 to meet long term industry needs in the area of rotorcraft vibration prediction. As a part of the Langley program, this research endeavors to develop an efficient means of coupling the rotor to the airframe for preliminary design analysis of helicopter airframe vibrations. The main effort was to modify the existing computer program for modeling the dynamic and aerodynamic behavior of rotorcraft called DYSCO (DYnamic System COupler) to calculate the rotor impedance. DYSCO was recently developed for the U.S. Army and has proven to be adaptable for the inclusion of new solution methods. The solution procedure developed to use DYSCO for the calculation of rotor impedance is presented. Verification of the procedure by comparison with a known solution for a simple wind turbine model is about 75 percent completed, and initial results are encouraging. After the wind turbine impedance is confirmed, the verification effort will continue by comparison to solutions of a more sophisticated rotorcraft model. Future work includes determination of the sensitivity of the rotorcraft airframe vibrations to helicopter flight conditions and rotor modeling assumptions. When completed, this research will ascertain the feasibility and efficiency of the impedance matching method of rotor-airframe coupling for use in the analysis of airframe vibrations during the preliminary rotorcraft design process.

Nygren, Kip P.↗

Verification Testing of Body Forces due to a Prescribed Angular Velocity in DYNA3D/Paradyn

This report documents the verification testing and regression testing done on a new feature in DYNA3D/Paradyn, which allows users to prescribe body force loads based upon an angular velocity. This feature is unique in that the direction of the angular velocity vector follows the unit vector formed by two coordinate points associated with two nodes or the average coordinates of two separate small collection of nodes. The angular velocity direction will follow the directional vector defined by these nodes while the angular velocity magnitude is defined by a load curve. A simple single element verification test was performed to determine the correct implementation of this feature, and two separate regression tests were added to the DYNA3D Software Quality Assur ance test suite. The nodal positions, velocities, and accelerations from the solution of the single element verification test compare well to analytically derived values of those nodal quantities. The regression tests serve as good examples of this new feature’s use case and were consequently added to the SQA test suite to ensure that further modifications of the DYNA3D source code do not unintentionally change the generated baseline answers.

42 ENGINEERING↗

Comparison of numerical oblique detonation solutions with an asymptotic benchmark

In order to have confidence in a numerical method, the verification of its reproduction of known benchmark analytic solutions for simple model problems is of great importance. Attention is presently given to a novel benchmarking procedure for numerical models of high speed, reactive 2D flows. The procedure is illustrated by comparing asymptotic and numerical solutions for oblique detonations in which an attached oblique shock is followed by an exothermic reaction with a thick reaction zone.

Grismer, Matthew J.↗

FY2021 Improvements to the New CTH Code Verification & Validation Test Suite

Over the past few years, the CTH multiphysics hydrocode has overhauled its software quality and testing processes, implementing current best practices in software quality and building a robust V&V test suite comprised of traditional hydrocode verification problems, including ASC Tri-Lab Test Suite and Enhanced Tri-Lab Test Suite problems, as well as validation problems for some of CTH’s most frequently used equations of state, materials models, and other key capabilities. Substantial progress towards building this new test suite was made in FY19 and FY20. In FY21, the test suite has been expanded to include verification and validation tests of the Steinberg-Guinan-Lund (ST) viscoplastic model and the Johnson Cook (JFRAC) fracture model. Additionally, two new verification tests were added, covering hydrodynamics and high explosive (HE) modeling capabilities: the Kidder Gaussian density problem and the Escape of HE Products (EHEP) problem from the Tri-Lab Test Suite. This report discusses each of these test problems in detail. Verification test results are compared to analytic solutions. Validation test results are compared to experimental data. Wherever possible, convergence or mesh refinement studies are included. Additionally, while implementing the Kidder verification problem, a bug was identified that affects the use of tables to initialize pressure or density in 1D or 2D calculations. A brief discussion of the bug and its fix is included. CTH demonstrates good performance overall on the new test suite problems. Simulation results showed good agreement with analytic solutions for the Kidder problem, with convergence rates ranging between 1.8 and sub-linear, and relatively good agreement for the EHEP problem, though convergence rates for pressure and density were nearly 0. The ST and JFRAC strain rate loading verification tests show good agreement with analytic solutions. Likewise, CTH simulation results show good agreement with experimental validation data, including Taylor rod impact testing, for the materials tested. Future V&V work will focus on adding 2D and 3D versions of existing verification tests as well as adding validation tests of other frequently used capabilities such as other fracture models.

42 ENGINEERING↗

Verification methods for drift–diffusion reaction models for plasma simulations

Abstract Compared to other computational physics areas such as codes for general computational fluid dynamics, the documentation of verification methods for plasma fluid codes remains under developed. Current analytical solutions for plasma are often highly limited in terms of testing highly coupled physics, due to the harsh assumptions needed to derive even simple plasma equations. This work highlights these limitations, suggesting the method of manufactured solutions (MMSs) as a potential option for future verification efforts. To demonstrate the flexibility of MMS in verifying these highly coupled systems, the Multiphysics Object-Oriented Simulation Environment (MOOSE) framework was utilized. Thanks to the MOOSE framework’s robustness and modularity, as well as to its physics module capabilities and ecosystem applications (i.e. Zapdos and the chemical reaction network) developed for plasma physics modeling and simulation, this report lays the groundwork for a structured method of conducting plasma fluid code verification.

DeChant, Corey (ORCID:0000000293779732)↗

Benchmarking Mixed Mode Failure in Progressive Damage and Failure Analysis Methods

The verification and validation of progressive-damage-analysis finite element methods are difficult but critical tasks to undertake during their development. Verification exercises assess whether a predictive analysis tool produces results that are consistent with the fundamental concepts and assumptions of the tool under evaluation. Ideally, closed-form analytical solutions can be derived for which method verification results can be compared. Problems selected for computational tool verification are often simple and isolate individual features of the tool. In the case of progressive damage finite element methods, verifications should be performed to evaluate the ability of the model to predict the initiation of damage and its growth through the finite element mesh under a variety of conditions. Mabson et al. proposed a test case of a unidirectional, fiber-reinforced plate with a center crack subjected to tensile loads to evaluate matrix crack propagation predictions. The problem was modeled using the Abaqus Hashin continuum damage mechanics (CDM) model for fiber-reinforced composites. Different combinations of matrix strengths and element sizes were used in the simulations, and the results were compared to a closed-form solution based on linear elastic fracture mechanics (LEFM). It was determined that the Abaqus CDM model could predict the LEFM solution of Mode I cracks only when the finite element mesh density met specific requirements based on the material properties. This paper presents closed-form LEFM solutions for a center notch mixed mode (CNMM) verification problem. Parametric finite element analyses were developed using progressive damage analysis methods of both the Discrete Damage Mechanics (DDM) and CDM classes. The progressive damage analysis methods applied in the analyses of the CNMM problem include CompDam and the Floating Node Method. Analyses were conducted with various mode mixities and element sizes to verify that the damage models were working as intended and to identify any limits of applicability.

Leone, Frank↗

CFD Code Validation of Wall Heat Fluxes for a G02/GH2 Single Element Combustor

This paper puts forth the case for the need for improved injector design tools to meet NASA s Vision for Space Exploration goals. Requirements for this improved tool are outlined and discussed. The potential for Computational Fluid Dynamics (CFD) to meet these requirements is noted along with its current shortcomings, especially relative to demonstrated solution accuracy. The concept of verification and validation is introduced as the primary process for building and quantifying the confidence necessary for CFD to be useful as an injector design tool. The verification and validation process is considered in the context of the Marshall Space Flight Center (MSFC) Combustion Devices CFD Simulation Capability Roadmap via the Simulation Readiness Level (SRL) concept. The portion of the validation process which demonstrates the ability of a CFD code to simulate heat fluxes to a rocket engine combustor wall is the focus of the current effort. The FDNS and Loci-CHEM codes are used to simulate a shear coaxial single element G02/GH2 injector experiment. The experiment was conducted a t a chamber pressure of 750 psia using hot propellants from preburners. A measured wall temperature profile is used as a boundary condition to facilitate the calculations. Converged solutions, obtained from both codes by using wall functions with the K-E turbulence model and integrating to the wall using Mentor s baseline turbulence model, are compared to the experimental data. The initial solutions from both codes revealed significant issues with the wall function implementation associated with the recirculation zone between the shear coaxial jet and the chamber wall. The FDNS solution with a corrected implementation shows marked improvement in overall character and level of comparison to the data. With the FDNS code, integrating to the wall with Mentor s baseline turbulence model actually produce a degraded solution when compared to the wall function solution with the K--E model. The Loci-CHEM solution, produced by integrating to the wall with Mentor s baseline turbulence model, matches both the heat flux rise rate in the near injector region and the peak heat flux level very well. However, it moderately over predicts the heat fluxes downstream of the reattachment point. The Loci-CHEM solution achieved by integrating to the wall with Mentor s baseline turbulence model was clearly superior to the other solutions produced in this effort.

Lin, Jeff↗

Assessment and Improvement of Fission Product Transport Predictions of Particle Fuel in BISON

The U.S. Department of Energy’s Nuclear Energy Advanced Modeling and Simulation (NEAMS) program aims to develop predictive capabilities by applying computational methods to the analysis and design of advanced reactor and fuel cycle systems. This program has been providing engineering-scale support for the development of BISON, a high-fidelity and high-resolution fuel performance tool. This study was motivated by the need to incorporate more physics-based models in BISON in order to foster tri-structural isotropic (TRISO) applications. This document details the integration of new modeling capabilities in BISON, including (1) development of pyrolytic carbon (PyC) and silicon carbide (SiC) layer anisotropic thermal and mass transport capabilities, (2) verification of the mass diffusion solution in TRISO modeling, (3) calibration of fission product diffusivity using Advanced Gas Reactor (AGR) experiments, (4) improved fission product release modeling by developing compact diffusion modeling capabilities, and (5) documentation of accelerated failure analysis on the BISON website. Improvements made to the diffusion models and parameters were documented and validated against AGR-1 and -2 experiment data.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Flow and transport in three-dimensional discrete fracture matrix models using mimetic finite difference on a conforming multi-dimensional mesh

Here, we present a comprehensive workflow to simulate single-phase flow and transport in fractured porous media using the discrete fracture matrix approach. The workflow has three primary parts: (1) a method for conforming mesh generation of and around a three-dimensional fracture network, (2) the discretization of the governing equations using a second-order mimetic finite difference method, and (3) implementation of numerical methods for high-performance computing environments. A method to create a conforming Delaunay tetrahedralization of the volume surrounding the fracture network, where the triangular cells of the fracture mesh are faces in the volume mesh, that addresses pathological cases which commonly arise and degrade mesh quality is also provided. Our open-source subsurface simulator uses a hierarchy of process kernels (one kernel per physical process) that allows for both strong and weak coupling of the fracture and matrix domains. We provide verification tests based on analytic solutions for flow and transport, as well as numerical convergence. We also provide multiple expositions of the method in complex fracture networks. In the first example, we demonstrate that the method is robust by considering two scenarios where the fracture network acts as a barrier to flow, as the primary pathway, or offers the same resistance as the surrounding matrix. In the second test, flow and transport through a three-dimensional stochastically generated network containing 257 fractures is presented.

97 MATHEMATICS AND COMPUTING↗

The liquid-conduction, vapor-flow heat pipe model in Sockeye

A single-phase heat pipe flow model implemented in the heat pipe application Sockeye is described. This model solves one-dimensional, compressible flow equations for the vapor phase in the center of a heat pipe, which are coupled to the two-dimensional heat conduction equation for the wick, liquid, and cladding, as well as to an ordinary differential equation tracking the working fluid inventory in the evaporator section of the heat pipe. This model is demonstrated with several test problems, including comparisons to analytic solutions for the vapor flow fields, analytic curves for sonic and capillary limitations of heat pipe operation, and some experimental data. The numerical solution gives excellent agreement for verification problems and good agreement with experimental results. Also, demonstrations show that the model is very robust, allowing for full simulations of heat pipe transients, including frozen startup, sonic-limited (supersonic) flow, and heat pipe shutdown.

42 ENGINEERING↗

An implementation of a high-order generalized finite difference method for solving the time-harmonic cold plasma wave equation in toroidal geometry

A high-order physics-informed meshless finite difference numerical technique is introduced for solving the time-harmonic cold plasma wave equation in toroidal geometries, presenting a novel application of the generalized finite difference (GFD) method to plasma wave simulations. The algorithm employs an irregular distribution of computational points, with local point density informed by the shortest wavelength derived from the cold plasma dispersion relation. Numerical stability and robustness are addressed using regularization techniques. The algorithm, implemented for two spatial dimensions, solves for the wave electric field and is demonstrated to achieve convergence rates of $\mathcal{O}$($\mathcal{h}$ $\mathcal{P}$ )⁠. Verification tests reproduce plane wave solutions, and example simulations of ion cyclotron resonance heating and electron cyclotron resonance heating demonstrate its capability, approaching realistic tokamak plasma scenarios. This work contributes to laying a foundation for the GFD method to be used in more sophisticated, optimized, and physically realistic full-wave simulations in time-harmonic plasma wave research.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗