Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Code Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,387 records · Page 77

OC6 Phase Ia - Nonlinear hydrodynamic loading validation dataset

Two validation campaigns were examined within the Offshore Code Comparison Collaboration, Continued, with Correlation and unCertainty (OC6) Phase 1 project to examine the modeling tools' underprediction of loads and motion of a floating wind semisubmersible (semi) at their surge and pitch natural frequencies. These campaigns were performed at the Maritime Research Institute Netherlands (MARIN) in 2017 and 2018. The load cases (LC) considered include: LC1 – Load measurements across semi under current loading; LC2 - Load measurements across semi under forced surge oscillation; LC3 – Load measurements across semi under wave loading, while held fixed; LC4 – Free-decay motion measurements in surge, pitch, and heave; and LC5 – Motion measurements under wave loading. Details on the results from the OC6 Phase Ia project can be found in the reference, “OC6 Phase 1: Investigating the underprediction of low-frequency hydrodynamic loads and responses of floating wind turbines”, J Phys: Conf Series 1618 032033.

17 WIND ENERGY↗

Using Whisper-1.1 to Guide Improvements to Nuclear Data Evaluations

Along with the latest release of the general purpose Monte Carlo radiation transport code, MCNP6.2, came the first officially released version of Whisper, version 1.1, a statistical analysis code used for nuclear criticality safety (NCS) validation. The Whisper software package is primarily used to calculate the upper subcritical limit (USL) of a particular application case along with components of the margin of subcriticality (MOS). In the calculation of the MOS due to nuclear data uncertainties, Whisper uses the generalized linear-least-squares (GLLS) approach to obtain adjusted nuclear data uncertainties which are then propagated to estimate the nuclear data uncertainties in the k eff of the application. Due to the fact that Whisper contains the simulated and measured k eff values for over 1100 benchmarks, nuclear data sensitivity profiles for each benchmark along with the nuclear data covariance matrices, all of which are used in the GLLS method, it is possible to easily utilize these data available to help guide improvements to nuclear data evaluations. In the present work, the Whisper data and the GLLS method are used together to suggest an adjusted nuclear data cross section evaluation specifically for 233 U such that the agreement between the calculated and experimental k eff measurements of the relevant benchmarks are improved. With this adjusted nuclear data available, feedback to the theoretical and experimental nuclear data community is provided.

97 MATHEMATICS AND COMPUTING↗

Conceptual design of a quadrupole kicker and study of beam dynamics for generating echoes in IOTA

In this project we design dipole and quadrupole stripline kickers for echo generation in the IOTA ring. We developed a semi-analytic solver for dipole and quadrupole kickers with curved plates of innitesimal thickness, and independently validated it against a nite element software code (FEMM). The analytic series converges rapidly and is in agreement with FEMM within 5% everywhere except at the tips of the plates. We also consider nite thickness plates of dierent shapes (curved and parallel) and compare the central eld quality and characteristic impedance. We nd that in the dipole case, the parallel plates provide better eld quality than curved plates while in the quadrupole case, the dierence is not signicant. The characteristic impedance of relevant modes are computed. Matching the characteristic impedance to an external load is necessary to prevent unwanted re ection and ringing.

43 PARTICLE ACCELERATORS↗

A dynamic, dependent type system for nuclear fuel cycle code generation

The nuclear fuel cycle may be interpreted as a network or graph, thus allowing methods from formal graph theory to be used. Nodes are often idealized as nuclear fuel cycle facilities (reactors, enrichment cascades, deep geologic repositories). With the advent of modern object-oriented programming languages - and fuel cycle simulators implemented in these languages - it is natural to define a class hierarchy of facility types. Bright is a quasi-static simulator, meaning that the number of material passes through a facility is tracked rather than natural time. Bright is implemented as a C++ library that models many canonical components such as reactors, storage facilities, and more. Cyclus is a discrete time simulator, meaning that natural time is tracked through out the simulation. Therefore a robust, dependent type system was developed to enable inter-operability between Bright and Cyclus. This system is capable of representing any fuel cycle facility. Types declared in this system can then be used to automatically generate code which binds a facility implementation to a simulator front end. Facility model wrappers may be used either internally to a fuel cycle simulator or as a mechanism for inter-operating multiple simulators. While such a tool has many potential use cases it has two main purposes: enabling easy performance of code-to-code comparisons and the verification and the validation of user input.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Analysis of Massively Parallel Discrete-Ordinates Transport Sweep Algorithms with Collisions

We present theoretical scaling models for a variety of discrete-ordinates sweep algorithms. In these models, we pay particular attention to the way each algorithm handles collisions. A collision is defined as a processor having multiple angles with ready to be swept during one stage of the sweep. The models also take into account how subdomains are assigned to processors and how angles are grouped during the sweep. We describe a data driven algorithm that resolves collisions efficiently during the sweep as well as other algorithms that have been designed to avoid collisions completely. Our models are validated using the ARGES and AMTRAN transport codes. We then use the models to study and predict scaling trends in all of the sweep algorithms.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Fully 3D Multiple Beam Dynamics Processes Simulation for the Fermilab Tevatron

The Fermilab Tevatron has been, until 2010, the premier high-energy physics collider in the world. The data collected over the last decade by high-energy physics experiments running at the Tevatron have been analyzed to make important measurements in fundamental areas such as B meson masses and flavor oscillation, searches for the Higgs boson, and supersymmetry. Collecting these data at the limits of detectability has required the Tevatron to operate reliably at high beam intensities to maximize the number of collisions to analyze. This impressive achievement has been assisted by the use of HPC resources and software provided through the SciDAC program. This paper describes the enhancements to the BeamBeam3d code to realistically simulate the Tevatron, the validation of these simulations, and the improvement in equipment reliability and personal safety achieved with the aid of simulations.

43 PARTICLE ACCELERATORS↗

Verification of BModes: Rotary Beam and Tower Modal Analysis Code; Preprint

This paper describes verification of BModes, a finite-element code developed to provide coupled modes for the blades and tower of a wind turbine. The blades, which may be rotating or non-rotating, and the towers, whether onshore or offshore, are modeled using specialized 15-dof beam finite elements. Both blade and tower models allow a tip attachment, which is assumed to be rigid body with sixmoments of inertia, and a mass centroid that may be offset from the blade or tower axis. Examples of tip attachments are aerodynamic brakes for blades and nacelle-rotor subassembly for towers. BModes modeling allows for tower supports including tension wires, floating platforms, and monopiles on elastic foundations. Coupled modes (implying coupling of flap, lag, axial, and torsional motions) arerequired for modeling major flexible components in a modal-based, aeroelastic code such as FAST1. These are also required for validation of turbine models using experimental data, modal-based fatigue analysis, controls design, and understanding aeroelastic-stability behavior of turbines. Verification studies began with uniform tower models, with and without tip inertia, and progressed torealistic towers. For the floating turbine, we accounted for the effects of hydrodynamic inertia, hydrostatic restoring, and mooring lines stiffness. For the monopole-supported tower, we accounted for distributed hydrodynamic mass on the submerged part of the tower and for distributed foundation stiffness. Finally, we verified a model of a blade carrying tip mass and rotating at different speeds(verifications of other blade models, rotating or non-rotating, have been reported in another paper.) Verifications were performed by comparing BModes-generated modes with analytical results, if available, or with MSC.ADAMS results. All results in general show excellent agreement.

17 WIND ENERGY↗

Design and execution of a verification, validation, and uncertainty quantification plan for a numerical model of left ventricular flow after LVAD implantation

Left ventricular assist devices (LVADs) are implantable pumps that act as a life support therapy for patients with severe heart failure. Despite improving the survival rate, LVAD therapy can carry major complications. Particularly, the flow distortion introduced by the LVAD in the left ventricle (LV) may induce thrombus formation. While previous works have used numerical models to study the impact of multiple variables in the intra-LV stagnation regions, a comprehensive validation analysis has never been executed. The main goal of this work is to present a model of the LV-LVAD system and to design and follow a verification, validation and uncertainty quantification (VVUQ) plan based on the ASME V&V40 and V&V20 standards to ensure credible predictions. The experiment used to validate the simulation is the SDSU cardiac simulator, a bench mock-up of the cardiovascular system that allows mimicking multiple operation conditions for the heart-LVAD system. The numerical model is based on Alya, the BSC’s in-house platform for numerical modelling. Alya solves the Navier-Stokes equation with an Arbitrary Lagrangian-Eulerian (ALE) formulation in a deformable ventricle and includes pressure-driven valves, a 0D Windkessel model for the arterial output and a LVAD boundary condition modeled through a dynamic pressure-flow performance curve. The designed VVUQ plan involves: (a) a risk analysis and the associated credibility goals; (b) a verification stage to ensure correctness in the numerical solution procedure; (c) a sensitivity analysis to quantify the impact of the inputs on the four quantities of interest (QoIs) (average aortic root flow $Q^{avg}_{Ao}$, maximum aortic root flow $Q^{max}_{Ao}$, average LVAD flow $Q^{avg}_{VAD}$, and maximum LVAD flow $Q^{max}_{VAD}$; (d) an uncertainty quantification using six validation experiments that include extreme operating conditions. Numerical code verification tests ensured correctness of the solution procedure and numerical calculation verification showed a grid convergence index (GCI)95% <3.3%. The total Sobol indices obtained during the sensitivity analysis demonstrated that the ejection fraction, the heart rate, and the pump performance curve coefficients are the most impactful inputs for the analysed QoIs. The Minkowski norm is used as validation metric for the uncertainty quantification. It shows that the midpoint cases have more accurate results when compared to the extreme cases. The total computational cost of the simulations was above 100 [core-years] executed in around three weeks time span in Marenostrum IV supercomputer. This work details a novel numerical model for the LV-LVAD system, that is supported by the design and execution of a VVUQ plan created following recognised international standards. We present a methodology demonstrating that stringent VVUQ according to ASME standards is feasible but computationally expensive.

59 BASIC BIOLOGICAL SCIENCES↗

LANL-SNL Collaboration on NCS Validation.

During 2016, nuclear criticality safety (NCS) practitioners from SNL and code developers from LANL collaborated in several areas of interest to the DOE/NNSA Nuclear Criticality Safety Program (NCSP). This collaboration involved. Testing of the preliminary release of the MCNP6- Whisper methodology, with feedback to the developers, Sharing of the benchmark catalogs (the collection of MCNP input files and benchmark results), with 1101 cases from LANL and 866 cases from SNL, Comparison and analysis of 357 benchmarks common to both catalogs, Investigation of the impact of the different benchmark catalogs on sensitivity-uncertainty based NCS validation results from MCNP6-Whisper, Investigation of the impact of randomized selections from the benchmark catalog on sensitivity-uncertainty based validation results from MCNP6-Whisper. Investigation of the use of MCNP6-Whisper in selecting benchmarks for use in NCS validation for unique, nonstandard, legacy fuel applications. This paper summarizes the collaboration work and initial results. It must be noted that the results described herein are preliminary and need further research and detailed analysis. However, the initial results are very interesting, and it is important to share them with the NCSP community.

97 MATHEMATICS AND COMPUTING↗

LANL-SNL Collaboration on NCS Validation

During 2016, nuclear criticality safety (NCS) practitioners from SNL and code developers from LANL collaborated in several areas of interest to the DOE/NNSA Nuclear Criticality Safety Program (NCSP). This collaboration involved: - Testing of the preliminary release of the MCNP6- Whisper methodology, with feedback to the developers, - Sharing of the benchmark catalogs (the collection of MCNP input files and benchmark results), with 1101 cases from LANL and 866 cases from SNL, - Comparison and analysis of 357 benchmarks common to both catalogs, - Investigation of the impact of the different benchmark catalogs on sensitivity-uncertainty based NCS validation results from MCNP6-Whisper, - Investigation of the impact of randomized selections from the benchmark catalog on sensitivity-uncertainty based validation results from MCNP6-Whisper. - Investigation of the use of MCNP6-Whisper in selecting benchmarks for use in NCS validation for unique, nonstandard, legacy fuel applications. This paper summarizes the collaboration work and initial results. It must be noted that the results described herein are preliminary and need further research and detailed analysis. However, the initial results are very interesting, and it is important to share them with the NCSP community.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Differences in Health Care, Family, and Community Factors Associated with Mental, Behavioral, and Developmental Disorders Among Children Aged 2–8 Years in Rural and Urban Areas — United States, 2011–2012

Problem/Condition: Mental, behavioral, and developmental disorders (MBDDs) begin in early childhood and often affect lifelong health and well-being. Persons who live in rural areas report more health-related disparities than those in urban areas, including poorer health, more health risk behaviors, and less access to health resources. Reporting Period: 2011–2012. Description of System: The National Survey of Children’s Health (NSCH) is a cross-sectional, random-digit–dial telephone survey of parents or guardians that collects information on noninstitutionalized children aged <18 years in the United States. Interviews included indicators of health and well-being, health care access, and family and community characteristics. Using data from the 2011–2012 NSCH, this report examines variations in health care, family, and community factors among children aged 2–8 years with and without MBDDs in rural and urban settings. Restricting the data to U.S. children aged 2–8 years with valid responses for child age and sex, each MBDD, and zip code resulted in an analytic sample of 34,535 children; MBDD diagnosis was determined by parent report and was not validated with health care providers or medical records. Results: A higher percentage of all children in small rural and large rural areas compared with all children in urban areas had parents who reported experiencing financial difficulties (i.e., difficulties meeting basic needs such as food and housing). Children in all rural areas more often lacked amenities and lived in a neighborhood in poor condition. However, a lower percentage of children in small rural and isolated areas had parents who reported living in an unsafe neighborhood, and children in isolated areas less often lived in a neighborhood lacking social support, less often lacked a medical home, and less often had a parent with fair or poor mental health. Across rural subtypes, approximately one in six young children had a parent-reported MBDD diagnosis. A higher prevalence was found among children in small rural areas (18.6%) than in urban areas (15.2%). In urban and the majority of rural subtypes, children with an MBDD more often lacked a medical home, had a parent with poor mental health, lived in families with financial difficulties, and lived in a neighborhood lacking physical and social resources than children without an MBDD within each of those community types. Only in urban areas did a higher percentage of children with MBDDs lack health insurance than children without MBDDs. After adjusting for race/ethnicity and poverty among children with MBDDs, those in rural areas more often had a parent with poor mental health and lived in resource-low neighborhoods than those in urban areas. Interpretation: Certain health care, family, and community disparities were more often reported among children with MBDDS than among children without MBDDs in rural and urban areas. Public Health Action: Collaboration involving health care, family, and community services and systems can be used to address fragmented services and supports for children with MBDDs, regardless of whether they live in urban or rural areas. However, addressing differences in health care, family, and community factors and leveraging community strengths among children who live in rural areas present opportunities to promote health among children in rural communities.

60 APPLIED LIFE SCIENCES↗

Using a Large Language Model as a Building Block to Generate Usable Validation and Verification Suite for OpenMP

In the HPC area, both hardware and software move quickly. Often new hardware is developed and deployed, the corresponding software stack, including compilers and other tools, are under active development while leading edge software developers are working to port and tune their applications, all at the same time. While the software ecosystem is in flux, one of the key challenges for users is obtaining insight into the state of implementation of key features in the programming languages and models their applications are using – whether they have been implemented, and whether the implementation conforms to the specification, especially for newly implemented features (less tested by widespread use). OpenMP is one of the most prominent shared memory programming models used for on-node programming in HPC. With the shift towards accelerators (such as GPUs and FPGAs) and heterogeneous programming OpenMP features are getting more complex. It is natural to ask whether generative AI approaches, and large language models (LLMs) in particular, can help in producing validation and verification test suites to allow users better and faster insights into the availability and correctness of OpenMP features of interest. In this work, we explore the use of ChatGPT-4 to generate a suite of tests for OpenMP features. We have chosen a set of directives and clauses, a total of 78 combinations, which first appeared in OpenMP 3.0 (released in May 2008) but are also relevant for accelerators. We prompted ChatGPT to generate tests in the C and Fortran languages, for both host (CPU) and device (accelerator). On the Summit super-computer using the GNU implementation, we found that, of the 78 generated tests 67 C tests and 43 Fortran tests compiled successfully and fewer than those executed to completion. On further analysis we show that not all generated tests are valid. We document the process, results, and provide detailed analysis regarding the quality of tests generated. With the aim of providing input to a production quality validation and verification suite, we manually implement the corrections required to make the tests valid according to the current OpenMP specification. We quantify this effort as small, medium, or large, and record the lines of code changed to correct the invalid tests. With the corrected tests we validate recent implementations from HPE, AMD, and GNU on the Frontier supercomputer. Our experiment and subsequent analysis show that although LLMs are capable of producing HPC specific codes, they are limited by their understanding of the deeper semantics and restrictions of programming models such as OpenMP. Unsurprisingly more commonly used features have better support, while some OpenMP 3.0 directives such as sections and tasking are not universally supported on accelerators. We demonstrate that successful compilation and execution to completion are inadequate metrics for evaluating generated code and that, at this time, commodity LLMs require expert intervention for code verification. This points to gaps in the training data that is currently available for HPC. We demonstrate that with "small" effort 37% of generated invalid C tests and 63% of generated invalid Fortran tests could be corrected. This improves productivity of test generation as we circumvent writing from scratch and the common programming errors associated with it.

Pophale, Swaroop [ORNL] (ORCID:0000000185446367)↗

SAPHIRE 8 Quality Assurance Software Metrics Report

The purpose of this review of software metrics is to examine the quality of the metrics gathered in the 2010 IV&V and to set an outline for results of updated metrics runs to be performed. We find from the review that the maintenance of accepted quality standards presented in the SAPHIRE 8 initial Independent Verification and Validation (IV&V) of April, 2010 is most easily achieved by continuing to utilize the tools used in that effort while adding a metric of bug tracking and resolution. Recommendations from the final IV&V were to continue periodic measurable metrics such as McCabe's complexity measure to ensure quality is maintained. The four software tools used to measure quality in the IV&V were CodeHealer, Coverage Validator, Memory Validator, Performance Validator, and Thread Validator. These are evaluated based on their capabilities. We attempted to run their latest revisions with the newer Delphi 2010 based SAPHIRE 8 code that has been developed and was successful with all of the Validator series of tools on small tests. Another recommendation from the IV&V was to incorporate a bug tracking and resolution metric. To improve our capability of producing this metric, we integrated our current web reporting system with the SpiraTest test management software purchased earlier this year to track requirements traceability.

97 MATHEMATICS AND COMPUTING↗

Memory Scalability and Efficiency Analysis of Parallel Codes

Memory scalability is an enduring problem and bottleneck that plagues many parallel codes. Parallel codes designed for High Performance Systems are typically designed over the span of several, and in some instances 10+, years. As a result, optimization practices which were appropriate for earlier systems may no longer be valid and thus require careful optimization consideration. Specifically, parallel codes whose memory footprint is a function of their scalability must be carefully considered for future exa-scale systems. In this paper we present a methodology and tool to study the memory scalability of parallel codes. Using our methodology we evaluate an application s memory footprint as a function of scalability, which we coined memory efficiency, and describe our results. In particular, using our in-house tools we can pinpoint the specific application components which contribute to the application s overall memory foot-print (application data- structures, libraries, etc.).

Janjusic, Tommy↗

Buffer-IPyC separation process in TRISO fuel particles simulated with Bison code

During High Temperature Gas-cooled Reactor (HTGR) operation, tristructural isotropic (TRISO) coated-particle fuel undergoes irradiation-induced changes in morphology and thermomechanical properties. Experimental results from the Advanced Gas Reactor (AGR) Fuel Development and Qualification Program show, among other things, the mechanism of gap formation between the buffer and inner pyrolytic carbon (IPyC) layers, which could be explored further via computational simulations using the Bison code. Two simulation models were developed, the debonding restricted model, where no gap formation between buffer and IPyC layers is permitted, and the debonding enabled model, where the gap between those layers is created. The inputs of the simulated models are based on the irradiation conditions from the AGR-1 experiment. The research included simulations on spherical and aspherical fuel types. Under the specific temperatures and fluences of the AGR-1 irradiation experiment, and the Bison simulations, it was concluded that the most common scenario is a gap formation along the buffer-IPyC interface, while the least possible scenario is the situation where there is no gap formation at the buffer-IPyC junction. The computational results confirmed that the sphericity of the fuel influences the thickness of the gap that occurs at the buffer-IPyC junction, in a way that with increasing aspect ratio the gap thickness increases. The results obtained for spherical and aspherical fuel are nearly identical. Finally, performed simulations match conclusions observed from the AGR-1 experiment, which as such shows that the Bison code is a good computational method for simulating the TRISO fuel. Future simulations will include the validation of performed research and comparison of the results between Bison and PARFUME codes.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

A thermodynamics-based damage model for the non-linear mechanical behavior of SiC/SiC ceramic matrix composites in irradiation and thermal environments

A damage model is developed and validated with experimental data for the non-linear mechanical behavior of SiC/SiC composite materials in nuclear applications. Cyclic thermal and mechanical loading associated with neutron irradiation effects of these composites leads to wide-spread and progressive micro-cracking that leads to loss of thermal conductivity and further enhancement of thermo-mechanical damage. A physics-based model of wide-spread micro-cracking is developed within the thermodynamic framework of continuum damage mechanics. Evolution equations for damage parameters that describe the growth of continuum damage are developed, where the material variables are obtained from experiments. The model novelty is in coupling mechanical, thermal, and irradiation damage through a consistent thermodynamic framework, including loss of thermal conductivity due to the evolution of mechanically induced micro-cracks. A number of thermo-mechanical experiments were conducted to confirm model assumptions. The model is shown to be validated with out-of-pile experiments, and then implemented using commercial finite element code COMSOL to the fuel cladding problem with normal and high radiation dose cases.

Materials Science↗

Addition of tabulated equation of state and neutrino leakage support to illinoisgrmhd

Here we have added support for realistic, microphysical, finite-temperature equations of state (EOS) and neutrino physics via a leakage scheme to illinoisgrmhd, an open-source GRMHD code for dynamical spacetimes in the einstein toolkit. These new features are provided by two new, nrpy+-based codes: nrpyeos, which performs highly efficient EOS table lookups and interpolations, and nrpyleakage, which implements a new, adaptive mesh refinement (AMR)-capable neutrino leakage scheme in the einstein toolkit. We have performed a series of strenuous validation tests that demonstrate the robustness of these new codes, particularly on the Cartesian AMR grids provided by carpet. Furthermore, we show results from fully dynamical GRMHD simulations of single unmagnetized neutron stars, and magnetized binary neutron star mergers. This new version of illinoisgrmhd, as well as nrpyeos and nrpyleakage, is pedagogically documented in jupyter notebooks and fully open source. The codes will be proposed for inclusion in an upcoming version of the einstein toolkit.

79 ASTRONOMY AND ASTROPHYSICS↗

Validation of columnar CsI x-ray detector responses obtained with hybridMANTIS, a CPU-GPU Monte Carlo code for coupled x-ray, electron, and optical transport

Purpose: hybridMANTIS is a Monte Carlo package for modeling indirect x-ray imagers using columnar geometry based on a hybrid concept that maximizes the utilization of available CPU and graphics processing unit processors in a workstation. Methods: The authors compare hybridMANTIS x-ray response simulations to previously published MANTIS and experimental data for four cesium iodide scintillator screens. These screens have a variety of reflective and absorptive surfaces with different thicknesses. The authors analyze hybridMANTIS results in terms of modulation transfer function and calculate the root mean square difference and Swank factors from simulated and experimental results. Results: The comparison suggests that hybridMANTIS better matches the experimental data as compared to MANTIS, especially at high spatial frequencies and for the thicker screens. hybridMANTIS simulations are much faster than MANTIS with speed-ups up to 5260. Conclusions: hybridMANTIS is a useful tool for improved description and optimization of image acquisition stages in medical imaging systems and for modeling the forward problem in iterative reconstruction algorithms.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗