SEARCH · Engineering Papers

Results for “benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30

All sources NASA NTRS DOE OSTI

DOE OSTI2015

Integrated Geologic and Geophysical Approach for Establishing Geothermal Play Fairways and Discovering Blind Geothermal Systems in the Great Basin Region, Western USA: A Progress Report

We have undertaken an integrated geologic, geochemical, and geophysical study of a broad 240-km-wide, 400-km-long transect stretching from west-central to eastern Nevada in the Great Basin region of the western USA. The main goal of this study is to produce a comprehensive geothermal potential map that incorporates up to 11 parameters and identifies geothermal play fairways that represent potential blind or hidden geothermal systems. Our new geothermal potential map incorporates: 1) heat flow; 2) geochemistry from springs and wells; 3) structural setting; 4) recency of faulting; 5) slip rates on Quaternary faults; 6) regional strain rate; 7) slip and dilation tendency on Quaternary faults; 8) seismologic data; 9) gravity data; 10) magnetotelluric data (where available); and 11) seismic reflection data (primarily from the Carson Sink and Steptoe basins). The transect is respectively anchored on its western and eastern ends by regional 3D modeling of the Carson Sink and Steptoe basins, which will provide more detailed geothermal potential maps of these two promising areas. To date, geological, geochemical, and geophysical data sets have been assembled into an ArcGIS platform and combined into a preliminary predictive geothermal play fairway model using various statistical techniques. The fairway model consists of the following components, each of which are represented in grid-cell format in ArcGIS and combined using specified weights and mathematical operators: 1) structural component of permeability; 2) regional-scale component of permeability; 3) combined permeability, and 4) heat source model. The preliminary model demonstrates that the multiple data sets can be successfully combined into a comprehensive favorability map. An initial evaluation using known geothermal systems as benchmarks to test interpretations indicates that the preliminary modeling has done a good job assigning relative ranks of geothermal potential. However, a major challenge is defining logical relative rankings of each parameter and how best to combine the multiple data sets into the geothermal potential/ permeability map. Ongoing feedback and data analysis are in use to revise the grouping and weighting of some parameters in order to develop a more robust, optimized, final model. The final product will incorporate more parameters into a geothermal potential map than any previous effort in the region and may serve as a prototype to develop comprehensive geothermal potential maps for other regions.

15 GEOTHERMAL ENERGY↗

DOE OSTI2016

IMPLEMENTATION AND VALIDATION OF A FULLY IMPLICIT ACCUMULATOR MODEL IN RELAP-7

This paper presents the implementation and validation of an accumulator model in RELAP-7 under the framework of preconditioned Jacobian free Newton Krylov (JFNK) method, based on the similar model used in RELAP5. RELAP-7 is a new nuclear reactor system safety analysis code being developed at the Idaho National Laboratory (INL). RELAP-7 is a fully implicit system code. The JFNK and preconditioning methods used in RELAP-7 is briefly discussed. The slightly modified accumulator model is summarized for completeness. The implemented model was validated with LOFT L3-1 test and benchmarked with RELAP5 results. RELAP-7 and RELAP5 had almost identical results for the accumulator gas pressure and water level, although there were some minor difference in other parameters such as accumulator gas temperature and tank wall temperature. One advantage of the JFNK method is its easiness to maintain and modify models due to fully separation of numerical methods from physical models. It would be straightforward to extend the current RELAP-7 accumulator model to simulate the advanced accumulator design.

Accumulator↗

DOE OSTI2012

Simulating the Effects of Stellarator Geometry on Gyrokinetic Drift-Wave Turbulence

Nuclear fusion is a clean, safe form of energy with abundant fuel. In magnetic fusion energy (MFE) experiments, the plasma fuel is confined by magnetic fields at very high temperatures and densities. One fusion reactor design is the non-axisymmetric, torus-shaped stellarator. Its fully-3D fields have advantages over the simpler, better-understood axisymmetric tokamak, including the ability to optimize magnetic configurations for desired properties, such as lower transport (longer confinement time). Turbulence in the plasma can break MFE confinement. While turbulent transport is known to cause a significant amount of heat loss in tokamaks, it is a new area of research in stellarators. Gyrokinetics is a good mathematical model of the drift-wave instabilities that cause turbulence. Multiple gyrokinetic turbulence codes that had great success comparing to tokamak experiments are being converted for use with stellarator geometry. This thesis describes such adaptations of the gyrokinetic turbulence code, GS2. Herein a new computational grid generator and upgrades to GS2 itself are described, tested, and benchmarked against three other gyrokinetic codes. Using GS2, detailed linear studies using the National Compact Stellarator Experiment (NCSX) geometry were conducted. The first compares stability in two equilibria with different beta=(plasma pressure)/(magnetic pressure). Overall, the higher beta case was more stable than the lower beta case. As high beta is important for MFE experiments, this is encouraging. The second compares NCSX linear stability to a tokamak case. NCSX was more stable with a 20% higher critical temperature gradient normalized by the minor radius, suggesting that the fusion power might be enhanced by about 50%. In addition, the first nonlinear, non-axisymmetric GS2 simulations are presented. Finally, linear stability of two locations in a W7-AS plasma were compared. The experimentally-measured parameters used were from a W7-AS shot in which measured heat fluxes match neoclassical theory predictions at inner radii, but are too large for neoclassical predictions at outer radii. Results from GS2 linear simulations show that the outer location has higher gyrokinetic instability growth rates than at the inner one. Mixing-length estimates of the heat flux are within a factor of 3 of the experimental measurements, indicating that gyrokinetic turbulence may be responsible for the higher transport measured by the experiment in the outer regions. Future nonlinear simulations can explore this question in more detail.

Gyrokinetics↗

DOE OSTI2017

SCANAIR-BISON BENCHMARK ON CIP0-1 RIA TEST

In the frame of their research programs on fuel safety, the French “Institut de Radioprotection et de Sûreté Nucléaire” (IRSN) and the Idaho National Laboratory (INL) have developed respectively SCANAIR and BISON codes to describe the thermo-mechanical behavior of irradiated fuel rods during Reactivity Initiated Accidents (RIA) in LWR. A RIA, characterized by a very rapid increase of reactivity and power in some rods of the reactor, can be schematically represented in two main phases. First, the energy deposition leads to a rapid rise of the fuel temperature which induces thermal swelling of the fuel pellets. During this phase, the Pellet Clad Mechanical Interaction (PCMI) leads to clad deformation and potentially to failure depending on fuel enthalpy increase and on the level of clad embrittlement. After the PCMI phase, the increase of clad temperature can lead to the boiling crisis of the water surrounding the rod. During the film boiling phase, the clad to coolant heat transfer becomes very low and the clad can reach high temperature (>700°C). Depending on the internal gas pressure, the ductile clad can undergo large deformation and possible failure. The RIA codes have to predict properly these two phases of the transient in order to be used, in particular, to assess current fuel safety criteria but also to be able to predict the behavior of upcoming fuel (such as accident tolerant fuel). In this paper, codes computation comparison against experimental data obtained on CIP0-1 test is done for the first phase of the transient, the PCMI phase, in order to point out the strengths and weaknesses of the codes. The CIP0-1 experiment was performed with UO2 high burnup fuel in the CABRI sodium loop facility, at 280°C and low pressure (~3 bars) without boiling crisis and no failure of the fuel rod. The initial state of the rod calculated by irradiation codes are compared with measurements before the transient. Then global rod thermal behavior during the CIP0-1 test is assessed with the sodium coolant temperature measurements. The rod mechanical behavior is analyzed with the fuel and clad elongation and the clad residual hoop strain. Finally comparison of the fission gas behavior between codes is performed and compared to the measurements of the fission gas released in the experiment.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2015

Integrated Geologic and Geophysical Approach for Establishing Geothermal Play Fairways and Discovering Blind Geothermal Systems in the Great Basin Region, Western USA: A Progress Report

We have undertaken an integrated geologic, geochemical, and geophysical study of a broad 240-km-wide, 400-kmlong transect stretching from west-central to eastern Nevada in the Great Basin region of the western USA. The main goal of this study is to produce a comprehensive geothermal potential map that incorporates up to 11 parameters and identifies geothermal play fairways that represent potential blind or hidden geothermal systems. Our new geothermal potential map incorporates: 1) heat flow; 2) geochemistry from springs and wells; 3) structural setting; 4) recency of faulting; 5) slip rates on Quaternary faults; 6) regional strain rate; 7) slip and dilation tendency on Quaternary faults; 8) seismologic data; 9) gravity data; 10) magnetotelluric data (where available); and 11) seismic reflection data (primarily from the Carson Sink and Steptoe basins). The transect is respectively anchored on its western and eastern ends by regional 3D modeling of the Carson Sink and Steptoe basins, which will provide more detailed geothermal potential maps of these two promising areas. To date, geological, geochemical, and geophysical data sets have been assembled into an ArcGIS platform and combined into a preliminary predictive geothermal play fairway model using various statistical techniques. The fairway model consists of the following components, each of which are represented in grid-cell format in ArcGIS and combined using specified weights and mathematical operators: 1) structural component of permeability; 2) regional-scale component of permeability; 3) combined permeability, and 4) heat source model. The preliminary model demonstrates that the multiple data sets can be successfully combined into a comprehensive favorability map. An initial evaluation using known geothermal systems as benchmarks to test interpretations indicates that the preliminary modeling has done a good job assigning relative ranks of geothermal potential. However, a major challenge is defining logical relative rankings of each parameter and how best to combine the multiple data sets into the geothermal potential/permeability map. Ongoing feedback and data analysis are in use to revise the grouping and weighting of some parameters in order to develop a more robust, optimized, final model. The final product will incorporate more parameters into a geothermal potential map than any previous effort in the region and may serve as a prototype to develop comprehensive geothermal potential maps for other regions.

15 GEOTHERMAL ENERGY↗

DOE OSTI2021

An Orthogonal Recursive Bisection (ORB) Based Time Advancement Algorithm for CFD-DEM Solvers

The time integration of the granular phase in coupled computational fluid dynamics (CFD) – discrete element method (DEM) simulations presents a unique computational challenge brought about by the large variations in particle collisional time scales. Particles in the dilute regions of the computational domain can be advanced with large time steps while dense regions require much smaller time increments. However, the time step size in most solvers is globally set as the limit for accuracy and stability imposed by the collisions and is typically orders of magnitude less than that required away from collisions. This work addresses this precise issue and provides a strategy to avoid the use of a global conservative small time step size for the entire set of particles.A novel time stepping algorithm for CFD-DEM solvers using a partitioning approach using orthogonal recursive bisection (ORB) that allows for variable time steps among particles is described and its computational performance is compared against baseline explicit methods, typically used in several CFD-DEM solvers. ORB has advantages of being relatively quick and easy to update incrementally and has the required heuristic behavior (i.e., it will split the region in half with a cluster on each side) when groups of particles are well separated (clustered). The algorithm presented in this work uses a local time stepping approach to resolve collisional time scales for subsets of particles that are present at the leaves of the ORB, thereby resulting in substantial reduction of computational cost. The parallel implementation of this method where a ``knapsack” algorithm is used in tandem with ORB for effective load-balancing is also presented, where a best possible partitioning is obtained based on number of particles and local time-stepping costs. The algorithm is tested against benchmark problems with varying particle distributions that include fluidized bed and riser flow scenarios. Preliminary results indicate that the approach is 2-3X faster than traditional explicit methods for problems that involve both dense and dilute regions, while maintaining the same level of accuracy.

adaptive timestepping↗

DOE OSTI2017

Evaluating the Practicability of Multiphase CFD for BWR Fuel Assembly Analysis

Multiphase computational fluid dynamics (M-CFD) models of a boiling water reactor (BWR) fuel assembly have been generated in the commercial CFD code, STAR-CCM+ Ver.11.04.010-R8. The Eulerian multiphase approach was employed, in combination with a baseline ‘Zero Closure model’ for two-phase flow boiling, applicable to high void fraction regimes. The capability and practicability of MCFD for BWR fuel assembly were evaluated against the international OECD/NRC BWR Full-size Finemesh Bundle Test (BFBT) benchmark data. The benchmark selected, BFBT-4101-61, is a steady-state full power case, with high void fraction conditions. Geometrical modeling and mesh construction of BWR assemblies introduce challenges in generating high quality computational meshes, while retaining a low cell count to allow acceptable runtimes. In order to evaluate the scalability of the CFD code, parallel CFD simulations were carried out with the High Performance Computing (HPC) system of the Idaho National Laboratory. M-CFD results display good agreement with the experimental data for both local void fraction distribution and exit quality. The parallel speedup factor is linearly proportional to the number of processors up to 500 cores, and retains over 92% efficiency with 1000 cores. The execution time of the simulation decreased exponentially with increasing number of processors while the cost of the simulation increased linearly. The proposed baseline closure, in combination with the parallel performance of the STAR-CCM+ code demonstrated promising capabilities for analyzing BWR fuel assemblies.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2012

Krylov subspace iteration for eigenvalue response matrix calculations

Recent work has revisited the eigenvalue response matrix method as an approach for reactor core analyses. In its most straightforward form, the method consists of a two-level Eigen problem. An outer Picard iteration updates the k-eigenvalue, while the inner Eigen problem imposes current continuity between coarse meshes. In this paper, several Eigen solvers are evaluated for this inner problem, using several 2-D diffusion benchmarks as test cases. The results indicate both the explicitly-restarted Arnoldi and the Krylov-Schur methods are up to an order of magnitude more efficient than power iteration. This increased efficiency makes the nested eigenvalue formulation more effective than the ILU-preconditioned Newton-Krylov formulation previously studied. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2016

Implementation and validation of a fully implicit accumulator model in RELAP-7

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2016

Predicting Future Solar Modulation and Implementation in MCNP6

The application of detecting low level radiation in the field requires quantification of the natural radiation background specific to that location. This background is made up two primary components: naturally decaying radionuclides in the soil and atmosphere known as terrestrial background, and the particle cascades caused by high energy cosmic radiation interacting within the earth's atmosphere known as cosmic background. The terrestrial component dominates the background spectrum below approximately 2 MeV, however, the cosmic component comprises the entirety of the high-energy spectrum. Furthermore, the terrestrial component is relatively constant for a given location while the cosmic component is heavily dependent on solar activity, an effect known as solar modulation. Annual values of the solar modulation parameter, φ, have been determined since 1936, and their fluctuations are seen to be roughly sinusoidal over time. If one wished to predict or simulate the outcome of an experiment in the future, a prediction for the solar modulation would be necessary to accurately determine the cosmic background contribution. The previous version 6.1.1 of MCNP contained solar modulation data for 46 years between 1960 and 2005. This data was updated with newer solar modulation data, from I. G. Usoskin et al., which reports solar modulation data for an additional 33 years between 1936 and 2014. In order to use past solar modulation data to predict cosmic background radiation fluctuations for dates beyond 2014 an algorithm was developed to forecast future solar modulation data based on the sinusoidal behavior exhibited in recorded data. This algorithm was implemented into MCNP 6.1.2 to be used for cosmic background simulations and tested against benchmark data to assess its accuracy. (authors)

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Updates to the HTR-PROTEUS HALEU Benchmark Using Modern Analysis Methodologies

The HTR-PROTEUS IRPhEP Handbook benchmarks represent some of the highest quality benchmarks available for systems with TRISO-HALEU fuel, graphite pebbles, graphite reflector, and high neutron leakage. Nevertheless, significant variability in computed eigenvalue results was encountered in HTR-PROTEUS configurations that are relevant for transportation configurations. The team will investigate the source of these variabilities in the original benchmark. In addition, the team will investigate the HTR-PROTEUS subcritical measurements, kinetics data, and potential criticality effects from the introduction of hydrogen in the system (water ingress). The project will generate a benchmark evaluation of additional HTR-PROTEUS measurements that can significantly increase the value of these criticality benchmarks in testing nuclear codes and data to support transportation validation needs for industry and the U.S. NRC.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2014

Results of the 2013 UT modeling benchmark obtained with models implemented in CIVA

The 2013 Ultrasonic Testing (UT) modeling benchmark concerns direct echoes from side drilled holes (SDH), flat bottom holes (FBH) and corner echoes from backwall breaking artificial notches inspected with a matrix phased array probe. This communication presents the results obtained with the models implemented in the CIVA software: the pencilmodel is used to compute the field radiated by the probe, the Kirchhoff approximation is applied to predict the response of FBH and notches and the SOV (Separation Of Variables) model is used for the SDH responses. The comparison between simulated and experimental results are presented and discussed.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2020

Spin Splitting Energy of Transition Metals: A New, More Affordable Wave Function Benchmark Method and Its Use to Test Density Functional Theory

Accurately predicting the spin splitting energy of chemical species is important for understanding their reactivity and magnetic properties, but it is very challenging, especially for molecules containing transition metals. One impediment to progress is the scarcity of accurate benchmark data. Here we report a set of calculations designed to yield reliable benchmarks for simple transition-metal complexes that can be used to test density functional methods that are affordable for large systems of more practical interest. Various wave function methods are tested against experiment for Fe 2+ , Fe 3+ , and Co 3+ , including CASSCF, CASPT2, CASPT3, MRCISD, MRCISD+Q, ACPF, AQCC, CCSD(T), and CASPT2/CCSD(T) and also a new method called CASPT2.5, which is performed by taking the average of the CASPT2 and CASPT3 energies. Furthermore, we find that MRCISD+Q, ACPF, and AQCC require smaller active spaces for good accuracy than are required by CASPT2 and CASPT3, and this aspect may be important for calculations on larger molecules; here we find that CASPT2.5 extrapolated to a complete basis set is the most suitable method—in terms of computational cost and in terms of accuracy on monatomic systems—and therefore we chose this method for molecular benchmarks. Then Kohn–Sham density functional calculations with 60 exchange-correlation functionals are tested for FeF 2 , FeCl 2 , and CoF 2 . We find that MN15-L, M06-SX, and revM06 have very good agreement with CASPT2.5 benchmarks in terms of both the spin splitting energy and the optimized geometry for each spin state. In addition, we recommend def2-TZVP as the most suitable basis set to perform density functional calculations for molecular spin splitting energies; extra polarization functions in the basis set do not help to increase the accuracy of the spin splitting energy in KS calculations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2014

Application of the Hybrid Diffusion-Transport Spatial Homogenization Method to a Pressurized Water Reactor Benchmark Problem - Paper 70

The recently developed Hybrid Diffusion-Transport Spatial Homogenization (DTH) method was previously tested on a benchmark problem typical of a boiling water reactor. In this summary, the DTH method is tested in a 1-D benchmark problem typical of a pressurized water reactor. The method recreates the heterogeneous flux to within 1% average flux error and 34 pcm eigenvalue error in half the time as a heterogeneous transport calculation. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2013

Neutronics Benchmark Specifications for EBR-II Shutdown Heat Removal Test SHRT-45R - Revision 1

A neutronics benchmark specification was developed to support the analysis of SHRT-45R test, which was conducted in April 1986 using Experimental Breeder Reactor II (EBR-II) to demonstrate that a sodium-cooled fast reactor (SFR) with a sodium-bonded metallic fuel could be designed such that passive phenomena, as opposed to active electromechanical systems, are effective in protecting the reactor against the potentially adverse consequences of unprotected accidents.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2022

TRIPOLI-4 neutronics calculations for IAEA-CRP benchmark of CEFR start-up tests using new libraries JEFF-3.3 and ENDF/B-VIII

Sodium-cooled Fast Reactors (SFR) are one of the promising Generation IV fast reactors. The China Experimental Fast Reactor (CEFR) is a 65 MWth pool-type SFR with a high neutron leakage core using high enriched uranium oxide fuel. The CEFR start-up tests in 2010 consist of series of neutronics experiments. Essential experimental data are available from the 2018 IAEA-CEFR-CRP benchmark document and useful for the validation of neutron transport codes and nuclear data libraries. The TRIPOLI-4 Monte Carlo transport code is a general-purpose neutronics code using continuous-energy nuclear data libraries. It has a rich validation database covering different computational and experimental benchmark data sets to assure the accuracy and credibility of numerical studies. Previous TRIPOLI-4 SFR core physics calculations used mainly MOX fuels. SFR control rod worth studies with TRIPOLI-4 were mainly on big-size cores. To test the modeling capability of TRIPOLI-4 on fuel loading patterns and on variable control rods positions for SFRs and to check recent nuclear data libraries, it is interesting to investigate the CEFR start-up tests in this work, including core states from subcritical to supercritical, control rods and rod group worth, point kinetics parameters, and radial foil activation measurements. TRIPOLI-4 calculation results using new data libraries JEFF-3.3, ENDF/B-VIII, and those of ENDF/B-VII.1 for different CEFR core states are reported here. By means of different options of TRIPOLI-4, control-rod SAs reactivity worth, point kinetics parameters, and radial {sup 237}Np(n,f) fission rate distribution were successfully evaluated. Both ENDF/B-VIII and JEFF-3.3 nuclear data libraries provided reliable results with a difference of 170 +/- 11 pcm in k{sub eff}.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

NASA NTRS2010

Experimental Creep Life Assessment for the Advanced Stirling Convertor Heater Head

The United States Department of Energy is planning to develop the Advanced Stirling Radioisotope Generator (ASRG) for the National Aeronautics and Space Administration (NASA) for potential use on future space missions. The ASRG provides substantial efficiency and specific power improvements over radioisotope power systems of heritage designs. The ASRG would use General Purpose Heat Source modules as energy sources and the free-piston Advanced Stirling Convertor (ASC) to convert heat into electrical energy. Lockheed Martin Corporation of Valley Forge, Pennsylvania, is integrating the ASRG systems, and Sunpower, Inc., of Athens, Ohio, is designing and building the ASC. NASA Glenn Research Center of Cleveland, Ohio, manages the Sunpower contract and provides technology development in several areas for the ASC. One area is reliability assessment for the ASC heater head, a critical pressure vessel within which heat is converted into mechanical oscillation of a displacer piston. For high system efficiency, the ASC heater head operates at very high temperature (850 C) and therefore is fabricated from an advanced heat-resistant nickel-based superalloy Microcast MarM-247. Since use of MarM-247 in a thin-walled pressure vessel is atypical, much effort is required to assure that the system will operate reliably for its design life of 17 years. One life-limiting structural response for this application is creep; creep deformation is the accumulation of time-dependent inelastic strain under sustained loading over time. If allowed to progress, the deformation eventually results in creep rupture. Since creep material properties are not available in the open literature, a detailed creep life assessment of the ASC heater head effort is underway. This paper presents an overview of that creep life assessment approach, including the reliability-based creep criteria developed from coupon testing, and the associated heater head deterministic and probabilistic analyses. The approach also includes direct benchmark experimental creep assessment. This element provides high-fidelity creep testing of prototypical heater head test articles to investigate the relevant material issues and multiaxial stress state. Benchmark testing provides required data to evaluate the complex life assessment methodology and to validate that analysis. Results from current benchmark heater head tests and newly developed experimental methods are presented. In the concluding remarks, the test results are shown to compare favorably with the creep strain predictions and are the first experimental evidence for a robust ASC heater head creep life.

Krause, David L.↗

DOE OSTI2025

ON THE EFFECTIVENESS OF LLMS IN UNIT TEST GENERATION FOR STRUCTURED TEXT PROGRAMS

The reliability of industrial automation systems heavily depends on the correctness of Programmable Logic Controller (PLC) programs, which are often written in Structured Text (ST). While Large Language Models (LLMs) have shown promise in automating test generation for mainstream programming languages, their effectiveness for the syntactically strict ST language remains underexplored. This thesis presents a systematic empirical evaluation of three state-of-the-art LLMs—GPT-4o, Gemini 2.5 Pro, and Claude Sonnet 4.5—for generating ST unit tests. We examine three prompting strategies: Natural Language (NL), Code Language (CL), and Chain-of-Thought (CoT), across a curated set of 11 ST function blocks. The quality of the generated tests is assessed using Compilation Success Rate (CSR), Statement Coverage (SC), and Branch Coverage (BC). In the zero-shot setting, Claude Sonnet 4.5 achieves the highest CSR, while Gemini 2.5 Pro consistently delivers the best statement and branch coverage, particularly under CL prompts. By incorporating a one-shot CL prompt, all models exhibit substantial improvements—most notably GPT-4o, whose CSR increases from 45.45% to 90.91%, with substantial gains in both SC and BC. To further contextualize these findings, we compare GPT-4o’s one-shot results with PLCAutoTester, a state-ofthe- art ST unit test generation tool, on an additional benchmark dataset. While LLMgenerated tests approach competitive coverage levels, PLCAutoTester maintains significantly higher and more stable coverage across programs. This study provides the first comprehensive benchmark of modern LLMs for ST unit testing, highlighting their strengths, limitations, and improvements through one-shot prompting, and positioning their performance relative to specialized automated testing tools in industrial automation.

42 ENGINEERING↗