Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18
All sourcesNASA NTRSDOE OSTI
NASA NTRS2011

In Situ Validation of the Soil Moisture Active Passive (SMAP) Satellite Mission

SMAP is a new NASA mission proposed for 2014 that would provide a number of soil moisture and freeze/thaw products. The soil moisture products span spatial resolutions from 3 to 40 km. In situ soil moisture observations will be one of the key elements of the validation program for SMAP. Data from the currently available set of soil moisture observing sites and networks need improvement if they are to be useful. Problems include a lack of standardization of instrumentation and installation and the disparity in spatial scale between the point-scale in situ data (a few centimeters) and the coarser satellite products. SMAP has initiated activities to resolve these issues for some of the existing resources. The other challenge to soil moisture validation is the need to expand the number of sites and their geographic distribution. SMAP is attempting to increase the number of sites and their value in validation through collaboration. The issues and solutions involving in situ validation being investigated will be described along with recent results from SMAP validation projects.

validation↗
NASA NTRS2013

Verification and Validation Studies for the LAVA CFD Solver

The verification and validation of the Launch Ascent and Vehicle Aerodynamics (LAVA) computational fluid dynamics (CFD) solver is presented. A modern strategy for verification and validation is described incorporating verification tests, validation benchmarks, continuous integration and version control methods for automated testing in a collaborative development environment. The purpose of the approach is to integrate the verification and validation process into the development of the solver and improve productivity. This paper uses the Method of Manufactured Solutions (MMS) for the verification of 2D Euler equations, 3D Navier-Stokes equations as well as turbulence models. A method for systematic refinement of unstructured grids is also presented. Verification using inviscid vortex propagation and flow over a flat plate is highlighted. Simulation results using laminar and turbulent flow past a NACA 0012 airfoil and ONERA M6 wing are validated against experimental and numerical data.

Validation↗
NASA NTRS2021

Validation of IASI Satellite Ammonia Observations at the Pixel Scale Using In Situ Vertical Profiles

Satellite ammonia (NH 3 ) observations provide unprecedented insights into NH3 emissions, spatiotemporal variabilities and trends, but validation with in situ measurements remains lacking. Here, total columns from the Infrared Atmospheric Sounding Interferometer (IASI) were intercompared to boundary layer NH 3 profiles derived from aircraft- and surface-based measurements primarily in Colorado, USA, in the summer of 2014. IASI-NH 3 version 3 near real-time data set compared well to in situ derived columns (windows ±15 km around centroid, ±1 h around overpass time) with a correlation of 0.58, a slope of 0.78 ± 0.14 and an intercept of 2.1 × 10 15 ±1.5 × 10 15 molecules cm −2 . Agreement degrades at larger spatiotemporal windows, consistent with the short atmospheric lifetime of NH 3 . We also examined IASI version 3R data, which relies on temperature retrievals from the ERA Reanalysis, and a third product generated using aircraft-measured temperature profiles. The overall agreement improves slightly for both cases, and neither is biased within their combined measurement errors. Thus, spatiotemporal averaging of IASI over large windows can be used to reduce retrieval noise. Nonetheless, sampling artifacts of airborne NH 3 instruments result in significant uncertainties of the in situ-derived columns. For example, large validation differences exist between ascent and descent profiles, and the assumptions of the free tropospheric NH 3 profiles used above the aircraft ceiling significantly impact the validation. Because short-lived species like NH 3 largely reside within the boundary layer with complex vertical structures, more comprehensive validation is needed across a wide range of environments. More accurate and widespread in situ NH 3 data sets are therefore required for improved validations of satellite products.

Ammonia↗
DOE OSTI2016

Initial Validation of the Neutron Physics Codes in COSINE Using the MIT BEAVRS Benchmark

A software package for nuclear power plant design and analysis, known as COSINE, has been developed by State Nuclear Power Software Development Center (SNPSDC). A detailed benchmark called BEAVRS which includes measured reactor data is presented by MIT. The BEAVRS benchmark is based on a commercial power plant and provides a highly-detailed Pressurized Water Reactor (PWR) specification with measured operational data that has been used to validate the neutron physics codes in COSINE. In this paper, a COSINE core model is prepared to calculate the BEAVRS benchmark. The first stage validation is focused on the depletion of two cycles and initial physics test of cycle 1. The calculation results agree well with the measured data. It could be confirmed that the COSINE codes package has the ability to design and analyze a commercial PWR core, and the precision of the calculation results can meet the requirements of industrial design and analysis. A calculation of MIT BEAVRS benchmark using COSINE has been performed in this paper. A lot of measurements are given in the benchmark specification which can be used for code validation. The calculation includes a depletion calculation of both two cycles and a calculation of the initial physics test of cycle 1. COSINE neutron physics codes use the mature industrial calculation method which can achieve reasonable results with acceptable accuracy and speed. Through the calculation, it can be seen that the difference of critical boron concentration calculated from cos Nu is less than 25 pcm compared with measured data. And the relative difference of rod worth is less than 10%. The isothermal temperature coefficient difference between measurement and calculation is less than 1 pcm/deg. F. All results meet the criteria of ANS. The validation for measurements after initial physics test following a more complex power history and the validation for in-core detector signals are underway. (authors)

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

Open-air Demolition: Validation of EPA Approved Alternative Method for Emission Estimation - 19397

Emissions from open-air demolition of US Department of Energy (DOE) facilities are regulated by the US Environmental Protection Agency (EPA) under 40 CFR 61 subpart H. This regulation requires that facilities estimate emissions using an EPA approved method from activities such as open-air demolition prior to commencing the activity. Should those emissions exceed certain thresholds, the facility may be required to obtain an Approval to Construct or Modify the facility and/or installed monitoring methods meeting methods acceptable to EPA. There are no EPA approved methods that are specific to open-air demolition methods. For this project the DOE and CH2M Hill BWXT elected to prepare an alternative method specific to open-air demolition. EPA conditionally approved the method but required validation of the method during the demolition of the Vitrification Facility at the West Valley Demonstration Project (WVDP) before use for open-air demolition at other WVDP structures. The validation method included detailed source characterization, close-in ambient samplers, and a comparison of measured results to predicted emissions using AERMOD (American Meteorological Society (AMS) and U.S. Environmental Protection Agency (EPA) Regulatory Model). The methods evaluated include hydraulic hammers, mechanical shears, load out of waste and handling of the debris piles. The validation method involved the collection and analysis of ambient air samples from air samplers located at strategic locations within the projected plume path of the demolition activities. The analytical results from the air samplers were then compared to ambient air concentrations predicted at the sampler locations with the EPA model AERMOD. The input to the AERMOD software is a source term developed weekly using the alternative method and material at risk disturbed during each week. To account for the building wake effects of the surrounding structures, virtual point sources were developed in the AERMOD model and placed at the locations of the demolition, debris piles, debris handling and load out areas. It was found that the factors used for hydraulic hammering were extremely conservative and that emissions from the debris pile were not only the primary emission source, but that the moisture content of the debris pile and the wind speed were critical factors that must be considered in future open-air demolition projects. Based on the results of the validation process, adjustments were made to the alternative method. The final validated alternative method provides an approach for estimating airborne emissions from open-air demolition methods and techniques. The method will be used in lieu of 40 CFR 61 Appendix D to estimate emissions from future open-air demolition projects at the WVDP. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2015

Use of tsunami in the validation of scale 6.1 for the Swedish spent fuel repository - 14381

In March 2011 SKB applied to the Swedish Radiation Safety Authority (SSM) for a permit to build a final repository for spent Fuel and an encapsulation plant (Clink). The application contained a criticality safety analysis for the canisters to be used in Clink and the copper canister to be used in the final repository. In 2012 SSM requested several updates to the application. One of SSM's concerns was the validation of the codes. SSM emphasized that SKB must improve the method to select critical experiments to the validation suite. To satisfy this demand, SKB used the tool Tsunami in the Scale 6.1 code package to select experiments from the handbook of criticality experiment (IHECSBE). With help of sensitivity files SKB evaluated almost 700 experiments from the LEU-COMP-THERM library. SKB then picked the experiments that most resembled our safety cases. The sensitivity coefficient, ck, from Tsunami has been used to evaluate the similarity between the experiments and the applications. It has been considered that a ck over 0.8 provides a 'good enough' similarity between the experiment and our evaluated safety cases. For the different safety cases between 50-600 experiments satisfied the 0.8 criteria giving a good base of data for statistical analysis. It is worth noticing that PWR-fuel generally receives a higher ck than BWR fuel. Initial analysis shows that the differences in results between BWR and PWR can be explained by a larger sensitivity for the U{sup 238} n,n' part of the cross section in the PWR cases. To make sure the validation covers all materials and required physical parameters a gap analysis was made using engineering judgement by criticality safety experts. From this exercise additional experiments were added to the suite. This paper will discuss the Tsunami results for different safety cases and the reasons for differences between them. It will also present the final results of the validation and discuss experiments that were excluded from the validation suite. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2025

Cross‐Cultural Validation of the Binge Eating Disorder Screener‐7 ( BEDS ‐7) Across 42 Countries

ABSTRACT Objective This study aimed to evaluate the reliability and validity of the Binge Eating Disorder Screener‐7 (BEDS‐7) across 42 countries and 26 languages, assessing its reliability and validity as a screening tool for binge‐eating disorder (BED) in diverse cultural contexts. Specifically, it sought to enhance early recognition of BED symptoms in primary care settings globally, contributing to a standardized framework for assessing BED. Method The International Sex Survey, a cross‐sectional online study, was conducted in 42 countries and 26 languages. A diverse community sample of 82,243 participants, aged 18 years or older, completed the BEDS‐7 and measures of sexuality, mental health, substance use, and sociodemographic characteristics. Confirmatory factor analyses and tests of measurement invariance were employed to evaluate the reliability and validity of the BEDS‐7 across languages, countries, genders, and sexual orientations. Results The BEDS‐7 demonstrated scalar factorial invariance across languages and countries, indicating consistent factor loadings and item intercepts. In contrast, the screener showed residual invariance across gender and sexual orientation groups, supporting its robustness across these demographics. Kruskal–Wallis tests revealed significant differences in BED symptoms across languages, countries, genders, and sexual orientations, with the highest BED scores observed among queer, pansexual, and gender‐diverse individuals. The BEDS‐7 also demonstrated adequate reliability (Cronbach's alpha > 0.80) and moderate criterion validity. Discussion The findings provide further evidence of the reliability and validity of the BEDS‐7 as a potential screening tool for identifying probable cases of BED globally, facilitating early intervention in primary care settings.

Gewirtz‐Meydan, Ateret [School of Social Work, Fac↗
DOE OSTI2024

Validation of a Hybrid Domain Overlapping Coupling Between SAM and CFD Against the TALL-3D Transients

The System Thermal Hydraulics (STH) code SAM has been coupled to the Computational Fluid Dynamics (CFD) code Simcenter STAR-CCM+ utilizing a hybrid domain overlapping method with an explicit coupling in time. The coupling aims to extend the STH code’s applicability to scenarios where local momentum and energy transfers are important yet difficult for STH codes to capture, such as three-dimensional (3D) mixing. The coupling method’s numerical stability was verified in the past against two closed-loop configurations, and it was validated against a double T-junction experiment with 3D scalar mixing. In the present work, the coupling method is validated against the TALL-3D STH/CFD coupling benchmark facility. TALL-3D is a three-legged, liquid-metal facility with a large, pool-type enclosure (test section) that exhibits 3D flow effects to be modeled by a CFD code. The rest of the system exhibits approximately 1D behavior well-predicted by an STH code. First, the present STAR-CCM+ CFD model of the 3D test section is validated against experimental data. Then, the SAM-STARCCM+ coupled model is validated against six different TALL-3D steady states, including SAM standalone model results for comparison. Lastly, the SAM-STARCCM+ coupled model is validated against two TALL-3D transients, one exhibiting flow reversal in the test section and one exhibiting nonlinear, Limit Cycle Oscillations (LCO). For the first transient, the SAM-STARCCM+ coupled model properly predicts an increase in the test section’s inlet temperature during flow reversal, and this is not predicted by the SAM standalone model. Following flow reversal, the SAM-STARCCM+ coupled model better-predicts the initial flow recovery and following oscillations as the system approaches a final natural circulation state. For the second transient, no true final steady state is observed due to LCO. Neither the SAM-STARCCM+ coupled model nor the SAM standalone model can perfectly capture the experiment’s changing oscillation frequency during the transient. However, the SAM-STARCCM+ coupled model does reproduce the oscillatory feedback observed in the system. This is a significant achievement as the SAM-STARCCM+ coupled model only uses an explicit coupling in time, as opposed to a semi-implicit coupling. In comparison, previous STH/CFD coupling efforts of the TALL-3D facility required semi-implicit coupling to obtain similar results.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Availability of Critical Benchmark Experiments for the Pebble Tanker Transportation Model for Nuclear Criticality Safety Validation of TRISO Pebbles

This study addresses the need for comprehensive investigations into TRi-structural ISOtropic (TRISO) fuel pebble transportation validation. In this work, an exploratory model, the pebble tanker(PT), was developed with the aim of facilitating the validation of nuclear criticality safety calculations in the context of industrial-scale transportation of TRISO fuel. The PT model was designed to investigate the availability and applicability of critical benchmark experiments crucial for assessing the transportation of these pebbles. This work incorporated sensitivity/uncertainty (S/U) similarity studies to quantify the applicability of critical benchmark experiments and to address nuclear data uncertainties in the context of TRISO transportation. Two container models were investigated: one for the Hermes-type pebble and one for the Pebble Bed Modular Reactor (PBMR)–type pebble. The models were simplified, considering fuel, containment, and either water or air, to enable a focus on the underlying physics of applications involving TRISO fuel pebbles using the PT model. A crucial aspect under consideration was the capacity of the transport package to hold pebbles while ensuring subcriticality in the flooded state. An approach in the criticality validation process involves assessing the similarity between systems through an integral index parameter evaluation. This involves calculating a correlation coefficient (referred to as c k ) based on shared nuclear data–induced uncertainty between a benchmark experiment and the application of the PT model. To facilitate this analysis, the SCALE tools, particularly the CSAS6-Shift, TSUNAMI-3D-Shift, and TSUNAMI-IP sequences, were employed for comprehensive studies in neutronics and S/U analysis. Our findings showed that there are sufficient critical experimental benchmarks to perform this validation of the PT model in the most reactive state, i.e. when the tanker is flooded. This paper provides valuable insights into validating a transport package for Generation IV TRISO fuel pebbles.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Validation of realistic Monte Carlo plasma gamma-ray source on JET discharges

A novel modelling methodology has been developed for the creation of a realistic plasma gamma-ray source for Monte Carlo transport simulations in the tokamak JET. The methodology couples the TRANSP code for plasma transport calculations with the MCNP Monte Carlo particle transport code, thus connecting plasma physics with gamma-ray transport. Here, we present the validation of the developed source methodology by comparing calculated gamma-ray spectra with measurements performed at JET. The validation focuses on gamma-ray spectra measured by the tangential gamma-ray spectrometer during two JET three ion RF scenario discharges, performed in the JET 2019 deuterium experimental campaign. For validation the calculated plasma gamma-ray spectrum was combined with the neutron induced prompt gamma-ray background, originating in the vacuum vessel, and scaled to absolute values calculating the total number of plasma gamma-ray and neutron emitting reactions. The comparison between calculated and measured gamma-ray spectra shows good agreement with the shape of the calculated gamma-ray spectra matching that of measurements for both studied discharges. Moreover, the calculated absolute values of the gamma-ray spectra were of the same order of magnitude at the position of the gamma-ray detector located at the end of a long line-of-sight in a biological shield. Finally, the comparison has validated the developed plasma gamma-ray source methodology for MCNP photon transport calculations at JET. The validation provides a basis for the developed plasma gamma-ray source to be used as a support for the development of future tokamaks such as DEMO.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2019

A systematic review of validated suicide outcome classification in observational studies

Abstract Background Suicidal outcomes, including ideation, attempt, and completed suicide, are an important drug safety issue, though few epidemiological studies address the accuracy of suicidal outcome ascertainment. Our primary objective was to evaluate validated methods for suicidal outcome classification in electronic health care database studies. Methods We performed a systematic review of PubMed and EMBASE to identify studies that validated methods for suicidal outcome classification published 1 January 1990 to 15 March 2016. Abstracts and full texts were screened by two reviewers using prespecified criteria. Sensitivity, specificity, and predictive value for suicidal outcomes were extracted by two reviewers. Methods followed PRISMA-P guidelines, PROSPERO Protocol: 2016: CRD42016042794. Results We identified 2202 citations, of which 34 validated the accuracy of measuring suicidal outcomes using International Classification of Diseases (ICD) codes or algorithms, chart review or vital records. ICD E-codes (E950-9) for suicide attempt had 2–19% sensitivity, and 83–100% positive predictive value (PPV). ICD algorithms that included events with ‘uncertain’ intent had 4–70% PPV. The three best-performing algorithms had 74–92% PPV, with improved sensitivity compared with E-codes. Read code algorithms had 14–68% sensitivity and 0–56% PPV. Studies estimated 19–80% sensitivity for chart review, and 41–97% sensitivity and 100% PPV for vital records. Conclusions Pharmacoepidemiological studies measuring suicidal outcomes often use methodologies with poor sensitivity or predictive value or both, which may result in underestimation of associations between drugs and suicidal behaviour. Studies should validate outcomes or use a previously validated algorithm with high PPV and acceptable sensitivity in an appropriate population and data source.

Swain, Richard S.↗
DOE OSTI2025

Dark energy survey: Modeling strategy for multiprobe cluster cosmology and validation for the full six-year dataset

Here, we introduce an updated To&Krause2021 model for joint analyses of cluster abundances and large-scale two-point correlations of weak lensing and galaxy and cluster clustering (termed CL+3×2 pt analysis) and validate that this model meets the systematic accuracy requirements of analyses with the statistical precision of the final Dark Energy Survey (DES) Year 6 (Y6) dataset. The validation program consists of two distinct approaches, (i) identification of modeling and parametrization choices and impact studies using simulated analyses with each possible model misspecification and (ii) end-to-end validation using mock catalogs from customized Cardinal simulations that incorporate realistic galaxy populations and DES-Y6-specific galaxy and cluster selection and photometric redshift modeling, which are the key observational systematics. In combination, these validation tests indicate that the model presented here meets the accuracy requirements of DES-Y6 for CL+3×2 pt based on a large list of tests for known systematics. In addition, we also validate that the model is sufficient for several other data combinations: the CL+GC subset of this data vector (excluding galaxy–galaxy lensing and cosmic shear two-point statistics) and the CL+3×2 pt+BAO+SN (combination of CL+3×2 pt with the previously published Y6 DES baryonic acoustic oscillation and Y5 supernovae data).

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2014

SU-E-T-50: Automatic Validation of Megavoltage Beams Modeled for Clinical Use in Radiation Therapy

Purpose: To automatically validate megavoltage beams modeled in XiO™ 4.50 (Elekta, Stockholm, Sweden) and Varian Eclipse™ Treatment Planning Systems (TPS) (Varian Associates, Palo Alto, CA, USA), reducing validation time before beam-on for clinical use. Methods: A software application that can automatically read and analyze DICOM RT Dose and W2CAD files was developed using MatLab integrated development environment.TPS calculated dose distributions, in DICOM RT Dose format, and dose values measured in different Varian Clinac beams, in W2CAD format, were compared. Experimental beam data used were those acquired for beam commissioning, collected on a water phantom with a 2D automatic beam scanning system.Two methods were chosen to evaluate dose distributions fitting: gamma analysis and point tests described in Appendix E of IAEA TECDOC-1583. Depth dose curves and beam profiles were evaluated for both open and wedged beams. Tolerance parameters chosen for gamma analysis are 3% and 3 mm dose and distance, respectively.Absolute dose was measured independently at points proposed in Appendix E of TECDOC-1583 to validate software results. Results: TPS calculated depth dose distributions agree with measured beam data under fixed precision values at all depths analyzed. Measured beam dose profiles match TPS calculated doses with high accuracy in both open and wedged beams. Depth and profile dose distributions fitting analysis show gamma values < 1. Relative errors at points proposed in Appendix E of TECDOC-1583 meet therein recommended tolerances.Independent absolute dose measurements at points proposed in Appendix E of TECDOC-1583 confirm software results. Conclusion: Automatic validation of megavoltage beams modeled for their use in the clinic was accomplished. The software tool developed proved efficient, giving users a convenient and reliable environment to decide whether to accept or not a beam model for clinical use. Validation time before beam-on for clinical use was reduced to a few hours.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2014

MO-C-17A-03: A GPU-Based Method for Validating Deformable Image Registration in Head and Neck Radiotherapy Using Biomechanical Modeling

Purpose: Deformable image registration (DIR) plays a pivotal role in head and neck adaptive radiotherapy but a systematic validation of DIR algorithms has been limited by a lack of quantitative high-resolution groundtruth. We address this limitation by developing a GPU-based framework that provides a systematic DIR validation by generating (a) model-guided synthetic CTs representing posture and physiological changes, and (b) model-guided landmark-based validation. Method: The GPU-based framework was developed to generate massive mass-spring biomechanical models from patient simulation CTs and contoured structures. The biomechanical model represented soft tissue deformations for known rigid skeletal motion. Posture changes were simulated by articulating skeletal anatomy, which subsequently applied elastic corrective forces upon the soft tissue. Physiological changes such as tumor regression and weight loss were simulated in a biomechanically precise manner. Synthetic CT data was then generated from the deformed anatomy. The initial and final positions for one hundred randomly-chosen mass elements inside each of the internal contoured structures were recorded as ground truth data. The process was automated to create 45 synthetic CT datasets for a given patient CT. For instance, the head rotation was varied between +/− 4 degrees along each axis, and tumor volumes were systematically reduced up to 30%. Finally, the original CT and deformed synthetic CT were registered using an optical flow based DIR. Results: Each synthetic data creation took approximately 28 seconds of computation time. The number of landmarks per data set varied between two and three thousand. The validation method is able to perform sub-voxel analysis of the DIR, and report the results by structure, giving a much more in depth investigation of the error. Conclusions: We presented a GPU based high-resolution biomechanical head and neck model to validate DIR algorithms by generating CT equivalent 3D volumes with simulated posture changes and physiological regression.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2015

Validation of an in-vivo proton beam range check method in an anthropomorphic pelvic phantom using dose measurements

Purpose: In-vivo dosimetry and beam range verification in proton therapy could play significant role in proton treatment validation and improvements. In-vivo beam range verification, in particular, could enable new treatment techniques one of which could be the use of anterior fields for prostate treatment instead of opposed lateral fields as in current practice. This paper reports validation study of an in-vivo range verification method which can reduce the range uncertainty to submillimeter levels and potentially allow for in-vivo dosimetry. Methods: An anthropomorphic pelvic phantom is used to validate the clinical potential of the time-resolved dose method for range verification in the case of prostrate treatment using range modulated anterior proton beams. The method uses a 3 × 4 matrix of 1 mm diodes mounted in water balloon which are read by an ADC system at 100 kHz. The method is first validated against beam range measurements by dose extinction measurements. The validation is first completed in water phantom and then in pelvic phantom for both open field and treatment field configurations. Later, the beam range results are compared with the water equivalent path length (WEPL) values computed from the treatment planning system XIO. Results: Beam range measurements from both time-resolved dose method and the dose extinction method agree with submillimeter precision in water phantom. For the pelvic phantom, when discarding two of the diodes that show sign of significant range mixing, the two methods agree with ±1 mm. Only a dose of 7 mGy is sufficient to achieve this result. The comparison to the computed WEPL by the treatment planning system (XIO) shows that XIO underestimates the protons beam range. Quantifying the exact XIO range underestimation depends on the strategy used to evaluate the WEPL results. To our best evaluation, XIO underestimates the treatment beam range between a minimum of 1.7% and maximum of 4.1%. Conclusions: Time-resolved dose measurement method satisfies the two basic requirements, WEPL accuracy and minimum dose, necessary for clinical use, thus, its potential for in-vivo protons range verification. Further development is needed, namely, devising a workflow that takes into account the limits imposed by proton range mixing and the susceptibility of the comparison of measured and expected WEPLs to errors on the detector positions. The methods may also be used for in-vivo dosimetry and could benefit various proton therapy treatments.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

A validated tumor control probability model based on a meta-analysis of low, intermediate, and high-risk prostate cancer patients treated by photon, proton, or carbon-ion radiotherapy

Purpose: A fully heterogeneous population averaged mechanistic tumor control probability (TCP) model is appropriate for the analysis of external beam radiotherapy (EBRT). This has been accomplished for EBRT photon treatment of intermediate-risk prostate cancer. Extending the TCP model for low and high-risk patients would be beneficial in terms of overall decision making. Furthermore, different radiation treatment modalities such as protons and carbon-ions are becoming increasingly available. Consequently, there is a need for a complete TCP model. Methods: A TCP model was fitted and validated to a primary endpoint of 5-year biological no evidence of disease clinical outcome data obtained from a review of the literature for low, intermediate, and high-risk prostate cancer patients (5218 patients fitted, 1088 patients validated), treated by photons, protons, or carbon-ions. The review followed the preferred reporting item for systematic reviews and meta-analyses statement. Treatment regimens include standard fractionation and hypofractionation treatments. Residual analysis and goodness of fit statistics were applied. Results: The TCP model achieves a good level of fit overall, linear regression results in a p-value of <0.000 01 with an adjusted-weighted-R{sup 2} value of 0.77 and a weighted root mean squared error (wRMSE) of 1.2%, to the fitted clinical outcome data. Validation of the model utilizing three independent datasets obtained from the literature resulted in an adjusted-weighted-R{sup 2} value of 0.78 and a wRMSE of less than 1.8%, to the validation clinical outcome data. The weighted mean absolute residual across the entire dataset is found to be 5.4%. Conclusions: This TCP model fitted and validated to clinical outcome data, appears to be an appropriate model for the inclusion of all clinical prostate cancer risk categories, and allows evaluation of current EBRT modalities with regard to tumor control prediction.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2022

Validation of earthquake ground-motion models in southern California, USA, using precariously balanced rocks

Accurate estimates of earthquake ground shaking rely on uncertain ground-motion models derived from limited instrumental recordings of historical earthquakes. A critical issue is that there is currently no method to empirically validate the resultant ground-motion estimates of these models at the timescale of rare, large earthquakes; this lack of validation causes great uncertainty in ground-motion estimates. Here, we address this issue and validate ground-motion estimates for southern California utilizing the unexceeded ground motions recorded by 20 precariously balanced rocks. We used cosmogenic 10Be exposure dating to model the age of the precariously balanced rocks, which ranged from ca. 1 ka to ca. 50 ka, and calculated their probability of toppling at different ground-motion levels. With this rock data, we then validated the earthquake ground motions estimated by the Uniform California Earthquake Rupture Forecast, Version 3 (UCERF3) seismic-source characterization and the Next Generation Attenuation (NGA)-West2 ground-motion models. We found that no ground-motion model estimated levels of earthquake ground shaking consistent with the observed continued existence of all 20 precariously balanced rocks. The ground-motion model I14 estimated ground-motion levels that were inconsistent with the most rocks; therefore, I14 was invalidated and removed. At a 2475 year mean return period, the removal of this invalid ground-motion model resulted in a 2−7% reduction in the mean and a 10−36% reduction in the 5th−95th fractile uncertainty of the ground-motion estimates. Our findings demonstrate the value of empirical data from precariously balanced rocks as a validation tool for removing invalid ground-motion models and, in turn, reducing the uncertainty in earthquake ground-motion estimates.

Geology↗
DOE OSTI2025

Using a Large Language Model as a Building Block to Generate Usable Validation and Verification Suite for OpenMP

In the HPC area, both hardware and software move quickly. Often new hardware is developed and deployed, the corresponding software stack, including compilers and other tools, are under active development while leading edge software developers are working to port and tune their applications, all at the same time. While the software ecosystem is in flux, one of the key challenges for users is obtaining insight into the state of implementation of key features in the programming languages and models their applications are using – whether they have been implemented, and whether the implementation conforms to the specification, especially for newly implemented features (less tested by widespread use). OpenMP is one of the most prominent shared memory programming models used for on-node programming in HPC. With the shift towards accelerators (such as GPUs and FPGAs) and heterogeneous programming OpenMP features are getting more complex. It is natural to ask whether generative AI approaches, and large language models (LLMs) in particular, can help in producing validation and verification test suites to allow users better and faster insights into the availability and correctness of OpenMP features of interest. In this work, we explore the use of ChatGPT-4 to generate a suite of tests for OpenMP features. We have chosen a set of directives and clauses, a total of 78 combinations, which first appeared in OpenMP 3.0 (released in May 2008) but are also relevant for accelerators. We prompted ChatGPT to generate tests in the C and Fortran languages, for both host (CPU) and device (accelerator). On the Summit super-computer using the GNU implementation, we found that, of the 78 generated tests 67 C tests and 43 Fortran tests compiled successfully and fewer than those executed to completion. On further analysis we show that not all generated tests are valid. We document the process, results, and provide detailed analysis regarding the quality of tests generated. With the aim of providing input to a production quality validation and verification suite, we manually implement the corrections required to make the tests valid according to the current OpenMP specification. We quantify this effort as small, medium, or large, and record the lines of code changed to correct the invalid tests. With the corrected tests we validate recent implementations from HPE, AMD, and GNU on the Frontier supercomputer. Our experiment and subsequent analysis show that although LLMs are capable of producing HPC specific codes, they are limited by their understanding of the deeper semantics and restrictions of programming models such as OpenMP. Unsurprisingly more commonly used features have better support, while some OpenMP 3.0 directives such as sections and tasking are not universally supported on accelerators. We demonstrate that successful compilation and execution to completion are inadequate metrics for evaluating generated code and that, at this time, commodity LLMs require expert intervention for code verification. This points to gaps in the training data that is currently available for HPC. We demonstrate that with "small" effort 37% of generated invalid C tests and 63% of generated invalid Fortran tests could be corrected. This improves productivity of test generation as we circumvent writing from scratch and the common programming errors associated with it.

Pophale, Swaroop [ORNL] (ORCID:0000000185446367)↗