Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “VALID”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Results of an In-Field Validation Exercise in Support of Wide-Area Environmental Sampling

The National Nuclear Security Administration’s (NNSA) Office of Nonproliferation and Arms Control (NA-24) is evaluating Wide-Area Environmental Sampling (WAES) as an additional safeguards verification tool for the International Atomic Energy Agency to detect undeclared nuclear activities. The NNSA is evaluating strategies for conducting a generic WAES campaign, the cost of a WAES campaign, and the effect of technological advancements that have occurred since the last major WAES review in 1999. Until now, the NNSA effort has focused on tabletop exercises (TTXs) in which high-performance computing allows for advanced modeling and simulation efforts to be applied to the WAES question. Although the modeling and simulations used in the TTXs are extremely valuable, field campaigns are still needed to validate the assumptions that underpin the models and the modeling process itself. During a 7 week period beginning in May 2023 and ending in June 2023, which included 4 weeks of active field collections, a multilaboratory team conducted its first in-field validation exercise. Prior to the in-field exercise, abbreviated TTXs were conducted to estimate the performance of all collection systems to be used during the field test. These TTXs guided the selection of materials to be released and the placement of the collection system. Based on these determinations, materials were procured to use in the field test, and an injection/release system was designed, built, and installed at the test facility. Background samples were collected during weeks one and four, and environmental collections against active releases were conducted during weeks two and three. The goals of this validation exercise included a demonstration of (1) the ability to provide controlled releases of particulates of surrogate materials, (2) the fielding and operation of collection systems (including deposition and active air collectors), and (3) the flexibility to revise equipment and campaign plans in the field. This paper presents the results and preliminary conclusions for this initial validation test. Based on these results, subsequent field campaigns are anticipated and will include the addition of other released materials.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Validation of the DESI DR2 Ly$α$ forest full-shape analysis

We present the validation of the Dark Energy Spectroscopic Instrument (DESI) Data Release 2 (DR2) Lyman-$α$ (Ly$α$) forest full-shape analysis. This analysis combines three-dimensional Ly$α$ forest auto-correlations and cross-correlations with quasars to extract information from both the baryon acoustic oscillation (BAO) feature and the broadband clustering signal, with primary emphasis on the Alcock-Paczynski (AP) measurement. Compared to the DESI DR1 analysis, the DR2 validation uses substantially larger and more realistic mock datasets, including CoLoRe 2LPT and AbacusSummit Ly$α$ forest simulations. The modeling framework is also improved through analytic marginalization over small scales ($<10$$h^{-1}$Mpc) and the impact of ultraviolet background fluctuations. The validation program was completed prior to unblinding and defines quantitative requirements for the cosmological parameters of interest, which are evaluated using hundreds of mock realizations. We further test the analysis through independent fits to the auto- and cross-correlations, multiple catalog splits, and a broad suite of analysis and modeling variations applied to both mocks and blinded observational data. We find that the BAO and AP parameters satisfy all validation requirements and remain stable across all tests. In contrast, mock studies reveal a significant bias in the inferred growth-rate parameter $fσ_8$, leading us to exclude this measurement from the final analysis. The consistency across mocks, data splits, and robustness tests demonstrates that the DR2 Ly$α$ full-shape analysis provides a reliable and substantially improved broadband AP measurement over previous Ly$α$ forest studies.

Herbold, M. [Chicago U., KICP; Ohio State U.] (ORC↗

Systematic Validation of Ensemble Cloud-Process Simulations using Polarimetric Radar Observations and Simulator over the NASA Wallops Flight Facility

The BiLateral Operational Storm-Scale Observation and Modeling (BLOSSOM) project was initiated to establish a long-term supersite to improve understanding of cloud physical states and processes as well as to support satellite and climate model programs over the WFF site via a bilateral approach of storm-scale observations and process modeling. This study highlights a noble systematic validation framework of the BLOSSOM ensemble cloud-process simulations through mixed-phase, light-rain, and deep-convective precipitation cases. The framework consists of creating a domain-shifted ensemble of large-scale forcing datasets, and configuring and performing cloud-process simulations with three different bulk microphysics schemes. Validation uses NASA S-band dual-POLarimetric radar (NPOL) observations in the form of statistical composites and skill scores via a polarimetric radar simulator and newly developed CfRad Data tool (CfRAD). While the simulations capture the overall structures of the reflectivity composites, polarimetric signals are still poorly simulated, mainly due to a lack of representation of ice microphysics diversity in shapes, orientation distributions, and their complex mixtures. Despite the limitation, this new ensemble-based validation framework demonstrates that 1) no particular forcing or microphysics scheme outperforms the rest and 2) the skill scores of coarse- and fine-resolution ensemble simulations with different domain-shifted forcing and microphysics schemes are highly correlated with each other with no clear improvement. On the other hand, this suggests that coarse-resolution ensemble simulations are relevant for selecting the best meteorological forcing and microphysics scheme before conducting computationally demanding large eddy simulations (LESs) in support of aircraft and satellite instrument development as well as cloud-precipitation-convection parameterizations.

54 ENVIRONMENTAL SCIENCES↗

ORNL’s Continuing Efforts in Evaluating and Validating TSLs [Slides]

This presentation finds that INS measurements are not as variable based on sample composition, because phonon spectra is a properly of the bulk material. Additionally, INS and transmission measurements are and should be the most significant part of TSL validation, as they are the fundamental quantities used by Monte Carlo neutronics codes. This presentation reasons that relaying solely on theoretical atomistic calculations for TSL evaluation is not enough, they are highly dependent on inter-atomic potentials (which are not the most accurate depending on the quantity trying to be reproduced) and evaluators knowledge and understanding of the material being studied. Finally on Critical benchmarks, while extremely useful for validation of nuclear data at all energies, critical benchmarks are not the best tool to provide a definitive answer on conflicting TSLs. The presentation concludes that INS and transmission measurements need to be the basis of validation of TSLs.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

OC6 Phase IV: Validation of CFD Models for Stiesdal TetraSpar Floating Offshore Wind Platform

ABSTRACT With only a few floating offshore wind turbine (FOWT) farms deployed anywhere in the world, FOWT technology is still in its infancy, building on a modicum of real‐world experience to advance the nascent industry. To support further development, engineers rely heavily on modeling tools to accurately portray the behavior of these complex systems under realistic environmental conditions. This reliance creates a need for verification and validation of such tools to improve reliability of load and dynamic response prediction and analysis capabilities of FOWT systems. The Offshore Code Comparison Collaboration, Continued with Correlation and unCertainty (OC6) project was created under the framework of the International Energy Agency to address this need and considers a three‐sided verification and validation between engineering level models, computational fluid dynamics (CFD), and experimental results. In this paper, a novel floating offshore wind platform, the Stiesdal TetraSpar, is simulated using CFD under the load conditions defined by Phase IV of the OC6 project. The comparison of these CFD results against the experimental results demonstrated the ability to predict the platform response to waves when imposing the measured wave signals as input. Although validation versus experiment was largely successful, the damping behavior was impacted by uncertainties likely originating from the mooring system and sensor umbilical cable. This extensive comparison effort with multiple CFD practitioners offers insight into best practices to achieve reliable results.

17 WIND ENERGY↗

Which nuclear data can be validated with LLNL pulsed-sphere experiments?

It is shown here that 14-MeV D+T LLNL pulsed-sphere experiments bring complementary information into the process of validating nuclear data compared to experiments that are traditionally used for this purpose—such as critical assemblies. To be more specific, the 14-MeV D+T LLNL pulsed-sphere neutron-leakage spectra enable to validate scattering and fission nuclear data up to 15 MeV (compared to approximately up to 5 MeV when using criticality experiments) and employ to this end simple compound targets containing only few isotopes. In this work, sensitivity profiles of the spectra to nuclear data are calculated in order to understand in detail which isotopes, observables, and energy ranges of nuclear data contribute significantly to their simulation. These profiles are presented for a few selected spheres containing 16 O, 12 C, 56 Fe, and 239 Pu. It is shown that the neutron-leakage spectra of spheres containing light elements are mostly sensitive to elastic- and inelastic-scattering cross sections on discrete levels and corresponding angular distributions. Spheres of structural materials are sensitive to elastic- and inelastic-scattering cross sections, including scattering on discrete levels and the continuum, and double-differential cross sections. Actinide spheres are also strongly sensitive to the fission observables, in particular to the total-fission neutron spectrum. Thin spheres (in which neutrons experience on average less than one scatter) are mostly sensitive to data near the elastic peak, in the energy range from 12–15 MeV, while thicker ones can be sensitive to data at lower incident-neutron energies due to multiple-scattering effects. This information is brought together with simulations of 71 pulsed-sphere neutron-leakage spectra using the ENDF/B-VII.1 and ENDF/B-VIII.0 nuclear-data libraries. This analysis highlights ENDF/B-VIII.0 data that could be further investigated for potential shortcomings ( 6 Li, 12 C, 16 O, 24-26 Mg, 27 Al, 48 Ti, 56 Fe, and 208 Pb) or are likely reliable ( 1,2 H, 7 Li, 9 Be, 14 N, 235,238 U, and 239 Pu) as indicated by validating with LLNL pulsed-sphere experiments.

14-MeV D+T LLNL pulsed-sphere neutron-leakage spec↗

Validation of Phasor-Domain Transmission and Distribution Co-simulation Against Electromagnetic Transient Simulation

The rapid deployment of renewable energy resources has led to the widespread use of power electronics in modern power systems. As these systems transition from being dominated by large synchronous machines to increasingly incorporating inverter-based resources (IBRs), traditional methods are becoming inadequate. Addressing this challenge, this paper introduces a scalable phasor-domain T\&D co-simulation framework based on open-source software. It focuses on the framework's validation against the PSCAD Electromagnetic Transient (EMT) analysis tool. The validation results demonstrate the framework's high-fidelity and a computational time speed-up of 60 to 100 times, marking a pioneering validation effort in T\&D co-simulation research.

Inverter-based resources, co-simulation, Electroma↗

First-In-Human Validation of CT-Based Proton Range Prediction Using Prompt Gamma Imaging in Prostate Cancer Treatments

Uncertainty in computed tomography (CT)-based range prediction substantially impairs the accuracy of proton therapy. Direct determination of the stopping-power ratio (SPR) from dual-energy CT (DECT) has been proposed (DirectSPR), and initial validation studies in phantoms and biological tissues have proven a high accuracy. However, a thorough validation of range prediction in patients has not yet been achieved by any means. Here, we present the first systematic validation of CT-based proton range prediction in patients using prompt gamma imaging (PGI).

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Development and validation of a quantitative proton NMR method for the analysis of pregnenolone

Pregnenolone (PREG) is an endogenous steroid frequently sold as an over-the-counter dietary supplement touted to promote neurological and immunological health. While the PREG dietary supplement is added to the diet for health benefits, there are no FDA approved PREG drugs. However, compounded PREG drug products are available to U.S. patients. The FDA works with state regulatory authorities on the oversight of compounding activities, including developing 503A and 503B lists of bulk substances that compounders are permitted to use. PREG is one of the substances publicly nominated to be included on the 503B list. Compounded hormone therapies such as those using PREG are of interest given the lack of standardization in compounded drug products which may increase the possibility of underdosing, overdosing, or contamination. However, no USP monograph currently exists to evaluate the quality of PREG drug substance or product. To address knowledge gaps and assist in quality control, a simple and rapid quantitative proton nuclear magnetic resonance spectroscopy (qNMR) method for the identification and assay of PREG in different types of PREG products was developed and validated. PREG samples were characterized using 1D 1 H and 2D 1 H– 13 C HSQC NMR spectra. The qNMR assay method (taking approximately 10 min per NMR spectrum) was validated for precision, accuracy, specificity, robustness and linearity per ICH Q2(R1) guidance. The method was validated in a range from 0.032 to 3.2 mg/mL. As a proof of concept, seven PREG bulk substance samples, three tablet and two capsule PREG dietary supplements were assessed by the qNMR analytical procedure. NMR data from all tested samples met the expected criteria for identification and assay. The results demonstrate the potential of qNMR for the quality assessment of different types of PREG samples.

60 APPLIED LIFE SCIENCES↗

Validation of electron backscattering in the MCNP6.3 code

A new electron backscattering validation suite has been developed for the MCNP® code. The calculations in this suite cover both condensed history and single-event transport methods, seven different elemental materials ranging from beryllium to uranium, and incident electron energies from 200 eV to 14.1 MeV. In general, the accuracy of the MCNP code for electron backscattering calculations is energy-dependent. For incident electron energies below 2 keV, the condensed history method is not applied while the single-event method shows poor agreement with experimental measurements due to poor accuracy of the underlying atomic data. For incident energies between 2 keV and 256 keV, the single-event method typically shows better agreement with experiments, while for incident energies above 256 keV the condensed history method gives better accuracy. Additionally, agreement with experimental data is generally worse for low- Z materials such as beryllium and carbon, which may reflect deficiencies in the data or physics underlying electron transport through light elements in the MCNP code. The new electron backscattering validation suite, along with the previously introduced electron stopping power and Lockwood energy deposition validation suites, provide MCNP users with a quantified understanding of the uncertainties in electron transport calculations. Future improvements to electron transport in the MCNP code are necessary for low energies (≤ 2 keV) and for low- Z materials.

36 MATERIALS SCIENCE↗

Experimental validation of a high fidelity Monte Carlo neutron transport model of the MIT graphite exponential pile

High-fidelity modeling and simulation were performed for the MIT graphite exponential pile (MGEP) using Monte Carlo neutron transport codes OpenMC and MCNP, and the results were validated by experimental data. The MGEP is being used as the test bed for the design of an autonomous control system for the pile's neutron flux distribution. The main contribution of this work is to generate the training data sets of neutron flux distributions with different locations of control rods that perturb the neutron flux profiles. First, code -to-code cross verification between OpenMC and MCNP was performed to ensure consistency of the numerical modeling within statistical uncertainties. To validate the accuracy of this high-fidelity model, a series of neutron flux measurements were conducted using a Helium-3 (He-3) neutron detector on a mobile platform that is placed inside the pile. Second, the neutron flux profiles were measured in four vertical layers of interest, and compared to the corresponding simulation results. The comparison results shows that the root mean square error is less than 2.5% in the two upper layers, and less than 4.5% in all four measured layers. Here the results validated the accuracy of the modeling and simulation. Finally, the relative change of the neutron flux profiles from moving control rods was analyzed, which identified the layer that has the best sensitivity regarding the control rods movements. Thus, this work identified and provided training data sets of both simulated and experimental neutron flux profiles in the most sensitive layer, paving the path forward to the real-time experimental demonstration of the autonomous control system.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

SCALE 6.2.4 Validation for Light Water Reactor Decay Heat Analysis

Energy release from the decay of radionuclides in nuclear fuel after its discharge from reactor is a critical parameter for design, safety, and licensing analyses of used nuclear fuel storage, transportation, and repository systems. Well-validated computational tools and nuclear data are essential for decay heat prediction. This paper summarizes the validation of the SCALE nuclear analysis code system version 6.2.4, used with ENDF/B-VII.1 libraries, for decay heat analysis of light water reactor used fuel. The experimental data used for validation include full-assembly decay heat measurements that cover assembly burnups of 5 to 51 GWd/tonne U, cooling times after discharge in the 2- to 27-year range, and initial fuel enrichments up to 4 wt% 235U. The comparison between calculated (C) and experimental (E) decay heat showed very good agreement, with an average C/E over all considered measurements of 1.006 (σ = 0.016) for pressurized water reactor and 0.984 (σ = 0.077) for boiling water reactor assembly measurements. The effect of using assembly-average versus axially varying modeling data on the calculated decay heat, important to thermal analyses for used fuel transportation and storage systems, is discussed.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Benchmark of the Chlorine Worth Study Experiments in Support of Chlorine Nuclear Data Validation for Nuclear Criticality Safety

The Chlorine Worth Study (CWS) was a critical experiment to address an urgent need for thermal chlorine nuclear data validation in plutonium systems. This urgent need is tied directly to plutonium recycle and recovery operations in the plutonium facility at Los Alamos National Laboratory, where exceptionally conservative criticality safety limits are used because no credit is taken for the neutron capture by chlorine. The experiment used weapons-grade plutonium metal plates clad in stainless steel, known as the PANN (plutonium aluminum no nickel) ZPPR (zero power physics reactor) plates. The plutonium was reflected and moderated by high-density polyethylene and included combinations of polyvinyl chloride (PVC) and chlorinated polyvinyl chloride (CPVC) as absorbers. The experiment and benchmark included three configurations mimicking 30 g 239 Pu/L plutonium, 300 g 239 Pu/L plutonium, and 600 g 239 Pu/L plutonium in an aqueous chloride solution. Uncertainties in the benchmark included five broad categories: (1) criticality measurement, (2) mass and density, (3) dimensions, (4) material compositions, and (5) positioning. The largest contribution to the overall uncertainties for all three cases came from the material compositions, in particular the PVC and CPVC absorber compositions. A detailed model was created to be a near match (that is within expectations of transport code users) and a simplified model was created to minimize offset dimensions and expedite modeling for code validation. Sample calculations were completed in MCNP6.3 with ENDF/B-VIII.0 and ENDF/B-VII.1 nuclear data. For the detailed and simplified models, the average difference between the computed and experimental k eff was 951 pcm. CWS will serve as the key validation experiment for nuclear criticality safety in support of aqueous chloride operations. The sensitivity to the chlorine capture cross section is orders of magnitude greater than other existing benchmarks. The current limits, as defined by nuclear criticality safety, are 520 g Pu per batch, i.e. the minimum critical mass of the Pu solution infinitely reflected by water [Criticality Handbook: Volume II, (1969)]. This extremely conservative critical mass limit does not credit any neutron capture by chlorine (in particular neutron capture by 35 Cl) and greatly impedes the throughput required for current and future operations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Summary report of the 4th IAEA Technical Meeting on Fusion Data Processing, Validation and Analysis (FDPVA)

The objective of the Fourth Technical Meeting on Fusion Data Processing, Validation and Analysis was to provide a platform during which a set of topics relevant to fusion data processing, validation and analysis are discussed with the view of extrapolating needs to next step fusion devices such as ITER. The validation and analysis of experimental data obtained from diagnostics used to characterize fusion plasmas are crucial for a knowledge-based understanding of the physical processes governing the dynamics of these plasmas. This paper presents the recent progress and achievements in the domain of plasma diagnostics and synthetic diagnostics data analysis (including image processing, regression analysis, inverse problems, deep learning, machine learning, big data and physics-based models for control) reported at the meeting. The progress in these areas highlight trends observed in current major fusion confinement devices. A special focus is dedicated on data analysis requirements for ITER and DEMO with a particular attention paid to artificial intelligence for automatization and improving reliability of control processes.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Experimental Validation of Models of a Hull-Based Tuned Mass Damper System for a Semisubmersible Floating Offshore Wind Turbine Platform

Floating offshore wind turbine designs can be further optimized if the controller and remaining systems are designed together, known as control co-design. To effectively perform control co-design, modeling tools predicting the influence of the control systems on the response of a system must be validated. This article presents an experimental validation that utilizes a scale model of a semisubmersible platform for an offshore wind turbine that is fitted with adjustable tuned mass dampers. These dampers can be tuned to attenuate either the hull-pitch resonance or the tower-bending resonance. The data from the experiment are used to validate state-of-the-art modeling tools. It is shown that the models capture the overall effects of the tuned mass dampers; however, some models overpredict the reduction in platform pitch motion when the dampers are tuned to the pitch resonance. The relative reduction in the tower-base bending moment is more consistently captured by the models when the dampers are tuned to the tower-bending resonance. However, there are significant differences in the absolute level of tower-base bending moment between the models and the experiment. Much of the differences observed are a consequence of the challenge with accurately predicting the baseline platform resonance motion and the tower-bending moment, which should be addressed in future modeling efforts.

17 WIND ENERGY↗

Offshore Wind Energy Validation Experiment Hierarchy

This paper provides a summary of planning work for experiments that will be necessary to address the long-term model validation needs required to meet offshore wind energy deployment goals. Conceptual experiments are identified and laid out in a validation hierarchy for both wind turbine and wind plant applications. Instrumentation needs that will be required for the offshore validation experiments to be impactful are then listed. The document concludes with a nominal vision for how these experiments can be accomplished.

17 WIND ENERGY↗

Inverter Model Validation and Calibration Using Phasor Measurement Unit Data

As the penetration of inverter-based renewable energy resources increases in the power grid, especially at the distribution and microgrid levels, the need to accurately represent them in planning studies increases as well. However, due to the lack of well-established standard procedures, and vendor reluctance towards the detailed sharing of proprietary models, automated dynamic model validation and parameter calibration tools for inverter based resources (IBRs) remain scarce. This work presents a model validation and parameter calibration platform for representing IBRs with generic phasor-domain models. Phasor measurements of power system events are used for continuous validation using the data playback method, and model parameters are re-calibrated if a significant mismatch between measurements and model response is observed. Unique features of the proposed platform include- (a) an iterative Bayesian optimization approach towards parameter calibration to address a possible mismatch between the structures of generic models implemented in simulation softwares and actual commercial inverters, (b) error metrics designed to account for a possible mismatch between the time resolution of simulation and measurements, and (c) analysis of the measurement-simulation mismatch to provide guidance to engineering personnel regarding model shortcomings. The performance of the platform has been illustrated using both simulated data and field measurements to validate/calibrate inverter models in GridLAB-D.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Medium-Scale Methanol Pool Fire Model Validation

In this work, medium scale (30 cm diameter) methanol pool fires were simulated using the latest fire modeling suite implemented in Sierra/Fuego, a low Mach number multiphysics reacting flow code. The sensitivity of model outputs to various model parameters was studied with the objective of providing model validation. This work also assesses model performance relative to other recently published large eddy simulations (LES) of the same validation case. Two pool surface boundary conditions were simulated. The first was a prescribed fuel mass flux and the second used an algorithm to predict mass flux based on a mass and energy balance at the fuel surface. Gray gas radiation model parameters (absorption coefficients and gas radiation sources) were varied to assess radiant heat losses to the surroundings and pool surface. The radiation model was calibrated by comparing the simulated radiant fraction of the plume to experimental data. The effects of mesh resolution were also quantified starting with a grid resolution representative of engineering type fire calculations and then uniformly refining that mesh in the plume region. Simulation data were compared to experimental data collected at the University of Waterloo and the National Institute of Standards and Technology (NIST). Validation data included plume temperature, radial and axial velocities, velocity temperature turbulent correlations, velocity velocity turbulent correlations, radiant and convective heat fluxes to the pool surface, and plume radiant fraction. Additional analyses were performed in the pool boundary layer to assess simulated flame anchoring and the effect on convective heat fluxes. This work assesses the capability of the latest Fuego physics and chemistry model suite and provides additional insight into pool fire modeling for nonluminous, non-sooting flames.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗