Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,729 records · Page 96

Bayesian experimental design and parameter estimation for ultrafast spin dynamics

Abstract Advanced experimental measurements are crucial for driving theoretical developments and unveiling novel phenomena in condensed matter and materials physics, which often suffer from the scarcity of large-scale facility resources, such as x-ray or neutron scattering centers. To address these limitations, we introduce a methodology that leverages the Bayesian optimal experimental design paradigm to efficiently uncover key quantum spin fluctuation parameters from x-ray photon fluctuation spectroscopy (XPFS) data. Our method is compatible with existing theoretical simulation pipelines and can also be used in combination with fast machine learning surrogate models in the event that real-time simulations are unfeasible. Our numerical benchmarks demonstrate the superior performance in predicting model parameters and in delivering more informative measurements within limited experimental time. Our method can be adapted to many different types of experiments beyond XPFS and spin fluctuation studies, facilitating more efficient data collection and accelerating scientific discoveries.

97 MATHEMATICS AND COMPUTING↗

BEAMS3D Neutral Beam Injection Model

With the advent of applied 3D fields in Tokamaks and modern high performance stellarators, a need has arisen to address non-axisymmetric effects on neutral beam heating and fueling. We report on the development of a fully 3D neutral beam injection (NBI) model, BEAMS3D, which addresses this need by coupling 3D equilibria to a guiding center code capable of modeling neutral and charged particle trajectories across the separatrix and into the plasma core. Ionization, neutralization, charge-exchange, viscous velocity reduction, and pitch angle scattering are modeled with the ADAS atomic physics database. Benchmark calculations are presented to validate the collisionless particle orbits, neutral beam injection model, frictional drag, and pitch angle scattering effects. A calculation of neutral beam heating in the NCSX device is performed, highlighting the capability of the code to handle 3D magnetic fields.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Open Data and Deep Semantic Segmentation for Automated Extraction of Building Footprints

Advances in machine learning and computer vision, combined with increased access to unstructured data (e.g., images and text), have created an opportunity for automated extraction of building characteristics, cost-effectively, and at scale. These characteristics are relevant to a variety of urban and energy applications, yet are time consuming and costly to acquire with today’s manual methods. Several recent research studies have shown that in comparison to more traditional methods that are based on features engineering approach, an end-to-end learning approach based on deep learning algorithms significantly improved the accuracy of automatic building footprint extraction from remote sensing images. However, these studies used limited benchmark datasets that have been carefully curated and labeled. How the accuracy of these deep learning-based approach holds when using less curated training data has not received enough attention. The aim of this work is to leverage the openly available data to automatically generate a larger training dataset with more variability in term of regions and type of cities, which can be used to build more accurate deep learning models. In contrast to most benchmark datasets, the gathered data have not been manually curated. Thus, the training dataset is not perfectly clean in terms of remote sensing images exactly matching the ground truth building’s foot-print. A workflow that includes data pre-processing, deep learning semantic segmentation modeling, and results post-processing is introduced and applied to a dataset that include remote sensing images from 15 cities and five counties from various region of the USA, which include 8,607,677 buildings. The accuracy of the proposed approach was measured on an out of sample testing dataset corresponding to 364,000 buildings from three USA cities. The results favorably compared to those obtained from Microsoft’s recently released US building footprint dataset.

97 MATHEMATICS AND COMPUTING↗

(U) The Effect of ENDF/B-VIII.1 on Jezebel

The 239 Pu Jezebel critical assembly of 1954-55 was modeled in great detail and reevaluated using ENDF/B-VII.1 cross sections, and a new simplified (homogeneous one-dimensional spherical) benchmark was derived. The new simplified model was similar to that derived by Hansen and Paxton in 1969, but its radius was modified so that its k eff was the average of the C/E’s (where C is the calculated k eff and E is the inferred experimental k eff ) of the four detailed models. When ENDF/B-VIII.0 data were released, a mismatch between the detailed and simplified models was introduced due to changes in the nickel cross sections, because the detailed models contain nickel but the simplified model does not. A revision of the simplified model realigned the detailed and simplified models. ENDF/B-VIII.1 data have now been released. The simplified and detailed Jezebel models have been run using preliminary ENDF/B-VIII.1 ACE files. In Sec. II, it is shown that the detailed and simplified models are still aligned. No revision of the simplified model is called for. These results were computed using MCNP6.3.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Assessment of ORIGEN Reactor Library Development for Pebble-Bed Reactors Based on the PBMR-400 Benchmark

This report provides an evaluation of present SCALE capabilities for modeling depletion of pebble-bed reactor systems, using the PBMR-400 benchmark as a test case. A specific aim of this work is to understand the system characteristics required to generate production-quality reactor data libraries for rapid depletion calculations with ORIGEN. This report includes a discussion of present SCALE capabilities for modeling doubly heterogeneous fuels, prior SCALE work modeling pebble bed–type reactors, and a detailed neutronic analysis of the PBMR-400 core for both fresh and equilibrium-composition core conditions.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Broadening Dark Matter Searches at the LHC: Mono-X versus Darkonium Channels

Current searches for dark matter at the LHC focus on mono-X signatures: the production of dark matter in association with a Standard Model (SM) particle. The simplest benchmark introduces a massive spin-1 mediator, the Z$^{′}$ boson, between the dark matter χ and the SM. Limits derived from mono-X channels are most effective when the mediator can decay into two on-shell dark matter particles: M$_{Z}$′ ≳ 2M$_{χ}$. We broaden the experimental reach into the complementary region, where the Z$^{′}$ mediator is much lighter than the dark matter. In this scenario the Z$^{′}$ mediates an effective long-range force between the dark matter, thereby facilitating the formation of darkonium bound states, as is common in many dark sector models. The darkonium becomes active when M$_{χ}$> M$_{Z}$′/α$_{eff}$ , where α$_{eff}$ is the effective fine-structure constant in the dark sector. Moreover, the darkonium could decay back into SM quarks, without producing missing transverse momentum in the detector. Considering multijet final states, we reinterpret existing searches to constrain the simple Z$^{′}$ benchmark beyond the region probed by mono-X searches. Assuming a baryonic Z$^{′}$ mediator and a Dirac dark matter, direct detection bounds can be loosened by giving a small Majorana mass to the dark matter. We also consider the interplay between mono-X and darkonium channels at future high energy colliders, which is at the frontier of probing the model parameter space.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Reanalysis of the radii of the Benchmark eclipsing binary V578 Mon

V578 Mon is an eclipsing binary system in which both stars have masses above 10 M {sub ☉} determined with an accuracy better than 3%. It is one of only five such massive eclipsing binaries known that also possess eccentric orbits and measured apsidal motions, thus making it an important benchmark for theoretical stellar evolution models. However, recently reported determinations of the radii of V578 Mon differ significantly from previously reported values. We reanalyze the published data for V578 Mon and trace the discrepancy to the use of an incorrect formulation for the stellar potentials in the most recent analysis. Here we report corrected radii for this important benchmark eclipsing binary.

79 ASTRONOMY AND ASTROPHYSICS↗

Language Model For Earth Science: Exploring Potential Downstream Applications As Well As Current Challenges

The use of deep learning techniques to build transformer language models such as SciBERT and GPT3 have transformed the natural language technology (NLT) landscape. These new NLTs are being used in speech to text and vice versa, auto-mated text classification, sentiment analysis, topic modeling, text summarization, and cognitive assistants. While Earth science has no shortage of unstructured data such as journal and conference papers, little efforts have focused on harnessing NLTs for knowledge extraction and supporting the scientific process. This paper surveys the use of language models in different science. BERT-E, a new Earth science-specific language model, is presented. BERT-E is generated using a transfer learning solution. A language model that has already been trained for general Science (SciBERT) is fine-tuned using abstracts and full text extracted from various Earth science-related articles. A downstream keywords classification application is used for evaluation, and the use of BERT-E shows improved performance. The need to develop a robust set of benchmarks in evaluating the language model such as BERT-E is discussed. Finally, example applications are presented to inspire additional ideas for applications using domain-specific language models.

R Ramachandran↗

Mastering the Cryogenic Frontier: Predicting Sloshing in Cryogenic Propellant Tanks

In recent years, NASA has undertaken the development and validation of computation fluid dynamic (CFD) models for predicting cryogenic two-phase sloshing within propellant tanks. These models have been rigorously anchored against cryogenic ground tests that induce sloshing, as well as limited microgravity tests. The primary focus of these models is to accurately predict the two-phase condensation and, at times, evaporation within the cryogenic propellant. This approach is important for estimating the required autogenous and/or helium pressurant for completing propulsion system burns or ensuring adequate pressure for in-space propellant transfers. Unlike in hypergolic propulsion systems, where the propellant is stored at room temperature, cryogenic propellant is highly volatile. Therefore, ensuring the accurate estimation of pressurant necessitates the precise modeling of two-phase interfacial heat and mass transfer processes. This paper aims to provide an overview of NASA’s continuing efforts in developing and validating these CFD models, with particular emphasis on benchmark cases with sloshing that enhances phase change, tracing their historical development, and demonstrating their predictive accuracy when compared to test results.

low-gravity fluid modeling↗

Benchmarking Initiatives

Benchmarking has been recognized as an efficient tool for model validation as well as scientific collaboration. Several workshop series have been established to foster the benchmarking idea: setting up test cases with increasing complexity for method development and code comparison. In addition to representing model complexity, one of the key efforts is to develop codes that are suitable for modern HPC platforms such as PetaFlop supercomputers. It has been realized that those challenges are beyond single team capabilities. The Subsurface Environmental Simulation Benchmarking (SSBench) working group was initiated to develop, publish, and make publicly available well-described benchmark problems that could be used to demonstrate simulator conformance with norms established by the subsurface science and engineering community. SSBench supports the development of environmentally-relevant benchmark problem sets that provide rigorous tests for process model conceptualization, numerical implementation, process coupling, and accuracy. The initial SSBench focus on multicomponent reactive transport modeling reflects the expanding range of mechanisms and increasing complexity needed to address issues relevant to climate change, nuclear waste management, contaminant remediation, and pollution prevention.

benchmarking↗

Comparison of Results between the Legacy and Refined RELAP5-3D Models of the High Temperature Test Facility in Exercises 1 and 2 of the HTTF Benchmark

Work conducted in FY23 identified that RELAP5-3D was capable of reproducing trends in HTTF data during experiment PG-27 but was incapable of reproducing measured values. The primary cause of this discrepancy between RELAP5-3D results and experimental data was hypothesized to be a distortion in power density that was introduced by the radial nodalization of the model. We further hypothesized that a new model would provide better results when compared to the experiments PG-27 and PG-29. Work this FY developed a new model that is better capable of capturing local heat generation rates and contains a representation of each 1/6 azimuthal sector of the core. We used this model to develop a new set of solutions to Exercises 1 and 2 of Problems 2 and 3 in the benchmark. In this report, we present the first comprehensive comparison of the results between the two models. We see that in Exercise 1A, which is common between problems 2 and 3, the results are similar, though the results from the new model show greater detail than those from the legacy model. In Problem 2 Exercise 1B and Problem 3 Exercise 1B, we see that heat removal is slower in the new model than the legacy model. Problem 3 Exercise 1C shows temperatures that are lower in most places in the new model than the legacy model, but the area with active heat generation has higher block temperatures in the new model than the legacy model. Problem 3 Exercise 1D further shows that long-term heat removal is lower in the new model. Problem 2 Exercise 1C demonstrated that the new model observes higher temperatures in the core regions than the legacy model, justifying the need to preserve the power density in HTTF. The validation of PG-27 and PG-29 also demonstrated the improved temperature agreement in the core regions, particularly with a calibrated model that implements an effective thermal conductivity for the core material. Overall, PG-27 models show reasonable to excellent agreement for steady-state temperatures and minimal to reasonable agreement for transients. PG-29 models showed minimal to insufficient agreement with the data.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Numerical study of the chemo-mechanical behavior of FEBEX bentonite in nuclear waste disposal based on the Barcelona expansive model

Experimental studies show that compacted bentonite used as a backfill material for nuclear waste repository experiences strong coupling between chemical and mechanical processes. Here, we use a dual-structure expansive soil model, referred to as the Barcelona Expansive Model (BExM), to predict the behavior of bentonite buffer in subsurface emplacement tunnels for high-level radioactive waste. After emplacement, the bentonite is subjected to complex and coupled Thermal-Hydraulic-Mechanical-Chemical (THMC) processes. The BExM constitutive model is implemented in a multi-phase reactive transport and geomechanics simulator, TOUGHREACT-FLAC3D, and the model is verified with one benchmark test on FEBEX bentonite. We utilize a one-way Chemo-Mechanical (C-M) coupling approach, in which chemical changes affect the mechanical behavior of bentonite through the BExM linked with the evolution of mass fraction of smectite, exchangeable cation concentration, and ionic strength via osmotic suction. The parameters of the new coupled model for FEBEX bentonite are calibrated against a series of laboratory experiments with various salinity solutions. Finally, coupled THMC modeling is conducted for a generic argillite repository with bentonite buffer under high temperature, focusing on the long-term chemical change and its effect on the mechanical process.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Efficient discontinuous finite difference meshes for 3-D Laplace–Fourier domain seismic wavefield modelling in acoustic media with embedded boundaries

Simulation of acoustic wave propagation in the Laplace–Fourier (LF) domain, with a spatially uniform mesh, can be computationally demanding especially in areas with large velocity contrasts. To improve efficiency and convergence, we use 3-D second- and fourth-order velocity-pressure finite difference (FD) discontinuous meshes (DM). Our DM algorithm can use any spatial discretization ratio between meshes. We evaluate direct and iterative parallel solvers for computational speed, memory requirements and convergence. Finally, benchmarks in realistic 3-D models and topographies show more efficient and stable results for DM with direct solvers than uniform mesh results with iterative solvers.

58 GEOSCIENCES↗

Quantification of the importance of the modeling fidelity in the Best Estimate Plus Uncertainty analysis

In this work, the multi-physics coupling of CTF-PARCS for both steady-state and transient simulations is evaluated focusing on the quantification of the importance of the modeling fidelity when applied to the Best Estimate Plus Uncertainty safety analysis. For the steady-state, a Picard iteration approach is adopted in the coupled code while for the transient an explicit approach has been developed as a first step. The CTF-PARCS coupling is applied to the REA at HFP BOC scenario proposed in the exercise I-2c of LWR-UAM benchmark Phase III. Two different modeling choices are investigated for the nominal calculations. The first consists of including the 3D burnup information in CTF, and the second of modeling the spacers grids in both PARCS and CTF. It is observed that due to the degradation of the fuel thermal conductivity, the 3D burnup inclusion in CTF leads to significant higher centerline temperatures than the base case, with a difference up to 300 K. The spacer grids modeling shows the expected power and temperature decrease in the axial positions of the spacer grids. For the uncertainty quantification study, the multi-physics modeling including the burnup information in CTF is used. The results show that the inserted reactivity has a relative standard deviation of 13.6% mainly attributed to the nuclear data. The maximum linear power has a relative standard deviation of 16.2% due to the nuclear data as well, while the maximum centerline temperature has a relative standard deviation of 3.5% primarily caused by the fuel thermal conductivity. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Self-shielding models of MICROX-2 code

The MICROX-2 is a transport theory code that solves for the neutron slowing-down and thermalization equations of a two-region lattice cell. In the previous study, a new fine-group cross section library of the MICROX-2 was generated and tested against reference calculations and measurement data. In this study, existing physics models of the MICROX-2 are reviewed and updated to improve the physics calculation performance of the MICROX-2 code, including the resonance self-shielding model and spatial self-shielding factor. The updated self-shielding models have been verified through a series of benchmark calculations against the Monte Carlo code, using homogeneous and pin cell models selected for this study. The results have shown that the updates of the self-shielding factor calculation model are correct and improve the physics calculation accuracy even though the magnitude of error reduction is relatively small. Compared to the existing models, the updates reduced the prediction error of the infinite multiplication factor by approximately 0.1 % and 0.2% for the homogeneous and pin cell models, respectively, considered in this study. (authors)

97 MATHEMATICS AND COMPUTING↗

Identification of Computational and Experimental Reduced-Order Models

The identification of computational and experimental reduced-order models (ROMs) for the analysis of unsteady aerodynamic responses and for efficient aeroelastic analyses is presented. For the identification of a computational aeroelastic ROM, the CFL3Dv6.0 computational fluid dynamics (CFD) code is used. Flutter results for the AGARD 445.6 Wing and for a Rigid Semispan Model (RSM) computed using CFL3Dv6.0 are presented, including discussion of associated computational costs. Modal impulse responses of the unsteady aerodynamic system are computed using the CFL3Dv6.0 code and transformed into state-space form. The unsteady aerodynamic state-space ROM is then combined with a state-space model of the structure to create an aeroelastic simulation using the MATLAB/SIMULINK environment. The MATLAB/SIMULINK ROM is then used to rapidly compute aeroelastic transients, including flutter. The ROM shows excellent agreement with the aeroelastic analyses computed using the CFL3Dv6.0 code directly. For the identification of experimental unsteady pressure ROMs, results are presented for two configurations: the RSM and a Benchmark Supercritical Wing (BSCW). Both models were used to acquire unsteady pressure data due to pitching oscillations on the Oscillating Turntable (OTT) system at the Transonic Dynamics Tunnel (TDT). A deconvolution scheme involving a step input in pitch and the resultant step response in pressure, for several pressure transducers, is used to identify the unsteady pressure impulse responses. The identified impulse responses are then used to predict the pressure responses due to pitching oscillations at several frequencies. Comparisons with the experimental data are then presented.

Silva, Walter A.↗

Burning Plasma-Wall Interactions

We have studied chemical sputtering, hydrogen retention and other products of particle-surface interactions in the least known, intermediate-to-low range of impact energies (1-30 eV/D), with atomic and molecular projectiles of deuterated amorphous carbon surfaces. Results from atomistic, molecular dynamics (MD) modeling using massive computation have been benchmarked against 'in house' particle beam experiments, enhancing its predictive capabilities. We have extended previous MD simulations for well defined ion beam experiments to plasma-bombardment environments using predefined distributions of impact particles in energy, angle, and angular momentum. Initial comparison with available plasma-irradiation experimental data is encouraging. The quality of the existing interatomic potentials and research opportunities in the development of new potentials for mixed fusion materials are discussed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗