Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,459 records · Page 81

Multi-scale Material Parameter Identification Using LS-DYNA® and LS-OPT®

Ever-tightening regulations on fuel economy, and the likely future regulation of carbon emissions, demand persistent innovation in vehicle design to reduce vehicle mass. Classical methods for computational mass reduction include sizing, shape and topology optimization. One of the few remaining options for weight reduction can be found in materials engineering and material design optimization. Apart from considering different types of materials, by adding material diversity and composite materials, an appealing option in automotive design is to engineer steel alloys for the purpose of reducing plate thickness while retaining sufficient strength and ductility required for durability and safety. A project to develop computational material models for advanced high strength steel is currently being executed under the auspices of the United States Automotive Materials Partnership (USAMP) funded by the US Department of Energy. Under this program, new Third Generation Advanced High Strength Steel (i.e., 3GAHSS) are being designed, tested and integrated with the remaining design variables of a benchmark vehicle Finite Element model. The objectives of the project are to integrate atomistic, microstructural, forming and performance models to create an integrated computational materials engineering (ICME) toolkit for 3GAHSS. The mechanical properties of Advanced High Strength Steels (AHSS) are controlled by many factors, including phase composition and distribution in the overall microstructure, volume fraction, size and morphology of phase constituents as well as stability of the metastable retained austenite phase. The complex phase transformation and deformation mechanisms in these steels make the well-established traditional techniques obsolete, and a multi-scale microstructure-based modeling approach following the ICME [0]strategy was therefore chosen in this project. Multi-scale modeling as a major area of research and development is an outgrowth of the Comprehensive Test Ban Treaty of 1996 which banned surface testing of nuclear devices [1]. This had the effect that experimental work was reduced from large scale tests to multiscale experiments to provide material models with validation at different length scales. In the subsequent years industry realized that multi-scale modeling and simulation-based design were transferable to the design optimization of any structural system. Horstemeyer [1] lists a number of advantages of the use of multiscale modeling. Among these are: the reduction of product development time by alleviating costly trial-and-error iterations as well as the reduction of product costs through innovations in material, product and process designs. Multi-scale modeling can reduce the number of costly large scale experiments and can increase product quality by providing more accurate predictions. Research tends to be focussed on each particular length scale, which enhances accuracy in the long term. This paper serves as an introduction to the LS-OPT and LS-DYNA methodology for multi-scale modeling. It mainly focuses on an approach to integrate material identification using material models of different length scales. As an example, a multi-scale material identification strategy, consisting of a Crystal Plasticity (CP) material model and a homogenized State Variable (SV) model, is discussed and the parameter identification of the individual material models of different length scales is demonstrated. The paper concludes with thoughts on integrating the multi-scale methodology into the overall vehicle design.

Stander, Nielen↗

Magneto-Hydrodynamic Modeling in the Design and Interpretation of Wire Array Z-pinches

Magneto-hydrodynamic simulations provide a powerful tool for improving our understanding of the complex physical processes underlying the behavior of wire array Z-pinches. We show how, by using large scale parallel 3D simulations of the array as a whole, it is possible to encompass all of the important features of the wire ablation, implosion and stagnation phases and to observe how these phenomena control the X-ray pulse that is achieved. Comparison of code results with experimental data from the 'Z' and MAGPIE pulsed power generators is shown to provide a detailed benchmark test for the models. The simulation results are also used to highlight key areas for future research.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Towards interpretable Cryo-EM: disentangling latent spaces of molecular conformations

Molecules are essential building blocks of life and their different conformations (i.e., shapes) crucially determine the functional role that they play in living organisms. Cryogenic Electron Microscopy (cryo-EM) allows for acquisition of large image datasets of individual molecules. Recent advances in computational cryo-EM have made it possible to learn latent variable models of conformation landscapes. However, interpreting these latent spaces remains a challenge as their individual dimensions are often arbitrary. The key message of our work is that this interpretation challenge can be viewed as an Independent Component Analysis (ICA) problem where we seek models that have the property of identifiability. That means, they have an essentially unique solution, representing a conformational latent space that separates the different degrees of freedom a molecule is equipped with in nature. Thus, we aim to advance the computational field of cryo-EM beyond visualizations as we connect it with the theoretical framework of (nonlinear) ICA and discuss the need for identifiable models, improved metrics, and benchmarks. Moving forward, we propose future directions for enhancing the disentanglement of latent spaces in cryo-EM, refining evaluation metrics and exploring techniques that leverage physics-based decoders of biomolecular systems. Moreover, we discuss how future technological developments in time-resolved single particle imaging may enable the application of nonlinear ICA models that can discover the true conformation changes of molecules in nature. The pursuit of interpretable conformational latent spaces will empower researchers to unravel complex biological processes and facilitate targeted interventions. This has significant implications for drug discovery and structural biology more broadly. More generally, latent variable models are deployed widely across many scientific disciplines. Thus, the argument we present in this work has much broader applications in AI for science if we want to move from impressive nonlinear neural network models to mathematically grounded methods that can help us learn something new about nature.

59 BASIC BIOLOGICAL SCIENCES↗

Quantitative modeling of ICRF antennas with integrated time domain RF sheath and plasma physics

Significant efforts have been made to quantitatively benchmark the sheath sub-grid model used in our time-domain simulations of plasma-immersed antenna near fields, which includes highly detailed three-dimensional geometry, the presence of the slow wave, and the non-linear evolution of the sheath potential. We present both our quantitative benchmarking strategy, and results for the ITER antenna configuration, including detailed maps of electric field, and sheath potential along the entire antenna structure. Our method is based upon a time-domain linear plasma model, using the finite-difference electromagnetic Vorpal/Vsim software. This model has been augmented with a non-linear rf-sheath sub-grid model, which provides a self-consistent boundary condition for plasma current where it exists in proximity to metallic surfaces. Very early, this algorithm was designed and demonstrated to work on very complicated three-dimensional geometry, derived from CAD or other complex description of actual hardware, including ITER antennas. Initial work with the simulation model has also provided a confirmation of the existence of propagating slow waves in the low density edge region, which can significantly impact the strength of the rf-sheath potential, which is thought to contribute to impurity generation. Our sheath algorithm is based upon per-point lumped-circuit parameters for which we have estimates and general understanding, but which allow for some tuning and fitting. We are now engaged in a careful benchmarking of the algorithm against known analytic models and existing computational techniques to insure that the predictions of rf-sheath voltage are quantitatively consistent and believable, especially where slow waves share in the field with the fast wave. Currently in progress, an addition to the plasma force response accounting for the sheath potential, should enable the modeling of sheath plasma waves, a predicted additional root to the dispersion, existing at the plasma-metal interface. Our model is presently restricted to plasma in the vicinity of metallic (highly conducting) surfaces, however we report on a new effort to include thin and thick dielectric (poorly conducting) surfaces, which are of interest to both fusion devices and to industrial plasmas, where dielectric, or dielectric-coated vessels and geometry are heavily used.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Improving the representation of hydrologic processes in Earth System Models

Many of the scientific and societal challenges in understanding and preparing for global environmental change rest upon our ability to understand and predict the water cycle change at large river basin, continent, and global scales. However, current large-scale models, such as the land components of Earth System Models (ESMs), do not yet represent the terrestrial water cycle in a fully integrated manner or resolve the finer-scale processes that can dominate large-scale water budgets. This paper reviews the current representation of hydrologic processes in ESMs and identifies the key opportunities for improvement. This review suggests that (1) the development of ESMs has not kept pace with modeling advances in hydrology, both through neglecting key processes (e.g., groundwater) and neglecting key aspects of spatial variability and hydrologic connectivity; and (2) many modeling advances in hydrology can readily be incorporated into ESMs and substantially improve predictions of the water cycle. Accelerating modeling advances in ESMs requires comprehensive hydrologic benchmarking activities, in order to systematically evaluate competing modeling alternatives, understand model weaknesses, and prioritize model development needs. This demands stronger collaboration, both through greater engagement of hydrologists in ESM development and through more detailed evaluation of ESM processes in research watersheds. Advances in the representation of hydrologic process in ESMs can substantially improve energy, carbon and nutrient cycle prediction capabilities through the fundamental role the water cycle plays in regulating these cycles.

54 ENVIRONMENTAL SCIENCES↗

Overview of Liquid-Metal PFC R&D at the University of Illinois Urbana-Champaign

The design and implementation of future flowing liquid-lithium plasma-facing components (LLPFCs) will be dependent on several factors. Of course, one of the most important is the need to be able to deal with high heat fluxes incident on the surface of the LLPFCs, but there are also several other important liquid-metal behaviors that have been identified for their critical impact on the feasibility of a LLPFC. One of these is the ability to constantly wet 100% of the plasma-facing component area and the best way to achieve that. Another key point is knowing and understanding the erosion and corrosion of the surfaces subject to a flowing liquid-lithium system and the ability for hydrogen and helium uptake by the system. The Center for Plasma Material Interactions (CPMI) has been tasked with looking at these various issues. The Mock-up Entry module for EAST device was used to investigate wetting and erosion effects and to design a suitable distribution and collection system with a liquid-lithium loop. The vapor shielding effects of lithium on the surface were also modeled and studied. A model coupling CRANE, an open-source global reaction network solver, and Zapdos, a plasma transport solver, is being developed to better understand the dynamics of the vapor cloud. Experiments on the Magnum-PSI at the Dutch Institute for Fundamental Energy Research have been carried out to study the vapor shielding effect and obtain experimental benchmarks to verify the model. Also, initial experiments using the Hybrid Illinois Device for Research and Applications have been performed to understand the pumping effects of lithium on helium. Experiments with a drop of liquid lithium (~100 mg) into a helium plasma have shown the ability of lithium to take out the cold recycling helium gas as well as hydrogen and oxygen impurity gases. The improvement in plasma performance was significant, and further understanding of this effect will have impacts on how future LLPFCs will be designed. Further investigation into the exact mechanism for helium pumping by lithium needs to be performed in the future. Finally, this paper presents a summary of the results obtained at the CPMI.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

FY23 Progress on Computational Modeling of the Water-Based NSTF

This report summarizes the system-level modeling effort by Argonne National Laboratory (Argonne) of the Natural convection Shutdown heat removal Test Facility (NSTF) in FY23. As a continuation of the modeling effort from FY22, this year’s work focuses on improving the RELAP5-3D model developed previously for two-phase flow simulations. The RELAP5-3D model is updated to more accurately capture the heat loss experienced by the facility. The updated model is compared against experimental data for benchmarking purposes of the RELAP5-3D input model. By correctly accounting for heat loss, the updated RELAP5-3D model can now predict the two-phase baseline case more accurately. The onset and the duration of instability are captured well by the model. Furthermore, analyses are performed to better understand the instability mechanism experienced by the flow where the expansion of the boiling boundary in the chimney is studied in details and the fundamental frequencies of the oscillations are obtained. The updated RELAP5-3D model is further compared against four fault conditions, namely the reduction of riser header inlet flow area, depletion of system inventory, blocked riser channels, and static boiling scenario. For each fault condition, minor modifications and tuning are performed to improve the predictions of the model. The purpose of the analyses is to investigate the capability of RELAP5-3D in predicting complex two-phase flows in possible accident scenarios in actual Reactor Cavity Cooling System (RCCS). Overall, the model is able to capture the behaviors and trends of these fault conditions relatively well. Some discrepancies remain between the experimental data and the predictions, many of which are likely due to the differences in the predicted and experimental vapor generation rate. Future work will focus on the continued development of the current RELAP5-3D input model of the NSTF to both improve the accuracy of the model’s predictive capability and continue supporting the experimental program needs. The mutually beneficial relationship between analysis and experimental efforts has become integral to the parent NSTF program, and the greater objective to fully understand and accurately predict the heat removal performance of a full scale RCCS concept.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Performance modeling & simulation of complex systems (A systems engineering design & analysis approach)

Modeling of the Multi-mission Image Processing System (MIPS) will be described as an example of the use of a modeling tool to design a distributed system that supports multiple application scenarios. This paper examines: (a) modeling tool selection, capabilities, and operation (namely NETWORK 2.5 by CACl), (b) pointers for building or constructing a model and how the MIPS model was developed, (c) the importance of benchmarking or testing the performance of equipment/subsystems being considered for incorporation the design/architecture, (d) the essential step of model validation and/or calibration using the benchmark results, (e) sample simulation results from the MIPS model, and (f) how modeling and simulation analysis affected the MIPS design process by having a supportive and informative impact.

Hall, Laverne↗

AutomaDeD: Automata-Based Debugging for Dissimilar Parallel Tasks

Today's largest systems have over 100,000 cores, with million-core systems expected over the next few years. This growing scale makes debugging the applications that run on them a daunting challenge. Few debugging tools perform well at this scale and most provide an overload of information about the entire job. Developers need tools that quickly direct them to the root cause of the problem. This paper presents AutomaDeD, a tool that identifies which tasks of a large-scale application first manifest a bug at a specific code region at a specific point during program execution. AutomaDeD creates a statistical model of the application's control-flow and timing behavior that organizes tasks into groups and identifies deviations from normal execution, thus significantly reducing debugging effort. In addition to a case study in which AutomaDeD locates a bug that occurred during development of MVAPICH, we evaluate AutomaDeD on a range of bugs injected into the NAS parallel benchmarks. Our results demonstrate that detects the time period when a bug first manifested itself with 90% accuracy for stalls and hangs and 70% accuracy for interference faults. It identifies the subset of processes first affected by the fault with 80% accuracy and 70% accuracy, respectively and the code region where where the fault first manifested with 90% and 50% accuracy, respectively.

97 MATHEMATICS AND COMPUTING↗

Accurate and transferable multitask prediction of chemical properties with an atoms-in-molecules neural network

Atomic and molecular properties could be evaluated from the fundamental Schrodinger’s equation and therefore represent different modalities of the same quantum phenomena. Here, we present AIMNet, a modular and chemically inspired deep neural network potential. We used AIMNet with multitarget training to learn multiple modalities of the state of the atom in a molecular system. The resulting model shows on several benchmark datasets state-of-the-art accuracy, comparable to the results of orders of magnitude more expensive DFT methods. It can simultaneously predict several atomic and molecular properties without an increase in the computational cost. With AIMNet, we show a new dimension of transferability: the ability to learn new targets using multimodal information from previous training. The model can learn implicit solvation energy (SMD method) using only a fraction of the original training data and an archive median absolute deviation error of 1.1 kcal/mol compared to experimental solvation free energies in the MNSol database.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A flippon related singlet at the LHC II

Here, we consider the 750 GeV diphoton resonance at the 13 TeV LHC in the ℱ-SU(5) model with a Standard Model (SM) singlet field which couples to TeV-scale vector-like particles, dubbed flippons . This singlet field assumes the role of the 750 GeV resonance, with production via gluon fusion and subsequent decay to a diphoton via the vector-like particle loops. We present a numerical analysis showing that the observed 8 TeV and 13 TeV diphoton production cross-sections can be generated in the model space with realistic electric charges and Yukawa couplings for light vector-like masses. We further discuss the experimental viability of light vector-like masses in a General No-Scale ℱ-SU(5) model, offering a few benchmark scenarios in this consistent GUT that can satisfy all experimental constraints imposed by the LHC and other essential experiments.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Achieving GPT-4o level performance in astronomy with a specialized 8B-parameter large language model

AstroSage-Llama-3.1-8B is a domain-specialized natural-language AI assistant tailored for research in astronomy, astrophysics, cosmology, and astronomical instrumentation. Trained on the complete collection of astronomy-related arXiv papers from 2007 to 2024 along with millions of synthetically-generated question-answer pairs and other astronomical literature, AstroSage-Llama-3.1-8B demonstrates remarkable proficiency on a wide range of questions. AstroSage-Llama-3.1-8B scores 80.9% on the AstroMLab-1 benchmark, greatly outperforming all models—proprietary and open-weight—in the 8-billion parameter class, and performing on par with GPT-4o. This achievement demonstrates the potential of domain specialization in AI, suggesting that focused training can yield capabilities exceeding those of much larger, general-purpose models. AstroSage-Llama-3.1-8B is freely available, enabling widespread access to advanced AI capabilities for astronomical education and research.

AI assistant↗

Capturing Infrastructure Interdependencies for Power Outages Prediction During Extreme Events

As extreme weather events such as hurricanes, severe thunderstorms, and floods grow in frequency and intensity, the disruption of power grid systems poses significant challenges, including widespread electrical outages, economic losses, and threats to public safety. This paper presents a forward-looking approach that leverages geographical graph-based machine learning models to predict county-level maximum power outages during such events. By capturing the intricate interdependencies within power system networks, our approach aims to provide precise and actionable predictions that can optimize emergency response efforts and enhance grid resilience. Through the integration of real-world data, including hurricane advisories and power outage records, we have trained and benchmarked multiple machine learning models, demonstrating the feasibility and potential of this method. While our initial results are promising, this paper also charts a course for advancing these models, addressing the remaining challenges, and ultimately transforming how we anticipate and respond to the impacts of extreme weather on power systems.

Lee, Sangkeun (Matt) [ORNL] (ORCID:000000021317511↗

Total thermal neutron cross section measurements of hydrogen dense polymers from 0.0005–20 eV

Hydrogen dense polymers, specifically polyethylene, polystyrene, and Plexiglas, have served as neutron moderator and reflector materials in hundreds of separate critical benchmark experiments because of their low cost and abundance of hydrogen. In order to accurately model and simulate these critical benchmarks, the thermal scattering law (TSL) evaluation that governs how neutrons will thermalize must be well understood and rigorously validated. To support this validation, researchers at Rensselaer Polytechnic Institute performed total neutron cross section measurements for high-density polyethylene & polystyrene over the energy range 0.0005–20 eV and for Plexiglas G & Plexiglas G-UVT over the energy range 0.0005–3 eV. Comparisons were made between the measured cross section and that predicted by the ENDF/B-VIII.0 and Oak Ridge National Laboratory/European Spallation Source/Rensselaer Polytechnic Institute TSL evaluations for polyethylene, Plexiglas, and polystyrene, as available. These experiments represent the first total neutron cross section measurements for polystyrene.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Evolution of Ocean Heat Content Related to ENSO

As the strongest interannual perturbation to the climate system, El Niño–Southern Oscillation (ENSO) dominates the year-to-year variability of the ocean energy budget. Here we combine ocean observations, reanalyses, and surface flux data with Earth system model simulations to obtain estimates of the different terms affecting the redistribution of energy in the Earth system during ENSO events, including exchanges between ocean and atmosphere and among different ocean basins, and lateral and vertical rearrangements. This comprehensive inventory allows better understanding of the regional and global evolution of ocean heat related to ENSO and provides observational metrics to benchmark performance of climate models. Results confirm that there is a strong negative ocean heat content tendency (OHCT) in the tropical Pacific Ocean during El Niño, mainly through enhanced air–sea heat fluxes Q into the atmosphere driven by high sea surface temperatures. In addition to this diabatic component, there is an adiabatic redistribution of heat both laterally and vertically (0–100 and 100–300 m) in the tropical Pacific and Indian oceans that dominates the local OHCT. Heat is also transported and discharged from 20°S–5°N into off-equatorial regions within 5°–20°N during and after El Niño. OHCT and Q changes outside the tropical Pacific Ocean indicate the ENSO-driven atmospheric teleconnections and changes of ocean heat transport (i.e., Indonesian Throughflow). The tropical Atlantic and Indian Oceans warm during El Niño, partly offsetting the tropical Pacific cooling for the tropical oceans as a whole. While there are distinct regional OHCT changes, many compensate each other, resulting in a weak but robust net global ocean cooling during and after El Niño.

54 ENVIRONMENTAL SCIENCES↗

Development and Implementation of Mechanistic Terry Turbine Models in RELAP-7 to Simulate RCIC Normal Operation Conditions

As part of the efforts to understand the unexpected “self-regulating” mode of the RCIC (Reactor Core Isolation Cooling) systems in Fukushima accidents and extend BWR RCIC and PWR AFW (Auxiliary Feed Water) operational range and flexibility, mechanistic models for the Terry turbine, based on Sandia’s original work [1], have been developed and implemented in the RELAP-7 code to simulate the RCIC system. In 2016, our effort has been focused on normal working conditions of the RCIC system. More complex off-design conditions will be pursued in later years when more data are available. In the Sandia model, the turbine stator inlet velocity is provided according to a reduced-order model which was obtained from a large number of CFD (computational fluid dynamics) simulations. In this work, we propose an alternative method, using an under-expanded jet model to obtain the velocity and thermodynamic conditions for the turbine stator inlet. The models include both an adiabatic expansion process inside the nozzle and a free expansion process outside of the nozzle to ambient pressure. The combined models are able to predict the steam mass flow rate and supersonic velocity to the Terry turbine bucket entrance, which are the necessary input information for the Terry turbine rotor model. The analytical models for the nozzle were validated with experimental data and benchmarked with CFD simulations. The analytical models generally agree well with the experimental data and CFD simulations. The analytical models are suitable for implementation into a reactor system analysis code or severe accident code as part of mechanistic and dynamical models to understand the RCIC behaviors. The newly developed nozzle models and modified turbine rotor model according to the Sandia’s original work have been implemented into RELAP-7, along with the original Sandia Terry turbine model. A new pump model has also been developed and implemented to couple with the Terry turbine model. An input model was developed to test the Terry turbine RCIC system, which generates reasonable results. Both the INL RCIC model and the Sandia RCIC model produce results matching major rated parameters such as the rotational speed, pump torque, and the turbine shaft work for the normal operation condition. The Sandia model is more sensitive to the turbine outlet pressure than the INL model. The next step will be further refining the Terry turbine models by including two-phase flow cases so that off-design conditions can be simulated. The pump model could also be enhanced with the use of the homologous curves.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Albedos of homogeneous semi-infinite canopies - Comparison of two-stream analytic and numerical solutions

The albedo of plant canopies is treated as a problem in radiative transfer. Albedos calcualted from an iterative multistream numerical model are compared with those calculated with an analytic two-stream solution. With the assumption of a randomly homogeneous distribution of leaf positions and orientations and isotropic scattering by individual leaves, the single-scattering albedo of the canopy can be found analytically. This single-scattering solution is incorporated into the two-stream solution and used to benchmark the multistream numerical model in the single-scattering limit. Relative errors so established in the multistream model are O(0.3 percent) or less. The two-stream model is also found to be remarkably accurate, with the error in multiply scattered radiation O(5 percent) or less, corresponding to absolute errors in visible albedo of less than 0.001 and near-infrared albedo of less than or equal to 0.01. Thus the two-stream model should be adequate for many purposes, such as climate modeling, provided the assumptions of homogeneous canopy and isotropic scattering are not too unrealistic.

Dickinson, Robert E.↗

Analysis of an RNG based turbulence model for separated flows

A two-equation turbulence model of the K-epsilon type was recently derived by using Renormalization Group (RNG) methods. It was later reported that this RNG based model yields substantially better predictions than the standard K-epsilon model for turbulent flow over a backward facing step - a standard test case used to benchmark the performance of turbulence models in separated flows. The improvements obtained from the RNG K-epsilon model were attributed to the better treatment of near wall turbulence effects. In contrast to these earlier claims, it is shown in this paper that the original version of the RNG K-epsilon model substantially underpredicts the reattachment point in the backstep problem. This is a deficiency that is traced to the modeling of the production of dissipation term. However, with the most recent improvements in the RNG K-epsilon model, excellent results for the backstep problem are now obtained.

Speziale, C. G.↗