Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,657 records · Page 92

Evaluation of Oak Ridge National Laboratory Health Physics Research Reactor Operation Data for Critical Benchmark Creation [Slides]

During the evaluation of Oak Ridge National Laboratory Health Physics Research Reactor operation data for critical benchmark creation, a detailed, functional SCALE model was built, and experimental data was evaluated for the creation of a critical benchmark. The estimated experimental uncertainty is about 3800 pcm, which is considered very high. The relative difference between expected and calculated keff values is about 1.5 %, also considered very high. It was concluded that a good quality critical benchmark worthy of the ICSBEP standards cannot be created from HPRR data in the present conditions. Locating the HPRR fuel to obtain an uncertainty on the density would aid in solving this issue.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Experiments for SINBAD: Evaluation of Oak Ridge Health Physics Research Reactor Operation Data for CAAS Benchmark Creation [Slides]

This report was a real information preservation and dissemination work with a lot of legacy content that was found and used. There was an abundance of uncertainty, discrepancy, and contradictory information. Yet, a detailed, functional SCALE model was built, and the benchmark created is useful for shielding and CAAs validation work. Sulfur fluence C/E ratios are large (2 to 5), so different benchmark metrics were studied. Neutron fluence, element 57 dose, and other dosimetry responses at 3 meters C/E ratios are below 1.5 for bare and steel configurations. Additional promising metrics as dose per unit fluence and steel shield attenuation were computed.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

NEAMS Model Contributions in 2023 to the National Reactor Innovation Center Virtual Test Bed for Use by Industry and Other Stakeholders

The U.S. Department of Energy (DOE) Office of Nuclear Energy’s Advanced Modeling and Simulation (NEAMS) Program develops models of advanced reactor phenomena to demonstrate code applicability to challenging physics problems, drive code development through user assessment, and perform code verification and validation. Meanwhile, the U.S. DOE’s National Reactor Innovation Center (NRIC) hosts an open-source website and associated GitHub repository called the Virtual Test Bed (VTB) on which computational models for advanced reactors are documented and shared with the reactor community. This work documents NEAMS efforts to support industry adoption of advanced modeling tools through contribution of 10 NEAMS models to the NRIC Virtual Test Bed including models for the High Temperature Test Facility (HTTF), TRISO fuel failure in a microreactor, and multiphysics models of a molten chloride fast reactor, among others. The open sharing of these models benefits the reactor community by providing “best practice” examples using NEAMS tools for advanced reactor physics problems. In particular, the HTTF model is being used for code validation and benchmarking activities. The microreactor and molten chloride fast reactor models are representative of analysis that may be useful for current candidates of DOME and LOTUS, NRIC’s physical testbeds. This report summarizes and provides links to these new models, among others.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Towards an Aviation Large Language Model by Fine-tuning and Evaluating Transformers

In the aviation domain, there are many applications for machine learning and artificial intelligence tools that utilize natural language. For example, there is a desire to know the commonalities in written safety reports such as voluntary post incidents reports or aerial wildfire operations reports to better understand the risks present. Another use-case is the possibility of extracting airspace procedures and constraints currently written in documents such as Letters of Agreement. These applications can benefit from the use of state-of-the-art natural language processing techniques when adapted to the language/phraseology specific to the aviation domain. This paper evaluates the viability of adaptation of NLP tools to the aviation domain by fine-tuning transformer based models using aviation data sets. In 2018, a novel language model based on neural units (also called transformers) was created and became known as “Bidirectional Encoder Representations from Transformers” or BERT. This architecture combined with large amounts of English training data and innovative semi-supervised training tasks set the standard for what would later emerge as Large Language Models. The performance of these models was further improved by hyperparameter tuning and refinement of the semi-supervised training task and resulted in “Robustly Optimized BERT Pre-training Approach through hyperparameter tuning” or RoBERTa models. These pre-trained Large Language Models proved to be useful for a wide variety of natural language processing tasks such as text classification and question answering through a process called fine-tuning. The transformer architecture with pre-trained weights served as the basis with the last few layers replaced with layers fine-tuned to perform a new task e.g., a layer that provides a label for the entire input text. This process of fine-tuning can also be used to adapt the models to new domains; e.g., BioBERT started with the pre-trained BERT model and was completed by additional fine-tuning and training on biomedical documents. Transformer-based architectures can also be used to create rich representations of text called embeddings which can serve as the input to other machine learning models. This allows simpler algorithms such as logistic regression to use context-rich representations of the text while still remaining quick to train and evaluate. In the world of aviation, there is a growing demand for natural language processing and understanding but the domain presents unique challenges. Due to the technical content (and specialized language) of most aviation documents, fine-tuning pre-trained Large Language Models to specific tasks has not met the benchmark on natural language processing tasks set by simpler models trained from scratch on the data. To address this deficiency, this paper evaluates the improvements from fine-tuning a Large Language Model on a large set of aviation documents using the original semi-supervised training tasks before performing specific natural language tasks. In fine-tuning, a domain-specific dataset is used on the original training task but with the pre-trained Large Language Model instead of starting from a random initialization. This approach allows the model to be adapted to the specific domain language without discarding the information gained from training on general English data. This paper utilized two major dataset types to train and assess the RoBERTa fine-tuning performance. The first are 7,057 Letters of Agreement which are Federal Aviation Administration (FAA) documents that formalize airspace operations across the national airspace system. They contain many examples of ‘aviation English’ using domain specific terminology and phrasing which serves as a representative basis to perform the semi-supervised fine-tuning. The second type is the 494 document classification labels to be used for evaluation. This down-stream evaluation aims to show the performance of the fine-tuned model, better understand how much data is needed for an effective fine-tuning, and how fine-tuning can be adapted for different applications in-the domain. After semi-supervised training, evaluation begins by encoding the documents for classification using the fine-tuned RoBERTa model. Then a logistic regression classifier is trained to label the document type and compared against our ground truth labels. This currently leads to a 82.8% accuracy on 10-fold cross validation showing improvement over baseline RoBERTa which achieved 81.0%. We plan to measure the improvements on additional tasks and it is expected that these improvements will lead to more robust models that can tackle the natural language processing challenges present in aviation datasets.

ATM↗

Modeling betatron radiation using particle-in-cell codes for plasma wakefield accelerator diagnostics

The analysis of plasma wakefield acceleration experimental measurements, particularly in the characterization of photons emitted through the betatron radiation mechanism, requires the development of accurate numerical models. These computational models are crucial for supporting modern instrumentation designed to measure the single-shot, double-differential angular-energy radiation spectra resulting from interactions between beams and plasmas. Motivated by the needs of such applications, this paper presents detailed numerical models of betatron radiation generated in beam-plasma acceleration experiments. These models are based on the integration of the Liénard-Wiechert (LW) potentials, applied to computed particle trajectories. The particle trajectories are generated using three distinct methods: first, by tracking particles through idealized fields in the blowout regime of PWFA; second, by obtaining trajectories using the fast quasistatic particle-in-cell (PIC) code quickpic; and third, obtaining trajectories from the fully self-consistent PIC code osiris. To ensure the accuracy and reliability of these models, the paper includes various benchmark tests using analytical expressions, as well as employing the PIC code epoch, which takes an alternative approach by using a Monte Carlo quantum electrodynamics (QED)-based radiation model. Additionally, the paper presents simulations of the expected experimental betatron radiation spectra, taking into account parameters relevant to PWFA and plasma photocathode experiments at the SLAC FACET-II facility.

Yadav, M. [University of California, Los Angeles, ↗

FORCE Development Status Update: Vertical Integration and Benchmarking of System Dynamics

Recent efforts to establish effective models for grid energy analysis, especially given the increase in variable renewable energy (VRE) sources and the economic challenges faced by traditional nuclear energy, have generated new technological considerations. One effort to improve the economic viability of nuclear power involves investigating integrated energy systems (IES) which include secondary energy systems that introduce flexibility and secondary market possibilities to existing and perceived future nuclear energy generation technologies. To analyze the technical and economic potential of IES, the Framework for Optimization of Resources and Economics (FORCE) tool suite was developed through a collaboration among national laboratories. Within the FORCE tool suite, the Holistic Energy Resource Optimization Network (HERON) provides algorithms for analyzing the long-term viability of potential IES technologies, while HYBRID provides algorithms and models to achieve high-resolution analysis of coupling physics over a short time period. Continued maturing of the FORCE tool suite requires further interconnections between the various tools in the suite in order to ensure consistent analysis. Analyses performed by applying HYBRID to transient process modeling should be easily harvestable as inputs to HERON analyses. The first item in this status update is a demonstration of an automated data pipeline for loading data from HYBRID into HERON analyses. Application of HYBRID results to HERON, as part of using the FORCE tool suite, relies on robust modeling assumptions for the various models included in HYBRID. The second result of this status update is the benchmarking and validation of cost and operational data, with a particular focus on natural gas energy generators. These generators are benchmarked with a focus on contrasting them with proposed thermal energy storage (TES) technologies.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Heavy Flavor Simplified Models at the LHC

We consider a comprehensive set of simplified models that contribute to final states with top and bottom quarks at the LHC. These simplified models are used to create minimal search strategies that ensure optimal coverage of new heavy flavor physics involving the pair production of color octets and triplets. We provide a set of benchmarks that are representative of model space, which can be used by experimentalists to perform their own optimization of search strategies. For data sets larger than 1 fb{sup -1}, same-sign dilepton and 3b search regions become very powerful. Expected sensitivities from existing and optimized searches are given.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

AFRL Additive Manufacturing Modeling Series: Challenge 1, Characterization of Residual Strain Distribution in Additively-Manufactured Metal Parts Using Energy-Dispersive Diffraction

A machine component fabricated by additive manufacturing (AM) of metal powders often possesses steep residual stress gradients with significant magnitudes due to large temperature gradients that transpire within a localized area during fabrication. These processing-induced residual stresses can cause distortion of the part, and if they are of significant magnitude, they could induce cracking of the component, degrade printability, and/or diminish subsequent mechanical performance. The ability to predict these residual stresses imparted by AM is an important step in permeating AM technology for advanced manufacturing. Calibration and validation of AM process models used for prediction are, therefore, a critical step in understanding the origin and mitigating the challenges associated with residual stresses inherent to the AM process. In the present work, the residual strain distributions in components with simple geometries fabricated by a laser powder bed fusion (LBPF) process were characterized non-destructively using energy-dispersive X-ray diffraction in support of the US Air Force Research Laboratory Additive Manufacturing Modeling Challenge Series Groeber et al. (JOM 70:441-448, 2018). The measurement setup and approach are described in detail so that the data can be used as a benchmark to calibrate and validate models for the prediction of macro-scale residual stresses due to the LPBF process.

36 MATERIALS SCIENCE↗

Improvement of three-field based safety analysis code, SPACE, through verification and validation

To verify and validate the state-of-the-art safety analysis code, SPACE, features of three field governing equations were arranged and the comparative analysis with both analytic solution and experimental benchmarks were performed. With the world wide streamline on the safety analysis, SPACE uses two-fluid, three-field governing equations which aim to implement multi-dimensional and multi-scaled analysis. Through the Verification and Validation (V and V), developing code based on the three-field governing equation have not only been confirmed but also improved. V and V activities on SPACE have been conducted as to interfacial drag model in vertical turbulent flow. The verification of the interfacial drag model was based on cell size sensitivity test for confirming feasible calculation range of cell size. Furthermore, through the validation with analytic solution, the modification of the interfacial drag model in vertical turbulent annulus flow was carried out and the nominated model was incorporated. Modified interfacial drag model, Asali's correlation, yields improved result than previous interfacial drag model. The validation with experimental benchmarks had also been performed on the nearly horizontal counter current limitation. To confirm the possibility of the further application of the CCFL model in case with horizontal pipe, validation with nearly horizontal pipe experiment was carried out. V and V activities of SPACE with analytic solution and experimental benchmarks allow us to confirm/identify the tailorability for safety analysis. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Best Practices Guide for High-Performance Indian Office Buildings

This document provides best practice guidance and energy- efficiency recommendations for the design, construction, and operation of high-­performance office buildings in India. Through a discussion of learnings from exemplary projects and inputs from experts, it provides recommendations that can potentially help achieve (1) enhanced working environments, (2) economic construction/faster payback, (3) reduced operating costs, and (4) reduced greenhouse gas (GHG) emissions. It also provides ambitious (but achievable) energy performance benchmarks, both as adopted targets during building modeling (design phase) and during measurement and verification (operations phase). These benchmarks have been derived from a set of representative best-in-class office buildings in India. The best practices strategies presented in this guide would ideally help in delivering high-­performance in terms of a triad—of energy efficiency, cost efficiency, and occupant comfort and well-­being. These best practices strategies and metrics should be normalized—that is, corrected to account for building characteristics, diversity of operations, weather, and materials and construction methods.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

On benchmarking of simulations of particle transport in ITER

We present results of benchmarking of core particle transport simulations by a collection of codes widely used in transport modelling of tokamak plasmas. Our analysis includes formulation of transport equations, difference between electron and ion solvers, comparison of modules of the pellet and edge gas fuelling on the ITER baseline scenario. During the first phase of benchmarking we address the particle transport effects in the stationary phase. Firstly, simulations are performed with identical sources, sinks, transport coefficients, and boundary conditions prescribed in the flattop H-mode phase. The transformation of ion particle transport equations is introduced so to directly compare their results to electron transport solvers. Moreover, the pellet fuelling models are benchmarked in various conditions to evaluate the dependency of the pellet deposition on the pellet volume, injection side, pedestal and separatrix parameters. Thirdly, edge gas fuelling is benchmarked to assess sensitivities of source profile predictions to uncertainties in plasma conditions and detailed model assumptions. At the second phase, we address particle transport effects in the time-evolving plasma including the current ramp-up to the ramp-down phase. The ion and the electron solvers are benchmarked together. Differences between the simulation results of the solvers are investigated in terms of equilibrium, grid resolution, radial coordinate, radial grid distribution, and plasma volume evolution term. We found that the selection of the radial coordinate can yield prominent differences between the solvers mainly due to differences in the edge grid distribution. The simulations reveal that electron and ion solvers predict noticeably different density peaking for the same diffusion and pinch velocity while with the peaked profile of helium, expected in fusion reactors. The fuelling benchmarking demonstrates that gas puffing is not efficient for core fuelling in H-modes and density control should be done by the high field side pellet injection in contrast to present machines.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Search for new phenomena in photon+jet events collected in proton--proton collisions at sqrt(s) = 8 TeV with the ATLAS detector

CERN-LHC. A model-independent search is made for the production of new resonances in photon + jet events using 20 fb^-1 of proton-proton LHC data recorded with the ATLAS detector in 2012 at a centre-of-mass energy of sqrt(s) = 8 TeV. The photon + jet mass distribution is compared to a background model fit from data; no significant deviation from the background-only hypothesis is found. Limits are set at 95% credibility level on generic Gaussian-shaped signals and two benchmark phenomena beyond the Standard Model: non-thermal quantum black holes and excited quarks. Non-thermal quantum black holes are excluded below masses of 4.6 TeV and excited quarks are excluded below masses of 3.5 TeV.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Benchmarking of Heavy Ion Transport Codes

Accurate prediction of radiation fields generated by heavy ion interactions is important in medical applications, space missions, and in designing and operation of rare isotope research facilities. In recent years, several well-established computer codes in widespread use for particle and radiation transport calculations have been equipped with the capability to simulate heavy ion transport and interactions. To assess and validate these capabilities, we performed simulations of a series of benchmark-quality heavy ion experiments with the computer codes FLUKA, MARS15, MCNPX, and PHITS. We focus on the comparisons of secondary neutron production. Results are encouraging; however, further improvements in models and codes and additional benchmarking are required.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Benchmarking of Neutron Production of Heavy-Ion Transport Codes

Accurate prediction of radiation fields generated by heavy ion interactions is important in medical applications, space missions, and in design and operation of rare isotope research facilities. In recent years, several well-established computer codes in widespread use for particle and radiation transport calculations have been equipped with the capability to simulate heavy ion transport and interactions. To assess and validate these capabilities, we performed simulations of a series of benchmark-quality heavy ion experiments with the computer codes FLUKA, MARS15, MCNPX, and PHITS. We focus on the comparisons of secondary neutron production. Results are encouraging; however, further improvements in models and codes and additional benchmarking are required.

benchmarking↗

Benchmarking of neutron production of heavy-ion transport codes

Document available in abstract form only, full text of document follows: Accurate prediction of radiation fields generated by heavy ion interactions is important in medical applications, space missions, and in design and operation of rare isotope research facilities. In recent years, several well-established computer codes in widespread use for particle and radiation transport calculations have been equipped with the capability to simulate heavy ion transport and interactions. To assess and validate these capabilities, we performed simulations of a series of benchmark-quality heavy ion experiments with the computer codes FLUKA, MARS15, MCNPX, and PHITS. We focus on the comparisons of secondary neutron production. Results are encouraging; however, further improvements in models and codes and additional benchmarking are required. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

OECD NEA Benchmark Database of Spent Nuclear Fuel Isotopic Compositions for World Reactor Designs

Experimental data on the isotopic concentrations in irradiated nuclear fuel represent one of the primary methods for validating computational methods and nuclear data used for reactor and spent fuel depletion simulations that support nuclear fuel cycle safety and safeguards programs. Measurement data have previously not been available to users in a centralized or searchable format, and the majority of accessible information has been, for the most part, limited to light-water-reactor designs. This paper describes a recent initiative to compile spent fuel benchmark data for additional reactor designs used throughout the world that can be used to validate computer model simulations that support nuclear energy and nuclear safeguards missions. Experimental benchmark data have been expanded to include VVER-440, VVER-1000, RBMK, graphite moderated MAGNOX, gas cooled AGR, and several heavy-water moderated CANDU reactor designs. Additional experimental data for pressurized light water and boiling water reactor fuels has also been compiled for modern assembly designs and more extensive isotopic measurements. These data are being compiled and uploaded to a recently revised structured and searchable database, SFCOMPO, to provide the nuclear analysis community with a centrally-accessible resource of spent fuel compositions that can be used to benchmark computer codes, models, and nuclear data. The current version of SFCOMPO contains data for eight reactor designs, 20 fuel assembly designs, more than 550 spent fuel samples, and measured isotopic data for about 80 nuclides.

Gauld, Ian C↗

Benchmark for Free-Gas Elastic Scattering with the Heavy-Gas Model and Piecewise-Constant Cross Sections

Accurate Monte Carlo calculations involving thermal neutrons require that codes implement the thermal scattering physics correctly. The heavy-gas model, which is valid for large atomic mass, with constant cross sections in energy has an analytic solution for the thermal neutron spectrum that can be readily used to verify the implementation of the free-gas thermal scattering routines. Previous work has shown that MCNP6.1 correctly computes the free-gas thermal flux with constant cross sections. This summary extends the verification to piecewise-constant cross sections in energy that can better approximate physically realistic cross sections. The obtained solutions for the piecewise-constant cases agree with the respective thermal spectra obtained by MCNP6.1, further verifying that it is accurately simulating the free-gas model. (authors)

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Optical Properties of Moderately-Absorbing Organic and Mixed Organic/Inorganic Particles at Very High Humidities

Relative humidity (RH) affects the water content of an aerosol, altering its ability to scatter and absorb light, which is important for aerosol effects on climate and visibility. This project involves in situ measurement and modeling of aerosol optical properties including absorption, scattering and extinction at three visible wavelengths (467, 530, 660 nm), for organic carbon (OC) generated by pyrolysis of biomass, ammonium sulfate and sodium chloride, and their mixtures at controlled RH conditions. Novel components of this project include investigation of: (1) Changes in all three of these optical properties at scanned RH conditions; (2) Optical properties at RH values up to 95%, which are usually extrapolated instead of measured; and (3) Examination of aerosols generated by the pyrolysis of wood, which is representative of primary atmospheric organic carbon, and its mixture with inorganic aerosol. Scattering and extinction values were used to determine light absorption by difference and single scattering albedo values. Extensive instrumentation development and benchmarking with independently measured and modeled values were used to obtain and evaluate these new results. The single scattering albedo value for a dry absorbing polystyrene microsphere benchmark agreed within 0.02 (absolute value) with independently published results at 530 nm. Light absorption by a nigrosin (sample light-absorbing) benchmark increased by a factor of 1.24 +/-0.06 at all wavelengths as RH increased from 38 to 95%. Closure modeling with Mie theory was able to reproduce this increase with the linear volume average (LVA) refractive index mixing rule for this water soluble compound. Absorption by biomass OC aerosol increased by a factor of 2.1 +/- 0.7 and 2.3 +/- 1.2 between 32 and 95% RH at 467 nm and 530 nm, but there was no detectable absorption at 660 nm. Additionally, the spectral dependence of absorption by OC that was observed with filter measurements was confirmed qualitatively in situ at 467 and 530 nm. Closure modeling with the dynamic effective medium approximation (DEMA) refractive index model was able to capture the increasing absorption trend with RH indicating that the droplets were heterogeneously mixed while containing dispersed insoluble absorbing material within those droplets. Seven other refractive index mixing models including LVA did not adequately describe the measurements for OC. Mixing the biomass OC aerosol with select mass fractions of ammonium sulfate ranging from 25 to 36% and sodium chloride ranging from 21 to 30% resulted in an increase in light scattering and extinction with RH and inorganic mass fraction. However, no detectable difference in light absorption behavior in comparison to pure biomass OC was observed. The main finding of this research is a measured increase in absorption with increasing RH, which is currently not represented in radiative transfer models even though biomass burning produces most of the primary OC aerosol in the atmosphere.

54 ENVIRONMENTAL SCIENCES↗