Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,099 records · Page 61

Impact of Distributed Energy Resources on the Bulk Electric System: Combined Modeling of Transmission and Distribution Systems and Benchmark Case Studies

The high penetration of distributed energy resources (DERs) on modern distribution systems introduces intermittent power generation, stochastic system operating conditions, and bi-directional power flows that impact the system responses to various types of disturbances and may pose challenges to the operations and reliability of the Bulk Electric System (BES). In order to understand the impact of DERs on the planning and operation of the BES, the distribution system can no longer be represented as a single load at a node on the transmission system. At the same time, advanced control capabilities of DERs offer potential opportunities for improving BES reliability by transforming DERs from a passive “do no harm” resource to an active “support reliability” resource when applied in a planned and well-thought-out manner. This concept is often described as DER “flexibility.” With the persistent trend towards a high- penetration of DERs in distribution systems, regulators such as the North American Electric Reliability Corporation (NERC), planning coordinators and grid operators are in serious need of understanding the full-spectrum impact of DERs on the BES to ensure secure and reliable grid planning and operations.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Verification and Benchmarking of High Fidelity Physics Peat Smoldering Model

Peat fires are a major contributor to greenhouse gas emissions. The estimates of these emissions currently contain major uncertainties, due to the difficulty of determining the mass of peat burned in a fire. To address these uncertainties, we develop a computational physics-based peat smoldering model, which will be leveraged for high-fidelity quantitative estimates of peat fire emissions relevant to climate change. We present the verification of the 2-D axisymmetric model, a first step towards developing a full 3-D model. Verification includes the solution verification against a literature model for the 0-D smoldering case and verification of the heat transfer problem in 1-D and 2-D. Also presented is the effect of reaction mechanism on the smoldering model, for which we found a relatively simple three-step reaction mechanism is able to capture key behavior. These verification results provide the foundation for moving forward with validation against experimental data of the 2-D model.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Error associated with a reduced order linear model of a spur gear pair

The paper proposes a reduced-order analytical model of a spur gear pair which consists of two identical spur gears, two identical flexible shafts, and four identical rolling element bearings of a given radial stiffness. The error associated with the undamped eigensolution is estimated by a comparison with a benchmark finite element model.

Kahraman, A.↗

Atmospheric Carbon Cycle Dynamics Over the Above Domain: an Integrated Analysis Using Aircraft Observations (Arctic-CA) and Model Simulations (GEOS)

The Arctic Carbon Atmospheric Profiles (Arctic-CAP) project conducted six airborne surveys of Alaska and northwestern Canada between April and November 2017 to capture the spatial and temporal gradients of northern high-latitude carbon dioxide (CO2), methane (CH4) and carbon monoxide (CO) as part of NASA's Arctic-Boreal Vulnerability Experiment (ABoVE). The Arctic-CAP sampling strategy involved acquiring vertical profiles of CO2, CH4 and CO from the surface to 5 km altitude at 25 sites around the ABoVE domain on a 4- to 6-week time interval. We observed vertical gradients of CO2, CH4 and CO that vary by eco-region and duration of the sampling period, which spanned the majority of the seasonal cycle. All Arctic-CAP measurements were compared to a global simulation using the Goddard Earth Observing System (GEOS) modeling system. Comparisons with GEOS simulations of atmospheric CO2, CH4 and CO highlight the potential of these multi-species observations to inform improvements in surface flux estimates and the representation of atmospheric transport. GEOS simulations provide estimates of the near surface average CO2 and CH4 enhancements that are well correlated with aircraft observations (R=0.74 and R=0.60 respectively), suggesting that GEOS has reasonable fidelity over this complex and heterogeneous region. This model-data comparison over the ABoVE domain reveals that while current state-of-the-art models and flux estimates are able to capture broadscale spatial and temporal patterns in near-surface CO2 and CH4 concentrations, more work is needed to resolve fine-scale flux features that are observed. The study also provides a framework for benchmarking a global model at regional scales, which is needed to use climate models as tools to investigate high-latitude carbon-climate feedbacks.

C Sweeney↗

RELAP5-3D Modeling in the OECD-NEA HTTF Benchmark

Prismatic gas-cooled reactors are a technologically mature reactor concept of interest for near- to mid-term deployment. To accelerate the deployment of these reactors, the DOE's Advanced Reactor Technologies Gas-Cooled Reactor campaign is spearheading a thermal hydraulics code validation benchmark based on the High Temperature Test Facility at Oregon State University. This presentation provides an introduction to that benchmark and an overview of some of the RELAP5-3D validation activities stemming from that benchmark.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

RELAP5-3D Modeling of the OECD-NEA HTTF Benchmark

HTTF at Oregon State University (OSU) Reference: General Atomics’ modular high-temperature gas-cooled reactor Helium cooled, electrically heated (2.2 MW) Prismatic graphite blocks in the core and reflectors Alumina ceramic blocks are used to simulate the core and top and bottom reflectors One-fourth scale in length and diameter Most of the coolant channels in the core are full scale Lower pressure compared to the prototype reactor (0.7 MPa) Over 500 instruments Designed primarily to investigate depressurized (DCC) and pressurized (PCC) conduction cooldown transients

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Outcomes and Conclusions from the 2022 AM Bench Measurements, Challenge Problems, Modeling Submissions, and Conference

The Additive Manufacturing Benchmark Test Series (AM Bench) provides rigorous measurement data for validating additive manufacturing (AM) simulations for a broad range of AM technologies and material systems. AM Bench includes extensive in situ and ex situ measurements, simulation challenges for the AM modeling community, and a corresponding conference series. In 2022, the second round of AM Bench measurements, challenge problems, and conference were completed, focusing primarily upon laser powder bed fusion (LPBF) processing of metals, and both material extrusion processing and vat photopolymerization of polymers. In all, more than 100 people from 10 National Institute of Standards and Technology (NIST) divisions and 21 additional organizations were directly involved in the AM Bench 2022 measurements, data management, and conference organization. The international AM community submitted 138 sets of blind modeling simulations for comparison with the in situ and ex situ measurements, up from 46 submissions for the first round of AM Bench in 2018. Analysis of these submissions provides valuable insight into current AM modeling capabilities. The AM Bench data are permanently archived and freely accessible online. The AM Bench conference also hosted an embedded workshop on qualification and certification of AM materials and components.

36 MATERIALS SCIENCE↗

Leveraging Prior Concept Learning Improves Generalization From Few Examples in Computational Models of Human Object Recognition

Humans quickly and accurately learn new visual concepts from sparse data, sometimes just a single example. The impressive performance of artificial neural networks which hierarchically pool afferents across scales and positions suggests that the hierarchical organization of the human visual system is critical to its accuracy. These approaches, however, require magnitudes of order more examples than human learners. We used a benchmark deep learning model to show that the hierarchy can also be leveraged to vastly improve the speed of learning. We specifically show how previously learned but broadly tuned conceptual representations can be used to learn visual concepts from as few as two positive examples; reusing visual representations from earlier in the visual hierarchy, as in prior approaches, requires significantly more examples to perform comparably. These results suggest techniques for learning even more efficiently and provide a biologically plausible way to learn new visual concepts from few examples.

Rule, Joshua S.↗

Whole core analysis of OECD/NEA TVA-WB1 benchmark exercise 1 using continuous-energy Monte Carlo code MVP with JENDL-4.0u and ENDF/B-VII.0

The TVA WB1 benchmark problem was precisely modeled in accordance with the geometry and material specifications, and benchmark exercise 1 was solved with the MVP code and the nuclear data libraries based on JENDL-4.0u (JENDL-4.0 updated file) and ENDF/B-VII.0. The criticality, the control rod bank worth, the isothermal temperature coefficient (ITC), the integral rod worth of bank D, and differential soluble boron worth (DBW) were obtained. The criticality and the control rod bank worth were compared with the measured data and published calculation results with other codes, Serpent and KENO. The criticality and the control rod bank worth calculated by MVP and the libraries agree with the measured and the published calculation results within the criteria specified in the ANSI/ANS standard. From these results, the calculation model for the MVP and the libraries was verified. The other parameters such as ITC, the integral rod worth, and DBW were also compared between JENDL-4.0u and ENDF/B-VII.0. The comparison of the results shows JENDL-4.0u and ENDF/B-VII.0 give comparable results within the standard deviation, the difference between libraries is small. (author)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Verification Test Suite for Spalart-Allmaras QCR2000 Turbulence Model

The paper presents three benchmark cases for verification of Reynolds-averaged Navier-Stokes solvers. The verification studies focus on a one-equation Spalart-Allmaras model, SA-[neg]-QCR2000, that uses a version of quadratic constitutive relations.The benchmark cases are a two-dimensional subsonic flow around a Joukowski airfoil, a three-dimensional supersonic flow through a square duct, and a three-dimensional flow over a wing-fuselage configuration. The turbulence-model formulation, geometry, flow conditions, grids, and the expected output are described in detail. Reference solutions computed by several established codes are shown

Computational Aerodynamics↗

Search for new particles decaying to ZZ using final states with leptons and jets with the ATLAS detector in root s=7 TeV proton-proton collisions

A search is presented for a narrow resonance decaying to a pair of Z bosons using data corresponding to 1.02 fb{sup -1} of integrated luminosity collected by the ATLAS experiment from pp collisions at {radical}s = 7 TeV. Events containing either four charged leptons ({ell}{ell}{ell}{ell}) or two charged leptons and two jets ({ell}{ell}jj) are analyzed and found to be consistent with the Standard Model background expectation. Lower limits on a resonance mass are set using the Randall-Sundrum (RS1) graviton model as a benchmark. Using both {ell}{ell}{ell}{ell} and {ell}{ell}jj events, an RS1 graviton with k/{bar m}{sub pl} = 0.1 and mass between 325 and 845 GeV is excluded at 95% confidence level. In addition, the {ell}{ell}{ell}{ell} events are used to set a model-independent fiducial cross section limit of {sigma}{sub fid}(pp {yields} X {yields} ZZ) < 0.92 pb at 95% confidence level for any new sources of ZZ production with m{sub ZZ} greater than 300 GeV.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Review of Grey Box/Black Box Data Contamination Metrics on Open and Commercial Models

Dataset contamination is a problem where benchmarks and tasks used to evaluate the capabilities of Large Language Models (LLMs) have been incorporated into the training dataset of the models. This gives a false sense of performance that can overestimate how these models will function on truly unseen data. This problem becomes worse with commercial LLMs with larger and non-accessible training data, so techniques have been developed to try to measure the degree to which a model is contaminated with a benchmark’s data. To understand the effectiveness of these techniques, particularly when evaluating contamination on coding tasks, we review trends and categorize techniques by the degree of access to the model that is required. The research literature on this topic has reported mixed effectiveness of these techniques, so we select a set of black box (text access only) and grey box (access to model loss/probabilities required) techniques and apply them to both commercial and non-commercial models. We implement these metrics as part of a framework to test the contamination of Python code in LLMs to see to what extent we can replicate the effectiveness (or ineffectiveness) of these contamination detection techniques. Though we find mixed results in the capabilities of these metrics to identify contamination, we do observe evidence that they can identify contamination (broadly) in fine-tuned models when both a baseline and fine-tuned model is present. Additionally, similarity metrics were able to identify between contaminated and uncontaminated data even in situations where the data is distributionally similar (e.g., drawn from the same set of code projects).

97 MATHEMATICS AND COMPUTING↗

Current Status of Problem 2 in the HTGR T/H Benchmark

Problem 2 of the HTGR T/H Benchmark is for modeling the depressurized conduction cooldown (DCC) transient. This presentation shares the status of code-to-code and code-to-date comparisons (Exercises 1 and 2) of Problem 2 with results from several participants. A key factor in the discrepancy between results and data in Exercise 2 is the assumed power distribution that is used to model PG-29. This talk highlights both the similarities and differences in solutions and discusses areas where further investigation is merited.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

TH-C-BRD-01: Analytical Computation of Prompt Gamma Ray Emission and Detection for Proton Range Verification

Purpose: A prompt gamma (PG) slit camera prototype demonstrated that on-line range monitoring within 1–2 mm could be performed by comparing expected and measured PG detection profiles. Monte Carlo (MC) can simulate the expected PG profile but this would result in prohibitive computation time for a complete pencil beam treatment plan. We implemented a much faster method that is based on analytical processing of pre-computed MC data. Methods: The formation of the PG detection signal can be separated into: 1) production of PGs and 2) detection by the camera detectors after PG transport in geometry. For proton energies from 40 to 230 MeV, PG productions in depth were pre-computed by MC (PENH) for 12C, 14N, 16O, 31P and 40Ca. The PG production was then modeled analytically by adding the PG production for each element according to local proton energy and tissue composition.PG transport in the patient/camera geometries and the detector response were modeled by convolving the PG production profile with a transfer function. The latter is interpolated from a database of transfer functions fitted to pre-computed MC data (PENELOPE). The database was generated for a photon source in a cylindrical phantom with various radiuses and a camera placed at various positions.As a benchmark, the analytical model was compared to PENH for a water phantom, a phantom with different slabs (adipose, muscle, lung) and a thoracic CT. Results: Good agreement (within 5%) was observed between the analytical model and PENH for the PG production. Similar accuracy for detecting range shifts was also observed. Speed of around 250 ms per profile was achieved (single CPU) using a non-optimized MatLab implementation. Conclusion: We devised a fast analytical model for generating PG detection profiles. In the test cases considered in this study, similar accuracy than MC was achieved for detecting range shifts. This research is supported by IBA.

60 APPLIED LIFE SCIENCES↗

Plasma Simulation Using Gyrokinetic-Gyrofluid Hybrid Models

We are developing kinetic ion models for the simulation of extended MHD phenomena. The model they have developed uses full Lorentz force ions, and either drift-kinetic or gyro-kinetic electrons. Quasi-neutrality is assumed and the displacement current is neglected. They are also studying alpha particle driven Toroidal Alfven Eigenmodes (TAE) in the GEM gyrokinetic code [Chen 07]. The basic kinetic ion MHD model was recently reported in an invited talk given by Dan Barnes at the 2007 American Physical Society - Division of Plasma Physics (APS-DPP) and it has been published [Jones 04, Barnes 08]. The model uses an Ohm's law that includes the Hall term, pressure term and the electron inertia [Jones 04]. These results focused on the ion physics and assumed an isothermal electron closure. It is found in conventional gyrokinetic turbulence simulations that the timestep cannot be made much greater than the ion cyclotron period. However, the kinetic ion MHD model has the compressional mode, which further limits the timestep. They have developed an implicit scheme to avoid this timestep constraint. They have also added drift kinetic electrons. This model has been benchmarked linearly. Waves investigated where shear and compressional Alfven, whisterl, ion acoustic, and drift waves, including the kinetic damping rates. This work is ongoing and was first reported at the 2008 Sherwood Fusion Theory Conference [Chen 08] and they are working on a publication. They have also formulated an integrated gyrokinetic electron model, which is of interest for studying electron gradient instabilities and weak guide-field magnetic reconnection.

43 PARTICLE ACCELERATORS↗