SEARCH · Engineering Papers

Results for “Benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,729 records · Page 96

All sources NASA NTRS DOE OSTI

NASA NTRSDate not supplied

Reference Intercalibration for the Climate Observing System

Reference Intercalibration is critical in supporting the construction of climate data records, which, given their necessary longevity, must consist of measurements from multiple instruments. Reference intercalibration enables placing multiple instruments on the same radiometric scale, reducing calibration-based biases in climate data records. Measurements that have characteristics of a climate benchmark make excellent in-orbit intercalibration references. Climate Absolute Radiance and Refractivity Observatory (CLARREO) Pathfinder (CPF) consists of a reflected solar (RS) spectrometer (350-2300 nm) that will take hyperspectral Earth reflectance measurements with unprecedented SI-traceable accuracy (0.3%, 1-sigma) from the International Space Station (ISS). CPF measurements will have several characteristics of climate benchmark measurements and will demonstrate its capability as a rigorous in-orbit intercalibration reference with Clouds and Earth’s Radiant Energy System (CERES) and Visible Infrared Imaging Radiometer Suite (VIIRS). The methodologies that have been developed to support CPF-CERES and CPF-VIIRS intercalibration can readily be extended to other Low Earth Orbit and Geostationary instrument targets. With its highly accurate hyperspectral observations, CPF measurements can also be used to improve the characterization of targets widely used for satellite instrument vicarious calibration including Earth land surface pseudo-invariant calibration sites, deep convective clouds, and the Moon. We will discuss the importance of climate benchmark measurement attributes for intercalibration and considerations for the associated intercalibration data analysis to support building and maintaining climate data records.

Yolanda Shea↗

NASA NTRS2022

SoMoGym: A Toolkit for Developing and Evaluating Controllers and Reinforcement Learning Algorithms for Soft Robots

Soft robotsoffer a host of benefits over traditional rigid robots, including inherent compliance that lets them passively adapt to variable environments and operate safely around humans and fragile objects. However, that same compliance makes it hard to use model-based methods in planning tasks requiring high precision or complex actuation sequences. Reinforcement learning (RL) can potentially find effective control policies, but training RL using physical soft robots is often infeasible, and training using simulations has had a high barrier to adoption. To accelerate research in control and RL for soft robotic systems, we introduce SoMoGym ( So ft Mo tion Gym ), a software toolkit that facilitates training and evaluating controllers for continuum robots. SoMoGym provides a set of benchmark tasks in which soft robots interact with various objects and environments. It allows evaluation of performance on these tasks for controllers of interest, and enables the use of RL to generate new controllers. Custom environments and robots can likewise be added easily. We provide and evaluate baseline RL policies for each of the benchmark tasks. These results show that SoMoGym enables the use of RL for continuum robots, a class of robots not covered by existing benchmarks, giving them the capability to autonomously solve tasks that were previously unattainable.

Moritz A. Graule↗

NASA NTRSDate not supplied

A New Era of H-O-C-S Magma Solubility Modeling: Better, Faster, Stronger

H 2 O, CO 2 , and S are the most abundant volatiles in magmatic systems and are critical to understanding magma storage, phase equilibria, and volcanic eruptions. Models that consider all three of these components, however, may not allow for critical examination and adjustment of assumptions underlying the model, or provide benchmark testing or extensible interfaces. Thus, understanding why models produce different results can be challenging. We have gathered authors of established (D-Compress) and recent (VolFe, EVo, Sulfur_X, MAGEC) H-O-C-S volatile solubility models to work together to understand how and why our models diverge. We present a series of benchmark basalt degassing scenarios revealing that often understated model assumptions such as fO 2 buffer equations, fO 2 -Fe 3+ /ΣFe relationships, and even major element normalization routines have outsized effects on model results. All models consider S 2- and S 6+ melt species but with different approaches to sulfate/sulfide capacities, partition coefficients, and species fugacities, leading to divergence in the evolution of modeled gas compositions, melt S and Fe speciation, and fO 2 , with the extent of divergence depending on melt composition. Such scenarios enable meaningful intercomparison of existing models and lay the groundwork for a user-friendly yet powerful solubility modeling framework. Given our wealth of existing solubility literature, we suggest that the field of magmatic volatiles should focus now on the creation of modern tools and the modular implementation of existing model equations or methods, and that the evaluation of code usability, transparency, and benchmarking should be codified pillars of the peer-review process. As an example of such an endeavor, we present early work coupling these sulfur solubility models with VESIcal, an extensible and rigorously tested python library containing seven existing H 2 O-CO 2 solubility models. VESIcal includes the ability to extract, edit, and even interchange assumptions underlying any model. For example, users may combine or swap separately published H 2 O, CO 2 , and S models, as well as underlying model choices, such as Equations of State and redox models.

volatiles in magmas↗

DOE OSTI2020

Coupling of Pronghorn and RELAP-7 for a Pebble Bed Reactor

High temperature gas cooled reactors (HTGR) are a candidate for timely Gen-IV reactor technology deployment because of high technology readiness and walk-away safety. Among HTGRs, pebble bed reactors (PBRs) have attractive features such as low excess reactivity and online refueling. Pebble bed reactors pose unique challenges to analysts and reactor designers such as continuous burnup distribution depending on pebble motion and recirculation, radiative heat transfer across a variety of gas-filled gaps, and long design basis transients such as pressurized and depressurized loss of forced circulation. Modeling and simulation is essential for both the PBR’s safety case and design process. In order to verify and validate the new generation codes the Nuclear Energy Agency (NEA) Data bank provide a set of benchmarks data together with solutions calculated by the participants using the state of the art codes of that time. An important milestone to test the new PBR simulation codes is the OECD NEA PBMR-400 benchmark which includes thermal hydraulic and neutron kinetic standalone exercises as well as coupled exercises and transients scenarios. In this work, the reactor multiphysics code MAMMOTH and the thermal hydraulics code Pronghorn, both developed by the Idaho National Laboratory (INL) within the multiphysics object-oriented simulation environment (MOOSE), have been used to solve Phase 1 exercises 1 and 2 of the PBMR-400 benchmark. The steady state results are in agreement with the other participants’ solutions demonstrating the adequacy of MAMMOTH and Pronghorn for simulating PBRs.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2020

HTGR Simulation Methods & International Collaborations

ART-GCR “Methods” activity is split between Experimental Validation data from the ANL NSTF and OSU HTTF (next three presentations). HTGR core simulation (this presentation). International collaboration within OECD Generation-IV (Gen-IV) and USA/Japan bi-lateral agreements (this presentation) HTGR Simulation Methods No new NE-52 funding for HTGR Methods support in FY20; ~$200K FY19 carry-over funds only. Consists of international code-to-code benchmarks (IAEA CRP on HTGR UAM and OECD/NEA MHTGR-350) and refinement of a few-group Pebble Bed Reactor (PBR) cross section (XS) generation methodology. Funding will be requested in FY21 to produce the final reports for the two benchmarks and continue the development of the PBR XS generation methodology. Additional (non-ART) HTGR-related support work at INL NEAMS: HTR-Application work package at INL Create a benchmark for the pebble shuffling and depletion algorithms being developed for NEAMS Griffin code. iFOA award with X-Energy: Develop independent Monte Carlo model of Xe-100 design. Independent design confirmatory analysis of Xe-100 design using NEAMS tools Griffin and Pronghorn. Support X-Energy design team to use their own legacy design tools (VSOP99 and MGT). Support NEAMS Griffin and Pronghorn development team for the iFOA needs (received $50K additional funding for required development).

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2021

Apparatus and method for safety analysis evaluation with data-driven workflow

An apparatus and method for system safety analysis evaluation is provided, the apparatus including processing circuitry configured for generating a calculation matrix for a system, generating a plurality of models based on the calculation matrix, performing a benchmarking or convolution analysis of the plurality of models, identifying a design envelope based on the benchmarking or convolution analysis, deriving uncertainty models from the benchmarking or convolution analysis, deriving an assessment judgment based on the uncertainty models and acceptance criteria, defining one or more limiting scenarios based on the design envelope, and determining a safety margin in at least one figure-of-merit for the system based on the design envelope and the acceptance criteria.

Martin, Robert P.↗

DOE OSTI2021

Space Nuclear Thermal Propulsion Critical Assembly Boron Worth Experiments

The Space Nuclear Thermal Propulsion (SNTP) project was an attempt to create a more powerful and more efficient rocket engine utilizing nuclear technologies. As part of this project a zero-power critical assembly referred to as SNTPCX was designed and installed at Sandia National Laboratories. The SNTP-CX was a light water moderated particle bed reactor utilizing highly enriched uranium fuel in the form of UC particles. The SNTP-CX performed 142 runs covering numerous experiments from the year 1989 to 1992. The program was canceled in 1994 as the nation’s priorities shifted. Now these experiments are being evaluated for use as criticality safety benchmarks. Nineteen of the 142 reactor runs were dedicated to a series of experiments to calculate the worth of the boron used in the light water moderator. This series of experiments has been selected for further evaluation as a critical benchmark for the International Criticality Safety Benchmark Evaluation Project (ICSBEP).

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2022

Solar and Storage Techno-Economic Analysis Tutorial for the IEEE Photovoltaic Specialist Conference (PVSC)

This tutorial will highlight the most recent efforts from the National Renewable Energy Laboratory (NREL) to track solar photovoltaic (PV) technology trends and manufacturing costs, project levelized cost of electricity (LCOE), and project levelized cost of solar plus storage (LCOSS) for systems across the globe. We will begin with an overview of the global PV supply chain and 2021 benchmark input data for NREL's crystalline silicon (c-Si) and thin film PV module manufacturing cost models. The framework that we follow and will review during this tutorial provides a methodology to prepare bottom-up manufacturing cost models including the items within the U.S. Generally Accepted Accounting Principles (GAAP) and the International Financial Reporting Standards (IFRS). For the polysilicon, wafer, cell conversion, and module assembly steps of the c-Si supply chain, and for thin film modules, we will review input data and methods useful for calculating the costs of goods sold (COGS); research and development (R&D) expenses; and sales, general, and business administration (S, G, &A) expenses. This 2021 benchmark analysis is compiled for state-of-the-art c-Si and thin film module manufacturing. We will also review methods for our 2021 system benchmark costs calculations and LCOE technoeconomic analysis of PV systems and solar plus storage systems. Next generation technologies that lower PV manufacturing and installation costs, reduce operations and maintenance (O&M) expenses, and improve system energy yield will also be highlighted. Techniques for comparing LCOE performance will also be reviewed. We look forward to sharing NREL's extensive work in these areas and discussing ideas for future directions.

cost models↗

DOE OSTI2022

Modernization efforts for the R -Matrix code SAMMY [Abstract]

The R-Matrix code SAMMY is a widely used nuclear data evaluation code focused on the resolved range, which includes corrections for experimental effects. The code is still mostly written in Fortran 77, and uses a memory management system suitable for the time of its initial writing (1984). A modernization effort is under way to bring the code in-line with modern software development practices. A continuous-integration testing framework was added, automating the large existing set of test cases. It is run on every commit. The memory management was updated to current standard practices suitable for modern software analysis tools. The code can be obtained from https://code.ornl.gov/RNSD/SAMMY. The resonance parameters and covariance information are now stored in C++ objects shared by SAMMY and AMPX, the processing code that generates nuclear data libraries for SCALE. This allows for easier maintenance and access to the resonance parameters inside and outside of SAMMY. This feature is already used by accessing and changing parameters in memory in the Bayesian Monte Carlo Evaluation Framework for Cross Sections Nuclear Data and Integral Benchmark Experiments project, Further plans include the switch to the ENDF reading and writing routines in AMPX, as these routines are more robust, easier to maintain, and support more features. Of note here is support for the new GNDS format. Previously it wasn’t easy to share the full covariance matrix for evaluations containing more than one isotope due to limitations on the ENDF format; this is now supported in GNDS. The data are currently available in a binary SAMMY format and can be exported to GNDS to make them more widely available and sharable. The next step will be to use the same resonance processing code at 0K in AMPX and SAMMY as one of the available Reich-Moore R-Matrix formalism. The first step toward this goal is to isolate the reconstruction into a module that takes resonance parameters as its input and does not depend on SAMMY global parameters. This goal has been achieved and it should now be possible to more easily change the resonance formalism and add enhancements as the Phenomenological R-Matrix parameterization of direct, doorway, and compound nuclear reactions discussed elsewhere on this conference. This concerted modernization and enhancement effort provides multiple advantages to the nuclear data community. It will allow parameter optimization using enhanced formalisms, including experimental effects, that better match complex experimental data. Then those evaluated parameters can immediately be passed off to AMPX to be reconstructed with the exact same cross section model and be put into a data library for subsequent testing using SCALE and the Valid Benchmark suite or other suitable benchmark suites.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2023

Converging towards atomic and nuclear pressures (Final Report)

his report details the development of transformational tools and techniques, allowing the accurate characterization of matter at the most extreme conditions yet studied in the high energy density (HED) domain. Before this work, most experiments quantitatively mapping the nature of matter in the HED realm were performed using planar geometry, which allows for the isolation and measurement of variables in a single thermodynamic state. Such measurements include equation of state variables, optical conductivity, heat transport and more. However, due to a variety of plasma processes, such experiments are limited to below ~10 TPa (100 Mbar) pressures. To achieve higher pressures, convergent experiments are needed. Historically, convergent experiments have not been used for benchmark data because they are integral measurements. That is each part of a convergent target undergoes a time dependent wide range of states, making it difficult to accurately isolate any particular quantity for a given thermodynamic state. This effort developed innovative convergent HED platforms and techniques enabling the exploration of matter from atomic to nuclear scale pressures. This effort also performed pioneering experiments that yielded the first rigorous benchmark data at these extreme conditions. This funding award began with the overarching goal to understand the behavior of matter at extreme (atomic-to-nuclear scale) pressures. The motivation for these goals lie in the fact that every time scientists explore matter beyond the threshold of an atomic unit, there is a fundamental shift in science. The atomic unit for energy, mass, charge, length, and time have each been explored, and each time such a threshold was crossed, a new sequence of discoveries was made resulting in significant awards such as the Nobel Prize. The only unexplored atomic unit is pressure, and this effort set the course for exploring matter at and beyond such pressures. That most of the recently discovered extrasolar planets and stars, as well as matter in the late implosion stages of inertial fusion targets, have deep internal pressures at and beyond atomic pressures amplifies the importance of this effort. Much of the initial work in developing techniques to create these atomic-to-nuclear pressures already existed within the HED community, predominantly at large scale laser facilities such as the National Ignition Facility (NIF) and the Omega60 laser the University of Rochester and although these experiments were routinely performed the ability to extract information about the underlying physical states and processes remained elusive due to the complexity of the experiments, extreme scales in both time and space, and the integrated nature of all the measurements. This work built a rigorous framework so such measurements can routinely be made. This was done in part through the introduction of Bayesian inference techniques into the field of HED science. These techniques allow for the self-consistent extraction of the relevant variables and their explicit and implicit correlations, so as to make use of integrated experimental data to constrain physical models and provide accurate uncertainty bounds for the data. The techniques developed here are fully transparent and proved immediately useful providing quantitative rigorous benchmarks for physical states and processes at some of the most extreme conditions yet explored on Earth. This funding is directly or partly responsible for 7 publications in major peer-reviewed scientific journals, a doctoral thesis, 3 invited talks at major conferences, and the training of a post-doc, 2 graduate students, and 1 undergraduate student. Beyond the effort supported by this award launched the introduction of Bayesian inference into the HED physics community and helped push the usage if modern data-science techniques within the physics community at large.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2022

Correlation Calculations for the Russian Pu Metal Fast Experiments

Nuclear criticality experiments are often conducted in campaigns with multiple variations. These experiments reuse the same basic components, like the fuel, moderator, or positioning machines. The components have uncertainties in their geometry and composition that propagate to models of the experiments. Shared components create shared uncertainty between the $k_{eff}$ of benchmarks. The shared uncertainty is commonly quantified with a covariance, or correlation coefficient. These covariances can impact criticality safety and nuclear data validation applications. While benchmark evaluations tabulate an experiment’s uncertainty, they often lack a detailed calculation of correlations between experiments. Even some very commonly used benchmarks, like the Russian Pu Metal Fast (PMF) experiments, have missing correlations. This paper presents our approach to calculate the correlations for five of the Russian PMF experiments. The experiments share hemispherical Pu shells that induce a correlation between modeled $k_{eff}$ values. We estimated the correlations with simplified and detailed models of the experiments through linear-perturbation theory. The correlations between the experiments vary significantly between the detailed vs. simplified models. We also investigate how the correlations affect validation metrics of the experiments.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2022

Using Cosmic Ray Muons to Assess Geological Characteristics in the Subsurface

Cosmic rays are energetic nuclei and elementary particles that originate from stars and intergalactic events. The interaction of these particles with the upper atmosphere produces a wide range of secondary particles that reach the surface of the earth, of which muons are the most prominent. With enough energy, muons can travel up to a few kilometers beneath the surface of the earth before being stopped completely. The terrestrial muon flux profile and associated zenith angle can be utilized to determine geological characteristics of a location (e.g., rock overburden and density) without having to use conventional methods such as boreholes. This work uses a low-power plastic scintillator-based muon detection system as a prototype for this non-destructive geological assay methodology. Four custom designed 102 cm x 51 cm x 5 cm plastic scintillation panels are used to realize two orthogonal detection planes. Optical photons from each scintillation panel are read using OnSemi J-Series 4x4 silicon photomultiplier (SiPM) arrays in conjunction with preamplifiers. Simultaneous triggers between detectors from two planes indicate a coincidence event which is recorded using the QuarkNet data acquisition system (DAQ) from Fermi National Accelerator Laboratory. A custom detector holder was designed to securely mount the detection system and rotate the panels along the zenith to collect data at variable angles. In order to quantify the systematic uncertainties associated with the detector, such as energy depositions and angular resolution of the detector design, a Monte Carlo (MC) simulation using Geant4 is being developed. Cosmic ray flux prediction will be included in the project by adding the CORSIKA MC code to the simulation toolchain. Simulated and experimental data will drive the development and validation of a reconstruction algorithm that, upon completion, is expected to predict average overburden and rock density. Extended detector exposure to muons can be used as a means to understand changes in the surrounding environment like rock porosity. On the experimental front, muons will initially be measured at the surface, establishing the baseline flux. This is followed by recording the muon flux at variable depths and zenith angles, where the data will be used by the reconstruction algorithm to predict the overburden. The result will be benchmarked against geological surveys. The measured flux data will also be used to benchmark independent and established models. Successful proof-of-concept demonstration of this technology can open doors for long term non-invasive geological monitoring. The detector design, experimental methodology, and the benchmarking efforts are detailed in this work.

Gadey, Harish Reddy↗

DOE OSTI2023

Apparatus and method for safety analysis evaluation with data-driven workflow

Martin, Robert P.↗

DOE OSTI2023

A Reproducible Validation of Algorithms for Estimating Array Tilt and Azimuth from Photovoltaic Power Time Series

In this research, we assess the viability of four different, publicly available algorithms for estimating the azimuth and tilt parameters of solar photovoltaic systems using only the associated AC power time series data and site latitude-longitude coordinates. In this work, we curated a benchmarking data set of 44 fixed-tilt systems, comprising 275 measured AC power inverter data streams, with known azimuth and tilt parameters. Additionally, we isolated test cases in the data set with real-world issues, including shading and clipping, to determine how algorithm performance varies based on the presence of these phenomena. Using this data set for benchmarking, we evaluated the estimated vs. actual system characteristics for each algorithm, as well as the associated algorithm execution time using a standardized benchmarking process. The two highest performing algorithms were the Solar Data Tools and the PVWatts 5-based methods, which both achieved a median absolute error of approximately 5 and 1 degrees for azimuth and tilt, respectively. During run time analysis, the SDT method was approximately 5 times faster than the PVWatts 5-based method, with the median execution time for a stream varying between 6 and 8 seconds vs. a median run time of 31 seconds for the PVWatts 5-based method.

algorithm validation↗

DOE OSTI2023

Gamma-ray Measurements from Neutron Pulsed Die-Away Experiments

Pulsed-neutron die-away experiments are a promising experimental method that complement criticality benchmarks for nuclear data validation. The experiments have several advantages that include compatibility with non-fissile material, low benchmark uncertainties, and high sensitivity to absorption and scattering cross sections. When validating thermal neutron scattering laws, small targets are desirable for their large sensitivity to the scattering cross section and angular distribution. Unfortunately, room return or scattering from a shielding box limits the use of the very small targets needed to maximize sensitivity to thermal scattering laws. To address this problem, we propose changing the observable of the experiment from leaked thermal neutrons to γ-rays produced by (n, γ) reactions in the target. If feasible, this change allows removal of the shielding box, achieving higher sensitivity to thermal neutron scattering laws. This study focuses on replicating benchmark pulsed-neutron die-away experiments with γ-rays. We compare the integral parameters with γ-rays to those obtained with neutrons. We also discuss experimental design choices such as detector placement, shielding, and the presence of Cd. The results show the integral parameter with γ-rays is sensitive to detector location with respect to the target when Cd shielding is present. In addition, while Pb shielding around the γ-ray detectors do not seem to affect the integral parameter, the presence of Cd shielding does and adds background γ-rays to the die-away curves making it difficult to calculate the integral parameter.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2023

Workshop on Addressing Rigor and Reproducibility in Thermal, Heterogeneous Catalysis

Heterogeneous catalysis has long served as the bedrock of the manufacturing of energy carriers, fuels and chemicals, and various technologies for pollution abatement. The significant complexity and variability spanning the entire breadth of catalyst material properties, synthesis methods, characterization techniques, and evaluation procedures, has focused attention on the need to establish community-accepted best practices for ensuring high-quality, benchmarked, and reproducible data. In addition, increased societal urgency to transition to clean energy and reduce greenhouse gas concentrations has incentivized interdisciplinary, convergent, and translational approaches to catalysis research in recent years. Research engineers and scientists with expertise cutting broadly across materials science, chemical synthesis, interfacial science, spectroscopy, and methods of data science and computational simulation, all bring diverse and important perspectives to catalysis research, but often with little awareness of the complexity of catalytic systems, especially in their working environment. As has already occurred in other scientific fields, there has been growing recognition and consensus in the heterogeneous catalysis research community that mechanisms are needed to improve the rigor and reproducibility (R&R) of experimental measurements, to ensure alignment of the broader research community with a common core of best practices specific to the realization of high-quality catalysis research. Similarly, the field is moving rapidly toward computationally informed and data science-driven catalyst design, but the success of implementing such predictive tools hinges on model training and validation rooted in rigorously obtained and reproducible experimental data that are benchmarked to common specifications. As such, this workshop was convened to prepare a report summarizing best practices for reporting data and performing experiments that researchers can use to benchmark, validate, and reproduce data in specific sub-fields of thermal, heterogeneous catalysis. Additionally, we discussed recommendations for future actions that may improve R&R in this field. The workshop organizers and participants include a diverse range of catalysis researchers from various employment sectors (e.g., academia, industry, national laboratory), institutional mission and resources (e.g., PhD-granting research universities, non-PhD-granting teaching universities), career stage (e.g., early, mid and late-career), technical expertise, and demographic background. This diverse group was involved in the discussion of workshop agenda items, writing this report, and discussing possible future action items for the community to consider, which helped ensure that a broad range of perspectives were captured in the description of the problems at hand and the creation of actionable solutions that may be effectively adopted by the diverse practitioners in catalysis research. Importantly, this group of workshop participants also included very early career researchers (e.g., senior PhD students, postdoctoral scholars) who will become the next generation of scientific leaders in various sectors, thus capturing emerging perspectives of newcomers to the field to shape its future while positively impacting the development of its future workforce. We envision that this effort will help advance the field of catalysis science by improving the rigor and reproducibility of experimental data collected by current researchers and future newcomers to the field, which is of broad importance to health and vitality of any scientific discipline. Therefore, best practices identified in this endeavor for thermal heterogeneous catalysis can be translated to such efforts in other areas of catalysis and other scientific fields involving the study of materials, and vice versa. We also envision this to be an ongoing effort, with future workshops that are convened to discuss issues of rigor and reproducibility on technical topics that were unable to be covered in this workshop due to its scope limitations, and as emerging methods and materials become more prevalent in the research community.

36 MATERIALS SCIENCE↗

DOE OSTI2023

Neural Image Compression: Generalization, Robustness, and Spectral Biases

Recent advances in neural image compression (NIC) have resulted in models which are starting to outperform traditional codecs. While this has led to growing excitement about using these methods in real-world applications, the successful adoption of any machine learning system (including NIC) in the wild requires it to generalize (and be robust) to unseen distribution shifts at deployment time. Unfortunately, current research lacks comprehensive datasets and informative tools to evaluate and understand compression performance in real-world settings. To bridge this crucial gap, first, this paper presents a comprehensive benchmark suite to evaluate the out-of-distribution (OOD) performance of image compression methods. Specifically, we design CLIC-C and Kodak-C by introducing 15 common corruptions to popular CLIC and Kodak benchmarks. Next, we propose spectrally inspired introspection tools to gain a deeper understanding of errors introduced by image compression methods as well as their OOD performance. To this end, we carry out a detailed performance comparison of the classical codec with various variants of NIC (e.g., original, variable rate, pruned), revealing intriguing findings that challenge our current understanding of the strengths and limitations of NIC. Finally, we corroborate our empirical findings with theoretical analysis, providing an in-depth view of the OOD performance of NIC. Our benchmarks, spectral introspection tools, and findings provide a crucial bridge to the real-world adoption of NIC. We hope that our work will propel future efforts in designing more robust and generalizable NIC methods.

neural networks, Variational Autoencoder, robustne↗

DOE OSTI2025

Progress Towards the Validation of a new RELAP5-3D model of the High Temperature Test Facility

Validation is a key step in the development of any type of systems model. As the next generation of reactors approaches, the need for codes that have been validated for these new types of systems continues to grow. An example of a prominent option is the Reactor Excursion Leak Analysis Program (RELAP5-3D), developed by Idaho National Laboratory. This code was developed for the purpose of systems level thermal-hydraulic modeling of light water reactors (LWRS) and postulated transients that can occur in LWRS.RELAP5-3D has been substantially validated against LWR data. Due to its long history as a reactor safety analysis tool, there has been an effort to adapt RELAP5-3D for the purposes of advanced reactor concepts such as prismatic high-temperature gas-cooled reactors (HTGRs). However, RELAP5-3D has not nearly been validated and verified for HTGRs to the degree of LWRs, warranting verification and validation opportunities with computational benchmarks and existing experimental facilities. Examples of such facilities include the modular high-temperature gas-cooled reactor (MHTGR) 350 and the high temperature engineering test reactor (HTTR) from Japan. The MHTGR 350 is a benchmark design concept for code-to-code verification purposes; therefore, it does not provide any experimental data for validation opportunities The HTTR provides useful multiphysics validation data but does not have the in-core instruments to generate thermal-hydraulic experimental data to help with RELAP5-3D validation. Consequently, a facility that could provide key in-core temperatures for thermal-hydraulic validation was still needed. The High Temperature Test Facility (HTTF) is an integral effects facility for HTGR thermal hydraulics developed and operated by Oregon State University. HTTF represents ¼ length scale of the General Atomics MHTGR and is rated for a total power of 2.2 MW. Axially, the core consists of an upper and lower reflector and 10 blocks, numbered from bottom to top (Block 1 is right above lower reflector). The core is heated via graphite resistive heater rods, with respective channels distributed throughout the core. The primary coolant is helium and heat can radiate out of the core to the reactor cavity cooling system (RCCS), which is cooled by water. The primary purpose of the facility is to investigate pressurized conduction cooldown (PCC) and depressurized conduction cooldown (DCC) transients, which are also referred to as the pressurized and depressurized loss of forced cooling respectively. Two experiments were chosen to perform the validation study with a RELAP5-3D model of HTTF. These experiments are PG-27 (PCC) and PG-29 (DCC). These were chosen based off of the quality of available experimental data before and during the experiment which led to their inclusion in the HTGR Thermal Hydraulics Benchmark.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗