Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Code development and validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

A thermodynamics-based damage model for the non-linear mechanical behavior of SiC/SiC ceramic matrix composites in irradiation and thermal environments

A damage model is developed and validated with experimental data for the non-linear mechanical behavior of SiC/SiC composite materials in nuclear applications. Cyclic thermal and mechanical loading associated with neutron irradiation effects of these composites leads to wide-spread and progressive micro-cracking that leads to loss of thermal conductivity and further enhancement of thermo-mechanical damage. A physics-based model of wide-spread micro-cracking is developed within the thermodynamic framework of continuum damage mechanics. Evolution equations for damage parameters that describe the growth of continuum damage are developed, where the material variables are obtained from experiments. The model novelty is in coupling mechanical, thermal, and irradiation damage through a consistent thermodynamic framework, including loss of thermal conductivity due to the evolution of mechanically induced micro-cracks. A number of thermo-mechanical experiments were conducted to confirm model assumptions. The model is shown to be validated with out-of-pile experiments, and then implemented using commercial finite element code COMSOL to the fuel cladding problem with normal and high radiation dose cases.

Materials Science↗

3D CFD Model Validation Using Benchmark Data of 1/16th Scaled VHTR Upper Plenum and Development of Wall Heat-Transfer Correlation For Laminar Flow

With support from the U.S. Department of Energy-Office of Nuclear Energy’s (DOE-NE’s) Nuclear Energy Advanced Modeling and Simulation (NEAMS) program, an effort has been pursued to support high-temperature gas-cooled reactor (HTGR) technology development and its modeling and simulation needs. There is a particular need for advanced modeling and simulation tools to predict thermal-fluid behavior in the nuclear reactor primary system, especially in the core and the lower and upper plena, during safety-related transients. In this report, two main such activities are presented relevant to the HTGRs: (1) three-dimensional (3D) computational fluid dynamics (CFD) validation using benchmark data from the upper plenum of Texas A&M University’s 1/16th scaled very-high-temperature gas-cooled reactor (VHTR), and (2) development of wall heat-transfer correlation for laminar flow in a wall-heated pipe. The CFD tool validation exercises can be helpful to choose the models and CFD tools to simulate and design specific components of the HTRGs such as upper plenum where jet mixing is a complex phenomenon. In a loss of forced circulation event, the laminar flow can be observed during the development of natural circulation flow. This work includes the development and validation of heat transfer correlations for laminar flow using the Nek5000 CFD code due to limited available experimental data for laminar flow conditions to guide low-order models (1D). In this report, the flow characteristics of a single isothermal jet discharging into the upper plenum was investigated using the Nek5000 Large-Eddy Simulation (LES) CFD tool. Several numerical simulations were performed for various jet-discharged Reynolds numbers ranging from 3,413 to 12,819. A grid-independent study was performed. The numerical results of mean velocity, root-mean-square fluctuating velocity, and Reynolds stress were compared against the benchmark data. Good agreement was obtained between simulated and measured data for axial mean velocities, except near the upper plenum hemisphere. The maximum predicted errors for axial mean velocities at various normalized coolant channel diameter heights of 1, 5, and 10 are 1.56%, 1.88%, and 3.82%, respectively. In addition, the predicted root-mean-square fluctuating velocity and Reynolds stress are qualitatively in agreement with the experimental data. The Nek5000 code was used to develop wall-heat transfer correlation for laminar flow in a cylindrical tube. Several simulations were performed for various Reynolds flow and wall-heat fluxes. A new heat transfer correlation was developed using data from Nek5000 simulation results and regression functions in Matlab. The developed heat transfer correlation is valid for various Reynolds flows from 200 to 2000. The predicted R² value for model fit was 0.875, which ensures that 87.5% of the model data lies on the Nek5000 data. Moreover, a machine learning (ML) tool was used to train and test the Nek5000 data. A good fit of the ML-based model was observed with the test data.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

SFCOMPO Database of Spent Nuclear Fuel Assay Data – the Next Frontier

SFCOMPO is the world’s largest database for measured spent nuclear fuel assay data. An international effort coordinated by the Nuclear Energy Agency (NEA) resulted in a significant expansion of the database and its release online in 2017 as a downloadable application. The SFCOMPO Technical Review Group (TRG) was recently formed under the direction of NEA’s Nuclear Science Committee/Working Party on Nuclear Criticality Safety and was mandated to maintain and further coordinate the development of SFCOMPO. This TRG is currently focused on (1) critical evaluation of the experimental assay data by independent experts and (2) development of benchmarks and benchmark models that can be applied to validate burnup codes. This will improve the quality and documentation of the experimental datasets and enable their use by the international community to support code validation for design and safety analysis of spent nuclear fuel transportation, storage, and repository applications. It follows the precedent and draws on the experience gained from similar NEA efforts in the International Reactor Physics Experiment Evaluation Project and the International Criticality Safety Benchmark Experiment Project. Ongoing SFCOMPO evaluations have served as a test bed to develop templates for documenting evaluations, develop review guidance, improve approaches for a global uncertainty analysis, and devise a strategy focused on providing practical information of highest value to the user community. The current effort, status, and associated challenges are discussed.

Ilas, Germina↗

DRiFT - Release 2.1.0: Organic Scintillators and Gas Detectors

DRiFT (a Detector Response Function Toolkit) is LANL-developed software that post-processes output from the extensively validated radiation transport code, MCNP, and generates realistic nuclear instrumentation response. DRiFT is designed to be flexible, enabling users to specify detector type and many experimental settings, as well as accommodating the addition of their own desired features. The focus of this release is on organic scintillator, gas detector, and associated capabilities, while semiconductor features are still under development. Organic scintillators are widely used in the areas of nuclear safeguards and nuclear non-proliferation efforts. DRiFT has several diagnostic and detector physics features relevant to detailed scintillator simulations including: tracking source particle information, scintillation light production, the effects of PMT quantum efficiency and gain, and digitizer settings. Users can select responses from many scintillator and PMT types supported natively by DRiFT, or add their own by following the instructions in this document. DRiFT also has several diagnostic and detector physics features relevant to neutron gas detector simulations including: gas detector wall effects, inactive areas at the end of detector tubes, and effects of a preamplifier. We acknowledge that DRiFT is under active development, bug reports and general questions and comments should be directed to Madison Andrews, madison@lanl.gov. This manual is divided into four parts: I) An overview of DRiFT, including how to obtain and install the executable, II) A description of the detector physics related to scintillators available, III) a description of more general DRiFT features the user may find useful, and IV) a description of the test suite and examples made available with the code release.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Code Verification and Solution Verification framework in pin-resolved neutron transport code MPACT

Program verification in scientific computing encompasses the application of formal and mathematical techniques to a scientific computing code for its credibility, accuracy, and validity. Code Verification identifies bugs and performance issues in the software development stage. Solution Verification assesses the applicability of the code and the accuracy of the solution to problems of interest. Both activities utilize application cases and quantify the error against prescribed acceptance criteria. However, simply executing more application cases does not guarantee stronger or more comprehensive credibility. Here, we establish a verification framework that involves Code Verification and Solution Verification, both of which work together such that the overarching goal of “converge to the correct answer for the intended application” can be reasonably inferred. The application of such a verification framework is demonstrated using the pin-resolved neutron transport code MPACT, where standard unit tests and regression tests are covered, and where the Method of Exact Solutions and the Method of Manufactured Solutions are successfully used. Additionally, the applicability of Method of Manufactured Solutions is extended to the OECD/NEA C5G7 benchmark problems of practical material and geometric configurations. Solution Verification activities are demonstrated on a practical hierarchy of application models of increasing complexity ranging from 2D pin cell problems to 3D assembly problems. The convergence behavior and rate of convergence with respect to each individual variable are studied and provided. This framework can be adapted broadly to other fields involving scientific computing codes.

97 MATHEMATICS AND COMPUTING↗

Numerical studies on saturated kink and sawtooth induced fast ion transport in JET ITER-like plasmas

Here, this presentation examines the energetic particle transport induced by saturated kink modes and sawtooth crashes in JET deuterium plasmas. It is known that kink mode-resonant transport and phase-space redistribution from sawtooth crashes can drive strong fast ion transport with dependencies on particle pitch and energy. Measurements with JET's Faraday cup fast ion loss detector array have shown that the internal kink growth phase preceding sawtooth crashes produces substantial fast ion losses. This report will numerically investigate the dominant energetic particle transport mechanism with a detailed examination of the fast ion phase-space dependencies, resonances, orbit topology changes, induced losses, and redistribution associated with the long-lived, resonant, kink mode and non-resonant sawtooth crash. The ORBIT-kick model forms the basis of the transport studies with realistic fast ion distributions produced from TRANSP. A recently created reduced model for sawtooth induced transport is used while the saturated kink modes are modeled with ideal MHD codes. The simulations were further validated against experiment with a newly developed synthetic Faraday cup fast ion loss detector in addition to scintillator probe and neutron measurements.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

X-ray Source Characteristics from July 2020 SGEMP Experiments at the National Ignition Facility

This report details the measured x-ray characteristics radiating from laser targets on 7 shots at Lawrence Livermore National Laboratory's National Ignition Facility performed June 30 - July 2, 2020. Generally, the x-ray sources were designed to serve as meaningful drivers of a variety of Radiation Effects Sciences response experiments. Specifically, on these 7 shots, the measured x-ray output characteristics and the response experiments serve as a useful data set for validating performance and informing further development of Sandia National Laboratories' EMPIRE code. We present x-ray measurements and analyses relevant to simulating the System-Generated Electro Magnetic Pulse experiments that also occurred on these shots (described elsewhere). Sufficient detail is provided so that a motivated, but novice, x-ray source user could produce some of these analysis results from raw data on similar x-ray shots.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Development of a Comprehensive Two-Phase Flow Database for the Validation of NEK-2P

Three-dimensional (3-D) two-phase Computational Fluid Dynamics (CFD) codes are emerging as a powerful and potentially practical tool for applications in which detailed local flow information is needed. However, two-phase flow models and associated closure relations are not well established for CFD applications, which is partly due to the lack of high-quality validation data. The main objective of this work is to develop a comprehensive database of two-phase flows that can be used to validate two-phase CFD codes such as NEK-2P. In this project, four advanced local measurement systems, including Particle Image Velocimetry and Planar Laser-Induced Fluorescence (PIV-PLIF), high-speed imaging, x-ray densitometry, and multi-sensor conductivity probe are employed to measure the local two-phase flow parameters of both gas and liquid phases. By combining these techniques, the local void fraction, bubble velocity, interfacial area concentration, bubble frequency, liquid velocity, turbulence intensity, etc., in various two-phase flow regimes can be obtained. These local measurement techniques are first used in a 25.4 mm circular pipe test section. Seven air-water two-phase flow conditions spanning the bubbly, slug, churn-turbulent, and annular flow regimes are measured in this facility. The obtained database contains the radial profiles of both gas- and liquid-phase parameters at three axial locations along the test section. The second facility used in this work contains a 30 mm × 10 mm rectangular test section, in which three two-phase flow and two single-phase flow conditions are measured. Two-dimensional distributions of local two-phase flow parameters in the cross-sectional plane are measured in this facility at three axial locations as well. A facility featuring a 3×3 electrically heated rod bundle is also designed and being constructed in this project. This facility is specially designed for optical measurements and is expected to provide high-quality boiling data in the future. Preliminary analyses have been performed for the data taken in the 25.4 mm circular pipe. Both center-peaked and wall-peaked void fraction profiles have been observed in the data depending on the two-phase flow conditions and/or developing lengths. The 1-D drift-flux model was evaluated with the newly obtained datasets, in which both gas- and liquid-phases data were directly measured. The distribution parameter model has been optimized based on a new void-profile classification method proposed in this study. The optimized drift-flux model shows a significant improvement in predicting both gas velocity and void fraction. The measured liquid-phase turbulence was used to benchmark Sato’s turbulence model considering the bubble-induced shear stress for the three tested bubbly flows. The benchmark results showed good agreement between the PIV measurements and model predictions. In the bubbly flows tested that have low void fractions less than 3%, the effect of the bubble-induced turbulence was found not significant. However, the bubble-induced shear stress becomes important with the increase of the void fraction. The Conjugate Heat Transfer (CHT) model was developed and implemented in NEK-2P. This model allows the coupled simulation of the solid domain and two-phase fluid domain, allowing the specification of realistic boundary conditions. The CHT implementation was verified first with non-boiling simulations. The predicted temperatures in the fluid domain were shown to be identical in simulations with or without the CHT model. The CHT model was then validated through simulations of three Becker benchmark CHF tests performed under both Dryout (DO) and Departure from Nucleate Boiling (DNB) conditions. Reasonably good agreement was obtained between calculated wall temperatures and corresponding experimental data.

42 ENGINEERING↗

Development of Transmission Measurements Capability at VISION Spectrometer [Slides]

This presentation covers the development of transmission measurements capability at VISION Spectrometer. Main takeaways include that INS and transmission measurements are and should be the most significant part of TSL validation, as they are the fundamental quantities used by Monte Carlo neutronics codes. Additionally, the development of transmission capability at VISION instrument has commenced. Promising first results have been obtained with a big impact by the use of the collimators. Finally, Areas of improvement have been identified and new measurements are planned for June.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Macro-micro multiscale modeling to assist the design of HPDC Al castings microstructure and alloys for EV super-large body structures (Phase 1)

Implementation of High Pressure Die Casting (HPDC) Aluminum (Al) body structures for high volume electrified vehicles (EV) to improve electric efficiency remains a key strategy within many original equipment manufacturer (OEM)s. In addition to high strength for safety requirements, superior Self-Piercing Riveting (SPR) performance is demanded for HPDC Al alloys to be compatible with high volume SPR joining. In this work, it is proposed to extend and validate an existing Contractor finite element multiscale macro-micro modeling approach to quantify the influence of the microstructure of HPDC alloys on the fracture strain/displacement under 3-point bend and clinch testing. The success of this work will allow to replace solution treatment stage with low energy consumption heat treatment (HT) processes, or to design new non heat treatable (NHT) HPDC Al alloys to eliminate HT requirements. Ultimately, this project will facilitate the application of HPDC Al alloys for super-large vehicle structures to significantly reduce vehicle weight, and thus improving energy efficiency. The purpose of this project is to extend and validate an existing finite element code, which is based on the Contractor developed macro-micro multi-scale modeling approach, to numerically simulate the three-point bending and clinch test and study the influences of material microstructural characteristics and phase properties on the rivetability. The macro-micro modeling approach begins with a sample scale model and identify the location, which is mostly prone to failure, the deformation history of the boundaries of that location calculated will be used to drive a microstructure-based sub-models where the material microstructure and microscale properties are considered. Using this approach, the wrap-bending failure for two Al alloys are correctly predicted for the first time. This will start with phase I effort of building a framework of macro-micro three point bending test and clinch test of Al10SiMgMn HPDC alloy in the as-cast and T7 heat treated conditions. Those results will then be validated with experimental test results. The phase II effort will involve the utilization of the knowledge learned in phase I to establish the quantitative correlation between the microstructure characteristics and the riveting performance, which will be further used to guide the optimization of HPDC Al alloy microstructure using heat treatment process to achieve sufficient rivetability to join large thin-wall HPDC alloys.

36 MATERIALS SCIENCE↗

Ongoing Data Platform Development for High-Temperature Gas-cooled Reactor (HTGR) Thermal-Fluid Experiments Supported by Nuclear Energy University Program (NEUP) [Presentation Slides]

There are in total 30NEUP projects focusing on the thermal-fluid experiments related with High-Temperature Gas-cooled Reactor (HTGR) from FY2009 to FY2021, producing a large amount of high-quality validation data, however, these valuable data has been scattering everywhere and not been disseminated to the community well, and final reports are available only from OSTI webpage. This could potentially be a huge waste, not only for government budget but also for the HTGR research community. To improve access to this HTGR validation data and optimize the return on the significant investment made by DOE and supported by the Advanced Reactor Technologies (ART) Gas-Cooled Reactor (GCR) program, we conducted a survey to assess completed and ongoing HTGR NEUP projects with the aim to develop a public-access data platform that can be used to retrieve code validation data and guide future NEUP investments.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

IEEE 1547-2018 Based Interoperable PV Inverter with Advanced Grid-Support Functions

Grid integration of photovoltaic (PV) inverters has been increasing in the past decade. As a result of the uncertainties introduced with high penetrations of PV, better monitoring and control of the PV inverters becomes crucial for improving overall system stability. This paper focuses on the communications capability of the inverter controller and on enabling interoperability. Multiple standards are available to enable interoperability in PV inverters. In this paper, an interoperable controller, enabled by Distributed Network Protocol 3 (DNP3) communications protocols, is developed for a grid-connected, three-phase PV inverter. The DNP3 server for the PV inverter is programmed on the real-time layer of the field-programmable gate array (FPGA)-based inverter controller. Set points for advanced inverter control functions, such as volt/VAr curves, ride-through curves, are sent from a DNP3 client, a simulated distribution management system application, to the PV inverter through DNP3. This communications capability of the inverter controller is validated using a controller-hardware-in-the-loop experimental setup. The code developed to achieve the interoperability is available in the public domain through open-source software licensing. This interoperability will enable smoother grid integration of smart PV inverters with advanced grid-support functions as well as allow better monitoring and control of PV inverters for grid stability.

14 SOLAR ENERGY↗

Multiphysics Simulation of the NASA SIRIUS-CAL Fuel Experiment in the Transient Test Reactor Using Griffin

After approximately 50 years, NASA is restarting efforts to develop nuclear thermal propulsion (NTP) for interplanetary missions. Building upon nuclear engine tests performed from the late 1950s to the early 1970s, the present research and testing focuses on advanced materials and fabrication methods. A number of transient tests have been performed to evaluate materials performance under high-temperature, high-flux conditions, with several more experiments in the pipeline for future testing. The measured data obtained from those tests are being used to validate the Griffin reactor multiphysics code for this particular type of application. Griffin was developed at Idaho National Laboratory (INL) using the MOOSE framework. This article describes the simulation results of the SIRIUS-CAL calibration experiment in the Transient Reactor Test Facility (TREAT). SIRIUS-CAL was the first transient test conducted on NASA fuels, and although the test was performed with a relatively low core peak power, the test specimen survived a temperature exceeding 900 K. Griffin simulations of the experiment successfully matched the reactor’s power transient after calibrating the initial control rod position to match the initial reactor period. The thermal-hydraulics model largely matches the time-dependent response of a thermocouple located within the experiment specimen to within the uncertainty estimate. However, the uncertainty range is significant and must be reduced in the future.

33 ADVANCED PROPULSION SYSTEMS↗

Review of Experimental Data for Validating Computer Codes Used in Shielding Calculations for Spent Fuel Storage and Transportation Systems

This report presents a review of available radiochemical assay data and shielding benchmarks applicable to spent nuclear fuel (SNF) shielding calculations. The relevant information reviewed herein includes the Spent Fuel Composition (SFCOMPO) database, the Shielding Integral Benchmark Archive and Database (SINBAD), the International Handbook of Evaluated Criticality Safety Benchmark Experiments, and published measurements of external dose rates of casks loaded with SNF. The relevant experimental data identified in this report may be used to support verification and validation of computer codes used in SNF cask/transport shielding applications, as well as development of calculation uncertainties. It should be noted that a relatively small subset of the identified experimental data (e.g., criticality alarm experiments) is available in a standard format established by the international community participating in experimental isotopic and shielding data evaluations. An effort of the SFCOMPO Technical Review Group (TRG) is underway to publish first isotopic evaluations of individual assay data using a standard data evaluation format. The SINBAD TRG has recently initiated benchmark evaluations and modernization of the database. Therefore, more relevant information is expected in the future that will enable users to select quality experimental data in depletion code and shielding code validations for SNF applications.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Validation of the SCEPTRE Boltzmann-CSD Solver

A new Boltzmann-CSD solver has been developed within the SCEPTRE radiation-transport code, based on the 1st-order form of the transport equation, using discontinuous finite elements in space and energy and discrete ordinates in angle. The Boltzmann-CSD solver has been validated against experimental data for electron energy deposition distributions and for electron emission spectra. Comparison of the calculated results with experimental data shows excellent agreement for many of the test configurations and reasonable agreement for other test configurations. The tests have also been modeled with the ITS Monte Carlo code, which also shows excellent to reasonable agreement with the SCEPTRE results and experimental data. The SCEPTRE Boltzmann-CSD solver relies on electron cross sections generated by the legacy CEPXS code, which currently is limited to electron-only Boltzmann-CSD cross sections. Performing full electron-photon radiation transport with the Boltzmann-CSD solver will require further development in the cross section generating code. For the energy- deposition calculations, neglecting photon transport results in at most about 5% overprediction of the energy deposition for high-energy electrons on high-Z targets, and relatively insignificant difference for the other test configurations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

High-Temperature Gas-Cooled Reactors Multiphysics Simulation Demonstration and Code Validation

This study presents a comprehensive benchmarking and verification effort of several thermal-hydraulic and multiphysics capabilities for high-temperature gas-cooled reactor applications. The first part of this effort focuses on the running-in verification of Griffin’s multiphysics capabilities, specifically for simulating the evolution of pebble-bed reactor cores from startup to equilibrium. Since Fiscal Year 2024, improvements and enhancements have been implemented in Griffin, including simplifying the process to specify streamlines and developing the online cross-section generation capability. In the absence of validation data, code-to-code comparisons are conducted with kugelpy, showing good agreement for integral quantities like k-eff predictions and predictions for maximum power density. However, accuracy issues are noted for more detailed quantities like the spatial distribution of fission rate densities which will require further work to address. The second part of this report presents an improved System Analysis Module (SAM) core channel model where the effects of cross flow are considered during the pressurized loss of forced cooling transient, resulting in an improved agreement of the predicted pebble temperature with respect to the predictions from the SAM 2D porous media model. Additionally, the wall channeling effect due to variable porosity at the near wall region of the core is also investigated. Furthermore, to demonstrate Griffin’s online cross-section generation capability, a Multiphysics simulation is performed by coupling Griffin to the SAM core channel model. In the third part of the report, as a part of the Organisation for Economic Co-operation and Development/Nuclear Energy Agency (OECD/NEA) thermal-hydraulic code validation benchmark activity for a high-temperature gas-cooled reactor, the High Temperature Test Facility (HTTF) is investigated first using the NekRS computational fluid dynamics (CFD) code to study the flow mixing phenomenon in the lower plenum of the facility. Then, code-to-code and code-to-data comparisons are performed for Test PG27, which is a pressurized conduction cooldown (PCC) test, using five different codes by six organizations from five countries. The different simulations show good agreements in terms of the general trend but there are differences in some results such as the peak temperatures of different regions and heat removal rate.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

SAM: A Modern System Code for Advanced Non-LWR Safety Analysis

The System Analysis Module (SAM), developed at Argonne National Laboratory and by collaborators at other organizations, is for advanced non–light water reactor safety analysis. SAM aims to provide fast-running, modest-fidelity, whole-plant transient analysis capabilities that are essential for fast-turnaround design scoping and engineering analyses of advanced reactor concepts. To facilitate code development, SAM utilizes the MOOSE object-oriented application framework, its underlying finite element library, and linear and nonlinear solvers to leverage modern advanced software environments and numerical methods. SAM aims to solve tightly coupled physical phenomena, including fission reaction, heat transfer, fluid dynamics, and thermal-mechanical responses in advanced reactor structures, systems, and components with high accuracy and efficiency. Finally, this paper gives an overview of the SAM code development, including goals and functional requirements, physical models, current capabilities, verification and validation, software quality assurance, and examples of simulations for advanced nuclear reactor applications.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

The Sensitivity of GPz Estimates of Photo-z Posterior PDFs to Realistically Complex Training Set Imperfections

The accurate estimation of photometric redshifts is crucial to many upcoming galaxy surveys, for example, the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST). Almost all Rubin extragalactic and cosmological science requires accurate and precise calculation of photometric redshifts; many diverse approaches to this problem are currently in the process of being developed, validated, and tested. In this work, we use the photometric redshift code GPz to examine two realistically complex training set imperfections scenarios for machine learning based photometric redshift calculation: (i) where the spectroscopic training set has a very different distribution in color–magnitude space to the test set, and (ii) where the effect of emission line confusion causes a fraction of the training spectroscopic sample to not have the true redshift. By evaluating the sensitivity of GPz to a range of increasingly severe imperfections, with a range of metrics (both of photo-z point estimates as well as posterior probability distribution functions, PDFs), we quantify the degree to which predictions get worse with higher degrees of degradation. In particular, we find that there is a substantial drop-off in photo-z quality when line-confusion goes above ~1%, and sample incompleteness below a redshift of 1.5, for an experimental setup using data from the Buzzard Flock synthetic sky catalogs.

79 ASTRONOMY AND ASTROPHYSICS↗