Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Virtual Test Bed”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Documentation on How to Run the NEAMS Workbench GUI on Sawtooth

This document provides guidelines on how to run Moose-based applications from the NEAMS WorkbenchGUI on the HPC platform Sawtooth located at Idaho National Laboratory. The different steps are illustrated with a multi-app example modeling a sodium-cooled fast reactor (SFR) taken from the virtual test bed (VTB) website. The workflow consists of four steps to demonstrate the capabilities of the NEAMS Workbench GUI, that covers log into Sawtooth, editing and validating input files, submission of the job to the queue and visualization of the numerical solution and the geometry. Each step is illustrated with figures in the text, and a demonstration video is also available.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

High-fidelity multiphysics load following and accidental transient modeling of microreactors using NEAMS tools: Application of NEAMS codes to perform multiphysics modeling analyses of micro-reactor concepts

The feasibility of modeling microreactors using high-fidelity models with the Nuclear Energy Advanced Modeling and Simulation (NEAMS) tools is investigated in this report. Three overarching questions guided this research: can NEAMS tools readily be applied for high-fidelity multiphysics modeling of different types of transients in microreactor designs; how accurate are the results obtained; and are improvements needed in accuracy or user experience of NEAMS tools, especially considering newly developed capabilities? This work builds upon FY-2022 work, and two microreactor concepts considering heat pipe (HP-MR) and gas-cooled (GC-MR) technologies were further analyzed using high-fidelity multiphysics simulations. The NEAMS tools considered and coupled within the MultiApp environment are Griffin for neutronics, BISON for thermo-mechanics, Sockeye for heat pipe modeling (in HP-MR), SAM for 1D Fluid – 3D solid modeling of coolant channels and system modeling of balance of plant components (in GC-MR), and the SWIFT code for hydrogen redistribution in hydride moderator. The Heat Pipe MicroReactor (HP-MR) concept was further analyzed in FY-2023 to demonstrate the stochastic TRISO failure modeling capability in BISON to check operational limits of the TRISO fuel. A new full-core Gas-Cooled MicroReactor (GC-MR) model was developed based on the initial assembly-model used in Y-2022 and used for steady-state and accidental depressurization transient simulations. Accuracy of the simulations performed was assessed through 1) verification analyses completed on the different physics with code-to-code comparison, and 2) validation of the multiphysics simulations based on modeling of the Kilopower Reactor Using Stirling Technology (KRUSTY) experiment. In FY-2023, the mesh and model of KRUSTY was updated to closely match publicly available data, and the neutronic model was verified and validated against experimental control rod worth measurements. The multiphysics model of KRUSTY was developed and used for steady-state analysis and for modeling reactivity insertion transient. The calculated power increase and stabilization agrees well with experimental data following adjustment in fuel thermal expansion coefficient. As an important component of this project, the ANL team gathered experience with a wide range of NEAMS tools: the MOOSE Mesh System, Griffin, BISON, SWIFT, Sockeye, SAM, Workbench, and the MOOSE MultiApp System, and provided assessment of new capabilities. Noteworthy are the user assessment of the “vapor-only” flow model in Sockeye and development of a multiphysics startup transient in HP-MR unit cell for use as tutorial in Sockeye. The full-core GC-MR model was used for assessment of SAM for balance of plant modeling and for demonstrating the SWIFT code capability for hydrogen redistribution modeling in multiphysics transient analyses. In this process, several bugs/issues were identified and reported to developers. Finally, the assembly GC-MR model developed in FY-2022 coupling Griffin, BISON and SAM through flow blockage and rod ejection transients was published to the National Reactor Innovation Center (NRIC) Virtual Test Bed (VTB). The Heat Pipe MicroReactor (HP-MR) concept high-fidelity multiphysics coupling of Griffin/BISON/Sockeye in load-following and heat pipe failure transients was also published on the VTB. Those submissions are enabling thorough review of these models as well as wide distribution to industry, regulator, and university users. In this analysis, several new research questions were uncovered, and follow-up analyses are recommended to further improve some models, consider additional transients, and continue development of VTB models.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

BISON Fuel Fragmentation Relocation and Dispersal (FFRD) Assessment Database for Eventual Use in Bayesian Calibration

Existing light-water reactor (LWR) fuel vendors have been interested in seeking increased discharge burnups of nuclear fuel rods for improved economics for quite a few years. With increased burnups come additional challenges that must be addressed. It has been experimentally observed that average burnups higher than the current regulatory limit of 62 MWd/kgU may undergo fuel fragmentation, relocation, and dispersal (FFRD) during a loss-of-coolant accident (LOCA). Industry must demonstrate approaches to mitigate FFRD. In an effort to support industry, the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program within the U.S. Department of Energy (DOE) has for several years invested in developing multiscale models and creating a validation/assessment database for these models to study the mechanisms driving FFRD. This report provides an update on changes made to the assessment database and new models added to BISON to support the study of fuel rod behavior during FFRD. An effort has been initiated this year to begin adding dedicated inputs to the publicly available Virtual Test Bed (VTB) repository for industry use. A section of this report details the efforts made in this area. NEAMS has recently developed new capabilities in the Multiphysics Object-Oriented Simulation Environment (MOOSE) framework’s stochastic tools module for calibration using Bayesian inference. The goal in the future is to use these capabilities to calibrate and identify weaknesses in the existing BISON models for FFRD. The report concludes with a discussion on the models most likely to benefit the most from such calibration.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Assessment and validation of NEAMS tools for high-fidelity multiphysics transient modeling of microreactors: Application of NEAMS codes to perform multiphysics modeling analyses of micro-reactor concepts

The NEAMS Multiphysics Applications team aims at providing assessment of code useability and functionality for microreactor design and analyses, together with demonstration of their capabilities to properly capture the steady-state and time-dependent behavior of different microreactor concepts. In FY-24, significant progress was achieved in improving multi-physics models of several microreactors systems: HP-MR, GC-MR and KRUSTY. These efforts focused on solving more complex multiphysics problems enabled by enhanced tools capability, verifying and validating results obtained, providing feedback to developers for suggested improvements, and sharing these models to facilitate user training. A series of new multiphysics transients were completed on the HP-MR (using Griffin/BISON/Sockeye) with core startup transient, control drum inadvertent rotation accident, and hydrogen leakage from hydride moderator (also including SWIFT). On the GC-MR, a new full-core model was developed and analyzed through a series of new multiphysics (Griffin/BISON/SAM) transients to simulate moderator leakage (also including SWIFT), flow blockage and coolant depressurization. Additional and updated TRISO failure analyses were completed on the HP-MR unit-cell and GC-MR assembly models leveraging improved TRISO modeling capabilities. The amount of SiC failure following accidental transients at end-of-life was null. However, GC-MR assembly TRISO analysis highlighted Pd penetration rate can be problematic and may require design changes on the studied microreactor concept. The neutronics discrepancies observed on the KRUSTY model in previous years were resolved using hybrid set of Monte Carlo/Deterministic cross-sections. The multiphysics (Griffin neutronics / BISON thermal-mechanics) 15₵ insertion transient simulation displayed good agreement when comparing with experimental data. Initial modeling of the 30 ₵ reactivity insertion also displays promising results. Such close agreement provides important validation data that can be leveraged by the NEAMS program and by microreactor vendors to support licensing of their technology. Finally, important experience was gathered with the NEAMS tools leading to several user feedback shared with tools developers, especially with regards to MOOSE mesh generator and Griffin. This project led to many publications demonstrating modeling capabilities, and to three models shared on the Virtual Test Bed.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Multiphysics Modeling of Microreactors with NEAMS codes, and Validation Based on KRUSTY Reactivity Insertion

The NEAMS Multiphysics Applications team continues to assess code usability and functionality for microreactor design and safety analyses, while demonstrating that NEAMS tools capture both steady-state and transient behavior across distinct microreactor concepts. In FY2025, the team advanced full-core, high-fidelity, multiphysics models that solve more complex problems and strengthen verification/validation for several microreactor systems: heat-pipe microreactor (HPMR), gas-cooled microreactor (GCMR), and the KRUSTY experiment. These models employ the MOOSE MultiApp/Transfers architecture with Griffin for neutronics, BISON for heat conduction/thermomechanics, Sockeye for heat pipes, SAM/THM for coolant channels and loops, and SWIFT for hydride behavior, with meshes generated via the MOOSE Reactor Module. The graphite models available in the Grizzly code were also investigated for future analyses. For the HPMR, a Na-HPMR variant was constructed to align with recently validated heat-pipe experiments and Sockeye’s LCVF capability, enabling mechanistic heat-pipe transients and startup modeling. The Na-HPMR will serve as the primary model for HPMR investigations in upcoming tasks. The load-following and single heat-pipe failure scenarios (Griffin/BISON/Sockeye), which were previously modeled for the K-HPMR, were replicated for the Na-HPMR, showing strong negative temperature feedback and highly localized thermal effects, respectively, while the startup case captured vapor-front progression and heat-removal activation. Solid mechanics was added to the previously built K-HPMR full-core model in BISON, showing minimal impact on steady-state reactivity yet enabling stress-field predictions that prepare the path for full-core TRISO performance analyses. For the GCMR, automated steady-state and four transient scenarios were executed using Griffin/BISON/SAM/SWIFT. Results confirm robust inherent safety: power collapses promptly in loss-of-cooling events, the inlet-temperature drop settles to a new equilibrium, and a single-channel blockage yields only a ~30 K local fuel-temperature rise with <0.4% power decrease. SWIFT-predicted hydrogen redistribution affects reactivity during both steady-state and transient conditions, underscoring its importance. A Brayton-cycle balance of plant (BOP) model in SAM/THM demonstrated stable startup behavior, and xenon-driven reactivity during load following was analyzed. To improve TRISO-compact temperature fidelity, a fast multiscale Heat Source Decomposition (HSD) treatment was implemented. Against heterogeneous benchmarks, HSD reduces underprediction of kernel temperatures and lowers predicted peak powers in reactivity-insertion transients compared to previous homogenized models. KRUSTY warm-critical validation progressed from FY2024 baselines: the 15Ȼ insertion shows excellent agreement in peak power (~2% high) and temperature trends, and the 30Ȼ case was automated via a feedback controller that maintained power near 3 kW for ~150 s with close agreement to data. The successful modeling of the warm critical tests has laid a strong foundation for simulating more complex nuclear system tests in the years ahead. Throughout FY2025, developer feedback was provided (e.g., MOOSE batch mesh generation, distributed pre-split meshes, Griffin sweeper on displaced meshes), several new models were contributed to the Virtual Test Bed, and an OECD-NEA WPRS multiphysics benchmark based on the HPMR was initiated to enable broader cross-comparison and best-practice development with the nuclear community at large.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Web-based Weather Expert System (WES) for Space Shuttle Launch

The Web-based Weather Expert System (WES) is a critical module of the Virtual Test Bed development to support 'go/no go' decisions for Space Shuttle operations in the Intelligent Launch and Range Operations program of NASA. The weather rules characterize certain aspects of the environment related to the launching or landing site, the time of the day or night, the pad or runway conditions, the mission durations, the runway equipment and landing type. Expert system rules are derived from weather contingency rules, which were developed over years by NASA. Backward chaining, a goal-directed inference method is adopted, because a particular consequence or goal clause is evaluated first, and then chained backward through the rules. Once a rule is satisfied or true, then that particular rule is fired and the decision is expressed. The expert system is continuously verifying the rules against the past one-hour weather conditions and the decisions are made. The normal procedure of operations requires a formal pre-launch weather briefing held on Launch minus 1 day, which is a specific weather briefing for all areas of Space Shuttle launch operations. In this paper, the Web-based Weather Expert System of the Intelligent Launch and range Operations program is presented.

Bardina, Jorge E.↗

Business Intelligence Modeling in Launch Operations

This technology project is to advance an integrated Planning and Management Simulation Model for evaluation of risks, costs, and reliability of launch systems from Earth to Orbit for Space Exploration. The approach builds on research done in the NASA ARC/KSC developed Virtual Test Bed (VTB) to integrate architectural, operations process, and mission simulations for the purpose of evaluating enterprise level strategies to reduce cost, improve systems operability, and reduce mission risks. The objectives are to understand the interdependency of architecture and process on recurring launch cost of operations, provide management a tool for assessing systems safety and dependability versus cost, and leverage lessons learned and empirical models from Shuttle and International Space Station to validate models applied to Exploration. The systems-of-systems concept is built to balance the conflicting objectives of safety, reliability, and process strategy in order to achieve long term sustainability. A planning and analysis test bed is needed for evaluation of enterprise level options and strategies for transit and launch systems as well as surface and orbital systems. This environment can also support agency simulation .based acquisition process objectives. The technology development approach is based on the collaborative effort set forth in the VTB's integrating operations. process models, systems and environment models, and cost models as a comprehensive disciplined enterprise analysis environment. Significant emphasis is being placed on adapting root cause from existing Shuttle operations to exploration. Technical challenges include cost model validation, integration of parametric models with discrete event process and systems simulations. and large-scale simulation integration. The enterprise architecture is required for coherent integration of systems models. It will also require a plan for evolution over the life of the program. The proposed technology will produce long-term benefits in support of the NASA objectives for simulation based acquisition, will improve the ability to assess architectural options verses safety/risk for future exploration systems, and will facilitate incorporation of operability as a systems design consideration, reducing overall life cycle cost for future systems. The future of business intelligence of space exploration will focus on the intelligent system-of-systems real-time enterprise. In present business intelligence, a number of technologies that are most relevant to space exploration are experiencing the greatest change. Emerging patterns of set of processes rather than organizational units leading to end-to-end automation is becoming a major objective of enterprise information technology. The cost element is a leading factor of future exploration systems.

Bardina, Jorge E.↗

Distributed Web-Based Expert System for Launch Operations

The simulation and modeling of launch operations is based on a representation of the organization of the operations suitable to experiment of the physical, procedural, software, hardware and psychological aspects of space flight operations. The virtual test bed consists of a weather expert system to advice on the effect of weather to the launch operations. It also simulates toxic gas dispersion model, and the risk impact on human health. Since all modeling and simulation is based on the internet, it could reduce the cost of operations of launch and range safety by conducting extensive research before a particular launch. Each model has an independent decision making module to derive the best decision for launch.

Bardina, Jorge E.↗

Assembling Multiphysics Nuclear Reactor Simulations Using the MOOSE Framework

The Multiphysics Object Oriented Simulation Environment (MOOSE) [1] is an open-source, parallel finite element framework which provides the foundation for many advanced modeling and simulation tools developed under the Department of Energy (DOE) Nuclear Energy Advanced Modeling and Simulation (NEAMS) Program [2] for the analysis of advanced reactors. The MOOSE framework provides the common foundational capability on which many NEAMS codes for reactor analysis are built. The MOOSE framework also includes several systems to assemble unique workflows and couplingamong MOOSE-based applications. In particular, the MultiApp and Transfer Systems are widely used to assemble different MOOSE-based or MOOSE-wrapped physics applications together to perform loosely or tightly coupled multiphysics simulations. The National Reactor Innovation Center (NRIC) Virtual Test Bed (VTB) [3] hosts publicly available nuclear reactor multiphysics simulation examples which leverage MOOSE’s MultiApp System to meet the modeling needs of different reactor types. The flexibility and robustness of coupling provided by MOOSE permits rapid development of coupled physics models for a wide range of reactor types and events

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

MOOSE: A Modular Platform for Fission and Fusion Multiphysics

The Multiphysics Object-Oriented Simulation Environment (MOOSE) Framework, as well as MOOSE-based simulation tools, have accelerated the development of fission energy and advanced reactor technologies through the United States Department of Energy, Office of Nuclear Science, Nuclear Energy Advanced Modeling & Simulation (NEAMS) Program. MOOSE contains a complete platform of multiphysics simulation capabilities, capable of running on massively parallel systems, and is developed in an open-source manner with great attention paid to high-quality software quality assurance practices. This overall approach could greatly benefit the fusion energy community, which requires rapid design iteration and improvement in order to facilitate the successful development of fusion as an alternative energy source to fossil fuels. In the first half of this talk, applications of MOOSE and MOOSE-based tools for advanced reactor designs will be showcased, as well as MOOSE ecosystem infrastructure (such as the NEAMS Virtual Test Bed) that enables and accelerates fission reactor design. In the second half, a discussion of how the MOOSE approach to modeling and simulation is currently being applied internationally in fusion energy research and development at the United Kingdom Atomic Energy Authority will be discussed, and ongoing/future domestic research efforts will be highlighted.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Multiphysics Demonstration of Temperature-Driven Assembly Bowing in SFRs using MOOSE-Based Codes

Core bowing is an important passive safety mechanism in liquid metal cooled fast reactors. When the core restraint system is properly designed, temperature and flux gradients influence assemblies in the core to bow into less reactive configurations during accident scenarios, resulting in negative reactivity feedback. Prediction of core bowing involves complex interplay of radiation transport, impacts of fluid flow and heat transfer on duct temperature, and mechanical responses to the induced temperature and flux gradients. Under the U.S. Department of Energy Office of Nuclear Energy’s Advanced Modeling and Simulation (NEAMS) Program [1], an integrated multiphysics approach is being developed to model the core bowing phenomena in liquid metal-cooled fast reactors with the Multiphysics Object Oriented Simulation Environment (MOOSE) [2]. In this methodology, the MOOSE-based reactor physics code Griffin [3] will solve the neutron transport equation and determine the power distribution. With the detailed power distribution from Griffin, the subchannel analysis codes MOOSE-Subchannel [4] and Pronghorn [5] are utilized to calculate the assembly temperature distribution. MOOSE’s Solid Mechanics [6] and Contact [7] Modules are leveraged to calculate the thermal expansion and duct bowing displacement with the duct wall temperature from thermal hydraulics calculation. In this work, an initial one-way coupling demonstration of the integrated multiphysics approach has been performed on a seven-assembly problem based on the sodium-cooled fast reactor ABR-1000 design [8]. The neutronics calculation with Griffin is not yet involved in the current simulation. MOOSE-Subchannel and Pronghorn evaluate fluid and solid temperature based on a fixed power distribution. In addition, one-way coupling is utilized in this coupled calculation, via Pronghorn passing the duct temperature data to the MOOSE Solid Mechanics calculation. An assessment of the Solid Mechanics module was performed in parallel to verify duct bowing behavior with duct-to-duct contact phenomenon [9]. The displacement from MOOSE Solid Mechanics is not yet transferred back and utilized in the Pronghorn and MOOSE-Subchannel calculation. This model will be available on the National Reactor Innovation Center (NRIC) Virtual Test Bed (VTB) repository [10]. Future stages of this work will involve solving problems of increasing complexity as well as adding more physics (e.g. reactor physics) to the integrated workflow to reach the end goal of modeling the core bowing phenomenon with an integrated multiphysics workflow.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Demonstration and Verification of Thermo-Mechanical Bowing in a Limited Free-Bow SFR Concept Using MOOSE

Core bowing due to thermal gradients and irradiation induced swelling and creep introduces significant reactivity feedback effects in liquid metal-cooled fast spectrum reactors. During startup, normal operations, and transient events, differential thermal and flux gradients cause expansion, creep, and swelling, which results in bowing in preferential directions depending on local material properties and load-pad and restraint-ring design. The bowing phenomenon produces negative reactivity during accident conditions provided the restraint system has been properly designed to optimally guide the deformation outwards in the active core region. Under the Department of Energy Nuclear Energy Advanced Modeling and Simulation program, a Multiphysics Object Oriented Simulation Environment (MOOSE)-based multiphysics approach to model core bowing is being developed. The present work expands on previous modeling of simpler International Atomic Energy Agency (IAEA) verification problems with these tools by modeling IAEA Verification Problem 4, which involves a symmetric sector of a reactor core with ducted assemblies undergoing differential thermal expansion due to thermal gradients bowing outward with duct-to-duct contact. This model is available on the National Reactor Innovation Center Virtual Test Bed repository. This example was verified against benchmark participant results, which includes bowing deformation evaluation and duct-to-duct interactions at load pads with mechanical contact.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

The MPACT 2020 Milestone: Safeguards and Security by Design of Future Nuclear Fuel Cycle Facilities.

The Materials Protection, Accounting, and Control Technologies (MPACT) campaign, within the U.S. Department of Energy Office of Nuclear Energy, has developed a Virtual Facility Distributed Test Bed for safeguards and security design for future nuclear fuel cycle facilities. The purpose of the Virtual Test Bed is to bring together experimental and modeling capabilities across the U.S. national laboratory and university complex to provide a one-stop-shop for advanced Safeguards and Security by Design (SSBD). Experimental testing alone of safeguards and security technologies would be cost prohibitive, but testbeds and laboratory processing facilities with safeguards measurement opportunities, coupled with modeling and simulation, provide the ability to generate modern, efficient safeguards and security systems for new facilities. This Virtual Test Bed concept has been demonstrated using a generic electrochemical reprocessing facility as an example, but the concept can be extended to other facilities. While much of the recent work in the MPACT program has focused on electrochemical safeguards and security technologies, the laboratory capabilities have been applied to other facilities in the past (including aqueous reprocessing, fuel fabrication, and molten salt reactors as examples). This paper provides an overview of the Virtual Test Bed concept, a description of the design process, and a baseline safeguards and security design for the example facility. Parallel papers in this issue go into more detail on the various technologies, experimental testing, modeling capabilities, and performance testing.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Material Protection, Accounting and Control Technologies (MPACT) Implementation Plan: Lab-Scale Demonstration of Advanced Safeguard and Security Systems

The Materials Protection, Accounting, and Control Technologies (MPACT) campaign is working towards the goal of developing and demonstrating the next generation of nuclear materials management for the peaceful use of civilian nuclear energy. A major milestone of the campaign is the “Lab-scale demonstration of an advanced safeguards and security system,” due in 2020. This implementation plan describes how tools developed in the MPACT campaign will be used to meet this milestone. These tools consist of instrumentation and devices as well as computer software for modelling, simulation and integration of data and information for safeguard and security analysis. The plan is focused on demonstrating an advanced safeguard and security systems for electrochemical processing plants, but also identifies activities needed to address advanced reactor, aqueous processing and other advanced fuel cycle facilities. A key component to achieving the 2020 milestone is the development of a virtual distributed test bed that incorporates the instruments, data, analysis tools, and models currently under development and provides a framework to link and normalize the data in a way that simulates a facility, including uncertainty quantification. This virtual distributed test bed will integrate computer simulated facilities that make up a fuel cycle of interest, with distributed test beds located in actual operating facilities and laboratories. The MPACT campaign recently issued roadmaps for both Modelling & Simulation and Advanced Integration which address this component, and activities necessary to achieve the 2020 milestone. Research, development and testing of specific technologies have been supported by the MPACT campaign in coordination with other DOE-NE and DOE-NNSA programs. These technologies provide the essential data needed by the safeguard and security systems, and feed into the data analysis and facility models. This plan will identify these technologies, their current status and activities needed to demonstrate the technologies at the laboratory scale. Wherever possible, test of technologies in field conditions using suitable nuclear materials will be used to define performance. Where necessary, surrogate materials and/or simulation will be used to provide useful information for the demonstration. When completed, the 2020 milestone will provide a demonstration of advanced safeguard and security technologies, including advanced modelling, simulation and analysis approaches, applied to electrochemical processing. It will also identify applications of the technology and approaches in other advanced fuel cycle and reactor concepts.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

The Ground Truth Program: Simulations as Test Beds for Social Science Research Methods.

Social systems are uniquely complex and difficult to study, but understanding them is vital to solving the world’s problems. The Ground Truth program developed a new way of testing the research methods that attempt to understand and leverage the Human Domain and its associated complexities. The program developed simulations of social systems as virtual world test beds. Not only were these simulations able to produce data on future states of the system under various circumstances and scenarios, but their causal ground truth was also explicitly known. Research teams studied these virtual worlds, facilitating deep validation of causal inference, prediction, and prescription methods. The Ground Truth program model provides a way to test and validate research methods to an extent previously impossible, and to study the intricacies and interactions of different components of research.

97 MATHEMATICS AND COMPUTING↗