Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “games”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 937 records · Page 52

Sequential Training ToolKit - STTK

Sequential Training ToolKit, or STTK, is a software toolkit plugin for the Unity development platform that enables software developers to easily develop structured Sequential Training applications for gaming and extended reality (XR) environments. STTK is architected to easily import the toolkit as a plugin for the Unity platform and then interact with the graphical user interface (GUI) for drag-and-drop functionality. STTK also includes easy add-on plugins for Prefabs and auto-builds a State Machine. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525. SAND2021-3059 O

Klein, BrandonThorin↗

Graph-Env

The Graph-Env library provides a framework for adapting graph search problems into OpenAI Gym environments for reinforcement learning. In other words, Graph-Env enables reinforcement learning algorithms to be applied to graph search problems. Graph search problems include molecule and crystal structure design problems; route planning problems, including traveling salesperson problem; puzzles and games, such as chess and go; shortest path problems; minimum spanning tree; vehicle path generation; and others.

Tripp, Charles↗

Multiplayer Engineering

INL engineers developed a special purpose software framework designed to establish real-time connections between multiple running Unity instances. The framework is developed in Unity, a game engine development platform. This framework programmatically attaches functions to engineering models, enabling users to interact with, observe, and make changes to virtual models. These interactions are broadcasted through websocket connections, and received by other engineers in real-time.

Woodruff, Nathan↗

Network Defense Workforce Development System

The software implements the methodology of cybersecurity training architecture and is leveraged to build a turn-key based simulated cyberattack game in which the player assumes the facility manager's role and must defend the OT network from adaptive cyberattacks by directly configuring the physical network environment and implementing security policies.

Gourisetti, Sri Nikhil Gupta↗

POWER DATA PIPELINE

SF-25-081 Utility software for creating high-performance data pipelines to extract, load, and transform raw electric power systems measurements. For use with anomaly detection models training workflows. The software supports the project: Adaptive Cybersecurity for DER: A Game-Theoretic and Machine Learning approach for Real-Time Threat Detection and Mitigation

Plathottam, Silby Jose [Argonne National Laborator↗

Co-design Center for Exascale Machine Learning Technologies (ExaLearn)

We report rapid growth in data, computational methods, and computing power is driving a remarkable revolution in what variously is termed machine learning (ML), statistical learning, computational learning, and artificial intelligence. In addition to highly visible successes in machine-based natural language translation, playing the game Go, and self-driving cars, these new technologies also have profound implications for computational and experimental science and engineering, as well as for the exascale computing systems that the Department of Energy (DOE) is developing to support those disciplines. Not only do these learning technologies open up exciting opportunities for scientific discovery on exascale systems, they also appear poised to have important implications for the design and use of exascale computers themselves, including high-performance computing (HPC) for ML and ML for HPC. The overarching goal of the ExaLearn co-design project is to provide exascale ML software for use by Exascale Computing Project (ECP) applications, other ECP co-design centers, and DOE experimental facilities and leadership class computing facilities.

97 MATHEMATICS AND COMPUTING↗

Continuous removal of fission products from molten-salt-fueled reactors

A method based on separation of volatilized molten salt (MS) components, including by mass, is being developed to extract fission products (FPs) from operating molten-salt reactors. The initial application of this method is for accelerator-driven subcritical reactors fueled by (fluorinated molten salt) spent nuclear fuel (UNF) from any past, present, or future reactor. The actinides remain in the subcritical reactor to produce profitable energy and be transmuted while the extracted FPs can be buried without long-lived actinides such that a geologic repository is not necessarily needed to close the nuclear fuel cycle. By removing neutron-absorbing FPs and operating sub-critically, where the restrictive link between operation and criticality is broken, it is possible to envision complete burnup of the UNF fuel. The game-changing feature of continuously processing the molten salt inside the reactor while the reactor operates eliminates the need for a separate reprocessing plant. This feature also simultaneously improves the neutronics of the reactor, increasing the burnup of the fuel and extending its useful life for generating energy. Nuclear nonproliferation and need for geologic repositories are addressed by keeping actinides inside the reactor containment until they are consumed. (authors)

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

High-performance and high-fidelity Monte Carlo solutions to the BEAVRS benchmark

The BEAVRS (Benchmark for Evaluation and Validation of Reactor Simulation) benchmark is solved by PRAGMA, the GPU-based continuous energy Monte Carlo code. The resulting solutions are comprised of the detailed simulation results of two cycles, each of which consists of the zero power physics test (ZPPT) and the core depletion calculations. The ZPPT consists of characteristic parameters, such as critical boron concentration (CBC), control rod bank worth, isothermal temperature coefficients, and assembly-wise detector signal, which are compared with measured data provided by the benchmark administration. The core depletion calculations were performed for both the hot full power and the load follow modes, and the comparison was made with the measured or deduced CBCs and assembly-wise detector signals. In the load follow calculations, the operating power history was approximately applied to simulate the real operation as closely as possible. PRAGMA performed the various calculations with a tremendous number of histories ranging up to hundreds of millions per cycle, exploiting GPUs' massively parallel performance. The load follow run time was shorter than 16 hours on a single rack of computing nodes mounded with 24 gaming GPUs with a remarkable agreement with the measurements for most comparisons. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

PWR loading pattern optimization with reinforcement learning

The core loading pattern optimization problem belongs to the class of combinatorial optimization problem and has been studied since the dawn of commercial nuclear energy industry. It is characterized by multiple objectives and constraints, with a very high number of candidate patterns, which makes it impossible to solve explicitly. Stochastic optimization methodologies including Genetic Algorithms and Simulated Annealing are used by different nuclear utilities and vendors to perform fuel cycle reload design. Nevertheless, hand-designed solutions continue to be the prevalent method in the industry. To improve the state-of-the-art core reload patterns, we aim to create a method as scalable as possible, that agrees with the designer's goal of performance and safety. To help in this task Deep Reinforcement Learning (DRL), in particular Proximal Policy Optimization is leveraged. DRL has recently experienced a strong impetus from its successes applied to games, sometimes even reaching 'super-human' performances. This paper lays out the foundation of this method and proposes to study the behavior of several hyper-parameters that influence the DRL algorithm. The algorithm is highly dependent on multiple factors such as an exploration/exploitation trade-off that manifests through different parameters such as the number of loading patterns seen and the number of samples collected before a policy update, but also the shape of the objective function derived for the core design. Experimental results also demonstrate the effectiveness of the method in finding high-quality solutions from scratch within a reasonable amount of time. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Singularity: Scientific containers for mobility of compute

Here we present Singularity, software developed to bring containers and reproducibility to scientific computing. Using Singularity containers, developers can work in reproducible environments of their choosing and design, and these complete environments can easily be copied and executed on other platforms. Singularity is an open source initiative that harnesses the expertise of system and software engineers and researchers alike, and integrates seamlessly into common workflows for both of these groups. As its primary use case, Singularity brings mobility of computing to both users and HPC centers, providing a secure means to capture and distribute software and compute environments. This ability to create and deploy reproducible environments across these centers, a previously unmet need, makes Singularity a game changing development for computational science.

97 MATHEMATICS AND COMPUTING↗

An analysis and metric of reusable data licensing practices for biomedical resources

Data are the foundation of science, and there is an increasing focus on how data can be reused and enhanced to drive scientific discoveries. However, most seemingly “open data” do not provide legal permissions for reuse and redistribution. The inability to integrate and redistribute our collective data resources blocks innovation and stymies the creation of life-improving diagnostic and drug selection tools. To help the biomedical research and research support communities (e.g. libraries, funders, repositories, etc.) understand and navigate the data licensing landscape, the (Re)usable Data Project (RDP) assesses the licensing characteristics of data resources and how licensing behaviors impact reuse. We have created a ruleset to determine the reusability of data resources and have applied it to 56 scientific data resources (e.g. databases) to date. Here, the results show significant reuse and interoperability barriers. Inspired by game-changing projects like Creative Commons, the Wikipedia Foundation, and the Free Software movement, we hope to engage the scientific community in the discussion regarding the legal use and reuse of scientific data, including the balance of openness and how to create sustainable data resources in an increasingly competitive environment.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Post-fire time series of sensor and geochemistry sample data from surface water, groundwater, precipitation, soil, and vegetation across Oak Creek watershed, Washington

This dataset supports a broader study examining wildfire impacts on hydrologic connectivity across 5 sites within the Oak Creek watershed and the resulting biogeochemical impacts. Stream sites were selected using the Advanced Terrestrial Simulator (ATS) hydrologic model to identify locations with varying groundwater contributions and hydrologic responses across different burn severity scenarios. The Retreat Fire burned from July 23 to August 2 in 2024, affecting the five study sites at varying burn severities. Each site is equipped with YSI EXO2 sondes logging sub-hourly throughout the year, and grab samples are collected approximately every six weeks. YSI sondes are used to measure temporally resolved proxies for groundwater inputs (specific conductivity) and organic matter (fluorescent dissolved organic matter; fDOM) along with basic water quality and depth. Grab samples of surface water, groundwater, and precipitation are analyzed for water stable isotopes and conductivity to understand endmembers for hydrologic mixing Grab samples of surface water, groundwater, soil water, and litter/vegetation/soil leachates are analyzed for organic matter composition measured by Fourier-Transform Ion Cyclotron Resonance Mass Spectrometry (FTICR-MS) to understand organic matter dynamics. Game camera photos are provided in a separate data package available at https://data.ess-dive.lbl.gov/datasets/doi:10.15485/3018598. Future versions of this dataset will include time series data from YSI EXO2 sondes (fDOM, dissolved oxygen, temperature, depth, specific conductance, turbidity, pH), BaroTROLL sensors (air temperature and barometric pressure), rain gauges (precipitation), and data from the soil and vegetation samples. Because this study is ongoing, this data package will be updated regularly to include newly collected data and the additional data types. For details on how to navigate data packages generated by this project, see https://data.ess-dive.lbl.gov/portals/PNNLRiverCorridorSFA/About. In addition to a readme, this data package also includes a file-level metadata (FLMD) file that describes each file and a data dictionary (DD) that describes all column/row headers and variable definitions. This dataset is comprised of (1) a folder of field photos; (2) a folder of surface water sample data; (3) a folder of raw Fourier transform ion cyclotron resonance mass spectrometry (FTICR-MS) data; (4) a data checks report; (5) file-level metadata; (6) data dictionary; (7) field metadata; (8) readme; (9) international generic sample number (IGSN) mapping file; and (10) field protocols. The sample data subfolder contains (1) dissolved organic carbon (DOC, measured as non-purgeable organic carbon, NPOC) data and averages; (2) total dissolved nitrogen data and averages; (3) stable water isotopes and averages; (4) methods codes; (5) FTICR-MS methods; and (15) a subfolder of 9.4 Tesla (9.4T) FTICR-MS data. This folder contains the processed data and three subfolders, one containing the .xml files, one containing the water CoreMS output files, and the other containing instructions and scripts for processing the files in CoreMS (https://github.com/EMSL-Computing/CoreMS). All files are .csv, .pdf, .R, .xml, .d, .html, .Rmd, .py, .cal, .json, .jpg, .jpeg, .png, .mov, or .mp4.

Biogeochemistry↗

Fabrication and testing of high-performance all-metal neutron guides and axisymmetric mirrors by electrochemical replication

Neutron scattering is one of the most useful methods of studying the structure of matter, with applications to biomedical, structural, magnetic and energy-related materials. Neutron-scattering instruments are installed around research reactors or accelerator-based neutron sources, and neutron guides are critical components of these facilities. They are neutron-transport optical devices consisting of state-of-the-art mirrors often tens of meters long. Here we demonstrate a novel fabrication method of all-metallic neutron guides and axisymmetric mirrors by electroplating from precision mandrels. The process allows for the fabrication of single-piece all-metal guides of prismatic and axisymmetric shapes. We also demonstrate supermirror guides and axisymmetric focusing supermirrors produced with the same technology. We present the fabrication and tests of the multilayer-coated replicated guides and optic and show that the mandrel is reproduced with high fidelity and reliability. Furthermore, such supermirror optics will provide game-changing improvements in neutron techniques.

36 MATERIALS SCIENCE↗

graphenv: a Python library for reinforcement learning on graph search spaces

Many important and challenging problems in combinatorial optimization (CO) can be expressed as graph search problems, in which graph vertices represent full or partial solutions and edges represent decisions that connect them. Graph structure not only introduces strong relational inductive biases for learning (Battaglia et al., 2018) - in this context, by providing a way to explicitly model the value of transitioning (along edges) between one search state (vertex) and the next - but lends itself to problems both with and without clearly defined algebraic structure. For example, classic CO problems on graphs such as the Traveling Salesman Problem (TSP) can be expressed as either pure graph search or integer programs. Other problems, however, such as molecular optimization, do no have concise algebraic formulations and yet are readily implemented as a graph search (V. et al., 2022; Zhou et al., 2019). Such "model-free" problems constitute a large fraction of modern reinforcement learning (RL) research owing to the fact that it is often much easier to write a forward simulation that expresses all of the state transitions and rewards, than to write down the precise mathematical expression of the full optimization problem. In the case of molecular optimization, for example, one can use domain knowledge alongside existing software libraries to model the effect of adding a single bond or atom to an existing but incomplete molecule, and let the RL algorithm build a model of how good a given decision is by "experiencing" the simulated environment many times through. In contrast, a model-based mathematical formulation that fully expresses all the chemical and physical constraints is intractable. In recent years, RL has emerged as an effective paradigm for optimizing searches over graphs and led to state-of-the-art heuristics for games like Go and chess, as well as for classical CO problems such as the TSP. This combination of graph search and RL, while powerful, requires non-trivial software to execute, especially when combining advanced state representations such as Graph Neural Networks (GNN) with scalable RL algorithms.

97 MATHEMATICS AND COMPUTING↗

Recent Cryogenic Carbon Capture™ Field Test Results

Sustainable Energy Solutions (SES) has been developing Cryogenic Carbon Capture™ (CCC) since 2008. In that time, two processes have been developed, the External Cooling Loop and Compressed Flue Gas CCC processes (CCC-ECL and CCC-CFG, respectively). The CCC-ECL process cools the flue gas with an external refrigerant loop. This process currently captures up to 1 tonne of CO2 per day (TPD). SES has tested CCC-ECL on real flue gas slip streams from subbituminous coal, bituminous coal, biomass, natural gas, shredded tires, and municipal waste fuels at field sites that include utility power stations, heating plants, cement kilns, and pilot-scale research reactors. The CO2 concentrations from these tests ranged from 5 to 22% on a dry basis. CO2 capture ranged from 95-99+% during these tests. Several other condensable species were also captured including NO2, SO2 and PMxx at 95+%. NO was also captured at a modest rate. The CCC-CFG process has been scaled up to a 0.25 ton per day system. This system has been tested on real flue gas streams including subbituminous coal, bituminous coal, and natural gas at field sites that include utility power stations, heating plants, and pilot-scale research reactors. CO2 concentrations for these tests ranged from 5 to 15% on a dry basis. CO2 capture ranged from 95-99+% during these tests. Several other condensable species were also captured including NO2, SO2, and PMxx at 95+%. NO was also captured at 90+%. Hg capture was also verified and the resulting effluent from CCC-CFG was below a 1ppt concentration. This paper will focus on discussion of the capabilities of CCC generally, the results of CCC-ECL field testing, and future steps surrounding the development of this technology. Test results that will be presented have been collected during 9 months of testing at a commercial power plant under funding from the US Department of Energy (DOE) and the host utility. Testing of one of the systems at a commercial cement plant in the United States will also be discussed. During this testing, the system captured CO2 from the cement plant and stored the CO2 in pressurized tanks. These tanks were provided to a partner company that later used the CO2 in a CO2 utilization demonstration. The CO2 was utilized to cure concrete manufactured using cement from the same plant where the CO2 was captured. This integrated capture and utilization demonstration was the first time that the cement industry has shown in the field that it can sequester its CO2 emissions in its main product stream. This represents a potential game changing solution for industrial CO2 emissions. Operational data and host-site feedback indicate that the CCC process is ideally suited for deployment into a variety of commercial environments. A few areas of de-risking remain to make sure the technology can meet very strict industrial reliability standards. These areas of de-risking are identified and discussed. The product CO2 is shown to meet specification for many uses including industrial and merchant applications. The technology is nearing readiness for deployment at commercial scale and several initial target markets have been identified.

20 FOSSIL-FUELED POWER PLANTS↗

Decision Insight into Stakeholder Conflict for ERN

Participatory modeling has become an important tool in facilitating resource decision making and dispute resolution. Approaches to modeling that are commonly used in this context often do not adequately account for important human factors. Current techniques provide insights into how certain human activities and variables affect resource outcomes; however, they do not directly simulate the complex variables that shape how, why, and under what conditions different human agents behave in ways that affect resources and human interactions related to them. Current approaches also do not adequately reveal how the effects of individual decisions scale up to have systemic level effects in complex resource systems. This lack of integration prevents the development of more robust models to support decision making and dispute resolution processes. Development of integrated tools is further hampered by the fact that collection of primary data for decision-making modeling is costly and time consuming. This project seeks to develop a new approach to resource modeling that incorporates both technical and behavioral modeling techniques into a single decision-making architecture. The modeling platform is enhanced by use of traditional and advanced processes and tools for expedited data capture. Specific objectives of the project are: (1) Develop a proof of concept for a new technical approach to resource modeling that combines the computational techniques of system dynamics and agent based modeling, (2) Develop an iterative, participatory modeling process supported with traditional and advance data capture techniques that may be utilized to facilitate decision making, dispute resolution, and collaborative learning processes, and (3) Examine potential applications of this technology and process. The development of this decision support architecture included both the engineering of the technology and the development of a participatory method to build and apply the technology. Stakeholder interaction with the model and associated data capture was facilitated through two very different modes of engagement, one a standard interface involving radio buttons, slider bars, graphs and plots, while the other utilized an immersive serious gaming interface. The decision support architecture developed through this project was piloted in the Middle Rio Grande Basin to examine how these tools might be utilized to promote enhanced understanding and decision-making in the context of complex water resource management issues. Potential applications of this architecture and its capacity to lead to enhanced understanding and decision-making was assessed through qualitative interviews with study participants who represented key stakeholders in the basin.

97 MATHEMATICS AND COMPUTING↗

Long Term Processing Using Integrated Hydropyrolysis plus Hydroconversion (IH 2 ) for the Production of Gasoline and Diesel from Biomass

Cellulosic and woody biomass can be directly converted to hydrocarbon gasoline and diesel blending components through the use of a new, economical, technology named integrated hydropyrolysis plus hydroconversion (IH 2 ). The IH 2 gasoline and diesel blending components are fully compatible with petroleum based gasoline and diesel, contain less than 1% oxygen and have less than 1 total acid number (TAN). The IH 2 gasoline is high quality and very close to a drop in fuel. The life cycle analysis (LCA) shows that the use of the IH 2 process to convert wood to gasoline and diesel results in a greater than 90% reduction in greenhouse gas emission compared to that found with fossil derived fuels. The technoeconomic analysis showed the conversion of wood using the IH 2 process can produce gasoline and diesel at less than $\$$2.00/gallon. In this project, the previously reported semi-continuous small scale IH 2 test results were confirmed in a continuous 50 kg/day pilot plant. The continuous IH 2 pilot plant used in this project was operated round the clock for over 750 hours and showed good pilot plant operability while consistently producing 26-28 wt % yields of high quality gasoline and diesel product. The IH 2 catalyst showed good stability, although more work on catalyst stability is recommended. Additional work is needed to commercialize the IH 2 technology including running large particle size biomass, modeling the hydropyrolysis step, studying the effects of process variables and building and operating a 1-50 ton/day demonstration scale plant. The IH 2 is a true game changing technology by utilizing U.S. domestic renewable biomass resources to create transportation fuels, sufficient in quantity and quality to substantially reduce our reliance on foreign crude oil. Thus, the IH 2 technology offers a path to genuine energy independence for the U. S., along with the creation of a significant number of new U.S. jobs to plant, grow, harvest, and process biomass crops into fungible fuels.

09 BIOMASS FUELS↗

Southwestern United States Carbon Sequestration Training Center

The Southwest CO 2 Training Center was initiated in November 2009 in response to the need to develop a generation of workers with expertise in carbon capture, utilization and storage (CCUS). Three universities ran the Training Center cooperatively: New Mexico Tech, the University of Utah and Texas A&M University. The overall approach of the Training Center was to conduct education and outreach at a wide range of educational levels, including K-12 students and teachers, undergraduate and graduate students, professionals, and the general public. Key activities included: (1) Outreach targeted development of a video game (Carbon Bond) for middle-school students. (2) A summer program for high-school students. (3) Training for K-12 educators in Utah with a program by the Keystone center on “the Climate Status” and two offerings of a Masters of Science Teaching class at New Mexico Tech (NMT) on Climate and Carbon Sequestration. (3) Development and approval of an undergraduate curriculum for a concentration in CCUS for geology majors offered at the Earth and Environmental Science Department at NMT. This included a new course in Carbon Sequestration Science and a field course in Reservoir and Caprock Geology. (4) A new graduate-level course in CCUS was developed and offered via distance education to students at the University of Utah (U of U), NMT and the University of Texas at El Paso (UTEP). (5) Professional training via a reservoir modeling class, opening up the university courses to professionals, and conducting three webinars on outreach and public perception in CCUS. Overall we offered 60 CEU credits and 2,598 hours of professional training. A business plan was developed to continue the Training Center's CCUS education into the future. This involves a collaborative agreement with Schlumberger Carbon Services using the expertise and on-line materials developed by the Training Center for a commercial professional development website.

Lee, Robert↗