Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Human Performance Improvement”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Improving Non-Destructive Detection Technology Through SAVY Feature Detection

Surveillance of special nuclear material (SNM) storage containers is required by the DOE to assess their integrity across the Complex. This work aims to improve the task of container inspections by leveraging automation through machine learning (ML) tools to reduce the human-intensive effort and expert-level knowledge needed to assess container status. A field-deployable, non-destructive technology was designed using off-the-shelf components to collect multiple images from different perspectives of containers in storage to detect both spatial features of interest and anomalies of concern. Nine ML models were generated using unique training datasets and parameters. Learned features include SAVY surface regions including the body side wall, collar, lid, filter, and printed/etched information. Average Precision (AP) is used to calculate detection performance when both viewing previously seen environments and previously unseen environments. The application of image transformations and resolution scaling while training greatly improved the detection performance in unseen environments, and significantly increasing the number of computation iterations improved detection performance on previously seen environments. Additional capabilities were developed including the novel detection of procedural non-compliance and the ability to localize anomalies relative to SAVY surface features.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Improved bacterial recombineering by parallelized protein discovery

Exploiting bacteriophage-derived homologous recombination processes has offered precise, multiplex editing of microbial genomes and the construction of billions of customized genetic variants in a single day. The techniques that enable this, multiplex automated genome engineering (MAGE) and directed evolution with random genomic mutations (DIvERGE), are however, currently limited to a handful of microorganisms for which single-stranded DNA-annealing proteins (SSAPs) that promote efficient recombineering have been identified. Thus, to enable genome-scale engineering in new hosts, efficient SSAPs must first be found. Here we present a high-throughput method for SSAP discovery that we call “serial enrichment for efficient recombineering” (SEER). By performing SEER in Escherichia coli to screen hundreds of putative SSAPs, we identify highly active variants PapRecT and CspRecT. CspRecT increases the efficiency of single-locus editing to as high as 50% and improves multiplex editing by 5- to 10-fold in E. coli , while PapRecT enables efficient recombineering in Pseudomonas aeruginosa , a concerning human pathogen. CspRecT and PapRecT are also active in other, clinically and biotechnologically relevant enterobacteria. We envision that the deployment of SEER in new species will pave the way toward pooled interrogation of genotype-to-phenotype relationships in previously intractable bacteria.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Magnetoimpedance Biosensors and Real-Time Healthcare Monitors: Progress, Opportunities, and Challenges

A small DC magnetic field can induce an enormous response in the impedance of a soft magnetic conductor in various forms of wire, ribbon, and thin film. Also known as the giant magnetoimpedance (GMI) effect, this phenomenon forms the basis for the development of high-performance magnetic biosensors with magnetic field sensitivity down to the picoTesla regime at room temperature. Over the past decade, some state-of-the-art prototypes have become available for trial tests due to continuous efforts to improve the sensitivity of GMI biosensors for the ultrasensitive detection of biological entities and biomagnetic field detection of human activities through the use of magnetic nanoparticles as biomarkers. In this review, we highlight recent advances in the development of GMI biosensors and review medical devices for applications in biomedical diagnostics and healthcare monitoring, including real-time monitoring of respiratory motion in COVID-19 patients at various stages. We also discuss exciting research opportunities and existing challenges that will stimulate further study into ultrasensitive magnetic biosensors and healthcare monitors based on the GMI effect.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

Reinforcement learning based automated history matching for improved hydrocarbon production forecast

History matching aims to find a numerical reservoir model that can be used to predict the reservoir performance. An engineer and model calibration (data inversion) method are required to adjust various parameters/properties of the numerical model in order to match the reservoir production history. In this study, we develop deep neural networks within the reinforcement learning framework to achieve automated history matching that will reduce engineers’ efforts, human bias, automatically and intelligently explore the parameter space, and remove the need of large set of labeled training data. To that end, a fast-marching-based reservoir simulator is encapsulated as an environment for the proposed reinforcement learning. The deep neural-network-based learning agent interacts with the reservoir simulator within reinforcement learning framework to achieve the automated history matching. Reinforcement learning techniques, such as discrete Deep Q Network and continuous Deep Deterministic Policy Gradients, are used toth, used to train the learning agents. The continuous actions enable the Deep Deterministic Policy Gradients to explore more states at each iteration in a a learning episode; consequently, a better history matching is achieved using this algorithm as compared to Deep Q Network. For simplified dual-target composite reservoir models, the best history-matching performances of the discrete and continuous learning methods in terms of normalized root mean square errors are 0.0447 and 0.0038, respectively. Furthermore, our study shows that continuous action space achieved by the deep deterministic policy gradient drastically outperforms deep Q network.

42 ENGINEERING↗
DOE OSTI2024

DOE BSSD Performance Management Metrics Report Q1

Microbes play key roles in our biosphere, from driving global nutrient cycling to impacting plant, animal and human health and disease. Complex data from microbial genomes, proteins, and metabolites provide a window into these tiny engines that drive life on our planet. Yet these data are dispersed among researchers’ laboratories and various repositories, making it difficult to access. This calls for new ways of managing data, improving data interoperability, advancing community standards, and creating an infrastructure where data are shared efficiently. We have built the National Microbiome Data Collaborative (NMDC) to advance how scientists create, use, and reuse data to redefine the way we understand and harness the power of microbes. The vision of the National Microbiome Data Collaborative (NMDC) is to drive a microbiome data sharing network connecting data, people, and ideas to advance microbiome innovation and discovery. The NMDC was launched in 2019 and brought together DOE National Laboratories to collaborate across resources, capabilities, and expertise. The NMDC team was strategically assembled to include software developers, microbial researchers, metadata experts, and multi-omics specialists. The diversity of the NMDC team reflects the inherently interdisciplinary nature of microbiome science, and we leverage the strengths of the DOE National Laboratory system. Towards BER’s goal of advancing an iterative systems biology approach to the understanding of microbial genomes, the NMDC serves as a foundation for infrastructure, data standards, and community building. Together with the flagship DOE User Facilities, the Joint Genome Institute (JGI) and the Environmental Molecular Sciences Laboratory (EMSL), we are developing core capabilities in metadata standards for environmental descriptors and sample handling and processing; standardized bioinformatic workflows; an interface for data search and access; and robust community engagement activities. The NMDC production platform supports long-term data infrastructure and community building for BER’s bioenergy and environmental research goals. Our approach leverages lessons learned and an ambitious framework for collaborative, interdisciplinary data infrastructure to support microbiome research. The NMDC supports data, information, and knowledge access through three defined software tools – the Submission Portal, NMDC EDGE, and the Data Portal – driven by community needs. Herein, we describe the value proposition for the microbiome research community, our overarching strategy, and challenges and opportunities for developing the NMDC as both an infrastructure and community engagement program.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

The Impact of Crop Rotation and Spatially Varying Crop Parameters in the E3SM Land Model (ELMv2)

Abstract Earth System Models (ESMs) are increasingly representing agriculture due to its impact on biogeochemical cycles, local and regional climate, and fundamental importance for human society. Realistic large scale simulations may require spatially varying crop parameters that capture crop growth at various scales and among different cultivars, as well as common crop management practices, but their importance is uncertain, and they are often not represented in ESMs. In this study, we examine the impact of using constant versus spatially varying crop parameters using a novel, realistic crop rotation scenario in the Energy Exascale Earth System Model (E3SM) Land Model version 2 (ELMv2). We implemented crop rotation by using ELMv2's dynamic land unit capability, and then calibrated and validated the model against observations collected at three AmeriFlux sites in the US Midwest with corn soybean rotation. The calibrated model closely captured the magnitude and observed seasonality of carbon and energy fluxes across crops and sites. We performed regional simulations for the US Midwest using the calibrated model and found that spatially varying only a few crop parameters across the region, as opposed to using constant parameters, had a large impact, with the carbon fluxes and energy fluxes both varying by up to 40%. These results imply that large scale ESM simulations using spatially invariant crop parameters may result in biased energy and carbon fluxes estimation from agricultural land, and underline the importance of improving human‐earth systems interactions in ESMs.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

3D Printing of Cement-Based Materials Using Seawater for Simulated Marine Environments

Global demand for adaptable and rapidly deployable construction solutions in offshore, coastal, and fluvial environments continues to rise, driven by pressing needs to develop energy platforms, improve coastal resilience, and support emergency response in the face of natural disasters. Increased investment in human-made coastal infrastructure, such as piers, support structures for power lines, offshore wind farms, and seawall protection systems, further underscores this trend. This study investigates the development of printable concrete mixtures for underwater environments using seawater as a replacement for freshwater, using a 3D printing syringe-based extrusion system. The effect of seawater addition and the printing medium (in air vs. underwater) was assessed via rheological and mechanical performance characterization. The results indicate rheological properties are favorable for seawater adoption by producing mixtures with higher yield stress and viscosity with the same levels of admixtures used for freshwater. Seawater-based mixtures demonstrated superior dimensional stability compared to freshwater counterparts, maintaining cross-sectional geometry, while compressive strength results showed no statistical differences between in-air and underwater samples. However, flexural strength was significantly influenced by geometry and printing medium. These findings establish critical rheological parameters for printable underwater mixtures and highlight the need for optimized curing strategies and layer bonding techniques to improve interfacial strength in underwater 3D printing applications.

36 MATERIALS SCIENCE↗
DOE OSTI2020

The sensitive surface chemistry of Co-free, Ni-rich layered oxides: identifying experimental conditions that influence characterization results

Recent studies have suggested that Co-free, Ni-rich layered cathodes (e.g., doped LiNiO2) can provide promising battery performance for practical applications. However, these layered cathodes suffer from significant surface instability during various stages of the sample history, which generates inherent challenges for achieving stable battery performance and obtaining statistically representative characterization results. To reliably report the surface chemistry of these materials, delicate controls of stepwise sample preparation are required. In this study, we aim to reveal how the surface chemistry of LiNiO2 based materials changes with various environments, including human exhalation, sample storage, sample preparation, electrochemistry cycling, and surface doping. Our results demonstrate that the surface of these materials is highly reactive and prone to alter at various stages of sample handling and characterization. The sensitive surface could impact the interpretation of the surface chemical and structural information, including surface carbonate formation, transition metal reduction and dissolution, and surface reconstruction. Importantly, the heterogeneity of the surface degradation calls for a consolidation of nanoscale, high-resolution characterization, and ensemble-averaged methods in order to improve statistical representation. Furthermore, the doping chemistry can effectively mitigate the surface degradation and improve overall battery performance due to the enhanced surface oxygen retention. Our study highlights the necessity of strict measurements through complementary characterizations at multiple length scales to eliminate unintentional biased conclusions.

surface chemistry, Co-free Ni-rich cathodes, Istab↗
DOE OSTI2020

Autotuning of Double-Dot Devices In Situ with Machine Learning

The current practice of manually tuning quantum dots (QDs) for qubit operation is a relatively time-consuming procedure that is inherently impractical for scaling up and applications. In this work, we report on the in situ implementation of a recently proposed autotuning protocol that combines machine learning (ML) with an optimization routine to navigate the parameter space. In particular, we show that a ML algorithm trained using exclusively simulated data to quantitatively classify the state of a double-QD device can be used to replace human heuristics in the tuning of gate voltages in real devices. Here, we demonstrate active feedback of a functional double-dot device operated at millikelvin temperatures and discuss success rates as a function of the initial conditions and the device performance. Modifications to the training network, fitness function, and optimizer are discussed as a path toward further improvement in the success rate when starting both near and far detuned from the target double-dot range.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

In-situ irradiation-induced studies of grain growth kinetics of nanocrystalline UO 2

The thermal conductivity of UO 2 fuel needs to be high enough to dissipate the heat generated from the fission reaction. Since grain size affects thermal conductivity and grain size can evolve with irradiation, it is critical to understand in-reactor UO 2 grain growth. Most studies of grain growth in UO 2 are based on thermally driven processes at elevated temperatures. However, studies have shown that grain growth can occur even at cryogenic temperatures by ballistic processes. Such irradiation-induced grain growth in UO 2 is yet to be studied. Advanced in-situ Kr ion irradiation and transmission electron microscopy were systematically performed on nanocrystalline UO 2 thin films at temperatures ranging from 50 K to 1073 K; grain growth was observed at all temperatures. A combination of manual and machine learning techniques was used to measure and plot grain size evolution against irradiation fluence at various irradiation temperatures. The machine learning method has significantly improved the analysis efficiency and reduced human labors. The grain diameter data were fitted using classical grain growth and thermal spike models to describe grain growth kinetics with and without irradiation effect. Grain growth during low temperature irradiation (≤ 475 K) can be well described by the thermal spike model. Above 475 K, there were additional thermally assisted processes that further accelerate the grain growth. At the highest irradiation temperature about 1075 K, both irradiation-induced dislocation loops and cavities/bubbles were observed to form in the UO 2 . In this report, the effects of irradiation-induced defects on grain growth kinetics are discussed.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

The drivers and predictability of wildfire re-burns in the western United States (US)

Evidence is mounting that the effectiveness of using prescribed burns as a management tactic may be diminishing due to the higher incidence of wildfire re-burns. The development of predictive models of re-burns is thus essential to better understand their primary drivers so that forest management practices can be updated to account for these events. First, we assess the potential for human activity as a driver of re-burns by evaluating re-burn trends both within and outside of the wildland–urban interface (WUI) of the western US. Next, we investigate the predictability of re-burns through the application of both random forest and the explanatory machine learning non-negative matrix factorization using k-means clustering (NMFk) algorithms to predict re-burn occurrence over California based on a number of climate factors. Our findings indicate that while most states showed increasing trends within the WUI when trends were conducted over longer moving windows (e.g. 20 years), California was the only state where the rate of increase was consistently higher in the WUI, indicating a stronger potential for human activity as a driver in that location. Furthermore, we find model performance was found to be robust over most of California (Testing F1 scores = 0.688), although results were highly variable based on EPA level III Ecoregion (F1 scores = 0.0–0.778). Insights provided from this study will lead to a better understanding of climate and human activity drivers of re-burns and how these vary at broad spatial scales so that improvements in forest management practices can be tuned according to the level of change that is expected for a given region.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Blunt Impact Brain Injury using Cellular Injury Criterion

The Advanced Combat Helmet (\ACH") military specification (\mil-spec") requires a helmeted magnesium (\Mg") Department of Transportation (\DOT") headform be dropped vertically, with an impact speed of 3.1 m/s (10 ft/s), onto a steel hemispherical target. The pass/fail criteria are based on translational acceleration (150 G) alone, absent of any rotational component. Without a rotational component, the specification's injury risk application is limited to skull fracture and peripheral hematomas (subdural, subarachnoid), since this translational acceleration injury risk assessment is based on the Wayne State Tolerance Curve (\WSTC"). To provide a more comprehensive view of injury for the entire brain, an alternative approach is needed. To meet this need, we worked with a larger group called PANTHER, a collaboration between national laboratories, industry, and academia. Collaborations specific to research and results presented here come from efforts led by Mr. Ron Szalkowski and Mr. Sushant Malave, Ms. Alice Fawzi, and Dr. Christian Franck. We have developed a prototypical injury risk criterion based on the neuronal response to abrupt changes in general motion (translation, rotation, or both). The cellular-based mild traumatic brain injury (\cbmTBI") criterion utilizes both the strain and strain rate of brain tissue to account for the stretch and rate of stretch that occurs throughout the brain as a result of blunt impact to the head. We conducted physical experiments of an ACH-fitted magnesium headform, which produced repeatable headform peak accelerations. Then, we developed a simulation of the experiment, and validated the simulation output with the experimental data. We then substituted the magnesium headform with a human headform, consisting of skin, muscle, bone, gray matter, white matter, cerebral-spinal fluid, membranes, vasculature, intravertebral discs, airway and sinus. We quantified brain injury risk using the cbmTBI criterion, using the current mil-spec test and a modified test. The modified mil-spec test used an inclined anvil target that was located posterior to the crown of the helmet in the axial plane. While the current mil-spec test produced brain deformation from head translation alone, the modified test produced brain deformation from head translation and rotation, which is closer to most real world and combat theater impacts (e.g., such as occur in tertiary blast exposure). Compared to the current mil-spec test, the modified test produced elevated strains in the human digital twin. These data, mapped to the cbmTBI criterion, suggest increased injury risk for blunt impacts that cause rotation and translation, rather than just translation alone. Moreover, these data may lead to a rotational performance metric, which is rooted in the biology and pathology of the brain's response to impact and blast, and which should be used to improve next-generation helmet designs.

42 ENGINEERING↗
DOE OSTI2023

HOP and Cybersecurity: Leveraging safety and reliability experience to improve digital security culture

This presentation will introduce participants to key mental models on how to think about and understand safety and the organizational attributes that support it from three of the leading voices in the discipline – David Marx, Dr. Erik Hollnagel and Dr. Todd Conklin – and from there we ask the simple question of “how can we apply this to cybersecurity?” Opportunities, similarities, and differences from the history of accomplishment applying human and organizational performance principles to safety and reliability can be collectively leveraged to the meet the challenge of cybersecurity for OT/ICS/cyber-physical systems. This is the same intent as the "Cybersecurity Culture" principle of Cyber-Informed Engineering (CIE).

42 ENGINEERING↗
DOE OSTI2025

Speeding-up fuzzing through directional seeds

Abstract Fuzzing is an automated process for discovering inputs in a program that may trigger unexpected behavior. Today, fuzzing has become a standard practice for the discovery of bugs and security vulnerabilities. However, the main issue with such practices is that the exploration of the input space of programs can often be prohibitively expensive. Therefore, several alternative fuzzing strategies have been introduced during the last few years. Some fuzzing techniques rely on human expertise to provide a plausible set of initial input examples, namely, seeds. However, the process of handcrafting seeds for fuzzing purposes often becomes strenuous for humans as it requires a deeper understanding of the Program-Under-Test (PUT). Also, the use of known inputs to programs often does not trigger vulnerable program behavior or may not reach potentially vulnerable code locations. To address those issues, we propose a seed generation framework that enables Human-In-The-Loop (HITL) directed fuzzing where the human assumes a more active role in the creation of seeds that can penetrate and assess desired locations of the PUT. Our proposed framework uses Symbolic Execution (SE) to generate seeds that exercise paths to target program locations. Moreover, our framework enables the visualization of the explored execution paths in the binary of the PUT for the generated seeds. We evaluated our approach on a set of 12 carefully designed C programs with diverse characteristics that mimic real-world programs. The experimental results show the effectiveness of the proposed approach in improving the performance of standard fuzzing tools such as the American Fuzzy Lop ("Image missing" <#comment/> ). Specifically, our solution can generate seeds that substantially enhance the performance of the fuzzer, achieving speedups ranging from $$1.46\times $$ 1.46 × to $$68.53\times $$ 68.53 × for branch conditions, $$1.39\times $$ 1.39 × to $$254.62\times $$ 254.62 × for branch depths, $$14,879.59\times $$ 14 , 879.59 × to $$30,295.88\times $$ 30 , 295.88 × for branch widths over traditional seeds. Additionally, the speedup increases with the number of target function ranging from $$12,260\times $$ 12 , 260 × to $$22,856.07\times $$ 22 , 856.07 × over traditional seeds while only requiring less than 15 seconds on average for the seed generation step.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Assessing the Impact of Mirror Technology on Driver Perception and Safety: Traditional vs. Camera-Based Systems

Camera-based mirror systems (CBMS) are being adopted by commercial fleets based on the potential improvements to operational efficiency through improved aerodynamics, resulting in better fuel economy, improved maneuverability, and the potential improvement for overall safety. Until CBMS are widely adopted it will be expected that drivers will be required to adapt to both conventional glass mirrors and CBMS which could have potential impact on the safety and performance of the driver when moving between vehicles with and without CBMS. To understand the potential impact to driver perception and safety, along with other human factors related to CBMS, laboratory testing was performed to understand the impact of CBMS and conventional glass mirrors. Drivers were subjected to various, nominal driving scenarios using a truck equipped with conventional glass mirrors, CBMS, and both glass mirrors and CBMS, to observe the differences in metrics such as head and eye movement, reaction time, and perception of distance. The finds from this study will serve as the baseline measurements for future research regarding off-nominal driving scenarios and hardware failures of CBMS, as well as inform potential future policy regarding CBMS for the use in commercial vehicles in lieu of conventional glass mirrors.

Siekmann, Adam [ORNL] (ORCID:0000000284653935)↗
DOE OSTI2022

Complex genetics cause and constrain fungal persistence in different parts of the mammalian body

Determining how genetic polymorphisms enable certain fungi to persist in mammalian hosts can improve understanding of opportunistic fungal pathogenesis, a source of substantial human morbidity and mortality. We examined the genetic basis of fungal persistence in mice using a cross between a clinical isolate and the lab reference strain of the budding yeast Saccharomyces cerevisiae. Employing chromosomally encoded DNA barcodes, we tracked the relative abundances of 822 genotyped, haploid segregants in multiple organs over time and performed linkage mapping of their persistence in hosts. Detected loci showed a mix of general and antagonistically pleiotropic effects across organs. General loci showed similar effects across all organs, while antagonistically pleiotropic loci showed contrasting effects in the brain vs the kidneys, liver, and spleen. Persistence in an organ required both generally beneficial alleles and organ-appropriate pleiotropic alleles. This genetic architecture resulted in many segregants persisting in the brain or in nonbrain organs, but few segregants persisting in all organs. These results show complex combinations of genetic polymorphisms collectively cause and constrain fungal persistence in different parts of the mammalian body.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Evaluation of an open forecasting challenge to assess skill of West Nile virus neuroinvasive disease prediction

Abstract Background West Nile virus (WNV) is the leading cause of mosquito-borne illness in the continental USA. WNV occurrence has high spatiotemporal variation, and current approaches to targeted control of the virus are limited, making forecasting a public health priority. However, little research has been done to compare strengths and weaknesses of WNV disease forecasting approaches on the national scale. We used forecasts submitted to the 2020 WNV Forecasting Challenge, an open challenge organized by the Centers for Disease Control and Prevention, to assess the status of WNV neuroinvasive disease (WNND) prediction and identify avenues for improvement. Methods We performed a multi-model comparative assessment of probabilistic forecasts submitted by 15 teams for annual WNND cases in US counties for 2020 and assessed forecast accuracy, calibration, and discriminatory power. In the evaluation, we included forecasts produced by comparison models of varying complexity as benchmarks of forecast performance. We also used regression analysis to identify modeling approaches and contextual factors that were associated with forecast skill. Results Simple models based on historical WNND cases generally scored better than more complex models and combined higher discriminatory power with better calibration of uncertainty. Forecast skill improved across updated forecast submissions submitted during the 2020 season. Among models using additional data, inclusion of climate or human demographic data was associated with higher skill, while inclusion of mosquito or land use data was associated with lower skill. We also identified population size, extreme minimum winter temperature, and interannual variation in WNND cases as county-level characteristics associated with variation in forecast skill. Conclusions Historical WNND cases were strong predictors of future cases with minimal increase in skill achieved by models that included other factors. Although opportunities might exist to specifically improve predictions for areas with large populations and low or high winter temperatures, areas with high case-count variability are intrinsically more difficult to predict. Also, the prediction of outbreaks, which are outliers relative to typical case numbers, remains difficult. Further improvements to prediction could be obtained with improved calibration of forecast uncertainty and access to real-time data streams (e.g. current weather and preliminary human cases). Graphical Abstract

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

PWR loading pattern optimization with reinforcement learning

The core loading pattern optimization problem belongs to the class of combinatorial optimization problem and has been studied since the dawn of commercial nuclear energy industry. It is characterized by multiple objectives and constraints, with a very high number of candidate patterns, which makes it impossible to solve explicitly. Stochastic optimization methodologies including Genetic Algorithms and Simulated Annealing are used by different nuclear utilities and vendors to perform fuel cycle reload design. Nevertheless, hand-designed solutions continue to be the prevalent method in the industry. To improve the state-of-the-art core reload patterns, we aim to create a method as scalable as possible, that agrees with the designer's goal of performance and safety. To help in this task Deep Reinforcement Learning (DRL), in particular Proximal Policy Optimization is leveraged. DRL has recently experienced a strong impetus from its successes applied to games, sometimes even reaching 'super-human' performances. This paper lays out the foundation of this method and proposes to study the behavior of several hyper-parameters that influence the DRL algorithm. The algorithm is highly dependent on multiple factors such as an exploration/exploitation trade-off that manifests through different parameters such as the number of loading patterns seen and the number of samples collected before a policy update, but also the shape of the objective function derived for the core design. Experimental results also demonstrate the effectiveness of the method in finding high-quality solutions from scratch within a reasonable amount of time. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗