Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Distributed training”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,189 records · Page 66
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Wyandotte Integrated Renewable Energy Strategy (WIRES 2) (Final Technical Report)

Wyandotte Municipal Services (WMS), a Michigan Municipal Utility offering electric generation, transmission & distribution, water filtration & distribution and Broadband/Video sought to deploy a set of renewable energy projects for their Electric Utility that contributed to reducing the City’s environmental and energy impact, provided examples that would encourage businesses and citizens to adopt cleaner energy practices and help WMS meet the required renewable energy standards of the State of Michigan (10% in 2015, 15% in 2021). WMS generates and delivers roughly 280,000 megawatt hours (MWh) of electricity annually to more than 10,000 homes and 1,000 businesses within the City of Wyandotte. The Wyandotte Integrated Renewable Energy Strategy – WIRES 2 resulted in deployment of a set of community-scale micro-wind turbines, evaluation and installation of energy-efficient and low-maintenance light-emitting diode (LED) street lights and park lights in highly visible locations in the City and expansion of the geothermal heating and cooling district that already included residential geothermal systems, to include larger scale business/institutional systems at the Utility’s largest electric customer and at the City Library. Finally, WMS identified the need for job training in energy efficiency and renewable energy technologies to further develop a local skilled workforce in these areas. Partially funded by the grant, the wind turbine project provides a benchmark for WMS, local businesses and residents in the evaluation of utility-scale wind v. micro-wind in an urban environment as a renewable energy strategy. Also partially funded by the grant, the LED project benefited the City of Wyandotte by reducing load on the electric system for the public utility but also reduced City costs for streetlighting, parking lot lighting and park lighting without a compromise in security. The project also resulted in a visual success that has led to additional approvals for non-Grant related LED lighting installations resulting in further reduction in the electric load in the City. Commercial Geothermal installations resulted in the Utility being able to eliminate steam customers who formerly utilized the byproduct of steam from WMS electric production. Due to the reduction in natural gas prices and the overall reduction in market purchased power, it was no longer feasible for WMS to operate its Power Plant as a base load plant and to only operate on a market dispatch philosophy when market prices dictated that WMS could produce electricity cheaper than the market purchase price. This has resulted in fewer operating days for the WMS Power Plant, resulting in less environmental impact. WMS has now completely exited the steam business and the ability to offer a geothermal option to two (2) former steam customers (BASF-Wyandotte and the Bacon Memorial Library) allowed for that. In addition, peak loads have been shaved for these two (2) large customers due to the consistent temperature offered by geothermal heating and cooling, reducing the swings associated with thermostat changes caused by outside temperature changes during extreme high and low temperatures. Finally, energy efficiency and renewable energy college-level classes at Wayne County Community College allowed a group of interested students to pursue studies in those technologies through grant provided tuition, books and course materials. This effort provided a foundation of potential future employees not only for WMS but other energy efficiency/renewable energy employers such as Franklin Energy, a partner with WMS in energy optimization efforts with Wyandotte businesses.

17 WIND ENERGY↗
DOE OSTI2023

Hierarchical Data-Driven Protection for Microgrid with 100% Renewable Penetration: Preprint

The accurate detection and isolation of faults is critical for the reliable operation of microgrids (MGs). Traditional protection approaches are even more challenged for 100% renewable MGs because inverter-based resources (IBRs) are the only sources for fault current which are usually low and unpredictable/non-uniform. This calls for new protection scheme that can identify IBR fault responses and detect faults in MGs. Data-driven based protection can learn the pattern of IBR fault responses and make the correct decision to identify faults. Therefore, this paper presents a data-driven approach for fault localization in island MGs. The approach builds a training dataset of comprehensive fault scenarios that can be used to learn fault characteristics from processed measurements. The localization task is modeled as a binary classification problem at each relay, which simplifies the learning process. Then, a hierarchical decision mechanism is used to identify the fault location. The proposed approach is assessed using an exemplary MG with several grid-forming (GFM) and grid-following (GFL) inverters, where accurate estimation of fault location is achieved. The data-driven based protection approach developed in this paper provides a generic framework and useful guidance for power system protection engineers to achieve reliable protection for MGs with 100% renewables.

artificial intelligence↗
DOE OSTI2021

DOE Award No.: DE-FE0023919 Phase 4 Scientific/Technical Report

This is the Phase 4 Report for the ‘Deepwater Methane Hydrate Characterization and Scientific Assessment or Genesis of Methane Hydrates in the Gulf of Mexico (GOM2)’ research project (DOE Award No. DE-FE0023919). The report summarizes activities from October 1, 2019 to September 30, 2020. The project is led by the University of Texas at Austin (UT). The project objective is to gain insight into the nature, formation, occurrence and physical properties of methane hydrate-bearing sediments for the purpose of methane hydrate resource appraisal through the planning and execution of drilling, coring, logging, testing and analytical activities that assess the geologic occurrence, regional context, and characteristics of marine methane hydrate deposits in the Gulf of Mexico outer continental shelf (OCS). We published a dedicated American Association of Petroleum Geologists Bulletin volume describing initial results from the UT-GOM2-1 expedition in Sept. 2020. This is part 1 of a multi-volume commitment by AAPG to this project. We further confirmed that the natural gas in hydrate at GC-955 was formed by primary microbial processes (>76.1 %). The in-situ effective permeability hydrate-bearing sandy silts at the GC-955 reservoir ranges from 0.1 md (1.0×10-16 m2) to 2.4 md (2.4×10-15m2) in cores with 83% to 93% hydrate saturation. The intrinsic permeability (the single phase permeability) is estimated from reconstituted samples to be ~12 md (1.2×10-14 m2) to ~41 md (4.1×10-14 m2). We used observation and models to interpret that the core degradation that is found in pressure cores is due to dissociation of the methane hydrate in the outer circumference of the core and dissolution of that methane into the fresh pore water that the core is stored with. We are designing approaches to minimize this core loss in the future. We spent an enormous amount of effort to further improve the ability of the pressure coring tool (the PCTB) to pressure seal correctly. We completed upgrading the upper section of the PCTB to address poor pressure. We successful tested the modifications at Geotek’s test facility in Salt Lake City (Bench Test II). We completed a Land Test of the PCTB at the Schlumberger Cameron Test and Training Facility (CTTF). The tool did not seal in 6 out of 7 tests and we clearly demonstrated that cuttings were wedging in the ball valve assembly, keeping the ball valve from sealing. We reproduced the failure mechanism observed during the land test at Salt Lake City and confirmed the sensitivity of the ball valve assembly to grit. Geotek designed and tested 9 modifications to address this issue and the PCTB is now 100% successfully sealing in the presence of grit. Our science expedition is scheduled for spring 2022 and we are fully focused on preparing for this. UT and Ohio State completed a Shallow Hazard Assessment report for each proposed UT-GOM2-2 drilling location, pursuant to 30 CFR 250.214(f) and 250.244 (f). The Shallow Hazard Reports will accompany the UT-GOM2-2 Exploration Plan that is submitted to BOEM, and completes the geological and geophysical analysis for UT-GOM2-2 permitting efforts. We updated the UT-GOM2-2 Operations Plan (Version 1). We completed the UT-GOM2-2 Science and Sample Distribution Plan (Version 1). We evaluated the scope, budget, and schedule that would result from using a commercial vessel. We developed detailed drilling schedule, mud volume, and resource estimates. We developed a vessel specification document and a well plan, and sent these documents to prospective vessel contractors.

03 NATURAL GAS↗
DOE OSTI2022

A Fast and Accurate Transient Stability Assessment Method Based on Deep Learning: WECC Case Study

Transient stability is one of the critical aspects of power system stability assessment. The increasing integration of inverter-based resources and the retirement of conventional synchronous generators result in the decreasing system inertia and growing complexity of system operating conditions. Using a few selected typical operating conditions cannot guarantee system transient stability in all operating conditions, and the time-domain simulation of all operating conditions requires tremendous time and is often infeasible. This paper proposes a more efficient transient stability assessment method based on deep learning. The binary search method is used to determine the critical clearing time (CCT) in creating training databased by time-domain simulation. This method is fast and accurate with 1 ms resolution. The buses whose CCTs are lower than 200 ms are considered critical buses. Buses close to each other are grouped based on their mutual admittance matrix to reduce the search space of the critical buses. This paper also proposes the generator feature normalization based on the physical model. Case study on the reduced 240-bus WECC system model demonstrates that the proposed method can predict CCT accurately and efficiently.

critical clearing time↗
DOE OSTI2024

NSA Site Science: Use of ARM Observations from Northern Alaska to Evaluate and Improve Prediction Capabilities

The Arctic is warming at a rate nearly double that of the rest of the planet, leading to profound changes in atmospheric, oceanic, and ice processes. The U.S. Department of Energy's (DOE) Atmospheric Radiation Measurement (ARM) user facility has played a significant role in Arctic research, operating observatories in Alaska's North Slope for over 25 years. These observatories provide a rich, and wide-reaching dataset that offers insight into atmospheric processes in northern Alaska. This report details the results of a nine-year research project (2015–2024) supported by the DOE Atmospheric Systems Research (ASR) program, that leverages data from ARM’s deployment of observing facilities at Utqiaġvik (known as the North Slope of Alaska, or NSA, site) and Oliktok Point, Alaska. The project was conducted in two phases: - Phase 1 (2015–2019): Focused on understanding key atmospheric processes at Oliktok Point, including cloud formation, high-latitude precipitation, aerosol-cloud interactions, and cloud properties. - Phase 2 (2019–2024): Extended the research to the broader North Slope region, using data from both Oliktok Point and Utqiaġvik. Topics explored included surface energy budgets, atmospheric stability, ice nucleation processes, and microphysics in Arctic clouds. The project resulted in numerous research products, including 50 peer-reviewed publications and dissertations, 169 presentations, and 10 data products. These products cover a variety of topics, including: - Cloud Macro- and Microphysical Properties: Arctic clouds play a crucial role in energy transfer, and accurate representation in models is critical. The study explored cloud transitions, ice crystal shapes, and dual-wavelength radar data to understand ice crystal habits and size distributions. - Aerosol Properties and Processes: The team examined aerosol sources in the Arctic, including industrial emissions and natural sources. Observations showed significant spatial gradients in aerosol concentrations due to human activities and wildfire smoke. The influence of aerosols on cloud formation and the surface energy budget was also assessed. - Aerosol-Cloud Interactions: Research revealed that aerosols might suppress cloud ice production, affecting cloud radiative forcing and precipitation. The impact of local industrial emissions on cloud properties was also investigated. - Contextualizing the North Slope of Alaska in the context of the broader Arctic: To understand broader trends, the project evaluated large-scale circulation patterns and the influence of weather systems on the Arctic. Studies indicated that large-scale processes play a significant role in temperature patterns and the timing of snowmelt. - Advancing ARM Observational and Modeling Capabilities: The project developed new radar data products and advanced measurement techniques, including clutter mitigation and drizzle detection. Uncrewed aerial systems (UAS) and tethered balloon systems (TBS) were deployed to gather detailed atmospheric data. Additionally, the project supported 10 early career scientists, providing training and mentorship to undergraduate interns, graduate students, postdoctoral researchers, and early career researchers. These efforts contributed to the advancement of ARM research capabilities and fostered a new generation of scientists skilled in Arctic atmospheric research. Ultimately, this ASR-supported project has provided valuable insights into Arctic atmospheric processes and their broader climate implications. Recommendations for future work include continuing support for long-term observing at Arctic locations to foster additional research, further exploration of aerosol-cloud interactions and the potential impacts of enhanced industrialization of the Arctic, and expanded use of uncrewed systems to gather data in this remote and harsh environment. Additionally, the data products developed by this work, and the data products developed through the ARM infrastructure, leave a treasure-trove of additional information that should be explored for many years to come to gain additional insight into physical processes in the Arctic atmosphere that drive the rapid changes occurring in at high latitudes and their global impact.

58 GEOSCIENCES↗
DOE OSTI2024

A Full-Stack Exploration of Language-Based Parallelism in Fortran 2023

This poster explores native parallel features in Fortran 2023 through the lens of supporting applications with libraries, compilers, and parallel runtimes. The language revision informally named Fortran 2008 introduced parallelism in the form of Single Program Multiple Data (SPMD) execution with two broad feature sets: (1) loop-level parallelism via do concurrent and (2) a Partitioned Global Address Space (PGAS) comprised of distributed “coarray” data structures. Fortran’s native parallelism has demonstrated high performance [1] and reduced the burden of inserting what sometimes amounts to more directives than code. Several compilers support both feature sets, typically by translating do concurrent into serial do loops annotated by parallel directives and by translating SPMD/PGAS features into direct calls to a communication library. Our research focuses primarily on two questions: (1) can the compiler’s parallel runtime library be developed in the language being compiled (Fortran) and (2) can we define an interface to the runtime that liberates compilers from being hardwired to one runtime and vice versa. We are answering these questions by developing the Parallel Runtime Interface for Fortran (PRIF) [2] and the Co-Array Fortran Framework of Efficient Interfaces to Network Environments (Caffeine) [3]. Caffeine is initially targeting adoption by LLVM Flang, a new open-source Fortran compiler developed by a broad community in industry, academia, and government labs. We are also exploring the use of these features in Inference-Engine, a deep learning library designed to facilitate neural network training and inference for high-performance computing applications written in modern Fortran.

Rasmussen, Katherine↗
DOE OSTI2026

A Parametric Reduced-Order Model for Inverter Short-Circuit Response in Protection Studies

This paper presents a reduced-order model (ROM) for grid-following (GFL) inverters that reproduces inverter fault current trajectories, including sub transients, transient, and steady-state phases, across a range of fault types, locations, and pre-fault operating points. . The proposed model is developed by: Constructing the positive- and negative-sequence current with parameterization fitted by large data training and fitting Validating using EMT simulation against EMT full model and demonstrating the ROM's capability to capture fault current magnitude, phase angle, and oscillatory transients. Building a standard EMT simulation platform library component for easy configuration and application.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Scalable and Energy-Efficient Methods for Interactive Exploration of Scientific Data

The main scientific contributions of this project are the following novel concepts for multidimensional arrays: shape-based similarity join (SIGMOD 2016), incremental view maintenance (SIGMOD 2017), user-defined stencil functions (HPDC 2017), and distributed caching for in-situ processing (SSDBM 2018). Building on our collaboration with the astrophysics group at LBNL, we applied these techniques to the data generated in the Palomar Transient Factory (PTF) astronomical survey. They played a pivotal role in the first-ever observation of a neutron star merger, which produces gravitational waves and turns out to be the origin of heavy elements, including gold. This has lead to a Science magazine article that has received extensive media coverage on ACM TechNews, Slashdot, FiveThirtyEight, and Quanta Magazine, among others. Additionally, two other articles detailing related aspects of the same discovery have been published in the Astrophysical Journal Letters journal. These publications have more than 3,000 citations according to Google Scholar (as of February 2022). This cross-disciplinary collaboration provided very good opportunities to apply database techniques to real-life scientific problems. The fact that they facilitated major discoveries in astrophysics proves the importance of our research. In addition to the work on multidimensional array databases, this project has also developed stochastic gradient descent (SGD) optimization algorithms for training large scale machine learning models, methods for querying in-situ data, and a database query optimizer based on sketch synopses.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Using containers to speed up development, to run integration tests and to teach about distributed systems

GlideinWMS is a workload manager provisioning resources for many experiments including CMS and DUNE. The software is distributed both as native packages and specialized production containers. Following an approach used in other communities like web development we built our workspaces, system-like containers to ease development and testing. Developers can change the source tree or check out a different branch and quickly reconfigure the services to see the effect of their changes. In this paper, we’ll talk about what differentiates workspaces from other containers. We’ll describe our base system composed of three containers. A one-node cluster including a compute element and a batch system. A GlideinWMS Factory controlling pilot jobs. And a scheduler and Frontend, to submit jobs and provision resources. Additional containers can be used for optional components. This system can easily run on a laptop and we’ll share our evaluation of different container runtimes, with an eye for ease of use and performance. Finally, we’ll talk about our experience as developers and with students. The GlideinWMS workspaces are easily integrated with IDEs like VS Code, simplifying debugging and allowing development and testing of the system also when offline. They simplified the training and onboarding of new team members and Summer interns. And they were useful in workshops where students could have first-hand experience with the mechanisms and components that, in production, run millions of jobs.

Mambelli, Marco↗
DOE OSTI2025

Using Containers to Speed Up Development, to Run Integration Tests and to Teach About Distributed Systems

GlideinWMS is a workload manager provisioning resources for many experiments, including CMS and DUNE. The software is distributed both as native packages and specialized production containers. Following an approach used in other communities like web development, we built our workspaces, system-like containers to ease development and testing. Developers can change the source tree or check out a different branch and quickly reconfigure the services to see the effect of their changes. In this paper, we will talk about what differentiates workspaces from other containers. We will describe our base system, composed of three containers: a one-node cluster including a compute element and a batch system, a GlideinWMS Factory controlling pilot jobs, and a scheduler and Frontend to submit jobs and provision resources. Additional containers can be used for optional components. This system can easily run on a laptop, and we will share our evaluation of different container runtimes, with an eye for ease of use and performance. Finally, we will talk about our experience as developers and with students. The GlideinWMS workspaces are easily integrated with IDEs like VS Code, simplifying debugging and allowing development and testing of the system even when offline. They simplified the training and onboarding of new team members and summer interns. And they were useful in workshops where students could have first-hand experience with the mechanisms and components that, in production, run millions of jobs.

Mambelli, Marco [Fermilab] (ORCID:0000000294892681↗
DOE OSTI2021

Unbundling Smart Meter Services Through Spatio-Temporal Decomposition Agents in DER-rich Environment

Smart meters and the advanced metering infrastructure (AMI) facilitate distribution system operators (DSOs) to gather information on energy consumption at the customer level. With the increasing penetration of building-level intermittent distributed energy resources (DERs) behind the meter, DER information is not available to DSOs. At the same time, smart meter enables users to participate in grid, with real-time information. Information for behind the meter is needed by user to coordinate building level assets for maximum benefits. The concept of unbundled smart meter (USM) needs agents to decompose smart meter measurements to provide service to DSO as well as customers. In this paper, we propose a Spatio-Temporal Decomposition Agent (STDA) for USM based on Artificial Intelligence (AI). STDA can help users optimize their energy usage, help DSO to utilize building assets for the grid operation. The energy usage strategy developed by STDA is suitable for different users, and can be customized by deep learning (DL) models according to the different energy consumption habits of each user. The power prediction performance results of various DL models and evaluation using a set of data from a Hawaii utility is presented. Furthermore, STDA integration with Home Energy management Systems (HEMS) to manage resources is presented and validated. STDA pre-processes the measurements before model training, and provides the spatio-temporal decomposed forecasting.

42 ENGINEERING↗
DOE OSTI2020

Real-time Intrusion Detection for High-bandwidth Research Networks using Unsupervised Deep Learning

Nowadays, data generated by large-scale scientific experiments are on the scale of petabytes per month. These data are transferred through dedicated high-bandwidth networks across distributed collaboration sites for processing, storage, and analysis. Like general purpose networks, research networks experience attacks. However, monitoring traffic in such high-bandwidth network environments is challenging with conventional deep packet inspection (DPI)- based network intrusion detection systems (NIDS). Recently, machine learning (ML) algorithms have shown potential in detecting anomalous patterns with better generalizability and faster speed. Compared to the general purpose networks, traffic movement in research network is less volatile and more likely to benefit from the ML-based anomaly analysis. We present ThunderSecure, an efficient AI-powered system for detecting anomalies in 100G research networks. ThunderSecure implements a high-throughput packet processing infrastructure using multi-cores and GPUs. It takes time-series statistics from a variety of network measurements and uses 2D Convolutional Neural Network (CNN) to explore both spatial and temporal dependencies in network data stream. Patterns of science data traffic are learned with a one-class neural network, which blends an Adversarial Autoencoder (AAE) with Gaussian mixture density estimation. Testing traffic flows exhibiting significant deviations from the learned baseline of normality are marked as anomalies. We trained ThunderSecure on hundreds of billions of science data packets recorded from a 100G research network at Fermi National Accelerator Laboratory. The detection performance was evaluated on traffic captured from the same research network days and weeks after the training with different types of attack flows injected. To the best of our knowledge, this is the first ML work in the area of network anomaly detection that has been validated on such extreme scale datasets. Results show that ThunderSecure can recognize science data traffic that are captured long after the training and make nearly certain detection on those with anomalous flows injected, even in the case when the anomaly-to-normal mixing ratio is 0.1%.

Gong, Qian↗
DOE OSTI2023

Machine Learning in Power System Operations: Training Data

Reliability and stability of the electric grid today has depended upon operations of the grid which include the protective relay. Today, the electricity sector faces new challenges with the shift of generation resource characteristics away from the traditional “big iron” generation to inverter-based resources (IBR) which shift the physics and assumption used in grid operation and protection. These changing conditions represent new challenges for protective relays (identification of faults) and increased challenges for protection engineers (correct settings and configuration, reduction of mis-operations), both issues recognized in research and industry. Finding new approaches to reduce mis-operations in relaying and new approaches to fault identification is critical to grid operations. Using today’s modern technology of embedded systems, edge computing, machine learning (ML), and communications we can help address challenges and augment and improve on existing power system operations methodologies.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Developing Data-Driven Synthetic Infrastructure Models for Resilience Analysis

Research on infrastructure resilience has produced promising methods to simulate and optimize complex networks to improve performance. However, restrictions on sharing infrastructure models and the steep cost of developing and maintaining infrastructure models presents a roadblock to adoption. To overcome this limitation, this research focuses on methods to create data-driven infrastructure models that will help improve infrastructure resilience and security. The analysis couples incomplete utility data, geospatial data, machine learning, and synthetic network generation methods to rapidly develop and update infrastructure models. The methods are validated using realistic utility models and site-specific data, with a focus on Puerto Rico due to its unique infrastructure challenges and available data. This research highlights promising opportunities for the use of synthetic network generation and machine learning to create infrastructure models when very little data is available. Results demonstrate that hybrid methods, which combine sparse utility data with synthetic models, can enhance model accuracy, and machine learning can predict model attributes using training data from other models. However, the complexity of infrastructure systems means that even minor changes in network connectivity can significantly impact simulation results. Resilience analysis using synthetic infrastructure models shows that while some system behaviors are preserved, the magnitude of disruptions may not be accurately represented, indicating the need for more research and validation before using synthetic models for critical infrastructure investment decisions. The framework outlined in this report represents a significant advance to infrastructure model development and could be applied to additional domains and sites. Future research will continue to streamline and validate methods to help reduce roadblocks to resilience analysis.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Physics-informed neural networks for solving forward and inverse flow problems via the Boltzmann-BGK formulation

We report the Boltzmann equation with the Bhatnagar-Gross-Krook collision model (Boltzmann-BGK equation) has been employed to describe multiscale flows, i.e., from the hydrodynamic limit to free molecular flow. In this study we employ physics-informed neural networks (PINNs) to solve forward and inverse problems via the Boltzmann-BGK formulation (PINN-BGK), enabling PINNs to model flows in both the continuum and rarefied regimes. In particular, the PINN-BGK is composed of three sub-networks, i.e., the first for approximating the equilibrium distribution function, the second for approximating the non-equilibrium distribution function, and the third one for encoding the Boltzmann-BGK equation as well as the corresponding boundary/initial conditions. By minimizing the residuals of the governing equations and the mismatch between the predicted and provided boundary/initial conditions, we can approximate the Boltzmann-BGK equation for both continuous and rarefied flows. For forward problems, the PINN-BGK is utilized to solve various benchmark flows given boundary/initial conditions, e.g. Kovasznay flow, Taylor-Green flow, cavity flow, and micro Couette flow for Knudsen number up to 5. For inverse problems, we focus on rarefied flows in which accurate boundary conditions are difficult to obtain. We employ the PINN-BGK to infer the flow field in the entire computational domain given a limited number of interior scattered measurements on the velocity without using the (unknown) boundary conditions. Results for the two-dimensional micro Couette and micro cavity flows with Knudsen numbers ranging from 0.1 to 10 indicate that the PINN-BGK can infer the velocity field in the entire domain with good accuracy. Finally, we also present some results on using transfer learning to accelerate the training process. Specifically, we can obtain a three-fold speedup comparted to the standard training process (e.g., Adam plus L-BFG-B) for the two-dimensional flow problems considered in our work.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

Cross Section Measurements of Photonuclear Reaction Pathways Towards Promising Medical Radioisotopes

Project Objectives: The goal of this project was to generate data relevant to radioisotope production while developing innovative technologies that foster and enhance novel production of radioisotopes, and, also, while providing opportunities for cultivating and training future generations of scientists. This work has provided the foundation for methodologies for determination of photonuclear cross sections over multiple energies in a single irradiation. Simultaneously, the feasibility of electron LINAC production of several in-demand radioisotopes such as 47 Sc, 67 Cu, 77 As, and 186 Re has been demonstrated. To accomplish these objectives a collaboration was formed between two complimentary facilities, the Low Energy Accelerator Facility (LEAF) at Argonne National Laboratory and the High Intensity Gamma-ray Source (HIGS) at Triangular Universities Nuclear Laboratory (TUNL). The involvement of the research group from North Carolina Central University gave students at this Historically Black University experience in forefront nuclear-physics research relevant to addressing a high-priority interdisciplinary issue. Project Description: HIGS provides a nearly monoenergetic gamma-ray beam by intra-cavity Compton backscattering of free-electron photons from electrons circulating in a storage ring. This beam can be collimated to produce a very precise energy beam. If the beam is un-collimated a calculated and precise energy spread of the beam occurs radially. The γ-flux can be evenly distributed over the radial distribution of energy and used to perform activation experiments on concentric ring targets. Thus providing multiple energy ranges in a single irradiation. Each concentric ring target can be counted separately in order to determine activation at the given energy and successively be correlated to the activation cross section. Targets were activated to determine production feasibility using electron beams at LEAF. Potential Impact: The Nuclear Science Advisory Committee recently named production of radioisotopes with electron LINACs as one of the most compelling and largest-impact opportunities for the production of high specific activity radioisotopes. Improving the photonuclear cross sectional data base with experimentally verified results will greatly enhance a researcher’s ability to rationalize electron LINAC production routes towards desired radioisotopes. This work will provide the foundation for methodologies for determination of photonuclear cross sections over multiple energies and multiple targets in a single irradiation. The techniques developed in this project will enable future studies to continue verifying theoretically predicted photonuclear cross section with experimental results. These data will also enable adaptation of models and support more precise theoretical calculation of photonuclear cross sections. This research will involve undergraduates, graduate students, and post-docs to give them a valuable research experience leading towards the next generation of scientists in the field of medical isotopes.

07 ISOTOPE AND RADIATION SOURCES↗
DOE OSTI2024

A Generation-Storage Coordination Dispatch Strategy for Power System Based on Causal Reinforcement Learning

In the backdrop of global energy transformation, power systems integrating high proportions of renewable energy sources are facing unprecedented challenges in operational stability and dispatch efficiency. To address these challenges, this study introduces a generation-storage coordination real-time dispatch strategy based on Causal Power System Dynamic Reinforcement Learning (CPSDRL). Diverging from traditional reinforcement learning approaches, CPSDRL innovatively incorporates causal inference within the state prediction model - the crux of model-based reinforcement learning - thereby establishing the Power Causal Dynamic Model (PCDM). Assisted by the prior knowledge of power systems, the model significantly enhances prediction accuracy and reliability through a two-stage training process. Utilizing PCDM, this study further applies a direct policy search algorithm to optimize the real-time dispatch strategy. Experimental results indicate that the proposed method improves the stability of generation-storage coordination real-time dispatch and exhibits competitive advantages in sample efficiency and computational speed, compared to traditional model-based and model-free reinforcement learning algorithms. This method is expected to enhance the practicality and adaptability of causal reinforcement learning techniques in power system scheduling and control.

causal reinforcement learning↗
DOE OSTI2025

Review of Grey Box/Black Box Data Contamination Metrics on Open and Commercial Models

Dataset contamination is a problem where benchmarks and tasks used to evaluate the capabilities of Large Language Models (LLMs) have been incorporated into the training dataset of the models. This gives a false sense of performance that can overestimate how these models will function on truly unseen data. This problem becomes worse with commercial LLMs with larger and non-accessible training data, so techniques have been developed to try to measure the degree to which a model is contaminated with a benchmark’s data. To understand the effectiveness of these techniques, particularly when evaluating contamination on coding tasks, we review trends and categorize techniques by the degree of access to the model that is required. The research literature on this topic has reported mixed effectiveness of these techniques, so we select a set of black box (text access only) and grey box (access to model loss/probabilities required) techniques and apply them to both commercial and non-commercial models. We implement these metrics as part of a framework to test the contamination of Python code in LLMs to see to what extent we can replicate the effectiveness (or ineffectiveness) of these contamination detection techniques. Though we find mixed results in the capabilities of these metrics to identify contamination, we do observe evidence that they can identify contamination (broadly) in fine-tuned models when both a baseline and fine-tuned model is present. Additionally, similarity metrics were able to identify between contaminated and uncontaminated data even in situations where the data is distributionally similar (e.g., drawn from the same set of code projects).

97 MATHEMATICS AND COMPUTING↗