Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data needs”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,783 records · Page 99
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

DUNE Offline Computing Conceptual Design Report

This document describes Offline Software and Computing for the Deep Underground Neutrino Experiment (DUNE) experiment, in particular, the conceptual design of the offline computing needed to accomplish its physics goals. Our emphasis in this document is the development of the computing infrastructure needed to acquire, catalog, reconstruct, simulate and analyze the data from the DUNE experiment and its prototypes. In this effort, we concentrate on developing the tools and systems that facilitate the development and deployment of advanced algorithms. Rather than prescribing particular algorithms, our goal is to provide resources that are flexible and accessible enough to support creative software solutions as HEP computing evolves and to provide computing that achieves the physics goals of the DUNE experiment.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Distributed Energy Resource (DER) Reliability for Backup Electric Power Systems

Hospitals, emergency services, military bases, ports, airports, industries, commercial facilities, and others rely on backup power systems to provide electricity for their critical loads during grid outages. The purpose of this report it to provide accurate reliability information on commonly deployed distributed energy resources (DERs) to improve quantitative estimates for the reliability of these backup power systems during a grid outage. A backup power system consists of DERs, an electric distribution system with its associated switches and other devices, and mechanisms to control and manage the flow of electricity. Too often, facilities and campuses fail to properly quantify the reliability of their backup power systems. DERs are assumed to be 100% reliable, with the only concern being the availability of fuel. Such assumptions can lead to gross errors in the backup system's reliability estimates, particularly for long-duration outages. This report provides a set of estimates for reliability of emergency diesel generators (EDGs), natural gas prime generators and combined heat and power (CHP) prime movers, solar photovoltaics (PV), wind turbines, and Li-ion battery energy storage systems (BESS). The estimates are derived from empirical data when available and supplemented by modeling results when needed. These reliability estimates are for the DERs ability to provide power during a grid outage, ranging from an hour to 2 weeks.

14 SOLAR ENERGY↗
DOE OSTI2023

A Guide for Improved Resource Adequacy Assessments in Evolving Power Systems: Institutional and Technical Dimensions

This paper identifies and evaluates issues in traditional resource adequacy (RA) assessment practices, and how adjusting these practices may affect and depend on existing institutional arrangements for planning and procurement. The paper proposes a technical-institutional roadmap that would allow regulators in vertically-integrated jurisdictions and system planners and operators in restructured jurisdictions to revise RA practices across a range of components. First, we compile a critical review of current RA assessment practices based on (1) interviews with RA practitioners and (2) a review of recent technical literature. We find that (i) RA may need to expand beyond capacity adequacy to ensure energy adequacy – relevant for energy-limited resources such as storage – and potentially some form of ancillary service adequacy (e.g. enough ramping-up and ramping-down capability in the system); (ii) chronological hourly simulations for all hours in the year are the current best practice; (iii) metrics and models used do not reflect economic criteria in system operation and loss of load; and (iv) there is a need to improve representation of weather dependencies and weather data. Second, we review planning and RA reports for several private and public entities that plan generation and/or transmission infrastructure in the continental U.S. to look for existing practices involving resilience assessments. We find no systematic treatment of the costs of extreme weather and other hazards, the benefits of resilience, and resilience metrics in planning analyses and no systematic treatment of resilience metrics, methods, and outcomes for resource adequacy purposes. Third, we create a technical framework for probabilistic RA assessment and use it to study how key choices about how to model power system operations affect the values that are obtained for RA metrics. We find that (i) non-economic dispatch schemes that ignore economic objectives can lead to accurate RA assessments when coordinated with detailed operational strategies; (ii) multi-year data is critical to capture a wide variety of system conditions; (iii) not incorporating transmission limits into RA assessment could lead to substantial underestimation of traditional “expected value” RA metrics; and (iv) new RA metrics that capture event-specific shortfall characteristics should be used as supplements to traditional metrics. Finally, we examine RA assessments and use this information to propose a guide of evolving industry standards for resource adequacy assessments in resource planning and transmission planning. We report minimum, best, and frontier practices for temporal resolution of assessments, metrics and targets, weather data, load forecasting, characterization of variable renewable resources, characterization of transmission and market transactions, RA modeling and integration with planning processes, and capacity accreditation.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

Massively Parallel Bayesian Model Calibration and Uncertainty Quantification with Applications to Nuclear Fuels and Materials

The U.S. Department of Energy (DOE)’s Nuclear Energy Advanced Modeling and Simulation (NEAMS) program aims to develop predictive capabilities by applying computational methods to the analysis and design of advanced reactor and fuel cycle systems. This program has been providing engineering-scale support for the development of BISON, a high-fidelity and high-resolution fuel performance tool. Fuel behavior in a nuclear reactor is governed by a complex network of mechanisms interacting with various other physics aspects in the reactor system. Any model developed to represent the fuel behavior will likely be idealized resulting in uncertainties in their predictions compared to the observed data. As such, this report was motivated by the need to identify the sources of uncertainties and quantify and propagate them through the fuel model outputs. Such quantification of uncertainties will establish a level of model trustworthiness, identify approaches to improve the model trustworthiness, and even guide optimal experiment design for maximal information gain. To accomplish the uncertainty quantification for computational models, this report has relied on the Bayesian framework which provides probabilistic treatment of models their inputs and outputs. The current state-of-the-art on performing Bayesian Uncertainty Quantification (UQ) for nuclear engineering models using High Performance Computing (HPC) resources have been reviewed. Implementation of capabilities for massively parallel Bayesian UQ in Multiphysics Object-Oriented Simulation Environment (MOOSE) is discussed. Several verification cases are discussed to verify the accuracy of the quantified uncertainties using the developed computational capabilities in MOOSE. Then, the problem of quantifying the uncertainties in TRI-Structural isOtropic (TRISO) fuel silver release is addressed. For the first time, the uncertainties arising from the TRISO Fission Gas Release (FGR) model due to model inadequacy and experimental noise are quantified. Also, the Bayesian capabilities are applied to the calibration of the MATPRO creep model, a widely used model in several fuel assessment cases. The impact of the prediction uncertainties in the MATPRO model on the fuel cladding behavior as part of the TRIBULATION assessment case (which is an integral effects case) is investigated. This report concludes with a discussion on the future work for the UQ for computational models.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Investigation of Microphysics and Precipitation for Atlantic Coast-Threatening Snowstorms (IMPACTS) Field Campaign Report

The scientific focus here is interagency collaboration to support a National Aeronautics and Space Administration (NASA)-sponsored 2023 field campaign: Investigation of Microphysics and Precipitation for Atlantic Coast-Threatening Snowstorms (IMPACTS). IMPACTS objectives are to provide observations critical to understanding the mechanisms of snowband formation, organization, and evolution; study how the microphysical characteristics and likely growth mechanisms of snow particles vary across snowbands; and improve snowfall remote-sensing interpretation and modeling to significantly advance predictive capabilities. The relevance to The U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility's mission was to support the Interagency Council for Advancing Meteorological Services (ICAMS)’ objectives to enhance communication and coordination, and promote sharing, within and across agencies. NASA therefore requested to borrow ARM’s two-dimensional stereo probe (2DS) for possible use during the 2023 IMPACTS project. Additionally, this use of the 2DS could improve understanding of ARM 2DS measurements collected on previous field campaigns. The plan was to have the 2DS available for possible backup deployment on the NASA Lockheed Orion P-3 aircraft during the 2023 IMPACTS field project. NASA has a 2DS probe and the ARM 2DS is a hot swappable probe in case the project's 2DS fails. The 2DS is a critical probe and we had issues during a 2022 field project that prevented us from obtaining 2DS data on several flights. Hence, we wanted a hot swappable 2DS on stand-by. We have a data acquisition system, along with a backup data acquisition system for the 2DS, so we only needed the 2DS probe. David Delene was responsible for the use of the 2DS on the NASA P-3 aircraft. He has experience deploying the 2DS on several aircraft, including previously on the NASA P-3 in 2022. The team ensured that the aircraft wiring and deployment of the 2DS were completed correctly for the ARM 2DS.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Direct Air Capture-Based Carbon Dioxide Removal with United States Low-Carbon Energy and Sinks

The overall objective of this project was to complete an initial design of a commercial-scale, Carbon Capture and Storage system for Direct Air Capture (CCS-DAC) that separates and stores a minimum of 100,000 tonnes/year (t/yr.) net CO 2 from air. Three geographically diverse host sites will be used to determine the impact of different climates on the design and cost of the CCS-DAC systems; California (dry-hot), Louisiana (humid-hot), and Wyoming (mid-continental). In addition, the impact of using different low-carbon energy sources was also examined. The focus of this project was to geologically store the CO 2 , rather than the utilization of CO 2 . This Final Scientific/Technical Report is a collection of the deliverables for the project. The project team was able to successfully complete all the necessary tasks needed to determine the feasibility of the designs and operational needs of the DAC systems for each location. The data created by this allowed the project team to conduct the required evaluations to meet the requirements of the deliverables. The following deliverables were drafted and submitted to DOE prior to the conclusion of the project: (1) Initial Engineering Design; (2) Costing Estimate; (3) Techno-Economic Analysis (TEA); (4) Life Cycle Analysis (LCA); (5) Business Case Assessment; and (6) Technology EH&S Risk Assessment.

42 ENGINEERING↗
DOE OSTI2024

Evaluation of In-Situ AM Process Monitoring Techniques and Potential for Detecting Process Anomalies and Undesirable Microstructures

The US Department of Energy’s Advanced Materials and Manufacturing Technologies (AMMT) program is pursuing rapid qualification of new materials for fabrication of nuclear relevant components using advanced manufacturing techniques. Particular interest is placed on code-qualifying stainless steel (SS) 316H processed by laser powder bed fusion (LPBF) additive manufacturing. A paradigm that incorporates data from in-situ sensing during the printing, ex-situ characterization, and advanced artificial intelligence–based models was established under the Transformation Challenge Reactor (TCR) program to develop a pedigree for each fabricated component that could be tracked from the feedstock to the component’s release for application. Under the TCR program, the Peregrine software was developed as a tool for incorporating the vast amounts of in-situ and ex-situ characterization data collected; all data stored on a rapidly growing digital platform. The digital platform allows for users to link site-specific process anomalies to the macro- and microstructure. The platform will eventually be able to predict component performance, which will be crucial to qualifying materials and components in risk-averse industries such as those supporting and building nuclear reactors. Current in-situ process monitoring techniques that are already integrated with software like Peregrine are advantageous for identifying process anomalies including powder spatter, component edge swelling, recoating-build interactions, and so on. However, additional data are required to fully predict the resulting microstructures needed for identifying relationships to component performance. The rapid cooling rates observed in LPBF are some of the highest of any bulk manufacturing process, resulting in heterogenous microstructures and typically causing anisotropy in mechanical properties. Moreover, evolved residual thermal stresses are high, which can cause severe defects such as delamination or cracking. Therefore, other in-situ monitoring methods are warranted for exploration to measure and map the thermal history, and potentially the stress state, of each build. This report summarizes different in-situ monitoring strategies proposed for LPBF with a focus on the more developed sensor systems. Novel capabilities for measuring melt pool temperatures are also addressed to better inform modeling efforts.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Predicting secondary organic aerosol phase state and viscosity and its effect on multiphase chemistry in a regional-scale air quality model

Atmospheric aerosols are a significant public health hazard and have substantial impacts on the climate. Secondary organic aerosols (SOAs) have been shown to phase separate into a highly viscous organic outer layer surrounding an aqueous core. This phase separation can decrease the partitioning of semi-volatile and low-volatile species to the organic phase and alter the extent of acid-catalyzed reactions in the aqueous core. A new algorithm that can determine SOA phase separation based on their glass transition temperature (T g ), oxygen to carbon (O:C) ratio and organic mass to sulfate ratio, and meteorological conditions was implemented into the Community Multiscale Air Quality Modeling (CMAQ) system version 5.2.1 and was used to simulate the conditions in the continental United States for the summer of 2013. SOA formed at the ground/surface level was predicted to be phase separated with core–shell morphology, i.e., aqueous inorganic core surrounded by organic coating 65.4 % of the time during the 2013 Southern Oxidant and Aerosol Study (SOAS) on average in the isoprene-rich southeastern United States. Our estimate is in proximity to the previously reported ~70 % in literature. The phase states of organic coatings switched between semi-solid and liquid states, depending on the environmental conditions. The semi-solid shell occurring with lower aerosol liquid water content (western United States and at higher altitudes) has a viscosity that was predicted to be 10 2 –10 12 Pa s, which resulted in organic mass being decreased due to diffusion limitation. Organic aerosol was primarily liquid where aerosol liquid water was dominant (eastern United States and at the surface), with a viscosity <10 2 Pa s. Phase separation while in a liquid phase state, i.e., liquid–liquid phase separation (LLPS), also reduces reactive uptake rates relative to homogeneous internally mixed liquid morphology but was lower than aerosols with a thick viscous organic shell. The sensitivity cases performed with different phase-separation parameterization and dissolution rate of isoprene epoxydiol (IEPOX) into the particle phase in CMAQ can have varying impact on fine particulate matter (PM 2.5 ) organic mass, in terms of bias and error compared to field data collected during the 2013 SOAS. This highlights the need to better constrain the parameters that govern phase state and morphology of SOA, as well as expand mechanistic representation of multiphase chemistry for non-IEPOX SOA formation in models aided by novel experimental insights.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Multimodel simulation of vertical gas transfer in a temperate lake

In recent decades, several lake models of varying complexity have been developed and incorporated in numerical weather prediction systems and climate models. To foster enhanced forecasting ability and verification, improvement of these lake models remains essential. This especially applies to the limited simulation capabilities of biogeochemical processes in lakes and greenhouse gas exchanges with the atmosphere. Here we present multi-model simulations of physical variables and dissolved gas dynamics in a temperate lake (Harp Lake, Canada). The five models (ALBM, FLake, LAKE, LAKEoneD, MTCR-1) considered within this most recent round of the Lake Model Intercomparison Project (LakeMIP) all captured the seasonal temperature variability well. In contrast, none of the models is able to reproduce the exact dates of ice-cover and ice-off, leading to considerable errors in the simulation of eddy diffusivity around those dates.We then conducted an additional modeling experiment with a diffusing passive tracer to isolate the effect of the eddy diffusivity on gas concentration. Remarkably, sophisticated k -" models do not demonstrate a significant difference in the vertical diffusion of a passive tracer compared to models with much simpler turbulence closures. All models simulate less intensive spring overturn compared to autumn. Reduced mixing in the models consequently leads to the accumulation of the passive tracer distribution in the water column. The lake models with a comprehensive biogeochemical module, such as ALBM and LAKE, predict dissolved oxygen dynamics adequate to the observed data. However, for the surface carbon dioxide concentration the correlation between modeled (ALBM, LAKE) and observed data is weak (~0.3). Overall our results indicate the need to improve the representation of physical and biogeochemical processes in lake models, thereby contributing to enhanced weather prediction and climate projection capabilities.

Guseva, Sofya↗
DOE OSTI2021

Design Guidelines for Predicting Stress in Cemented Doublets Undergoing Temperature Change, Part 2

This work builds on prior work that developed a methodology for evaluating thermal stress in cemented doublets. The prior studies were limited by a paucity of actual test data, particularly from thermally tested cemented doublets. This follow-on study uses the existing methodology to estimate stresses in cemented doublets that have been tested for a temperature range from –40°C to 85°C and establishes safe stress levels using actual data. We also discuss limitations and concerns that we need to address to improve our understanding of cemented doublet failure.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Status of DUNE Offline Computing

We summarize the status of Deep Underground Neutrino Experiment (DUNE) Offline Software and Computing program. We describe plans for the computing infrastructure needed to acquire, catalog, reconstruct, simulate and analyze the data from the DUNE experiment and its prototypes in pursuit of the experiment's physics goals of precision measurements of neutrino oscillation parameters, detection of astrophysical neutrinos, measurement of neutrino interaction properties and searches for physics beyond the Standard Model. In contrast to traditional HEP computational problems, DUNE's Liquid Argon Time Projection Chamber data consist of simple but very large (many GB) data objects which share many characteristics with astrophysical images. We have successfully reconstructed and simulated data from 4% prototype detector runs at CERN. The data volume from the full DUNE detector, when it starts commissioning late in this decade will present memory management challenges in conventional processing but significant opportunities to use advances in machine learning and pattern recognition as a frontier user of High Performance Computing facilities capable of massively parallel processing. Our goal is to develop infrastructure resources that are flexible and accessible enough to support creative software solutions as HEP computing evolves.

43 PARTICLE ACCELERATORS↗
DOE OSTI2020

Use of the Manuela 3D/Radiation Scanning Tool at Nuclear Facilities - 20437

Licensees, facility operators and decommissioning contractors have a need for comprehensive, accurate and precise radiological and topographical data to plan and execute safe and efficient Decontamination and Decommissioning (D and D) projects. Traditional approaches rely greatly upon labor and administratively intensive data collection methods that require considerable time and effort to glean the relevant data to plan and perform work in a radiological work area. Orano Decommissioning Services has developed and utilized at French nuclear facilities a lightweight portable scanning instrument called MANUELA (Mobile Apparatus for Nuclear Expertise Localization Assistance). Recently Orano conducted demonstrations at two United States nuclear facilities using MANUELA that may prove useful in areas of the fuel cycle including: - ALARA (As Low As Reasonably Achievable) planning during facility operations; - Scoping and site characterization during the D and D planning phase; - Remedial action support during active decommissioning work; - Radiation and modeling planning for plant modifications; - Support Final Status Survey and demonstration of 'end state' compliance for license termination. MANUELA is currently being evaluated for use during decommissioning of nuclear facilities and could aide in demonstrating compliance with end state criteria after decommissioning. Of particular interest are decommissioning projects planned for various sites across the United States. Most of these sites present unique challenges and opportunities to safely and efficiently decommission in a regulatory compliant manner. The two demonstration site's current conditions of relatively low radiation levels inside containment proved to be ideal platforms to deploy the MANUELA instrument for evaluation of the complex geometries typically found in a nuclear facility. The MANUELA instrument was able to precisely identify local hot spots of the reactor system's primary equipment and was able to simultaneously overlay the dose information onto the scanned 3D images. Using data like this, a licensee would be able to make informed technical and personnel decisions on methods to remediate, shield or properly dispose of the radioactive source term. MANUELA can be used throughout the decommissioning process to validate progress and continue to refine the work activities to optimize the efforts of the crew which reduces downtime waiting for survey results, whereas traditional survey methodology relies on a physical survey to be performed and the data transcribed onto survey maps that are only two dimensional. The traditional format tends to be inaccurate and difficult to interpret the precise location(s) of hot spots or generalized dose rates. The resultant scan also allows the user to know the exact extent of the survey versus transposing information onto a map with only a portion of the map area scanned. MANUELA also compiles all of the relevant survey data into a downloadable table format which includes the measurement identification number, time stamp, point space location on the XYZ plane, and the dose rate value. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2024

Constrained curve fitting for semi-parametric models with radial basis function networks

Common to many analysis pipelines in lattice gauge theory and the broader scientific discipline is the need to fit a semi-parametric model to data. We propose a fit method that utilizes a radial basis function network to approximate the non-parametric component of such models. The approximate parametric model is fit to data using the basin hopping global optimization algorithm. Parameter constraints are enforced through Gaussian priors. The viability of our method is tested by examining its use in a finite-size scaling analysis of the $q$-state Potts model and $p$-state clock model with $q=2,3$ and $p=4,\infty$.

Peterson, Curtis T.↗
DOE OSTI2024

FFTF HT9 Cladding Microstructure Characterization

The sodium-cooled fast reactor (SFR) is a promising candidate for next generation nuclear reactors, operating at extreme conditions which include high temperatures (>500?C core outlet temperature) and significant neutron damage. High-Cr martensitic HT9 steel is an excellent candidate for SFR cladding and duct material due to its compatibility with liquid sodium, good thermal conductivity, resistance to void swelling, and strong creep rupture strength [1-4].However, the harsh in-core environment of SFRs can cause complex microstructural changes and mechanical property degradation in HT-9. Ensuring the safe use of HT9 cladding for metallic fuel requires both a thorough understanding of its mechanical response to microstructure evolution as well as reliable microstructure-sensitive modeling predictions. Microstructure-sensitive modeling of high temperature creep behavior in HT9 cladding for SFR applications currently lack experimental data to model the phenomena accurately. To fill this need, methods to perform microstructural characterization have been developed and performed on HT9.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Conditional diffusion machine-learning framework for mapping valence electron distribution from convergent beam electron diffraction

Quantitative convergent beam electron diffraction (CBED) enables determination of aspherical valence electron distributions through refinement of low-order structure factors, which are highly sensitive to chemical bonding and charge density variations. However, conventional quantitative CBED (QCBED) requires solving a highly nonlinear inverse problem with many coupled parameters, and computationally intensive dynamical diffraction calculations, making it time-consuming and difficult to apply to complex systems. More broadly, reconstructing charge density and orbital electron distribution from diffraction data has long been a central challenge in both x-ray and electron crystallography. Here, in this study, we introduce an artificial-intelligence (AI)-based framework that replaces traditional refinement with a data-driven inverse solver. Using a large synthetic CBED dataset generated by Bloch-wave simulations, we train a conditional diffusion model to directly infer crystal structural parameters and multipole density formalism parameters, and hence valence electron distributions, from CBED patterns alone. By learning from forward simulations across realistic parameter space, the model effectively solves the inverse problem. Compared with direct regression approaches, the diffusion-based framework provides posterior parameter distributions for rigorous uncertainty quantification while preserving quantitative fidelity and reducing analysis time by orders of magnitude. By eliminating the need for external single-crystal x-ray diffraction data and complex nonlinear refinement, this approach enables practical, high-throughput, and in situ quantitative CBED, enabling real-time mapping of valence electron distributions and their correlation with functional responses in quantum and energy materials.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2021

Workshop on Using a Git-based Repository for ASTM Committee Technical Knowledge Capture [Slides]

Consensus technical standards maintained by ASTM International rely on individual contributors to act as technical contacts, effectively stewards, for a particular standard. As a particular standard’s technical content evolves over time, the contact must update relevant tables, graphics, and supporting discussion. However, the details of the data sources and/or processes used to perform such updates may be separate enough from the standard such that expert knowledge is required to perform these updates. As a result of this need for expert knowledge, and the desire to capture that knowledge, subcommittee E10.05 (Nuclear Radiation Metrology) has experimented with using a git-based repository to capture data and processes to reproduce figures needed by E10.05 to maintain the ASTM standards under their jurisdiction. This workshop will provide an overview of the git-based repository site’s organization, operation, and outputs. It will then lead interested workshop participants through adding content, not yet already included in the repository to the site.

42 ENGINEERING↗
DOE OSTI2024

The Zwicky Transient Facility Bright Transient Survey. III. BTSbot: Automated Identification and Follow-up of Bright Transients with Deep Learning

Abstract The Bright Transient Survey (BTS) aims to obtain a classification spectrum for all bright ( m peak ≤ 18.5 mag) extragalactic transients found in the Zwicky Transient Facility (ZTF) public survey. BTS critically relies on visual inspection (“scanning”) to select targets for spectroscopic follow-up, which, while effective, has required a significant time investment over the past ∼5 yr of ZTF operations. We present BTSbot , a multimodal convolutional neural network, which provides a bright transient score to individual ZTF detections using their image data and 25 extracted features. BTSbot is able to eliminate the need for daily human scanning by automatically identifying and requesting spectroscopic follow-up observations of new bright transient candidates. BTSbot recovers all bright transients in our test split and performs on par with scanners in terms of identification speed (on average, ∼1 hr quicker than scanners). We also find that BTSbot is not significantly impacted by any data shift by comparing performance across a concealed test split and a sample of very recent BTS candidates. BTSbot has been integrated into Fritz and Kowalski , ZTF’s first-party marshal and alert broker, and now sends automatic spectroscopic follow-up requests for the new transients it identifies. Between 2023 December and 2024 May, BTSbot selected 609 sources in real time, 96% of which were real extragalactic transients. With BTSbot and other automation tools, the BTS workflow has produced the first fully automatic end-to-end discovery and classification of a transient, representing a significant reduction in the human time needed to scan.

Rehemtulla, Nabeel (ORCID:0000000256832389)↗
DOE OSTI2024

Integrating HPC, AI, and Workflows for Scientific Data Analysis: Report from Dagstuhl Seminar 23352

The Dagstuhl Seminar 23352, titled “Integrating HPC, AI, and Workflows for Scientific Data Analysis,” held from August 27 to September 1, 2023, was a significant event focusing on the synergy between High-Performance Computing (HPC), Artificial Intelligence (AI), and scientific workflow technologies. The seminar recognized that modern Big Data analysis in science rests on three pillars: workflow technologies for reproducibility and steering, AI and Machine Learning (ML) for versatile analysis, and HPC for handling large data sets. These elements, while crucial, have traditionally been researched separately, leading to gaps in their integration. The seminar aimed to bridge these gaps, acknowledging the challenges and opportunities at the intersection of these technologies. The event highlighted the complex interplay between HPC, workflows, and ML, noting how ML has increasingly been integrated into scientific workflows, thereby enhancing resource demands and bringing new requirements to HPC architectures, like support for GPUs and iterative computations. The seminar also addressed the challenges in adapting HPC for large-scale ML tasks, including in areas like deep learning, and the need for workflow systems to evolve to leverage ML in data analysis fully. Moreover, the seminar explored how ML could optimize scientific workflow systems and HPC operations, such as through improved scheduling and fault tolerance. A key focus was on identifying prestigious use cases of ML in HPC and understanding their unique, unmet requirements. The stochastic nature of ML and its impact on the reproducibility of data analysis on HPC systems was also a topic of discussion.

97 MATHEMATICS AND COMPUTING↗