Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Technical, Economic, Energetic, and Environmental Evaluation of Pretreatment Strategies for Scaling Control in Brackish Water Desalination Brine Treatment

Effective pretreatment is essential for achieving long-term stable operation and high water recovery during the desalination of alternative waters. This study developed a process modeling approach for technical, economic, energetic, and environmental assessments of pretreatment technologies to identify the impacts of each technology treating brackish water desalination brine with high scaling propensity. The model simulations evaluated individual pretreatment technologies, including chemical softening (CS), chemical coagulation (CC), electrocoagulation (EC), and ion exchange (IX). In addition, combinations of these pretreatment technologies aiming at the effective reduction of key scaling constituents such as hardness and silica were investigated. The three evaluation parameters in this assessment consist of levelized cost of water (LCOW, $/m 3 ), specific energy consumption and cumulative energy demand (SEC|CED, kWh/m 3 ), and carbon dioxide emissions (CO 2 , kg CO 2-eq /m 3 ). The case study evaluated in this work was the desalination brine from the Kay Bailey Hutchison Desalination Plant (KBHDP) with a total dissolved solids (TDS) concentration of 11,000 mg/L and rich in hardness and silica. The evaluation of individual pretreatment units from the highest to lowest LCOW, SEC|CED, and CO 2 emissions in the KBHDP brine was IX > CS > EC > CC, CS > IX > EC > CC, and CC > CS > EC > IX, respectively. In the case of pretreatment combinations for the KBHDP, the EC + IX treatment combination was shown to be the best in terms of the LCOW and CO 2 emissions. The modeling and evaluation of these pretreatment units provide valuable guidance on the selection of cost-effective, energy-efficient, and environmentally sustainable pretreatment technologies tailored to desalination brine applications for minimal- or zero-liquid discharge.

14 SOLAR ENERGY↗
DOE OSTI2026

Rapid Evaluation Framework for the CMIP7 Assessment Fast Track

As Earth system models (ESMs) grow in complexity and in volume of output data, there is an increasing need for rapid, comprehensive evaluation of their scientific performance. The upcoming Assessment Fast Track for the Seventh Phase of the Coupled Model Intercomparison Project (CMIP7) will require expeditious response for model analyses designed to inform and drive integrated Earth system assessments. To meet this challenge, the Rapid Evaluation Framework (REF), a community-driven platform for benchmarking and performance assessment of ESMs, was designed and developed. The initial implementation of the REF, constructed to meet the near-term needs of the CMIP7 Assessment Fast Track, builds upon four disparate community evaluation and benchmarking tools that are coupled together using the Coordinated Model Evaluation Capabilities (CMEC) framework. The REF runs within a containerized workflow for portability and reproducibility and is aimed at generating and organizing diagnostics covering a variety of model variables. The REF leverages well documented observational datasets to provide assessments of model fidelity across a collection of diagnostics. All diagnostics were identified and selected with community involvement and consultation. Operational integration with the Earth System Grid Federation (ESGF) will permit automated execution of the REF for selected diagnostics as soon as model output data are published on ESGF by the originating modeling centers. The REF is designed to be portable across a range of current computational platforms to facilitate use by modeling centers for assessing the evolution of model versions or gauging the relative performance of CMIP simulations before being published on ESGF. When integrated into production simulation workflows, results from the REF provide immediate quantitative feedback that allows model developers and scientists to quickly identify model biases and performance issues. After the REF is released to the community, its subsequent development and support will be prioritized by an international consortium of scientists and engineers, enabling a broader impact across Earth science disciplines. For instance, the REF will facilitate improvements to models and will enhance confidence in model projections through process-based selection of models based on their performance with respect to observations. Production of reproducible diagnostics and community-based assessments are key features of the REF. Furthermore, providing interoperability with existing evaluation packages assures that contributions from previous community efforts will be available for use in future model intercomparison projects.

Hoffman, Forrest [ORNL] (ORCID:0000000158024134)↗
DOE OSTI2025

Comparative evaluation and selection of heat exchangers using multicriteria decision-making

Here, this study presents a well-structured method for comparing and selecting Heat Exchanger (HE) technologies for Integrated Energy Systems (IES). The decision to select a HE for a particular IES configuration can vary greatly depending not only on engineering requirements but also on customer’s specific demand. In other words, the HE selection for IES requires a multicriteria decision-making approach, taking into account diverse technical, economic, and safety aspects, as well as the relative priorities considered by energy users. This study employs a HE evaluation approach combining multicriteria decision-making techniques widely used in various industries: quality function deployment (QFD) and analytic hierarchy process (AHP) techniques. Of particular interest is the use of the proposed method to select a high-temperature HEs that couples advanced nuclear reactors and industrial processes. To build a practical basis for comparing HEs within the proposed framework, efforts were made to identify the various HEs requirements for IES purposes. In addition, leveraging the insights obtained from the literature review and the market survey of commercial HE suppliers, a knowledge base was built to facilitate the comparison of each requirement across various HE designs. Also, evaluation metrics were identified for HE requirements with robust rational to enhance the quality of decisions made throughout the proposed evaluation process. The evaluation procedure and knowledge base described in this study can provide a useful basis for those interested in screening the appropriate HE designs for various IES scenarios.

Analytic Hierarchy Process (AHP)↗
DOE OSTI2024

Data-Informed Evaluation Framework for Integrated Energy Systems: Insights from Power, Process Heat, and Hydrogen Production Applications

The multi-criteria decision analysis (MCDA) framework provides a systematic evaluation of the diverse preferences and performance metrics associated with alternative solutions. This approach is advantageous over a single-criterion methodology, which are only valid under conditions that assume ceteris paribus or an "apples-to-apples" comparison. However, selecting suitable technologies for integrated energy systems (IES) can be likened to an "apples-to-oranges" comparison, given the heterogeneous factors at stake. These factors include economics and performance parameters, geological compatibility, and environmental impacts. Consequently, past research has often employed a mixture of qualitative and quantitative criteria tailored to the specific interests of each study. While the method proves effective in handling the intricate interplay of criteria, the resulting rankings and scores can vary from study to study. This inconsistency is introduced from the use of subjectively defined thresholds and weights. As a result, decision-makers frequently find it challenging to establish clear connections between specific criteria and the resulting scores, as the transformation of criteria into ordinal scores results in a substantial loss of information. To address this challenge, we introduce a data-informed IES evaluation framework that offers comprehensive, interpretable, and traceable evaluations backed by quantifiable rationale. First, we identified key IES evaluation criteria from a decade of literature, focusing on relevant IES applications in power, process heat, and hydrogen production. We leveraged state-of-the-art cost estimates from the Idaho National Laboratory (INL) and technical data from 78 reactor designs from the International Atomic Energy Agency (IAEA) and the Organization for Economic Co-operation and Development - Nuclear Energy Agency (OECD-NEA). Lastly, we established thresholds by analyzing the mean, variance, root mean square, and slope of values across alternatives, categorizing the preferences of decision-makers into distinct utility functions, such as linear, saturating, exponential, and stepwise. Our approach yielded two main outcomes: (1) it provided consistent assessments across different stakeholder groups and (2) it visualized uncertainties in the decision-making context via comprehensive sensitivity analysis. To demonstrate the impact of our framework, we conducted case studies on 6 reactor designs (AP1000, NuScale, BWRX-300, Xe-100, eVinci, iMSR) for the three applications. Our data-driven framework proved to be highly effective in addressing heterogenous uncertainties faced by varied decision-makers? preferences and IES applications, as well as cost and technical estimates of advanced reactors.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Building a Clean Energy Workforce: An Evaluation Framework for State Energy Office Workforce Programs

This fact sheet is a summary of the workforce evaluation framework that was first proposed in the white paper, An Evaluation Framework for State Energy Offices' Energy Efficiency and Clean Energy Workforce Program. This evaluation framework was developed to guide State Energy Offices (SEOs) in assessing and enhancing the workforce development programs the manage, fund, or partner on. By following this step-by-step framework, SEOs can evaluate program components, identify areas for improvement, and optimize program outcomes for greater impact.

clean energy↗
DOE OSTI2024

Data-Informed Evaluation Framework for Integrated Energy Systems: Insights from Power, Process Heat, and Hydrogen Production Applications

The multi-criteria decision analysis (MCDA) framework provides a systematic evaluation of the diverse preferences and performance metrics associated with alternative solutions. This approach is advantageous over a single-criterion methodology, which are only valid under conditions that assume ceteris paribus or an "apples-to-apples" comparison. However, selecting suitable technologies for integrated energy systems (IES) can be likened to an "apples-to-oranges" comparison, given the heterogeneous factors at stake. These factors include economics and performance parameters, geological compatibility, and environmental impacts. Consequently, past research has often employed a mixture of qualitative and quantitative criteria tailored to the specific interests of each study. While the method proves effective in handling the intricate interplay of criteria, the resulting rankings and scores can vary from study to study. This inconsistency is introduced from the use of subjectively defined thresholds and weights. As a result, decision-makers frequently find it challenging to establish clear connections between specific criteria and the resulting scores, as the transformation of criteria into ordinal scores results in a substantial loss of information. To address this challenge, we introduce a data-informed IES evaluation framework that offers comprehensive, interpretable, and traceable evaluations backed by quantifiable rationale. First, we identified key IES evaluation criteria from a decade of literature, focusing on relevant IES applications in power, process heat, and hydrogen production. We leveraged state-of-the-art cost estimates from the Idaho National Laboratory (INL) and technical data from 78 reactor designs from the International Atomic Energy Agency (IAEA) and the Organization for Economic Co-operation and Development - Nuclear Energy Agency (OECD-NEA). Lastly, we established thresholds by analyzing the mean, variance, root mean square, and slope of values across alternatives, categorizing the preferences of decision-makers into distinct utility functions, such as linear, saturating, exponential, and stepwise. Our approach yielded two main outcomes: (1) it provided consistent assessments across different stakeholder groups and (2) it visualized uncertainties in the decision-making context via comprehensive sensitivity analysis. To demonstrate the impact of our framework, we conducted case studies on 6 reactor designs (AP1000, NuScale, BWRX-300, Xe-100, eVinci, iMSR) for the three applications. Our data-driven framework proved to be highly effective in addressing heterogenous uncertainties faced by varied decision-makers? preferences and IES applications, as well as cost and technical estimates of advanced reactors.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

Potential of deep learning methods to enhance satellite-based monitoring of nuclear power plants focusing on remote operation evaluations

The anticipated expansion of the nuclear industry and the deployment of new nuclear reactors (200 + GW of new nuclear capacity by 2050) require the development of monitoring systems that align with safety and security concerns, providing enhanced evaluation capabilities. A remote monitoring system using satellites and deep learning techniques was evaluated for its ability to detect anomalies and capture various features of nuclear reactors independently of the conditions on the ground. Satellite images of current operational and under-construction nuclear power plants were collected from Google Earth Pro as a surrogate database. Subsequently, five datasets were created from the collected images. Transfer learning technique was used for several classification tasks utilizing VGG16, ResNet50V2, Xception, DenseNet121, and MobileNetV2 pre-trained models. In the first task, the capability of the monitoring system to detect abnormal conditions or processes in a nuclear power plant was investigated. In the second task, the ability to capture operational features remotely was examined. As an example, for the purposes of this study, these features included classifying reactors based on type, power range, or onsite condition. Several evaluation metrics were used to compare the performance of the pre-trained models and the overall monitoring system. Here, the evaluation results demonstrated that deep learning techniques and pre-trained models applied to satellite images have the potential to facilitate further and expand capabilities in monitoring systems to assess plant operation details.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Performance evaluation of finned tube heat exchanger using curved wavy delta winglet vortex generators with circular perforations

Vortex generation is recognized as an effective passive approach to improve the heat transfer rate in fin and tube heat exchangers (FTHEs). The current study proposed innovative designs of curved wavy delta winglet vortex generators (CWDWVGs), both without and with circular perforations, to improve the heat transfer efficiency of FTHEs. There is potential to increase heat transfer performance further through various CWDWVG designs. Here, this study explores seven unique CWDWVG configurations, from 1-wave to 7-wave. A 3-D computational numerical model is utilized to evaluate the Thermo-hydraulic performance of FTHEs fitted with these different CWDWVG configurations across Reynolds numbers from 400 to 2000. This comparative analysis of the Thermo-hydraulic performance of FTHEs featuring four parallel circular tube layouts assesses configurations both with and without vortex generators (VGs) and various hole configurations. The evaluation of Thermo-hydraulic performance involves different parameters, including the London area goodness factor (LAGF), Colburn factor (j), friction factor (f), pressure drop (?P), and Nusselt number (Nu). Results demonstrate that the various CWDWVG configurations and the number of holes in them substantially affect the efficiency, as evaluated by the dimensionless Performance Evaluation Criteria (PEC). Notably, the 7-wave CWDWVGs surpassed other configurations, and integrating circular punched perforations further improved the thermal-hydraulic performance of FTHE. Specifically, the 7-wave CWDWVGs without holes demonstrated superior performance over other configurations, showing a significant increase in Nusselt number by 75.18% and 85.16% at Reynolds numbers of 2000 and 400, respectively, alongside an increase in pressure drop by 216.38% to 224.96%. Meanwhile, the 7-wave CWDWVGs with eight holes, in comparison to those without holes, exhibited a Nusselt number increase of 0.85%, a pressure drop decrease of 7.31%, and a reduction in the friction factor by 5.82%.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Evaluation of RANS vs. LES simulation of fluid flow through 3 × 3 rod bundle with a simple spacer grid as a precursor to coupled fluid–structure interaction simulations

The research literature on Computational Fluid Dynamics (CFD) of coolant flow through rod bundles with spacer-grids and mixing vanes is replete, ranging from high fidelity Large Eddy Simulation (LES)/Direct Numerical Simulation (DNS) simulations to Reynolds-Averaged Navier–Stokes (RANS) modeled studies. The mixing of flow between subchannels and the pressure drop through the bundle are fundamental quantities useful for comparing and evaluating CFD methods. Less commonly observed and compared are the forces exerted onto the structure by the fluid. The present study seeks to evaluate the use of RANS simulations for predicting the structural response to fluid flow. Wall resolved RANS simulations are benchmarked against LES simulations of fluid flow at a Reynolds number of 15,000 through a 3 × 3 fuel rod bundle with a simple spacer grid. Velocity line-plots are compared showing good agreement between RANS and LES results, ascertaining that the former is capable of capturing the essential time-averaged velocity profile. Additionally, the distribution of forces on the spacer grid and fuel rods are collected as a function of time and space. The RANS methods are evaluated using the frequency and magnitude of the fluctuating forces on various portions of the structure as compared to LES. In conclusion, the power spectral density evaluation of the models reveal underprediction of force amplitude on the rod walls by RANS and also discrepancy in the prediction of high frequency spectra, especially in the immediate vicinity of spacer-grid structure, which may be attributed to the lack of random turbulence fluctuation or insufficient modeling of small-scale eddies in RANS simulation.

FIV↗
DOE OSTI2025

Implementation and Evaluation of Emission‐Driven Land‐Atmosphere Coupled Simulation in E3SMv2.1

Emissions-driven (prognostic CO 2 ) simulations are essential for representing two-way carbon-climate feedback in Earth System Models. We present an emissions-driven land–atmosphere coupled biogeochemistry (BGC) configuration (BGCLNDATM_progCO2) in version 2.1 of the Energy Exascale Earth System Model (E3SMv2.1). This is the first E3SM configuration that performs land-atmosphere emission-hindcasts. Here, we document its implementation, evaluate the model's performance against observations and other models, and propose a structured evaluation protocol for such emissions-driven simulations. We conducted transient historical simulations (1850–2014) with BGCLNDATM_progCO2 and compare them to reference simulations—a land-atmosphere coupled simulation without BGC and a standalone land simulation with BGC, both using prescribed CO 2 concentrations—and to observations. BGCLNDATM_progCO2 overestimates atmospheric CO 2 concentrations by 11–23 ppm yet stays within the 40-ppm spread CMIP6 emission-driven models and retains physical climate properties comparable to the reference runs. The CO 2 biases are partly attributed to underrepresented oceanic CO 2 uptake and inadequate representations of some terrestrial processes. In general, introducing prognostic CO 2 did not change physical climate metrics at the global scale but had larger regional effects, particularly over land where spatially heterogeneous CO 2 and prognostic leaf area index influenced surface energy balance. Finally, we propose a general evaluation protocol including spin-up assessment, atmospheric CO 2 benchmarking, physical climate evaluation, and land biogeochemical analysis to support scientific rigor and facilitate inter-model comparisons. The new configuration lays the groundwork for future enhancements, including improved terrestrial biogeochemical processes, integrated marine biogeochemistry, and additional human–Earth system interactions. These developments advance E3SM toward fully coupled emissions-driven simulations, enabling more accurate carbon–climate feedback projections and informing mitigation policy by providing physically consistent carbon-budget metrics for mitigation scenarios.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

An Evaluation and Qualification of U.S.-Based Research Reactors for Irradiation Capabilities Supporting Advanced Nuclear Systems

Irradiation experiments are a prerequisite for evaluating nuclear reactor system designs, analyzing the performance of these systems, and obtaining licenses. Likewise, irradiation facilities are necessary for producing the radioisotopes used in industrial and medical applications. Recent developments in modeling and simulation capabilities and advancements in computational resources have further enabled the design of irradiation experiments for evaluating radiation-induced phenomena and determining nuclear fuel, material, and system design and safety criteria pertaining to both normal and accident scenarios. These computational tools and models require comprehensive experimental datasets acquired under prototypic radiation conditions—for exploring material and system performance under the uniquely harsh environments found in nuclear reactors—to enable verification and validation for qualification and licensing purposes. However, qualification of irradiation experimental facilities, primarily research and test reactors (RTRs), necessitates that their performance be evaluated based on the irradiation environment (e.g. flux, power, testing capabilities) using an appropriate scoring matrix. Although many university campus RTRs are available for research and development (R&D) activities and initiatives, this study focuses on evaluating and qualifying the irradiation facilities (mostly RTRs) within the United States that are suitable for advanced nuclear fuel, material, and system irradiation experiments aimed at establishing operational-performance limits and informing component and fuel designs so as to improve operational efficiencies and mitigate proliferation vulnerabilities, as well as for radioisotope production aimed at multipurpose applications. As a result, the findings of the present study support the acceleration of nuclear fuel and material qualifications, thus hastening new and advanced nuclear energy system demonstrations and radioisotope production efforts by using extended R&D.

irradiation experiment↗
DOE OSTI2026

Commissioning and operation of a real-time multi-point Thomson scattering evaluation system at Wendelstein 7-X

A real-time multi-point Thomson scattering (rtMPTS) evaluation system has recently been installed and commissioned at the Wendelstein 7-X (W7-X) stellarator during the 2024 -2025 operational phases. This system has demonstrated successful evaluation of Thomson scattered spectra on millisecond timescales. We discuss initial results from this system, consisting of a comparison of different evaluation techniques, assessment of system evaluation times, and proof-of-principle control experiments carried out with the W7-X poloidal correlation reflectometer (PCR) system. This diagnostic represents the first step towards the development of a density profile controller at W7-X, which can be leveraged to support steady-state operation.

Mohammed, Ameer [Princeton Plasma Physics Laborato↗
DOE OSTI2024

Plan evaluation for heat resilience: complementary methods to comprehensively assess heat planning in Tempe and Tucson, Arizona

Abstract Escalating impacts from climate change and urban heat are increasing the urgency for communities to equitably plan for heat resilience. Cities in the desert Southwest are among the hottest and fastest warming in the U.S., placing them on the front lines of heat planning. Urban heat resilience requires an integrated planning approach that coordinates strategies across the network of plans that shape the built environment and risk patterns. To date, few studies have assessed cities’ progress on heat planning. This research is the first to combine two emerging plan evaluation approaches to examine how networks of plans shape urban heat resilience through case studies of Tempe and Tucson, Arizona. The first methodology, Plan Quality Evaluation for Heat Resilience, adapts existing plan quality assessment approaches to heat. We assess whether plans meet 56 criteria across seven principles of high-quality planning and the types of heat strategies included in the plans. The second methodology, the Plan Integration for Resilience Scorecard™ (PIRS™) for Heat, focuses on plan policies that could influence urban heat hazards. We categorize policies by policy tool and heat mitigation strategy and score them based on their heat impact. Scored policies are then mapped to evaluate their spatial distribution and the net effect of the plan network. The resulting PIRS™ for Heat scorecard is compared with heat vulnerability indicators to assess policy alignment with risks. We find that both cities are proactively planning for heat resilience using similar plan and strategy types, however, there are clear and consistent opportunities for improvement. Combining these complementary plan evaluation methods provides a more comprehensive understanding of how plans address heat and a generalizable approach that communities everywhere could use to identify opportunities for improved heat resilience planning.

Environmental Sciences & Ecology↗
DOE OSTI2024

An Evaluation of the Effect of Network Cost Optimization for Leadership Class Supercomputers

Dragonfly-based networks are an extensively deployed network topology in large-scale high-performance computing due to their cost-effectiveness and efficiency. The US will soon have three Exascale supercomputers for leadership class workloads deployed using dragonfly networks. Compared to indirect networks of similar scale, the dragonfly network has considerably reduced cable lengths, cable counts, and switch counts, resulting in significant network cost savings for a given system size, however, these cost reductions result in reduced global minimal paths and more challenging routing. Additionally, large scale dragonfly networks often require a taper at the global link level, resulting in less bisection bandwidth than is achievable in other traditional non-blocking topologies of equivalent scale. While dragonfly networks have been extensively studied, they have yet to be fully evaluated in an extreme scale (i.e., exascale) system that targets capability workloads. In this paper, we present the results of the first large scale evaluation of a dragonfly network on an exascale system (Frontier) and compare its behavior to a similar scale fat-tree network on a previous generation TOP500 system (Summit). This evaluation aims to determine the effect of network cost optimizations by measuring a tapered topology’s impact on capability workloads. Our evaluation is based on a collection of synthetic microbenchmarks, mini-apps, and full scale applications. It compares the scaling efficiencies of each benchmark between the dragonfly-based Frontier and the fat-tree-based Summit systems. Our results show that a dragonfly network is $\sim \mathbf{3 0 \%}$ more cost efficient than a fat-tree topology, which amortizes to $\sim 3 \%$ of an exascale system cost. Furthermore, while tapered dragonfly networks impose significant tradeoffs, the impacts are not as broad as initially thought and are mostly seen in applications with global communication patterns, particularly all-to-all (e.g., FFT-based algorithms), but also local communication patterns (e.g., nearest-neighbor algorithms) that are sensitive to network performance variability.

Khan, Awais↗
DOE OSTI2025

HPC Digital Twins for Evaluating Scheduling Policies, Incentive Structures and their Impact on Power and Cooling

Schedulers are critical for optimal resource utilization in high-performance computing. Traditional methods to evaluate sched- ulers are limited to post-deployment analysis, or simulators, which do not model associated infrastructure. In this work, we present the first-of-its-kind integration of scheduling and digital twins in HPC. This enables what-if studies to understand the impact of parameter configurations and scheduling decisions on the physical assets, even before deployment, or regarching changes not easily realizable in production. We (1) provide the first digital twin framework extended with scheduling capabilities, (2) integrate various top-tier HPC systems given their publicly available datasets, (3) implement extensions to integrate external scheduling simulators. Finally, we show how to (4) implement and evaluate incentive structures, as- well-as (5) evaluate machine learning based scheduling, in such novel digital-twin based meta-framework to prototype scheduling. Our work enables what-if scenarios of HPC systems to evaluate sustainability, and the impact on the simulated system.

Maiterth, Matthias [ORNL] (ORCID:000000018698460X)↗
DOE OSTI2025

Graph-based Reversible Evaluation and Tangents Library

GRETL is a C++ library for evaluation, re-evaluation and algorithmic differentiation of functional operations on an arbitrary computational graph with limited memory usage. Similar to popular machine learning frameworks in Python, like PyTorch and JAX, it tracks and stores both operations and output data as functions are evaluated. Once this composition of functions is built up, the entire chain of operations can be back propagated to compute sensitivities of the final result with respect to any number of inputs. In contrast to most machine learning applications, memory usage becomes the bottleneck for back propagation in many physics applications, especially for time-dependent PDEs. Dynamic check pointing becomes essential. An important distinguishing feature of GRETL is its ability to limit the maximum memory usage by automatically dynamic checkpointing the data output for each graph operation (see Wang, Moin, Iaccarino, 2009). During backpropagation, parts of the graph that are no longer in memory are automatically re-evaluated from upstream checkpointed states as needed for derivative sensitivity calculations (or more precisely, for vector-Jacobian products). GRETL is particularly beneficial for applications, such as coupled multi-physics, where deriving adjoint-based sensitivities and managing checkpoint memory across modules becomes onerous. Cases which can be readily handled by the GRETL library include: different time-integration algorithms per physics (e.g., coupled predictor-corrector algorithms, IMEX, etc.), sub-cycling, asynchronous integrators, state dependent timestep sizes, iterative solvers and coupling algorithms, controller algorithms, and more.

Tupek, MichaelR [Lawrence Livermore National Labor↗
DOE OSTI2025

Evaluation of Seismic Artificial Intelligence with Uncertainty

Artificial intelligence has transformed the seismic community with deep learning models (DLMs) that are trained to complete specific tasks within workflows. However, there is still a lack of robust evaluation frameworks for evaluating and comparing DLMs. Here, we address this gap by designing an evaluation framework that jointly incorporates two crucial aspects: performance uncertainty and learning efficiency. To target these aspects, we meticulously construct the training, validation, and test splits using a clustering method tailored to seismic data and enact an expansive training design to segregate performance uncertainty arising from stochastic training processes and random data sampling. The framework’s ability to guard against misleading declarations of model superiority is demonstrated through the evaluation of PhaseNet (Zhu and Beroza, 2018), a popular seismic phase picking DLM, under three training approaches. Our framework helps practitioners choose the best model for their problem and set performance expectations by explicitly analyzing model performance with uncertainty at varying budgets of training data.

58 GEOSCIENCES↗
DOE OSTI2025

Evaluating Function-as-a-Service (FaaS) frameworks for the Accelerator Control System

As particle accelerator control systems evolve in complexity and scale, the need for responsive, scalable, and cost-effective computational infrastructure becomes increasingly critical. Function-as-a-Service (FaaS) offers an alternative to traditional monolithic architecture by enabling event-driven execution, automatic scaling, and fine-grained resource utilization. This paper explores the applicability and performance of FaaS frameworks in the context of a modern particle accelerator control system, with the objective of evaluating their suitability for short lived and triggered workloads. In this paper, we evaluate prominent open-source FaaS platforms in executing functional logic, triggers, and diagnostics routines. Evaluation metrics consist of cold-start latency, scalability, performance, integration with other open-source tools like Kafka. Experimental workloads were designed to simulate real-world control tasks when implemented as stateless FaaS functions. These workloads were benchmarked under various invocation loads and network conditions. Self-hosted FaaS platforms, when deployed within accelerator networks, offer greater control over execution environment, better integration with legacy systems, and support for real-time guarantees when paired with message queues. Based on lessons learned and evaluation metrics, this paper describes reliability of the FaaS framework for the Accelerator Control Systems (ACS).

Jaikar, A. [Fermilab] (ORCID:0000000332046217)↗