SEARCH · Engineering Papers

Results for “reliability metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Toward Drilling the Perfect Geothermal Well: An International Research Coordination Network for Geothermal Drilling Optimization Supported by Deep Machine Learning and Cloud Based Data Aggregation

The EDGE project, supported by the U.S. Department of Energy Geothermal Technologies Office under award DE-EE0008793, established a data-driven framework for improving the efficiency, cost-effectiveness, and reliability of geothermal well drilling. The project focused on developing scalable data infrastructure, advanced machine learning and probabilistic models, and integrated analytics tools to support continuous drilling optimization. A central objective was to reduce geothermal drilling costs by up to seventy percent while minimizing the risk of well failure through predictive diagnostics and adaptive planning. Over the project period, a comprehensive data repository was designed and deployed, incorporating records from over one hundred geothermal wells across varied geological settings. This repository supported both structured and unstructured data and adhered to FAIR data principles, enabling provenance tracking, quality control, and standardized metadata. The project introduced automated ingestion pipelines and a cloud-hosted platform that facilitated access to raw, processed, and derived datasets. This infrastructure served as the foundation for model development and analysis. Machine learning workflows were developed to predict key drilling metrics including rate of penetration, non-productive time, and total drilling costs. Self-organizing maps and dimensionality reduction methods were used to uncover operational patterns and outliers, while supervised learning algorithms such as random forests and deep neural networks were applied to forecast performance outcomes. The models were validated on heterogeneous datasets from both U.S. and Icelandic fields, demonstrating variable but significant predictive accuracy. The results indicated that finer temporal resolution, inclusion of lithological data, and consistency in operational annotations could substantially improve model performance. The project also implemented process mining techniques to reconstruct state-transition models from drilling event logs. These models enabled the identification of deviations from optimal workflows and provided insights into recurring failure modes. Analysis of non-productive time highlighted the impact of equipment failures, geological challenges, and human factors, offering opportunities for targeted mitigation strategies. The EDGE Dashboard was developed as a web-based expert system integrating data visualization, model outputs, and user-driven queries. It provided an accessible interface for operators to explore historical data, evaluate predicted outcomes, and compare drilling scenarios. Initial feedback from project partners suggested that the dashboard could serve as a foundation for more advanced advisory and optimization tools. Overall, the EDGE project demonstrated the feasibility and value of applying modern data science techniques to geothermal drilling. It delivered a set of interoperable tools and models that can support more efficient, lower-risk well development. The findings point toward a viable path for transitioning from advisory analytics to semi-autonomous drilling systems, contingent on continued collaboration, expanded datasets, and field validation. The project results have immediate relevance for drilling operations, data management practices, and future geothermal R&D efforts aimed at achieving reliable, cost-competitive geothermal energy at scale.

15 GEOTHERMAL ENERGY↗

DOE OSTI2025

Packages of Distributed Energy Technologies Demonstrating Demand Flexibility at Community Scale

The combination of increased electric load growth across all sectors, deferred electrical infrastructure investment, and other factors resulting in variable electric power supply, has created technical challenges to maintaining a resilient and reliable grid. Many federal, regional, and local efforts are in play to modernize the electric grid, including advancing building technologies and distributed energy resources (DERs) that are utilizing smarter controls to become responsive to both occupant and grid needs. This report reviews ten pilot projects demonstrating how groups of buildings combined with behind-the-meter (BTM) DERs such as electric vehicle (EV) charging, battery storage, flexible HVAC and domestic hot water systems, and photovoltaic systems can reliably and cost effectively provide grid services. Each of the ten pilot projects aim to deliver both energy efficiency and demand flexibility (DF) while supporting load growth. The ten demonstration teams are piloting flexible DER packages across diverse communities of residential and commercial buildings to address a variety of regional grid needs. The outcomes of these pilot projects will be used to inform future scaling through utility program development. This paper characterizes the ten teams, showcasing the decision-making process used by each group to develop their packages (Section 2), the grid services they plan to deliver (Section 3), the types of DER packages selected for deployment within building sectors (Section 4) and trends between building sector, DER types, and grid services In order to achieve community scale benefits, the pilot projects must utilize aggregated control mechanisms for coordinating buildings and DERs together. Several types of coordinated control architectures have evolved amongst the teams, influenced by use type, existing market conditions, and integration type. Three coordinated controls architectures have been characterized, highlighting their use cases, benefits, challenges, and tradeoffs in their design. These insights can aid utilities, control vendors, and developers in scaling community-level energy systems (Paul, 2024). Ultimately, the technology packages selected by the ten teams will be coordinated to provide power system services, also known as grid services. Insights from these demonstrations will be useful for grid operators, regulators, aggregators and other stakeholders as they look to deploy demand flexible resources as grid services in the future. The grid services that each team is targeting for demonstration are described in Section 3 and Section 4. Methods for evaluating the grid services have been described in the paper Metrics for Evaluating Grid Service Provision from Communities of Grid-interactive and Efficient Buildings and other DER (MacDonald, 2023). To identify technology packages for demonstration, Section 2 shows that project teams used a range of analysis approaches, including building energy modeling, AMI data analysis, cost-benefit frameworks, and utility pilot data. Some teams emphasized technical modeling to quantify grid impacts and demand reduction potential, while others prioritized economic evaluations, stakeholder input, or exploratory pilots to inform deployment decisions. This diversity reflects the need to tailor selection methods to project goals, available data, and organizational context. Section 5 discusses trends between the DER technologies deployed and the grid service provisions from each team. Residential buildings (multifamily and single family) lean towards technologies that enhance energy efficiency (e.g. weatherization upgrades, smart thermostats) and onsite power generation integration (e.g. solar PV). Commercial building demonstrations prioritize technologies that ensure operational reliability (e.g. battery storage) and centralized energy management systems and optimization solutions. Teams that are deploying controllable storage-based technologies are more likely to provide grid services that require a near real-time response. Teams incorporating load shifting technologies like smart thermostats with HEMs are likely to include energy markets participation and customer bill management offerings. Campus demonstrations are adopting diverse sets of DERs to emphasize renewable generation, paired with centralized control. This section also describes technologies that were considered during project planning but ultimately excluded from final deployment. These demonstrations reveal that effective DER package design should be tailored to building type, customer segment, and construction vintage. Multifamily buildings benefit from centralized HVAC upgrades and supervisory controls, while single-family homes are well-suited for individualized technologies like solar, storage, and smart home energy monitors. Commercial and campus settings prioritize EMIS integration and load optimization. New construction enables cost-effective integration of DER-ready infrastructure, whereas retrofits require deployments aligned with owner and tenant value streams. For utility program planners, early coordination with developers and building owners, paired with segmented and modular program offerings, can improve adoption, scalability, and grid impact.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2022

How Reproducible are Surface Areas Calculated from the BET Equation?

Abstract Porosity and surface area analysis play a prominent role in modern materials science. At the heart of this sits the Brunauer–Emmett–Teller (BET) theory, which has been a remarkably successful contribution to the field of materials science. The BET method was developed in the 1930s for open surfaces but is now the most widely used metric for the estimation of surface areas of micro‐ and mesoporous materials. Despite its widespread use, the calculation of BET surface areas causes a spread in reported areas, resulting in reproducibility problems in both academia and industry. To prove this, for this analysis, 18 already‐measured raw adsorption isotherms were provided to sixty‐one labs, who were asked to calculate the corresponding BET areas. This round‐robin exercise resulted in a wide range of values. Here, the reproducibility of BET area determination from identical isotherms is demonstrated to be a largely ignored issue, raising critical concerns over the reliability of reported BET areas. To solve this major issue, a new computational approach to accurately and systematically determine the BET area of nanoporous materials is developed. The software, called “BET surface identification” (BETSI), expands on the well‐known Rouquerol criteria and makes an unambiguous BET area assignment possible.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Meeting Global Health Needs via Infectious Disease Forecasting: Development of a Reliable Data-Driven Framework

Infectious diseases (IDs) have a significant detrimental impact on global health. Timely and accurate ID forecasting can result in more informed implementation of control measures and prevention policies. To meet the operational decision-making needs of real-world circumstances, we aimed to build a standardized, reliable, and trustworthy ID forecasting pipeline and visualization dashboard that is generalizable across a wide range of modeling techniques, IDs, and global locations. We forecasted 6 diverse, zoonotic diseases (brucellosis, campylobacteriosis, Middle East respiratory syndrome, Q fever, tick-borne encephalitis, and tularemia) across 4 continents and 8 countries. We included a wide range of statistical, machine learning, and deep learning models (n=9) and trained them on a multitude of features (average n=2326) within the One Health landscape, including demography, landscape, climate, and socioeconomic factors. The pipeline and dashboard were created in consideration of crucial operational metrics—prediction accuracy, computational efficiency, spatiotemporal generalizability, uncertainty quantification, and interpretability—which are essential to strategic data-driven decisions. While no single best model was suitable for all disease, region, and country combinations, our ensemble technique selects the best-performing model for each given scenario to achieve the closest prediction. For new or emerging diseases in a region, the ensemble model can predict how the disease may behave in the new region using a pretrained model from a similar region with a history of that disease. The data visualization dashboard provides a clean interface of important analytical metrics, such as ID temporal patterns, forecasts, prediction uncertainties, and model feature importance across all geographic locations and disease combinations. As the need for real-time, operational ID forecasting capabilities increases, this standardized and automated platform for data collection, analysis, and reporting is a major step forward in enabling evidence-based public health decisions and policies for the prevention and mitigation of future ID outbreaks.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2024

Assessing the Sensitivity of Pourbaix Diagrams to Computational Protocols: Electrochemical Stability of Ni Oxides as a Case Study

Pourbaix diagrams stand as a useful tool in assessing and visualizing materials’ electrochemical stability and are widely used for electrocatalyst design. However, their reliability hinges on the accuracy of the chemical potentials of involved phases, which may bear uncertainties and can be significantly impacted by decision-making steps in the computational protocol. Here, this study introduces a robust sensitivity analysis framework, exemplified through a detailed examination of the computational Pourbaix diagram of Ni, the oxides of which are used as high-activity and cost-friendly catalysts for many electrochemical reactions. Quantities of interest derived from the Pourbaix diagram include the appearance and stability domain of the catalytically active Ni oxide phases along with the onset electrochemical potentials of phase transitions. These metrics can guide the design of operational conditions for Ni oxide electrocatalysts. We find that the employed DFT exchange-correlation functional has the most significant influence on the computed Pourbaix diagram. Uncertainties on crystal structures, along with their related ab initio energetics, are also found to affect the size of the phase stability domain. Higher-order coupling among input parameters is found to play a crucial role in influencing the appearance and distribution of Ni phases in the diagram. Our findings suggest a need to consider variations and uncertainties associated with the computational procedures on predicted Pourbaix diagrams for materials design.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2021

A Comprehensive Framework for Valuation of Ecosystem Services in the Context of Hydropower

While models to value ecosystem services exist, they suffer from a lack of “portability” in the sense that a single modelling framework developed for one site cannot be imported and applied to another. Additionally, benefit estimations are often fragmented, incomplete, incomparable, and in heterogenous metrics, thus preventing aggregation to arrive at one comprehensive value. In the context of hydropower, the methods, as well as the metrics used to value the associated ecosystem services, vary between stakeholders (e.g., competing water users, agencies, etc.), detracting from the ability to assess the total value of a hydropower project, water management schemes, or comparing value between competing water users. Further, current methods to value water neglect non-market ecosystem services’ values by failing to account for externalities, resulting in misallocation of costs (e.g., obligatory stakeholder payments for water use) and misinterpretation of hydropower benefits. The benefit-cost ratios in hydropower development are often incomplete because non-market benefits are excluded (e.g., benefits, such as fish habitat resiliency and agricultural water reliability, derived from hydropower development). An approach to enable consistent, standardized hydropower benefit-cost analyses does not currently exist. This paper conceptualizes a methodology to standardize ecosystem services valuation in the context of hydropower projects through the integration of the U.S. Environmental Protection Agency’s existing Final Ecosystem Goods and Services Classification System framework and economic valuation techniques, and demonstrates the applicability of this methodology through a limited proof-of-concept application (the New Waddell Plant, a pumped hydroelectric energy storage facility in Phoenix, AZ). The beauty of our proposed framework lies in its ability to be imported and applied to any other pumped storage facility after accounting for site-specific features.

13 HYDRO ENERGY↗

DOE OSTI2023

Evaluation of Cathode Materials with Lithium-Metal Anodes: Baseline Performance and Protocol Standardization of Coin Cells

The collaborative evaluation of electrode materials across multiple research entities requires standardized electrochemical testing protocols to produce reliable, one-to-one comparisons between different systems of interest. Similar to the work done by Long et al. on protocol standardization for coin-cell testing with graphite anodes [J. Electrochem. Soc., 163, A2999, (2016)], here we introduce two standardized testing protocols designed to quickly evaluate important electrochemical properties of cathode materials using lithium-metal anodes. The two protocols measure kinetic and thermodynamic capacity losses, rate- and voltage-dependent cycling capacities, instabilities at high voltage and high cycling rate, and overpotentials at various states of charge. We then apply these protocols to four commercially available cathode materials to establish benchmark performance metrics that can be used to screen and evaluate new cathode materials.

25 ENERGY STORAGE↗

DOE OSTI2026

Enhancing Operational Safety via Agentic Dialogue Hazard Identification Analysis

Operational safety in high-stakes domains such as industrial process control, autonomous, and safety-critical systems demand reliable hazard identification. While large language models (LLMs) have shown promise in automating safety analysis tasks, single-turn, monolithic inference is brittle: it lacks the self-correction, deliberation, and contextual refinement that safety engineers apply iteratively. In this paper, we introduce HAZDIAL, a framework that investigates whether structured agentic dialogue (multi-agent, multi-turn interactions) improves the quality of NLP-based hazard identification over single-pass baselines. We systematically compare two dialogue modalities: adversarial debate and constructive discussion, and propose an genetic algorithm-based agentic interaction optimization. We evaluate all configurations against a curated golden dataset using standard classification metrics (accuracy, precision, recall, F1) and a novel dialogue metrics. This work advances the intersection of dialogue systems, multi-agent reasoning, and AI safety, providing empirical evidence for dialogue-driven hazard analysis.

Das, Sanjay [ORNL] (ORCID:0009000542591915)↗

DOE OSTI2025

Rapid Bayesian High Entropy Alloy Designs Fabricated via Wire Arc Additive Manufacturing

Purpose: This project seeks to demonstrate a new high-throughput (rapid) alloy design technique applied to creating new high entropy alloys (HEAs) for extreme environments. High entropy alloys shift the design paradigm from being focused on a single principal element (e.g. nickel-based alloys) to target alloys that include high atomic fractions (X >10%) of multiple elements. These HEA materials can exhibit sluggish diffusion and enhanced corrosion resistance, ideal for potential applications in advanced ultra supercritical (A-USC) steam cycles for power generation. Scope: The addition of multiple elements in high atomic fractions creates an enormous design space that cannot easily be investigated by traditional material design strategies such as designed of experiments (DOE). This project utilizes a Bayesian machine learning algorithm that has been modified to work with calculation of phase diagrams (CALPHAD) software. This Bayesian algorithm reduces manual inputs and increase the likelihood of achieving an optimal solution. Compositional inputs to this algorithm will be assessed using existing material property models for high temperature strength and corrosion resistance. The target for alloy performance will be a 15% (~100 ⁰C) increase in allowable service temperature beyond heat-resistant stainless steels while maintaining or improving alloy cost and corrosion resistance. Haynes 230 was selected as a baseline, which is 57 wt% Ni with 22 wt% Cr 14 wt% W, and 2 wt% Mo as solid solution strengtheners. In addition to rapid design via Bayesian machine learning, the alloys were rapidly fabricated using a multi-wire arc additive manufacturing (mWAAM) technique which allows for precise control of alloy composition and assessing of alloy design “windows” to study composition effects. Build speeds for wire-arc additive processes are among the highest for additive technologies enabling rapid and reliable sample fabrication when compared to conventional methods such as arc button melting. The mWAAM samples will be rapidly characterized via instrumented indentation for room temperature modulus and strength and for elevated temperature strength via hot hardness tests. After being screened with hardness testing, potential alloys will be further evaluated with conventional microscopy techniques including scanning electron microscopy (SEM) and transmission electron microscopy (TEM) to assess agreement with modeling results. The most promising compositions will also be evaluated by printing full sized tensile specimens for mechanical behavior tests at elevated temperatures. Results: Bayesian machine learning of a single performance function was initially used to optimize five performance metrics: 1) single phase stability, 2) yield strength, 3) creep resistance (low diffusion coefficient), 4) freezing range (weldability), and 5) material cost. The single performance function was suboptimal as assumptions had to be made about the results while formulating the optimization. A goal-oriented Bayesian optimization strategy (Hanaoka, 2021) was implemented with CALPHAD for use with the five metrics above. This multi-objective Bayesian optimization (MOBO) enabled the design of NiCrCoFe alloys with V and W additions. A base composition of NiCoCr was selected as Ni provides a stable FCC matrix, Cr aids corrosion/oxidation resistance, and Co is a solid-solutions strengthener that also improves creep by increasing the activation energy. Fe helps reduce diffusion coefficients and cost. Finally, V and W were selected for their reasonable solubility and high atomic misfit to aid in solid solution strengthening. Cracking of the mWAAM specimens was an early issue, and the Easton solidification cracking model (Easton et al., 2014a) was selected for addition to the MOBO function. High performing alloys fabricated by mWAAM included Ni 28 Cr 25 Co 26 Fe 15 V 8 and Ni 62 Cr 18 Co 1 Fe 3 W 15 . It was observed that even after adapting the mWAAM process for W, the W did not fully dissolve. To fully evaluate the Ni 62 Cr 18 Co 1 Fe 3 W 15 composition, a cored wire (80-20 NiCr sheath/powder core) was manufactured and printed via WAAM, and HIP’ing was utilized to homogenize and densify the printed alloy. The V and W alloys produced met metrics 1 (solid solution), 4 (solidification cracking), and 5 (cost). However, an unmodeled mechanism of thermal stress cracking was identified in the WAAM produced materials, perhaps exacerbated by the lack of grain boundary strengthening elements (B, C). Conclusions & Recommendations: A high-throughput (rapid) alloy design technique was applied to designing and manufacturing new high entropy alloys (HEAs) for extreme environments utilizing MOBO and mWAAM. The developed process was rapid and effective in addressing the mechanisms included in the model. The lack of grain boundary strengthening element additions (e.g., B, C) was a simplification that likely produced thermal stress cracking that turned into a large part of the investigation. Additions on the order of 0.005 wt% B and 0.05 wt% C likely would have minimized thermal stress grain boundary cracking. Overall, the high throughput design strategy is promising for rapid design of metrics-driven alloys for advanced ultra supercritical (A-USC) steam cycles for power generation. The MOBO and mWAAM process could be commercialized to accelerate metrics-driven alloy design. In addition, the cored-wire process utilized for scale-up is a promising high-volume process for WAAM alloy development and scale-up.

36 MATERIALS SCIENCE↗

DOE OSTI2024

Distribution Grid Impact Study in Highland Park, Michigan: Understanding Rooftop Solar, Behind-the-Meter Energy Storage, Electric Vehicle Charging, and Building Electrification [Slides]

Through the Communities LEAP (Local Energy Action Program) Pilot, the National Renewable Energy Laboratory (NREL) engaged the Highland Park Stakeholder Coalition to scope four technical assistance work areas to address their energy needs and goals. This slide deck addresses the highlighted tasks under work area "B" related to policy analysis, due diligence, and case studies for removing barriers and providing best practices for local clean energy development. Highland Park community members face frequent, long-duration power interruptions due largely to the aging distribution system serving the area and the legacy design standards used in its construction. While degrading physical infrastructure such as poles, crossarms, and transformers can result in this substandard reliability, another notable characteristic of this legacy system is the lower, 4.8 kV, voltage class. This is a legacy construction standard which many utilities, DTE included, are phasing out in favor of higher, 15 or 25 kV, voltage classes instead. The existing 4.8 kV distribution system serving Highland Park may limit significant adoptions of clean-energy technologies like high percentages of building electrification or electric vehicle adoption. The following analysis seeks to quantify these limitations under a variety of clean-energy technology adoption scenarios. It compares the overall system risks of the present system to those of a hypothetical, upgraded 13.2 kV system, using NREL-developed risk metrics and offers upgrade cost considerations. The legacy 4.8 kV voltage class serving Highland park is not, as we have modeled it, a major limitation to the widespread adoption of cost-optimal rooftop solar and/or behind-the-meter energy storage. Within our modeling framework, these technologies namely impact secondary, low-voltage assets, which may be remedied without the need for a system-wide upgrade to a 13.2 kV voltage class. Our model of the current 4.8kV system indicates it is not capable of supporting community-wide electrification efforts. Widespread building electrification, and the resulting large increase in wintertime load, dramatically increases the prevalence of voltage violations and thermal overloading on the current 4.8 kV distribution system. These impacts illustrate the need for system-wide upgrades to a 13.2 kV voltage class to accommodate these technologies. Low to Moderate DER adoption does not adversely impact the grid but does improve undervoltage and asset overloading issues. However, these benefits are insufficient to defer grid upgrades. Higher DER penetration is shown to increase overvoltage and asset overloading in future electrification scenarios.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2021

Managing Solar Photovoltaic Integration in the Western United States: Resource Adequacy Considerations

This study examines the impact of reserve margin-based reliability assessment, as commonly used in capacity expansion models, on planning resource-adequate power systems under high penetrations of solar photovoltaics (PV). As a generation resource, PV is operationally different from the conventional dispatchable resources for which most capacity expansion models were designed. The question this study attempts to answer is whether large amounts of PV on a system (in this case, the Western Interconnection of North America) would bias the results of conventional reserve margin-based capacity expansion modeling towards an over- or under-provisioning of resource adequacy. This analysis used NREL’s Resource Planning Model (RPM) for capacity expansion modeling and NREL’s Probabilistic Resource Adequacy Suite (PRAS) for resource adequacy assessment. RPM uses a reserve margin requirement to enforce resource adequacy. PRAS, a collection of tools for studying the resource adequacy of power systems and the adequacy contributions of individual resources on a probabilistic basis, was used to compute multiple resource adequacy metrics across a number of simulated scenarios and system representations with differing regional detail. In all cases, including high PV penetrations (up to 33% annual generation from PV, interconnection-wide), RPM was able to produce resource-adequate systems as measured by normalized expected unserved energy and loss-of-load expectation results from PRAS. The accuracy of reserve margin approaches depends heavily on the underlying assumptions informing the capacity credit assigned to variable and energy-limited resources, particularly when such resources are abundant in the modeled system. RPM’s standard methodology for estimating variable and flexible resources’ capacity contributions, which is based on the top 100 hours of net load, did not appear to systematically undervalue or overvalue variable generation relative to a more rigorous equivalent firm capacity assessment using PRAS, although both over- and under-valuations were observed in specific scenarios. In the worst cases, the top 100 hour method underestimated the equivalent firm capacity of PV by two percentage points, and overestimated the equivalent firm capacity of PV by five percentage points. Calculating capacity contributions based on the top 10 hours of net load systematically underestimated equivalent firm capacities at more modest PV penetrations, but was often a better approximation of equivalent firm capacity than the existing 100-hour approach in scenarios with higher PV penetrations.

14 SOLAR ENERGY↗

DOE OSTI2021

Informing nuclear physics via machine learning methods with differential and integral experiments

Information from differential nuclear-physics experiments and theory is often too uncertain to accurately define nuclear-physics observables such as cross sections or energy spectra. Integral experimental data, representing the applications of these observables, are often more precise but depend simultaneously on too many of them to unambiguously identify issues in the observable with human expert analysis alone. Here, we explore how we can leverage physics knowledge gained from differential experimental data, nuclear theory, integral experiments, and neutron-transport calculations to better understand nuclear-physics observables in the context of the application area represented by integral experiments. We support this task with machine-learning methods to discern trends in a large amount of convoluted data. Differential and integral information was used in an analysis augmented by the random forest and the Shapley additive explanations metric. We chose as an application area one that is represented by criticality measurements and pulsed-sphere neutron-leakage spectra. We show one representative example ( 241 Pu fission observables) where the combination of differential and integral information allowed to resolve issues in data representing these observables. As a starting point, the machine learning (ML) algorithms highlighted several observables as leading potentially to bias in simulating integral experiments. Differential information, paired with sensitivity to integral quantities, allowed us then to pinpoint one specific observable ( 241 Pu fission cross section) as the main driver of bias. The comparison to integral experiments, on the other hand, allowed us to indicate a likely reliable experiment among several discrepant ones for this observables. In other cases (e.g., 239 Pu observables), we were not able to resolve the confounding introduced by integral experiments but instead highlighted the need for targeted new experiments and theory developments to better constrain the nuclear-physics space for the application area represented by integral experiments. We were able to combine information from differential experimental data, nuclear-physics theory, integral experiments, and neutron-transport simulations of the latter experiments with the help of the random forest algorithm and expert judgment. This combination of knowledge allows to improve our description of nuclear-physics observables as applied to a particular application area.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2023

Deep neural network uncertainty quantification for LArTPC reconstruction

We evaluate uncertainty quantification (UQ) methods for deep learning applied to liquid argon time projection chamber (LArTPC) physics analysis tasks. As deep learning applications enter widespread usage among physics data analysis, neural networks with reliable estimates of prediction uncertainty and robust performance against overconfidence and out-of-distribution (OOD) samples are critical for their full deployment in analyzing experimental data. While numerous UQ methods have been tested on simple datasets, performance evaluations for more complex tasks and datasets are scarce. Here we assess the application of selected deep learning UQ methods on the task of particle classification using the PiLArNet monte carlo 3D LArTPC point cloud dataset. We observe that UQ methods not only allow for better rejection of prediction mistakes and OOD detection, but also generally achieve higher overall accuracy across different task settings. We assess the precision of uncertainty quantification using different evaluation metrics, such as distributional separation of prediction entropy across correctly and incorrectly identified samples, receiver operating characteristic curves (ROCs), and expected calibration error from observed empirical accuracy. We conclude that ensembling methods can obtain well calibrated classification probabilities and generally perform better than other existing methods in deep learning UQ literature.

47 OTHER INSTRUMENTATION↗

DOE OSTI2021

In-Home Mobility Frequency and Stability in Older Adults Living Alone With or Without MCI: Introduction of New Metrics

Background: Older adults spend a considerable amount of time inside their residences; however, most research investigates out-of-home mobility and its health correlates. We measured indoor mobility using room-to-room transitions, tested their psychometric properties, and correlated indoor mobility with cognitive and functional status. Materials and Methods: Community-dwelling older adults living alone ( n = 139; age = 78.1 ± 8.6 years) from the Oregon Center for Aging & Technology (ORCATECH) and Minority Aging Research Study (MARS) were included in the study. Two indoor mobility features were developed using non-parametric parameters (frequency; stability): Indoor mobility frequency (room-to-room transitions/day) was detected using passive infrared (PIR) motion sensors fixed on the walls in four geographic locations (bathroom; bedroom; kitchen; living room) and using door contact sensors attached to the egress door in the entrance. Indoor mobility stability was estimated by variances of number of room-to-room transitions over a week. Test-retest reliability (Intra-class coefficient, ICC) and the minimal clinically important difference (MCID) defined as the standard error of measurement (SEM) were generated. Generalized estimating equations models related mobility features with mild cognitive impairment (MCI) and functional status (gait speed). Results: An average of 206 days (±127) of sensor data were analyzed per individual. Indoor mobility frequency and stability showed good to excellent test-retest reliability (ICCs = 0.91[0.88–0.94]; 0.59[0.48–0.70]). The MCIDs of mobility frequency and mobility stability were 18 and 0.09, respectively. On average, a higher indoor mobility frequency was associated with faster gait speed (β = 0.53, p = 0.04), suggesting an increase of 5.3 room-to-room transitions per day was associated with an increase of 10 cm/s gait speed. A decrease in mobility stability was associated with MCI (β = −0.04, p = 0.03). Discussion: Mobility frequency and stability in the home are clinically meaningful and reliable features. Pervasive-sensing systems deployed in homes can objectively reveal cognitive and functional status in older adults who live alone.

Wu, Chao-Yi↗

DOE OSTI2025

Challenges in predicting protein-protein interactions of understudied viruses: Arenavirus-human interactions

Understanding protein-protein interactions (PPIs) between viruses and host organisms is crucial for uncovering infection mechanisms and identifying potential therapeutic targets. The ability to generalize PPI predictive models across understudied viruses presents a significant challenge. In this work, we use arenavirus-human PPIs to illustrate the difficulties associated with model generalization, which are compounded by a lack of both positive and negative data. We employ a Transfer Learning approach to investigate arenavirus-human PPIs by utilizing models trained on better-studied virus-human and human-human PPIs. Additionally, we curate and assess four types of negative sampling datasets to evaluate their impact on model performance. Despite the overall high accuracies (93–99 %) and AUPRC scores (0.8–0.9) appearing promising, further analysis indicates that these performance metrics can be misleading due to data leakage, data bias, and overfitting, especially concerning under-represented viral proteins. We reveal these gaps and assess the impact of data imbalance using standard k-fold cross-validation and Independent Blind Testing with a Balanced Dataset, resulting in a drop in accuracy below 50 %. We propose a viral protein-specific evaluation framework that categorizes viral proteins into majority and minority classes based on their representation in the dataset, enabling comparison of model performance across these groups using balanced accuracies. This framework offers a more robust evaluation of model generalizability, addressing biases inherent in standard evaluation techniques and paving the way for more reliable PPI prediction models for understudied viruses.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2026

Are Capacity and Energy Loss Equivalent Metrics for Battery Aging Reporting?

Battery aging in research publications and manufacturer specification sheets for individual cells is commonly reported as capacity (Ah) versus cycle number. However, the key measured quantity in battery-powered devices is energy (Wh), which is derived from integrating capacity with voltage. In this work, we compare the rate of capacity and energy loss across a wide range of Li-ion single-cell cycling studies with different positive electrode chemistries, charge–discharge rates, and temperatures. We find that the relative rate of discharge energy loss varies with cycling conditions. For many cells cycled under moderate conditions, the rate of discharge energy fade is only slightly faster than the rate of discharge capacity fade. However, some cells demonstrated up to a 15% decline in cycle count when 80% energy retention rather than 80% capacity retention was used as the end-of-life metric. These results highlight the importance of reporting cell aging based on energy fade to avoid overestimating battery lifetime in full systems.

batteries↗

DOE OSTI2024

Vertical instability forecasting and controllability assessment of multi-device tokamak plasmas in DECAF with data-driven optimization

Abstract Reliable vertical position control will be an essential element of any future tokamak-based fusion power plant in order to reduce disruptions and maximize performance. We investigate methods to improve vertical controllability boundary determination in plasma operational space and demonstrate a data-driven approach based on direct pseudoinversion of operational space data that is rigorously quantitative, applicable in real-time plasma control systems, and physically intuitive to interpret. Applied to historical shot data from entire run campaigns on the MAST-U, KSTAR, and NSTX tokamaks, this approach, implemented in DECAF, improves vertical displacement event identification accuracy to 98.9%–100%. Further, we explore the application of a physics-based vertical stability metric as an early warning forecaster for vertical displacement events. The development of a linear surrogate model for the plasma current density profile, with a coefficient of determination of 0.992 on the training dataset, enables potential employment of this forecaster in real-time. The application of this approach on historical data from the MAST-U MU02 campaign yields a forecaster with 62.6% accuracy, indicating promise for this method when further refined and potentially coupled with other stability metrics.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2026

Evaluating multistation phase picking algorithm phase neural operator (PhaseNO) on local seismic networks

Reliable automatic phase picking is important for many seismic applications. With the development of machine learning approaches, many algorithms are proposed, evaluated and applied to different areas. Many of these algorithms are single station based, while recent proposed methods start to combine surrounding stations into consideration in the problem of phase picking. Among these algorithms, the phase neural operator (PhaseNO) shows promising results on regional data sets comparing to existing algorithms. But there are many use cases for the local seismic networks in our community, therefore in this paper we evaluate the performance of PhaseNO on four different local data sets and compare the results to PhaseNet and EQTransformer. We used both individual phase picking metrics as well as association metrics to illustrate the performance of PhaseNO. By manually reviewing the newly detected events, we find that the PhaseNO model outperforms the single station-based approaches in the local-scale use cases due to its consideration of coherent signals from multiple stations. We also explored PhaseNO’s behaviours when only using one station, as well as gradually increasing the number of stations in the seismic network to better understand its behaviour. Overall, using the off-the-shelf machine learning based phase pickers, PhaseNO demonstrated its good performance on local-scale seismic networks.

58 GEOSCIENCES↗