SEARCH · Engineering Papers

Results for “Gap Assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

All sources NASA NTRS DOE OSTI

DOE OSTI2025

AI Benchmark Democratization and Carpentry

Benchmarks are a cornerstone of modern machine learning, enabling reproducibility, comparison, and scientific progress. However, AI benchmarks are increasingly complex, requiring dynamic, AI-focused workflows. Rapid evolution in model architectures, scale, datasets, and deployment contexts makes evaluation a moving target. Large language models often memorize static benchmarks, causing a gap between benchmark results and real-world performance. Beyond traditional static benchmarks, continuous adaptive benchmarking frameworks are needed to align scientific assessment with deployment risks. This calls for skills and education in AI Benchmark Carpentry. From our experience with MLCommons, educational initiatives, and programs like the DOE's Trillion Parameter Consortium, key barriers include high resource demands, limited access to specialized hardware, lack of benchmark design expertise, and uncertainty in relating results to application domains. Current benchmarks often emphasize peak performance on top-tier hardware, offering limited guidance for diverse, real-world scenarios. Benchmarking must become dynamic, incorporating evolving models, updated data, and heterogeneous platforms while maintaining transparency, reproducibility, and interpretability. Democratization requires both technical innovation and systematic education across levels, building sustained expertise in benchmark design and use. Benchmarks should support application-relevant comparisons, enabling informed, context-sensitive decisions. Dynamic, inclusive benchmarking will ensure evaluation keeps pace with AI evolution and supports responsible, reproducible, and accessible AI deployment. Community efforts can provide a foundation for AI Benchmark Carpentry.

von Laszewski, Gregor [Virginia U.]↗

DOE OSTI2021

Assessing cathode property prediction via exchange-correlation functionals with and without long-range dispersion corrections

In this work, we benchmark calculated interlayer spacings, average topotactic voltages, thermodynamic stabilities, and band gaps in layered lithium transition-metal oxides (TMOs) and their de-lithiated counterparts, which are used in lithium-ion batteries as positive electrode materials, against available experimental data. Specifically, we examine the accuracy of properties calculated within density functional theory (DFT) using eight different treatments of electron exchange-correlation: the strongly constrained and appropriately normed (SCAN) and Perdew–Burke–Ernzerhof (PBE) density functionals, Hubbard-U-corrected SCAN and PBE (i.e., SCAN+U and PBE+U), and SCAN(+U) and PBE(+U) with added long-range dispersion (D) interactions (i.e., DFT(+U)+D). van der Waals interactions are included respectively via the revised Vydrov-Van Voorhis (rVV10) for SCAN(+U) and the DFT-D3 for PBE(+U). We find that SCAN-based functionals predict larger voltages due to an underestimation of stability of the MO2 systems, while also predicting smaller interlayer spacings compared to their PBE-based counterparts. Furthermore, adding dispersion corrections to PBE has a greater effect on voltage predictions and interlayer spacings than with SCAN, indicating that DFT-SCAN – despite being a ground-state theory – fortuitously captures some short and medium-range dispersion interactions better than PBE. While SCAN-based and PBE-based functionals yield qualitatively similar band gap predictions, there is no significant quantitative improvement of SCAN-based functionals over the corresponding PBE-based versions. Finally, we expect SCAN-based functionals to yield more accurate property predictions than the respective PBE-based functionals for most TMOs, given SCAN's stronger theoretical underpinning and better predictions of systematic trends in interlayer spacings, intercalation voltages, and band gaps obtained in this work.

25 ENERGY STORAGE↗

DOE OSTI2022

Public Health Response and Medical Management of Internal Contamination in Past Radiological or Nuclear Incidents: A Review

Following a radiological or nuclear emergency, workers, responders and the public may be internally contaminated with radionuclides. Screening, monitoring and assessing any internal contamination and providing necessary medical treatment, especially when a large number of individuals are involved, is challenging. Experience gained and lessons learned from the management of previous incidents would help to identify gaps in knowledge and capabilities on preparedness for and response to radiation emergencies. In this paper, eight largescale and five workplace radiological and nuclear incidents are reviewed cross 14 technical areas, under the broader topics of emergency preparedness, emergency response and recovery processes. The review findings suggest that 1) new strategies, algorithms and technologies are explored for rapid screening of large populations; 2) exposure assessment and dose estimation in emergency response and dose reconstruction in recovery process are supported by complementary sources of information, including ‘citizen science’; 3) surge capacity for monitoring and dose assessment is coordinated through national and international laboratory networks; 4) evidence-based guidelines for medical management and follow-up of internal contamination are urgently needed; 5) mechanisms for international and regional access to medical countermeasures are investigated and implemented; 6) long-term health and medical follow up programs are designed and justified; and 7) capabilities and capacity developed for emergency response are sustained through adequate resource allocation, routine nonemergency use of technical skills in regular exercises, training, and continuous improvement.

61 RADIATION PROTECTION AND DOSIMETRY↗

DOE OSTI2023

Connective Actions for Educational Institutions and Wind Industry Firms [Slides]

As a part of the National Wind Workforce Assessment, four presentations have been created in conjunction with the technical report to provide more insight into key findings. The four presentations are catered towards specific stakeholder groups that include: educators, wind industry firms, students, and current wind industry employees. This presentation is intended for use by wind industry firms and educational institutions looking to gain insight into key levers and actionable steps that can be taken to help narrow the wind workforce gap. Data and guidance on how wind industry firms and education institutions can collaborate to 1) grow the number of graduates applying into wind occupational roles through increasing awareness of opportunities in the industry and 2) increase the quality of applicants applying into wind through relevant experience gaining opportunities like internships and apprenticeships is included in the presentation.

17 WIND ENERGY↗

DOE OSTI2023

Metagenomic Methods for Addressing NASA's Planetary Protection Policy Requirements on Future Missions: A Workshop Report

Molecular biology methods and technologies have advanced substantially over the past decade. These new molecular methods should be incorporated among the standard tools of planetary protection (PP) and could be validated for incorporation by 2026. To address the feasibility of applying modern molecular techniques to such an application, NASA conducted a technology workshop with private industry partners, academics, and government agency stakeholders, along with NASA staff and contractors. The technical discussions and presentations of the Multi-Mission Metagenomics Technology Development Workshop focused on modernizing and supplementing the current PP assays. The goals of the workshop were to assess the state of metagenomics and other advanced molecular techniques in the context of providing a validated framework to supplement the bacterial endospore-based NASA Standard Assay and to identify knowledge and technology gaps. In particular, workshop participants were tasked with discussing metagenomics as a stand-alone technology to provide rapid and comprehensive analysis of total nucleic acids and viable microorganisms on spacecraft surfaces, thereby allowing for the development of tailored and cost-effective microbial reduction plans for each hardware item on a spacecraft. Workshop participants recommended metagenomics approaches as the only data source that can adequately feed into quantitative microbial risk assessment models for evaluating the risk of forward (exploring extraterrestrial planet) and back (Earth harmful biological) contamination. Participants were unanimous that a metagenomics workflow, in tandem with rapid targeted quantitative (digital) PCR, represents a revolutionary advance over existing methods for the assessment of microbial bioburden on spacecraft surfaces. The workshop highlighted low biomass sampling, reagent contamination, and inconsistent bioinformatics data analysis as key areas for technology development. Finally, it was concluded that implementing metagenomics as an additional workflow for addressing concerns of NASA's robotic mission will represent a dramatic improvement in technology advancement for PP and will benefit future missions where mission success is affected by backward and forward contamination.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2022

Offshore Oil and Gas Infrastructure Reuse for CCS: Opportunities and Challenges in the U.S. Gulf of Mexico

The United States Gulf of Mexico has historically been a significant oil and gas producing region and continues to produce hydrocarbons today. As such, significant investments have been made to install oil and gas infrastructure such as pipelines, platforms, and wells. As these assets reach the end of their useful life or production associated with the assets is curtailed, the assets become a liability for both the owner/operators and the U.S. and state governments responsible for regulating the assets. There are costs and risks associated with safely decommissioning the assets, and in some cases, the assets may be abandoned (e.g., the owner is no longer a going concern). In parallel, carbon capture and storage (CCS) technology has developed in the United States and interest and incentives for CCS projects have accelerated in recent years, with many public announcements of CCS projects in development in the U.S. Gulf of Mexico region. The region is particularly well-suited to CCS due to the high density of industry on the coastline (i.e., CO 2 sources) and favorable geology in the near-offshore region. CCS also requires the use of many of the same assets required for oil and gas production (pipelines, platforms, wells) and the oil and gas industry has direct experience with CO 2 transport and injection (i.e., EOR). Therefore, the combination of existing infrastructure in close proximity to potential CCS project sites appears to provide a potential “win-win” solution for re-use of existing oil and gas assets. This paper presents a high-level evaluation of oil and gas infrastructure in the Gulf of Mexico with the goals of identifying the scale of the opportunity (e.g., how much existing infrastructure is realistically re-usable), identifying gaps in knowledge/policy/information required to evaluate existing infrastructure for re-use, and proposing key actions that could be pursued to further the assessment of existing infrastructure re-use for CCS.

Infrastructure, reuse, re-purpose, oil and gas, pi↗

DOE OSTI2024

Pathways for Agricultural Decarbonization in the United States

In the United States, agricultural production is both a significant source of greenhouse gases (GHGs) (Environmental Protection Agency (EPA), 2022) and uniquely susceptible to climate change impacts (Vermeulen et al., 2012). Decarbonization solutions have been proposed for addressing agricultural GHGs; however, research has been limited in synthesizing qualitative and quantitative analysis of potential GHG mitigation solutions in the United States. In this report, we review U.S. agricultural GHG sources by activity and quantify potential mitigation solutions based on a comprehensive data and literature analysis. We also discuss agricultural carbon sequestration options to offset GHG emissions. In our analysis, we identified two significant and hard-to-abate GHG sources (N 2 O from soil management, and CH 4 from enteric fermentation from livestock) as well as high-impact GHG mitigation solutions (e.g. agroforestry, reforestation, and biochar application) and cross-cutting GHG mitigation solutions (renewable energy production, precision agriculture, no-till, integrated nutrient management, and biochar). This report is meant to provide initial analysis and establish a foundation for future agricultural decarbonization research - it is not an exhaustive analysis of all available studies. However, to our knowledge this report is the most comprehensive assessment of agricultural GHG emissions and associated mitigation opportunities in the United States to date. Future empirical research is recommended to close research gaps in different climates, soils, and agricultural systems. Meta-analyses for all mitigation solutions would increase confidence in the estimated GHG mitigation potentials. To conclude this report, we discuss short-term and long-term pathways for agricultural decarbonization in the United States, the importance of accounting for total GHG fluxes, potential co-benefits of agricultural decarbonization, analysis of study data confidence, and research gaps.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2024

Wind Energy Instrumentation Development Roadmap

The current instrumentation for observing the complex flow fields in and around wind plants struggles to match the fidelity of existing simulation tools. As a result, these measurement limitations create a hurdle for validating and assessing the quality of the wind plant numerical models. This roadmap for instrumentation development recommendations was created to offer guidance on narrowing the gap between measurement and simulation fidelity. A process was established to identify where gaps in instrumentation exist for wind energy test campaigns by analyzing the capabilities of instrumentation for capturing the various important phenomena at the necessary resolution for both the science goal and validation objectives. To this end, a multi-disciplinary team of experts on instrumentation, wind energy, and atmospheric science was assembled to identify these significant instrumentation needs. A recommendation for instrumentation to be developed is provided, and the framework developed through this process is expected to be useful to the design of future test campaigns. The mapping tools developed for this process will be distributed as part of a future International Energy Agency Wind Technology Collaboration Program task on instrumentation development.

17 WIND ENERGY↗

DOE OSTI2023

FY23 status report on the development of new ASME Section III, Division 5 Class B rules

This report summarizes the work done in Fiscal Year 2023 on the development of the new American Society of Mechanical Engineers Boiler and Pressure Vessel Code, Section III, Division 5, Class B rules to address the gaps identified for high temperature reactor designs. The summary of the design-by-analysis strain limit evaluation and creep-fatigue damage assessment is presented. The proposed design-by-analysis creep-fatigue damage calculation approach uses a new elastic follow-up-based Isochronous Stress Strain Curve stress relaxation procedure. This approach captures the elastic follow-up generated due to interactions of components with adjacent components, supports, and other connections in the power plant. A set of sample problems are selected to validate the proposed design-by-analysis rules for creep-fatigue damage assessment. The proposed Class B rules are evaluated against the Class A elastic design rules, and the experimental data obtained from a family of Simplified Model Test based key-feature test results. The proposed Class B creep-fatigue damage assessment methodology yields conservative design cycles estimates compared to the experimental results.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2023

Trap-Assisted Auger-Meitner Recombination from First Principles

Trap-assisted nonradiative recombination is known to limit the efficiency of optoelectronic devices, but the conventional multiphonon emission (MPE) process fails to explain the observed loss in wide-band-gap materials. Here, we highlight the role of trap-assisted Auger-Meitner (TAAM) recombination and present a first-principles methodology to determine TAAM rates due to defects or impurities in semiconductors or insulators. We assess the impact on efficiency of light emitters in a recombination cycle that may include both TAAM and carrier capture via MPE. We apply the formalism to the technologically relevant case study of a calcium impurity in InGaN, where a Shockley-Read-Hall recombination cycle involving MPE alone cannot explain the experimentally observed nonradiative loss. We find that, for band gaps larger than 2.5 eV, the inclusion of TAAM results in recombination rates that are orders of magnitude larger than recombination rates based on MPE alone, demonstrating that TAAM can be a dominant nonradiative process in wide-band-gap materials. Furthermore, our computational formalism is general and can be applied to the calculation of TAAM rates in any semiconducting or insulating material.

36 MATERIALS SCIENCE↗

DOE OSTI2021

Systems Analysis Approach to Polyethylene Terephthalate and Olefin Plastics Supply Chains in the Circular Economy: A Review of Data Sets and Models

The environmental and economic impacts of implementing a circular economy in plastic waste supply chains are not well understood. The proposed systems analysis framework assesses environmental, social, and economic impacts of plastic waste supply chains in a circular economy. The first objective of this article is to identify datasets, models and knowledge gaps associated with waste plastic supply chain processes, mainly in the U.S. Our literature review indicated that the best datasets exist for virgin plastic resin production, mechanical recycling, landfilling, and incineration, with materials recovery facility being intermediate, and with chemical recycling the lowest. The second objective of this article is to develop an illustrative application of the framework by conducting a preliminary systems analysis of PET bottles with closed-loop recycling. Here, the preliminary systems analysis of PET bottles utilized a linear programming optimization method. Our optimization model indicated that both chemical and mechanical recycling processes are needed to achieve a true circular economy of PET bottles with the least greenhouse gas emissions, specifically reductions of 24% when compared with the linear economy. Good quality and standardized life cycle assessment and techno-economic analysis studies are needed to better understand the environmental, economic, and social impacts of advanced sorting and chemical recycling technologies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2021

Critical adjustment of land mitigation pathways for assessing countries' climate progress

Collective progress towards the Paris Agreement’s temperature targets will be assessed by the Agreement’s Global Stocktake process. Global emission pathways by Integrated Assessment Models (IAMs) are a likely benchmark against which aggregated countries’ greenhouse gas mitigation pledges will be assessed. However, this approach requires comparability, which is currently hampered by a 5 GtCO2yr-1 mismatch between the estimated global land anthropogenic flux of IAMs and countries’ GHG inventories (GHGIs) for 2005-2015. We show that this gap is mostly the result of differences in how the anthropogenic forest sink is defined. Countries define managed forest more broadly than IAMs, and on this larger area typically consider anthropogenic also fluxes due to human-induced environmental change, which IAMs do not include their pathways. Using five IAMs and a dynamic global vegetation model (DGVM), we present and apply a novel method that adjusts IAM results to the countries’ definition, closing the gap with GHGIs at global and regional scale. When expressed in a way compatible with GHGIs, adjusted 1.5°C and well-below 2°C pathways have a cumulative CO2 balance until carbon neutrality that is 110–176 GtCO2 lower than the original IAMs pathways. The use of these country-compatible emission pathways under the Global Stocktake would therefore be essential for an accurate assessment of the collective progress towards the Paris Agreement’s climate goals.

Grassi, Giacomo↗

DOE OSTI2024

FY24 Progress Report on Viscosity and Thermal Conductivity Measurements of Nuclear Industry Relevant Chloride Salts: An Experimental and Computational Study

As presented in this report, experimental and computational techniques were performed to assess the viscosity and thermal conductivity of key alkali and actinide chloride mixtures for molten salt reactor developers. These mixtures were pure LiCl, NaCl-KCl, LiCl-NaCl, LiCl-KCl, LiCl-NaCl-KCl, and NaCl-UCl 3 . Experimental measurements of viscosity were performed with a rolling ball viscometer, whereas experimental measurements of thermal conductivity were performed with a variable gap apparatus. Additional benchmarking work was performed using both property measurement systems to prepare for x-ray radiography in stainless-steel crucibles for viscosity and to ensure that calibration methods were accurate for thermal conductivity before assessing the NaCl-UCl 3 system. Validation data for the NaCl-UCl 3 in literature are minimal. Details on the calibration methods, salt measurement processes, and sources of error and uncertainty are discussed in detail for both property measurements. The computational methods described herein involved ab-initio molecular dynamics (AIMD) calculations using CP2K. The calculations were performed for the LiCl-KCl-NaCl and NaCl-UCl 3 systems. These calculations not only provided thermophysical property estimations for comparison to experimental data, but they also allowed for the determination of diffusion coefficients, coordination numbers, and radial distribution functions to provide insight into ion mobility and local coordination environments, which is linked to macroscopic property trends.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2024

An assessment of China’s methane mitigation potential and costs and uncertainties through 2060

Abstract China, the world’s largest methane emitter, is increasingly focused on methane mitigation in support of its climate goals, but gaps exist in the understanding of key methane sources, as well as mitigation opportunities and their associated uncertainties. We use a bottom-up modeling approach with updated methane emission projections and abatement cost analysis to account for additional sources, uncertainties, and mitigation measures in China’s energy and agricultural sectors. Here we show the significant cost-effective potential for reducing methane emissions in China by 2030, with 660 million tonnes of carbon dioxide equivalent possible with average negative abatement costs of US$6.40 per tonne CO 2 e. Most of this potential exists in the energy sector, particularly coal mining, but the greater potential will shift towards agriculture by 2060. Aquaculture and biochar applications in rice cultivation have net economic benefits but need greater support for deployment, while new mitigation measures will be needed for remaining emissions from enteric fermentation, rice cultivation, and wastewater.

Science & Technology - Other Topics↗

DOE OSTI2024

Comprehensive evaluation of commercially scalable atomic-layer-deposited alumina coating impact on full cell battery performance across varied test conditions

Atomic Layer Deposition (ALD) has emerged as a strategic enhancement method for lithium-ion battery (LIB) materials offering potential benefits and durability benefits for industrial battery production. However, the translation from laboratory achievements to commercial-scale applications has been limited. Here, this study aims to bridge this gap by comprehensively evaluating the effects of commercially scalable Al 2 O 3 ALD coatings using full pouch cell performance as a means to assess the ALD impact. We utilized large-scale slot-die coating techniques to ensure consistent electrode quality and tested four configurations of pouch cells to analyze the individual effects of ALD coating on anode and cathode electroactive materials. Our extensive testing matrix included long-term cycling, fast discharge, fast charge, leakage current, and high voltage tests. While at lower C-rates (<~1C), the influence of Al 2 O 3 coatings on cell performance is not significant. Fast charging conditions reveal that the anode ALD coating significantly enhances performance via a passivating effect, while on the cathode, it is detrimental, potentially due to increased resistance of the thin interfacial layer formed during the ALD processing. Leakage current and high-voltage tests show that the application of ALD coatings on either anode or cathode effectively minimizes side reactions at the electrode-electrolyte interface. Additionally, ALD coatings significantly mitigate concentrated and localized lithium plating on the anodes. These insights provide a valuable understanding of the potential of ALD technologies in LIB manufacturing to tailor cell performance, paving the way for safer, more efficient, and cost-effective battery solutions.

25 ENERGY STORAGE↗

DOE OSTI2020

Integrating environmental understanding into freshwater floatovoltaic deployment using an effects hierarchy and decision trees

Abstract In an era of looming land scarcity and environmental degradation, the development of low carbon energy systems without adverse impacts on land and land-based resources is a global challenge. ‘Floatovoltaic’ energy systems—comprising floating photovoltaic (PV) panels over water—are an appealing source of low carbon energy as they spare land for other uses and attain greater electricity outputs compared to land-based systems. However, to date little is understood of the impacts of floatovoltaics on the hosting water body. Anticipating changes to water body processes, properties and services owing to floatovoltaic deployment represents a critical knowledge gap that may result in poor societal choices and water body governance. Here, we developed a theoretically-derived hierarchical effects framework for the assessment of floatovoltaic impacts on freshwater water bodies, emphasising ecological interactions. We describe how the presence of floatovoltaic systems may dramatically alter the air-water interface, with subsequent implications for surface meteorology, air-water fluxes and physical, chemical and biological properties of the recipient water body. We apply knowledge from this framework to delineate three response typologies—‘ magnitude’ , those for which the direction and magnitude of effect can be predicted; ‘ direction’ , those for which only the direction of effect can be predicted; and ‘ uncertain’ , those for which the response cannot be predicted—characterised by the relative importance of levels in the effects hierarchy. Illustrative decision trees are developed for an example water body response within each typology, specifically, evaporative water loss, cyanobacterial biomass, and phosphorus release from bed sediments, and implications for ecosystem services, including climate regulation, are discussed. Finally, the potential to use the new understanding of likely ecosystem perturbations to direct floatovoltaic design innovations and identify future research priorities is outlined, showcasing how inter-sectoral collaboration and environmental science can inform and optimise this low carbon, land-sparing renewable energy for ecosystem gains.

Environmental Sciences & Ecology↗

DOE OSTI2020

Nature of the Correlated Insulator States in Twisted Bilayer Graphene

We use self-consistent Hartree-Fock calculations performed in the full $\pi$-band Hilbert space to assess the nature of the recently discovered correlated insulator states in magic-angle twisted bilayer graphene (TBG). In this work, we find that gaps between the flat conduction and valence bands open at neutrality over a wide range of twist angles, sometimes without breaking the system’s valley projected $\mathcal{C}_2\mathcal{T}$ symmetry. Broken spin-valley flavor symmetries then enable gapped states to form not only at neutrality, but also at total moiré band filling $\textit{n}$ = ± $\textit{p}/4$ with integer $\textit{p}$ = 1, 2, 3, when the twist angle is close to the magic value at which the flat bands are most narrow. Because the magic-angle flat band quasiparticles are isolated from remote band quasiparticles only for effective dielectric constants larger than ~20, the gapped states do not necessarily break $\mathcal{C}_2\mathcal{T}$ symmetry and as a consequence the insulating states at $\textit{n}$ = ± 1/ 4 and $\textit{n}$ = ± 3/4 need not exhibit a quantized anomalous Hall effect.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

DOE OSTI2020

An Assessment of the Usability of Machine Learning Based Tools for the Security Operations Center

Gartner, a large research and advisory company, anticipates that by 2024 80% of security operation centers (SOCs) will use machine learning (ML) based solutions to enhance their operations. 1 1 https://www.ciodive.com/news/how-data-science-tools-can-lighten-the-load-for-cybersecurity-teams/572209/ In light of such widespread adoption, it is vital for the research community to identify and address usability concerns. This work presents the results of the first in situ usability assessment of ML-based tools. With the support of the US Navy, we leveraged the national cyber range-a large, air-gapped cyber testbed equipped with state-of-the-art network and user emulation capabilities-to study six US Naval SOC analysts' usage of two tools. Our analysis identified several serious usability issues, including multiple violations of established usability heuristics for user interface design. We also discovered that analysts lacked a clear mental model of how these tools generate scores, resulting in mistrust a and/or misuse of the tools themselves. Surprisingly, we found no correlation between analysts' level of education or years of experience and their performance with either tool, suggesting that other factors such as prior background knowledge or personality play a significant role in ML-based tool usage. Our findings demonstrate that ML-based security tool vendors must put a renewed focus on working with analysts, both experienced and inexperienced, to ensure that their systems are usable and useful in real-world security operations settings.

Oesch, T↗