Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation protocols”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Performance Assessments of Demand Flexibility from Grid-Interactive Efficient Buildings: Issues and Considerations

This SEE Action Network report explains basic concepts and fundamental considerations for assessing the actual demand flexibility performance of buildings participating in demand flexibility programs and responding to time-varying retail rates. Demand flexibility is the capability of distributed energy resources (DERs) to adjust a building’s load profile across different timescales. Assessments determine the timing, location, quantity, and quality of grid services provided. The results can be used for financial settlements and to improve performance of demand flexibility, support its consideration in resource potential studies and electricity system planning, and contribute to cost-effectiveness evaluations. While practitioners and regulators regularly find opportunities to improve performance assessments of demand-related services, to a large degree current best practices are sufficient for basic service offerings as demand flexibility is implemented today. However, advances in assessment practices will be required in a future with grid-interactive efficient buildings (GEBs) that provide continuous demand flexibility by integrating multiple DERs and flexibility modes (load shed, load shift, modulate, and generate). Example practices include using new baseline constructs—including whether baselines are even required for certain building flexibility modes or configurations, deploying more advanced metering and analytics, further developing cybersecurity standards, improving communication standards for increased interoperability, and establishing performance metrics and assessment procedures for load modulation as it is more fully defined and implemented. This report provides information on prioritizing and designing performance assessment elements for demand flexibility programs and time-varying retail rates, assessment protocols, and research and development needs. Additional research sponsored by DOE’s Building Technologies Office offers more detailed technical information on assessing performance of demand flexibility, including definition of performance metrics.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Timeseries Photos of a Variably Inundated Stream: Umtanum Creek, Washington, United States

This dataset is associated with a broader study using game camera timeseries photos collected to evaluate stream variable inundation via changes in width (i.e. wet fraction). Four game cameras were deployed along Umtanum Creek (Washington, United States) to track changes in stream inundation over time. Drone imagery was collected at the same location on October 18, 2024 which was used to construct a digital elevation model (DEM) of the streambed topography. The associated paper and data can be found at https://doi.org/10.1016/j.envsoft.2025.106715 (Bao et al., 2025a)) and https://doi.org/10.15485/2589885 (Bao et al., 2025b), respectively. For details on how to navigate data packages generated by this project, see https://data.ess-dive.lbl.gov/portals/PNNLRiverCorridorSFA/About. In addition to this readme, this data package also includes a file-level metadata (FLMD) files that describes each file and a data dictionaries (DD) that describe all column/row headers and variable definitions. This dataset is comprised of (1) file-level metadata; (2) data dictionary; (3) readme; (4) field metadata; (5) field protocol; and (5) folders containing game camera photos. Game camera photos are organized into folders for each camera (CDL, CUL, CDR, CUR; see readme for information on camera naming) by the month photos were collected. All files are .csv, .jpg, or .pdf.

AI image segmentation↗
DOE OSTI2021

Identification and Testing of Electric Vehicle Fast Charger Cybersecurity Mitigations

Fast-charging infrastructure for electric vehicles (EVs) is needed to enable and achieve the national goals of transitioning the vehicle fleet toward more electrification. Idaho National Laboratory, Oak Ridge National Laboratory, and the National Renewable Energy Laboratory (NREL) have jointly worked to identify, evaluate, and mitigate potential cyber-related consequences associated with fast charger systems. NREL contributed by considering cyberattack scenarios and consequences associated with integrating distributed energy resources (DERs) at fast-charging stations. The dynamic nature of fast-charger load profiles would encourage site operators to incorporate solar for energy cost reduction and energy storage for peak demand cost management at future charging facilities with multiple fast chargers at a site. These energy resources would be monitored and coordinated via a site energy management controller with data exchange between devices and local power metering infrastructure; thus, networking between devices and the design of the system becomes important in the overall cybersecurity posture. In addition, component vendors and system operators might have remote interfaces to any of these systems. It is therefore important to understand the breadth of the cyberattack surface and potential strategies to mitigate impacts. This project has focused on components and protocols expected to be found within a local charging site that includes multiple chargers and DER resources. Our methods and results are summarized in this final report.

42 ENGINEERING↗
DOE OSTI2022

Real-Time Hardware-in-the-Loop Testbed to Evaluate FLISR Implemented with OpenFMB

With the increasing complexity of the distribution smart grid architecture, algorithms such as the fault location, isolation, and service restoration (FLISR) scheme rely on robust communications that are resilient to natural and man-made adverse conditions and exhibit robustness. Existing communications infrastructure for information exchange are centralized at the distribution management system, with very little autonomy or intelligence at the grid-edge. As a first step towards achieving grid-edge self-healing, this paper aims to bridge this shortcoming by implementing a centrally coordinated rules-based FLISR scheme and integrating it with Open Field Message Bus (OpenFMB), which is a flexible publish-subscribe architecture with the potential to enable point-to-multipoint communications and is more robust and resilient to natural and man-made adverse conditions. A proof of concept is developed to validate the centrally coordinated FLISR and OpenFMB mounted on an SEL-3360 computer that interacts with a simple feeder network of five SEL-651R relays, an SEL-3530 RTAC, and a hardware-in-the-loop testbed. Results demonstrate the efficacy of this approach in enabling direct, low-latency information exchange. OpenFMB's publish-subscribe data model also opens new ways to enable grid-edge interoperability among devices of different vendors interacting with different protocols.

Sundararajan, Aditya↗
DOE OSTI2020

Curation of Ground-Truth Validated Benchmarking Datasets for Fault Detection & Diagnostics Tools

Fault detection and diagnostics (FDD) analytical tools for heating, ventilation and air conditioning (HVAC) systems represent one of the most active areas of smart building technology development. A diversity of techniques is used for FDD analytics, spanning physical models, black box, and rule-based approaches, and researchers continuously strive to develop improved algorithms. With FDD algorithm numbers now in the hundreds, there is a need for performance evaluation of these algorithms in order to assess improvements, improve costeffectiveness, and to prioritize investment in the further development of these technologies. A persistent challenge of FDD advance has been the lack of common datasets to benchmark the performance accuracy of FDD algorithms. This paper summarizes the successful curation of HVAC operational data, paired with validated ground-truth information regarding the presence and absence of faults. The current dataset, consisting of both simulation and experimental data, will evolve to include a larger set of HVAC systems with the objective of creating the largest publicly available dataset to be used by FDD developers, users, and researchers to compare and contrast performance accuracy across FDD algorithms, helping to drive improvements that will spur greater market adoption of FDD tools. Furthermore, in order to avoid previously observed issues with contributed datasets and ensure high quality and consistency of future submissions, the development of data validation and ground-truth assessment protocol is detailed in this study.

Casillas, Armando↗
DOE OSTI2023

Chemical abrasion: the mechanics of zircon dissolution

Chemical abrasion is a technique that combines thermal annealing and partial dissolution in hydrofluoric acid (HF) to selectively remove radiation-damaged portions of zircon crystals prior to U–Pb isotopic analysis, and it is applied ubiquitously to zircon prior to U–Pb isotope dilution thermal ionization mass spectrometry (ID-TIMS). The mechanics of zircon dissolution in HF and the impact of different leaching conditions on the zircon structure, however, are poorly resolved. We present a microstructural investigation that integrates microscale X-ray computed tomography (µCT), scanning electron microscopy, and Raman spectroscopy to evaluate zircon dissolution in HF. We show that µCT is an effective tool for imaging metamictization and complex dissolution networks in three dimensions. Acid frequently reaches crystal interiors via fractures spatially associated with radiation damage zoning and inclusions to dissolve soluble high-U zones, some inclusions, and material around fractures, leaving behind a more crystalline zircon residue. Other acid paths to crystal cores include the dissolution of surface-reaching inclusions and the percolation of acid across zones with high defect densities. In highly crystalline samples dissolution is crystallographically controlled with dissolution proceeding almost exclusively along the c axis. Increasing the leaching temperature from 180 to 210 °C results in deeper etching textures, wider acid paths, more complex internal dissolution networks, and greater volume losses. How a grain dissolves strongly depends on its initial radiation damage content and defect distribution as well as the size and position of inclusions. As such, the effectiveness of any chemical abrasion protocol for ID-TIMS U–Pb geochronology is likely sample-dependent. We also briefly discuss the implications of our findings for deep-time (U-Th)/He thermochronology.

58 GEOSCIENCES↗
DOE OSTI2024

Influence of electrical field on the susceptibility of gallium nitride transistors to proton irradiation

Radiation susceptibility of electronic devices is commonly studied as a function of radiation energetics and device physics. Often overlooked is the presence or magnitude of the electrical field, which we hypothesize to play an influential role in low energy radiation. Accordingly, we present a comprehensive study of low-energy proton irradiation on gallium nitride high electron mobility transistors (HEMTs), turning the transistor ON or OFF during irradiation. Commercially available GaN HEMTs were exposed to 300 keV proton irradiation at fluences varying from 3.76 × 10 12 to 3.76 × 10 14 cm 2 , and the electrical performance was evaluated in terms of forward saturation current, transconductance, and threshold voltage. The results demonstrate that the presence of an electrical field makes it more susceptible to proton irradiation. The decrease of 12.4% in forward saturation and 19% in transconductance at the lowest fluence in ON mode suggests that both carrier density and mobility are reduced after irradiation. Additionally, a positive shift in threshold voltage (0.32 V and 0.09 V in ON and OFF mode, respectively) indicates the generation of acceptor-like traps due to proton bombardment. high-resolution transmission electron microscopy and energy dispersive x-ray spectroscopy analysis reveal significant defects introduction and atom intermixing near AlGaN/GaN interfaces and within the GaN layer after the highest irradiation dose employed in this study. According to in-situ Raman spectroscopy, defects caused by irradiation can lead to a rise in self-heating and a considerable increase in (∼750 times) thermoelastic stress in the GaN layer during device operation. The findings indicate device engineering or electrical biasing protocol must be employed to compensate for radiation-induced defects formed during proton irradiation to improve device durability and reliability.

gallium nitride↗
DOE OSTI2020

Generalised hyper-Ramsey spectroscopy of two-level atoms in an optically dense medium

The peculiarities of Ramsey resonance and its sensitivity to the light shift from an optically dense medium of cold atoms are investigated. Different composite pulse protocols for clock spectroscopy, including hyper-Ramsey, modified and generalised hyper-Ramsey schemes, are compared. Error signals change significantly due to the processes of absorption and dispersion in the atomic medium. The dependence of the position of the central fringe resonance with a residual uncompensated light shift of the atomic transition is studied with the attenuation of the radiation intensity in the medium taken into account. It is shown that using a combination of generalised hyper-Ramsey error signals allows one to suppress the sensitivity to the light shift for any length of the medium. (laser cooling of atoms)

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2025

Esterification of 3-quinuclidinol, a marker for the incapacitant BZ, for analysis by EI-GC-MS in OPCW test matrices

The analysis by EI-GC-MS of 3-quinuclidinol (3Q), a marker for the riot control and incapacitating agent quinuclinidyl benzilate (BZ), using several, new acylation strategies is described. After evaluating and optimizing conditions for the acylations, these were tested on their ability to successfully derivatize 3Q in three different matrices featured in the 44th Organisation for the Prohibition of Chemical Weapons (OPCW) proficiency test (PT). As 3Q is a highly polar compound, the work here describes acylation strategies that generate 3Q analogs with superior gas chromatographic profiles relative to the underivatized material. The acyl groups studied in this work included acetyl, benzoyl, pentafluorobenzoyl and the bis(3,5-trifluoromethyl)benzoyl. The acylated 3Q products provide sharp, detectable peaks with significantly different retention times from that of the unmodified 3Q. Thus, the retention times for acetyl-, benzoyl-, pentafluorobenzoyl- and 3,5-bis(trifluoromethyl)benzoyl-3Q were determined to be 15.9, 24.9, 22.8 and 22.1 min respectively, in stark contrast to the unmodified 3Q which provides a sharp peak with a retention time centered at ~ 13.5 min only at high concentrations (> 10 µg/mL or µg/g) while a broad peak (RT ~ 15–15.5 min) at low concentrations (< 5 µg/mL or µg/g). The developed protocol was used to derivatize 3Q in three separate matrices. The first two matrices were liquid samples featured during the 44th OPCW PT at two separate concentrations in each (5 and 50 µg/mL). The last matrix was a soil sample featured in the same 44th OPCW PT wherein the 3Q had been spiked at a 12 µg/g concentration. The approach involves the extraction of 3Q from all matrices followed by its acylation resulting in a second reportable analytical method for an OPCW PT. The presented derivatization strategies should find wide applicability particularly in laboratories involved with the analysis of this chemical weapon agent degradation product and those participating in the yearly OPCW PTs.

3-quinuclidinol↗
DOE OSTI2021

Determining Partial Atomic Charges for Liquid Water: Assessing Electronic Structure and Charge Models

Partial atomic charges provide an intuitive and efficient way to describe the charge distribution and the resulting intermolecular electrostatic interactions in liquid water. Many charge models exist and it is unclear which model provides the best assignment of partial atomic charges in response to the local molecular environment. In this work, we systematically scrutinize various electronic structure methods and charge models (Mulliken, natural population analysis, CHelpG, RESP, Hirshfeld, Iterative Hirshfeld, and Bader) by evaluating their performance in predicting the dipole moments of isolated water, water clusters, and liquid water as well as charge transfer in the water dimer and liquid water. Although none of the seven charge models is capable of fully capturing the dipole moment increase from isolated water (1.85 D) to liquid water (about 2.9 D), the Iterative Hirshfeld method performs best for liquid water, reproducing its experimental average molecular dipole moment, yielding a reasonable amount of intermolecular charge transfer, and showing modest sensitivity to the local water environment. The performance of the charge model is dependent on the choice of the density functional and the quantum treatment of the environment. The computed molecular dipole moment of water generally increases with the percentage of the exact Hartree–Fock exchange in the functional, whereas the amount of charge transfer between molecules decreases. For liquid water, including two full solvation shells of surrounding water molecules (within about 5.5 Å of the central water) in the quantum chemical calculation converges the charges of the central water molecule. Furthermore, our final pragmatic quantum chemical charge-assigning protocol for liquid water is the Iterative Hirshfeld method with M06-HF/aug-cc-pVDZ and a quantum region cutoff radius of 5.5 Å.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Standardization and best practices in single-cell testing for liquid alkaline water electrolysis

The increasing demand for efficient and sustainable hydrogen production has driven significant advancements in water electrolysis technologies. Among these, liquid alkaline water electrolysis (LAWE) stands out for its cost-effectiveness and scalability. This manuscript establishes best practices and standardized testing procedures for single-cell LAWE, focusing on the use of nickel foam as both anode and cathode substrates, while incorporating catalysts such as nickel-iron layered double hydroxide (NiFe-LDH) as the anode material and nickel-molybdenum on carbon (NiMo/C) as the cathode material. By providing detailed guidelines on material preparation, cell assembly, and performance evaluation, this work offers a comprehensive framework to improve reproducibility and ensure consistency. The results demonstrate that applying these best practices minimizes variability across different laboratories and experimental setups, laying the groundwork for more robust comparisons and accelerating progress in LAWE research.

08 HYDROGEN↗
DOE OSTI2024

Parallel Simulation of Quantum Networks with Distributed Quantum State Management

Quantum network simulators offer the opportunity to cost-efficiently investigate potential avenues for building networks that scale with the number of users, communication distance, and application demands by simulating alternative hardware designs and control protocols. Several quantum network simulators have been recently developed with these goals in mind. As the size of the simulated networks increases, however, sequential execution becomes time-consuming. Parallel execution presents a suitable method for scalable simulations of large-scale quantum networks, but the unique attributes of quantum information create unexpected challenges. In this work, we identify requirements for parallel simulation of quantum networks and develop the first parallel discrete-event quantum network simulator by modifying the existing serial simulator SeQUeNCe. Our contributions include the design and development of a quantum state manager (QSM) that maintains shared quantum information distributed across multiple processes. We also optimize our parallel code by minimizing the overhead of the QSM and decreasing the amount of synchronization needed among processes. Using these techniques, we observe a speedup of 2 to 25 times when simulating a 1,024-node linear network topology using 2 to 128 processes. We also observe an efficiency greater than 0.5 for up to 32 processes in a linear network topology of the same size and with the same workload. We repeat this evaluation with a randomized workload on a caveman network. We also introduce several methods for partitioning networks by mapping them to different parallel simulation processes. We have released the parallel SeQUeNCe simulator as an open source tool alongside the existing sequential version.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Application of Peracetic Acid in Poultry Processing: Effects of Treatment Dynamics and Emerging Risk of Resistance Development in Salmonella spp.

Nontyphoidal Salmonella is a leading cause of foodborne illness, with poultry representing a major source. Peracetic acid (PAA), a widely adopted antimicrobial in poultry processing, offers advantages over traditional disinfectants but has sparked interest in its combined use with other antimicrobials and potential resistance. This review evaluates the efficacy of PAA in mitigating Salmonella in combination with other food-grade antimicrobials, explores possible synergism, efficacy under varying treatment parameters, resistance development against PAA, and its role in resistance evolution. While PAA demonstrates broad-spectrum efficacy, its performance varies with environmental parameters; higher temperatures generally enhance antimicrobial action but also accelerate PAA degradation. Organic matter diminishes PAA efficacy by reactive quenching. Variability in concentration and contact time further influences outcomes. Despite its oxidative mode of action and presumed low risk for resistance, emerging studies indicate that Salmonella can develop adaptive tolerance and potential cross/coresistance following repeated or sublethal exposure to PAA. These adaptations may involve genetic upregulation of oxidative stress response pathways, efflux systems, and modifications in cell membrane integrity, raising concerns about the long-term sustainability of PAA use. Additionally, combinatorial treatments (e.g., PAA with UV-C, enzymes, or organic acids) show promise in enhancing efficacy while mitigating resistance risks. Despite recognition of PAA's safety and effectiveness, knowledge gaps remain regarding standardized resistance definitions, serotype-specific tolerance, and optimal intervention strategies in commercial settings. Therefore, there is a need for standardized testing protocols, robust studies on potential resistance, and further exploration of synergistic PAA applications to ensure sustained poultry product safety and public health protection.

37 - INORGANIC, ORGANIC, PHYSICAL AND ANALYTICAL C↗
DOE OSTI2024

EV SALaD 2023 Demonstration: Best Practices and Mitigations for Protecting EVSE Infrastructure

The Electric Vehicle Secure Architecture Laboratory Demonstration (EV SALaD) program is a demonstration of cybersecurity best practices for high-power electric vehicle (EV) charging infrastructure led by Idaho National Laboratory (INL), in collaboration with other DOE National Laboratories participating in the EVs at Scale Consortium.a Sandia National Laboratories (SNL) and Pacific Northwest National Laboratory (PNNL) participated in the first 2-year (FY22-23) demonstration cycle for EV SALaD. This report documents the FY23 demonstration, the second in a series of demonstrations and collaborations in deploying and operating cybersecure EV charging infrastructure. It includes a summary of improvements from the FY22 demonstration, technical analysis of the FY23 demonstration, how the research demonstrates cyber-physical and cybersecurity best practices for high-power EV charging infrastructure, and related impacts to national and energy security. For EV SALaD, the FY22 demonstration focused on the detection, ranking, and prioritization of anomalous events for high-power EV charging. The FY23 demonstration additionally included the demonstration of cybersecurity best practices, which included protection and mitigation solutions to prevent, respond, and recover from anomalous events. During the demonstrations, the multi-lab EV SALaD team conducted a Test Effect Payload (TEP)b evaluation on extreme fast charger (XFC) hardware equipped with Cerberus, a detection and response solution, to demonstrate anomaly detection and mitigation cybersecurity best practices against cyber-enabled events.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2023

Impact of inoculation practices on microbiota assembly and community stability in a fabricated ecosystem

Studying plant-microbe-soil interactions is challenging due to their high complexity and variability in natural ecosystems. While fabricated ecosystems provide opportunities to recapitulate aspects of these systems in reduced complexity and controlled environments, inoculation can be a significant source of variation. To tackle this, we evaluated how different bacteria inoculation practices and plant harvesting time points affect the reproducibility of a microbial synthetic community (SynCom) in association with the model grass Brachypodium distachyon. We tested three microbial inoculation practices: seed inoculation, transplant inoculation, and seedling inoculation; and two harvesting points: early (14-day-old plants) and late (21 days post-inoculation). We grew our plants and bacterial strains in sterile devices (EcoFABs) and characterized the microbial community from root, rhizosphere, and sand using 16S ribosomal RNA gene sequencing. The results showed that inoculation practices significantly affected the rhizosphere microbial community only when harvesting at an early time point but not at the late stage. As the SynCom showed a persistent association with B. distachyon at 21 days post-inoculation regardless of inoculation practices, we assessed the reproducibility of each inoculation method and found that transplant inoculation showed the highest reproducibility. Moreover, plant biomass was not adversely affected by transplant inoculation treatment. We concluded that bacteria inoculation while transplanting coupled with a later harvesting time point gives the most reproducible microbial community in the EcoFAB-B. distachyon-SynCom fabricated ecosystem and recommend this method as a standardized protocol for use with fabricated ecosystem experimental systems.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Yes, No, Maybe So: Human Factors Considerations for Fostering Calibrated Trust in Foundation Models Under Uncertainty

High-stakes analytical environments require analysts to evaluate evidence and generate conclusions to inform critical decisions often under conditions of uncertainty. Probabilistic decision-making based on incomplete or inaccurate information can reduce productivity, compromise national interests, and endanger public safety. Researchers are developing expert systems built on foundation models (FMs) to support analysts’ decision-making processes by enabling human-artificial intelligence (AI) teaming, in part through the quantification and expression of uncertainty information. As FMs continue to mature, it is imperative to correspondingly consider analysts’ needs for appropriately interpreting and using uncertainty information. However, prior research indicates that it remains unclear how analysts engage with FM-generated uncertainty information and the extent to which these interactions influence trust in, and reliance on, expert systems. We plan to review the state of the science and conduct an exploratory, qualitative study to (a) understand how properly communicated uncertainty can foster calibrated trust and appropriate reliance and (b) identify approaches for effectively conveying FM-generated uncertainty information during analytical workflows. We will administer semi-structured interviews with analysts from a specific high-stakes analytical environment to collect their current experiences with job-related uncertainty and their impressions when viewing FM-generated uncertainty information. During the interview protocol, participants will be presented with several different FM outputs and invited to discuss their thoughts and beliefs about the uncertainty information displayed. Participants may provide insights into how trust and reliance may be influenced by uncertainty. The results of this study will help us to better understand how analysts currently interpret and use uncertainty information. Our findings may inform human factors recommendations for effectively conveying uncertainty information to foster calibrated trust in, and appropriate reliance on, expert systems. Interaction designers and FM developers can use this knowledge to enhance human-AI teaming and ensure the responsible deployment of FM-based expert systems in analytical workflows.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Assessment of task‐based performance from five clinical DBT systems using an anthropomorphic breast phantom

Purpose Digital breast tomosynthesis (DBT) is a limited‐angle tomographic breast imaging modality that can be used for breast cancer screening in conjunction with full‐field digital mammography (FFDM) or synthetic mammography (SM). Currently, there are five commercial DBT systems that have been approved by the U.S. FDA for breast cancer screening, all varying greatly in design and imaging protocol. Because the systems are different in technical specifications, there is a need for a quantitative approach for assessing them. In this study, the DBT systems are assessed using a novel methodology with an inkjet‐printed anthropomorphic phantom and four alternative forced choice (4AFC) study scheme. Method A breast phantom was fabricated using inkjet printing and parchment paper. The phantom contained 5‐mm spiculated masses fabricated with potassium iodide (KI)‐doped ink and microcalcifications (MCs) made with calcium hydroxyapatite. Images of the phantom were acquired on all five systems with DBT, FFDM, and SM modalities where available using beam settings under automatic exposure control. A 4AFC study was conducted to assess reader performance with each signal under each modality. Statistical analysis was performed on the data to determine proportion correct (PC), standard deviations, and levels of significance. Results For masses, overall detection was highest with DBT. The difference in PC was statistically significant between DBT and SM for most systems. A relationship was observed between increasing PC and greater gantry span. For MCs, performance was highest with DBT and FFDM compared to SM. The difference between PC of DBT and PC of SM was statistically significant for all manufacturers. Conclusions This methodology represents a novel approach for evaluating systems. This study is the first of its kind to use an inkjet‐printed anthropomorphic phantom with realistic signals to assess performance of clinical DBT imaging systems.

Ikejimba, Lynda C.↗
DOE OSTI2022

Procedure Parsing: A Method for Parsing Handwritten Documents into Computer-Based Procedures

The nuclear industry is heavily procedure driven, where almost everything has a step-by-step instruction that is expected to be followed in detail. Historically, these procedures were printed on paper copies. Recently, the industry transitioned towards electronic copies (i.e., PDFs on tablets). One major drive for this transition is the introduction of human error and loss of situation awareness when using paper copies. However, electronic copies of documents inherently have the same error traps as their paper cousins. Therefore, there is an increased interest in a way to utilize the information in the step-by-step guidance, but to present it in a dynamic manner that guides the user and adapts to any encountered conditions. Researchers at Idaho National Laboratory propose a flexible, automated method based on document parsing and augmented by natural language processing (NLP) techniques, to address these shortcomings and capitalize on these recent advancements in machine learning. The proposed method provides a cost-effective solution for computer-assisted procedure parsing of hand-written control room procedures, originally authored in Word or PDF formats, into instructions that can be displayed as computer-based procedures (CBP) in a modern graphical user interface. The researchers devised, implemented and demonstrated the Operating Procedure Extender for Novel Systems (OPENS) method in 2020. The key to OPENS is to map the original procedure text into a context-free grammar, tying content to equipment, locations, and other steps, actions, etc. This formal grammar is then used to isolate and define keywords and actions verbs, such as “measure” or “evaluate” and tie them to specific equipment referenced within that step or located in other steps, substeps, actions, subactions and tables throughout the procedure. OPENS generates an abstract syntax tree from the document which it uses to store a copy of this information in the open-standard, machine-readable and human-readable file formats XML and JSON. The XML is useful to preserve the relational aspects of the procedure for referencing tables and branching information so the user can be directed to the next appropriate active step based on the values entered for that step and previous steps. The JSON is useful for storing and exchanging data objects used to track responses to previous steps and state changes in simulated environments. In future iterations, these formats can also be used for storing more detailed information about input during plant operation or simulation. The techniques the researcher developed could further be improved by integration of recent advancements in machine learning. NLP methods could standardize documents, correct for grammatical error, and provide automated semantic validation. The researcher expects that self-supervised techniques applied to collections of natural language instructions could strengthen the model with broader context. All these methods together give us a practical way to automatically extract protocols from documents and user interactions, empowering researchers, procedure writers and nuclear operators while moving the industry forward.

99 GENERAL AND MISCELLANEOUS↗