Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Variational methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24

Durability Research Is Pivotal for Perovskite Photovoltaics

Metal halide perovskite solar cells have shown promising power conversion efficiencies, but commercialization requires that decent durability is also demonstrated. Under normal operation, solar cells are subject to a complex combination of stressors, such as visible light, ultraviolet light, heat, humidity, mechanical stress and electric potential, which complicates the understanding of failure mechanisms. Existing stress tests do not act as a time machine. In new materials systems such as perovskite photovoltaics, the tests have no known relationship to field service. In this Perspective we recommend following a durability learning cycle that interleaves photovoltaic module engineering with field testing; accelerated testing; and preconditioning and performance engineering. We advocate for field testing to demonstrate real-world performance and identify field-relevant failure modes, and urge the community to develop accelerated and qualification tests that account for device metastability, variations in material composition and different/various processing methods. In conclusion, these practices are more difficult, but more important, than the simple pursuit of higher initial efficiencies.

14 SOLAR ENERGY↗

The role of rotation-vibration coupling in symmetric and asymmetric isotopomers of ozone

A theoretical framework and a computer code (SpectrumSDT) are developed for accurate calculations of coupled rotational–vibrational states in triatomic molecules using hyper-spherical coordinates and taking into account the Coriolis coupling effect. Concise final formulas are derived for the construction of the Hamiltonian matrix using an efficient combination of the variational basis representation and discrete variable representation methods with locally optimized basis sets and grids. First, the new code is tested by comparing its results with those of the APH3D program of Kendrick et al. [Kendrick, Pack, Walker, and Hayes, J. Chem. Phys. 110, 6673 (1999)]. Then, accurate calculations of the rovibrational spectra are carried out for doubly substituted symmetric ( 18 O 16 O 18 O) and asymmetric ( 18 O 18 O 16 O) ozone isotopomers for the total angular momentum up to J = 5. Together with similar data recently reported for the singly substituted symmetric ( 16 O 18 O 16 O) and asymmetric ( 16 O 16 O 18 O) ozone isotopomers, these calculations quantify the role of the Coriolis coupling effect in the large mass-independent isotopic enrichment of ozone, observed in both laboratory experiments and the atmosphere of the Earth. It is found that the Coriolis effect in ozone is relatively small, as evidenced by deviations of its rotational constants from the symmetric-top-rotor behavior, magnitudes of parity splittings (Λ-doubling), and ratios of rovibrational partition functions for asymmetric vs symmetric ozone molecules. It is concluded that all of these characteristics are influenced by the isotopic masses as much as they are influenced by the overall symmetry of the molecule. It is therefore unlikely that the Coriolis coupling effect could be responsible for symmetry-driven mass-independent fractionation of oxygen isotopes in ozone.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Stochastic evaluation of fourth-order many-body perturbation energies

A scalable, stochastic algorithm evaluating the fourth-order many-body perturbation (MP4) correction to energy is proposed. Three hundred Goldstone diagrams representing the MP4 correction are computer generated and then converted into algebraic formulas expressed in terms of Green’s functions in real space and imaginary time. They are evaluated by the direct (i.e., non-Markov, non-Metropolis) Monte Carlo (MC) integration accelerated by the redundant-walker and control-variate algorithms. The resulting MC-MP4 method is efficiently parallelized and is shown to display O(n 5.3 ) size-dependence of cost, which is nearly two ranks lower than the O(n 7 ) dependence of the deterministic MP4 algorithm. Furthermore, it evaluates the MP4/aug-cc-pVDZ energy for benzene, naphthalene, phenanthrene, and corannulene with the statistical uncertainty of 10 mE h (1.1% of the total basis-set correlation energy), 38 mE h (2.6%), 110 mE h (5.5%), and 280 mE h (9.0%), respectively, after about 10 9 MC steps.

74 ATOMIC AND MOLECULAR PHYSICS↗

Optimization of sporulation and purification methods for sporicidal efficacy assessment on Bacillus spores

Abstract Validating the efficacy of sporicidal agents is a critical step in current good manufacturing practices for disinfection requirements. A limitation is that the poor quality of spores can lead to false positive sporicidal results. The aim of this study was to explore optimal sporulation and purification methods in Bacillus spores. Spores of 7 Bacillus strains were produced in 5 different sporulation media. After density centrifugation, spore yields were measured by phase-contrast microscopy and enumeration assays. Effects of purification methods including heat, sonication and lysozyme, and maturation on spore qualities were determined by sodium hypochlorite sporicidal assay. Difco sporulation media was identified as the preferred sporulation medium for 4 out of 7 tested Bacillus strains. Sporulation rates in B. cereus, B. sphaericus, and B. thuringiensis were higher at 30°C than the rates at 37°C at a difference of 5%, 65%, and 20%, respectively. Bacillus licheniformis favored Mn2+-amended 10% Columbia Broth at 37°C for sporulation with 40–72% higher sporulation rates than other media. The maximum sporulation rates of B. cereus and B. thuringiensis were observed on double-strength Schaeffer's-glucose broth. All studied purification methods improved the spore purity with strain variations. However, intense heat (80°C for 20 min) and lysozyme (100 μg/mL) treatment impaired the spore quality of specific Bacillus strains by sensitizing them against sodium hypochlorite. The length of the maturation period had an impact on the spore resistance, and the most optimal maturation periods ranged from 7 to 21 days in Bacillus strains. The results of this study will pave the way for further evaluation of the sporicidal activity of disinfectants.

Biotechnology & Applied Microbiology↗

Tetraquarks made of sufficiently unequal-mass heavy quarks are bound in QCD

Tetraquarks, bound states composed of two quarks and two antiquarks, have been the subject of intense study but are challenging to understand from first principles. We apply variational and Green’s function Monte Carlo methods to compute tetraquark ground-state energies in potential nonrelativistic QCD using a wide range of color and spatial wave functions. We find no evidence for bound tetraquarks composed of equal-mass quarks and antiquarks. Conversely, we find clear evidence for the existence of bound tetraquarks for sufficiently unequal quark/antiquark mass ratios at all overall mass scales where our effective theory results are applicable. We predict the critical mass ratios for bound state formation and study tetraquark bound states’ spatial and color structure at leading order and next-to-leading order in potential nonrelativistic QCD. Published by the American Physical Society 2024

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

PyMDA : microcrystal data assembly using Python

The recent developments at microdiffraction X-ray beamlines are making microcrystals of macromolecules appealing subjects for routine structural analysis. Microcrystal diffraction data collected at synchrotron microdiffraction beamlines may be radiation damaged with incomplete data per microcrystal and with unit-cell variations. A multi-stage data assembly method has previously been designed for microcrystal synchrotron crystallography. Here the strategy has been implemented as a Python program for microcrystal data assembly ( PyMDA ). PyMDA optimizes microcrystal data quality including weak anomalous signals through iterative crystal and frame rejections. Beyond microcrystals, PyMDA may be applicable for assembling data sets from larger crystals for improved data quality.

36 MATERIALS SCIENCE↗

Focused‐beam X‐ray fluorescence and diffraction microtomographies for mineralogical and chemical characterization of unsectioned extraterrestrial samples

Abstract This study describes the application of new synchrotron X‐ray fluorescence (XRF) and diffraction (XRD) microtomographies for the 3‐D visualization of chemical and mineralogical variations in unsectioned extraterrestrial samples. These improved methods have been applied to three compositionally diverse chondritic meteorite samples that were between 300 and 400 μm in diameter, including samples prepared from fragments of the CR2 chondrite LaPaz Icefield (LAP) 02342, H5 chondrite MacAlpine Hills (MAC) 88203, and the CM2 chondrite Murchison. The synchrotron‐based XRF and XRD tomographies used are focused‐beam techniques that measure the intensities of fluorescent and diffracted X‐rays in a sample simultaneously during irradiation by a high‐energy microfocused incident X‐ray beam. Measured sinograms of the emitted and diffracted intensities were then tomographically reconstructed to generate 2‐D slices of XRF and XRD intensity through the sample, with reconstructed pixel resolution of 1–2 μm, defined by the resolution of the focused incident X‐ray beam. For sample LAP 02342, primary mineral phases that were visualized in reconstructed slices using these techniques included isolated grains of α‐Fe, orthopyroxene, and olivine. For our sample of MAC 88203, XRF/XRD tomography allowed visualization of forsteritic olivine as a primary mineral phase, a vitrified fusion crust at the sample surface, identification of localized Cr‐rich spinels at spatial resolutions of several micrometers, and imaging of a plagioclase‐rich glassy matrix. In the sample of Murchison, major identifiable phases include clinoenstatite‐ and olivine‐rich chondrules, variable serpentine matrix minerals and small Cr‐rich spinels. Most notable in the tomographic analysis of Murchison is the ability to quantitatively distinguish and visualize the complex mixture of serpentine‐group minerals and associated tochilinite–cronstedtite intergrowths. These methods provide new opportunities for spatially resolved characterization of sample texture, mineralogy, crystal structure, and chemical state in unsectioned samples. This provides researchers an ability to characterize such samples internally with minimal disruption of sample micro‐structures and chemistry, possibly without the need for sample extraction from some types of sampling and capture media.

Geochemistry & Geophysics↗

Measured Performance of Over the Range Microwave Range Hoods

The California residential building code requires kitchen exhaust ventilation to protect indoor air quality. The requirement can be met with a kitchen exhaust fan or a range hood that conforms to airflow and sound specifications based on certified, standard test results. Appliances that integrate an exhaust fan with an over the range microwave (OTRs) are popular for their space saving utility; but for years there were none with the certified performance data required for building code compliance. This project, initiated during that period, aimed to evaluate OTR models found in new California homes and compare their performance to range hoods that minimally met code requirements. The study aimed to expand on limited information available about OTR performance with a particular focus on measuring the fraction of cooktop-generated air pollutants that are captured and removed by the exhaust devices, a parameter called “capture efficiency”. Airflow and capture efficiency (CE) were measured in a simulated kitchen in Berkeley Lab’s FLEXLAB facility. Airflows were measured using several variations of a balanced-pressure flow method (Walker et al. 2001) including a protocol that had been used in the California Healthy Efficient New Gas Homes (HENGH) field study. Measurements were made for six OTRs observed in the field study, including three with certified test results (published after the start of this project) for airflow and sound. Measurements were also made on two standard range hoods with comparable airflows and costs to the OTRs, when accounting for the microwave functionality. CE was measured using the CO 2 emitted from burners while heating pots of water (POW) as a tracer and calculating the ratio of added CO 2 in the exhaust flow over the total CO 2 generated from burning fuel. Results show that OTRs generally met the California code requirements for airflow, which are the same as those of the residential ventilation standard of ASHRAE. It was determined that the field protocol used in HENGH study homes was biased low by ~14% on average. The CE performance of OTRs tested in this study were consistent with those tested under controlled conditions in prior studies, showing CE increasing with airflow and being higher for emissions occurring at the back cooktop burner(s) compared with front burner emissions. The measured CE covered a range of 40% to 85% for the front burners and 60% to 100% for the back burners. The relationship of CE to airflow for OTRs was within the range of those found for standard range hoods in this study and prior studies, with the key caveat that OTRs appear to have more consistent CE performance for emissions on the front burner.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Modeling the Spectral Diversity of Quasars in the Sixteenth Data Release from the Sloan Digital Sky Survey

Abstract We present a new approach to capturing the broad diversity of emission-line and continuum properties in quasar spectra. We identify populations of spectrally similar quasars through pixel-level clustering on 12,968 high signal-to-noise ratio (S/N) spectra from the Sloan Digital Sky Survey (SDSS) in the redshift range of 1.57 < z < 2.4. Our clustering analysis finds 396 quasar spectra that are not assigned to any population, 15 misclassified spectra, and 6 quasars with incorrect redshifts. We compress the quasar populations into a library of 684 high-S/N composite spectra, anchored in redshift space by the Mg ii emission line. Principal component analysis on the library results in an eigenspectrum basis spanning 1067–4007 Å. We model independent samples of SDSS quasar spectra with the eigenbasis, allowing for a free redshift parameter. Our models achieve a median reduced χ 2 on non–broad absorption line quasar spectra that is reduced by 8.5% relative to models using the eigenspectra from the SDSS spectroscopic pipeline. A significant contribution to the relative improvement is from the ability to reconstruct the range of emission-line variation. The redshift estimates from our model are consistent with the Mg ii emission-line redshift with an average offset that displays 51.4% less redshift-dependent variation relative to the SDSS eigenspectra. Our method for developing quasar spectra models can improve automated classification and predict the intrinsic spectrum in regions affected by intervening absorbers such as Ly α , C iv , and Mg ii , thus benefiting studies of large-scale structure.

79 ASTRONOMY AND ASTROPHYSICS↗

Comparison of temperature adaptive calibration methods for laser induced fluorescence based fuel-in-oil instrument

Fuel dilution of engine oil (or fuel-in-oil, FiO) is an important issue as multiple and late-cycle fuel injection, integral to many combustion efficiency and emissions improvements (e.g., downsized boosted gasoline engines and catalyst thermal management) increases FiO rate. In addition to causing general wear and corrosion in engine due to decreased oil viscosity and pH buffering, FiO is also believed to cause destructive low speed pre-ignition (or super knock) in boosted SI engines. To understand the effects of engine operating conditions on the FiO rate, an optical diagnostic capable of measuring transient FiO on minute timescales was recently developed and demonstrated on a modified GM Ecotech engine system (Neupane et al., Applied Spectroscopy 2021). The measurement is based on adding a dye to the fuel and monitoring for its presence in oil via laser-induced fluorescence (LIF). The measured LIF signal is related to FiO concentration via pre-determined calibration factors using a multivariate classical least square (CLS) method.Since fluorescence quantum yield is a function of temperature, measured LIF intensity not only depends on FiO concentration but also oil temperature. To expand the applicability of the FiO diagnostic to transient oil-temperature conditions (e.g., cold start in practical engines), this study develops a method to account for oil-temperature variations. The effect of oil temperature (20°C - 95°C) on the LIF spectra of eight FiO samples ranging from ~0.8-15% was investigated. LIF intensities of the FiO samples decreased linearly with increasing temperature; the reductions being more significant at dye peaks. We develop a new calibration model (T-adaptive CLS) incorporating the temperature (T) effects on LIF intensity that enables simultaneous calculation of FiO and oil temperature. The improved FiO diagnostic with T-adaptive calibration is more robust, and applicable to varying oil-temperature conditions. For example, when strategies such as multiple/late fuel injections are applied to overcome cold-start instability due to use of low vaporization bio-based fuels such as ethanol, FiO rate is expected to be very high; the improved T-adaptive FiO diagnostic is hence relevant for engine- and fuel-system calibration and optimization. The diagnostic could also provide validation data for flow-field and spray interaction CFD models, further broadening the diagnostic’s utility for advancing engine technology and efficiency.

Neupane, Sneha↗

The German Site Selection Process - Implementation and Challenges - 20528

Federal Company for Radioactive Waste Disposal (Bundesgesellschaft fuer Endlagerung mbH; hereinafter referred to as BGE) is a state-owned company established in September 2016 following the 'Act on the Organisational Restructuring in the Field of Radioactive Waste Storage'. 'Repository Site Selection Act' (hereinafter referred to as StandAG) defines the site selection procedure, aiming to ensure the best possible safety for storing high-level radioactive waste in Germany for the duration of one million years. The selection procedure is a participatory, transparent, learning and self-questioning process based on scientific expertise. Possible repository sites are sought all over Germany, without excluding or predetermining any potential site at the beginning. The procedure consists of three phases. After each phase, the legislative decides on the regions for further consideration in the next phase of the site selection procedure. The current first phase (Phase I) is divided into two steps. Objective of Step 1 is to determine subareas of favorable geological conditions based on available data. Step 2 of Phase I will lead to identification of specific regions that are considered for further surface-based geoscientific and geophysical exploration. Potential host rocks are rock salt, clay rock and crystalline rock. As part of the site selection procedure, an overview of the status of the planning and implementation of R and D activities is given. Topics of particular interest are, for example, the adaptation of the maximum temperature of 100 deg. C at the container surface, the impact of long-term climate variations as well as minimally invasive exploration methods. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Automated Waterbox Inspection for Nuclear Power Plants Using Computer Vision - Based Change Detection

Nuclear power plant waterboxes require regular inspection for leaks, missing components, and structural damage during maintenance outages. Traditional manual inspection is time-consuming and poses safety risks from confined space entry. We developed an automated computer vision system for drone-based waterbox inspection in partnership with Florida Light and Power. Our approach uses feature detection and matching to identify critical changes between baseline and current inspection images, automatically flagging additions (leaks/debris), removals (missing plugs), and translations (displaced components) while compensating for drone movement and environmental variations. We systematically evaluated six feature matching methods, from classical approaches (SIFT+BF) to state-of-the-art neural networks (SuperPoint+SuperGlue), using both standard benchmarks (HPatches) and waterbox-specific validation with real-world augmentations. SuperPoint+SuperGlue achieved superior performance with 7.82 pixels RMSE and 100% success rate—2.8x better accuracy than our baseline. While the pre-trained model has commercial licensing restrictions for nuclear deployment, our findings validate this architecture for custom training. We implemented a real-time GUI demonstrating the SIFT+BF approach for immediate deployment, processing drone feeds at 30 FPS with color-coded change visualization. Future work includes training a custom SuperPoint+SuperGlue model on waterbox data and integrating Vision-Language Models for automated reporting and maintenance guidance.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗

Variational Monte Carlo calculations of n + H 3 scattering

A paramount goal in nuclear physics is to unify ab initio treatments of bound and unbound states. The position-space quantum Monte Carlo (QMC) methods have a long history of successful bound-state calculations in light systems but have seen minimal implementation in unbound systems. Here, we introduce a numerical method to improve the efficiency and accuracy of unbound-state calculations in QMC. As an initial application, we compute scattering observables for the smallest system available to probe three-body forces, the neutron-triton system, using variational Monte Carlo (VMC) wave functions. The method involves inferring long-range amplitudes in the wave function from integrals over the short-range region where all the particles interact. This approach using integral relations is well established in the literature; here, we develop it for the QMC framework. We validate our approach with a consistency check between short-range spectroscopic overlap functions computed from direct evaluation and from the integral relations; scattering amplitudes are long-range asymptotics of those overlaps. Comparison against published benchmark calculations using the same potential demonstrates that when applied to the current VMC wave functions, the integral method produces more accurate scattering observables than direct evaluation from the same variational wave function. However, it still differs noticeably from the exact results. Using additional interactions, we then present phase shifts and mixing parameters for the n + 3 H system. In particular, we present one of the first applications of the Norfolk family of local coordinate-space chiral potentials in unbound systems of A > 2. The Norfolk results accurately describe s-wave scattering but predict p-wave cross sections too large. Compared with previous QMC scattering calculations, the integral method avoids difficulties associated with the precise computation of energy differences and with convergence outside the interaction region, which is particularly severe in the variational calculation. Application of the integral method here paves the way for its use in Green's function Monte Carlo (GFMC) calculations. In GFMC, the wave functions are more accurate, but the high-precision convergence of their tails is slow, and there are additional difficulties in reading out amplitudes. Here, the integral methods will address both of those remaining problems.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Multimodal Defect Imaging of Pure Tungsten Components Fabricated via Electron Beam Powder Bed Fusion

The utilization of additive manufacturing (AM) techniques for refractory materials in high-temperature environments has significantly expanded because of the ability to fabricate geometrically complex components. Electron beam powder bed fusion (EB-PBF), which provides lower residual stress, a cleaner vacuum environment, and better efficiency for high melting point, is one of the best-suited AM methods to produce advanced refractory components. However, the property variation attributed to the heterogeneous microstructure and process-induced defects has hindered the widespread adoption of EB-PBF-produced material like tungsten. While numerous in-situ monitoring and defect detection methods have been demonstrated for EB-PBF, a workflow that compares and evaluates process-induced abnormalities from different imaging perspectives is still limited. This study examines a feature-embedded tungsten component manufactured via the EB-PBF process to demonstrate the defect detection capabilities of a multimodal defect imaging workflow. The predefined and process-induced defects are evaluated by harnessing various imaging techniques, including in-situ electron imaging, layerwise near-infrared (NIR) imaging, post-build high-energy x-ray computed tomography (CT), and conventional destructive metallography. The results highlight the strengths and limitations of distinctive defect imaging techniques concerning specific defect types, sizes, and conditions. It was found that electron imaging can provide more abnormal detection capabilities while maintaining a higher measuring accuracy, against the conventional metallography in this case study, compared with NIR and CT imaging techniques.

36 MATERIALS SCIENCE↗

3D strain field reconstruction by inversion of dynamical scattering

Strain governs not only the mechanical response of materials but also their electronic, optical, and catalytic properties. For this reason, the measurement of the 3D strain field is crucial for a detailed understanding and for further development of material properties through strain engineering. However, measuring strain variations along the electron beam direction has remained a major challenge for (scanning-) transmission electron microscopy (S/TEM). In this article, we present a method for 3D strain field determination using 4D-STEM. The method is based on the inversion of dynamical diffraction effects, which occur at strain field variations along the beam direction. We test the method against simulated data with a known ground truth and demonstrate its application to an experimental 4D-STEM dataset from an inclined pseudomorphically grown Al0.47Ga0.53N layer.

Niermann, Laura↗

Fully variational incremental CASSCF

We report the complete-active-space self-consistent field (CASSCF) method is a canonical electronic structure theory that holds a central place in conceptualizing and practicing first principles simulations. For application to realistic molecules, however, the CASSCF must be approximated to circumvent its exponentially scaling computational costs. Applying the many-body expansion - also known as the method of increments - to CASSCF (iCASSCF) has been shown to produce a polynomially scaling method that retains much of the accuracy of the parent theory and is capable of treating full valence active spaces. Due to an approximation made in the orbital gradient, the orbital parameters of the original iCASSCF formulation could not be variationally optimized, which limited the accuracy of its nuclear gradient. Herein, a variational iCASSCF is introduced and implemented, where all parameters are fully optimized during energy minimization. This method is able to recover electronic correlations from the full valence space in large systems, produce accurate gradients, and optimize stable geometries as well as transition states. Demonstrations on challenging test cases, such as the oxoMn(salen)Cl complex with 84 electrons in 84 orbitals and the automerization of cyclobutadiene, show that the fully variational iCASSCF is a powerful tool for describing challenging molecular chemistries.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Error mitigation, optimization, and extrapolation on a trapped-ion testbed

Current noisy intermediate-scale quantum (NISQ) trapped-ion devices are subject to errors which can significantly impact the accuracy of calculations if left unchecked. A form of error mitigation called zero noise extrapolation (ZNE) can decrease an algorithm’s sensitivity to these errors without increasing the number of required qubits. Here we explore different methods for integrating this error mitigation technique into the Variational Quantum Eigensolver (VQE) algorithm for calculating the ground state of the HeH + molecule at 0.8 Å in the presence of experimental noise. Using the Quantum Scientific Computing Open User Testbed (QSCOUT) trapped-ion device, we test three methods of scaling noise for extrapolation: time stretching the two-qubit gates, scaling the sideband detuning parameter, and inserting two-qubit gate identity operations into the ansatz circuit. We find that time stretching and sideband detuning scaling fail to scale the noise on our particular hardware in a way that can be extrapolated to zero noise. Scaling our noise with global gate identity insertions and extrapolating after variational optimization, we achieve error suppression of 96.8%, resulting in an energy estimate within –0.004 ± 0.04 hartree of the ground state energy. This is an improvement, but still outside the chemical accuracy threshold of 0.0016 hartree. Furthermore, our results show that the efficacy of this error mitigation technique depends on choosing the correct implementation for a given device architecture.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Path-BigBird: An AI-Driven Transformer Approach to Classification of Cancer Pathology Reports

PURPOSE Surgical pathology reports are critical for cancer diagnosis and management. To accurately extract information about tumor characteristics from pathology reports in near real time, we explore the impact of using domain-specific transformer models that understand cancer pathology reports. METHODS We built a pathology transformer model, Path-BigBird, by using 2.7 million pathology reports from six SEER cancer registries. We then compare different variations of Path-BigBird with two less computationally intensive methods: Hierarchical Self-Attention Network (HiSAN) classification model and an offthe-shelf clinical transformer model (Clinical BigBird). We use five pathology information extraction tasks for evaluation: site, subsite, laterality, histology, and behavior. Model performance is evaluated by using macro and micro F 1 scores. RESULTS We found that Path-BigBird and Clinical BigBird outperformed the HiSAN in all tasks. Clinical BigBird performed better on the site and laterality tasks. Versions of the Path-BigBird model performed best on the two most difficult tasks: subsite (micro F 1 score of 72.53, macro F 1 score of 35.76) and histology (micro F 1 score of 80.96, macro F 1 score of 37.94). The largest performance gains over the HiSAN model were for histology, for which a Path-BigBird model increased the micro F 1 score by 1.44 points and the macro F 1 score by 3.55 points. Overall, the results suggest that a Path-BigBird model with a vocabulary derived from wellcurated and deidentified data is the best-performing model. CONCLUSION The Path-BigBird pathology transformer model improves automated information extraction from pathology reports. Although Path-BigBird outperforms Clinical BigBird and HiSAN, these less computationally expensive models still have utility when resources are constrained.

60 APPLIED LIFE SCIENCES↗