Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Related References”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

ToF-SIMS evaluation of PEG-related mass peaks and applications in PEG detection in cosmetic products

Polyethylene glycols (PEGs) are used in industrial, medical, health care, and personal care applications. The cycling and disposal of synthetic polymers like PEGs pose significant environmental concerns. Detecting and monitoring PEGs in the real world calls for immediate attention. This study unveils the efficacy of time-of-flight secondary ion mass spectrometry (ToF-SIMS) as a reliable approach for precise analysis and identification of reference PEGs and PEGs used in cosmetic products. By comparing SIMS spectra, we show remarkable sensitivity in pinpointing distinctive ion peaks inherent to various PEG compounds. Moreover, the employment of principal component analysis effectively discriminates compositions among different samples. Notably, the application of SIMS two-dimensional image analysis visually portrays the spatial distribution of various PEGs as reference materials. The same is observed in authentic cosmetic products. The application of ToF-SIMS underscores its potential in distinguishing PEGs within intricate environmental context. ToF-SIMS provides an effective solution to studying emerging environmental challenges, offering straightforward sample preparation and superior detection of synthetic organics in mass spectral analysis. These features show that SIMS can serve as a promising alternative for evaluation and assessment of PEGs in terms of the source, emission, and transport of anthropogenic organics.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Air quality impacts from the development of unconventional oil and gas well pads: Air toxics and other volatile organic compounds

Unconventional oil and natural gas development (UOGD) has expanded rapidly across the United States in recent decades and raised concerns about associated air quality impacts. While significant effort has been made to quantify methane emissions, relatively few observations have been made of Volatile Organic Compounds (VOCs), especially during drilling and completion of new wells. Extensive air monitoring during development of several large, multi-well pads in Broomfield, Colorado, in the Denver-Julesburg Basin, provides a novel opportunity to examine changes in local air toxics and other VOC concentrations during well drilling and completions and production. These operations offer an especially useful case to study as several management practices were implemented to reduce emissions (e.g., electrified, grid-powered drill rigs and closed loop fluid handling systems to reduce truck traffic and limit fluid handling on the pad). With simultaneous measurements of methane and 50 VOCs from October 2018 to December 2022 at as many as 19 sites near well pads, in adjacent neighborhoods, and at a more distant reference location, we identify impacts from each phase of well development and production. Use of weekly, time-integrated canisters, a Proton Transfer Reaction Mass Spectrometer (PTR-MS), continuous photoionization detectors (PID) to trigger canister collection upon detection of VOC-rich plumes, and an instrumented vehicle, provided a powerful suite of measurements to characterize both transient plumes and longer-term changes in air quality. Prior to the start of well development, VOC gradients were small across Broomfield. Once drilling commenced, concentrations of oil and gas (O&G) related VOCs, including alkanes and aromatics, increased around active well pads. Concentration increases were clearly apparent during certain operations, including drilling, coil tubing/millout operations, and production tubing installation. Emissions of C 8 –C 10 n-alkanes during drilling operations highlighted the importance of VOC emissions from synthetic drilling mud chosen to reduce odor impacts. More than 90 samples were collected of transient plumes. Using composition measurements, meteorological data, and information about well pad activities, these plumes were connected with specific UOGD operations including drilling, flowback, and production equipment maintenance. The chemical signatures of these plumes differed by operation type (e.g., C 8 –C 10 n-alkanes constituted a larger fraction of measured VOCs in drilling-related plumes). Concentrations of individual, oil and gas-related VOCs in these plumes were often several orders of magnitude higher than in background air, with maximum ethane and benzene concentrations of 79,600 and 819 ppbv, respectively. Because these plumes typically impact a monitoring site for just several minutes, they are easily missed by slower-responding instruments. Study measurements highlight future emission mitigation opportunities during UOGD operations, including better control of emissions from shakers that separate drill cuttings from drilling mud, production separator maintenance operations, and periodic emptying of sand cans during flowback operations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Beam dynamics in independent phased cavities

Linear accelerators containing the sequence of independently phased cavities with constant geometrical velocity along each structure are widely used in practice. The chain of cavities with identical cell lengths is utilized within a certain beam velocity range, with subsequent transformation to the next chain with higher cavity velocity. Design and analysis of beam dynamics in this type of accelerator are usually performed using numerical simulations. A full theoretical description of particle acceleration in an array of independent phased cavities has not been developed. In the present paper, we provide an analytical treatment of beam dynamics in such linacs employing Hamiltonian formalism. We begin our analysis with an examination of beam dynamics in an equivalent traveling wave of a single cavity, propagating within accelerating section with constant phase velocity. We then consider beam dynamics in arrays of cavities, utilizing an effective traveling wave propagating along with the whole accelerator with the velocity of synchronous (reference) particle. The analysis concluded with the determination of the matched beam conditions. Finally, we present a beam dynamics study in 805 MHz Coupled Cavity Linac of the LANSCE accelerator facility.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Application of Self-Interaction Corrected Density Functional Theory to Early, Middle, and Late Transition States

Density functional theory (DFT)-based methods often significantly underpredict chemical reaction barriers compared with experiments because of the tendency of DFT to over-stabilize transition states with stretched bonds due to the impact of unphysical electron self-interaction. But many reactions have early or late transition states where the transition state geometry closely resembles the reactants or products, respectively. The role of self-interaction in those cases is not known. Here we compare the performance of DFT with and without self-interaction correction (SIC) for describing the hydrogenation of CO and CO 2 catalyzed by a Lewis acid-base pair incorporated onto an aromatic cluster, using CCSD(T) results for reference. The three elementary steps in these reactions consist of an early, a middle, and a late transition. Our results show that the Perdew-Zunger SIC (PZ-SIC), implemented in the Fermi-L Lowdin orbital SIC (FLO-SIC) approach, qualitatively improves the description of the forward and reverse reaction barriers relative to uncorrected DFT for the middle transition, but not the early or late transitions. By contrast, the local scaling SIC (LSIC) method, also implemented in the FLO-SIC framework, significantly improves the calculated barriers over DFT and PZ-SIC in all but one case. Lastly, the results also show how the FLO-SIC approach can provide insight into the bonding in aromatic systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Algorithm to extract direction in 2D discrete distributions and a continuous Frobenius norm

In this study, we present a novel algorithm for determining directionality in 2D distributions of discrete data. We compare a reference dataset with a known direction to a measured dataset with an unknown direction by the Frobenius norm of the difference (FND) to find the unknown direction. To generalize this concept, we develop a continuous Frobenius norm of the difference (CFND) as a continuous analog of the FND and derive its analytical expression. By relating fitted and normalized 2D Gaussian distributions, we show that the CFND approximates the FND, and we validate this relationship with computer simulations. We find that a first-order approximation of the CFND between two similar Gaussian distributions takes the form of an absolute sine function, offering a simple analytical form with potential applications in specialized areas such as segmented inverse beta decay neutrino detectors, astronomy, machine learning, and more. Our methodology consists of modeling a 2D Gaussian distribution, binning the data into a histogram, and encoding it as a square matrix. Rotating this matrix around its geometric center and comparing it to a measured dataset using the FND gives us rotational data that we fit with an absolute sine function. The location of the minimum of this fit is the angle closest to the true angle of the direction in the measured dataset. We present the derivation and discuss initial applications of the CFND in our novel algorithm, demonstrating its success in approximating directionality in 2D distributions.

Physics↗
DOE OSTI2023

A high-temperature sample changer for parallelized in situ X-ray studies to efficiently explore reaction space

A sample environment for high-throughput X-ray scattering studies in transmission geometry to probe the mechanism and kinetics of moderate-temperature reactions in solution, molten fluxes and solids is described. This high-temperature sample changer enables efficient studies of reactions that are slow relative to the timescale of the X-ray scattering measurements by allowing up to 18 samples to be probed at the same temperature in parallel. This significantly enhances the throughput ofin situX-ray scattering studies as the sample changer effectively facilitates systematic studies that compare different reaction parameters (e.g.concentration, precursor, composition, additives), reference samples (e.g.background, pure precursors) and replicates (to demonstrate reproducibility) with enhanced consistency afforded by the quasi-simultaneous nature of the measurements. The large sample volumes, compared with those typically used for X-ray scattering measurements, are on a similar scale to those in the laboratory, making the results more directly comparable.

Chemistry↗
DOE OSTI2024

A Cryogenic readout integrated circuit with analog pile-up and in-Pixel ADC for high frame rate Skipper CCD-in-CMOS Sensors

The Skipper CCD-in-CMOS Parallel Read-Out Circuit V2 (SPROCKET2) is designed to enable high frame rate readout of Skipper CCD-in-CMOS image sensors. The SPROCKET2 pixel is fabricated in a 65 nm CMOS process and occupies a 60$\mu$m $\times$ 60$\mu$m footprint. SPROCKET2 is intended to be heterogeneously integrated with a pixelated Skipper CCD-in-CMOS sensor, such that one readout pixel is connected to a multiplexed array of 16 active image sensor pixels, to match their spatial geometry. Our design benefits from the Skipper CCD-in-CMOS sensor's non-destructive readout capability to achieve exceptionally low noise through multi-sampling and averaging while optimizing for total power consumption. The pixel readout utilizes correlated double sampling to minimize 1/f noise and includes "pile-up" of ten successive samples in the analog domain before digitizing at a rate of 66.7 ksps. Measurement results of in-pixel serial SAR ADC show DNL and INL of ~0. 44 LSB and 0.58 LBS respectively. A large area array of 20,000 SPROCKET2 ADC pixels (multiplexed 1:16 to 320,000 sensor pixels) is currently under test. By reading out data over a 10 Gbps optical link, this pixel design enables a frame rate of $\sim$ 4 kfps for large sensing areas with minimal sensing deadtime. In the highest gain mode, the pixelated ADC has an input-referred resolution of 10$\mu$V with a simulated power consumption of 50$\mu$W. The pixel operates with constant current draw to minimize power-rail crosstalk.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Income Trends among U.S. Residential Rooftop Solar Adopters [Slides]

Berkeley Lab tracks and analyzes solar-adopter demographic characteristics. A central element of this work is an annual report describing income trends of residential solar adopters over time and across geographies. The report is based on household-level income estimates for single-family residential solar adopters across the United States, and is intended to serve as a foundational reference document for policy-makers, industry stakeholders, and other researchers interested in demographic trends among residential solar adopters. The report is published with an accompanying interactive data visualization tool that allows users to further explore the underlying data. In addition to the annual report, Berkeley Lab also conducts targeted topical analyses on issues related to solar-adopter demographics and provides direct analytical support to organizations working to expand access to solar energy among low-to-moderate income households.

14 SOLAR ENERGY↗
DOE OSTI2022

Engineered Cell Line Imaging Assay Differentiates Pathogenic from Non-Pathogenic Bacteria

Cell culture systems have greatly expanded our understanding of how bacterial pathogens target signaling pathways to manipulate the host and cause infection. Advances in genetic engineering have allowed for the creation of fluorescent protein readouts within signaling pathways, but these techniques have been underutilized in pathogen biology. Here, we genetically engineered a lung cell line with fluorescent reporters for extracellular signal-related kinase (ERK) and the downstream transcription factor FOS-related antigen 1 (Fra1) and evaluated signaling after inoculation with pathogenic and non-pathogenic bacteria. Cells were inoculated with 100 colony-forming units of Acinetobacter baylyi, Klebsiella pneumoniae, Pseudomonas aeruginosa, Streptococcus agalactiae, or Staphylococcus epidermidis and imaged in a multi-mode reader. The alamarBlue cell viability assay was used as a reference test and showed that pathogenic P. aeruginosa induced significant (p < 0.05) cell death after 8 h in both wild-type and engineered cell lines compared to non-pathogenic S. epidermidis. In engineered cells, we found that Fra1 signaling was disrupted in as little as 4 h after inoculation with bacterial pathogens compared to delayed disruption in signaling by non-pathogenic S. epidermidis. Overall, we demonstrate that low levels of pathogenic versus non-pathogenic bacteria can be rapidly and sensitively screened based on ERK-Fra1 signaling

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Algorithm to extract direction in 2D discrete distributions and a continuous Frobenius norm

In this study, we present a novel algorithm for determining directionality in 2D distributions of discrete data. We compare a reference dataset with a known direction to a measured dataset with an unknown direction by the Frobenius norm of the difference (FND) to find the unknown direction. To generalize this concept, we develop a continuous Frobenius norm of the difference (CFND) as a continuous analog of the FND and derive its analytical expression. By relating fitted and normalized 2D Gaussian distributions, we show that the CFND approximates the FND, and we validate this relationship with computer simulations. We find that a first-order approximation of the CFND between two similar Gaussian distributions takes the form of an absolute sine function, offering a simple analytical form with potential for specialized applications in segmented inverse beta decay (IBD) neutrino detectors, astronomy, machine learning, and more. Although this method may easily extend to 3D scalar fields, our focus here is on 2D real-valued fields as it directly applies to directionality. Our methodology consists of modeling a 2D Gaussian distribution, binning the data into a histogram, and encoding it as a square matrix. Rotating this matrix around its geometric center and comparing it to a measured dataset using the FND gives us rotational data that we fit with an absolute sine function. The location of the minimum of this fit is the angle closest to the true angle of the direction in the measured dataset. We present the derivation and discuss initial applications of the CFND in our novel algorithm, demonstrating its success in approximating directionality in 2D distributions.

Data Analysis, Statistics and Probability (physics↗
DOE OSTI2020

High command fidelity electromagnetically driven calorimeter

An example apparatus can comprise an emitter to emit radio frequency radiation, an absorber that changes temperature based on emissions from the emitter, and one or more sensors to measure a temperature difference between a sample and a reference coupled to the absorber.

42 ENGINEERING↗
DOE OSTI2025

Role of the junction voltage on the overflow current in light-emitting diodes

Quantum-well (QW)-based light emitters, such as light-emitting diodes (LEDs) and lasers, of various semiconductor materials experience a reduction in their efficiency when operating at higher temperatures, a phenomenon referred to as “thermal droop.” Among the various claims on the origins of thermal droop, an increased overflow current with increasing temperatures is a common contender. Since overflow of carriers can only occur when the junction voltage 𝑉 Junction approaches the built-in voltage 𝑉 BI of any diodes, we develop a simple method relating the difference between 𝑉 Junction and 𝑉 BI to approximate the upper limit of overflow occurring in QW-based light-emitting diodes. The measured difference between 𝑉 Junction and 𝑉 BI of state-of-the-art commercial blue and green In⁢Ga⁢N-based LEDs at temperatures up to ∼450 K suggests negligible overflow. To further experimentally verify the absence of overflow, we perform temperature-dependent electron emission spectroscopy on the same commercial blue and green LEDs and find no evidence of thermally enhanced overflow carriers up to ∼450 K. In agreement with our claims that 𝑉 Junction must approach 𝑉 BI for overflow to occur, two-dimensional temperature-dependent electrical simulations of violet, blue, and green LEDs including alloy disorder and V-defects demonstrate that overflow can be significant in violet LEDs, where the small band offset between the In⁢Ga⁢N QW and Ga⁢N cladding layers due to the larger QW bandgap requires larger 𝑉 Junction to reach standard operating current densities, thereby approaching 𝑉 BI . By contrast, simulations indicate that overflow is negligible in blue and green LEDs, whose smaller QW bandgaps result in smaller quasi-Fermi levels difference to reach significant carrier injection, resulting in a 𝑉 Junction much smaller than 𝑉 BI up to large operating current densities. Considering that overflow is negligible in blue and longer-wavelength LEDs, and our observations of the large thermal droop occurring at low current densities, where Shockley-Read-Hall (SRH) recombination dominates, we conclude that thermally enhanced SRH processes are the most significant contributor to thermal droop. Finally, we also simulate the carrier densities in the different QWs of a multiple-QW LED and observe a reduction in the total carrier density at a given operating current density, which results in a decrease in the total Auger-Meitner current of the LED from just the thermally enhanced carrier redistribution among QWs without taking any possible additional temperature dependence of their recombination coefficients. Taking all this into account, minimizing thermal droop effects in LEDs can be achieved by a reduction in defect density, using wider band gap p-n junction-defining cladding layers, and operating at higher currents.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2021

Quantitative Account of the Bonding Properties of a Rubredoxin Model Complex [Fe(SCH3)4]q, q = -2, -1, +2, +3

Iron-sulfur clusters play important roles in biology as parts of electron transfer chains and catalytic cofactors. Here, we report a detailed computational analysis of a structural model of the simplest natural iron-sulfur cluster of rubredoxin and its cationic counterparts. Specifically, we report results for the ground and low-lying electronically excited states of the complex [Fe(SCH3)4]2-/1-/2+/3+, using Multi-Reference (CASSCF, MRCISD), and Coupled Cluster [CCSD(T)] methodology in order to provide accurate adiabatic reduction energies, dissociation energies and insights into the bonding analysis. The nature of the Fe-S chemical bond and the magnitude of the ionization potentials in the anionic and cationic [Fe(SCH3)4] complexes offer a physical rationale for the relative stabilization, structure and speciation of these complexes. Anionic and cationic complexes present different types of chemical bonds: prevalently ionic in [Fe(SCH3)4]2-/1- complexes and covalent in [Fe(SCH3)4]2+/3+ complexes. The ionic bonds result in an energy gain for the transition [Fe(SCH3)4]2-®[Fe(SCH3)4]- (i.e., FeII®FeIII) of 1.5 eV, while the covalent bonds result in an energy loss for the transition [Fe(SCH3)4]2+®[Fe(SCH3)4]3+ of 16.6 eV, almost half of the IP of Fe2+. The ionic vs covalent bond character influences the Fe-S bond strength and length, i.e., ionic Fe-S bonds are longer than covalent ones by about 0.2 Å (for FeII) and 0.04 Å (for FeII). Finally, the average Fe-S heterolytic bond strength is 6.7 eV (FeII) and 14.6 (FeIII) eV at the RCCSD(T) level of theory.

Tzeli, Demeter↗
DOE OSTI2025

Hidden diversity: Transcriptomic and photosynthetic variation among common ‘wild type’ Chlamydomonas strains

The unicellular green alga Chlamydomonas reinhardtii is a widely studied reference organism, particularly in photosynthesis research. It employs photoprotective mechanisms, such as state transitions (ST) and non-photochemical quenching (NPQ), to cope with rapid light changes. Most widely used strains share a recent common ancestor yet differ by up to ~50 000 nuclear variants—genetic diversity that is often overlooked. Even among ‘wild type’ strains, we document significant phenotypic differences, such as pigment accumulation, and nutrient utilization. To elucidate the basis for this variation, we compared transcriptomes and physiological traits of seven commonly used laboratory strains, including the reference strain and the CLiP mutant library parental strain. Despite identical growth conditions, ~40% of genes were differentially expressed between strains. Most of these differences are attributable to changes that have accrued during laboratory propagation, and adverse conditions may have driven transcriptomic drift. At the physiological level, we catalog the range of strain-dependent responses related to photosynthesis and high light (HL) acclimation. Specifically, (i) all strains develop NPQ upon HL exposure, but to various degrees, (ii) they show a substantial variation in ST capacity, and (iii) they regulate the composition of the photosynthetic apparatus differently. We find that NPQ levels do not correlate with LHCSR3 expression, suggesting an additional layer of NPQ regulation. STs are constantly activated and independent of growth light intensities. Overall, our findings highlight significant strain-to-strain differences in virtually all photosynthetic parameters, emphasizing the importance of careful strain selection in future research endeavors.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Transferable GeSn ribbon photodetectors for high-speed short-wave infrared photonic applications

We experimentally demonstrate a low-cost transfer process of GeSn ribbons to insulating substrates for short-wave infrared (SWIR) sensing/imaging applications. By releasing the original compressive GeSn layer to nearly fully relaxed state GeSn ribbons, the room-temperature spectral response of the photodetector is further extended to 3.2 μm, which can cover the entire SWIR range. Compared with the as-grown GeSn reference photodetectors, the fabricated GeSn ribbon photodetectors have a fivefold improvement in the light-to-dark current ratio, which can improve the detectivity for high-performance photodetection. The transient performance of a GeSn ribbon photodetector is investigated with a rise time of about 40 μs, which exceeds the response time of most GeSn (Ge)-related devices. In addition, this transfer process can be applied on various substrates, making it a versatile technology that can be used for various applications ranging from optoelectronics to large-area electronics. These results provide insightful guidance for the development of low-cost and high-speed SWIR photodetectors based on Sn-containing group IV low-dimensional structures.

42 ENGINEERING↗
DOE OSTI2024

Sea Ice and Cloud Processes Mediating Compensation between Atmospheric and Oceanic Meridional Heat Transports across the CMIP6 Preindustrial Control Experiment

Abstract Bjerknes compensation (BJC) refers to the anticorrelation observed between atmospheric and oceanic heat transport (AHT/OHT) variability, particularly on decadal to longer time scales that may be important to the predictability of the climate system. This study investigates the spread in BJC across fully coupled simulations of phase 6 of the Coupled Model Intercomparison Project (CMIP6) and critical processes (particularly related to sea ice and clouds) that may contribute to that spread. BJC on decadal to longer time scales is confirmed across all the simulations evaluated, and it is strongest in the Northern Hemisphere (NH) between 60° and 70°N. At these latitudes, BJC appears to be primarily driven by the exchange of turbulent fluxes (sensible and latent) in the Greenland, Iceland, and Barents Seas. Metrics to break down how sea ice and clouds uniquely modify the radiative balance of the polar atmosphere during anomalous OHT events are presented. These metrics quantify the impacts of sea ice and clouds on surface and top of atmosphere (latent, sensible, longwave, and shortwave radiative) energy fluxes. Cloud responses tend to counter the clear sky impacts over the Marginal Ice Zone (MIZ). It is further shown that the degree of BJC present in a simulation at high latitudes is heavily influenced by the sensitivity of the sea ice to OHT, which is most influential over the MIZ. These results are qualitatively robust across models and explain the intermodel spread in NH BJC in the preindustrial control experiment.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Report Series: Finding of Effect, and Mitigation Documentation for Building 23-702, Mercury, Area 23, Nevada National Security Site, Nye County, Nevada

The U.S. Department of Energy (DOE), National Nuclear Security Administration Nevada Field Office (NNSA/NFO) plans to demolish Building 23-702 in the town of Mercury (Nevada State Historic Preservation Office [SHPO] Resource No. B15278), which is on the Nevada National Security Site (NNSS) in Nye County, Nevada (see Figure 1). The purpose of the undertaking is related to the modernization of Mercury for future mission needs. The NNSA/NFO will implement this undertaking in accordance with the Programmatic Agreement between the National Nuclear Security Administration Nevada Field Office and the Nevada State Historic Preservation Officer Regarding Modernization and Operational Maintenance of the Nevada National Security Site, at Mercury in Nye County, Nevada, hereafter referred to as the Mercury PA. Building 23-702 was built in 1965 as a foil handling building for the Los Alamos Scientific Laboratory (LASL), who worked on the design and engineering of nuclear weapons and other nuclear experiments. The building appeared to have secondarily functioned as a storage for radioactive sources in the 1980s and 1990s. The building was operational until 2004, then deactivated sometime between 2005 and 2014. The town of Mercury and the immediate surrounding area have been formally determined eligible for listing in the National Register of Historic Places (National Register, NRHP) as the Mercury Historic District (MHD, SHPO Resource No. D230) under Criteria A and C for its importance in supporting nuclear testing and scientific research from 1951 through 1992. Building 23-702 was identified as a contributing element to the MHD in a 2018 architectural survey of the district (Reno et al.) and recorded on a Nevada Architectural Resource Assessment (ARA) form (Reno et al. 2017). Building 23-702 was also identified in Appendix C of the Mercury PA as a Category I contributing element, indicating that it might be individually eligible for the NRHP. It is a historic property for the purposes of compliance with Section 106 of the National Historic Preservation Act (NHPA) and subject to the stipulations of the Mercury PA.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Automating the Analysis of Large Language Models Responses through Zero-Shot Question Answering

Recent advancements in Large Language Models (LLMs) have shown significant potential in various applications, yet their evaluation, particularly in zero-shot question answering scenarios, remains a challenging task. In this study, our objective was to explore precision metrics for Large Language Models (LLM) and design and implement a software pipeline to automatically evaluate LLMs' outputs under zero-shot question answering. Zero-shot question answering involves a model providing answers to questions about topics it hasn't seen during training. It leverages the principles of zero-shot learning by relying on semantic understanding and generalization from related knowledge. The data used was metadata from medical databases on congenital heart disease. We explored eleven LLM metrics and selected three for our evaluation: BLEU, BERTScore, and MoverScore. BLEU calculates a score based on the overlap of n-grams (contiguous sequences of n items, typically words) between the machine-generated translation and the reference translations. Higher BLEU scores indicate better correspondence between the machine-generated and human-generated translations. BERTScore is a metric used to evaluate the quality of machine-generated text by measuring the similarity of token embeddings produced by BERT (Bidirectional Encoder Representations from Transformers) between the generated text and reference text. MoverScore is a metric that quantifies the dissimilarity between the distributions of word embeddings from machine-generated text and reference text, emphasizing semantic similarity over exact token overlap. We also introduced HBKI, a composite metric summarizing these approaches. We tested five models —GPT-3, Llama-2, Gemini 1.5 Pro, Solar 10.7B, and Mixtral-8x7b. Our software pipeline, designed and implemented using Object-Oriented Programming principles, allows users to customize the selection and extraction of features for topics of interest in their own research. Our results show that MoverScore delivered the most precise evaluation of the LLM's outputs, while Mixtral-8x7b achieved the best overall performance in extracting metadata from the databases.

97 MATHEMATICS AND COMPUTING↗