Results for “METRICS” — Page 35

DOE OSTI2022

Jobs, jobs, jobs: what’s an analyst to do?

Analysts and economists often face the task of using employment metrics to characterize industries of interest. Some key challenges can be understanding where to find employment metrics, the differences in various employment metrics, and when each metric should be used. This article analyzes a variety of publicly available employment data for the United States and compares these data. A detailed description of the intricacies of each data source is provided, which covers factors such as regionality, industry breakout, periodicity, and the types of jobs included. This article provides several case study examples, using the oil and gas extraction, coal mining, and chemical manufacturing sectors to portray challenges data users may face when developing employment estimates that suit their needs. Data users should be aware of a variety of data sources to understand alternative analysis options when data limitations are present and to determine which data source best meets their needs. Instances may occur in which information from one dataset may be used to help impute missing values.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2024

Physical Yukawa couplings in heterotic string compactifications

One of the challenges of heterotic compactification on a CalabiYau threefold is to determine the physical (27) 3 Yukawa couplings of the resulting four-dimensional $\mathcal{N}$ = 1 theory. In general, the calculation necessitates knowledge of the Ricci-flat metric. However, in the standard embedding, which references the tangent bundle, we can compute normalized Yukawa couplings from the Weil-Petersson metric on the moduli space of complex structure deformations of the Calabi-Yau manifold. In various examples (the Fermat quintic, the intersection of two cubics in $\mathbb{P}$ 5 , and the TianYau manifold), we calculate the normalized Yukawa couplings for (2,1)-forms using the Weil-Petersson metric obtained from the Kodaira-Spencer map. In cases where $h^{1,1}$ = 1 , this is compared to a complementary calculation based on performing period integrals. A third expression for the normalized Yukawa couplings is obtained from a machine learned approximate Ricci-flat metric making use of explicit harmonic representatives. Finally, the excellent agreement between the different approaches opens the door to precision string phenomenology.

Butbaia, Giorgi↗

DOE OSTI2021

Quantifying the impacts of compound extremes on agriculture

Agricultural production and food prices are affected by hydroclimatic extremes. There has been a growing amount of literature measuring the impacts of individual extreme events (heat stress or water stress) on agricultural and human systems. Yet, we lack a comprehensive understanding of the significance and the magnitude of the impacts of compound extremes. This study combines a fine-scale weather product with outputs of a hydrological model to construct functional metrics of individual and compound hydroclimatic extremes for agriculture. Then, a yield response function is estimated with individual and compound metrics, focusing on corn in the United States during the 1981–2015 period. Supported by statistical evidence, the findings suggest that metrics of compound hydroclimatic extremes are better predictors of corn yield variations than metrics of individual extremes. The results also confirm that wet heat is more damaging than dry heat for corn. This study shows the average yield damage from heat stress has been up to four times more severe when combined with water stress.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Supercritical CO2 Recuperators, Presented at The ASME Turbo Expo 2017, June 29, 2017, by Dr. John Kelly, President, Altex Technologies Corporation

Closed Brayton super-critical CO2 power cycles are well suited to waste heat bottoming cycles, due to their increased efficiency and compactness, relative to Rankine steam bottoming cycles. Since waste heat applications would be retrofits, the power system compactness is important. To achieve high efficiency, these power cycles require high pressure recuperative type heat exchangers, of substantial heat duty. Current Printed Circuit Heat Exchangers (PCHE), originally developed for high pressure gas and oil applications, can be used as recuperators, but costs are higher than desired. Altex is developing a purpose-built high pressure and effectiveness recuperator to provide the reliability, compactness, performance and pressure capability of current recuperators, but at a reduced cost. The High Effectiveness Low Cost (HELC) recuperative heat exchanger design yields volume and weight metrics of .0024 m3/UA and 10.2 kg/UA, which are 4% and 77.3% below recuperator target metrics, respectively. A 50 kW test article was designed and fabricated. Performance tests on water and oil showed that the HELC design model could predict heat transfer, to within 10% of the measured value. This model was then used to project HELC performance, when operating on supercritical CO2. Besides performance tests, the test article was hydrostatically tested, for integrity at up to 4,000 psi pressure. At these conditions, some distortion of channels was encountered. To mitigate distortion, the inserts were redesigned and these results were used to project the cost of 500 kW and 5,083 kW HELC units. The cost metric for the 5,083 kW unit was determined to be $1,349/UA, which is 10% lower than the recuperator desired cost metric desired target of $1,500/UA. In addition, the 5,083 kW unit HELC cost of $61.09/kW is 33.6% lower than the $92/kW estimated cost for a PCHE. Hydrostatic pressure tests, at up to 4,000psi, showed that the unit did not leak. However, channels were distorted at this pressure differential. Design updates to minimize stress concentrations and distortion were prepared and analyzed, to show that distortion could be controlled, but to date tests have not been run to prove the design. Project results show the potential of the HELC approach, but more work is required to confirm this potential, at the larger scales of interest.

14 SOLAR ENERGY↗

DOE OSTI2020

High Effectiveness, Compact, High Pressure and Low-Cost Recuperator, Presented at The Fifth International Symposium – Super-Critical CO2 Power Cycles, San Antonio, Texas, March 28-31, 2016, by Dr. John Kelly, President, Altex Technologies Corporation

Closed Brayton super-critical CO2 power cycles are well suited to waste heat bottoming cycles, due to their increased efficiency and compactness, relative to Rankine steam bottoming cycles. Since waste heat applications would be retrofits, the power system compactness is important. To achieve high efficiency, these power cycles require high pressure recuperative type heat exchangers, of substantial heat duty. Current Printed Circuit Heat Exchangers (PCHE), originally developed for high pressure gas and oil applications, can be used as recuperators, but costs are higher than desired. Altex is developing a purpose-built high pressure and effectiveness recuperator to provide the reliability, compactness, performance and pressure capability of current recuperators, but at a reduced cost. The High Effectiveness Low Cost (HELC) recuperative heat exchanger design yields volume and weight metrics of .0024 m3/UA and 10.2 kg/UA, which are 4% and 77.3% below recuperator target metrics, respectively. A 50 kW test article was designed and fabricated. Performance tests on water and oil showed that the HELC design model could predict heat transfer, to within 10% of the measured value. This model was then used to project HELC performance, when operating on supercritical CO2. Besides performance tests, the test article was hydrostatically tested, for integrity at up to 4,000 psi pressure. At these conditions, some distortion of channels was encountered. To mitigate distortion, the inserts were redesigned and these results were used to project the cost of 500 kW and 5,083 kW HELC units. The cost metric for the 5,083 kW unit was determined to be $1,349/UA, which is 10% lower than the recuperator desired cost metric desired target of $1,500/UA. In addition, the 5,083 kW unit HELC cost of $61.09/kW is 33.6% lower than the $92/kW estimated cost for a PCHE. Hydrostatic pressure tests, at up to 4,000psi, showed that the unit did not leak. However, channels were distorted at this pressure differential. Design updates to minimize stress concentrations and distortion were prepared and analyzed, to show that distortion could be controlled, but to date tests have not been run to prove the design. Project results show the potential of the HELC approach, but more work is required to confirm this potential, at the larger scales of interest.

14 SOLAR ENERGY↗

DOE OSTI2020

High Effectiveness, Compact, High Pressure and Low Cost Recuperator for Super-Critical CO2 Power Cycles, Paper Presented at The Fifth International Symposium – Super-Critical CO2 Power Cycles, San Antonio, Texas, March 28-31, 2016, by Dr. John Kelly, President, Altex Technologies Corporation

Closed Brayton super-critical CO2 power cycles are well suited to waste heat bottoming cycles, due to their increased efficiency and compactness, relative to Rankine steam bottoming cycles. Since waste heat applications would be retrofits, the power system compactness is important. To achieve high efficiency, these power cycles require high pressure recuperative type heat exchangers, of substantial heat duty. Current Printed Circuit Heat Exchangers (PCHE), originally developed for high pressure gas and oil applications, can be used as recuperators, but costs are higher than desired. Altex is developing a purpose-built high pressure and effectiveness recuperator to provide the reliability, compactness, performance and pressure capability of current recuperators, but at a reduced cost. The High Effectiveness Low Cost (HELC) recuperative heat exchanger design yields volume and weight metrics of .0024 m3/UA and 10.2 kg/UA, which are 4% and 77.3% below recuperator target metrics, respectively. A 50 kW test article was designed and fabricated. Performance tests on water and oil showed that the HELC design model could predict heat transfer, to within 10% of the measured value. This model was then used to project HELC performance, when operating on supercritical CO2. Besides performance tests, the test article was hydrostatically tested, for integrity at up to 4,000 psi pressure. At these conditions, some distortion of channels was encountered. To mitigate distortion, the inserts were redesigned and these results were used to project the cost of 500 kW and 5,083 kW HELC units. The cost metric for the 5,083 kW unit was determined to be $1,349/UA, which is 10% lower than the recuperator desired cost metric desired target of $1,500/UA. In addition, the 5,083 kW unit HELC cost of $61.09/kW is 33.6% lower than the $92/kW estimated cost for a PCHE. Hydrostatic pressure tests, at up to 4,000psi, showed that the unit did not leak. However, channels were distorted at this pressure differential. Design updates to minimize stress concentrations and distortion were prepared and analyzed, to show that distortion could be controlled, but to date tests have not been run to prove the design. Project results show the potential of the HELC approach, but more work is required to confirm this potential, at the larger scales of interest.

14 SOLAR ENERGY↗

DOE OSTI2020

2019 ASHRAE Handbook: HVAC Applications - Chapter 37 - Energy Use and Management

Handbook is a highly-regarded engineers reference book for heating, ventilating, air conditioning, and energy engineers. Building energy and water use metrics were developed for 53 commercial and residential building types. Supporting narrative was drafted and provided along with multiple tables of building performance metrics for publication in this ASHRAE handbook. ORNL (T. Sharp) developed the building performance metrics in Tables 2, 3, and 4 and authored the narrative about them. T. Sharp also authored the section on "Benchmarking Water Use" and developed building water use metrics published in Table 5.

Sharp, Terry↗

DOE OSTI2021

Data Release Report for the Source Physics Experiment Phase II: Dry Alluvium Geology Experiments (DAG-1 through DAG-4), Nevada National Security Site

The Dry Alluvium Geology (DAG) project was Phase II of the Source Physics Experiment and consisted of a series of four chemical explosive tests conducted in the same source hole on the Nevada National Security Site. This hole is located at 37.1146°N and -116.0693°W, with a surface elevation of 1,285.2 meters (m) (4,216.5 feet [ft]) above sea level. The first test (DAG-1) was conducted on July 20, 2018, at 16:51:52.67838 Coordinated Universal Time (UTC). The explosive source for DAG-1 was nitromethane initiated by a small plastic-bonded explosive (PBX) charge, detonated at the depth of 385.0 m (1,263.2 ft) below ground surface. DAG-1 had a trinitrotoluene (TNT) equivalent yield of 0.908 metric tons (2,002 pounds [lbs]). DAG-2 was conducted on December 19, 2018, at 18:45:56.92115 UTC. This test was the largest in the series, with a TNT equivalent yield of 50.997 metric tons (112,429 lbs). The explosive source for DAG-2 was nitromethane initiated by a small PBX charge, detonated at the depth of 299.8 m (983.6 ft) below ground surface. DAG-3 was conducted on April 27, 2019, at 15:49:01.84183 UTC. The explosive source for this test was nitromethane initiated by a small PBX charge, detonated at the depth of 149.9 m (492.0 ft) below ground surface. DAG-3 had a TNT equivalent yield of 0.908 metric tons (2,002 lbs). The final DAG test (DAG-4) was conducted on June 22, 2019, at 21:06:19.87632 UTC. The explosive source for DAG-4 was nitromethane initiated by a small PBX charge, detonated at the depth of 51.6 m (169.3 ft) below ground surface. DAG-4 had a TNT equivalent yield of 10.357 metric tons (22,833 lbs). The four tests were recorded by an extensive set of instrumentation that included sensors both at near-field (less than 200 m) and far-field (200 m or greater) distances. The near-field instruments consisted of three-component (3C) accelerometers installed at various depths ranging from 51.6 to 385 m (169.3 to 1,263.1 ft) below ground surface in boreholes positioned around the source hole, and arrays of single-component and 3C accelerometers on the surface. The far-field network comprised a variety of seismic and acoustic sensors, including short-period geophones, broadband seismometers, and 3C accelerometers at distances of 200 m to 400 kilometers. In addition, the DAG-2, DAG-3, and DAG-4 explosions were recorded by a temporary array of 496 geophones arranged in a densely spaced grid pattern known as “Large N.” This report coincides with the release of these data for analysts and organizations that are not participants in this program. This report describes the four DAG tests and the various types of near-field, far-field, and other data that are available. Assembled data sets are accessible through: Incorporated Research Institutions for Seismology, Data Management Center 1408 NE 45th Street, Suite 201, Seattle, Washington 98105 USA. www.iris.washington.edu

58 GEOSCIENCES↗

DOE OSTI2022

Investigation of Multiple Data Streams for Gearbox Bearing Fault Prediction Through Machine-Learning Models

Operations and maintenance (O&M) cost of wind plant accounts up to 30% of total energy cost, which can be reduced through continuous monitoring and successfully detecting incipient wind turbine failures. To accomplish this, condition monitoring and predictive maintenance systems are being implemented in wind industry to support O&M decision making. A wide range of approaches for condition monitoring and fault prediction have been developed. These approaches generally use historical data of wind turbines collected by Supervisory Control and Data Acquisition (SCADA) system to identify patterns that lead to failure. These SCADA data show the overall condition of a wind turbine and can be leveraged to detect when the turbine's performance is degrading and to identify if a fault is developing. However, it becomes challenging to predict the failure of a specific wind turbine gearbox bearing, because the SCADA data are often not directly linked to the component. To bridge the gap, we have investigated features calculated from SCADA data using physics-based models and the gearbox design over the years. The damaged metric we used in the physics domain is frictional energy. Combining these physics domain variables with SCADA data as inputs to various machine learning models for gearbox bearing fault prediction, we have demonstrated the benefits of leveraging both physics and data domain models. It was an attempt to improve frictional-energy-based damage metric by adding data domain inputs, as we had learned that the frictional-energy-based damage metric alone is not sufficient to single out failed bearings from healthy. As condition monitoring data (either vibration or oil debris data) has become available at more and more wind plants, we would like to evaluate whether by adding the condition monitoring data can help further improve the performance of frictional-energy-based damage metric for gearbox bearing fault prediction. Both cases by modeling through various machine learning algorithms are discussed in this study along with some observations.

fault prediction↗

DOE OSTI2023

Sustainability Criteria for Hydrogen Deployments

Hydrogen sustainability metrics that exist today are primarily limited to economic and environmental factors. While these are good, further research is needed to refine existing metrics and provide frameworks with which to consider other future, quantifiable metrics such as social metrics. This research, funded by Mission Innovation in collaboration with Department of State and the Department of Energy, will aim to expand sustainability framework considerations in a manner that can be accurately measured which will guide deployment of and investment in hydrogen supply chain infrastructure projects.

ENERGY PLANNING, POLICY, AND ECONOMY,HYDROGEN↗

DOE OSTI2023

Anomalous behavior detection by an artificial intelligence-enabled system with multiple correlated sensors

Multi-metric artificial intelligence (AI)/machine learning (ML) models for detection of anomalous behavior of a machine/system are disclosed. The multi-metric AI/ML models are configured to detect anomalous behavior of systems having multiple sensors that measure correlated sensor metrics such as coolant distribution units (CDUs). The multi-metric AI/ML models perform the anomalous system behavior detection in a manner that enables both a reduction in the amount of sensor instrumentation needed to monitor the system's operational behavior as well as a corresponding reduction in the complexity of the firmware that controls the sensor instrumentation. As such, AI-enabled systems and corresponding methods for anomalous behavior detection disclosed herein offer a technical solution to the technical problem of increased failure rates of existing multi-sensor systems, which is caused by the presence of redundant sensor instrumentation that necessitates complex firmware for controlling the sensor instrumentation.

Serebryakov, Sergey↗

DOE OSTI2023

Acoustic signal based analysis of batteries

Systems and methods for acoustic signal based analysis, include obtaining acoustic response signal data of at least a portion of a battery cell, the acoustic response signal data comprising waveforms generated by transmitting one or more acoustic excitation signals into at least the portion of the battery cell and recording response vibration signals to the one or more acoustic excitation signals. One or more metrics are determined from at least the acoustic response signal data, the one or more metrics being determined based on correlation of the one or more metrics to one or more characteristics of battery cells and a reference model is generated from the one or more metrics. A test battery can be evaluated using the reference model. Actionable insights or recommendations can be generated based on the evaluation. The reference model can also be updated based on the evaluation.

Van Tassell, Barry J.↗

DOE OSTI2024

Measuring Sustainability of Solar Modules for Energy Transition: Mass, Energy, and Circularity

Transition to a carbon-free energy system is crucial for global decarbonization and underpins Circular Economy (CE) goals. Photovoltaic (PV) technology is required for Energy Transition, but manufacturing and circular pathways can be material, energy, and carbon-intensive. Therefore, we need a prioritization of sustainability strategies for PV evolution and lifecycle management in the context of Energy Transition. This study employs a suite of quantitative metrics to compare different proposed sustainability strategies for PV modules on their ability to achieve Energy Transition. Proposals for sustainable PV range from high-yield, high-efficiency paradigms, to short-lived and fully recyclable, to long-lasting, indestructible modules. We leverage a global decarbonization deployment schedule through 2100 with the open-source PV in Circular Economy (PV ICE) tool to quantify the impacts of different evolving module design scenarios covering the range of proposed sustainability strategies. First, modules are compared on effective capacity and required replacements to meet and maintain decarbonization capacity targets through 2100. We demonstrate the effects of lifetime, degradation, and reliability on effective capacity. Next, we quantify and compare virgin material demands and lifecycle wastes, examining the impacts of lifetime and recycling rates. Finally, and critically for renewable energy technologies, we quantify the energy demands required to achieve the decarbonization capacity targets and calculate energy balance metrics (net energy, energy return on investment). These results are then summarized into a metric matrix, demonstrating tradeoffs and the importance of longevity. Our suite of mass and energy metrics provides stakeholders and decision-makers with quantitative data on circular economy choices for PV in the energy transition, enabling informed evaluation of tradeoffs of different PV module designs and CE pathways.

circular economy↗

DOE OSTI2024

Life-Cycle Assessment Integration into Scalable Open-Source Numerical Models (LiAISON) for Analyzing Emerging Low-Carbon Technologies

Decarbonizing the industrial sector is a significant challenge in achieving a net-zero greenhouse gas (GHG) emissions economy by 2050 and the Paris Agreement, i.e., a global climate change mitigation target of achieving a maximum average temperature change potential of 1.5 degrees Celsius or less by 2100 with respect to pre-industrial levels. In the United States (US), the industrial sector accounts for 23% of total GHG emissions and is home to a number of hard-to-electrify activities. The chemicals subsector has the single largest subsector emissions profile after direct emissions from fossil fuel combustion and leakage from fossil fuel distribution systems. Within the chemicals subsector, many processes depend on hydrogen or ammonia precursors. Decarbonizing these two commodities would contribute significantly to decarbonizing the industrial sector as hydrogen could also be used for low carbon steel production (e.g., hydrogen-based direct reduction of iron) and other industrial applications. Emerging technologies require the application of prospective life cycle assessment (LCA), which can account for technology (foreground) scaling and process improvements via learning-by-doing, among others. In many cases, the future system context (background) in which the technologies are assumed to operate in is equally relevant. Background scenarios generated by integrated assessment models (IAM) can coherently incorporate potential future dynamics of the energy-climate-human-land system. Further, IAM scenarios are harmonized across socioeconomic and climate change mitigation pathways, which facilitates the comparability of prospective LCAs using different IAMs. We introduce an open source prospective LCA framework, the Life-cycle Assessment Integration into Scalable Open-source Numerical models (LiAISON), to analyze the non-linear relationships between technology foreground and the future energy system background across a series of midpoint and resource use metrics. The integration of LCA and IAM data is achieved using prospective environmental Impact assessment (PREMISE). We showcase it by assessing two Power-to-Hydrogen (PtH2) processes, namely Solid Oxide Electrolysis (SOE) and Polymer Electrolyte Membrane Electrolysis (PEME). We compare the technologies to a baseline of hydrogen production via natural gas-based Steam Methane Reforming (SMR) in a US context of multiple energy system and climate change mitigation futures. Besides providing an analysis that specifies the LCA results ranges with temporal and geospatial explicitness across the two technologies, metrics, and impact assessment methods, this research also aims to establish a base framework that can be expanded to use other IAM generated scenarios and US open-source life cycle inventory (LCI) databases. We find that the temporal environmental performance of either technology or their difference to SMR is directly influenced by the underlying background dynamics. Under baseline projections (i.e., no decarbonization goals), neither process reaches parity with the incumbent technology across several environmental metrics. Under the decarbonization scenarios, the underlying sectoral shifts result in declining impacts over time, compared to 2020 levels, except for metal depletion levels, which increase. The background shifts postulate a heavily decarbonized economy and energy system, which help technologies reach parity with SMR between 2040-2050 (RCP2.6) and 2030-2040 (RCP1.9) for global warming. Despite declines across several other metrics over time, neither PtH2 technology break even with SMR by 2100 besides for global warming.

decarbonizing↗

DOE OSTI2024

Life-Cycle Assessment Integration into Scalable Open-Source Numerical Models (LiAISON) for Analyzing Emerging Low-Carbon Technologies

Decarbonizing the industrial sector is a significant challenge in achieving a net-zero greenhouse gas (GHG) emissions economy by 2050 and the Paris Agreement, i.e., a global climate change mitigation target of achieving a maximum average temperature change potential of 1.5 degrees C or less by 2100 with respect to pre-industrial levels. In the United States (US), the industrial sector accounts for 23% of total GHG emissions and is home to a number of hard-to-electrify activities. The chemicals subsector has the single largest subsector emissions profile after direct emissions from fossil fuel combustion and leakage from fossil fuel distribution systems. Within the chemicals subsector, many processes depend on hydrogen or ammonia precursors. Decarbonizing these two commodities would contribute significantly to decarbonizing the industrial sector as hydrogen could also be used for low carbon steel production (e.g., hydrogen-based direct reduction of iron) and other industrial applications. Emerging technologies require the application of prospective life cycle assessment (LCA), which can account for technology (foreground) scaling and process improvements via learning-by-doing, among others. In many cases, the future system context (background) in which the technologies are assumed to operate in is equally relevant. Background scenarios generated by integrated assessment models (IAM) can coherently incorporate potential future dynamics of the energy-climate-human-land system. Further, IAM scenarios are harmonized across socioeconomic and climate change mitigation pathways, which facilitates the comparability of prospective LCAs using different IAMs. We introduce an open source prospective LCA framework, the Life-cycle Assessment Integration into Scalable Open-source Numerical models (LiAISON), to analyze the non-linear relationships between technology foreground and the future energy system background across a series of midpoint and resource use metrics The integration of LCA and IAM data is achieved using prospective environmental Impact assessment (PREMISE). We showcase it by assessing two Power-to-Hydrogen (PtH2) processes, namely Solid Oxide Electrolysis (SOE) and Polymer Electrolyte Membrane Electrolysis (PEME). We compare the technologies to a baseline of hydrogen production via natural gas-based Steam Methane Reforming (SMR) in a US context of multiple energy system and climate change mitigation futures. Besides providing an analysis that specifies the LCA results ranges with temporal and geospatial explicitness across the two technologies, metrics, and impact assessment methods, this research also aims to establish a base framework that can be expanded to use other IAM generated scenarios and US open-source life cycle inventory (LCI) databases. We find that the temporal environmental performance of either technology or their difference to SMR is directly influenced by the underlying background dynamics. Under baseline projections (i.e., no decarbonization goals), neither process reaches parity with the incumbent technology across several environmental metrics. Under the decarbonization scenarios, the underlying sectoral shifts result in declining impacts over time, compared to 2020 levels, except for metal depletion levels, which increase. The background shifts postulate a heavily decarbonized economy and energy system, which help technologies reach parity with SMR between 2040-2050 (RCP2.6) and 2030-2040 (RCP1.9) for global warming. Despite declines across several other metrics over time, neither PtH2 technology break even with SMR by 2100 besides for global warming.

decarbonizing↗

DOE OSTI2024

Acoustics-based noninvasive wafer defect detection

Techniques are provided for detecting wafer defects. Example techniques include exciting a wafer using an acoustic signal to cause the wafer to exhibit vibrations, measuring one or more of linear frequency response metrics or nonlinear frequency responses metrics associated with the vibrations, and identifying any defects in the wafer based at least in part on one or more of the linear frequency response metrics or nonlinear frequency responses metrics. In embodiments, the wafer includes bismuth telluride (Bi 2 Te 3 ).

Pantea, Cristian↗

DOE OSTI2026

FATHOMS-RAG: A Framework for the Assessment of Thinking and Observation in Multimodal Systems that use Retrieval Augmented Generation

Retrieval-augmented generation (RAG) has emerged as a promising paradigm for improving factual accuracy in large language models (LLMs). We introduce a benchmark designed to evaluate RAG pipelines as a whole, evaluating a pipelines ability to ingest several modalities of information. We present (1) a curated dataset of 93 questions designed to evaluate a pipeline's ability to ingest textual data, tables, images, multimodal data, and cross-document multimodal data; (2) a phrase-level recall metric for correctness; (3) a nearest-neighbor embedding classifier in an attempt to classify pipeline hallucinations; (4) a comparative evaluation of 2 pipelines built with open-source retrieval mechanisms and 4 closed-source foundational models; and (5) a third-party human evaluation of the alignment of our correctness and hallucination metrics. We find that closed-source pipelines significantly outperform open-source pipelines in both the correctness and halucination metrics, with a wider performance gap in questions relying on multimodal and cross-document information. We also find after a human evaluation of our correctness and hallucination metric compared with our questions and pipeline responses, average agreement was 4.62 for correctness 4.53 for hallucination detection on a 1-5 Likert scale with 5 being strongly agree with our determination.

Hildebrand, Samuel [ORNL] (ORCID:0009000465963104)↗

DOE OSTI2022

Utilization of the Critic Subnetwork of a Generative Adversarial Network as Detector of Morphological Material Change in Image Data

The resolution of computed tomography (CT) has become high enough to monitor morphological changes due to aging in materials in long-term applications. For this work, we explored the utility of the critic of a generative adversarial network (GAN) to automatically detect such changes. The GAN was trained with images of pristine Pharmatose, which is used as a surrogate energetic material. It is important to note that images of the material with altered morphology were only used during the test phase. The GAN-generated images reproduced the microstructure of Pharmatose well, although some unrealistic particle fusion was seen. Calculated morphological metrics (volume fraction, interfacial line length, and local thickness) for the synthetic images also showed good agreement with the training data, albeit with signs of mode collapse in the interfacial line length. While the critic exposed changes in particle size, it showed limited ability to distinguish images by particle shape. The detection of shape differences was also a more challenging task for the selected morphological metrics that related to energetic material performance. We further tested the critic with images of aged Pharmatose. Subtle changes due to aging are difficult for the human analyst to detect; but both critic and morphological metrics analysis showed image differentiation.

36 MATERIALS SCIENCE↗