Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “human systems modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

An extended focused assessment with sonography in trauma ultrasound tissue-mimicking phantom for developing automated diagnostic technologies

Medical imaging-based triage is critical for ensuring medical treatment is timely and prioritized. However, without proper image collection and interpretation, triage decisions can be hard to make. While automation approaches can enhance these triage applications, tissue phantoms must be developed to train and mature these novel technologies. Here, we have developed a tissue phantom modeling the ultrasound views imaged during the enhanced focused assessment with sonography in trauma exam (eFAST). The tissue phantom utilized synthetic clear ballistic gel with carveouts in the abdomen and rib cage corresponding to the various eFAST scan points. Various approaches were taken to simulate proper physiology without injuries present or to mimic pneumothorax, hemothorax, or abdominal hemorrhage at multiple locations in the torso. Multiple ultrasound imaging systems were used to acquire ultrasound scans with or without injury present and were used to train deep learning image classification predictive models. Performance of the artificial intelligent (AI) models trained in this study achieved over 97% accuracy for each eFAST scan site. We used a previously trained AI model for pneumothorax which achieved 74% accuracy in blind predictions for images collected with the novel eFAST tissue phantom. Grad-CAM heat map overlays for the predictions identified that the AI models were tracking the area of interest for each scan point in the tissue phantom. Overall, the eFAST tissue phantom ultrasound scans resembled human images and were successful in training AI models. Tissue phantoms are critical first steps in troubleshooting and developing medical imaging automation technologies for this application that can accelerate the widespread use of ultrasound imaging for emergency triage.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

Metabolic Feedback Inhibition Influences Metabolite Secretion by the Human Gut Symbiont Bacteroides thetaiotaomicron

ABSTRACT Microbial metabolism and trophic interactions between microbes give rise to complex multispecies communities in microbe-host systems. Bacteroides thetaiotaomicron ( B. theta ) is a human gut symbiont thought to play an important role in maintaining host health. Untargeted nuclear magnetic resonance metabolomics revealed B. theta secretes specific organic acids and amino acids in defined minimal medium. Physiological concentrations of acetate and formate found in the human intestinal tract were shown to cause dose-dependent changes in secretion of metabolites known to play roles in host nutrition and pathogenesis. While secretion fluxes varied, biomass yield was unchanged, suggesting feedback inhibition does not affect metabolic bioenergetics but instead redirects carbon and energy to CO 2 and H 2 . Flux balance analysis modeling showed increased flux through CO 2 -producing reactions under glucose-limiting growth conditions. The metabolic dynamics observed for B. theta , a keystone symbiont organism, underscores the need for metabolic modeling to complement genomic predictions of microbial metabolism to infer mechanisms of microbe-microbe and microbe-host interactions. IMPORTANCE Bacteroides is a highly abundant taxon in the human gut, and Bacteroides thetaiotaomicron ( B. theta ) is a ubiquitous human symbiont that colonizes the host early in development and persists throughout its life span. The phenotypic plasticity of keystone organisms such as B. theta is important to understand in order to predict phenotype(s) and metabolic interactions under changing nutrient conditions such as those that occur in complex gut communities. Our study shows B. theta prioritizes energy conservation and suppresses secretion of “overflow metabolites” such as organic acids and amino acids when concentrations of acetate are high. Secreted metabolites, especially amino acids, can be a source of nutrients or signals for the host or other microbes in the community. Our study suggests that when metabolically stressed by acetate, B. theta stops sharing with its ecological partners.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Model predictive control for integrated control of air-conditioning and mechanical ventilation, lighting and shading systems

Modern buildings are increasingly automated and often equipped with multiple building services (e.g., air-conditioning and mechanical ventilation (ACMV), dynamic shading, dimmable lighting). These systems are conventionally controlled individually without considering their interactions, affecting the building’s overall energy inefficiency and occupant comfort. A model predictive control (MPC) system that features a multi-objective MPC scheme to enable coordinated control of multiple building services for overall optimized energy efficiency, indoor thermal and visual comfort, as well as a hybrid model for predicting indoor visual comfort and lighting power is proposed. The MPC system was implemented in a test facility having two identical, side-by-side experimental cells to facilitate comparison with a building management system (BMS) employing conventional reactive feedback control. The MPC system coordinated the control of the ACMV, dynamic façade and automated dimmable lighting systems in one cell while the BMS controlled the building services in the other cell in a conventional manner. The MPC side achieved 15.1–20.7% electricity consumption reduction, as compared to the BMS side. Simultaneously, the MPC system improved indoor thermal comfort by maintaining the room within the comfortable range (-0.5 < predicted mean vote < 0.5) for 98.3% of the time, up from 91.8% of the time on the BMS side. Visual comfort, measured by indoor daylight glare probability (DGP) and horizontal illuminance level at work plane height, was maintained for the entire test period on the MPC side, improving from having visual comfort for 94.5% and 85.7% of the time, respectively, on the BMS side.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

High-Fidelity Accelerated Design of High-performance Electrochemical Systems

Large-scale electrification is vital to addressing the climate crisis, but several scientific and technological challenges remain to fully electrify both the chemical industry and transportation. In both of these areas, new electrochemical materials will be critical, but their development currently relies heavily on human-time-intensive experimental trial and error and computationally expensive first-principles, meso-scale and continuum simulations. To accelerate this process, our team has developed the AutoMat platform. AutoMat can accelerate development of new electrochemical materials along two avenues: first, automated input generation and management of simulations at multiple lengthscales as well as “handoff” of outputs from one lengthscale as inputs to the next; and second, replacement of the most computationally intensive simulation processes with machine-learned surrogate models. The crux of our team’s effort was not “reinventing the wheel” by developing entirely new techniques, but rather building a “superhighway” that allows existing state-of-the-art techniques to run faster and more smoothly than before. AutoMat can utilize tools spanning from first-principles quantum chemistry computations to automated robotic experimentation, and is driven by design space search techniques to reduce the number of iterations through the full simulation loop by rapidly targeting promising regions of design spaces such as single-atom alloy catalysts or blends of liquid electrolytes.

25 ENERGY STORAGE↗
DOE OSTI2023

Expanded diversity of novel hemoplasmas in rare and undersampled Neotropical bats

Hemotropic mycoplasmas are emerging as a model system for studying bacterial pathogens in bats, but taxonomic coverage of sampled host species remains biased. We leveraged a long-term field study in Belize to uncover novel hemoplasma diversity in bats by analyzing 80 samples from 19 species, most of which are infrequently encountered. PCR targeting the partial 16S rRNA gene found 41% of bats positive for hemoplasmas. Phylogenetic analyses found two novel host shifts of hemoplasmas, four entirely new hemoplasma genotypes, and the first hemoplasma detections in four bat species. One of these novel hemoplasmas (from Neoeptesicus furinalis) shared 97.6% identity in the partial 16S rRNA gene to a human hemoplasma (Candidatus Mycoplasma haemohominis). Additional analysis of the partial 23S rRNA gene allowed us to also designate two novel hemoplasma species, in Myotis elegans and Phyllostomus discolor, with the proposed names Candidatus Mycoplasma haematomyotis sp. nov. and Candidatus Mycoplasma haematophyllostomi sp. nov., respectively. Our analyses show that additional hemoplasma diversity in bats can be uncovered by targeting rare or undersampled host species.

16S rRNA gene↗
DOE OSTI2021

Foreword: Selected papers from the 2020 Nuclear and Emerging Technologies for Space Topical Meeting (NETS 2020)

Humanity’s curiosity of and intrigue for exploring space has been with our species since we first looked up into the night sky. This age-old curiosity has driven humankind to innovate technologies for millennia, including efforts ranging from the construction of Stonehenge to track the annual movements of the sun to the investigation of advanced propulsion systems capable of transporting people to distant planets. Today’s technical communities dedicated to researching and developing innovative technologies for space exploration have seen a recent reinvigoration. Over the past few years, impressive progress made by industry, with exceptional support from government agencies, to reestablish and develop new capabilities has renewed confidence in humanity’s ability to reach the stars—a confidence that has not been present since the days of the Apollo program. Moreover, history shows that innovation and collaboration within the scientific and engineering communities reaches unparalleled pinnacles during periods of astrophilia. Finally, given the advancements in computational capacities for advanced modeling and simulation, unprecedented breakthroughs in commercializing advanced manufacturing techniques, and powerful collaborative relationships between industry and national scientific organizations, today we are limited only by our own imaginations.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2024

Decode the Workload: Training Deep Learning Models for Efficient Compute Cluster Representation

Monitoring the status of a high throughput computing cluster running computationally intensive production jobs is a crucial yet challenging system administration task due to the complexity of such systems. To this end, we train autoencoders using the Linux kernel CPU metrics of the cluster. Additionally, we explore assisting these models with graph neural networks to share information across threads within a compute node. The models are compared in terms of their ability to: 1) Produce a compressed latent representation that captures the salient features of the input, 2) Detect anomalous activity, and 3) Make distinction between different kinds of jobs run at Jefferson Lab. The goal is to have a robust encoder whose compressed embeddings are used for several downstream tasks. We extend this study further by deploying these models in a human-in-the-loop production-based setting for the anomaly detection task and discuss the associated implementation aspects such as continual learning and the criterion to generate alarms. This study represents a first step in the endeavor towards building self-supervised large-scale foundation models for computing centers.

Mohammed, Ahmed↗
DOE OSTI2021

Modelling Nuclear Thermal Propulsion Reactor Startup Transients

The National Aeronautics and Space Administration (NASA) has set the goal of a manned mission to Mars by the year 2030 [1] and charged the national academy of sci- ences "to identify primary technical and programmatic chal- lenges, merits, and risks for maturing space nuclear propulsion technologies of interest to a future human Mars exploration mission" [2]. One relevant technology, nuclear thermal propul- sion (NTP), has notable advantages over traditional chemical rockets; most important among them is the ability to produce larger specific impulse on the order of 900s. The reduction of mission time is crucial for a manned mission to Mars to reduce the risk for the crew. Due to its higher specific impulse, NTP satisfies this need and is pursued as one technology to get humans to Mars [3, 4]. The construction of an NTP sys- tem has to negotiate several challenges laid out in Ref. [2]; one of these challenges is the need to startup the NTP sys- tem from essentially cold conditions to full power within one minute. This paper focuses on studying the neutronics and thermal-hydraulics behavior of a simplified NTP model dur- ing prescribed reactivity insertions and mass flow rate (MFR) ramps. It is the goal of this paper to investigate startup, peak material temperatures, and average specific impulse for a low enriched Uranium (LEU), ceramic and metal material (CER- MET) NTP system when varying reactivity insertion and MFR ramps.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2021

Cabin Thermal Management Analysis for SuperTruck II Next-Generation Hybrid Electric Truck Design

In this article, we present a multistage, coupled thermal management simulation approach, informed by physical testing where available, to aid design decisions for PACCAR's SuperTruck II hybrid truck cabin concept. Focus areas include cabin insulation, battery sizing, and sleeper curtain position, as well as heating, ventilating, and air-conditioning (HVAC) component and accessory configurations, to maintain or improve thermal comfort while saving energy. The authors analyzed weather data and determined the national vehicle miles traveled weighted temperature and solar conditions for long-haul trucks. Example weather day profiles were selected to approximate the 5th and 95th percentile weighted conditions. A daylong drive cycle was developed to impose appropriate external wind conditions during rest and driving periods. Using the National Renewable Energy Laboratory's vehicle HVAC modeling and simulation tool VTCab, HVAC load design trade-off studies for the new truck geometry concept were completed. Parameters analyzed included effects of paint color, insulation, glass transmissivity, and curtain location. Simulation results helped with early design material selections for efficient cabin climate control. A detailed three-dimensional computer-aided engineering (CAE), computational fluid dynamics (CFD), radiation, and human physiology co-simulation, referred to in this article as CAE Thermal-CFD, was used to evaluate thermal comfort and energy impacts of diffuser configurations and air supply settings in driving and hoteling modes. Analysis revealed that it is more difficult to heat the cabin in hoteling mode during the winter than to cool the space in the summer. This seasonal load profile drives the requirement of additional energy storage for heating comfort. To determine the battery capacity requirement, multiday HVAC operation drive cycle simulations were then completed, showing that a 15-kWh battery would be required for HVAC operation during hoteling. Results helped reduce cabin thermal loads, determine component sizing requirements, and improve occupant comfort to save fuel and contribute to the economic viability of the hybrid system.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2020

Cybersecurity for Distance Relay Protection

This project is a DOE follow-up effort on the CREDC workshop held on September 13, 2018 in Cambridge, MA to discuss cybersecurity of distance relays, which considered the benefits, vulnerabilities and risk mitigations for the use of communication systems in power system protection. The objectives of this project are to define the taxonomy of relay protection and associated communications; define use cases describing approaches to reduce the cyber-attack surface on those protective relays; and evaluate the loss of operational functional capability from changes to communication coverage. Mitigating controls will also be evaluated to understand if there are other approaches to reduce attack surfaces while maintaining communications or partial communications. Distance relays are used to protect transmission lines of approximately 10 to 300 miles in length, by detecting short circuits (i.e., faults) on the lines and then tripping circuit breakers in the substation. Such protection systems are a subset of the power system and they incorporate sensing, logic and communication functions. Protection system exposure to cyberattack could be drastically limited by disconnecting relays from all vulnerable communication systems, but this may adversely impact overall power system performance in the absence of cyberattack. This project began with a use case analysis of protection systems with communications, as summarized in this report. It continued with modeling, testing and evaluation in a miniature power system (MPS), located in the Western Area Power Administration (WAPA) Electric Power Training Center (EPTC). The project also incorporated feedback from two industry meetings held in February and September 2019. The suggested next steps account for and complement the work already underway with DOE/CESER funding: 1. Study the performance of LCD and PC vs. PUTT, which is less reliant on communication system performance and GPS timing references. The PUTT scheme could prove to be more resilient to cyberattack or communications-related disruption. It could also be more tolerant of message re-routing with SDN/SDR communication systems. On the other hand, it will be more vulnerable to false tripping during dynamic events or to loss of the voltage signal. The optimum choice of scheme may depend on the specific power system and risk assessment. This study could provide a new template for evaluation based on business functions. 2. Research and develop new methods to detect and monitor distributed physical attacks, possibly using drones, video sensors, thermal sensors, machine learning and other advanced techniques. This will help mitigate the impact of cyberattack on the protection system, and will also help mitigate the impact of wild fires. 3. Implement a scalable PKI for use in electric utility protection systems. This will encourage widespread adoption of secure authentication methods that are already available, but not widely used at present. This will help secure engineering access to the relays. 4. Investigate the use of SDN in combination with SDR to achieve better cybersecurity and electromagnetic security of the network, incorporating path variability. This would help secure both engineering access and peer-to-peer GOOSE messaging. 5. Perform additional testing, with operator evaluation of “red button” scenarios, PUTT vs. LCD, relay mis-operations, and other cyberattacks in the EPTC. This is an important advantage of testing in the EPTC rather than by computer simulation or even hardware-in-the-loop simulation; the EPTC is already dedicated to managing the situational awareness, operator response times and other human impacts. One of the project objectives was to settle on a common nomenclature for this problem space. We have concluded that the OSI layer model, supplemented by ANSI device numbers and other IEEE standards, is already well-accepted by the industry. The IEEE PSRC knowledge base provides a great deal of public information

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

A machine-learning-driven data labeling pipeline for scientific analysis in MLExchange

This study introduces a novel labeling pipeline to accelerate the labeling process of scientific data sets by using artificial intelligence (AI)-guided tagging techniques. This pipeline includes a set of interconnected web-based graphical user interfaces (GUIs), where Data Clinic and MLCoach enable the preparation of machine learning (ML) models for data reduction and classification, respectively, while Label Maker is used for label assignment. Throughout this pipeline, data can be accessed through a direct connection to a file system or through Tiled for access through Hypertext Transfer Protocol (HTTP). Our experimental results present three use cases where this labeling pipeline has been instrumental for the study of large X-ray scattering data sets in the area of pattern recognition, the remote analysis of resonant soft X-ray scattering data and the fine-tuning process of foundation models. These use cases highlight the labeling capabilities of this pipeline, including the ability to label large data sets in a short period of time, to perform remote data analysis while minimizing data movement and to enhance the fine-tuning process of complex ML models with human involvement.

Chavez, Tanny (ORCID:0000000193172896)↗
DOE OSTI2020

Models and Strategies for Optimal Demand Side Management in the Chemical Industries

Deregulation and the increase of renewable electricity generation from wind and solar photovoltaics have transformed the U.S. electricity market. Economic and environmental benefits notwithstanding, the presence of renewables has increased variability and uncertainty on the supply side of the grid. Managing demand, rather than generation – a strategy referred to as “demand response (DR)” – is an attractive approach for mitigating this imbalance. DR efforts aim to reduce electricity usage during peak demand times, lessening stress on the grid. Industrial users are particularly attractive entities for DR participation since they present large, localized loads that can provide significant relief on grid demand and –unlike other large loads, such as buildings – are minimally dependent on human needs and preferences. In this project, we accomplished three main objectives. (1) We developed data-driven low-order DR scheduling-relevant dynamic models of chemical processes. Concurrently, we studied the formulation and solution of the associated optimal DR production scheduling problems. (a) A prototype air separation unit (ASU) model was used to generate simulated operating data for initial modeling efforts, which enabled the later use of industrial data for data-driven modeling. (b) We utilized Hammerstein-Wiener (HW) and Finite Step Response (FSR) models to represent nonlinear plant dynamics. (c) The HW models were linearized using exact linearization so they could potentially be embedded in power system models, which are formulated as mixed integer linear programs (MILPs). (d) We solved DR optimization problems under uncertainty and found that even naïve predictions of electricity price and product demand led to significant cost savings benefits. (2) Our DR scheduling optimization problem formulations are amenable to real-time solution. (a) We utilized Lagrangian Relaxation (LR) to efficiently solve the optimization problem by decoupling subproblems linked by complicating constraints. (b) We have achieved computation times for the 3-day DR scheduling problem of an ASU as low as 1.88 minutes. (3) Our representations of the DR behavior of chemical process as grid-level batteries were embedded in power system models. (a) For a small-scale grid, we found that incorporating the dynamics of the chemical plant in the optimal power flow calculations resulted in better resource management leading to up to 15% and 46% cost reduction for the grid and chemical plant operations, respectively, during periods of power line congestion. We have published several works dedicated to modeling and solving DR optimization problems from the user side. These were published in top peer-reviewed journals and are summarized in this report. The most recent work (and papers in preparation) considers DR scheduling from the grid side. Future efforts will consider networked plants (e.g., air separation units operating on a common pipeline) for DR participation, which is expected to amplify the capabilities of industrial DR participants to perform load-shifting. Our consideration of uncertainty in DR has inspired future directions in this area as well: we plan to develop multistage methods to fully account for the effects of uncertainty in DR scheduling.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Reevaluating Contour Visualizations for Power Systems Data

Effective visual analytics tools are needed now more than ever as emerging energy systems data and models are rapidly growing in scale and complexity. Here we examined the suitability of colored contour maps to visually represent bus values in two different power system models: a dense 24k-bus distribution system and a 240-bus transmission system. In a quantitative analysis, we found that contour maps misrepresent power systems data, changing the statistical dispersion of the bus values, including the loss of extreme values. In a controlled empirical study with thirty professional power system research engineers, we found that these distortions significantly impact excursion identification tasks. Additionally, the engineers were less confident in their assessments using contour-based visualizations than glyph-based visualizations.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

A characterization of recombinant Arabidopsis FRIABLE1 (FRB1) reveals robust rhamnogalacturonan-I rhamnosyltransferase activity and critical catalytic residues

Plant cell walls are glycan-rich extracellular matrices that fundamentally impact essential cellular processes, such as growth, adhesion, and cell shape acquisition. Understanding plant cell wall glycans requires the identification and characterization of the biosynthetic enzymes that produce these polymers. Most successful in vitro protein expression studies of plant cell wall glycosyltransferases have relied on insect, fungal/yeast, or human cell expression systems, whereas prokaryotic expression systems have been generally unsuccessful. Here, we show that Arabidopsis FRIABLE1 (FRB1)/rhamnogalacturonan-I rhamnosyltransferase 8 (RRT8) can be produced in Escherichia coli RosettaGami2 cells as N-terminal maltose-binding protein fusion proteins containing C-terminal 6X-His-tags. We also report the catalytic constants of FRB1/RRT8 with apparent K M and K cat values of 226 μM and 33 min -1 for UDP-Rhamnose and 117 μM and 28.7 min -1 for rhamnogalacturonan-I (RG-I), respectively. We examine the catalytic activities of mutated FRB1/RRT8 proteins based on an AlphaFold 3-generated FRB1/RRT8 protein structural model with a virtually docked UDP-Rha donor. Enzymatic characterization of the mutated and wildtype FRB1/RRT8 protein confirmed that mutation of predicted catalytic site amino acid residues resulted in a 20-fold reduction in RRT activity. FRB1 also robustly polymerizes RG-I in combination with RG-I galacturonosyltransferase 1. These results show how a robust E. coli expression system combined with artificial intelligence tools can be used to increase understanding of plant cell wall glycosyltransferase structure and function.

glycosyltransferase↗
DOE OSTI2024

Toward digital design at the exascale: An overview of project ICECap

High performance computing has entered the Exascale Age. Capable of performing over 1018 floating point operations per second, exascale computers, such as El Capitan, the National Nuclear Security Administration's first, have the potential to revolutionize the detailed in-depth study of highly complex science and engineering systems. However, in addition to these kind of whole machine “hero” simulations, exascale systems could also enable new paradigms in digital design by making petascale hero runs routine. Currently, untenable problems in complex system design, optimization, model exploration, and scientific discovery could all become possible. Motivated by the challenge of uncovering the next generation of robust high-yield inertial confinement fusion (ICF) designs, project ICECap (Inertial Confinement on El Capitan) attempts to integrate multiple advances in machine learning (ML), scientific workflows, high performance computing, GPU-acceleration, and numerical optimization to prototype such a future. Built on a general framework, ICECap is exploring how these technologies could broadly accelerate scientific discovery on El Capitan. In addition to our requirements, system-level design, and challenges, we describe some of the key technologies in ICECap, including ML replacements for multiphysics packages, tools for human-machine teaming, and algorithms for multifidelity design optimization under uncertainty. As a test of our prototype pre-El Capitan system, we advance the state-of-the art for ICF hohlraum design by demonstrating the optimization of a 17-parameter National Ignition Facility experiment and show that our ML-assisted workflow makes design choices that are consistent with physics intuition, but in an automated, efficient, and mathematically rigorous fashion.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Estimation Methodology to Evaluate Hypothetical Downwind Impacts from Fusion Plants

The continuing move toward establishing fusion systems for power generation and the associated research to that end is prompting examination of the potential health and safety impacts of such plants to the environment and human health. As many fusion facilities will have tritium inventories on site as part of the fusion fuel, evaluating the potential for downwind impacts from fusion facilities or power plants resulting from accident or routine emissions is a general requirement for assessing location and impacts to workers and the public. As part of siting considerations and permitting, the fusion facilities would be evaluated for potential for downwind concentration and dose impacts. For accident assessment scenarios, the downwind impacts are usually modeled as an instantaneous (or near-instantaneous) release of material transported following the wind. A range of meteorological conditions are usually assessed to determine a bounding case which results in a dose exceeding a specified threshold (e.g., 95 th or 99 th percentile; DOE 2015). This report provides initial estimates of the downwind dose impacts from a potential tritium release at a fusion power plant-relevant facility and identifies potential distances required to limit impacts to nearby population. This effort is meant to provide a bounding analysis and theoretical understanding of impacts of tritium releases for facilities subject to various environmental and atmospheric conditions. Using a Gaussian dispersion model to simulate a brief plume, downwind concentration and dose is projected for tritium oxide. Releases are assumed to consist entirely of tritium oxide due to the increased dose impacts from the oxide form relative to the elemental form of tritium. We also briefly identify how climatological conditions could potentially be used to support risk profile determination.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

FATHOMS-RAG: A Framework for the Assessment of Thinking and Observation in Multimodal Systems that use Retrieval Augmented Generation

Retrieval-augmented generation (RAG) has emerged as a promising paradigm for improving factual accuracy in large language models (LLMs). We introduce a benchmark designed to evaluate RAG pipelines as a whole, evaluating a pipelines ability to ingest several modalities of information. We present (1) a curated dataset of 93 questions designed to evaluate a pipeline's ability to ingest textual data, tables, images, multimodal data, and cross-document multimodal data; (2) a phrase-level recall metric for correctness; (3) a nearest-neighbor embedding classifier in an attempt to classify pipeline hallucinations; (4) a comparative evaluation of 2 pipelines built with open-source retrieval mechanisms and 4 closed-source foundational models; and (5) a third-party human evaluation of the alignment of our correctness and hallucination metrics. We find that closed-source pipelines significantly outperform open-source pipelines in both the correctness and halucination metrics, with a wider performance gap in questions relying on multimodal and cross-document information. We also find after a human evaluation of our correctness and hallucination metric compared with our questions and pipeline responses, average agreement was 4.62 for correctness 4.53 for hallucination detection on a 1-5 Likert scale with 5 being strongly agree with our determination.

Hildebrand, Samuel [ORNL] (ORCID:0009000465963104)↗