Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image representation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Differences in fine particle chemical composition on clear and cloudy days

Clouds are prevalent and alter fine particulate matter (PM 2.5 ) mass and chemical composition. Cloud-affected satellite retrievals are subject to higher uncertainty and are often removed from data products, hindering quantitative estimates of tropospheric chemical composition during cloudy times. We examine surface PM 2.5 chemical constituent concentrations in the Interagency Monitoring of PROtected Visual Environments (IMPROVE) network in the United States during cloudy and clear-sky times defined using Moderate Resolution Imaging Spectroradiometer (MODIS) cloud flags from 2010 to 2014 with a focus on differences in particle species that affect hygroscopicity and aerosol liquid water (ALW). Cloudy and clear-sky periods exhibit significant differences in PM 2.5 mass and chemical composition that vary regionally and seasonally. In the eastern US, relative humidity alone cannot explain differences in ALW, suggesting that emissions and in situ chemistry related to anthropogenic sources exert determining impacts. An implicit clear-sky bias may hinder efforts to quantitatively understand and improve representation of aerosol–cloud interactions, which remain dominant uncertainties in models.

54 ENVIRONMENTAL SCIENCES↗

QCalEval: Benchmarking Vision-Language Models for Quantum Calibration Plot Understanding

Quantum computing calibration depends on interpreting experimental data, and calibration plots provide the most universal human-readable representation for this task, yet no systematic evaluation exists of how well vision-language models (VLMs) interpret them. We introduce QCalEval, the first VLM benchmark for quantum calibration plots: 243 samples across 87 scenario types from 22 experiment families, spanning superconducting qubits and neutral atoms, evaluated on six question types in both zero-shot and in-context learning settings. The best general-purpose zero-shot model reaches a mean score of 72.3, and many open-weight models degrade under multi-image in-context learning, whereas frontier closed models improve substantially. A supervised fine-tuning ablation at the 9-billion-parameter scale shows that SFT improves zero-shot performance but cannot close the multimodal in-context learning gap. As a reference case study, we release NVIDIA Ising Calibration 1, an open-weight model based on Qwen3.5-35B-A3B that reaches 74.7 zero-shot average score.

Cao, Shuxiang↗

Water chemistry in flume channel and hyporheic zone (i.e., porewater) associated with: “Rethinking Aerobic Respiration in the Hyporheic Zone Under Variation in Carbon and Nitrogen Stoichiometry”

Dissolved oxygen (DO), total organic carbon (TOC), total nitrogen (TN), molecular data for organic matter, and biochemical reactions for surface water and porewater (i.e., hyporheic zone) collected from a water recirculating flume located at the University of Texas, Austin. The flume contained real river water from Lower Colorado River(Austin, TX) and clean sand. Hyporheic exchange in the flume was induced through The study aims to understand relationships between aerobic metabolism of organic matter and molecular characteristics of organic matter, such as thermodynamic signature and nitrogen content, through the extent of the hyporheic zone at 10 cm- resolution, and through time. During the experiment, organic matter (dry leaves) was added to the flume and removed after 24 hours. The water samples were collected before the addition of leaves, at the time of removal of leaves, and at hour 72. The water samples were analyzed using ultrahigh resolution Fourier transform ion cyclotron resonance mass spectrometry (FTICR-MS) and total organic carbon (TOC) and total nitrogen (TN) analysis. Dissolved oxygen content throughout the surface water and the hyporheic zone of the flume was measured with a large planar optode. This data package is associated with the publication ’ Rethinking Aerobic Respiration in the Hyporheic Zone Under Variation in Carbon and Nitrogen Stoichiometry’ published in Environmental Science and Technology (Turețcaia et al., 2023 https://doi.org/10.1021/acs.est.3c04765). The dataset is comprised of five folders (1) Diss_O2_pic, (2) input_files (3) output_files; (4) python_code; and (5) R_code . Diss_O2_pic contains siximages of dissolved oxygen distribution in a bedform at hours 0, 24, and 72 of the experiment conducted in a large recirculation flume. Images are in separate R and G channels (i.e., RGB). The input_files contains (1) a csv file with FTICR peaks identified within each sample, (2) a csv file with molecular information pertinent to FTICR data with Gibbs free energy calculations adjusted for environmental temperature, (3) a csv file containing concentrations of non-purgeable organic carbon measured throughout the experiment , (4) a csv file containing concentrations of total nitrogen measured throughout the experiment, (5) a csv file containing total biochemical reactions (i.e., transformations) identified in the dataset, (6) a csv containing transformation profiles, and (7) a csv file containing transformations with formulas, and (8) a jpg file with schematic representation of locations for sample collection. The output_files contains (1) and xlsx file containing percent biochemical reactions containing nitrogen identified across all 39 sample, (2) a csv file of merged FTICR data and molecular information files, (3) a csv files containing average Gibbs free energy within sampling domains and at each sampling location, (4) a csv file with average concentrations of dissolved oxygen across sampling locations at hour 0, (5) a csv file with average concentrations of dissolved oxygen across sampling locations at hour 24, (6) a csv file with average concentrations of dissolved oxygen across sampling locations at hour 72, (7) a csv file with percent chemical classes identified across sampling locations at hour 0, (8) a csv file with percent chemical classes identified across sampling locations at hour 24, (9) a csv file with percent chemical classes identified across sampling locations at hour 72, and (10) a csv file containing percent nitrogen containing biochemical reactions identified across sampling locations at hours 0, 24, and 72. The python_code contains seven ipynb files which are Jupyter Notebooks used for data analysis and figures generation. The R_code contains 3 R files with R code used for data analysis and figures generation. This data package contains the processed data used in the associated manuscript. This data has not been previously published.

54 ENVIRONMENTAL SCIENCES↗

Integrating State Data Assimilation and Innovative Model Parameterization Reduces Simulated Carbon Uptake in the Arctic and Boreal Region

Model representation of carbon uptake and storage is essential for accurate projection of the response of the arctic-boreal zone to a rapidly changing climate. Land model estimates of LAI and aboveground biomass that can have a marked influence on model projections of carbon uptake and storage vary substantially in the arctic and boreal zone, making it challenging to correctly evaluate model estimates of Gross Primary Productivity (GPP). To understand and correct bias of LAI and aboveground biomass in the Community Land Model (CLM), we assimilated the 8-day Moderate Resolution Imaging Spectroradiometer (MODIS) LAI observation and a machine learning product of annual aboveground biomass into CLM using an Ensemble Adjustment Kalman Filter (EAKF) in an experimental region including Alaska and Western Canada. Assimilating LAI and aboveground biomass reduced these model estimates by 58% and 72%, respectively. The change of aboveground biomass was consistent with independent estimates of canopy top height at both regional and site levels. The International Land Model Benchmarking system assessment showed that data assimilation significantly improved CLM's performance in simulating the carbon and hydrological cycles, as well as in representing the functional relationships between LAI and other variables. Here, to further reduce the remaining bias in GPP after LAI bias correction, we re-parameterized CLM to account for low temperature suppression of photosynthesis. The LAI bias corrected model that included the new parameterization showed the best agreement with model benchmarks. Combining data assimilation with model parameterization provides a useful framework to assess photosynthetic processes in LSMs.

58 GEOSCIENCES↗

Systematically tracking the hourly progression of large wildfires using GOES satellite observations

Abstract. In the western United States, prolonged drought, a warming climate, and historical fuel buildup have contributed to larger and more intense wildfires as well as to longer fire seasons. As these costly wildfires become more common, new tools and methods are essential for improving our understanding of the evolution of fires and how extreme weather conditions, including heat waves, windstorms, droughts, and varying levels of active-fire suppression, influence fire spread. Here, we develop the Geostationary Operational Environmental Satellites (GOES)-Observed Fire Event Representation (GOFER) algorithm to derive the hourly fire progression of large wildfires and create a product of hourly fire perimeters, active-fire lines, and fire spread rates. Using GOES-East and GOES-West geostationary satellite detections of active fires, we test the GOFER algorithm on 28 large wildfires in California from 2019 to 2021. The GOFER algorithm includes parameter optimizations for defining the burned-to-unburned boundary and correcting for the parallax effect from elevated terrain. We evaluate GOFER perimeters using 12 h data from the Visible Infrared Imaging Radiometer Suite (VIIRS)-derived Fire Event Data Suite (FEDS) and final fire perimeters from the California's Fire and Resource Assessment Program (FRAP). Although the GOES imagery used to derive GOFER has a coarser resolution (2 km at the Equator), the final fire perimeters from GOFER correspond reasonably well to those obtained from FRAP, with a mean Intersection-over-Union (IoU) of 0.77, in comparison to 0.83 between FEDS and FRAP; the IoU indicates the area of overlap over the area of the union relative to the reference perimeters, in which 0 is no agreement and 1 is perfect agreement. GOFER fills a key temporal gap present in other fire tracking products that rely on low-Earth-orbit imagery, where perimeters are available at intervals of 12 h or longer or at ad hoc intervals from aircraft overflights. This is particularly relevant when a fire spreads rapidly, such as at maximum hourly spread rates of over 5 km h−1. Our GOFER algorithm for deriving the hourly fire progression using GOES can be applied to large wildfires across North and South America and reveals considerable variability in the rates of fire spread on diurnal timescales. The resulting GOFER product has a broad set of potential applications, including the development of predictive models for fire spread and the improvement of atmospheric transport models for surface smoke estimates. The resulting GOFER product has a broad set of potential applications, including the development of predictive models for fire spread and the improvement of atmospheric transport models for surface smoke estimates (https://doi.org/10.5281/zenodo.8327264, Liu et al., 2023).

Geology↗

INL Senior Project

What did my team set out to accomplish:? Can I put a custom Machine Learning Model on FPGA?? Can I analyze network traffic in real time?? Can a QSFP port be used with an FPGA?? Does a visual representation of the latent space enhance our understanding of network traffic?? What is QSFP QSFP (Quad Small Form-Factor Pluggable)? QSFP supports transfer speeds generally up to 100Gb/s? Runs 4 parallel lines running up to 28 Gb/s? Why the latent space is important to our project ?Latent space is the compressed mapping of data points in a non-linear fashion? Create an understanding of the relationship of data collected? Can represent that relationship of a single network packet in 3 points (X, Y, Z) Project Outline FPGA? Custom Xilinx Petalinux Image for the operating system? Python program to collect packets and run them through the DPU (Data Processing Unit)? The program then sends the information over a socket to a computer? Display Program? Python Program that collects the information sent from the FPGA and display it in a graph

99 GENERAL AND MISCELLANEOUS↗

The DECam MAGIC Survey: A Wide-field Photometric Metallicity Study of the Sculptor Dwarf Spheroidal Galaxy

The metallicity distribution function (MDF) and internal chemical variations of a galaxy are fundamental to understand its formation and assembly history. In this work, we analyze photometric metallicities for 3883 stars over 7 half-light radii (rh) in the Sculptor (Scl) dwarf spheroidal (dSph) galaxy, using new narrowband imaging data from the Mapping the Ancient Galaxy in CaHK (MAGIC) survey conducted with the Dark Energy Camera (DECam) at the 4 m Blanco Telescope. This work demonstrates the scientific potential of MAGIC using the Scl dSph galaxy, one of the most well-studied satellites of the Milky Way. Our sample ranges from [Fe/H] ≈ –4.0 to [Fe/H] ≈ –0.6, includes six new extremely metal-poor candidates ([Fe/H] ≤ –3.0), and is almost 3 times larger than the largest spectroscopic metallicity data set in the Scl dSph. Our spatially unbiased sample of metallicities provides a more accurate representation of the MDF, revealing a more metal-rich peak than observed in the most recent spectroscopic sample. It also reveals a break in the metallicity gradient, with a strong change in the slope: from −3.26 ± 0.18 dex deg −1 for stars inside ∼1 rh to −0.55 ± 0.26 dex deg −1 for the outer part of the Scl dSph. Our study demonstrates that combining photometric metallicity analysis with the wide field of view of DECam offers an efficient and unbiased approach for studying the stellar populations of dwarf galaxies in the Local Group.

79 ASTRONOMY AND ASTROPHYSICS↗

Promoting Physical Activity During Pregnancy and the Postpartum Period

Introduction Physical activity is important for improving and maintaining overall health across the life span, including during and after pregnancy. Achieving recommended levels of physical activity can be challenging during pregnancy and the postpartum period. The US Office of Disease Prevention and Health Promotion sought to promote physical activity during and after pregnancy through the development of health education materials for the Move Your Way campaign. Research was conducted with pregnant and postpartum people to learn what types of messages and materials would encourage physical activity in these populations. Methods Participants were recruited from 3 regions of the United States to participate in 90‐minute virtual focus groups. Eligible participants were aged 18 years or older and either pregnant or 6 weeks to 1 year postpartum. Participants were asked questions about their beliefs, attitudes, and perceptions about physical activity and prompted to provide feedback on health promotion messages and images. Sessions were recorded, transcribed, and analyzed for key themes. Results Twenty‐four focus groups were conducted with 48 pregnant participants and 52 postpartum participants. Sixteen sessions were conducted in English and 8 were conducted in Spanish. Most participants had questions about how much physical activity is recommended, and many cited their health care provider as a trusted source of information. Participants responded positively to materials that acknowledged the uniqueness of each pregnant or postpartum experience, referenced gradually increasing physical activity levels, highlighted the benefits of physical activity, focused on safety, addressed common barriers, and displayed realistic representations of physical activity. Discussion There is an opportunity to improve messaging about physical activity during and after pregnancy. To better promote physical activity, perinatal health care providers and other health professionals can share information about recommended amounts of physical activity, communicate the benefits, and promote realistic and achievable physical activity messages that address common barriers in these populations.

Nursing↗

Coordinate-Based Seismic Interpolation in Irregular Land Survey: A Deep Internal Learning Approach

Physical and budget constraints often result in irregular sampling, which complicates accurate subsurface imaging. Preprocessing approaches, such as missing trace or shot interpolation, are typically employed to enhance seismic data in such cases. Recently, deep learning has been used to address the trace interpolation problem at the expense of large amounts of training data to adequately represent typical seismic events. Nonetheless, most research in this area has focused on trace reconstruction, with little attention having been devoted to shot interpolation. Furthermore, existing methods assume regularly spaced receivers/sources failing in approximating seismic data from real (irregular) surveys. This work presents a novel shot gather interpolation approach which uses a continuous coordinate-based representation of the acquired seismic wavefield parameterized by a neural network. The proposed unsupervised approach, which we call coordinate-based seismic interpolation (CoBSI), enables the prediction of specific seismic characteristics in irregular land surveys without using external data during neural network training. Importantly, experimental results on real and synthetic 3-D data validate the ability of the proposed method to estimate continuous smooth seismic events in the time-space and frequency-wavenumber domains, improving sparsity or low-rank-based interpolation methods.

58 GEOSCIENCES↗

Coincident learning for unsupervised anomaly detection of scientific instruments

Abstract Anomaly detection is an important task for complex scientific experiments and other complex systems (e.g. industrial facilities, manufacturing), where failures in a sub-system can lead to lost data, poor performance, or even damage to components. While scientific facilities generate a wealth of data, labeled anomalies may be rare (or even nonexistent), and expensive to acquire. Unsupervised approaches are therefore common and typically search for anomalies either by distance or density of examples in the input feature space (or some associated low-dimensional representation). This paper presents a novel approach called coincident learning for anomaly detection (CoAD), which is specifically designed for multi-modal tasks and identifies anomalies based on coincident behavior across two different slices of the feature space. We define an unsupervised metric, F ^ β , out of analogy to the supervised classification F β statistic. CoAD uses F ^ β to train an anomaly detection algorithm on unlabeled data , based on the expectation that anomalous behavior in one feature slice is coincident with anomalous behavior in the other. The method is illustrated using a synthetic outlier data set and a MNIST-based image data set, and is compared to prior state-of-the-art on two real-world tasks: a metal milling data set and our motivating task of identifying RF station anomalies in a particle accelerator.

43 PARTICLE ACCELERATORS↗

Impacts of Sub‐Grid Topographic Representations on Surface Energy Balance and Boundary Conditions in the E3SM Land Model: A Case Study in Sierra Nevada

Abstract Sub‐grid topographic heterogeneity has large impacts on surface energy balance and land‐atmosphere interactions. However, the impacts of representing sub‐grid topographic effects in land surface models (LSMs) on surface energy balance and boundary conditions remain unclear. This study analyzed and evaluated the impacts of sub‐grid topographic representations on surface energy balance, turbulent heat flux, and scalar (co‐)variances in the Energy Exascale Earth System Model (E3SM) land model (ELM). Three sub‐grid topographic representations in ELM were compared: (a) the default sub‐grid structure (D), (b) the recently developed sub‐grid topographic structure (T), and (c) high spatial resolution (1KM). Additionally, two different solar radiation schemes in ELM were compared: (a) the default plane‐parallel radiative transfer scheme (PP) and (b) the parameterization scheme (TOP) that accounts for sub‐grid topographic effects on solar radiation. A series of offline simulations with the three grid discretization structures (D, T, and 1KM) and two schemes of solar radiation (TOP and PP) were carried out using the Sierra Nevada, California. 1KM simulations with TOP well capture the spatial heterogeneity of surface fluxes compared to Moderate Resolution Imaging Spectroradiometer remote sensing data. There are significant differences between TOP and PP in the 1‐km simulated surface energy balance, but the differences in mean values and standard deviations become small when aggregated to the grid scale (i.e., 0.5°). The T configuration better mimics the 1KM simulations with TOP than the D configuration and better captures the sub‐grid topographic effects on surface energy balance and boundary conditions. These results underline the importance of representing sub‐grid topographic heterogeneities in LSMs and motivate future research to understand the sub‐grid topographic effects on land‐atmosphere interactions over mountainous areas.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Computed Tomography Scanning and Petrophysical Measurements of the Lively Grove #1 Well Core

The computed tomography (CT) facilities and the Multi-Sensor Core Logger (MSCL) at the National Energy Technology Laboratory (NETL) in Morgantown, West Virginia were used to characterize core from the Lively Grove #1 Well (API 121892494700), drilled near Marissa, Washington County, Illinois. Core from the well was obtained as part of the Illinois Storage Corridor’s Carbon Storage Assurance Facility Enterprise (CarbonSAFE) project (DE FE0031892). The primary impetus of this work was to capture a detailed digital representation of the core from the Lively Grove #1 Well. The collaboration between the U.S. Department of Energy’s (DOE) NETL and the Illinois State Geological Survey (ISGS) enables other research entities to access information about this potential carbon storage location and Cambro-Ordovician Storage Complex formations of the Illinois Basin. The resultant datasets are presented in this report and can be accessed from NETL’s Energy Data eXchange (EDX) online system. All equipment and techniques used were non-destructive, enabling future examinations and analyses to be performed on these cores. Fractures, discontinuities, and millimeter-scale features were readily detectable with the medical CT scanner-acquired images. Imaging with the NETL medical CT scanner was performed on entire cores. Qualitative analysis of the medical CT images, coupled with X-ray fluorescence (XRF), gamma density, and magnetic susceptibility measurements from the MSCL were useful in identifying zones of interest for potential future analysis. Higher-resolution industrial and micro-CT images were acquired from selected zones along the depth of the core to visualize the structure in higher detail. The ability to quickly identify key areas for more detailed study with higher resolution will save time and resources in future studies. The combination of methods used provides a multi-scale analysis of the core; with the resulting macro- and micro-descriptions relevant to many subsurface energy related examinations traditionally performed at NETL.

54 ENVIRONMENTAL SCIENCES↗

A Deep Multimodal Representation Learning Framework for Accurate Molecular Properties Prediction

Drug discovery is a complex and challenging process, requiring the optimization of candidate compounds to identify those with the potential to become safe and effective drugs. Predicting molecular properties is an indispensable step in the drug discovery pipeline. Traditionally, this process is costly and time-intensive, involving multiple rounds of experiments and clinical trials, rendering it impractical for every candidate compound. Deep learning techniques have emerged as a promising approach to drug discovery to reduce the cost and time required to identify novel drugs. However, prevalent research in deep learning models focused on predicting molecular properties has primarily fixated on single-modal models, which utilize a single modality of data, neglecting the potential benefits of combining different data modalities. To overcome this limitation, we introduce MRL-Mol: a deep \textbf{M}ultimodal \textbf{R}epresentation \textbf{L}earning framework for accurate \textbf{Mol}ecular properties prediction. MRL-Mol harnesses three data modalities: sequence, graph, and image, augmenting the depth of comprehension. Leveraging a large-scale unlabeled dataset~($\sim$1M unique molecules), we pretrain MRL-Mol to extract inter- and intra-modal information. Our study demonstrates the superior performance of MRL-Mol in predicting molecular properties across six benchmark datasets, including both classification and regression tasks. Notably, MRL-Mol outperforms other state-of-the-art molecular properties prediction models. These findings suggest that by combining information from multiple data modalities, MRL-Mol can comprehend molecules better than single-modal deep learning models and identify molecular properties with better accuracy.

Yang, Yuxin↗

Stochastic parametric skeletal dosimetry model for humans: Pediatric and adult computational skeleton phantoms for internal bone marrow dosimetry

Currently, computational phantoms that simulate skeletal tissues are used in active red bone marrow (AM) internal dosimetry. Up-to-date reference computational phantoms recommended by the ICRP are based on the analysis of CT-images of cadavers. Such phantoms have significant disadvantages. One disadvantage is that the assessment of uncertainty due to the population variability of skeleton dimensions and microstructure results from the limited availability of autopsy material. Another disadvantage is the simplified modelling of cortical layer and bone microarchitecture. A method of stochastic parametric skeletal dosimetry modelling of the bone structures – SPSD modelling – has been developed as an alternative to the ICRP reference phantoms. In the framework of this approach, skeletal phantom parameters are evaluated based on extensively reviewed results of published measurements of real bones. The SPSD approach allows for the assessment of both population-average values and their variability. SPSD-phantoms of the skeleton are modelled in voxel representation. They consist of smaller phantoms of the bone sites – segments – described by simple geometric shapes with uniform microarchitecture parameters. Such segmentation makes it possible to account for non-homogeneous skeletal microarchitecture and to model the bone structure with the required voxel resolution to elaborate suitable skeletal phantoms. The current study presents the parameters of the SPSD skeletal phantoms for the following age-groups: newborn, 1-year-old, 5-year-old, 10-year-old, 15-year-old (male and female), and adult (male and female). This skeletal phantom can be used for dosimetry as an alternative to available reference phantoms for bone-seeking radionuclides. The above-mentioned age- and sex-specific skeletal phantoms are comprised of 289 unique segments. The characteristics of the SPSD phantoms do not contradict published data and are in good agreement with the measurement results of real bones.

Science & Technology - Other Topics↗

Results from a synthetic model of the ITER XRCS-Core diagnostic based on high-fidelity x-ray ray tracing

A high-fidelity synthetic diagnostic has been developed for the ITER core x-ray crystal spectrometer diagnostic based on x-ray ray tracing. This synthetic diagnostic has been used to model expected performance of the diagnostic, to aid in diagnostic design, and to develop engineering tolerances. The synthetic model is based on x-ray ray tracing using the recently developed xicsrt ray tracing code and includes a fully three-dimensional representation of the diagnostic based on the computer aided design. The modeled components are: plasma geometry and emission profiles, highly oriented pyrolytic graphite pre-reflectors, spherically bent crystals, and pixelated x-ray detectors. Plasma emission profiles have been calculated for Xe 44+ , Xe 47+ , and Xe 51+ , based on an ITER operational scenario available through the Integrated Modelling & Analysis Suite database, and modeled within the ray tracing code as a volumetric x-ray source; the shape of the plasma source is determined by equilibrium geometry and an appropriate wavelength distribution to match the expected ion temperature profile. All individual components of the x-ray optical system have been modeled with high-fidelity producing a synthetic detector image that is expected to closely match what will be seen in the final as-built system. Particular care is taken to maintain preservation of photon statistics throughout the ray tracing allowing for quantitative estimates of diagnostic performance.

47 OTHER INSTRUMENTATION↗

Making Corgis Important for Honeycomb Classification: Adversarial Attacks on Concept-based Explainability Tools

Methods for model explainability have become increasingly critical for testing the fairness and soundness of deep learning. Concept-based interpretability techniques, which use a small set of human-interpretable concept exemplars in order to measure the influence of a concept on a model's internal representation of input, are an important thread in this line of research. In this work we show that these explainability methods can suffer the same vulnerability to adversarial attacks as the models they are meant to analyze. We demonstrate this phenomenon on two well-known concept-based interpretability methods: TCAV and faceted feature visualization. We show that by leveraging the geometry of the problem and carefully perturbing the examples of the concept that is being investigated, we can radically change the output of the interpretability method. The attacks that we propose can either induce positive interpretations (polka dots are an important concept for a model when classifying zebras) or negative interpretations (stripes are not an important factor in identifying images of a zebra). Our work highlights the fact that in safety-critical applications, there is need for security around not only the machine learning pipeline but also the model interpretation process.

Brown, Davis R.↗

PRIMED for the Future: Purposing Raw Intake for Machine Learning-Enabled Detection (Final Report)

The COVID-19 pandemic demonstrated how a novel, elusive, and diffuse biological threat can engender uncertainty and misinformation, and it underscored the need for flexible analytical modalities agnostic to the identity of biological material. Yet even before the pandemic, recognition of the limitations of the current, list-based approach, which focuses on known pathogens and biotoxins, and of the importance of agent-agnostic biodetection was growing within the biosecurity community. In a 2018 report on “Biodefense in the Age of Synthetic Biology,” for example, the National Academy of Sciences stated that “an overreliance on the Select Agent List is a systematic weakness affecting many aspects of the United States’ current biodefense mitigation capability”. More recently, a group of biodefense researchers proposed the identification and adoption of “bioagent-agnostic signatures (BASs)” as a way of detecting and characterizing not only existing agents but also novel ones, an approach they believe will “enable a more flexible and resilient biodefense posture”. Indeed, the future of biodetection requires us to begin developing novel analytics that can identify anomalies and/or characteristics that indicate a potential threat, whether known or unknown, without looking for a specific signature that has been identified previously. To assess potential threats more rapidly, it is critical to develop agnostic artificial intelligence (AI)/machine learning (ML) systems that can be employed for real-time assessment of the nature and source of a perturbation. Such systems should be multi scale and multi-dimensional, integrating sensor data from a range of biological, chemical, and physical application spaces. Emerging deep learning (DL) models demonstrate exceptional promise for identification of discriminatory features within multi-dimensional datasets. DL models have the capacity to recognize and encode highly complex patterns in a wide range of input data modalities, including images, text, and biological/chemical/physical spectra. As such, they can execute a wide range of assessments and determinations that have traditionally required a human operator. The promise of advances in DL is apparent in the realm of human health and medicine. DL models have been validated for evaluating a variety of clinical threats to human health in a range of contexts, including infection and cancer, and they demonstrated improved performance in predicting stroke relative to human neurologists in some categories of data. Continuously evolving advances in AI/ML are expected to support more efficient evaluation of raw sequence, spectroscopy, and spectrometry data. For instance, recent advances and deployment of large language models (LLM) such as Generative Pre training Transformer (GPT) and Bidirectional Encoder Representations from Transformers (BERT) have already motivated application of these models for biological function prediction. As frameworks such as LLMs become larger and more complex in their representations, their capacity to serve as pre-trained models that can be fine-tuned for biological/biodetection purposes will similarly be amplified. While existing and emerging AI/ML have found broad applicability and use cases in the clinical sciences, development for environmental evaluation and biodetection has been limited. Functionalizing such capabilities for this purpose requires an understanding of the existing technical landscape and how the respective tools and algorithms are currently being employed. This landscape awareness then allows an assessment of the current practical capabilities of existing models and the anticipated requirements and development efforts that will be needed to adapt available algorithms for biodetection applications relevant to DHS. Leveraging expertise in biodetection, ML, and operational biodetection, the effort described in this report is comprised of a systematic landscape assessment (Subtask 2.1), comparative evaluation (Subtask 2.2), and formulation of a value proposition (Subtask 2.3) for the prospect of ML-enabled, agnostic biodetection from raw, or minimally-processed, datasets.

59 BASIC BIOLOGICAL SCIENCES↗

Robust Spectral Anomaly Detection in EELS Spectral Images via 3D Convolutional Variational Autoencoders

Abstract A 3D Convolutional Variational Autoencoder (3D‐CVAE) is introduced for automated anomaly detection in electron energy‐loss spectroscopy spectrum imaging (EELS‐SI) data. This approach leverages the full 3D structure of EELS‐SI data to detect subtle spectral anomalies while preserving both spatial and spectral correlations across the datacube. By employing cross‐entropy loss and training on bulk spectra, the model learns to reconstruct bulk features characteristic of the defect‐free material. In exploring methods for anomaly detection, both the 3D‐CVAE approach and principal component analysis (PCA) are evaluated, testing their performance using FeL‐edge ΔEpeak shifts designed to simulate material defects. These results show that 3D‐CVAE achieves superior anomaly detection and maintains consistent performance across various shift magnitudes. The method demonstrates clear bimodal separation between bulk and anomalous spectra, enabling reliable classification. Further analysis verifies that lower‐dimensional representations are robust to anomalies in the data. While performance advantages over PCA diminish with decreasing anomaly concentration, our method maintains high reconstruction quality even in challenging, noise‐dominated spectral regions. This approach provides a robust framework for unsupervised automated detection of spectral anomalies in EELS‐SI data, particularly valuable for analyzing complex material systems.

Chemistry↗