Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “interpretable models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

The Thermodynamics of Crystallization and Phase-Separation in Melt-Derived Nuclear Waste Forms

This project aimed to gain detailed and fundamental understanding of the stability of glass waste forms to be used for safe and reliable encapsulation of nuclear waste. The focus was to understand thermodynamic and structural properties involved in crystallization and phase separation in melt-derived waste form glasses and glass-ceramics by studying a baseline glass composition with varying additives. This was achieved by combining neutron total scattering, advanced calorimetric measurements, and extensive modeling study. This project harnessed diverse and complementary approaches and expertise from four collaborating interdisciplinary institutions (two universities, one national laboratory, and one UK university partner). Samples were prepared at the national laboratory and exchanged with the two university institutions. The thermodynamic data obtained by various advanced calorimetry techniques were linked to the underlying short-range structure of waste forms measured by state-of-the-art neutron total scattering experiments. An important element of this project was extensive modeling to interpret and fundamentally understand the experimental results.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2023

Investigation of Microphysics and Precipitation for Atlantic Coast-Threatening Snowstorms (IMPACTS) Field Campaign Report

The scientific focus here is interagency collaboration to support a National Aeronautics and Space Administration (NASA)-sponsored 2023 field campaign: Investigation of Microphysics and Precipitation for Atlantic Coast-Threatening Snowstorms (IMPACTS). IMPACTS objectives are to provide observations critical to understanding the mechanisms of snowband formation, organization, and evolution; study how the microphysical characteristics and likely growth mechanisms of snow particles vary across snowbands; and improve snowfall remote-sensing interpretation and modeling to significantly advance predictive capabilities. The relevance to The U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility's mission was to support the Interagency Council for Advancing Meteorological Services (ICAMS)’ objectives to enhance communication and coordination, and promote sharing, within and across agencies. NASA therefore requested to borrow ARM’s two-dimensional stereo probe (2DS) for possible use during the 2023 IMPACTS project. Additionally, this use of the 2DS could improve understanding of ARM 2DS measurements collected on previous field campaigns. The plan was to have the 2DS available for possible backup deployment on the NASA Lockheed Orion P-3 aircraft during the 2023 IMPACTS field project. NASA has a 2DS probe and the ARM 2DS is a hot swappable probe in case the project's 2DS fails. The 2DS is a critical probe and we had issues during a 2022 field project that prevented us from obtaining 2DS data on several flights. Hence, we wanted a hot swappable 2DS on stand-by. We have a data acquisition system, along with a backup data acquisition system for the 2DS, so we only needed the 2DS probe. David Delene was responsible for the use of the 2DS on the NASA P-3 aircraft. He has experience deploying the 2DS on several aircraft, including previously on the NASA P-3 in 2022. The team ensured that the aircraft wiring and deployment of the 2DS were completed correctly for the ARM 2DS.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Development of an L-Edge X-ray Absorbance Spectrometer for Monitoring Dissolver Solutions in H-Canyon

Savannah River National Laboratory has developed a monitor to measure plutonium and uranium concentrations in solutions of dissolved nuclear fuel. The monitor will be installed in the sample aisle location for the 6.3D Dissolver in the Savannah River Site’s H-Canyon and used in support of the electrolytic dissolution such as Fast Critical Assembly fuel. The monitor is based on the atomic absorbance of x-rays. Elements are differentiated by the appearance of absorbance features at specific energies of the x-ray spectrum that correspond to L-edge transitions of inner core electrons. Hence, the technique is called L-Edge X-Ray Absorbance Spectroscopy (L-XRAS). The technique is suitable for nuclear fuel processing due to its relative insensitivity to other components of the dissolver solution, such as nitric acid, transition metals (Fe, Cr, Ni, Mn) such as those from stainless steel, particulates, and catalysts and additives. The instrumentation consists of a commercially available x-ray source and detector, a sample cell designed to interface with the airlift sampler associated with H-Canyon Tank 6.3D, and a stainless steel enclosure. SRNL wrote instrument control software and developed chemometric models to interpret x-ray intensity spectra and estimate analyte concentrations and uncertainties in real time.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2024

Are Marine Low Cloud Droplet Concentrations Buffered by Entrained Aitken‐Mode Aerosol (Final Technical Report)

During the summertime, the high-latitude oceans come to life with green phytoplankton, which gain their energy from sunlight and are food for sea creatures small and large. When the phytoplankton are eaten or die, sulfur-rich gases are released under the ocean surface and mix into the air. Observations suggest that, over the Southern Ocean, frequent storms lift this air high into the atmosphere while raining out particulates like salt. As a result, the sulfur-rich air then spawns high concentrations of small ‘Aitken-mode’ aerosol particles. We hypothesize that these particles work their way down into the marine boundary layer, where they can replenish the supply of cloud-condensation nuclei scavenged by frequent precipitation. Further, this process maintains high concentrations of liquid cloud droplets in austral summer, promoting more sunlight to be reflected to space. We call this ‘Aitken buffering’. The primary objective of this project has been to document and test what role Aitken-mode aerosols play in clouds over the Southern Ocean and elsewhere. This effort has included three main components: 1) developing a computer model that realistically simulates the aerosol processes and the small-scale turbulent air motions that move aerosols around and create the clouds, 2) using that model to interpret and extend these observations for process understanding, by allowing different factors that contribute to the aerosol budget, such as surface wind speed, precipitation, surface gas exchange, etc. to be separated, and 3) studying Aitken-mode aerosol and its variability with a focus over the Southern Ocean and Antarctica, using data from Atmospheric Radiation Measurement (ARM) sites and other available observations. Initial computer studies in more idealized conditions found that elevated concentrations of Aitken-mode aerosols above the clouds could help prevent the breakup of those clouds by acting as cloud-condensation nuclei after they were entrained into the cloudy boundary layer. Simulations of a day during the ACE-ENA field campaign showed that Aitken-mode aerosols could also prevent cloud breakup under more realistic conditions. A new method that extracts information about Aitken-mode aerosols from measurements of aerosols onto which cloud droplets can form finds that Aitken-mode aerosols do vary seasonally over the Southern Ocean, with a peak in summertime, as described above. Other work during this project has focused on understanding how patterns of water vapor, clouds and precipitation are coupled within low-lying clouds over the oceans, and also on how cloud droplets cluster within clouds and how the distribution of cloud droplet sizes change as dry air is mixed into clouds, with the latter studies also using observations from ACE-ENA.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Elucidating the Morphological Instability Mechanisms During Electrodeposition of Active Metals

The primary aim of this investigation is to elucidate the mechanisms by which a group of metals pertinent to battery technology exhibit unstable growth morphology during electrodeposition, which are crucial for the operational efficacy of batteries. The metals under consideration include alkali metals alongside zinc, all of which are characterized by high atomic mobility and reactivity with the electrolytes employed in battery systems. These materials represent promising electrode candidates for next-generation rechargeable batteries that are anticipated to deliver significantly enhanced energy density at a reduced cost. Nevertheless, the widespread occurrence of distinctly non-uniform morphologies, exemplified by the emergence of filamentous and moss-like structures, constitutes a significant impediment to their effective utilization, as it leads to accelerated capacity degradation and potential internal short circuits. This study addresses a critical question that has thus far garnered limited attention: Does the residual stress induced by the plating process play an instrumental role in inducing the morphological instability? Utilizing zinc as the primary model system, this project will be executed through three interconnected tasks: (1) the quantification of the relationship between plating stress and electroplating morphologies, (2) the three-dimensional imaging of the microstructure of the mossy structure at the nanoscale, and (3) the development of a mesoscale electroplating model to interpret empirical findings and generate additional predictive insights.

25 ENERGY STORAGE↗
DOE OSTI2025

Fundamental Studies of Soiling and Cementation of PV Cover Glass Materials: Addressing Reliability with Advanced X-ray Scattering/Spectroscopy and First Principles Modeling (Final Technical Report)

Accumulation of soils and other particulate matter on the front cover glass of solar photovoltaic (PV) modules results in transmission losses that detrimentally affect the power output of PV installations. The conventional solution to this problem is manual abrasive scrubbing of modules, which entails significant water usage and manpower. To further combat this issue, there is a concerted effort within the PV industry to develop anti-soiling (AS) coatings to mitigate power losses due to soiling of PV modules, which can exceed 35% in some cases. However, relatively little is known about the fundamental physical and chemical mechanisms that enable anti-soiling behavior. In this project, a combination of advanced X-ray analysis tools and first principles computational modeling has employed to understand the physical and chemical interactions between environmental soils and PV cover glass materials. The specific objectives were: 1) investigate soiling interactions and cementation behavior of relevant PV materials, including bare glass, conventional antireflective (AR) coatings, and a commercial AS coating, using a library of representative particulate soils, and 2) utilize first principles computational spectroscopy modeling to interpret the experimental X-ray spectroscopy measurements and determine the detailed surface chemistry changes that occur on these surfaces in the presence of soiling and cementation.

14 SOLAR ENERGY↗
DOE OSTI2026

Microscopic Scattering Approach to In-Gap States

We develop a microscopic scattering formalism to describe Yu-Shiba-Rusinov (YSR) states due to a single Cr adatom on the Bi-terminated surface of beta Bi2Pd, by combining ab initio Wannier functions with a real-space Green's function approach in the Bogoliubov-de Gennes formalism[1]. Our framework reproduces key scanning tunneling spectroscopy features, including a single particle-hole asymmetric YSR peak and isotropic dIdV maps around the impurity. Decomposing the YSR states reveals contributions from four nearly degenerate C4v representations, with energy broadening masking their individual signatures. Spin-orbit coupling induces partial spin polarization, while the spatial asymmetry between particle and hole components arises from Cr d-Bi p hybridization. These results highlight the importance of realistic band structures and microscopic modeling for interpreting STM data for magnetic in-gap states on superconductors. Further advances examining layered 2D material surfaces, such as NbSe2, will be described[2]. For this system the superconducting properties are obtained from a full anisotropic Eliashberg calculation of the superconducting order parameter along with the charge density wave gap. Additional features associated with proposals to measure the dynamics of these individual YSR states will be presented. [1] arXiv:2507.08740 [2] arXiv:2507.11856

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2022

Temporal regulation of cold transcriptional response in switchgrass

Switchgrass low-land ecotypes have significantly higher biomass but lower cold tolerance compared to up-land ecotypes. Understanding the molecular mechanisms underlying cold response, including the ones at transcriptional level, can contribute to improving tolerance of high-yield switchgrass under chilling and freezing environmental conditions. Here, by analyzing an existing switchgrass transcriptome dataset, the temporal cis- regulatory basis of switchgrass transcriptional response to cold is dissected computationally. We found that the number of cold-responsive genes and enriched Gene Ontology terms increased as duration of cold treatment increased from 30 min to 24 hours, suggesting an amplified response/cascading effect in cold-responsive gene expression. To identify genomic sequences likely important for regulating cold response, machine learning models predictive of cold response were established using k -mer sequences enriched in the genic and flanking regions of cold-responsive genes but not non-responsive genes. These k -mers, referred to as putative cis -regulatory elements (pCREs) are likely regulatory sequences of cold response in switchgrass. There are in total 655 pCREs where 54 are important in all cold treatment time points. Consistent with this, eight of 35 known cold-responsive CREs were similar to top-ranked pCREs in the models and only these eight were important for predicting temporal cold response. More importantly, most of the top-ranked pCREs were novel sequences in cold regulation. Our findings suggest additional sequence elements important for cold-responsive regulation previously not known that warrant further studies.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Variable Ion Compositions of Solar Energetic Particle Events in the Inner Heliosphere: A Field Line Braiding Model with Compound Injections

We propose a model for interpreting highly variable ion composition ratios in solar energetic particle (SEP) events recently observed by the Parker Solar Probe (PSP) at 0.3–0.45 au. We use numerical simulations to calculate SEP propagation in a turbulent interplanetary magnetic field with a Kolmogorov power spectrum from large scales down to the gyration scale of energetic particles. We show that when the source regions of different species are offset by a distance comparable to the size of the source regions, the observed energetic particle composition He/H can be strongly variable over more than two orders of magnitude, even if the source ratio is at the nominal value. Assuming a 3 He/ 4 He source ratio of 10% in impulsive 3 He-rich events and the same spatial offset of the source regions, the 3 He/ 4 He ratio at observation sites also vary considerably. The variability of the ion composition ratios depends on the radial distance, which can be tested by observations made at different radial locations. We discuss the implications of these results on the variability of ion composition of impulsive events and on further PSP and Solar Orbiter observations close to the Sun.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Panning for Gold: New Emission Lines from UV–VIS Spectroscopy of Au i and Au ii

The recent detection of a neutron star merger by the LIGO collaboration has renewed interest in laboratory studies of r-process elements. Accurate modeling and interpretation of the electromagnetic transients following the mergers requires computationally expensive calculations of both the structure and opacity of all trans-iron elements. To date, the necessary atomic data to benchmark structure codes are incomplete or, in some cases, absent entirely. Within the available laboratory studies, the literature on Au i and Au ii provides incomplete reports of the emission lines and level structures. We present a new study of Au i and Au ii lines and levels by exposing a solid gold target to plasma in the Compact Toroidal Hybrid (CTH) experiment at Auburn University. A wavelength range from 187 to 800 nm was studied. In Au i, 86 lines are observed, 43 of which are unreported in the literature, and the energies of 18 $5{d}^{9}6s6p$ levels and 16 of the 18 known $5{d}^{9}6s6d$ levels are corroborated by a least-squares level energy optimization. In Au ii, 76 emission lines are observed, and 51 of the lines are unreported in the literature. For both Au i and Au ii, the new lines predominantly originate from the most energetic of the known levels, and over half of the new Au ii lines have wavelengths longer than 300 nm. For the estimated electron parameters of CTH plasmas at the gold target (ne ~ 10 12 cm -3 , T e ~ 10 eV), two-electron transitions are similar in intensity to LS-allowed one-electron transitions.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Factors controlling marine aerosol size distributions and their climate effects over the northwest Atlantic Ocean region

Abstract. Aerosols over Earth's remote and spatially extensive ocean surfaces have important influences on planetary climate. However, these aerosols and their effects remain poorly understood, in part due to the remoteness and limited observations over these regions. In this study, we seek to understand factors that shape marine aerosol size distributions and composition in the northwest Atlantic Ocean region. We use the GEOS-Chem model with the TwO-Moment Aerosol Sectional (TOMAS) microphysics algorithm model to interpret measurements collected from ship and aircraft during the four seasonal campaigns of the North Atlantic Aerosols and Marine Ecosystems Study (NAAMES) conducted between 2015 and 2018. Observations from the NAAMES campaigns show enhancements in the campaign-median number of aerosols with diameters larger than 3 nm in the lower troposphere (below 6 km), most pronounced during the phytoplankton bloom maxima (May/June) below 2 km in the free troposphere. Our simulations, combined with NAAMES ship and aircraft measurements, suggest several key factors that contribute to aerosol number and size in the northwest Atlantic lower troposphere, with significant regional-mean (40–60∘ N and 20–50∘ W) cloud-albedo aerosol indirect effect (AIE) and direct radiative effect (DRE) processes during the phytoplankton bloom. These key factors and their associated simulated radiative effects in the region include the following: (1) particle formation near and above the marine boundary layer (MBL) top (AIE: −3.37 W m−2, DRE: −0.62 W m−2); (2) particle growth due to marine secondary organic aerosol (MSOA) as the nascent particles subside into the MBL, enabling them to become cloud-condensation-nuclei-sized particles (AIE: −2.27 W m−2, DRE: −0.10 W m−2); (3) particle formation and growth due to the products of dimethyl sulfide, above and within the MBL (−1.29 W m−2, DRE: −0.06 W m−2); (4) ship emissions (AIE: −0.62 W m−2, DRE: −0.05 W m−2); and (5) primary sea spray emissions (AIE: +0.04 W m−2, DRE: −0.79 W m−2). Our results suggest that a synergy of particle formation in the lower troposphere (particularly near and above the MBL top) and growth by MSOA contributes strongly to cloud-condensation-nuclei-sized particles with significant regional radiative effects in the northwest Atlantic. To gain confidence in radiative effect magnitudes, future work is needed to understand (1) the sources and temperature dependence of condensable marine vapors forming MSOA, (2) primary sea spray emissions, and (3) the species that can form new particles in the lower troposphere and grow these particles as they descend into the marine boundary layer.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

DOE Award No.: DE-FE0023919 Phase 4 Scientific/Technical Report

This is the Phase 4 Report for the ‘Deepwater Methane Hydrate Characterization and Scientific Assessment or Genesis of Methane Hydrates in the Gulf of Mexico (GOM2)’ research project (DOE Award No. DE-FE0023919). The report summarizes activities from October 1, 2019 to September 30, 2020. The project is led by the University of Texas at Austin (UT). The project objective is to gain insight into the nature, formation, occurrence and physical properties of methane hydrate-bearing sediments for the purpose of methane hydrate resource appraisal through the planning and execution of drilling, coring, logging, testing and analytical activities that assess the geologic occurrence, regional context, and characteristics of marine methane hydrate deposits in the Gulf of Mexico outer continental shelf (OCS). We published a dedicated American Association of Petroleum Geologists Bulletin volume describing initial results from the UT-GOM2-1 expedition in Sept. 2020. This is part 1 of a multi-volume commitment by AAPG to this project. We further confirmed that the natural gas in hydrate at GC-955 was formed by primary microbial processes (>76.1 %). The in-situ effective permeability hydrate-bearing sandy silts at the GC-955 reservoir ranges from 0.1 md (1.0×10-16 m2) to 2.4 md (2.4×10-15m2) in cores with 83% to 93% hydrate saturation. The intrinsic permeability (the single phase permeability) is estimated from reconstituted samples to be ~12 md (1.2×10-14 m2) to ~41 md (4.1×10-14 m2). We used observation and models to interpret that the core degradation that is found in pressure cores is due to dissociation of the methane hydrate in the outer circumference of the core and dissolution of that methane into the fresh pore water that the core is stored with. We are designing approaches to minimize this core loss in the future. We spent an enormous amount of effort to further improve the ability of the pressure coring tool (the PCTB) to pressure seal correctly. We completed upgrading the upper section of the PCTB to address poor pressure. We successful tested the modifications at Geotek’s test facility in Salt Lake City (Bench Test II). We completed a Land Test of the PCTB at the Schlumberger Cameron Test and Training Facility (CTTF). The tool did not seal in 6 out of 7 tests and we clearly demonstrated that cuttings were wedging in the ball valve assembly, keeping the ball valve from sealing. We reproduced the failure mechanism observed during the land test at Salt Lake City and confirmed the sensitivity of the ball valve assembly to grit. Geotek designed and tested 9 modifications to address this issue and the PCTB is now 100% successfully sealing in the presence of grit. Our science expedition is scheduled for spring 2022 and we are fully focused on preparing for this. UT and Ohio State completed a Shallow Hazard Assessment report for each proposed UT-GOM2-2 drilling location, pursuant to 30 CFR 250.214(f) and 250.244 (f). The Shallow Hazard Reports will accompany the UT-GOM2-2 Exploration Plan that is submitted to BOEM, and completes the geological and geophysical analysis for UT-GOM2-2 permitting efforts. We updated the UT-GOM2-2 Operations Plan (Version 1). We completed the UT-GOM2-2 Science and Sample Distribution Plan (Version 1). We evaluated the scope, budget, and schedule that would result from using a commercial vessel. We developed detailed drilling schedule, mud volume, and resource estimates. We developed a vessel specification document and a well plan, and sent these documents to prospective vessel contractors.

03 NATURAL GAS↗
DOE OSTI2022

A Review on the State of the Art of Machine Learning and Satellite Imaging: Detecting Scene Changes in Selected Nuclear Fuel Cycle Datasets

The timely detection of clandestine nuclear facilities is one of the greatest challenges faced by the International Atomic Energy Agency’s (IAEA). Idaho National Laboratory is currently applying machine learning (ML) to existing satellite imagery (SI) datasets to find facilities within the nuclear fuel life cycle, with primary focus placed on identifying critical predecessor (i.e., fuel fabrication and fuel enrichment) and successor (i.e., nuclear power plants) facilities. This could provide a satellite image methodology that the IAEA could leverage to discover clandestine facilities. The work presented in this paper describes the evolution of a workflow developed by this team for object detection related to critical infrastructure by expanding that workflow for the purpose of identifying nuclear fuel cycle components and automating dependency assessments. This will be done using two methods housed within a single pipeline. The first method involves implementing a DenseNet161 convolutional neural network to classify the images and explain the results using Local Interpretable Model-Agnostic Explanations (LIME). The second method implements You Only Look Once version 5 (YoloV5), to detect objects within images, provide a probability for the detection, and provide a bounding box that corresponds to the object of interest. The results of this work are anticipated to provide a clear picture of this portion of the nuclear fuel cycle and perform as a stand-alone tool for image assessment that can be expanded to additional fuel cycle components and implemented in international safeguards and national security domains. This capability addresses the IAEA’s need to detect undeclared nuclear materials and activities within a state while encompassing the entire nuclear fuel cycle.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Leak Detection and Sensor Importance Within a Solvent Extraction Process Abstract

In anticipation of the Special Nuclear Material test bed (Beartooth), Idaho National Laboratory has developed a smaller, multi-sensor system for analyzing the solvent extraction process. These systems will allow for research into nuclear fuel processing operations. The multi-sensor system consists of a row of centrifugal contactors and allows for measurement sources that are not traditionally used in the solvent extraction process to be explored including temperature, vibration, acoustics, pH, color, flow, and motor current. Currently, the solvent extraction process is very labor intensive and requires vigilant operators to identify the occurrence of leaks, which can be common during startup or after any change to the system. This study aims to locate leaks using non-traditional measurement sources then to identify which signals were of greatest importance in making this classification using Local Interpretable Model-agnostic Explanations. These results can be used to help solvent extraction process operators detect leaks and to inform future test beds designers to which sensors contain relevant, actionable information in this scenario.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2026

Interpretable and flexible non-intrusive reduced-order models using reproducing kernel Hilbert spaces

This paper develops an interpretable, non-intrusive reduced-order modeling technique using regularized kernel interpolation. Existing non-intrusive approaches approximate the dynamics of a reduced-order model (ROM) by solving a data-driven least-squares regression problem for low-dimensional matrix operators. Our approach instead leverages regularized kernel interpolation, which yields an optimal approximation of the ROM dynamics from a user-defined reproducing kernel Hilbert space. We show that our kernel-based approach can produce interpretable ROMs whose structure mirrors full-order model structure by embedding judiciously chosen feature maps into the kernel. The approach is flexible and allows a combination of informed structure through feature maps and closure terms via more general nonlinear terms in the kernel. We also derive a computable a posteriori error bound that combines standard error estimates for intrusive projection-based ROMs and kernel interpolants. In conclusion, the approach is demonstrated in several numerical experiments that include comparisons to operator inference using both proper orthogonal decomposition and quadratic manifold dimension reduction.

Data-driven model reduction↗
DOE OSTI2024

An Investigation of LES Wall Modeling for Rayleigh–Bénard Convection via Interpretable and Physics-Aware Feedforward Neural Networks with DNS

Abstract The traditional approach of using the Monin–Obukhov similarity theory (MOST) to model near-surface processes in large-eddy simulations (LESs) can lead to significant errors in natural convection. In this study, we propose an alternative approach based on feedforward neural networks (FNNs) trained on output from direct numerical simulation (DNS). To evaluate the performance, we conduct both a priori and a posteriori tests. In the a priori (offline) tests, we compare the statistics of the surface shear stress and heat flux, computed from filtered DNS input variables, to the stress and flux obtained from the filtered DNS. Additionally, we investigate the importance of various input features using the Shapley additive explanations value and the conditional average of the filter grid cells. In the a posteriori (online) tests, we implement the trained models in the System for Atmospheric Modeling (SAM) LES and compare the LES-generated surface shear stress and heat flux with those in the DNS. Our findings reveal that vertical velocity, a traditionally overlooked flow quantity, is one of the most important input features for determining the wall fluxes. Increasing the number of input features improves the a priori test results but does not always improve the model performance in the a posteriori tests because of the differences in input variables between the LES and DNS. Last, we show that physics-aware FNN models trained with logarithmic and scaled parameters can well extrapolate to more intense convection scenarios than in the training dataset, whereas those trained with primitive flow quantities cannot. Significance Statement The traditional near-surface turbulence model, based on a shear-dominated boundary layer flow, does not represent near-surface turbulence in natural convection. Using a feedforward neural network (FNN), we can construct a more accurate model that better represents the near-surface turbulence in various flows and reveals previously overlooked controlling factors and process interactions. Our study shows that the FNN-generated models outperform the traditional model and highlight the importance of the near-surface vertical velocity. Furthermore, the physics-aware FNN models exhibit the potential to extrapolate to convective flows of various intensities beyond the range of the training dataset, suggesting their broader applicability for more accurate modeling of near-surface turbulence.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Experimental Observations of the Topology of Convolutional Neural Network Activations

Topological data analysis (TDA) is a branch of computational mathematics, bridging algebraic topology and data science, that provides compact, noise-robust representations of complex structures. Deep neural networks (DNNs) learn millions of parameters associated with a series of transformations defined by the model architecture resulting in high-dimensional, difficult to interpret internal representations of input data. As DNNs become more ubiquitous across multiple sectors of our society, there is increasing recognition that mathematical methods are needed to aid analysts, researchers, and practitioners in understanding and interpreting how these models' internal representations relate to the final classification. In this paper we apply cutting edge techniques from TDA with the goal of gaining insight towards interpretability of convolutional neural networks used for image classification. We use two common TDA approaches to explore several methods for modeling hidden layer activations as high-dimensional point clouds, and provide experimental evidence that these point clouds capture valuable structural information about the model's process. First, we demonstrate that a distance metric based on persistent homology can be used to quantify meaningful differences between layers and discuss these distances in the broader context of existing representational similarity metrics for neural network interpretability. Second, we show that a mapper graph can provide semantic insight as to how these models organize hierarchical class knowledge at each layer. These observations demonstrate that TDA is a useful tool to help deep learning practitioners unlock the hidden structures of their models.

topological data analysis, deep learning↗