SEARCH · Engineering Papers

Results for “Feature importance”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

All sources NASA NTRS DOE OSTI

DOE OSTI2023

A detailed study of interpretability of deep neural network based top taggers

Abstract Recent developments in the methods of explainable artificial intelligence (XAI) allow researchers to explore the inner workings of deep neural networks (DNNs), revealing crucial information about input–output relationships and realizing how data connects with machine learning models. In this paper we explore interpretability of DNN models designed to identify jets coming from top quark decay in high energy proton–proton collisions at the Large Hadron Collider. We review a subset of existing top tagger models and explore different quantitative methods to identify which features play the most important roles in identifying the top jets. We also investigate how and why feature importance varies across different XAI metrics, how correlations among features impact their explainability, and how latent space representations encode information as well as correlate with physically meaningful quantities. Our studies uncover some major pitfalls of existing XAI methods and illustrate how they can be overcome to obtain consistent and meaningful interpretation of these models. We additionally illustrate the activity of hidden layers as neural activation pattern diagrams and demonstrate how they can be used to understand how DNNs relay information across the layers and how this understanding can help to make such models significantly simpler by allowing effective model reoptimization and hyperparameter tuning. These studies not only facilitate a methodological approach to interpreting models but also unveil new insights about what these models learn. Incorporating these observations into augmented model design, we propose the particle flow interaction network model and demonstrate how interpretability-inspired model augmentation can improve top tagging performance.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Machine learning reveals factors that control ion mobility in anti-perovskite solid electrolytes

Solid-state batteries are projected to exhibit improved energy densities and safety compared to liquid-electrolyte-based systems. Consequently, the development of solid electrolytes that can conduct cations at rates comparable to that of liquid electrolytes is an active area of research. To facilitate this search it is desirable to understand the chemical and structural features that control ion transport through a crystalline lattice. Here, machine learning (ML) is used to identify features that influence ion mobility in solids, quantify the relative importance of those features, and demonstrate how the variation of individual features alters ion mobility. Adopting the anti-perovskite lattice as a model system, ML algorithms were trained to predict migration barriers from a data set containing hundreds of barriers calculated using density functional theory. In this study, more than 10 6 feature sets of non-redundant descriptors were evaluated for their ability to predict migration barriers. The present analysis correctly reiterates the importance of several features that are known to influence mobility – for example, anion polarizability – but also identifies others whose importance is not widely recognized. Lattice properties such as hopping distance and channel width exhibit the greatest influence on cation mobility. Individual conditional expectation analyses performed on these features shows that barriers decrease as hopping distance decreases and as channel width increases. The defect formation energy – which is commonly associated with the concentration of defects, but not with their mobility – is identified as an important feature for interstitial migration. In sum, this analysis aids in the design of optimal solid electrolytes by simplifying the multi-dimensional design space to a sub-set of properties that are the most important.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

NASA NTRS1986

Toward real-time performance benchmarks for Ada

Benchmarks are developed to measure the Ada notion of time, the Ada features believed important to real-time performance, and other time-related features that are not part of the language, but are part of the run-time system; these benchmarks are then applied to the language and run-time system, and the results evaluated.

Clapp, Russell M.↗

NASA NTRS1986

Toward real-time performance benchmarks for Ada

The issue of real-time performance measurements for the Ada programming language through the use of benchmarks is addressed. First, the Ada notion of time is examined and a set of basic measurement techniques are developed. Then a set of Ada language features believed to be important for real-time performance are presented and specific measurement methods discussed. In addition, other important time related features which are not explicitly part of the language but are part of the run-time related features which are not explicitly part of the language but are part of the run-time system are also identified and measurement techniques developed. The measurement techniques are applied to the language and run-time system features and the results are presented.

Clapp, Russell M.↗

NASA NTRS2003

Near-Infrared Spectra of Type Ia Supernovae

We report near-infrared (NIR) spectroscopic observations of 12 'branch-normal' Type Ia supernovae (SNe Ia) that cover the wavelength region from 0.8 to 2.5 microns. Our sample more than doubles the number of SNe Ia with published NIR spectra within 3 weeks of maximum light. The epochs of observation range from 13 days before maximum light to 18 days after maximum light. A detailed model for a Type Ia supernovae is used to identify spectral features. The Doppler shifts of lines are measured to obtain the velocity and thus the radial distribution of elements. The NIR is an extremely useful tool to probe the chemical structure in the layers of SNe Ia ejecta. This wavelength region is optimal for examining certain products of the SNe Ia explosion that may be blended or obscured in other spectral regions. We identify spectral features from Mg II, Ca II, Si II, Fe II, Co II, Ni II, and possibly Mn II. We find no indications for hydrogen, helium, or carbon in the spectra. The spectral features reveal important clues about the physical characteristics of SNe Ia. We use the features to derive upper limits for the amount of unburned matter, to identify the transition regions from explosive carbon to oxygen burning and from partial to complete silicon burning, and to estimate the level of mixing during and after the explosion. Elements synthesized in the outer layers during the explosion appear to remain in distinct layers. That provides strong evidence for the presence of a detonation phase during the explosion as it occurs in delayed detonation or merger models. Mg II velocities are found to exceed 11,000 - 15,000 km/s, depending on the individual SNe Ia. That result suggests that burning during the explosion reaches the outermost layers of the progenitor and limits the amount of unburned material to less than 10% of the mass of the progenitor. Small residuals of unburned material are predicted by delayed detonation models but are inconsistent with pure deflagration or merger models. Differences in the spectra of the individual SNe Ia demonstrate the variety of these events.

Marion, G. H.↗

DOE OSTI2022

PyTREES

PyTREES (Python tool for Training/Testing Robust Explainable Ensembles on Spectra) is software that implements a data-driven approach to predicting the amount of specific oxides present in materials samples of laser-induced breakdown spectroscopy (LIBS); such as from the ChemCam instrument suite onboard the NASA Curiosity rover. PyTREES is designed to input LIBS data in the format provided by the ChemCam team [1]. PyTREES then applies appropriate pre-processing to this data [2], and implements several regression methods for predicting oxides from spectra. The regression methods include: ensemble methods (random forest, extra trees, and gradient boosting regression) and blended submodels using the “double blending” technique. PyTREES additionally implements methods for quantifying the importance of features in regression model: (1) mean decrease in impurity (MDI) and (2) permutation importance to investigate the wavelengths used by the regression methods. [1] Gasda et al. (2021). Spectrochim Acta B, 181, 106223. [2] Clegg et al. (2017). Spectrochim Acta B , 129, 64–85.

Oyen, Diane↗

DOE OSTI2022

Extracting structural motifs from pair distribution function data of nanostructures using explainable machine learning

Characterization of material structure with X-ray or neutron scattering using e.g. Pair Distribution Function (PDF) analysis most often rely on refining a structure model against an experimental dataset. However, identifying a suitable model is often a bottleneck. Recently, automated approaches have made it possible to test thousands of models for each dataset, but these methods are computationally expensive and analysing the output, i.e. extracting structural information from the resulting fits in a meaningful way, is challenging. Our Machine Learning based Motif Extractor (ML-MotEx) trains an ML algorithm on thousands of fits, and uses SHAP (SHapley Additive exPlanation) values to identify which model features are important for the fit quality. We use the method for 4 different chemical systems, including disordered nanomaterials and clusters. ML-MotEx opens for a type of modelling where each feature in a model is assigned an importance value for the fit quality based on explainable ML.

36 MATERIALS SCIENCE↗

DOE OSTI2024

Effective parameterization of phase-field models of fission gas bubble growth

Fission gas bubbles are one of the most important microstructural features of ceramic nuclear fuels. As gas bubbles grow and interconnect, they allow release of gases, with important consequences for fuel performance. Phase-field modeling has been increasingly used to simulate the evolution of fission gas bubble microstructural because of its capability to capture complex microstructural features. However, computational performance limitations have made it difficult to simulate all the defects present in fuels during operation. For this reason, phase-field models have often simulated only vacancies and used multiple approaches to include the effect of vacancy-interstitial recombination and sinks in a simplified way. Here, we compare some of the most prevalent approaches, including source-only and source/sink. The kinetics of bubble growth using these approaches are analyzed analytically, and simulations with these approaches are compared to a full vacancy-interstitial model.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2021

Data Science Meets Physical Organic Chemistry

At the heart of synthetic chemistry is the holy grail of predictable catalyst design. In particular, researchers involved in reaction development in asymmetric catalysis have pursued a variety of strategies toward this goal. This is driven by both the pragmatic need to achieve high selectivities and the inability to readily identify why a certain catalyst is effective for a given reaction. While empiricism and intuition have dominated the field of asymmetric catalysis since its inception, enantioselectivity offers a mechanistically rich platform to interrogate catalyst-structure response patterns that explain the performance of a particular catalyst or substrate. In the early stages of an asymmetric reaction development campaign, the overarching mechanism of the reaction, catalyst speciation, the turnover limiting step, and many other details are unknown or posited based on related reactions. Considering the unclear details leading to a successful reaction, initial enantioselectivity data are often used to intuitively guide the ultimate direction of optimization. However, if the conditions of the Curtin-Hammett principle are satisfied, then measured enantioselectivity can be directly connected to the ensemble of diastereomeric transition states (TSs) that lead to the enantiomeric products, and the associated free energy difference between competing TSs (ΔΔ G ‡ = - RT ln[( S )/( R )], where ( S ) and ( R ) represent the concentrations of the enantiomeric products). We, and others, speculated that this important piece of information can be leveraged to guide reaction optimization in a quantitative way. Although traditional linear free energy relationships (LFERs), such as Hammett plots, have been used to illuminate important mechanistic features, we sought to develop data science derived tools to expand the power of LFERs in order to describe complex reactions frequently encountered in modern asymmetric catalysis. Specifically, we investigated whether enantioselectivity data from a reaction can be quantitatively connected to the attributes of reaction components, such as catalyst and substrate structural features, to harness data for asymmetric catalyst design. In this context, we developed a workflow to relate computationally derived features of reaction components to enantioselectivity using data science tools. The mathematical representation of molecules can incorporate many aspects of a transformation, such as molecular features from substrate, product, catalyst, and proposed transition states. Statistical models relating these features to reaction outputs can be used for various tasks, such as performance prediction of untested molecules. Perhaps most importantly, statistical models can guide the generation of mechanistic hypotheses that are embedded within complex patterns of reaction responses. Overall, merging traditional physical organic experiments with statistical modeling techniques creates a feedback loop that enables both evaluation of multiple mechanistic hypotheses and future catalyst design. In this Account, we highlight the evolution and application of this approach in the context of a collaborative program based on chiral phosphoric acid catalysts (CPAs) in asymmetric catalysis.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2023

Materials characterization: Can artificial intelligence be used to address reproducibility challenges?

Material characterization techniques are widely used to characterize the physical and chemical properties of materials at the nanoscale and, thus, play central roles in material scientific discoveries. However, the large and complex datasets generated by these techniques often require significant human effort to interpret and extract meaningful physicochemical insights. Artificial intelligence (AI) techniques such as machine learning (ML) have the potential to improve the efficiency and accuracy of surface analysis by automating data analysis and interpretation. In this perspective paper, we review the current role of AI in surface analysis and discuss its future potential to accelerate discoveries in surface science, materials science, and interface science. We highlight several applications where AI has already been used to analyze surface analysis data, including the identification of crystal structures from XRD data, analysis of XPS spectra for surface composition, and the interpretation of TEM and SEM images for particle morphology and size. We also discuss the challenges and opportunities associated with the integration of AI into surface analysis workflows. These include the need for large and diverse datasets for training ML models, the importance of feature selection and representation, and the potential for ML to enable new insights and discoveries by identifying patterns and relationships in complex datasets. Most importantly, AI analyzed data must not just find the best mathematical description of the data, but it must find the most physical and chemically meaningful results. In addition, the need for reproducibility in scientific research has become increasingly important in recent years. The advancement of AI, including both conventional and the increasing popular deep learning, is showing promise in addressing those challenges by enabling the execution and verification of scientific progress. By training models on large experimental datasets and providing automated analysis and data interpretation, AI can help to ensure that scientific results are reproducible and reliable. Although integration of knowledge and AI models must be considered for the transparency and interpretability of models, the incorporation of AI into the data collection and processing workflow will significantly enhance the efficiency and accuracy of various surface analysis techniques and deepen our understanding at an accelerated pace.

Materials Science↗

NASA NTRS2016

Coastal High-resolution Observations and Remote Sensing of Ecosystems (C-HORSE)

Coastal benthic marine ecosystems, such as coral reefs, seagrass beds, and kelp forests are highly productive as well as ecologically and commercially important resources. These systems are vulnerable to degraded water quality due to coastal development, terrestrial run-off, and harmful algal blooms. Measurements of these features are important for understanding linkages with land-based sources of pollution and impacts to coastal ecosystems. Challenges for accurate remote sensing of coastal benthic (shallow water) ecosystems and water quality are complicated by atmospheric scattering/absorption (approximately 80+% of the signal), sun glint from the sea surface, and water column scattering (e.g., turbidity). Further, sensor challenges related to signal to noise (SNR) over optically dark targets as well as insufficient radiometric calibration thwart the value of coastal remotely-sensed data. Atmospheric correction of satellite and airborne remotely-sensed radiance data is crucial for deriving accurate water-leaving radiance in coastal waters. C-HORSE seeks to optimize coastal remote sensing measurements by using a novel airborne instrument suite that will bridge calibration, validation, and research capabilities of bio-optical measurements from the sea to the high altitude remote sensing platform. The primary goal of C-HORSE is to facilitate enhanced optical observations of coastal ecosystems using state of the art portable microradiometers with 19 targeted spectral channels and flight planning to optimize measurements further supporting current and future remote sensing missions.

Coasts↗

DOE OSTI2020

3D Printing of Liquid Crystal Elastomer Foams for Enhanced Energy Dissipation Under Mechanical Insult

Polymer foams are an essential class of lightweight materials used to protect assets against mechanical insults, such as shock and vibration. Two features are important to enhance their energy absorption characteristics: the foam structure and the matrix phase mechanical behavior. This study investigates novel approaches to control both of these features to enhance the energy absorption capability of flexible lattice foams. First, we consider 3D printing via digital light processing (DLP) as a method to control the foam mesostructure across a suite of periodic unit cells. Second, we introduce an additional energy dissipation mechanism in the solid matrix phase material by 3D printing the lattice foams with polydomain liquid crystal elastomer (LCE), which undergo a mechanically induced phase transition under large strains. This phase transition is associated with LC mesogen rotation and alignment and provides a second mechanism for mechanical energy dissipation in addition to the viscoelastic relaxation of the polymer network. Here, we contrast the 3D printed LCE lattices with conventional, thermomechanically near-equivalent elastomer lattice foams to quantify the energy-absorbing enhancement the LCE matrix phase provides. Under cyclic quasi-static uniaxial compression conditions, the LCE lattices show dramatically enhanced energy dissipation in uniaxial compression compared to the non-LCE equivalent foams printed with a commercially available photocurable elastomer resin. The lattice geometry also plays a prominent role in determining the energy dissipation ratio between the LCE and non-LCE foams. We show that when increasing the lattice connectivity, the foam deformation transitions from bending-dominated to stretching-dominated deformations, which generates higher axial strains in the struts and higher energy dissipation in the lattice foam, as stretching allows greater mesogen rotation than bending. The LCE foams demonstrate superior energy absorption during the repeated dynamic loading during drop testing compared with the non-LCE equivalent foams, demonstrating the potential of LCEs to enhance physical protection systems against mechanical impact.

3D printing↗

DOE OSTI2022

HyMARC Seedling: Optimized Hydrogen Adsorbents via Machine Learning and Crystal Engineering

This final report is presented in two parts: In Part 1, the H 2 capacities of a diverse set of 918,734 metal-organic frameworks (MOFs) sourced from 19 databases is predicted via machine learning (ML). Using only 7 structural features as input, ML identifies 8,282 MOFs with the potential to exceed the capacities of state-of-the-art materials. The identified MOFs are predominantly hypothetical compounds having low densities (<0.31 g/cm3) in combination with high surface areas (>5,300 m2/g), void fractions ($0.90), and pore volumes (>3.3 cm3/g). The relative importance of the input features are characterized, and dependencies on the ML algorithm and training set size are quantified. The most important features for predicting H 2 uptake are pore volume (for gravimetric capacity) and void fraction (for volumetric capacity). The ML models are available on the web, allowing for rapid and accurate predictions of the hydrogen capacities of MOFs from limited structural data; the simplest models require only a single crystallographic feature. In part 2, ways to improve the poor powder packing density of MOFs is discussed. More specifically, a strategy that improves packing efficiency and volumetric hydrogen gas storage density dramatically through engineered morphologies and controlled-crystal size distributions is presented that holds promise for maximizing storage capacity for a given MOF. The packing density improvement, demonstrated for the benchmark sorbent MOF-5, leads to a significant enhancement of volumetric hydrogen storage performance relative to commercial MOF-5. System model projections demonstrate that engineering of crystal morphology/size or use of a bimodal distribution of cubic crystal sizes in tandem with system optimization can surpass the 25 g/L volumetric capacity of a typical 700 bar compressed storage system and exceed the DOE targets 2020 volumetric capacity (30 g/L). Finally, a critical link between improved powder packing density and reduced damage upon compaction is revealed leading to sorbents with both high surface area and high density.

08 HYDROGEN↗

NASA NTRS1987

Design improvement of a pump wear ring labyrinth seal

The investigation was successful in obtaining two improved designs for the impeller wear ring seal of the liquid hydrogen turbopump of interest. A finite difference computer code was extensively used in a parametric computational study in determining a cavity configuration with high flow resistance due to turbulence dissipation. These two designs, along with that currently used, were fabricated and tested. The improved designs were denoted Type O and Type S. The measurements showed that Type O and Type S given 67 and 30 percent reduction in leakage over the current design, respectively. It was found that the number of cavities, the step height and the presence of a small stator groove are quite important design features. Also, the tooth thickness is of some significance. Finally, the tooth height and an additional large cavity cut out from the stator (upstream of the step) are of negligible importance.

Rhode, David L.↗

DOE OSTI2021

Nanoparticle cellular internalization is not required for RNA delivery to mature plant leaves

Rapidly growing interest in the nanoparticle-mediated delivery of DNA and RNA to plants requires a better understanding of how nanoparticles and their cargoes translocate in plant tissues and into plant cells. However, little is known about how the size and shape of nanoparticles influence transport in plants and the delivery efficiency of their cargoes, limiting the development of nanotechnology in plant systems. In this study we employed non-biolistically delivered DNA-modified gold nanoparticles (AuNPs) of various sizes (5-20 nm) and shapes (spheres and rods) to systematically investigate their transport following infiltration into Nicotiana benthamiana leaves. Generally, smaller AuNPs demonstrated more rapid, higher and longer-lasting levels of association with plant cell walls compared with larger AuNPs. We observed internalization of rod-shaped but not spherical AuNPs into plant cells, yet, surprisingly, 10 nm spherical AuNPs functionalized with small-interfering RNA (siRNA) were the most efficient at siRNA delivery and inducing gene silencing in mature plant leaves. These results indicate the importance of nanoparticle size in efficient biomolecule delivery and, counterintuitively, demonstrate that efficient cargo delivery is possible and potentially optimal in the absence of nanoparticle cellular internalization. Additionally, our results highlight nanoparticle features of importance for transport within plant tissues, providing a mechanistic overview of how nanoparticles can be designed to achieve efficacious biocargo delivery for future developments in plant nanobiotechnology.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2025

Detailed simulations of the first deuterium-tritium-filled double shell implosions on the National Ignition Facility

The first indirectly driven, liquid DT-filled double shell inertial confinement fusion (ICF) implosions have recently been successfully performed on the National Ignition Facility (NIF). Double shells are a class of alternative designs that use a low-Z outer shell to compress a foam cushion that accelerates a high-Z inner shell to efficiently compress a liquid DT core. Double shells are challenging to fabricate, field, and model. Important engineering features enabling double shell fabrication include a fill-tube penetrating all shells and a carefully designed and very narrow (few μm) step-joint in the ablator. Due to the higher density materials involved, high Atwood number instabilities are also important at many material interfaces. In this paper, numerical simulations of double shell implosions using the Los Alamos National Laboratory multi-physics radiation-hydrodynamics code xRAGE will be discussed. An extensive effort has been under way for several years to develop the code capabilities for ICF simulations in a common modeling framework to allow ease of simulation setup and standardization of the computational methodology. This paper will present a wide range of simulation results capturing, quantifying, and comparing the impact of all these degradation mechanisms on implosion performance. Brief comparisons with recent experimental results and suggestions for future improvements will also be discussed. Our results suggest that capsule surface roughness and the step-joint gap have the largest impact on implosion performance. Initial experimental data may suggest that the sensitivity to the step-joint gap could provide the dominant explanation for DT-filled double shell experiments that have been fielded on NIF thus far.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2022

Modeling the distribution of the endangered Jemez Mountains salamander (Plethodon neomexicanus) in relation to geology, topography, and climate

The Jemez Mountains salamander (Plethodon neomexicanus; hereafter JMS) is an endangered salamander restricted to the Jemez Mountains in north-central New Mexico, United States. This strictly terrestrial and lungless species requires moist surface conditions for activities such as mating and foraging. Threats to its current habitat include fire suppression and ensuing severe fires, changes in forest composition, habitat fragmentation, and climate change. Forest composition changes resulting from reduced fire frequency and increased tree density suggest that its current aboveground habitat does not mirror its historically successful habitat regime. However, because of its limited habitat area and underground behavior, we hypothesized that geology and topography might play a significant role in the current distribution of the salamander. We modeled the distribution of the JMS using a machine learning algorithm to assess how geology, topography, and climate variables influence its distribution. The best habitat suitability model indicates that geology type and maximum winter temperature (November to March) were most important in predicting the distribution of the salamander (23.5% and 50.3% permutation importance, respectively). Minimum winter temperature was also an important variable (21.4%), suggesting this also plays a role in salamander habitat. Our habitat suitability map reveals low uncertainty in model predictions, and we found slight discrepancies between the designated critical habitat and the most suitable areas for the JMS. Because geological features are important to its distribution, we recommend that geological and topographical data are considered, both during survey design and in the description of localities of JMS records once detected.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2021

The Fall and Rise of the Global Climate Model

Abstract Global models are an essential tool for climate projections, but conventional coarse‐resolution atmospheric general circulation models suffer from errors both in their parameterized cloud physics and in their representation of climatically important circulation features. A notable recent study by Terai et al. (2020, https://doi.org/10.1029/2020ms002274) documents a global model capable of reproducing the regime‐based effect of aerosols on cloud liquid water path expected from observational evidence. This may represent a significant advance in cloud process fidelity in global models. Such models can be expected to give a better estimate of the effective radiative forcing of the climate. If this advance in cloud process representation can be matched by advances in the representation of circulation features such as monsoons, then such models may also be able to navigate the complex tangle between spatially heterogeneous aerosol–cloud interactions and regional circulation patterns. This tight link between aerosol and circulation results in anthropogenic perturbations of climate variables of societal importance, such as regional rainfall distributions. Upcoming global models with km‐scale resolution may improve the regional circulation and be able to take advantage of the Terai et al. (2020, https://doi.org/10.1029/2020ms002274) improvement in cloud physics. If so, an era of significantly improved regional climate projection capabilities may soon dawn. If not, then the improvement in cloud physics might spur intensified efforts on problems in model dynamics. Either way, based on the rapid changes in aerosol emissions in the near future, learning to make reliable projections based on biased models is a skill that will not go out of style.

54 ENVIRONMENTAL SCIENCES↗