Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Feature importance”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

Automated Grain Boundary (GB) Segmentation and Microstructural Analysis in 347H Stainless Steel Using Deep Learning and Multimodal Microscopy

Austenitic 347H stainless steel offers superior mechanical properties and corrosion resistance required for extreme operating conditions such as high temperature. The change in microstructure due to composition and process variations is expected to impact material properties. Identifying microstructural features such as grain boundaries thus becomes an important task in the process-microstructure-properties loop. Applying convolutional neural network (CNN)-based deep learning models is a powerful technique to detect features from material micrographs in an automated manner. In contrast to microstructural classification, supervised CNN models for segmentation tasks require pixel-wise annotation labels. However, manual labeling of the images for the segmentation task poses a major bottleneck for generating training data and labels in a reliable and reproducible way within a reasonable timeframe. Microstructural characterization especially needs to be expedited for faster material discovery by changing alloy compositions. Here, in this study, we attempt to overcome such limitations by utilizing multimodal microscopy to generate labels directly instead of manual labeling. We combine scanning electron microscopy images of 347H stainless steel as training data and electron backscatter diffraction micrographs as pixel-wise labels for grain boundary detection as a semantic segmentation task. The viability of our method is evaluated by considering a set of deep CNN architectures. We demonstrate that despite producing instrumentation drift during data collection between two modes of microscopy, this method performs comparably to similar segmentation tasks that used manual labeling. Additionally, we find that naïve pixel-wise segmentation results in small gaps and missing boundaries in the predicted grain boundary map. By incorporating topological information during model training, the connectivity of the grain boundary network and segmentation performance is improved. Finally, our approach is validated by accurate computation on downstream tasks of predicting the underlying grain morphology distributions which are the ultimate quantities of interest for microstructural characterization.

36 MATERIALS SCIENCE↗

Data-driven prediction of geometry- and toolpath sequence-dependent intra-layer process conditions variations in laser powder bed fusion

Geometrical features and toolpath sequence are two important factors that cause process condition variations, such as variations in the meltpool temperature or meltpool size, that might lead to undesired material properties in the laser powder bed fusion (LPBF) process. Due to the high dynamics and complex physics of the LPBF process, it is difficult to predict variations in process conditions with simulations alone. Advances in measurement technology and computational technologies open up new possibilities for smart manufacturing. In this paper, a data-driven method to predict intra-layer variations in the processing conditions that source from the toolpath sequence and part geometry is presented. The approach is demonstrated using two-color on-axis pyrometer measurements. Three demonstration cases are presented in which it is demonstrated (1) how the trained predictive model can be used as a filter to ease the interpretation of process variations and discover patterns related to toolpath and part geometry, and (2) how to generate predictions that can be used for feedforward control, i.e., for adjusting laser power or scanning speed along the toolpath using a meltpool temperature prediction model generated based on on-axis measurements. Results show that the developed prediction model is able to meaningfully predict process variations resulted from toolpath sequence and geometry. Predictions are aligned with the results from the related work of others and for the case of 180° laser path turnarounds in our high-speed X-ray imaging experiments. In conclusion, the potential issues related to the current maturity status of the process and measuring equipment that could in practice affect the performance of the proposed solutions are also discussed.

42 ENGINEERING↗

Optimization with the OpenACC-to-FPGA framework on the Arria 10 and Stratix 10 FPGAs

The reconfigurable computing paradigm with field programmable gate arrays (FPGAs) has received renewed interest in the high-performance computing field due to FPGAs’ unique combination of performance and energy efficiency. However, difficulties in programming and optimizing FPGAs have prevented them from being widely accepted as general-purpose computing devices. In accelerator-based heterogeneous computing, portability across diverse heterogeneous devices is also an important issue, but the unique architectural features in FPGAs make this difficult to achieve. To address these issues, a directive-based, high-level FPGA programming and optimization framework was previously developed. In this work, developed optimizations were combined holistically using the directive-based approach to show that each individual benchmark requires a unique set of optimizations to maximize performance. We perform this exploration on Intel Arria 10 and Stratix 10 FPGAs. We also explored the relationships between performance, resource usages, and compilation times, and investigated implications for performance portability. Finally, we present an initial evaluation of a real-world proxy application, LULESH.

97 MATHEMATICS AND COMPUTING↗

Adaptive Ensemble Refinement of Protein Structures in High Resolution Electron Microscopy Density Maps with Radical Augmented Molecular Dynamics Flexible Fitting

Recent advances in cryo-electron microscopy (cryo-EM) have enabled modeling macromolecular complexes that are essential components of the cellular machinery. The density maps derived from cryo-EM experiments are often integrated with manual, knowledge or artificial intelligence driven, and physics-guided computational methods to build, fit, and refine molecular structures. Going beyond a single stationary- structure determination scheme, it is becoming more common to interpret the experimental data with an ensemble of models, which contributes to an average observation. Hence, there is a need to decide on the quality of an ensemble of protein structures on-the-fly, while refining them against the density maps. Here, we introduce such an adaptive decision making scheme during the molecular dynamics flexible fitting (MDFF) of biomolecules. Using RADICAL-Cybertools, and the new RADICAL augmented MDFF implementation (R-MDFF) is examined in high-performance computing environments for refinement of two protein systems, Adenylate Kinase and Carbon Monoxide Dehydrogenase. For the test cases, use of multiple replicas in flexible fitting with adaptive decision making in R-MDFF improves the overall correlation to the density by 40% relative to the refinements of the brute-force MDFF. The improvements are particularly significant at high, 2 - 3 Å, map resolutions. More importantly, the ensemble model captures key features of biologically relevant molecular dynamics that is inaccessible to a single-model interpretation. Finally, the pipeline is applicable to systems of growing sizes, which is demonstrated using ensemble refinement of capsid proteins from Chimpanzee adenovirus. The overhead for decision making remaining low and robust to computing environments. The software is publicly available on GitHub and includes a short user guide to install the R-MDFF on different computing environments, from local Linux based workstations to High Performance Computing (HPC) environments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Full-Scale Ab Initio Simulation of Magic-Angle-Spinning Dynamic Nuclear Polarization

Theoretical models aimed at describing magic-angle-spinning (MAS) dynamic nuclear polarization (DNP) NMR have great potential in facilitating the in silico design of DNP polarizing agents and formulations. These models must typically face a trade-off between the accuracy of a strict quantum mechanical description and the need for using realistically large spin systems, for instance, using phenomenological models. In this paper, we show that the use of aggressive state-space restrictions and an optimization strategy allows full-scale ab initio MAS-DNP simulations of spin systems containing thousands of nuclei. Our simulations are shown to reproduce experimental DNP enhancements quantitatively, including their MAS rate dependence, for both frozen solutions and solid materials. They also reveal the importance of a previously unrecognized structural feature found in some polarizing agents that helps minimize the sensitivity losses imposed by the spin diffusion barrier.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

High-Throughput Screening and Accurate Prediction of Ionic Liquid Viscosities Using Interpretable Machine Learning

Ionic liquids (ILs) are a novel group of green solvents with great promise for various industrial applications, including carbon capture and lignocellulosic biomass deconstruction. However, the use of ILs at the industrial scale remains challenging due to their high viscosities at ambient temperatures. To develop ILs with lower viscosities, a systematic study of their quantitative structure–property relationship (QSPR) is desirable. Here, we developed four machine learning (ML) models to predict viscosity at various temperature and pressure ranges, trained over a wide range of ILs consisting of various cationic and anionic families. ML methods including two-factor polynomial regression (two-factor PR), support vector regression (SVR), feed-forward neural networks (FFNN), and categorical boosting (CATBoost) were developed based on features that have proven useful in previous ML studies: COSMO-RS (conductor-like screening model for real solvents)-derived surface screening charge densities (sigma profiles). FFNN and CATBoost were the most accurate in predicting IL viscosities with lower average absolute relative deviation and higher R2 values on the test set. Tanimoto similarity scores were calculated to characterize the chemical space and structural similarity of the investigated ions. Furthermore, SHapley Additive exPlanation (SHAP) analysis was employed to interpret the ML results. Temperature, the polar area of ILs, and the nonpolar regions of ions are key features that influence the viscosity predictions. Importantly, the IL viscosity prediction here is the most accurate reported to date.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Rapid Generation of Tandem Mass Spectrometry Reference Libraries Using Immediate Drop-on-Demand Liquid Handling Coupled to an Open Port Sampling Interface

In metabolomics, tandem MS (MS2) fragmentation libraries are important for the identification of unknown features, but generating these libraries takes many valuable hours of instrument and operator time. Here, an immediate droplet-on-demand/open port sampling interface was used to rapidly acquire tandem MS of standards arrayed in a 96-well plate format. A workflow was developed for automated, high-throughput control of MS2 library generation. Pure standard mass spectral libraries were collected on Orbitrap and Q-TOF mass spectrometers for 192 compounds using 6 different collision energies with a throughput of 4 and 7.8 s/spectrum, respectively. Libraries were acquired using different solvent additives, precursor adducts, and ion polarities.

Cahill, John [ORNL] (ORCID:0000000298664010)↗

Many-body enhancement of high-harmonic generation in monolayer MoS2

Abstract Many-body effects play an important role in enhancing and modifying optical absorption and other excited-state properties of solids in the perturbative regime, but their role in high harmonic generation (HHG) and other nonlinear response beyond the perturbative regime is not well-understood. We develop here an ab initio many-body method to study nonperturbative HHG based on the real-time propagation of the non-equilibrium Green’s function with the GW self energy. We calculate the HHG of monolayer MoS 2 and obtain good agreement with experiment, including the reproduction of characteristic patterns of monotonic and nonmonotonic harmonic yield in the parallel and perpendicular responses, respectively. Here, we show that many-body effects are especially important to accurately reproduce the spectral features in the perpendicular response, which reflect a complex interplay of electron-hole interactions (or exciton effects) in tandem with the many-body renormalization and Berry curvature of the independent quasiparticle bandstructure.

36 MATERIALS SCIENCE↗

Hole formation effect on surface morphological response of plasma-facing tungsten

We report simulation results on the effect of helium (He) bubble bursting-mediated surface hole formation on the surface morphological response of tungsten plasma-facing components (PFCs) in nuclear fusion devices. Our analysis is based on an atomistically informed, continuum-scale model, which is capable of accessing the spatiotemporal scales relevant to the fuzz nanostructure formation process on the surface of PFC tungsten. Our simulations account, in an empirical fashion, for two types of subsurface bubble dynamical phenomena in the nanobubble region of PFC tungsten during He plasma irradiation, involving bubble bursting and surface crater formation. We demonstrate that the hole formation effect on the PFC tungsten surface accelerates the growth rate of nanotendrils and the onset of fuzz formation. As a result, the predicted incubation time for surface nanotendril growth is shortened, in agreement with experimental data of incubation fluence at comparable plasma exposure conditions. We also explore systematically the dependence of the PFC surface morphological response on the areal density of holes introduced at regular time intervals onto the He-implanted tungsten surface, a parameter in our analysis that serves as a proxy for the rate of He bubble bursting. More importantly, our simulations capture fine surface features in the PFC tungsten surface morphology and predict that the average spacing between nanotendrils is on the order of 100 nm, consistent with the experimental findings.

Chen, Chao-Shou (ORCID:0000000307910042)↗

Asymptotic vacuum solution at tokamak X-point tip

In the H-mode regime of diverted tokamaks, the presence of strong pressure gradients in the pedestal gives rise to a sizable bootstrap current, together with the Ohmic and Pfirsch–Schlueter currents, close to the separatrix. For such equilibria, the presence of finite current density close to the separatrix requires the reexamination of equilibrium properties. It is almost universally assumed that the two branches of the separatrix (the stable and unstable manifolds) are straight as they cross at the X-point. However, the opposite angles of the plasma-filled segment and vacuum one cannot be equal if the current density does not vanish at the separatrix on the plasma side. We solve this difficulty by chipping off a thin layer of plasma edge so that the sharp corner of the plasma-filled segment becomes a hyperbola. Using the conformal transformation, we found that in the assumption of a hyperbolic boundary, the X point moves beyond the plasma boundary to fall in the vacuum region. An acute angle of the plasma-filled segment leads to an obtuse opposite angle of vacuum segment and vice versa. In the case of an acute angle of the plasma-filled segment, the new X point shifts inside the X point formed by the asymptotes of a hyperbolic boundary; in the case of an obtuse angle of the plasma-filled segment, the new X point shifts outside the X point formed by the asymptotes of a hyperbolic plasma boundary. Furthermore, the results are important for understanding the X point features, which affect the tokamak edge stability and transport.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

X-ray microscopy enables multiscale high-resolution 3D imaging of plant cells, tissues, and organs

Capturing complete internal anatomies of plant organs and tissues within their relevant morphological context remains a key challenge in plant science. While plant growth and development are inherently multiscale, conventional light, fluorescence, and electron microscopy platforms are typically limited to imaging of plant microstructure from small flat samples that lack a direct spatial context to, and represent only a small portion of, the relevant plant macrostructures. We demonstrate technical advances with a lab-based X-ray microscope (XRM) that bridge the imaging gap by providing multiscale high-resolution three-dimensional (3D) volumes of intact plant samples from the cell to the whole plant level. Serial imaging of a single sample is shown to provide sub-micron 3D volumes co-registered with lower magnification scans for explicit contextual reference. High-quality 3D volume data from our enhanced methods facilitate sophisticated and effective computational segmentation. Advances in sample preparation make multimodal correlative imaging workflows possible, where a single resin-embedded plant sample is scanned via XRM to generate a 3D cell-level map, and then used to identify and zoom in on sub-cellular regions of interest for high-resolution scanning electron microscopy. In total, we present the methodologies for use of XRM in the multiscale and multimodal analysis of 3D plant features using numerous economically and scientifically important plant systems.

59 BASIC BIOLOGICAL SCIENCES↗

Model-Free Measurement of Local Entropy Production and Extractable Work in Active Matter

Time-reversal symmetry breaking and entropy production are universal features of nonequilibrium phenomena. Despite its importance in the physics of active and living systems, the entropy production of systems with many degrees of freedom has remained of little practical significance because the high dimensionality of their state space makes it difficult to measure. Here, in this work, we introduce a local measure of entropy production and a numerical protocol to estimate it. We establish a connection between the entropy production and extractability of work in a given region of the system and show how this quantity depends crucially on the degrees of freedom being tracked. We validate our approach in theory, simulation, and experiments by considering systems of active Brownian particles undergoing motility-induced phase separation, as well as active Brownian particles and E.coli in a rectifying device in which the time-reversal asymmetry of the particle dynamics couples to spatial asymmetry to reveal its effects on a macroscopic scale.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

In-Depth Optimization with the OpenACC-to-FPGA Framework on an Arria 10 FPGA

The reconfigurable computing paradigm that uses field programmable gate arrays (FPGAs) has received renewed interest in the high-performance computing field due to FPGAs' unique combination of performance and energy efficiency. However, difficulties in programming and optimizing FPGAs have prevented them from being widely accepted as general-purpose computing devices. In accelerator-based heterogeneous computing, portability across diverse heterogeneous devices is also an important issue, but the unique architectural features in FPGAs make this difficult to achieve. To address these issues, a directive-based, high-level FPGA programming and optimization framework was previously developed. In this work, developed optimizations were combined holistically using the directive-based approach to show that each individual benchmark requires a unique set of optimizations to maximize performance. The relationships between FPGA resource usages and runtime performance were also explored.

Lambert, Jacob↗

Integrating multi-modal remote sensing, deep learning, and attention mechanisms for yield prediction in plant breeding experiments

In both plant breeding and crop management, interpretability plays a crucial role in instilling trust in AI-driven approaches and enabling the provision of actionable insights. The primary objective of this research is to explore and evaluate the potential contributions of deep learning network architectures that employ stacked LSTM for end-of-season maize grain yield prediction. A secondary aim is to expand the capabilities of these networks by adapting them to better accommodate and leverage the multi-modality properties of remote sensing data. In this study, a multi-modal deep learning architecture that assimilates inputs from heterogeneous data streams, including high-resolution hyperspectral imagery, LiDAR point clouds, and environmental data, is proposed to forecast maize crop yields. The architecture includes attention mechanisms that assign varying levels of importance to different modalities and temporal features that, reflect the dynamics of plant growth and environmental interactions. The interpretability of the attention weights is investigated in multi-modal networks that seek to both improve predictions and attribute crop yield outcomes to genetic and environmental variables. This approach also contributes to increased interpretability of the model's predictions. The temporal attention weight distributions highlighted relevant factors and critical growth stages that contribute to the predictions. The results of this study affirm that the attention weights are consistent with recognized biological growth stages, thereby substantiating the network's capability to learn biologically interpretable features. Accuracies of the model's predictions of yield ranged from 0.82-0.93 R 2 ref in this genetics-focused study, further highlighting the potential of attention-based models. Further, this research facilitates understanding of how multi-modality remote sensing aligns with the physiological stages of maize. The proposed architecture shows promise in improving predictions and offering interpretable insights into the factors affecting maize crop yields, while demonstrating the impact of data collection by different modalities through the growing season. By identifying relevant factors and critical growth stages, the model's attention weights provide valuable information that can be used in both plant breeding and crop management. The consistency of attention weights with biological growth stages reinforces the potential of deep learning networks in agricultural applications, particularly in leveraging remote sensing data for yield prediction. To the best of our knowledge, this is the first study that investigates the use of hyperspectral and LiDAR UAV time series data for explaining/interpreting plant growth stages within deep learning networks and forecasting plot-level maize grain yield using late fusion modalities with attention mechanisms.

59 BASIC BIOLOGICAL SCIENCES↗

Customs: Inspect and Report Python Imports (customs) v1.0.0

We have developed a simple, minimally invasive monitoring framework that enables us to capture key metrics from Python user processes. This is part of a larger effort to collect data across our entire data-intensive science workload at NERSC. The approach for Python is inspired by a similar framework developed for Blue Waters at NCSA. Both frameworks leverage standard Python features, sitecustomize and atexit, to capture Python imports of interest and other job data. The customs package decomposes the information capture into separate inspection and reporting interfaces.

Thomas, Rollin↗

An Overview of Mesoscale Convective Systems: Global Climatology, Satellite Observations, and Modeling Strategies

Deep convection is responsible for redistributing water as well as energy and providing vital water resources for many regions of the world. Cumulonimbus clouds aggregation into a single storm system develop mesoscale convective systems (MCS). MCSs have precipitation covering a horizontal region on the scale of 100?km or more. After more than the last seven decades, MCS has been gradually received wide attention in the scientific community as an important component of the Earth's hydrologic cycle and energy balance. MCSs differ from ordinary deep convection because of the mesoscale circulations consisting of a layer of air overturning on a scale much larger than those created by individual convective updrafts or downdrafts. Moreover, a key feature that separates MCS from ordinary deep convection is the significant portion of stratiform precipitation that results in the production and detrainment of a large number of ice particles from their organized convective cores and continues the mesoscale ascent that supports ice growth and aggregation as the crystals fall. This significant stratiform precipitation gives rise to top-heavy latent heating profiles that have substantial impacts on the upper-level global circulations, especially for those MCS that have a larger portion of stratiform rainfall. Top-heavy latent heating profiles are more frequent over the ocean than over the land. These unique features of MCS suggest that they are important for the hydrologic cycle, general circulation, and radiative balance of the climate system. In this chapter, we focus on the recent advances in the climatological perspective of MCS as well as the research tools used to better understand MCS after the advent of the satellite era. We will discuss both tropical and midlatitude MCS, the influence of modes of tropical climate variability on MCS, and the new insight from satellite observations on MCS interaction with the land surface.

Chakraborty, Sudip↗

Azobenzene-based sinusoidal surface topography drives focal adhesion confinement and guides collective migration of epithelial cells

Surface topography is a key parameter in regulating the morphology and behavior of single cells. At multicellular level, coordinated cell displacements drive many biological events such as embryonic morphogenesis. However, the effect of surface topography on collective migration of epithelium has not been studied in detail. Mastering the connection between surface features and collective cellular behaviour is highly important for novel approaches in tissue engineering and repair. Herein, we used photopatterned microtopographies on azobenzene-containing materials and showed that smooth topographical cues with proper period and orientation can efficiently orchestrate cell alignment in growing epithelium. Furthermore, the experimental system allowed us to investigate how the orientation of the topographical features can alter the speed of wound closure in vitro. Our findings indicate that the extracellular microenvironment topography coordinates their focal adhesion distribution and alignment. These topographic cues are able to guide the collective migration of multicellular systems, even when cell–cell junctions are disrupted.

59 BASIC BIOLOGICAL SCIENCES↗

Probabilistic Data-Driven Sampling via Multi-Criteria Importance Analysis

Although supercomputers are becoming increasingly powerful, their components have thus far not scaled proportionately. Compute power is growing enormously and is enabling finely resolved simulations that produce never-before-seen features. However, I/O capabilities lag by orders of magnitude, which means only a fraction of the simulation data can be stored for post hoc analysis. Prespecified plans for saving features and quantities of interest do not work for features that have not been seen before. Data-driven intelligent sampling schemes are needed to detect and save important parts of the simulation while it is running. Here, we propose a novel sampling scheme that reduces the size of the data by orders-of-magnitude while still preserving important regions. The approach we develop selects points with unusual data values and high gradients. Finally, we demonstrate that our approach outperforms traditional sampling schemes on a number of tasks.

97 MATHEMATICS AND COMPUTING↗