Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Feature importance”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

High-throughput printing of combinatorial materials from aerosols

The development of new materials and their compositional and microstructural optimization are essential in regard to next-generation technologies such as clean energy and environmental sustainability. However, materials discovery and optimization have been a frustratingly slow process. The Edisonian trial-and-error process is time consuming and resource inefficient, particularly when contrasted with vast materials design spaces 1 . Whereas traditional combinatorial deposition methods can generate material libraries 2,3 , these suffer from limited material options and inability to leverage major breakthroughs in nanomaterial synthesis. Here we report a high-throughput combinatorial printing method capable of fabricating materials with compositional gradients at microscale spatial resolution. In situ mixing and printing in the aerosol phase allows instantaneous tuning of the mixing ratio of a broad range of materials on the fly, which is an important feature unobtainable in conventional multimaterials printing using feedstocks in liquid–liquid or solid–solid phases 4–6 . We demonstrate a variety of high-throughput printing strategies and applications in combinatorial doping, functional grading and chemical reaction, enabling materials exploration of doped chalcogenides and compositionally graded materials with gradient properties. The ability to combine the top-down design freedom of additive manufacturing with bottom-up control over local material compositions promises the development of compositionally complex materials inaccessible via conventional manufacturing approaches.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Functional and transcriptional characterization of complex neuronal co-cultures

Brain-on-a-chip systems are designed to simulate brain activity using traditional in vitro cell culture on an engineered platform. It is a noninvasive tool to screen new drugs, evaluate toxicants, and elucidate disease mechanisms. However, successful recapitulation of brain function on these systems is dependent on the complexity of the cell culture. In this study, we increased cellular complexity of traditional (simple) neuronal cultures by co-culturing with astrocytes and oligodendrocyte precursor cells (complex culture). We evaluated and compared neuronal activity (e.g., network formation and maturation), cellular composition in long-term culture, and the transcriptome of the two cultures. Compared to simple cultures, neurons from complex co-cultures exhibited earlier synapse and network development and maturation, which was supported by localized synaptophysin expression, up-regulation of genes involved in mature neuronal processes, and synchronized neural network activity. Also, mature oligodendrocytes and reactive astrocytes were only detected in complex cultures upon transcriptomic analysis of age-matched cultures. Functionally, the GABA antagonist bicuculline had a greater influence on bursting activity in complex versus simple cultures. Collectively, the cellular complexity of brain-on-a-chip systems intrinsically develops cell type-specific phenotypes relevant to the brain while accelerating the maturation of neuronal networks, important features underdeveloped in traditional cultures.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Metagenomic features of bioburden serve as outcome indicators in combat extremity wounds

Abstract Battlefield injury management requires specialized care, and wound infection is a frequent complication. Challenges related to characterizing relevant pathogens further complicates treatment. Applying metagenomics to wounds offers a comprehensive path toward assessing microbial genomic fingerprints and could indicate prognostic variables for future decision support tools. Wound specimens from combat-injured U.S. service members, obtained during surgical debridements before delayed wound closure, were subjected to whole metagenome analysis and targeted enrichment of antimicrobial resistance genes. Results did not indicate a singular, common microbial metagenomic profile for wound failure, instead reflecting a complex microenvironment with varying bioburden diversity across outcomes. Genus-level Pseudomonas detection was associated with wound failure at all surgeries. A logistic regression model was fit to the presence and absence of antimicrobial resistance classes to assess associations with nosocomial pathogens. A. baumannii detection was associated with detection of genomic signatures for resistance to trimethoprim, aminoglycosides, bacitracin, and polymyxin. Machine learning classifiers were applied to identify wound and microbial variables associated with outcome. Feature importance rankings averaged across models indicated the variables with the largest effects on predicting wound outcome, including an increase in P. putida sequence reads. These results describe the microbial genomic determinants in combat wound bioburden and demonstrate metagenomic investigation as a comprehensive tool for providing information toward aiding treatment of combat-related injuries.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Data-driven analysis and prediction of stable phases for high-entropy alloy design

High-entropy alloys (HEAs) represent a promising class of materials with exceptional structural and functional properties. However, their design and optimization pose challenges due to the large composition-phase space coupled with the complex and diverse nature of the phase formation dynamics. In this study, a data-driven approach that utilizes machine learning (ML) techniques to predict HEA phases and their composition-dependent phases is proposed. By employing a comprehensive dataset comprising 5692 experimental records encompassing 50 elements and 11 phase categories, we compare the performance of various ML models. Our analysis identifies the most influential features for accurate phase prediction. Furthermore, the class imbalance is addressed by employing data augmentation methods, raising the number of records to 1500 in each category, and ensuring a balanced representation of phase categories. The results show that XGBoost and Random Forest consistently outperform the other models, achieving 86% accuracy in predicting all phases. Additionally, this work provides an extensive analysis of HEA phase formers, showing the contributions of elements and features to the presence of specific phases. We also examine the impact of including different phases on ML model accuracy and feature significance. Notably, the findings underscore the need for ML model selection based on specific applications and desired predictions, as feature importance varies across models and phases. This study significantly advances the understanding of HEA phase formation, enabling targeted alloy design and fostering progress in the field of materials science.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Data-driven emulation of modal aerosol microphysics via neural operator-based modeling

The complexity and the small characteristic scales of aerosol microphysical processes pose a big challenge for accurate and efficient Earth system simulations at regional and global scales. In this work, we construct and evaluate a surrogate model: the aerosol deep operator network (ADON), a physics-inspired dual-net architecture for emulating the aerosol microphysics parameterization suite in the version 2 of the Energy Earth System Model (E3SMv2). The current version of the surrogate model is trained on a dataset comprising 9.8 million samples obtained from a global E3SMv2 simulation with the horizontal resolution of about one degree under cloud-free conditions. Incorporating domain spatial and temporal coordinates, as well as principle components extracted from training data, the dual-net surrogate model effectively captures the intricate representations of aerosol and the relationship with atmospheric state variables, achieving an R-squared score over $$95.7\%$$ for all the lognormal aerosol modes in the extrapolated regime. The validated model provides feature importance of input variables and their impact on the predictive capacity of the surrogate model in relation to the E3SM. The computational cost of online inference time deployed on CPUs and GPUs with lower precisions highlights ADON’s efficiency and potential in robust predictive modeling for large-scale Earth system computations.

Bai, Zhe↗
DOE OSTI2021

Machine-learning-accelerated multimodal characterization and multiobjective design optimization of natural porous materials

Natural porous materials such as nanoporous clays are used as green and low-cost adsorbents and catalysts. The key factors determining their performance in these applications are the pore morphology and surface activity, which are typically represented by properties such as specific surface area, pore volume, micropore content and pH. The latter may be modified and tuned to specific applications through material processing and/or chemical treatment. Characterization of the material, raw or processed, is typically performed experimentally, which can become costly especially in the context of tuning of the properties towards specific application requirements and needing numerous experiments. In this work, we present an application of tree-based machine learning methods trained on experimental datasets to accelerate the characterization of natural porous materials. The resulting models allow reliable prediction of the outcomes of experimental characterization of processed materials (R2 from 0.78 to 0.99) as well as identification of key factors contributing to those properties through feature importance analysis. Furthermore, the high throughput of the models enables exploration of processing parameter–property correlations and multiobjective optimization of prototype materials towards specific applications. We have applied these methodologies to pinpoint and rationalize optimal processing conditions for clays exploitable in acid catalysis. One of such identified materials was synthesized and tested revealing appreciable acid character improvement with respect to the pristine material. Specifically, it achieved 79% removal of chlorophyll-a in acid catalyzed degradation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Machine learning for design principles for single atom catalysts towards electrochemical reactions

Machine learning (ML) integrated density functional theory (DFT) calculations have recently been used to accelerate the design and discovery of heterogeneous catalysts such as single atom catalysts (SACs) through the establishment of deep structure–activity relationships. Here, this review provides recent progress in the ML-aided rational design of heterogeneous catalysts with the focus on SACs in terms of structure–activity relationships, feature importance analysis, high-throughput screening, stability, and metal–support interactions for electrochemistry. Support vector machine (SVM), random forest regression (RFR), and deep neural networks (DNN) along with atomic properties are mainly used for the design of SACs. The ML results have shown that the number of electrons in the d orbital, oxide formation enthalpy, ionization energy, Bader charge, d-band center, and enthalpy of vaporization are mainly the most important parameters for the defining of the structure–activity relationships for electrochemistry. However, the black-box nature of ML techniques occasionally makes a physical interpretation of descriptors, such as the Bader charge, d-band center, and enthalpy of vaporization, non-trivial. At the current stage, ML application is limited by the lack of a large and high-quality database. Future prospects for the development of a large database and a generalized ML algorithm for SAC design are discussed to give insights for further studies in this field.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Photometric redshift-aided classification using ensemble learning

We present SHEEP, a new machine learning approach to the classic problem of astronomical source classification, which combines the outputs from the XGBoost, LightGBM, and CatBoost learning algorithms to create stronger classifiers. A novel step in our pipeline is that prior to performing the classification, SHEEP first estimates photometric redshifts, which are then placed into the data set as an additional feature for classification model training; this results in significant improvements in the subsequent classification performance. SHEEP contains two distinct classification methodologies: (i) Multi-class and (ii) one versus all with correction by a meta-learner. We demonstrate the performance of SHEEP for the classification of stars, galaxies, and quasars using a data set composed of SDSS and WISE photometry of 3.5 million astronomical sources. The resulting F1 -scores are as follows: 0.992 for galaxies; 0.967 for quasars; and 0.985 for stars. In terms of the F1-scores for the three classes, SHEEP is found to outperform a recent RandomForest-based classification approach using an essentially identical data set. Our methodology also facilitates model and data set explainability via feature importances; it also allows the selection of sources whose uncertain classifications may make them interesting sources for follow-up observations.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Star formation rate and stellar mass calibrations based on infrared photometry and their dependence on stellar population age and extinction

The stellar mass (M $\star$ ) and the star formation rate (SFR) are among the most important features that characterize galaxies. Measuring these fundamental properties accurately is critical for understanding the present state of galaxies, their history, and future evolution. Infrared (IR) photometry is widely used to measure the M $\star$ and SFR of galaxies because the near-IR traces the continuum emission of the majority of their stellar populations (SPs), and the mid/far-IR traces the dust emission powered by star-forming activity. This work explores the dependence of the IR emission of galaxies on their extinction, and the age of their SPs. It aims to provide accurate and precise IR-photometry SFR and M $\star$ calibrations that account for SP age and extinction while providing quantification of their scatter. We used the CIGALE spectral energy distribution (SED) fitting code to create model SEDs of galaxies with a wide range of star formation histories, dust content, and interstellar medium properties. We fit the relations between M $\star$ and SFR with IR and optical photometry of the model-galaxy SEDs with the Markov chain Monte Carlo (MCMC) method. As an independent confirmation of the MCMC fitting method, we performed a machine-learning random forest (RF) analysis on the same data set. The RF model yields similar results to the MCMC fits, thus validating the latter. This work provides calibrations for the SFR using a combination of the WISE bands 1 and 3, or the JWST NIR-F200W and MIRI-F2100W. It also provides mass-to-light ratio calibrations based on the WISE band-1, the JWST NIR-F200W, and the optical u - r or g - r colors. These calibrations account for the biases attributed to the SP age, while they are given in the form of extinction-dependent and extinction-independent relations. The proposed calibrations show robust estimations while minimizing the scatter and biases throughout a wide range of SFRs and stellar masses. The SFR calibration offers better results, especially in dust-free or passive galaxies where the contributions of old SPs or biases from the lack of dust are significant. Similarly, the M $\star$ calibration yields significantly better results for dusty and high-SFR galaxies where dust emission can otherwise bias the estimations.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Production Operations Management System (POMS) for Fermilab Experiments

The Production Operations Management System (POMS) software allows production teams and analysis groups across multiple Fermilab experiments to launch, modify and monitor large scale campaigns of related Monte Carlo or data processing jobs, and currently manages the majority of production computing of experiments at Fermilab.POMS provides a web service interface that enables automated job submission on distributed resources according to customers’ requests, as well as subsequent monitoring of those submissions as well as recovery of failed submissions, debugging and record keeping.POMS interfaces with existing HEP data access, processing, movement and monitoring tools at Fermilab, including Jobsub (for job submission), SAM (for data management), and Landscape (for monitoring), and in combination with them handles the creation of intermediate datasets of files for multistage campaigns.POMS visualizes these campaigns with an interactive GUI interface. An important feature of POMS is a one-to-one connection between the GUI campaign visualizer and a text based representation of the complete campaign configuration. An extensible library of template campaign configurations is available. The templates are user modifiable and map cleanly to and from the GUI description of the campaign.This paper will discuss the current usage, history, and some technical details of POMS, as well as planned future extensions, particularly interfacing with Rucio as well as SAM for file movement.

Mengel, Marc↗
DOE OSTI2024

Full Simulation of CMS for Run-3 and Phase-2

In this contribution we report the status of the CMS Geant4 simulation and the prospects for Run-3 and Phase-2. Firstly, we report about our experience during the start of Run-3 with Geant4 10.7.2, the common software package DD4hep for geometry description, and VecGeom runtime geometry library. In addition, FTFP_BERT_EMM Physics List and CMS configuration for tracking in magnetic field have been utilized. For the first time, for the Grid mass production of Monte-Carlo, this combination of components is used. Further simulation improvements are under development targeting Run-3 such as the switch to the new Geant4 11.1 in production, that provides several features important for the optimization of simulation, for example the new transportation process with built-in multiple scattering, neutron general process, custom tracking manager, G4HepEm sub-library, and others. We will present evaluation of various options, validation results, and the final choice of simulation configuration for 2023 production and beyond. The performance of the CMS full simulation for Run-2 and Run-3 will also be discussed. CMS development plan for the Phase-2 Geant4 based simulation is very ambitious, and it includes a new geometry description, physics, and simulation configurations. The progress on new detector descriptions and full simulation will be presented as well as the R&D in progress to reduce compute capacity needs.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

River Dissolved Oxygen Prediction Using Machine Learning Models and Wireless Sensor Measurements

Simultaneous flooding&heat and droughts&heat events can potentially destabilize hydro-meteorological conditions to deteriorate the water quality of Neches River. Machine learning (ML) models utilizing wireless sensor measurements have been applied to predict water quality and optimize various water management strategies. This study aims to develop ML models to predict dissolved oxygen (DO) prediction under various hydro-meteorological conditions and enhance water management decision-making. Wireless sensor measurements of DO, water temperature, sample depth, conductivity, turbidity, and pH, along with discharge from the United States Geological Survey stations, are collected for model inputs at the Pine Island Bayou C749 station (PIB-C749) and Neches River Saltwater Barrier (SWB). Multilayer perceptron neural networks, recurrent neural networks, long short-term memory (LSTM), and bidirectional LSTM (BiLSTM) with and without attention mechanism (AT) are tested to determine the best model, which is applied the rolling forecast method to predict 14-day DO. Traditional and recurrent transfer learning (TL and RTL) methods are adopted to overcome insufficient data at the SWB. The input feature importance analysis using the integrated gradients (IG) algorithm is applied to determine dominant inputs. The results show LSTM-based models are capable handling long sequential data. AT-BiLSTM and RTL-LSTM demonstrate the best performance at the PIB-C749 (RMSE=0.054) and the SWB (RMSE=0.028), respectively. TL and RTL methods significantly improve model performance at the SWB. DO, temperature, and pH show higher importance, consistent with hydrodynamics and water chemistry. Both best models are applied to predict 14-day DO and demonstrate reasonable performance for decision-making. Hydro-meteorological conditions of 2017 flood and 2012 drought events are simulated and reveal that possible hypoxia occurs after flooding due to increasing temperature and turbidity, and DO concentration decreases significantly under heat and drought conditions. In conclusion, LSTM-based models utilizing wireless sensor data can be a timely and effective approach to make appropriate decisions on water resource management.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Instrumentation development and testing of a wind turbine blade for sub-scale wake studies

Wind turbine blade aerodynamics and the resulting wake flow are complex, and wind tunnel testing of these flows can provide critical insight. The data from such tests are also valuable for validation of numerical models. For experiments using sub-scale turbines to be useful, the blade aerodynamics and wakes must exhibit the important features observed in utility-scale turbine flows. In this work, ~1 m blades designed to produce physics relevant to larger scale turbines were manufactured and affixed to an existing turbine. One of the blades was instrumented for blade surface pressure measurements. Time-dependent surface pressure measurements coupled with instantaneous measurements of the inflow with Cobra probes and the wake with particle image velocimetry allowed for characterization of the inflow, blade flow, and near wake. The results demonstrate that the instrumentation was effective in characterizing the blade loading and the flow field. For the one test case discussed in this paper, the measurements of inflow, blade loading, and wake properties facilitate understanding of the wake's behavior.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

Probing the properties and mechanisms of failure waves in soda-lime glass

Soda-lime glass (SLG) and other silica glasses exhibit the failure wave phenomenon under shock compression. The mechanism responsible for this peculiar behavior of glasses is still unresolved. In this study, a series of plate impact experiments was performed at three different impact stresses of 6.4, 8.3, and 10.8 GPa to better understand the mechanisms underlying the failure wave phenomenon. Specifically, spall experiments were conducted to probe the speed and existence of failure waves at different stresses in SLG. A layered glass target was used to probe the possibility of a “renucleation” of the wave at the SLG–SLG interface. When it existed, the failure wave was inferred to propagate at a speed of 1.3 km/s. However, it was observed that the failure wave phenomenon ceases to exist for impact stresses higher than 10 GPa. In experiments with a 6.4 GPa impact stress, the peak free surface velocity was significantly less than what is predicted by stress-Hugoniot calculations. This velocity deficit and other important features of the measured free surface velocity profiles were simulated using finite element analysis by incorporating an abrupt densification of SLG at a critical stress in the equation of state. Furthermore, this densification feature is similar to what would be expected of a phase transition. Although unable to unambiguously reveal the mechanism causing the failure wave phenomenon, the results of the present work clearly indicate that the failure wave causes a secondary compression and densification in SLG.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Parametric dependencies of resonant layer responses across linear, two-fluid, drift-MHD regimes

Non-axisymmetric magnetic fields arising in a tokamak either by external or internal perturbations can induce complex non-ideal MHD responses in their resonant surfaces while remaining ideally evolved elsewhere. This layer response can be characterized in a linear regime by a single parameter called the inner-layer Δ, which enables outer-layer matching and the prediction of torque balance to non-linear island regimes. In this work, we follow strictly one of the most comprehensive analytic treatments including two-fluid and drift MHD effects and keep the fidelity of the formulation by incorporating the numerical method based on the Riccati transformation when quantifying the inner-layer Δ. The proposed scheme reproduces not only the predicted responses in essentially all asymptotic regimes but also with continuous transitions as well as improved accuracies. In particular, the Δ variations across the inertial regimes with viscous or semi-collisional effects have been further resolved, in comparison with additional analytic solutions. The results imply greater shielding of the electromagnetic torque at the layer than what would be expected by earlier work when the viscous or semi-collisional effects can compete against the inertial effects, and also due to the intermediate regulation by kinetic Alfvén wave resonances as rotation slows down. These are important features that can alter the non-axisymmetric plasma responses including the field penetration by external fields or island seeding process in rotating tokamak plasmas.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

An exploration of machine learning models for the determination of reaction coordinates associated with conformational transitions

Determining collective variables (CVs) for conformational transitions is crucial to understanding their dynamics and targeting them in enhanced sampling simulations. Often, CVs are proposed based on intuition or prior knowledge of a system. However, the problem of systematically determining a proper reaction coordinate (RC) for a specific process in terms of a set of putative CVs can be achieved using committor analysis (CA). Identifying essential degrees of freedom that govern such transitions using CA remains elusive because of the high dimensionality of the conformational space. Various schemes exist to leverage the power of machine learning (ML) to extract an RC from CA. Here, we extend these studies and compare the ability of 17 different ML schemes to identify accurate RCs associated with conformational transitions. We tested these methods on an alanine dipeptide in vacuum and on a sarcosine dipeptoid in an implicit solvent. Our comparison revealed that the light gradient boosting machine method outperforms other methods. In order to extract key features from the models, we employed Shapley Additive exPlanations analysis and compared its interpretation with the “feature importance” approach. For the alanine dipeptide, our methodology identifies ϕ and θ dihedrals as essential degrees of freedom in the C7ax to C7eq transition. For the sarcosine dipeptoid system, the dihedrals ψ and ω are the most important for the cisαD to transαD transition. We further argue that analysis of the full dynamical pathway, and not just endpoint states, is essential for identifying key degrees of freedom governing transitions.

Chemistry↗
DOE OSTI2025

Prevention of resistive wall tearing mode major disruptions with feedback

Resistive wall tearing modes (RWTMs) can cause major disruptions. A signature of RWTMs is that the rational surface is sufficiently close to the wall to interact with it. For (m,n) = (2,1) modes, a RWTM requires normalized minor radius of the rational surface ρ q2 ≥ 0.75, which can also be expressed as q 75 ≤ 2. Major disruptions can occur when the criterion is satisfied. This is confirmed in simulations and theory and in a DIII-D locked mode disruption database. The q 75 < 2 criterion is valid at high β as well as at low β. A very important feature of RWTMs is that they can be feedback stabilized. If the ρ q2 criterion is not satisfied, or if the wall is ideally conducting, then the mode does not produce a major disruption, although it can produce a minor disruption. Feedback, or rotation of the mode at the wall by complex feedback, can emulate an ideal wall, preventing major disruptions. The ρ q2 criterion depends weakly on the wall radius. A simple geometric model of its dependence on wall radius is given.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Identifying sequence perturbations to an intrinsically disordered protein that determine its phase-separation behavior

Phase separation of intrinsically disordered proteins (IDPs) commonly underlies the formation of membraneless organelles, which compartmentalize molecules intracellularly in the absence of a lipid membrane. Identifying the protein sequence features responsible for IDP phase separation is critical for understanding physiological roles and pathological consequences of biomolecular condensation, as well as for harnessing phase separation for applications in bioinspired materials design. To expand our knowledge of sequence determinants of IDP phase separation, we characterized variants of the intrinsically disordered RGG domain from LAF-1, a model protein involved in phase separation and a key component of P granules. Based on a predictive coarse-grained IDP model, we identified a region of the RGG domain that has high contact probability and is highly conserved between species; deletion of this region significantly disrupts phase separation in vitro and in vivo. We determined the effects of charge patterning on phase behavior through sequence shuffling. We designed sequences with significantly increased phase separation propensity by shuffling the wild-type sequence, which contains well-mixed charged residues, to increase charge segregation. This result indicates the natural sequence is under negative selection to moderate this mode of interaction. We measured the contributions of tyrosine and arginine residues to phase separation experimentally through mutagenesis studies and computationally through direct interrogation of different modes of interaction using all-atom simulations. Finally, we show that despite these sequence perturbations, the RGG-derived condensates remain liquid-like. Together, these studies advance our fundamental understanding of key biophysical principles and sequence features important to phase separation.

36 MATERIALS SCIENCE↗