SEARCH · Engineering Papers
Results for “abstract machine model”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Tackling Disorder in γ‐Ga 2 O 3
Abstract Ga 2 O 3 and its polymorphs are attracting increasing attention. The rich structural space of polymorphic oxide systems such as Ga 2 O 3 offers potential for electronic structure engineering, which is of particular interest for a range of applications, such as power electronics. γ‐Ga 2 O 3 presents a particular challenge across synthesis, characterization, and theory due to its inherent disorder and resulting complex structure–electronic‐structure relationship. Here, density functional theory is used in combination with a machine‐learning approach to screen nearly one million potential structures, thereby developing a robust atomistic model of the γ‐phase. Theoretical results are compared with surface and bulk sensitive soft and hard X‐ray photoelectron spectroscopy, X‐ray absorption spectroscopy, spectroscopic ellipsometry, and photoluminescence excitation spectroscopy experiments representative of the occupied and unoccupied states of γ‐Ga 2 O 3 . The first onset of strong absorption at room temperature is found at 5.1 eV from spectroscopic ellipsometry, which agrees well with the excitation maximum at 5.17 eV obtained by photoluminescence excitation spectroscopy, where the latter shifts to 5.33 eV at 5 K. This work presents a leap forward in the treatment of complex, disordered oxides and is a crucial step toward exploring how their electronic structure can be understood in terms of local coordination and overall structure.
The cis-regulatory codes of response to combined heat and drought stress in Arabidopsis thaliana
Abstract Plants respond to their environment by dynamically modulating gene expression. A powerful approach for understanding how these responses are regulated is to integrate information about cis-regulatory elements (CREs) into models called cis-regulatory codes. Transcriptional response to combined stress is typically not the sum of the responses to the individual stresses. However, cis-regulatory codes underlying combined stress response have not been established. Here we modeled transcriptional response to single and combined heat and drought stress in Arabidopsis thaliana. We grouped genes by their pattern of response (independent, antagonistic and synergistic) and trained machine learning models to predict their response using putative CREs (pCREs) as features (median F-measure = 0.64). We then developed a deep learning approach to integrate additional omics information (sequence conservation, chromatin accessibility and histone modification) into our models, improving performance by 6.2%. While pCREs important for predicting independent and antagonistic responses tended to resemble binding motifs of transcription factors associated with heat and/or drought stress, important synergistic pCREs resembled binding motifs of transcription factors not known to be associated with stress. These findings demonstrate how in silico approaches can improve our understanding of the complex codes regulating response to combined stress and help us identify prime targets for future characterization.
MSD CoP Webinar: Advancing MSD Research with Artificial Intelligence
Context: This webinar was hosted by the MultiSector Dynamics Community of Practice (MSD CoP; https://multisectordynamics.org). Abstract: Recent advances in Artificial Intelligence (AI) are quickly changing the landscape of tools available to conceptualize, execute, and disseminate research. We posit that research efforts in Multi-Sector Dynamics can benefit from these advances; the new AI in MSD Working Group thus aims to identify and quantify opportunities and risks associated with their implementation. In this webinar, we will first introduce the new AI Working Group, which was initially conceived during the first MSD workshop in October 2023. Next, our panelists will explore how generative AI, explainable AI, and machine learning can help us improve modeling efforts in multiple domains, including climate science, hydrology, and energy systems. Finally, we will discuss the aims of the working group, gather inputs from the community, and suggest directions for the next steps. Presenters : Andrea Castelletti (Politecnico di Milano; Invited Speaker), Chaopeng Shen (Pennsylvania State University; Invited Speaker), Nicole Jackson (Sandia National Laboratory; Invited Speaker), Stefano Galelli (Cornell University; Co-Chair), David Gold (Utrecht University; Co-Chair), Jillian Sturtevant (Baylor University; Communications Officer) Moderator: Pat M. Reed (MSD CoP Facilitation Team) This webinar was held on: June 14th, 2024 from 12-1:30 PM EST
Experience with abstract notation one
The development of computer science has produced a vast number of machine architectures, programming languages, and compiler technologies. The cross product of these three characteristics defines the spectrum of previous and present data representation methodologies. With regard to computer networks, the uniqueness of these methodologies presents an obstacle when disparate host environments are to be interconnected. Interoperability within a heterogeneous network relies upon the establishment of data representation commonality. The International Standards Organization (ISO) is currently developing the abstract syntax notation one standard (ASN.1) and the basic encoding rules standard (BER) that collectively address this problem. When used within the presentation layer of the open systems interconnection reference model, these two standards provide the data representation commonality required to facilitate interoperability. The details of a compiler that was built to automate the use of ASN.1 and BER are described. From this experience, insights into both standards are given and potential problems relating to this development effort are discussed.
Quantum Divide and Compute: Exploring the Effect of Different Noise Sources
Abstract Our recent work (Ayral et al. in Proceedings of IEEE computer society annual symposium on VLSI, ISVLSI, pp 138–140, 2020. 10.1109/ISVLSI49217.2020.00034 ) showed the first implementation of the Quantum Divide and Compute (QDC) method, which allows to break quantum circuits into smaller fragments with fewer qubits and shallower depth. This accommodates the limited number of qubits and short coherence times of quantum processors. This article investigates the impact of different noise sources—readout error, gate error and decoherence—on the success probability of the QDC procedure. We perform detailed noise modeling on the Atos Quantum Learning Machine, allowing us to understand tradeoffs and formulate recommendations about which hardware noise sources should be preferentially optimized. We also describe in detail the noise models we used to reproduce experimental runs on IBM’s Johannesburg processor. This article also includes a detailed derivation of the equations used in the QDC procedure to compute the output distribution of the original quantum circuit from the output distribution of its fragments. Finally, we analyze the computational complexity of the QDC method for the circuit under study via tensor-network considerations, and elaborate on the relation the QDC method with tensor-network simulation methods.
Hydrogen-induced degradation dynamics in silicon heterojunction solar cells via machine learning
Abstract Among silicon-based solar cells, heterojunction cells hold the world efficiency record. However, their market acceptance is hindered by an initial 0.5% per year degradation of their open circuit voltage which doubles the overall cell degradation rate. Here, we study the performance degradation of crystalline-Si/amorphous-Si:H heterojunction stacks. First, we experimentally measure the interface defect density over a year, the primary driver of the degradation. Second, we develop SolDeg, a multiscale, hierarchical simulator to analyze this degradation by combining Machine Learning, Molecular Dynamics, Density Functional Theory, and Nudged Elastic Band methods with analytical modeling. We discover that the chemical potential for mobile hydrogen develops a gradient, forcing the hydrogen to drift from the interface, leaving behind recombination-active defects. We find quantitative correspondence between the calculated and experimentally determined defect generation dynamics. Finally, we propose a reversed Si-density gradient architecture for the amorphous-Si:H layer that promises to reduce the initial open circuit voltage degradation from 0.5% per year to 0.1% per year.
Can machine learning accelerate process understanding and decision‐relevant predictions of river water quality?
Abstract The global decline of water quality in rivers and streams has resulted in a pressing need to design new watershed management strategies. Water quality can be affected by multiple stressors including population growth, land use change, global warming, and extreme events, with repercussions on human and ecosystem health. A scientific understanding of factors affecting riverine water quality and predictions at local to regional scales, and at sub‐daily to decadal timescales are needed for optimal management of watersheds and river basins. Here, we discuss how machine learning (ML) can enable development of more accurate, computationally tractable, and scalable models for analysis and predictions of river water quality. We review relevant state‐of‐the art applications of ML for water quality models and discuss opportunities to improve the use of ML with emerging computational and mathematical methods for model selection, hyperparameter optimization, incorporating process knowledge into ML models, improving explainablity, uncertainty quantification, and model‐data integration. We then present considerations for using ML to address water quality problems given their scale and complexity, available data and computational resources, and stakeholder needs. When combined with decades of process understanding, interdisciplinary advances in knowledge‐guided ML, information theory, data integration, and analytics can help address fundamental science questions and enable decision‐relevant predictions of riverine water quality.
Uncertainty Quantification for Dissimilar Material Joints Under Corrosion Environment
Abstract Self-Piercing Riveting (SPR) is one of the most commonly used methods for joining dissimilar materials in the automotive industry. These joints are popular due to their adaptability, high performance and short cycle time. However, since these joints involve two dissimilar materials, they are susceptible to galvanic corrosion in the presence of an electrolyte which is driven by the difference in the equilibrium potential of the metals. This can affect the safety and resilience of these joints. In this paper, we focus on galvanic corrosion in Al-Fe SPR joints. A Machine learning (ML) based surrogate model, which is based off of FE simulations, for statistical corrosion analysis is developed. This model enables the resilience and reliability analysis of SPR joints under corrosion environment. In this study, first a physics-based finite element (FE) corrosion model has been developed to simulate the galvanic corrosion between a Fe cathode and an Al anode of a SPR joint. This model takes into account the effect of the crystal microstructure of the Al anode and the precipitation of the corrosion product. Several geometric and environmental factors including crevice gap, roughness of anode, conductivity, pH and the temperature of the electrolyte that effect corrosion are investigated. A thorough Uncertainty Quantification (UQ) analysis is conducted for the overall corrosion behavior of the Fe-Al SPR joints using a novelistic Probabilistic Confidence-Based Adaptive Sampling (PCAS) technique. PCAS is used to train the surrogate model by identifying the critical sampling points and thus reducing the overall computational costs. It is found that the electrolyte temperature has the largest effects on the material loss and needs to be managed closely for better corrosion control. By understanding the corrosion performance and resultant uncertainty impact on SPR joints, the reliability and resilience of these joints can be improved.
Experimental and modeling study of the autoignition behavior of a saturated heterocycle: Pyrrolidine
Experiments are conducted in both rapid compression machine (RCM) and shock tube (ST) to better quantify autoignition behavior (e.g., ignition delay, heat release) and understand heteroatomic effects in heterocyclic compounds, which are important reference components for the combustion of biomass-derived liquid fuels. These tests focus on the nitrogen-containing, five-membered saturated ring, pyrrolidine, at diluted conditions covering pressures of 20 and 50 bar, temperatures of 720–1450 K and a range of stoichiometries (ϕ = 0.5–2). A chemical kinetic model is developed and coupled to an existing combustion kinetics framework describing key nitrogen containing intermediates (e.g. pyrrole, ammonia and NOx). H-abstraction reactions by OH, H, CH 3 and HO 2 , are determined using ab-initio transition state theory methods, while analogies to cyclopentane are adopted for many other reactions, such as ring-opening. Here, the autoignition measurements reveal the lack of negative temperature coefficient (NTC) behavior and low-temperature chemistry for pyrrolidine, as opposed to its saturated hydrocarbon analogue, cyclopentane. Interestingly, at the lowest temperatures (T < 750 K), the reactivity of cyclopentane is greater than pyrrolidine, while at higher temperatures, pyrrolidine becomes more reactive. Agreement between the experimental measurements and the model is good, and it is found that H-abstraction reactions by HO 2 and ensuing chemistry play key roles in controlling the reactivity of this cyclic amine. Most of the fluxes, i.e., >70 %, are predicted to move through 1- or 2-pyrroline (C 4 H 7 N) and then the cyclic C 4 H 6 N radical, at both lower and higher temperatures, to form either CH 2 CHCHCHNH via ring-opening or pyrrole via β-scission. It appears that the ring opens more easily at lower temperature whereas the C–H β-scission dominates at higher temperature and lower pressure, such that the reaction of the fuel radical intermediate carrying an unpaired electron on the nitrogen atom with HO 2 is the next most notable in promoting oxidation. When comparing pyrrolidine and cyclopentane, which exhibits distinct pathways in different temperature regimes, the pyrrolidine pathways and sensitivity analysis align more closely to the high temperature case of cyclopentane where the important role of HO 2 radicals is seen to provide chain branching through HO 2 reaction with the fuel, accompanied by H 2 O 2 formation and decomposition to OH. The formation of 5-membered diene rings and ring opening reactions are also found to be highly relevant. Of particular note, it is found that there is little influence of small molecule nitrogen-chemistry, e.g., NH 2 , HCN, NO/NO 2 on the reactivity of the pyrrolidine mixtures investigated here where no recirculated combustion gases are included.
Data analytics approach to predict high-temperature cyclic oxidation kinetics of NiCr-based Alloys
Abstract Although of practical importance, there is no established modeling framework to accurately predict high-temperature cyclic oxidation kinetics of multi-component alloys due to the inherent complexity. We present a data analytics approach to predict the oxidation rate constant of NiCr-based alloys as a function of composition and temperature with a highly consistent and well-curated experimental dataset. Two characteristic oxidation models, i.e., a simple parabolic law and a statistical cyclic oxidation model, have been chosen to numerically represent the high-temperature oxidation kinetics of commercial and model NiCr-based alloys. We have successfully trained machine learning (ML) models using highly ranked key input features identified by correlation analysis to accurately predict experimental parabolic rate constants ( k p ). This study demonstrates the potential of ML approaches to predict oxidation kinetics of alloys over wide composition and temperature ranges. This approach can also serve as a basis for introducing more physically meaningful ML input features to predict the comprehensive cyclic oxidation behavior of multi-component high-temperature alloys with proper constraints based on the known underlying mechanisms.
Enabling deeper learning on big data for materials informatics applications
Abstract The application of machine learning (ML) techniques in materials science has attracted significant attention in recent years, due to their impressive ability to efficiently extract data-driven linkages from various input materials representations to their output properties. While the application of traditional ML techniques has become quite ubiquitous, there have been limited applications of more advanced deep learning (DL) techniques, primarily because big materials datasets are relatively rare. Given the demonstrated potential and advantages of DL and the increasing availability of big materials datasets, it is attractive to go for deeper neural networks in a bid to boost model performance, but in reality, it leads to performance degradation due to the vanishing gradient problem. In this paper, we address the question of how to enable deeper learning for cases where big materials data is available. Here, we present a general deep learning framework based on Individual Residual learning (IRNet) composed of very deep neural networks that can work with any vector-based materials representation as input to build accurate property prediction models. We find that the proposed IRNet models can not only successfully alleviate the vanishing gradient problem and enable deeper learning, but also lead to significantly (up to 47%) better model accuracy as compared to plain deep neural networks and traditional ML techniques for a given input materials representation in the presence of big data.
Deep learning with plasma plume image sequences for anomaly detection and prediction of growth kinetics during pulsed laser deposition
Abstract Materials synthesis platforms that are designed for autonomous experimentation are capable of collecting multimodal diagnostic data that can be utilized for feedback to optimize material properties. Pulsed laser deposition (PLD) is emerging as a viable autonomous synthesis tool, and so the need arises to develop machine learning (ML) techniques that are capable of extracting information from in situ diagnostics. Here, we demonstrate that intensified-CCD image sequences of the plasma plume generated during PLD can be used for anomaly detection and the prediction of thin film growth kinetics. We develop multi-output (2 + 1)D convolutional neural network regression models that extract deep features from plume dynamics that not only correlate with the measured chamber pressure and incident laser energy, but more importantly, predict parameters of an auto-catalytic film growth model derived from in situ laser reflectivity experiments. Our results demonstrate how ML with in situ plume diagnostics data in PLD can be utilized to maintain deposition conditions in an optimal regime. Further, the predictive capabilities of plume dynamics on the kinetics of film growth or other film properties prior to deposition provides a means for rapid pre-screening of growth conditions for the non-expert, which promises to accelerate materials optimization with PLD.
Reionization history constraints from neural network based predictions of high-redshift quasar continua
ABSTRACT Observations of the early Universe suggest that reionization was complete by z ∼ 6, however, the exact history of this process is still unknown. One method for measuring the evolution of the neutral fraction throughout this epoch is via observing the Lyα damping wings of high-redshift quasars. In order to constrain the neutral fraction from quasar observations, one needs an accurate model of the quasar spectrum around Lyα, after the spectrum has been processed by its host galaxy but before it is altered by absorption and damping in the intervening intergalactic medium (IGM). In this paper, we present a novel machine learning approach, using artificial neural networks, to reconstruct quasar continua around Lyα. Our Quasar Spectra from Artificial Neural Network based predictive Regression Algorithm(QSANNdRA) improves the error in this reconstruction compared to the state-of-the-art principal component analysis (PCA) based model in the literature by 14.2 per cent on average, and provides an improvement of 6.1 per cent on average when compared to an extension thereof. In comparison with the extended PCA model, QSANNdRA further achieves an improvement of 22.1 per cent and 16.8 per cent when evaluated on low-redshift quasars most similar to the two high-redshift quasars under consideration, ULAS J1120+0641 at z = 7.0851 and ULAS J1342+0928 at z = 7.5413, respectively. Using our more accurate reconstructions of these two z > 7 quasars, we estimate the neutral fraction of the IGM using a homogeneous reionization model and find $\bar{x}_\mathrm{H\, \small{I}} = 0.25^{+0.05}_{-0.05}$ at z = 7.0851 and $\bar{x}_\mathrm{H\, \small{I}} = 0.60^{+0.11}_{-0.11}$ at z = 7.5413. Our results are consistent with the literature and favour a rapid end to reionization.
Microbial vitamin biosynthesis links gut microbiota dynamics to chemotherapy toxicity
ABSTRACT Dose-limiting toxicities pose a major barrier to cancer treatment. While preclinical studies show that the gut microbiota influences and is influenced by anticancer drugs, data from patients paired with careful side effect monitoring remains limited. Here, we investigate capecitabine (CAP)-microbiome interactions through longitudinal metagenomic sequencing of stool from 56 advanced colorectal cancer patients. CAP significantly altered the gut microbiome, enriching for menaquinol (vitamin K2) biosynthesis genes. Transposon library screens, targeted gene deletions, and media supplementation revealed that menaquinol biosynthesis protectsEscherichia colifrom drug toxicity. Stool menaquinol gene and metabolite levels were associated with decreased peripheral sensory neuropathy. Machine learning models trained in this cohort predicted toxicities in an independent cohort. Taken together, these results suggest treatment-associated increases in microbial vitamin biosynthesis serve a chemoprotective role for bacterial and host cells. Further, our findings provide a foundation for in-depth mechanistic dissection, human intervention studies, and extension to other cancer treatments. IMPORTANCE Side effects are common during the treatment of cancer. The trillions of microbes found within the human gut are sensitive to anticancer drugs, but the effects of treatment-induced shifts in gut microbes for side effects remain poorly understood. We profiled gut microbes in colorectal cancer patients treated with capecitabine and carefully monitored side effects. We observed a marked expansion in genes for producing vitamin K2 (menaquinone). Vitamin K2 rescued gut bacterial growth and was associated with decreased side effects in patients. We then used information about gut microbes to develop a predictive model of drug toxicity that was validated in an independent cohort. These results suggest that treatment-associated increases in bacterial vitamin production protect both bacteria and host cells from drug toxicity, providing new opportunities for intervention and motivating the need to better understand how dietary intake and bacterial production of micronutrients like vitamin K2 influence cancer treatment outcomes.
Risk-Aware Framework Development for Disruption Prediction: Alcator C-Mod and DIII-D Survival Analysis
Abstract Survival regression models can achieve longer warning times at similar receiver operating characteristic performance than previously investigated models. Survival regression models are also shown to predict the time until a disruption will occur with lower error than other predictors. Time-to-event predictions from time-series data can be obtained with a survival analysis statistical framework, and there have been many tools developed for this task which we aim to apply to disruption prediction. Using the open-source Auton-Survival package we have implemented disruption predictors with the survival regression models Cox Proportional Hazards, Deep Cox Proportional Hazards, and Deep Survival Machines. To compare with previous work, we also include predictors using a Random Forest binary classifier, and a conditional Kaplan-Meier formalism. We benchmarked the performance of these five predictors using experimental data from the Alcator C-Mod and DIII-D tokamaks by simulating alarms on each individual shot. We find that developing machine-relevant metrics to evaluate models is an important area for future work. While this study finds cases where disruptive conditions are not predicted, there are instances where the desired outcome is produced. Giving the plasma control system the expected time-to-disruption will allow it to determine the optimal actuator response in real time to minimize risk of damage to the device.
Towards atom-level understanding of metal oxide catalysts for the oxygen evolution reaction with machine learning
Abstract Green hydrogen production is crucial for a sustainable future, but current catalysts for the oxygen evolution reaction (OER) suffer from slow kinetics, despite many efforts to produce optimal designs, particularly through the calculation of descriptors for activity. In this study, we develop a dataset of density functional theory calculations of bulk and surface perovskite oxides, and adsorption energies of OER intermediates, which includes compositions up to quaternary and facets up to (555). We demonstrate that per-site properties of perovskite oxides such as Bader charge or band center can be tuned through element substitution and faceting, and develop a machine learning model that accurately predicts these properties directly from the local chemical environment. We leverage these per-site properties to identify promising perovskites with high theoretical OER activity. The identified design principles and promising materials provide a roadmap for closing the gap between current artificial catalysts and biological enzymes such as photosystem II.
The design space of E(3)-equivariant atom-centred interatomic potentials
Abstract Molecular dynamics simulation is an important tool in computational materials science and chemistry, and in the past decade it has been revolutionized by machine learning. This rapid progress in machine learning interatomic potentials has produced a number of new architectures in just the past few years. Particularly notable among these are the atomic cluster expansion, which unified many of the earlier ideas around atom-density-based descriptors, and Neural Equivariant Interatomic Potentials (NequIP), a message-passing neural network with equivariant features that exhibited state-of-the-art accuracy at the time. Here we construct a mathematical framework that unifies these models: atomic cluster expansion is extended and recast as one layer of a multi-layer architecture, while the linearized version of NequIP is understood as a particular sparsification of a much larger polynomial model. Our framework also provides a practical tool for systematically probing different choices in this unified design space. An ablation study of NequIP, via a set of experiments looking at in- and out-of-domain accuracy and smooth extrapolation very far from the training data, sheds some light on which design choices are critical to achieving high accuracy. A much-simplified version of NequIP, which we call BOTnet (for body-ordered tensor network), has an interpretable architecture and maintains its accuracy on benchmark datasets.