Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Learning Theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,351 records · Page 75

Navigating Transition-Metal Chemical Space: Artificial Intelligence for First-Principles Design

Conspectus The variability of chemical bonding in open-shell transition-metal complexes not only motivates their study as functional materials and catalysts but also challenges conventional computational modeling tools. Here, tailoring ligand chemistry can alter preferred spin or oxidation states as well as electronic structure properties and reactivity, creating vast regions of chemical space to explore when designing new materials atom by atom. Although first-principles density functional theory (DFT) remains the workhorse of computational chemistry in mechanism deduction and property prediction, it is of limited use here. DFT is both far too computationally costly for widespread exploration of transition-metal chemical space and also prone to inaccuracies that limit its predictive performance for localized d electrons in transition-metal complexes. These challenges starkly contrast with the well-trodden regions of small-organic-molecule chemical space, where the analytical forms of molecular mechanics force fields and semiempirical theories have for decades accelerated the discovery of new molecules, accurate DFT functional performance has been demonstrated, and gold-standard methods from correlated wavefunction theory can predict experimental results to chemical accuracy. The combined promise of transition-metal chemical space exploration and lack of established tools has mandated a distinct approach. In this Account, we outline the path we charted in exploration of transition-metal chemical space starting from the first machine learning (ML) models (i.e., artificial neural network and kernel ridge regression) and representations for the prediction of open-shell transition-metal complex properties. The distinct importance of the immediate coordination environment of the metal center as well as the lack of low-level methods to accurately predict structural properties in this coordination environment first motivated and then benefited from these ML models and representations. Once developed, the recipe for prediction of geometric, spin state, and redox potential properties was straightforwardly extended to a diverse range of other properties, including in catalysis, computational “feasibility”, and the gas separation properties of periodic metal–organic frameworks. Interpretation of selected features most important for model prediction revealed new ways to encapsulate design rules and confirmed that models were robustly mapping essential structure–property relationships. Encountering the special challenge of ensuring that good model performance could generalize to new discovery targets motivated investigation of how to best carry out model uncertainty quantification. Distance-based approaches, whether in model latent space or in carefully engineered feature space, provided intuitive measures of the domain of applicability. With all of these pieces together, ML can be harnessed as an engine to tackle the large-scale exploration of transition-metal chemical space needed to satisfy multiple objectives using efficient global optimization methods. In practical terms, bringing these artificial intelligence tools to bear on the problems of transition-metal chemical space exploration has resulted in ML-model assessments of large, multimillion compound spaces in minutes and validated new design leads in weeks instead of decades.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Properties of the new $ \mathcal{N} $ = 1 AdS 4 vacuum of maximal supergravity

The recent comprehensive numerical study of critical points of the scalar potential of four-dimensional N = 8, SO(8) gauged supergravity using Machine Learning software in [1] has led to a discovery of a new N = 1 vacuum with a triality-invariant SO(3) symmetry. Guided by the numerical data for that point, we obtain a consistent SO(3) × Z 2 -invariant truncation of the N = 8 theory to an N = 1 supergravity with three chiral multiplets. Critical points of the truncated scalar potential include both the N = 1 point as well as two new non-supersymmetric and perturbatively unstable points not found by previous searches. Studying the structure of the submanifold of SO(3) × Z 2 -invariant supergravity scalars, we find that it has a simple interpretation as a submanifold of the 14-dimensional Z $3\atop{2}$ -invariant scalar manifold (SU(1, 1)/U(1)) 7 , for which we find a rather remarkable superpotential whose structure matches the single bit error correcting (7, 4) Hamming code. This 14-dimensional scalar manifold contains approximately one quarter of the known critical points. We also show that there exists a smooth supersymmetric domain wall which interpolates between the new N = 1 AdS4 solution and the maximally supersymmetric AdS4 vacuum. Using holography, this result indicates the existence of an N = 1 RG flow from the ABJM SCFT to a new strongly interacting conformal fixed point in the IR.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Theory-guided experimental design in battery materials research

A reliable energy storage ecosystem is imperative for a renewable energy future, and continued research is needed to develop promising rechargeable battery chemistries. To this end, better theoretical and experimental understanding of electrochemical mechanisms and structure-property relationships will allow us to accelerate the development of safer batteries with higher energy densities and longer lifetimes. This Review discusses the interplay between theory and experiment in battery materials research, enabling us to not only uncover hitherto unknown mechanisms but also rationally design more promising electrode and electrolyte materials. We examine specific case studies of theory-guided experimental design in lithium-ion, lithium-metal, sodium-metal, and all-solid-state batteries. We also offer insights into how this framework can be extended to multivalent batteries. To close the loop, we outline recent efforts in coupling machine learning with high-throughput computations and experiments. Last, recommendations for effective collaboration between theorists and experimentalists are provided.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Multiresolutional models of uncertainty generation and reduction

Kolmogorov's axiomatic principles of the probability theory, are reconsidered in the scope of their applicability to the processes of knowledge acquisition and interpretation. The model of uncertainty generation is modified in order to reflect the reality of engineering problems, particularly in the area of intelligent control. This model implies algorithms of learning which are organized in three groups which reflect the degree of conceptualization of the knowledge the system is dealing with. It is essential that these algorithms are motivated by and consistent with the multiresolutional model of knowledge representation which is reflected in the structure of models and the algorithms of learning.

Meystel, A.↗

NASA Participated in the Japan 2001 Science, Creativity and the Young Mind Workshop

During the week of July 23, 2001, a workshop called the Japan 2001 Science, Creativity and the Young Mind took place at Bristol University in Bristol, England. Coordinated by the Clifton Scientific Trust, it brought together 60 British and Japanese students and provided them with a forum for learning and interacting. All the students were chosen from geographical areas of social deprivation, where university education is not seen as a natural progression for students. One of the aims of the workshop was to give the combined group a new view of themselves as potential scientists and an ambition to succeed at the highest level. Members of the Glenn Research Center's Learning Technologies Project participated with six of the students and their team leaders as a Space Science Team. Four interactive videoconferencing sessions were held between the NASA Glenn Research Center and Bristol University on four consecutive days. During the sessions, students raised questions concerning various theories about the probable formation of volcanoes on Mars. Of specific interest was if the great Tharsis volcanoes might be the result of an ancient collision of planetary proportions, or if plate tectonic movement, evidence for which was recently discovered by NASA's Mars Global Surveyor Spacecraft, might account for them.

Kolecki, Joseph C.↗

Ultrafast Melting at Metal-Semiconductor Interfaces: A Molecular Dynamics Study

Quantifying the thermodynamics of interfacial melting is important for several applications such as laser machining and designing radiation hardened electronic devices. Due to the short time and length scales that are involved in the process, molecular simulations provide an ideal path for understating the interfacial melting phenomena. In this work we investigate tungsten (W) – silicon carbide (SiC) interfaces which are relevant in modern high-power electronic devices. Classical molecular dynamics simulations along with the two-temperature model (TTM) were used to study the radiation induced melting of the interface while a neural network-based machine learning framework was used to track the transient re-crystallization process. The damage endured by the semiconductor at the interface following the radiation event is discussed in detail while the re-crystallization of the metal is described in terms of the classical nucleation theory.

Ashwin Ravichandran↗

Theoretical Investigations of Anharmonic Effects and Phonon Transport in the Cubic Phase of Crystalline Perovskite CsPbCl 3

The role of anharmonic effects on lattice dynamics and thermal transport has been investigated in the cubic phase of the CsPbCl 3 perovskite. Limitations of the harmonic approximation, which lead to phonon instabilities in the Brillouin zone, were addressed based on self-consistent phonon theory in combination with first-principles calculations and by incorporation of frequency renormalization effects from bubble and loop diagrams. This theoretical approach demonstrates significant improvements compared to results obtained using a self-consistent phonon dynamic matrix. Both the cubic-to-tetragonal phase transition temperature as well as the predicted lattice thermal conductivity values show good agreement with selected sets of available experimental data. In conclusion, the accuracy of the predicted thermal conductivity data is also tested against systems significantly larger than those allowed by quantum calculations, by using molecular dynamic simulations with machine-learning force fields.

Lattices↗

Exploring Professor Motivations and Implementations of a Real-World Problem-Solving Project

Engineering education literature offers a variety of theoretical and conceptual frameworks for project-based learning. This study explores the implementation of real-world problem-solving projects in engineering education. The research team analyzed the motivations and methods behind professors' adoption of such projects through exploratory qualitative interviews with seven professor participants who integrated a nation-wide student competition into their courses. We analyzed the resulting data using a constructivist grounded theory approach to identify key themes of professor practices. Findings reveal that the real-world aspect of the projects and alignment with values and research interests were primary motivators for implementation. While implementation methods varied significantly based on context (i.e., university setting, course type), we found that these projects could be effectively integrated into various classroom settings. The findings support the recommendation for non-academic institutions to develop and manage competitions that can be integrated into classrooms and which offer a point of engagement that is available to professors from a wide range of disciplines.

42 ENGINEERING↗

Machine Learning-Driven Solvent Screening for Biobased 2,3-Butanediol Extraction

Biobased 2,3-butanediol (2,3-BDO) is a valuable biomass-derived chemical due to its versatility in being transformed into a wide variety of products. However, the separation and purification of 2,3-BDO from fermentation broth remain a significant challenge owing to its high boiling point and hydrophilic nature. Herein, we developed a machine learning (ML)-based screening workflow that uses molecular calculations as training data and requires only a small number of experimental measurements for validation to identify alternative solvent candidates for the liquid–liquid extraction (LLE) of 2,3-BDO from aqueous solution. In particular, 130 density functional theory (DFT) calculations with the implicit solvation method not only built a correlation between the computational partition coefficient and the experimental distribution coefficient of 2,3-BDO but also parameterized an Extra-Trees ML model to screen the distribution coefficient for a wider range of 6717 organic solvents. The experimental measurements of only 24 solvents were needed to validate the computational results. A list of 50 prioritized solvents was proposed for 2,3-BDO LLE, and seven additional experimental measurements were conducted to further verify our selected solvents. The impact of the extraction temperature and solvent-to-feed ratio was also investigated for selected solvents in experiments. Furthermore, this work suggested alternative solvents for 2,3-BDO LLE and proposed a versatile workflow that requires fewer experiments and can be applied to a broader range of LLE studies.

Extraction↗

Data-driven design of novel halide perovskite alloys

The great tunability of the properties of halide perovskites presents new opportunities for optoelectronic applications as well as significant challenges associated with exploring combinatorial chemical spaces. Here, in this work, we develop a framework powered by high-throughput computations and machine learning for the design and prediction of mixed cation halide perovskite alloys. In a chemical space of ABX 3 perovskites with a selected set of options for A, B, and X species, pseudo-cubic structures with B-site mixing are simulated using density functional theory (DFT) and several properties are computed, including stability, lattice constant, band gap, vacancy formation energy, refractive index, and optical absorption spectrum, using both semi-local and hybrid functionals. Neural networks (NN) are used to train predictive models for every property using tabulated elemental properties of A, B, and X site species as descriptors. Starting from a DFT dataset of 229 points, we use the trained NN models to predict the structural, energetic, electronic, and optical properties of an extensive dataset of 17955 compounds, and perform high-throughput screening in terms of stability, band gap, and defect tolerance, to obtain 392 promising compounds that are ranked as potential absorbers according to their photovoltaic figure of merit. Compositional trends in the screened set of attractive mixed cation halide perovskites are revealed and additional computations are performed on selected compounds. The data-driven design framework developed here is promising for designing novel mixed compositions and can be extended to a wider perovskite chemical space in terms of A, B, and X species, different kinds of mixing at the A, B, or X sites, non-cubic phases, and other properties of interest.

36 MATERIALS SCIENCE↗

A Dual-Route Model that Learns to Pronounce English Words

This paper describes a model that learns to pronounce English words. Learning occurs in two modules: 1) a rule-based module that constructs pronunciations by phonetic analysis of the letter string, and 2) a whole-word module that learns to associate subsets of letters to the pronunciation, without phonetic analysis. In a simulation on a corpus of over 300 words the model produced pronunciation latencies consistent with the effects of word frequency and orthographic regularity observed in human data. Implications of the model for theories of visual word processing and reading instruction are discussed.

Remington, Roger W.↗

Atmospheric Excitation of Planetary Normal Modes

The objectives of this study were to: (1) understand the phenomenon of continuous free oscillations of the Earth and (2) examine the idea of using this phenomenon for planetary seismology. We first describe the results on (1) and present our evaluations of the idea (2) in the final section. In 1997, after almost forty years since the initial attempt by Benioff et al, continuous free oscillations of the Earth were discovered. Spheroidal fundamental modes between 2 and 7 millihertz are excited continuously with acceleration amplitudes of about 0.3-0.5 nanogals. The signal is now commonly found in virtually all data recorded by STS-1 type broadband seismometers at quiet sites. Seasonal variation in amplitude and the existence of two coupled modes between the atmosphere and the solid Earth support that these oscillations are excited by the atmosphere. Stochastic excitation due to atmospheric turbulence is a favored mechanism, providing a good match between theory and data. The atmosphere has ample energy to support this theory because excitation of these modes require only 500-10000 W whereas the atmosphere contains about 117 W of kinetic energy. An application of this phenomenon includes planetary seismology, because other planets may be oscillating due to atmospheric excitation. The interior structure of planets could be learned by determining the eigenfrequencies in the continuous free oscillations. It is especially attractive to pursue this idea for tectonically quiet planets, since quakes may be too infrequent to be recorded by seismic instruments.

Tanimoto, Toshiro↗

Davis Computational Spectroscopy Workflow—From Structure to Spectra

Here, we describe an automated workflow that connects a series of atomic simulation tools to investigate the relationship between atomic structure, lattice dynamics, materials properties, and inelastic neutron scattering (INS) spectra. Starting from the atomic simulation environment (ASE) as an interface, we demonstrate the use of a selection of calculators, including density functional theory (DFT) and density functional tight binding (DFTB), to optimize the structures and calculate interatomic force constants. We present the use of our workflow to compute the phonon frequencies and eigenvectors, which are required to accurately simulate the INS spectra in crystalline solids like diamond and graphite as well as molecular solids like rubrene. We have also implemented a machine-learning force field based on Chebyshev polynomials called the Chebyshev interaction model for efficient simulation (ChIMES) to improve the accuracy of the DFTB simulations. We then explore the transferability of our DFTB/ChIMES models by comparing simulations derived from different training sets. We show that DFTB/ChIMES demonstrates ~100× reduction in computational expense while retaining most of the accuracy of DFT as well as yielding high accuracy for different materials outside of our training sets. The DFTB/ChIMES method within the workflow expands the possibilities to use simulations to accurately predict materials properties of increasingly complex structures that would be unfeasible with ab initio methods.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Striving to translate shale physics across ten orders of magnitude: What have we learned?

Shales will play an important role in the successful transition of energy from fossil-based resources to renewables in the coming decades. Aside from being a significant source of low-carbon intensity fuels, like natural gas, they also serve as geologic seals of subsurface formations that may be used to isolate nuclear waste, sequester CO 2 , or store intermittent energy (e.g., solar hydrogen). Despite their importance, shales pose significant engineering and environmental challenges due to their nanoporous structure and extreme heterogeneity that spans at least ~10 orders of magnitude in spatial scale. Two challenges inhibit a system-level understanding: (1) the physics of fluid flow and phase behavior in shales are poorly understood due to the dominant molecular interactions between minerals and fluids under confinement, and (2) the apparent lack of scale separation that prevents a reliable (closed) description of the physics at any single scale of observation. In this review, we focus on the latter issue and discuss scale translation, which in its broadest sense is transforming data or simulations from one spatiotemporal scale to another. While effective scale translation is not exclusive to shales, but all geologic porous media, the need for it is especially acute in shales given their high degree of heterogeneity. Classical theories like homogenization, while indispensable, fail when scales are not separated. Other methods, like numerical upscaling, scale-translate in only one direction: small to large, but not the reverse, called downscaling. However, the confluence of advances in three areas are bringing challenging problems such as shales within reach: increased computational power and scalable algorithms; high-resolution imaging and multi-modal data acquisition; and machine learning to process massive amounts of data. While these advances equip geoscientists with a wide array of experimental and computational tools, no individual tool can probe the entire gamut of heterogeneity in shales. Their effective use, therefore, requires an ability to bridge between various data types obtained at different scales. The aim of this review is to present a coherent account of computational and experimental methods that may be used to achieve just that, i.e., to perform scale translation. We provide a broader definition of scale translation, one that transcends classical homogenization and upscaling methods, but is consistent with them and accommodates notions like downscaling and data translation. After a brief introduction to homogenization, we review hybrid methods, numerical upscaling and its recent extensions, multiscale computing, high-resolution imaging, and machine learning. We place particular emphasis on multiscale computing and propose an algorithmic framework to bridge between the pore (micro) and Darcy (macro) scales. Throughout the paper, we draw comparisons between the various methods and highlight their (often hidden) similarities, differences, benefits, and pitfalls. We finally conclude with two case studies on shales that exemplify some of the methods presented.

58 GEOSCIENCES↗

Web-Based Tools for Data-Informed Remedy Optimization: Software Theory and User Guide

This report documents the development and application of two web-based decision-support tools for pump-and-treat (P&T) groundwater remediation systems: PTOLEMY (Pump-and-Treat Optimized Location Evaluation to Maximize Yields) and OPTIMA (Optimization for Pump-and-Treat Implementation, Management, & Assessment). These tools enhance remedy design and management by leveraging advanced computational methods – specifically deep learning and multi-objective optimization – within a user-friendly platform. By integrating data-driven models with established hydrogeological knowledge, PTOLEMY and OPTIMA enable more efficient evaluation of well placement and operational strategies, helping site managers balance multiple remediation objectives under complex conditions. Both tools are implemented as modules within the SOCRATES (Suite Of Comprehensive Rapid Analysis Tools for Environmental Sites) web platform, which provides data access, visualization, and analytics to support remedy optimization across sites in the U.S. Department of Energy Office of Environmental Management complex. PTOLEMY is a rapid screening module designed to identify promising locations for new extraction wells. It employs a multi-channel three-dimensional convolutional neural network (MC3D-CNN) trained on high-fidelity simulation data to predict the relative performance (in terms of contaminant mass recovery) of potential well sites. Through an interactive web interface, PTOLEMY visualizes the probability of high performance across a site, highlighting areas where an extraction well is likely to yield above-threshold contaminant removal over a multi-year period. PTOLEMY’s map-based displays and exportable results support transparent communication of screening analyses. By focusing attention on the most favorable candidate locations, the tool augments traditional engineering judgment and physics-based modeling, providing a data informed basis for subsequent detailed evaluations. OPTIMA is a multi objective optimization module designed to find wellfield layouts and operating schedules that meet various cleanup goals. It quickly evaluates thousands of candidate setups – combinations of well locations, timing, and rates – and returns a small set of best trade-off options for comparison. At its core, OPTIMA uses a U-Net-based surrogate model – a deep-learning emulator of a groundwater flow and transport simulator – to dramatically accelerate scenario evaluations. Coupling this fast surrogate with the NSGA-II (Non-dominated Sorting Genetic Algorithm II) evolutionary algorithm, OPTIMA explores a wide decision space of well locations and schedules to identify Pareto-optimal solutions that trade off key objectives (e.g., minimizing cleanup time, maximizing contaminant mass removal, and minimizing plume extent). The tool outputs a family of optimal configurations and visualizes their trade-offs (Pareto frontiers of cleanup metrics and maps of optimized well placements). Site managers can use these results to understand the range of viable strategies and to select candidate designs for more detailed verification. OPTIMA is currently under active development and not yet fully released; this guide provides early documentation to support planning and gather user feedback.

54 ENVIRONMENTAL SCIENCES↗

Grassmannian diffusion maps based surrogate modeling via geometric harmonics

Abstract A novel surrogate model based on the Grassmannian diffusion maps (GDMaps) and utilizing geometric harmonics (GH) is developed for predicting the response of complex physical phenomena. The method utilizes GDMaps to obtain a low‐dimensional representation of the underlying behavior of physical/mathematical systems with respect to uncertain input parameters. Using this representation, GH, an out‐of‐sample extension technique, is employed to create a global map from the input parameter space to a Grassmannian diffusion manifold. GH is further employed to locally map points on the diffusion manifold onto the tangent space of a Grassmann manifold. The exponential map is then used to project the points in the tangent space onto the Grassmann manifold, where reconstruction of the full solution is performed. The performance of the proposed surrogate model is verified with three examples. The first problem is a toy example used to illustrate the technique. In the second example, errors associated with the various mappings are assessed by studying response predictions of the electric potential of a dielectric cylinder in a homogeneous electric field. The last example applies the method for uncertainty prediction in the strain field evolution in a model amorphous material using the shear transformation zone theory of plasticity.

42 ENGINEERING↗

When and why PINNs fail to train: A neural tangent kernel perspective

Physics-informed neural networks (PINNs) have lately received great attention thanks to their flexibility in tackling a wide range of forward and inverse problems involving partial differential equations. However, despite their noticeable empirical success, little is known about how such constrained neural networks behave during their training via gradient descent. More importantly, even less is known about why such models sometimes fail to train at all. Here in this work, we aim to investigate these questions through the lens of the Neural Tangent Kernel (NTK); a kernel that captures the behavior of fully-connected neural networks in the infinite width limit during training via gradient descent. Specifically, we derive the NTK of PINNs and prove that, under appropriate conditions, it converges to a deterministic kernel that stays constant during training in the infinite-width limit. This allows us to analyze the training dynamics of PINNs through the lens of their limiting NTK and find a remarkable discrepancy in the convergence rate of the different loss components contributing to the total training error. To address this fundamental pathology, we propose a novel gradient descent algorithm that utilizes the eigenvalues of the NTK to adaptively calibrate the convergence rate of the total training error. Finally, we perform a series of numerical experiments to verify the correctness of our theory and the practical effectiveness of the proposed algorithms.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗