Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Learning theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,099 records · Page 61

Ductility mechanisms in complex concentrated refractory alloys from atomistic fracture simulations

The striking variation in damage tolerance among refractory complex concentrated alloys is examined through the analysis of atomistic fracture simulations, contrasting behavior in elemental Nb with that in brittle NbMoTaW and ductile Nb45Ta25Ti15Hf15. We employ machine-learning interatomic potentials (MLIPs), including a new MLIP developed for NbTaTiHf, in atomistic simulations of crack tip extension mechanisms based on analyses of atomistic fracture resistance curves. While the initial behavior of sharp cracks shows good correspondence with the Rice theory, fracture resistance curves reveal marked changes in fracture modes for the complex alloys as crack extension proceeds. In NbMoTaW, compositional complexity appears to promote dislocation nucleation relative to pure Nb, despite theoretical predictions that the alloy should be relatively more brittle. In Nb45Ta25Ti15Hf15, alloying alters the fracture mode compared to elemental Nb, promoting crack tip blunting and enhancing resistance to crack propagation.

Computational methods↗

Accurate numerical simulations of open quantum systems using spectral tensor trains

Decoherence between qubits is a major bottleneck in quantum computations. Decoherence results from intrinsic quantum and thermal fluctuations as well as noise in the external fields that perform the measurement and preparation processes. With prescribed colored noise spectra for intrinsic and extrinsic noise, we present a numerical method, Quantum Accelerated Stochastic Propagator Evaluation (Q-ASPEN), to solve the time-dependent noise-averaged reduced density matrix in the presence of intrinsic and extrinsic noise. Q-ASPEN is arbitrarily accurate and can be applied to provide estimates for the resources needed to error-correct quantum computations. We employ spectral tensor trains, which combine the advantages of tensor networks and pseudospectral methods, as a variational ansatz to the quantum relaxation problem and optimize the ansatz using methods typically used to train neural networks. Here, the spectral tensor trains in Q-ASPEN make accurate calculations with tens of quantum levels feasible. We present benchmarks for Q-ASPEN on the spin-boson model in the presence of intrinsic noise and on a quantum chain of up to 32 sites in the presence of extrinsic noise. In our benchmark, the memory cost of Q-ASPEN scales as a low-order polynomial in the size of the system once the number of system states surpasses the number of basis functions used in the spectral expansion.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Multistage nucleation pathway in LiF molten salt mirrors the crystal–melt interface structure

Despite over a century of studies, fundamental questions remain about the processes governing crystal nucleation from melts or solutions. Research over the past three decades has presented mounting evidence for kinetic pathways of crystal nucleation that are more complex than envisioned by the simplest forms of classical theory. Such observations have been presented for colloidal and elemental systems with covalent and metallic bonding. Despite the technological and geochemical importance of molten salts, similar studies for these ionically bonded systems are currently lacking. Here we develop a machine learning interatomic potential for a model ionic system: LiF. The potential features quantum-level accuracy for both liquid and multiple solid polymorphs over wide temperature and pressure ranges and accurately reproduces experimentally measured properties. Thanks to the efficiency of the potential, which enables microsecond-scale molecular dynamics simulations, induction times for nucleation of LiF solids from their melts are computed over a range of undercoolings. With the aid of a set of robust local order parameters established here, the simulations reveal that homogeneous crystal nucleation in undercooled melts preferentially initiates from liquid regions showing slow dynamics and high bond orientational order simultaneously, and the second-shell order of both precritical nuclei and the surface of postcritical nuclei is dominated by hexagonal close packing and body-centered cubic local structure, even though the nucleus core is dominated by face-centered cubic structure corresponding to the stable rocksalt crystal structure. Finally, we establish a connection between the crystallization pathway and the equilibrium crystal-melt interface structure.

Applied Physical Sciences↗

Synthesis of motif and symmetry for accelerated learning, discovery, and design of electronic structures for energy conversion applications (Final Technical Report)

The overall goal of the projects is to develop a framework to incorporate structure motifs and crystal/orbital symmetries into the data-driven materials discovery infrastructure. The PI proposed to develop structure-motif- and symmetry-based graph convolutional networks for effective learning and efficient predictions of electronic structures and related properties. Fundamental understanding of the roles of structure motif and symmetry will establish new hypothesis and design rules, which will be combined with high-throughput computations based on density functional theory to discover novel light absorbers, transparent conductors, as well as 2D light emitting materials and heterojunctions for optoelectronics.

36 MATERIALS SCIENCE↗

Strong Correlation DMRG and DFT

This project developed new ways to improve computer simulations of materials where electrons interact strongly with each other, a challenge for today’s most widely used method, density functional theory (DFT). We used an exact numerical method, the density matrix renormalization group (DMRG), to create highly accurate reference results for simple model systems, and used these to test DFT, prove when it will converge, and even train machine-learned functionals. We also invented new kinds of localized basis functions (“gausslets” and “multi-sliced gausslets”) and a “sliced-basis” approach that make high-accuracy simulations faster and more practical. These methods were applied to extended hydrogen systems, enabling the direct derivation of accurate low-energy models from first-principles calculations. We also introduced a new formalism, Conditional-Probability DFT, which could bypass traditional approximations. The tools and results from this work, including open-source software releases, will help scientists design and understand complex quantum materials.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Mueller-Lyer decrement: practice or prolonged inspection?

Noting the similarity between the illusion decrement and selective adaptation paradigms, Long has challenged the view that illusion decrement effects reflect a strategic--as opposed to a structural--underlying mechanism, and has called for further research on this issue. To investigate the confound between prolonged free inspection and repeated trials in the standard decrement procedure, the effects of three inspection conditions (continuous, intermittent, and immediate) on the magnitude of the overestimation Mueller-Lyer illusion have been assessed under two levels of trials (a total of two or six judgments). Significant illusion decline was found only under conditions of repeated trials, with either continuous or intermittent inspection. These findings do not support the predictions of purely structural theories (including neural adaptation and efferent readiness theories), according to which degree of decrement should be determined solely by viewing time. Instead, the data demonstrate that illusion decrement is a product of practice, providing converging evidence for the view of decrement as involving a cognitive 'recalibration' or learning process.

Form Perception↗

Integrating Machine Learning Potential and X-ray Absorption Spectroscopy for Predicting the Chemical Speciation of Disordered Carbon Nitrides

Precise determination of atomic structural information in functional materials holds transformative potential and broad implications for emerging technologies. Spectroscopic techniques, such as X-ray absorption near-edge structure (XANES), have been widely used for material characterization; however, extracting chemical information from experimental probes remains a significant challenge, particularly for disordered materials. We present an integrated approach that combines atomic simulations, data-driven techniques, and experimental measurements to investigate chemical speciation of amorphous carbon nitride systems as a case study. Here, we discuss the development of machine learning potentials that can efficiently explore the vast configuration space of amorphous carbon nitrides. By employing statistical methods, this structural database enables the elucidation of the most representative local structures and how they evolve with chemical compositions and density. Density functional theory simulations are used to establish a correlation between the local structure and spectroscopic signatures, which then serve as the basis for interpreting and extracting chemical content from experimental data. Although our framework is specifically demonstrated for XANES and carbon nitrides, the approach described herein is readily adaptable as applied to other experimental characterization probes and materials classes.

36 MATERIALS SCIENCE↗

From minimum-viable-products to full models: a step-wise development of diagnostic forward models in support of design, analysis and modelling on the ST40 tokamak

Like most magnetic confined fusion experiments, the ST40 tokamak started off with a small subset of diagnostics and gradually increased the diagnostic set to include more complex and comprehensive systems. To make the most of each operational phase, forward models of various diagnostics are used and developed to aid design, provide consistency-checks during commissioning, test analysis methods, and build workflows to constrain high-level parameters to inform interpretation, theory and modelling. For new models and new analysis workflows, minimum-viable-products are released early, and their complexity is increased in a step-wise manner, facilitating the support of all programme phases on multiple parallel applications, while enabling learning opportunities and feedback loops. In this contribution we review the philosophy, scope and architecture of the framework under development. We discuss the details of some forward models, with examples on how they are used to aid diagnostic design, to investigate analysis methodologies through synthetic data, and how they are embedded in experimental analysis workflows. We compare previously published experimental results with new, more advanced analysis workflows employing more recent, detailed models and new diagnostic data, providing confirmation of the published material from the 2021–22 experimental campaign.

integrated data analysis↗

Delta Scuti stars: Theory

The purpose of asteroseismology is not only to derive the internal structure of individual stars from their observed oscillation frequencies, but also to test and extend one's understanding of the physics of matter under the extremes of temperature, density, and pressure found in stellar interiors. In this review, the author hopes to point out what one can learn about the Sun by studying (delta) Scuti stars, as well as what one can learn about stars more massive or evolved than the Sun. He discusses some of the difficulties in theoretical approaches to asteroseismology for (delta) Scuti stars, using FG Vir, (delta) Scuti, and CD-24(degree) 7599 as examples.

Guzik, J. A.↗

Nuclear Theory from First Principles to Forefront Experiments (Final Report for DE-SC0018638)

The Lee research group is a part of the Nuclear Lattice Effective Field Theory Collaboration, which has developed and performed ab initio lattice simulations of nuclear structure, scattering, reactions, and many-body systems. The other senior members of the collaboration include Ulf-G. Meißner at Bonn/Julich, Evgeny Epelbaum and Hermann Krebs at Bochum, Timo Lahde and Thomas Luu at Julich, and Gautam Rupak at Mississippi State. Our letter “Ab initio alpha-alpha scattering” was featured in a Nature News and Views article. Another letter “Nuclear binding near a quantum phase transition” was highlighted in a Viewpoint article in the online APS journal Physics as well as a news article in the IOP publication Physics World (September 21, 2016). Our letter “Eigenvector continuation with subspace learning” was also highlighted a Synopsis article in Physics. There are many promising ab initio approaches being used to calculate the properties of few-and many-nucleon systems. This includes the no-core shell model, symmetry-adapted no-core shell model quantum Monte Carlo, auxiliary-field diffusion Monte Carlo, self-consistent Green’s functions, many-body perturbation theory, in-medium similarity renormalization group, and coupled cluster methods. Lattice effective field theory is another ab initio approach which combines the framework of effective field theory with lattice Monte Carlo methods to allow favorable scaling from few- to many-body systems. Perhaps the most important aspect of lattice effective field theory is that its strengths and weaknesses are orthogonal to that of other ab initio methods. For example, lattice effective field theory has little difficulty in probing cluster structures and collectivity, while such features are much more difficult using other methods. Furthermore it can be used to compute superfluid condensate fractions as well as the phase diagram of strongly matter and the density and temperature dependence of clustering. Lattice effective field theory was first used in simulations of infinite nuclear matter and infinite neutron matter with pions and without pions. In addition to the efforts by our collaboration, there have been recent efforts by other groups as well.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Mathematical nuances of Gaussian process-driven autonomous experimentation

Abstract The fields of machine learning (ML) and artificial intelligence (AI) have transformed almost every aspect of science and engineering. The excitement for AI/ML methods is in large part due to their perceived novelty, as compared to traditional methods of statistics, computation, and applied mathematics. But clearly, all methods in ML have their foundations in mathematical theories, such as function approximation, uncertainty quantification, and function optimization. Autonomous experimentation is no exception; it is often formulated as a chain of off-the-shelf tools, organized in a closed loop, without emphasis on the intricacies of each algorithm involved. The uncomfortable truth is that the success of any ML endeavor, and this includes autonomous experimentation, strongly depends on the sophistication of the underlying mathematical methods and software that have to allow for enough flexibility to consider functions that are in agreement with particular physical theories. We have observed that standard off-the-shelf tools, used by many in the applied ML community, often hide the underlying complexities and therefore perform poorly. In this paper, we want to give a perspective on the intricate connections between mathematics and ML, with a focus on Gaussian process-driven autonomous experimentation. Although the Gaussian process is a powerful mathematical concept, it has to be implemented and customized correctly for optimal performance. We present several simple toy problems to explore these nuances and highlight the importance of mathematical and statistical rigor in autonomous experimentation and ML. One key takeaway is that ML is not, as many had hoped, a set of agnostic plug-and-play solvers for everyday scientific problems, but instead needs expertise and mastery to be applied successfully. Graphical abstract

97 MATHEMATICS AND COMPUTING↗

Machine learning a molecular Hamiltonian for predicting electron dynamics

We develop a computational method to learn a molecular Hamiltonian matrix from matrix-valued time series of the electron density. As we demonstrate for three small molecules, the resulting Hamiltonians can be used for electron density evolution, producing highly accurate results even when propagating 1,000 time steps beyond the training data. As a more rigorous test, we use the learned Hamiltonians to simulate electron dynamics in the presence of an applied electric field, extrapolating to a problem that is beyond the field-free training data. We find that the resulting electron dynamics predicted by our learned Hamiltonian are in close quantitative agreement with the ground truth. Our method relies on combining a reduced-dimensional, linear statistical model of the Hamiltonian with a time-discretization of the quantum Liouville equation within time-dependent Hartree Fock theory. In conclusion, we train the model using a least-squares solver, avoiding numerous, CPU-intensive optimization steps. For both field-free and field-on problems, we quantify training and propagation errors, highlighting areas for future development.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Session Introduction: Graph Representations and Algorithms in Biomedicine

Connectivity is a fundamental property of biological systems: on the cellular level, proteins interact with each other to form protein-protein interaction networks (PPIs); on the organism level, neurons are arranged in a network; and on a community-level, species can have complex relationships with one another that drive the development and balance of an ecosystem. Graphs, representations of systems consisting of entities as vertices and their connections as edges, are a useful structure to characterize many such systems. Such models can be used to understand biological systems that naturally have a network structure, including PPIs, biological neurons, and ecosystems. In today’s information age, graph representations and algorithms (often in combination with machine learning techniques) are used to organize massive amounts of related data, much of which may be heterogeneous or unstructured, and identify patterns that represent novel biological insights. PSB’s 2023 session “Graph Representations and algorithms in Biomedicine,” encompasses modern developments in graph theory and its applications to various fields of biomedicine. This session includes a wide range of research - knowledge graphs built from text-mined health data, heterogeneous networks using multi-omic databases, and graphs refined to represent uncertainty or improve memory usage.

Chrisman, Brianna S.↗

Sparse distributed memory

Theoretical models of the human brain and proposed neural-network computers are developed analytically. Chapters are devoted to the mathematical foundations, background material from computer science, the theory of idealized neurons, neurons as address decoders, and the search of memory for the best match. Consideration is given to sparse memory, distributed storage, the storage and retrieval of sequences, the construction of distributed memory, and the organization of an autonomous learning system.

Kanerva, Pentti↗

Machine learning enabled discovery of application dependent design principles for two-dimensional materials

Abstract The unique electronic and mechanical properties of two-dimensional (2D) materials make them promising next-generation candidates for a variety of applications. Large-scale searches for high-performing 2D materials are limited to calculating descriptors with computationally demanding first-principles density functional theory. In this work, we alleviate this issue by extending and generalizing crystal graph convolutional neural networks to systems with planar periodicity and train an ensemble of models to predict thermodynamic, mechanical and electronic properties. We carry out a screening of nearly 45,000 structures for two separate applications: mechanical strength and photovoltaics. By collecting statistics of the screened candidates, we investigate structural and compositional design principles that impact the properties of the structures surveyed. Our approach recovers some well-accepted design rules: hybrid organic-inorganic perovskites with lead and tin tend to be good candidates for solar cell applications and titanium based MXenes usually have high stiffness coefficients. Interestingly, other members of the group 4 elements also contribute to increasing the mechanical strength of MXenes. For all-inorganic perovskites, we discover some compositions that have not been deeply studied in the field of photovoltaics and thus open up paths for further investigation. We open-source the code-base to spur further development in this space.

Venturi, Victor (ORCID:0000000156727549)↗

Toward equitable environmental exposure modeling through convergence of data, open, and citizen sciences: an example of air pollution exposure modeling amidst increasing wildfire smoke

Exposure modeling is critical in environmental epidemiology and human health but may face challenges (e.g., skewed data, unequal error, context-insensitive validation, and computational demands). Modeling decisions reflect the intended use of the models and the values that modelers prioritize. We aimed to provide a conceptual framework and machine learning (ML) modeling protocols that address these issues. With 500m-gridded hourly PM 2.5 and O 3 levels in Illinois before, during, and after the 2023 Canadian wildfire season as a motivating example, we conducted modeling experiments to evaluate modeling methods, guided by three domains we propose based on theories of science: 1) Data Diversity, leveraging open and citizen science data to enhance inclusivity, parsimony, and representativeness; 2) Equitable Accuracy, ensuring fairly distributed uncertainties across subpopulations; and 3) Sustainable Modeling, balancing accuracy with reducing computational demands to promote accessibility for under-resourced researchers. Here, we found that ML with publicly available data can achieve high accuracy. Depending on methods, performance may vary substantially, even with identical input data. Large but skewed data may reduce performance. Misuse of cross-validation protocols can underestimate prediction error; although we observed R 2 s of ∼98 %, the modeled estimates varied significantly, indicating the need for careful model validation. By using new modeling protocols including representativeness-considered training and validation data and a new loss function, we achieved high agreement between estimates and ground-based measurements (e.g., R 2 = ∼90 % for PM 2.5 ; ∼80 % for O 3 ), equally distributed errors across sociodemographic strata and urban–rural divides, and reduction in computation time—from several weeks or months to a few days.

Exposure assessment↗