Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Learning Theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,567 records · Page 87

Platform Agnostic Streaming Data Application Performance Models

The mapping of computational needs onto execution resources is, by and large, a manual task, and users are frequently guided simply by intuition and past experiences. We present a queueing theory based performance model for streaming data applications that takes steps towards a better understanding of resource mapping decisions, thereby assisting application developers to make good mapping choices. The performance model (and associated cost model) are agnostic to the specific properties of the compute resource and application, simply characterizing them by their achievable data throughput. We illustrate the model with a pair of applications, one chosen from the field of computational biology and the second is a classic machine learning problem.

Faber, Clayton↗

Theory and Implementation of the Spectacular Nonlinear Viscoelastic Constitutive Model

This report is a comprehensive guide to the nonlinear viscoelastic Spectacular model, which is an isotropic, thermo-rheologically simple constitutive model for glass-forming materials, such as amorphous polymers. Spectacular is intermediate in complexity to the previous PEC and SPEC models (Potential Energy Clock and Simplified Potential Energy Clock models, respectively). The model form consists of two parts: a Helmholtz free energy functional and a nonlinear material clock that controls the rate of viscoelastic relaxation. The Helmholtz free energy is derived from a series expansion about a reference state. Expressions for the stress and entropy functionals are derived from the Helmholtz free energy following the Rational Mechanics approach. The material clock depends on a simplified expression for the potential energy, which itself is a functional of the temperature and strain histories. This report describes the thermo-mechanical theory of Spectacular, the numerical methods for time-integrating the model, model verification for its implementation in LAMÉ, a user guide for its implementation in LAMÉ, and ideas for future work. A number of appendices provide supplementary mathematical details and a description of the procedure used to derive the simplified potential energy from the full expression for the potential energy. The goal of this report is create a convenient point-of-entry for engineers who wish to learn more about Spectacular, but also to serve as a reference manual for advanced users of the model.

36 MATERIALS SCIENCE↗

Novel experimental probes of QCD in SIDIS and e + e - annihilation (Final Technical Report)

The research addressed with this award seeks to advance our understanding of the structure and dynamics underlying the properties of visible matter. In our current understanding the nucleons (protons and neutrons) are not fundamental but are comprised of quarks and gluons, which are collectively called partons. A static quark picture fails to explain the properties of the nucleons, such as their mass and intrinsic spin, which are thought to emerge dynamically from the quark-gluon interactions via the strong force. In this work, novel observables employing correlations of particles produced in the scattering of high energy electrons off protons at the CLAS12 experiment at Jefferson Lab were analyzed to probe quark-gluon interactions. The ultimate goal of this line of inquiry is to be able to describe the properties of protons and neutrons from first principles, similar to how studying the hydrogen atom has led to the formulation of the theory of Quantum Electrodynamics. Because quarks cannot be observed directly but only as part of more complex composite particles, a smaller, complimentary part of this work was the analysis of particle production in electron-positron annihilation at the Belle II experiment to understand the production of particles from initial quarks. This takes advantage of the fact that in e + e - annihilation the initial quark dynamics is known, unlike in the scattering of nucleons. Several new applications using Machine Learning algorithms for event tagging and reconstruction to support this program were developed as part of this award. In addition, we had a significant role in the development of the physics program for the future Electron-Ion Collider, which is a new collider to be build in the US within the next decade.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Stability and distortion of fcc LaH 10 with path-integral molecular dynamics

The synthesis of the high-temperature superconductor LaH 10 requires pressures in excess of 100 GPa, wherein it adopts a face-centered cubic structure. Upon decompression, this structure undergoes a distortion, which still supports superconductivity, but with a lower critical temperature. Previous calculations have shown that quantum and anharmonic effects are necessary to stabilize the cubic structure, but have not resolved the low pressure distortion. Using large scale path-integral molecular dynamics enabled by a machine learned potential, we show that a rhombohedral distortion appears at sufficiently low pressures. Here, we also highlight the importance of quantum zero-point motion in stabilizing the cubic structure.

08 HYDROGEN↗

Machine Learning Algorithm Identifies an Antibiotic Vocabulary for Permeating Gram-Negative Bacteria

Drug discovery faces a crisis. The industry has used up the “obvious” space in which to find novel drugs for biomedical applications, and productivity is declining. One strategy to combat this is rational approaches to expand the search space without relying on chemical intuition, to avoid rediscovery of similar spaces. Here, we present proof of concept of an approach to rationally identify a “chemical vocabulary” related to a specific drug activity of interest without employing known rules. We focus on the pressing concern of multidrug resistance in Pseudomonas aeruginosa by searching for submolecules that promote compound entry into this bacterium. By synergizing theory, computation, and experiment, we validate our approach, explain the molecular mechanism behind identified fragments promoting compound entry, and select candidate compounds from an external library that display good permeation ability.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Multifidelity Ensemble Kalman Filtering Using Surrogate Models Defined by Theory-Guided Autoencoders

Data assimilation is a Bayesian inference process that obtains an enhanced understanding of a physical system of interest by fusing information from an inexact physics-based model, and from noisy sparse observations of reality. The multifidelity ensemble Kalman filter (MFEnKF) recently developed by the authors combines a full-order physical model and a hierarchy of reduced order surrogate models in order to increase the computational efficiency of data assimilation. The standard MFEnKF uses linear couplings between models, and is statistically optimal in case of Gaussian probability densities. This work extends the MFEnKF into to make use of a broader class of surrogate model such as those based on machine learning methods such as autoencoders non-linear couplings in between the model hierarchies. We identify the right-invertibility property for autoencoders as being a key predictor of success in the forecasting power of autoencoder-based reduced order models. We propose a methodology that allows us to construct reduced order surrogate models that are more accurate than the ones obtained via conventional linear methods. Numerical experiments with the canonical Lorenz'96 model illustrate that nonlinear surrogates perform better than linear projection-based ones in the context of multifidelity ensemble Kalman filtering. We additionality show a large-scale proof-of-concept result with the quasi-geostrophic equations, showing the competitiveness of the method with a traditional reduced order model-based MFEnKF.

97 MATHEMATICS AND COMPUTING↗

17 O NMR Spectroscopy Reveals CO 2 Speciation and Dynamics in Hydroxide-Based Carbon Capture Materials

Carbon dioxide capture technologies are set to play a vital role in mitigating the current climate crisis. Solid-state 17 O NMR spectroscopy can provide key mechanistic insights that are crucial to effective sorbent development. In this work, we present the fundamental aspects and complexities for the study of hydroxide-based CO 2 capture systems by 17 O NMR. We perform static density functional theory (DFT) NMR calculations to assign peaks for general hydroxide CO 2 capture products, finding that 17 O NMR can readily distinguish bicarbonate, carbonate and water species. However, in application to CO 2 binding in two test case hydroxide-functionalised metal-organic frameworks (MOFs) – MFU-4l and KHCO 3 -cyclodextrin-MOF, we find that a dynamic treatment is necessary to obtain agreement between computational and experimental spectra. We therefore introduce a workflow that leverages machine-learning force fields to capture dynamics across multiple chemical exchange regimes, providing a significant improvement on static DFT predictions. In MFU-4l, we parameterise a two-component dynamic motion of the bicarbonate motif involving a rapid carbonyl seesaw motion and intermediate hydroxyl proton hopping. For KHCO 3 -CD-MOF, we combined experimental and modelling approaches to propose a new mixed carbonate-bicarbonate binding mechanism and thus, we open new avenues for the study and modelling of hydroxide-based CO 2 capture materials by 17 O NMR.

NMR spectroscopy↗

How the birth and death of shear layers determine confinement evolution: from the L → H transition to the density limit

Electric field profile structure—especially its shear—is a natural order parameter for the edge plasma, and characterizes confinement regimes ranging from the H-mode (Wagner et al. 1982 Phys. Rev. Lett.49, 1408–1412 (doi:10.1103/PhysRevLett.49.1408)) to the density limit (DL) (Greenwald et al. 1988 Nucl. Fusion28, 2199–2207 (doi:10.1088/0029-5515/28/12/009)). The theoretical developments and lessons learned during 40 years of H-mode studies (Connor & Wilson 1999 Plasma Phys. Control. Fusion42, R1–R74 (doi:10.1088/0741-3335/42/1/201); Wagner 2007 Plasma Phys. Control. Fusion49, B1–B33 (doi:10.1088/0741-3335/49/12b/s01)) are applied to the shear layer collapse paradigm (Hong et al. 2017 Nucl. Fusion58, 016041 (doi:10.1088/1741-4326/aa9626)) for the onset of DL phenomena. Results from recent experiments on edge shear layers and DL phenomenology are summarized and discussed in the light of L → H transition physics. The theory of shear layer collapse is then developed. In this work, we demonstrate that shear layer physics captures both the well known current (Greenwald) scaling of the DL (Greenwald 2002 Plasma Phys. Control. Fusion44, R27–R53 (doi:10.1088/0741-3335/44/8/201); Greenwald et al. 2014 Phys. Plasmas21, 110501 (doi:10.1063/1.4901920)), as well as the emerging power scaling (Zanca, Sattin, JET Contributors 2019 Nucl. Fusion59, 126011 (doi:10.1088/1741-4326/ab3b31)). The derivation of the power scaling theory exploits an existing model, originally developed for the L → H transition (Diamond, Liang, Carreras, Terry 1994 Phys. Rev. Lett.72, 2565–2568 (doi:10.1103/PhysRevLett.72.2565); Kim & Diamond 2003 Phys. Rev. Lett.90, 185006 (doi:10.1103/PhysRevLett.90.185006)). We describe the enhanced particle transport events that occur following shear layer collapse. Open problems and future directions are discussed.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Attention theory and training research

This study used elements of attention theory as a methodological basis to decompose a complex training task in order to improve training efficiency. The complex task was a microcomputer flight simulation where subjects were required to control the stability of their own helicopter while acquiring and engaging enemy helicopers in a threat enviroment. Subjects were divided into whole-task, part-task, and part/open loop adaptive task groups in a transfer of training paradigm. The effect of reducing mental workload at the early stages of learning was examined with respect to the degree that subordinate elements of the complex task could be automated through practice of consistent, learnable stimulus-response relationships. Results revealed trends suggesting the benefit of isolating consistently mapped sub-tasks for part-task training and the presence of a time-sharing skill over and above the skill required for the separate subtasks.

Connelly, James G., Jr.↗

Depletion-Driven Assembly of Polymer-Coated Nanocrystals

Depletion-driven assembly has been widely studied for micron-sized colloids, but questions remain at the nanoscale where the governing physics are impacted by stabilizing surface ligands or wrapping polymers, whose dimensions are similar to those of the colloidal core and the depletant. Here, we probe how wrapping colloidal tin-doped indium oxide nanocrystals with polymers affects their depletion-induced interactions and assembly in solutions of polyethylene glycol. Copolymers of polyacrylic acid grafted with polyethylene oxide provide nanocrystal wrappings with different effective polymer graft densities and molecular weights. (Ultra) small angle X-ray scattering, coarse-grained molecular dynamics simulation, and molecular thermodynamic theory were combined to analyze how depletant size and polymer wrapping characteristics affect depletion interactions, structure, and phase behavior. The results show how depletant molecular weight, as well as surface density and molecular weight of polymer grafts, set thresholds for assembly. These signatures are unique to depletion-driven assembly of nanoscale colloids and mirror phase behaviors of grafted nanoparticle–polymer composites. Optical and rheological responses of depletion-driven assemblies of nanocrystals with different polymer shell architectures were probed to learn how their structural differences impact properties. Finally, we discuss how these wrinkles for depletion-driven assembly at the nanoscale may provide fresh opportunities for designing responsive depletion interactions and dynamically reconfigurable materials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Deep Bayesian local crystallography

Abstract The advent of high-resolution electron and scanning probe microscopy imaging has opened the floodgates for acquiring atomically resolved images of bulk materials, 2D materials, and surfaces. This plethora of data contains an immense volume of information on materials structures, structural distortions, and physical functionalities. Harnessing this knowledge regarding local physical phenomena necessitates the development of the mathematical frameworks for extraction of relevant information. However, the analysis of atomically resolved images is often based on the adaptation of concepts from macroscopic physics, notably translational and point group symmetries and symmetry lowering phenomena. Here, we explore the bottom-up definition of structural units and symmetry in atomically resolved data using a Bayesian framework. We demonstrate the need for a Bayesian definition of symmetry using a simple toy model and demonstrate how this definition can be extended to the experimental data using deep learning networks in a Bayesian setting, namely rotationally invariant variational autoencoders.

36 MATERIALS SCIENCE↗

Visual language recognition with a feed-forward network of spiking neurons

An analogy is made and exploited between the recognition of visual objects and language parsing. A subset of regular languages is used to define a one-dimensional 'visual' language, in which the words are translational and scale invariant. This allows an exploration of the viewpoint invariant languages that can be solved by a network of concurrent, hierarchically connected processors. A language family is defined that is hierarchically tiling system recognizable (HREC). As inspired by nature, an algorithm is presented that constructs a cellular automaton that recognizes strings from a language in the HREC family. It is demonstrated how a language recognizer can be implemented from the cellular automaton using a feed-forward network of spiking neurons. This parser recognizes fixed-length strings from the language in parallel and as the computation is pipelined, a new string can be parsed in each new interval of time. The analogy with formal language theory allows inferences to be drawn regarding what class of objects can be recognized by visual cortex operating in purely feed-forward fashion and what class of objects requires a more complicated network architecture.

99 GENERAL AND MISCELLANEOUS↗

Graph Learning in Knowledge Bases

The amount of text data has been growing exponentially in recent years, giving rise to automatic information extraction methods that store text annotations in a database. The current state-of-theart structured prediction methods, however, are likely to contain errors and it’s important to be able to manage the overall uncertainty of the database. On the other hand, the advent of crowdsourcing has enabled humans to aid machine algorithms at scale. As part of this project we introduced pi-CASTLE , a system that optimizes and integrates human and machine computing as applied to a complex structured prediction problem involving conditional random fields (CRFs). We proposed strategies grounded in information theory to select a token subset, formulate questions for the crowd to label, and integrate these labelings back into the database using a method of constrained inference. On both a text segmentation task over academic citations and a named entity recognition task over tweets we showed an order of magnitude improvement in accuracy gain over baseline methods.

97 MATHEMATICS AND COMPUTING↗

From Theory to Large-Scale Simulations, or Living Without “The Paradox of Choice”

Navigating the challenges we face at work and in life is often difficult, and can even make us question our past decisions. This dilemma is even worse nowadays because of the many options available to us, leaving us not enough time to explore them all: the paradox of choice. My life experience offers another perspective on how to make choices; wherein I had to rely more on serendipity, coincidence, and embracing risks. This paper presents a brief description of my career path in space science—from a small village in the countryside to one of the top science Laboratories in the world—and lessons learned through the process of becoming a more resilient scientist. I came to the United States from Bulgaria about 30 years ago, seeking a better education and job opportunities. Navigating a career of research scientist, not only did I find jobs that motivated me every day, I also met amazing people to work with along the way. As a woman in science, I hope my story can inspire and attract young researchers (girls and boys alike) to our community, helping to grow and diversify the next generation of space scientists.

99 GENERAL AND MISCELLANEOUS↗

Accelerated Discovery of Large Electrostrains in BaTiO 3 ‐Based Piezoelectrics Using Active Learning

Abstract A key challenge in guiding experiments toward materials with desired properties is to effectively navigate the vast search space comprising the chemistry and structure of allowed compounds. Here, it is shown how the use of machine learning coupled to optimization methods can accelerate the discovery of new Pb‐free BaTiO 3 (BTO‐) based piezoelectrics with large electrostrains. By experimentally comparing several design strategies, it is shown that the approach balancing the trade‐off between exploration (using uncertainties) and exploitation (using only model predictions) gives the optimal criterion leading to the synthesis of the piezoelectric (Ba 0.84 Ca 0.16 )(Ti 0.90 Zr 0.07 Sn 0.03 )O 3 with the largest electrostrain of 0.23% in the BTO family. Using Landau theory and insights from density functional theory, it is uncovered that the observed large electrostrain is due to the presence of Sn, which allows for the ease of switching of tetragonal domains under an electric field.

Yuan, Ruihao↗

Trust-Enhancing Probabilistic Transfer Learning for Sparse and Noisy Data Environments

There is an increasing aspiration to utilize machine learning (ML) for various tasks of relevance to national security. ML models have thus far been mostly applied to tasks and domains that, while impactful, have sufficient volume of data. For predictive tasks of national security relevance, ML models of great capacity (ability to approximate nonlinear trends in input-output maps) are often needed to capture the complex underlying physics. However, scientific problems of relevance to national security are often accompanied by various sources of sparse and/or incomplete data, including experiments and simulations, across different regimes of operation, of varying degrees of fidelity, and include noise with different characteristics and/or intensity. State-of-the-art ML models, despite exhibiting superior performance on the task and domain they were trained on, may suffer detrimental loss in performance in such sparse data environments. This report summarizes the results of the Laboratory Directed Research and Development project entitled Trust-Enhancing Probabilistic Transfer Learning for Sparse and Noisy Data Environments. The objective of the project was to develop a new transfer learning (TL) framework that aims to adaptively blend the data across different sources in tackling one task of interest, resulting in enhanced trustworthiness of ML models for mission- and safety-critical systems. The proposed framework determines when it is worth applying TL and how much knowledge is to be transferred, despite uncontrollable uncertainties. The framework accomplishes this by leveraging concepts and techniques from the fields of Bayesian inverse modeling and uncertainty quantification, relying on strong mathematical foundations of probability and measure theories to devise new uncertainty-aware TL workflows.

97 MATHEMATICS AND COMPUTING↗

Simulating Activities: Relating Motives, Deliberation and Attentive Coordination

Activities are located behaviors, taking time, conceived as socially meaningful, and usually involving interaction with tools and the environment. In modeling human cognition as a form of problem solving (goal-directed search and operator sequencing), cognitive science researchers have not adequately studied "off-task" activities (e.g., waiting), non-intellectual motives (e.g., hunger), sustaining a goal state (e.g., playful interaction), and coupled perceptual-motor dynamics (e.g., following someone). These aspects of human behavior have been considered in bits and pieces in past research, identified as scripts, human factors, behavior settings, ensemble, flow experience, and situated action. More broadly, activity theory provides a comprehensive framework relating motives, goals, and operations. This paper ties these ideas together, using examples from work life in a Canadian High Arctic research station. The emphasis is on simulating human behavior as it naturally occurs, such that "working" is understood as an aspect of living. The result is a synthesis of previously unrelated analytic perspectives and a broader appreciation of the nature of human cognition. Simulating activities in this comprehensive way is useful for understanding work practice, promoting learning, and designing better tools, including human-robot systems.

Clancey, William J.↗

Computational Advances in Ionic Liquid Applications for Green Chemistry: A Critical Review of Lignin Processing and Machine Learning Approaches

The valorization and dissolution of lignin using ionic liquids (ILs) is critical for developing sustainable biorefineries and a circular bioeconomy. This review aims to critically assess the current state of computational and machine learning methods for understanding and optimizing IL-based lignin dissolution and valorization processes reported since 2022. The paper examines various computational approaches, from quantum chemistry to machine learning, highlighting their strengths, limitations, and recent advances in predicting and optimizing lignin-IL interactions. Key themes include the challenges in accurately modeling lignin’s complex structure, the development of efficient screening methodologies for ionic liquids to enhance lignin dissolution and valorization processes, and the integration of machine learning with quantum calculations. These computational advances will drive progress in IL-based lignin valorization by providing deeper molecular-level insights and facilitating the rapid screening of novel IL-lignin systems.

09 BIOMASS FUELS↗