Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Learning Theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,441 records · Page 80

Factors Impacting Nuclear Energy Share in U.S. Energy Markets

The purpose of this report is to collate information and findings from recent studies conducted by national and international bodies/institutes to identify approaches for maintaining/enhancing the role of nuclear energy in the current and future energy mix of the United States. This report shows how nuclear generation grew quickly to provide 20% of U.S. electricity, sustaining that level for three decades without the benefit of new construction, but is now projected to decline going forward. Nuclear construction costs in the U.S. spiraled out of control, ending construction for two decades and the recent resumption of construction has continued the pattern of schedule delays and cost overruns. However, nuclear operations exhibited strong learning, achieving and sustaining the highest capacity factor of any electricity generation technology and license extensions and uprates have sustained nuclear market share. The share of nuclear energy in the U.S. electricity market is projected to decline by ~1/3rd over the next 30 years The report provides an overview of how the markets work in theory and in practice. It indicates how market deregulation and clean energy policies have created conditions where nuclear plants are being retired for economic rather than technical reasons. The report also shows how many of the markets do not in practice have free competition but instead have outcomes that are being determined more and more by policy instead of market forces. While electricity costs from existing nuclear plants are low, electricity from new builds is projected to be too expensive to be competitive head-to-head with natural gas, even for nth-of-a-kind costs. Wind and solar energy have enjoyed an extended period of sustained subsidy. This protected environment has resulted in a sustained reduction in plant level costs to the point that some of these Variable Renewable Energy (VRE) technologies are becoming competitive even if their direct subsidies are removed. But plant level costs underestimate total VRE costs which include a number of system-level externalities. The incremental system value of additional VRE capacity was shown to decline as market share increases, with solar value declining more quickly than wind. The report closes with examination of a possible future for nuclear generation as part of deep decarbonization of the electricity sector. This approach avoids direct competition with natural gas. The two options for achieving 100% decarbonization are to use only renewables or to use all zero emissions technologies, and the report shows the second approach is much less expensive than the first.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Using Technology to Better Characterize the Apollo Sample Suite: A Retroactive PET Analysis and Potential Model for Future Sample Return Missions

From 1969-1972 the Apollo missions collected 382 kg of lunar samples from six distinct locations on the Moon. Studies of the Apollo sample suite have shaped our understanding of the formation and early evolution of the Earth-Moon system, and have had important implications for studies of the other terrestrial planets (e.g., through the calibration of the crater counting record) and even the outer planets (e.g., the Nice model of the dynamical evolution of the Solar System). Despite nearly 50 years of detailed research on Apollo samples, scientists are still developing new theories about the origin and evolution of the Moon. Three areas of active research are: (1) the abundance of water (and other volatiles) in the lunar mantle, (2) the timing of the formation of the Moon and the duration of lunar magma ocean crystallization, (3) the formation of evolved lunar lithologies (e.g., granites) and implications for tertiary crustal processes on the Moon. In order to fully understand these (and many other) theories about the Moon, scientists need access to "new" lunar samples, particularly new plutonic samples. Over 100 lunar meteorites have been identified over the past 30 years, and the study of these samples has greatly aided in our understanding of the Moon. However, terrestrial alteration and the lack of geologic context limit what can be learned from the lunar meteorites. Although no "new" large plutonic samples (i.e., hand-samples) remain to be discovered in the Apollo sample collection, there are many large polymict breccias in the Apollo collection containing relatively large (approximately 1 cm or larger) previously identified plutonic clasts, as well as a large number of unclassified lithic clasts. In addition, new, previously unidentified plutonic clasts are potentially discoverable within these breccias. The question becomes how to non-destructively locate and identify new lithic clasts of interest while minimizing the contamination and physical degradation of the samples.

Zeigler, R. A.↗

Enhancing Drinking Water Quality Modeling: Leveraging Physics Informed Neural Networks for Learning with Imperfect Reaction Models and Partial Data

Chemical kinetics models, typically formulated as systems of ordinary or partial differential equations, are valuable tools for simulating drinking water quality. However, these models often face inaccuracies due to discrepancies between the laboratory and the real-world conditions, as well as limitations in experimental analytical methods, hindering the accurate representation of the true underlying chemical mechanisms. In this study, we propose a Physics Informed Neural Network (PINN), using the eXtreme Theory of Functional Connections, to improve the prediction of chemical concentrations over time. The PINN method accounts for imperfect chemical models and incorporates partial data to improve predictions. Focusing on reactions describing water disinfection residual and disinfectant byproduct formation, which are crucial for public health and regulatory compliance, we demonstrate that the PINN model is able to accurately predict the concentrations of chemical species across various pH values. Notably, the model extends its accuracy to predict concentrations of chemical species not originally included in its training data. The developed method can be extended to a variety of chemical systems, offering a wide array of potential applications.

13 HYDRO ENERGY↗

Accuracy, transferability, and computational efficiency of interatomic potentials for simulations of carbon under extreme conditions

Large-scale atomistic molecular dynamics (MD) simulations provide an exceptional opportunity to advance the fundamental understanding of carbon under extreme conditions of high pressures and temperatures. However, the fidelity of these simulations depends heavily on the accuracy of classical interatomic potentials governing the dynamics of many-atom systems. Here, this study critically assesses several popular empirical potentials for carbon, as well as machine learning interatomic potentials (MLIPs), in their ability to simulate a range of physical properties at high pressures and temperatures, including the diamond equation of state, its melting line, shock Hugoniot, uniaxial compressions, and the structure of liquid carbon. Empirical potentials fail to accurately predict the behavior of carbon under high pressure–temperature conditions. In contrast, MLIPs demonstrate quantum accuracy, with Spectral Neighbor Analysis Potential (SNAP) and atomic cluster expansion (ACE) being the most accurate in reproducing the density functional theory results. ACE displays remarkable transferability despite not being specifically trained for extreme conditions. Furthermore, ACE and SNAP exhibit superior computational performance on graphics processing unit-based systems in billion atom MD simulations, with SNAP emerging as the fastest. In addition to offering practical guidance in selecting an interatomic potential with a fine balance of accuracy, transferability, and computational efficiency, this work also highlights transformative opportunities for groundbreaking scientific discoveries facilitated by quantum-accurate MD simulations with MLIPs on emerging exascale supercomputers.

36 MATERIALS SCIENCE↗

Tracking the topology of neural manifolds across populations

Neural manifolds summarize the intrinsic structure of the information encoded by a population of neurons. Advances in experimental techniques have made simultaneous recordings from multiple brain regions increasingly commonplace, raising the possibility of studying how these manifolds relate across populations. However, when the manifolds are nonlinear and possibly code for multiple unknown variables, it is challenging to extract robust and falsifiable information about their relationships. We introduce a framework, called the method of analogous cycles, for matching topological features of neural manifolds using only observed dissimilarity matrices within and between neural populations. We demonstrate via analysis of simulations and in vivo experimental data that this method can be used to correctly identify multiple shared circular coordinate systems across both stimuli and inferred neural manifolds. Conversely, the method rejects matching features that are not intrinsic to one of the systems. Further, as this method is deterministic and does not rely on dimensionality reduction or optimization methods, it is amenable to direct mathematical investigation and interpretation in terms of the underlying neural activity. We thus propose the method of analogous cycles as a suitable foundation for a theory of cross-population analysis via neural manifolds.

97 MATHEMATICS AND COMPUTING↗

Next Day Building Load Predictions based on Limited Input Features Using an On-Line Laterally Primed Adaptive Resonance Theory Artificial Neural Network.

Optimal integration of thermal energy storage within commercial building applications requires accurate load predictions. Several methods exist that provide an estimate of a buildings future needs. Methods include component-based models and data-driven algorithms. This work implemented a previously untested algorithm for this application that is called a Laterally Primed Adaptive Resonance Theory (LAPART) artificial neural network (ANN). The LAPART algorithm provided accurate results over a two month period where minimal historical data and a small amount of input types were available. These results are significant, because common practice has often overlooked the implementation of an ANN. ANN have often been perceived to be too complex and require large amounts of data to provide accurate results. The LAPART neural network was implemented in an on-line learning manner. On-line learning refers to the continuous updating of training data as time occurs. For this experiment, training began with a singe day and grew to two months of data. This approach provides a platform for immediate implementation that requires minimal time and effort. The results from the LAPART algorithm were compared with statistical regression and a component-based model. The comparison was based on the predictions linear relationship with the measured data, mean squared error, mean bias error, and cost savings achieved by the respective prediction techniques. The results show that the LAPART algorithm provided a reliable and cost effective means to predict the building load for the next day.

25 ENERGY STORAGE↗

Detection of the pairwise kinematic Sunyaev-Zel’dovich effect and pairwise velocity with DESI DR1 galaxies and ACT DR6 and Planck CMB data

We present a 9.3⁢𝜎 detection of the pairwise kinematic Sunyaev-Zel’dovich (kSZ) effect by combining a sample of 913,286 Luminous Red Galaxies (LRGs) from the Dark Energy Spectroscopic Instrument Data Release 1 (DESI DR1) catalog and coadded Atacama Cosmology Telescope (ACT DR6) and Planck cosmic microwave background (CMB) temperature maps. This represents the highest-significance pairwise kSZ measurement to date. The analysis uses three ACT CMB temperature maps: coadded 150 GHz, total frequency maps, and a component separated Internal Linear Combination (ILC) map, all of which cover 19,000 square degrees of the sky from Advanced ACTPol observations conducted between 2017 and 2022. Comparison of the results of these three maps serves as a consistency check for potential foreground contamination that may depend on the observation frequency. An estimate of the best-fit mass-averaged optical depth is obtained by comparing the pairwise kSZ curve with the linear theory prediction of the pairwise velocity under the best-fit Planck cosmology and is compared with predictions from simulations. This estimate serves as a reference point for future comparisons with thermal SZ–derived optical depth measurements for the same DESI cluster samples, which will be presented in a companion paper. Finally, we employ a machine learning approach, trained on simulations to estimate the optical depth for 456,803 DESI LRG-identified clusters within the simulated mass range ( ≳ 10 13 ⁢𝑀 ⊙ ). These are combined with the measured kSZ signal to infer the individual cluster peculiar velocities, providing the opportunity to constrain the behavior of gravity and the dark sector over a range of cosmic scales and epochs.

Gong, Yulin [Cornell University] (ORCID:0000000346↗

Conference Discussion of the Nuclear Force

Discussion of the nuclear force, lead by a round table consisting of T. Cohen, E. Epelbaum, R. Machleidt, and F. Gross (chair). After an invited talk by Machleidt, published elsewhere in these proceedings, brief remarks are made by Epelbaum, Cohen, and Gross, followed by discussion from the floor moderated by the chair. The chair asked the round table and the participants to focus on the following issues: (1)What does each approach (chiral effective field theory, large Nc, and relativistic phenomenology) contribute to our knowledge of the nuclear force? Do we need them all? Is any one transcendent? (2) How important for applications (few body, nuclear structure, EMC effect, for example) are precise fits to the NN data below 350 MeV? How precise do these fits have to be? (3) Can we learn anything about nonperturbative QCD from these studies of the nuclear force? The discussion presented here is based on a video recording made at the conference and transcribed afterward.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Comprehensive Computational Study of Partial Lead Substitution in Methylammonium Lead Bromide

Impurities in semiconductors, for example, lead-based hybrid perovskites, have a major influence on their performance as photovoltaic (PV) light absorbers. While impurities could create harmful trap states that lead to nonradiative recombination of charge carriers and adversely affect PV efficiency, they could also potentially increase absorption via midgap energy levels that act as stepping stones for subgap photons or introduce charge carriers via doping. To unearth trends in impurity energy states, we use first principles density functional theory calculations to extensively study partial substitution of Pb in methylammonium lead bromide (MAPbBr 3 ), a representative lead-halide perovskite. Investigation of the density of states and energy levels related to the transition of the substitutional defect from one charge state to another reveals that several elements create midgap energy states in MAPbBr 3 . We machine learned trends and design rules from the computational data and discovered that a few easily computed properties of the bromide compounds of any element can be used to predict the energetics and energy levels of the substitutional defect related to that element. The calculated Fermi level-dependent defect formation energies lead to the observation that substitution by transition metals, Zr, Hf, Nb, and Sc, and group V element Sb can shift the equilibrium Fermi level and change the perovskite conductivity, as determined by the dominant intrinsic point defects. Finally, metal-substituted MAPbBr 3 compounds of Bi, Sc, Ni, and Zr were experimentally investigated, and while there was an improvement in the thin-film morphology and an enhancement in charge carrier lifetimes, no clear evidence of subgap absorption features owing to the substituent being incorporated in the MAPbBr 3 lattice could be seen.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Transferable Dynamic Molecular Charge Assignment Using Deep Neural Networks

We report that the ability to accurately and efficiently compute quantum-mechanical partial atomistic charges has many practical applications, such as calculations of IR spectra, analysis of chemical bonding, and classical force field parametrization. Machine learning (ML) techniques provide a possible avenue for the efficient prediction of atomic partial charges. Modern ML advances in the prediction of molecular energies [i.e., the hierarchical interacting particle neural network (HIP-NN)] has provided the necessary model framework and architecture to predict transferable, extensible, and conformationally dynamic atomic partial charges based on reference density functional theory (DFT) simulations. Utilizing HIP-NN, we show that ML charge prediction can be highly accurate over a wide range of molecules (both small and large) across a variety of charge partitioning schemes such as the Hirshfeld, CM5, MSK, and NBO methods. To demonstrate transferability and size extensibility, we compare ML results with reference DFT calculations on the COMP6 benchmark, achieving errors of 0.004e – (elementary charge). This is remarkable since this benchmark contains two proteins that are multiple times larger than the largest molecules in the training set. An application of our atomic charge predictions on nonequilibrium geometries is the generation of IR spectra for organic molecules from dynamical trajectories on a variety of organic molecules, which show good agreement with calculated IR spectra with reference method. Critically, HIP-NN charge predictions are many orders of magnitude faster than direct DFT calculations. Lastly, these combined results provide further evidence that ML (specifically HIP-NN) provides a pathway to greatly increase the range of feasible simulations while retaining quantum-level accuracy.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Accurate force field for molybdenum by machine learning large materials data

In this work, we present a highly accurate spectral neighbor analysis potential (SNAP) model for molybdenum (Mo) developed through the rigorous application of machine learning techniques on large materials data sets. Despite Mo's importance as a structural metal, existing force fields for Mo based on the embedded atom and modified embedded atom methods still do not provide satisfactory accuracy on many properties. We will show that by fitting to the energies, forces and stress tensors of a large density functional theory (DFT)-computed dataset on a diverse set of Mo structures, a Mo SNAP model can be developed that achieves close to DFT accuracy in the prediction of a broad range of properties, including energies, forces, stresses, elastic constants, melting point, phonon spectra, surface energies, grain boundary energies, etc. We will outline a systematic model development process, which includes a rigorous approach to structural selection based on principal component analysis, as well as a differential evolution algorithm for optimizing the hyperparameters in the model fitting so that both the model error and the property prediction error can be simultaneously lowered. We expect that this newly developed Mo SNAP model will find broad applications in large-scale, long-time scale simulations.

36 MATERIALS SCIENCE↗

SU-D-201-05: On the Automatic Recognition of Patient Safety Hazards in a Radiotherapy Setup Using a Novel 3D Camera System and a Deep Learning Framework

Purpose: Patient safety hazards such as a wrong patient/site getting treated can lead to catastrophic results. The purpose of this project is to automatically detect potential patient safety hazards during the radiotherapy setup and alert the therapist before the treatment is initiated. Methods: We employed a set of co-located and co-registered 3D cameras placed inside the treatment room. Each camera provided a point-cloud of fraxels (fragment pixels with 3D depth information). Each of the cameras were calibrated using a custom-built calibration target to provide 3D information with less than 2 mm error in the 500 mm neighborhood around the isocenter. To identify potential patient safety hazards, the treatment room components and the patient’s body needed to be identified and tracked in real-time. For feature recognition purposes, we used a graph-cut based feature recognition with principal component analysis (PCA) based feature-to-object correlation to segment the objects in real-time. Changes in the object’s position were tracked using the CamShift algorithm. The 3D object information was then stored for each classified object (e.g. gantry, couch). A deep learning framework was then used to analyze all the classified objects in both 2D and 3D and was then used to fine-tune a convolutional network for object recognition. The number of network layers were optimized to identify the tracked objects with >95% accuracy. Results: Our systematic analyses showed that, the system was effectively able to recognize wrong patient setups and wrong patient accessories. The combined usage of 2D camera information (color + depth) enabled a topology-preserving approach to verify patient safety hazards in an automatic manner and even in scenarios where the depth information is partially available. Conclusion: By utilizing the 3D cameras inside the treatment room and a deep learning based image classification, potential patient safety hazards can be effectively avoided.

60 APPLIED LIFE SCIENCES↗

Determining SMEFT and PDF parameters simultaneously based on the CTEQ-TEA framework

The SM effective field theory (SMEFT) provides a model-independent and systematically improvable framework for new physics searches. In this talk, we outline our approach of simultaneously fitting SMEFT parameters and Probability Density Functions (PDFs) in an extension of the CT18 global analysis framework. To enhance the efficiency of our global fitting and Lagrange multiplier scans, we leverage machine-learning techniques. We focus on several representative operators relevant to top-quark pair production and jet production. Through this approach, we establish self-consistent limitations on the associated Wilson coefficients, and explore the correlations between these Wilson coefficients and the PDFs.

Shen, XiaoMin↗

Building brains for bodies

We describe a project to capitalize on newly available levels of computational resources in order to understand human cognition. We will build an integrated physical system including vision, sound input and output, and dextrous manipulation, all controlled by a continuously operating large scale parallel MIMD computer. The resulting system will learn to 'think' by building on its bodily experiences to accomplish progressively more abstract tasks. Past experience suggests that in attempting to build such an integrated system we will have to fundamentally change the way artificial intelligence, cognitive science, linguistics, and philosophy think about the organization of intelligence. We expect to be able to better reconcile the theories that will be developed with current work in neuroscience.

Brooks, Rodney Allen↗

Uncertainty-Aware, Structure-Preserving Machine Learning Approach for Domain Shift Detection From Nonlinear Dynamic Responses of Structural Systems

Complex structural systems deployed for aerospace, civil, or mechanical applications must operate reliably under varying operational conditions. Structural health monitoring (SHM) systems help ensure the reliability of these systems by providing continuous monitoring of the state of the structure. SHM relies on synthesizing measured data with a predictive model to make informed decisions about structural states. However, these models—which may be thought of as a form of a digital twin—need to be updated continuously as structural changes (e.g., due to damage) arise. We propose an uncertainty-aware machine learning model that enforces distance preservation of the original input state space and then encodes a distance-aware mechanism via a Gaussian process (GP) kernel. The proposed approach leverages the spectral-normalized neural GP algorithm to combine the flexibility of neural networks with the advantages of GP, subjected to structure-preserving constraints, to produce an uncertainty-aware model. This model is used to detect domain shift due to structural changes that cannot be observed directly because they may be spatially isolated (e.g., inside a joint or localized damage). This work leverages detection theory to detect domain shift systematically given statistical features of the prediction variance produced by the model. The proposed approach is demonstrated on a nonlinear structure being subjected to damage conditions. In conclusion, it is shown that the proposed approach is able to rely on distances of the transformed input state space to predict increased variance in shifted domains while being robust to normative changes.

Algorithms↗

Convergent Protocols for Computing Protein–Ligand Interaction Energies Using Fragment-Based Quantum Chemistry

Fragment-based quantum chemistry methods offer a way to sidestep the steep nonlinear scaling of electronic structure calculations so that large molecular systems can be investigated using high-level methods. Here, we use fragmentation to compute protein–ligand interaction energies in systems with several thousand atoms, using a new software platform for managing fragment-based calculations that implements a screened many-body expansion. Convergence tests using a minimal-basis semiempirical method (HF-3c) indicate that two-body calculations, with single-residue fragments and simple hydrogen caps, are sufficient to reproduce interaction energies obtained using conventional supramolecular electronic structure calculations, to within 1 kcal/mol at about 1% of the computational cost. We also demonstrate that the HF-3c results are illustrative of trends obtained with density functional theory in basis sets up to augmented quadruple-ζ quality. Strategic deployment of fragmentation facilitates the use of converged biomolecular model systems alongside high-quality electronic structure methods and basis sets, bringing ab initio quantum chemistry to systems of hitherto unimaginable size. This will be useful for generation of high-quality training data for machine learning applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Locally coupled open subsystems: A formalism for affordable electronic structure calculations featuring fractional charges and size consistency

This manuscript introduces a methodology (within the Born-Oppenheimer picture) to compute electronic ground-state properties of molecules and solids/surfaces with fractionally occupied components. Given a user-defined division of the molecule into subsystems, our theory uses an auxiliary global Hamiltonian that is defined as the sum of subsystem Hamiltonians, plus the spatial integral of a second-quantized local operator that allows the electrons to be transferred between subsystems. This electron transfer operator depends on a local potential that can be determined using density functional approximations and/or other techniques such as machine learning. The present framework employs superpositions of tensor-product wave functions, which can satisfy size consistency and avoid spurious fractional charges at large bond distances. The electronic population of each subsystem is in general a positive real number and is obtained from wave-function amplitudes, which are calculated by means of ground-state matrix diagonalization (or matrix propagation in the time-dependent case). Furthermore, our method can provide pathways to explore charge-transfer effects in environments where dividing the molecule into subsystems is convenient and to develop computationally affordable electronic structure algorithms.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Design of Hopfield Networks Based on Superconducting Coupled Oscillators

The global energy shortage has driven the development of many energy-efficient computational platforms beyond Moore's law, among which brain-inspired neuromorphic computing is one of the promising solutions. Associative memory and pattern recognition are important computations solved by brain-inspired Hopfield networks. Classical Hopfield networks store memories via fixed point attractors of their dynamics. In oscillatory Hopfield networks, these attractors are replaced by periodic orbits. Here, we design an oscillatory Hopfield network based on coupled superconducting oscillators. We first employ a mathematical phase reduction approach to map networks of coupled superconducting rapid single flux quantum (RSFQ) ring oscillators to coupled Kuramoto phase-oscillator networks. We use this theory to numerically optimize the hardware's mutual inductances in order to directly match the phase-reduced superconducting oscillators to a model of phase-oscillator-based Hopfield networks. The resulting network can store multiple oscillatory phase-locked memory patterns and recover the patterns based on the initial phase conditions. As different pattern recognition tasks, or learning, require tunable connectivity strengths between the oscillatory nodes, we further employ a coupler circuit that enables tuning the coupling strength between two oscillators by applying an external flux. We demonstrate the functionality of our design through numerical simulations of a small example network with oscillators operating at 86 GHz and recognizing patterns within 10 ns. Our approach enables the learning and retrieval of dynamical memory patterns with a wide range of applications where rhythmic dynamic output is beneficial.

Cheng, Ran↗