Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Learning Theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,693 records · Page 94

Hofmann Stability Charts Revisited for PIP-II: From Classical Theory to Assumption-Free and ML-Driven Maps

The Hofmann stability chart remains a standard for visualizing parametric resonances in space-charge–dominated linacs, but its use typically relies on non-oscillatory Vlasov dispersion relations with simplifying assumptions (continuous focusing, KV phase space, linear optics, limited transverse–longitudinal coupling). We revisit the chart for the PIP-II linac along three tracks. (1) We reproduce the conventional maps in the (νz/νx, νx/ν0x) plane for relevant εz/εx, providing a validated reference. (2) We remove key assumptions by deriving stability surfaces directly from multi-particle tracking with realistic lattice discreteness, RF defocusing, solenoid/quad optics, and bunched-beam dynamics; local tunes and early-time growth rates are estimated from envelope oscillations and projected to the same coordinates. These assumption-reduced maps recover the canonical stopbands while revealing shifts and broadenings driven by tune modulation, non-KV distributions, and transverse–longitudinal coupling at PIP-II intensities. (3) We train a compact machine-learning surrogate that emulates the growth surface from zero-current optics, tune depression, emittance ratio, bunching factor, and selected lattice descriptors, enabling rapid scans and online working-point selection. We compare the three representations on representative PIP-II sections and discuss implications for commissioning guard bands, resonance avoidance, and routine operations.

Pathak, Abhishek [Fermilab] (ORCID:000000021704208↗

Traversable wormhole dynamics on a quantum processor

The holographic principle, theorized to be a property of quantum gravity, postulates that the description of a volume of space can be encoded on a lower-dimensional boundary. The anti-de Sitter (AdS)/conformal field theory correspondence or duality is the principal example of holography. The Sachdev–Ye–Kitaev (SYK) model of N >> 1 Majorana fermions has features suggesting the existence of a gravitational dual in AdS 2 , and is a new realization of holography. Here, we invoke the holographic correspondence of the SYK many-body system and gravity to probe the conjectured ER=EPR relation between entanglement and spacetime geometry through the traversable wormhole mechanism as implemented in the SYK model. A qubit can be used to probe the SYK traversable wormhole dynamics through the corresponding teleportation protocol. This can be realized as a quantum circuit, equivalent to the gravitational picture in the semiclassical limit of an infinite number of qubits. Here we use learning techniques to construct a sparsified SYK model that we experimentally realize with 164 two-qubit gates on a nine-qubit circuit and observe the corresponding traversable wormhole dynamics. Despite its approximate nature, the sparsified SYK model preserves key properties of the traversable wormhole physics: perfect size winding, coupling on either side of the wormhole that is consistent with a negative energy shockwave, a Shapiro time delay, causal time-order of signals emerging from the wormhole, and scrambling and thermalization dynamics. Our experiment was run on the Google Sycamore processor. By interrogating a two-dimensional gravity dual system, our work represents a step towards a program for studying quantum gravity in the laboratory. Future developments will require improved hardware scalability and performance as well as theoretical developments including higher-dimensional quantum gravity duals and other SYK-like models.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Boundary Layer Climatology at ARM Southern Great Plains

Operational since 1992, the Atmospheric Radiation Measurement (ARM) southern great plains (SGP) site at Oklahoma, USA has become a reference research site for meteorological studies. Due to an open data policy the ARM data are used by researchers all over the world. In this report, we review the long-term climatology of the atmospheric boundary layer, SGP instrumentations, the site and some site-specific atmospheric conditions which potentially effect wind turbines within the region. As the atmospheric boundary layer is bounded and influenced by the surface, observations of surface radiation components and heat fluxes are crucial in understanding land-atmosphere interactions. The entrainment of air, updrafts, downdrafts and boundary layer height characteristics is needed for understanding the structure and growth of the atmospheric boundary layer. Therefore, measurements from both surface in-situ and remote sensing observations at SGP provide an overall climatology and their interactions from surface up to the boundary layer. Measurements from a 60 m meteorological tower, surface flux stations, disdrometers, soil temperature and moisture flux plates, coherent Doppler lidar, Raman lidar, radiosondes, and satellite data at SGP central facility were analyzed. All the measurements were generally within a few square kilometers of each other at the central facility. This report focuses on data from January 2010 to June 2020 at SGP central facility. The various sections describe the ARM SGP site and surrounding wind turbines; in-situ and remote sensing instrumentation used in the report; provides mathematical equations to analyze fluxes, turbulence and other boundary layer parameters; a climatological analysis of surface winds, fluxes and thermodynamic parameters for several years; an analysis of observed winds in the framework of Monin-Obukhov Similarity Theory; an analysis of the boundary layer winds and direction from a Doppler lidar; multi-year turbulence estimates through the boundary layer from a Doppler lidar; atmospheric boundary layer water vapor and relative humidity profiles from Raman lidar; cloud base height and boundary layer height from multiple sensors and satellite data; and finally site specific atmospheric conditions, such as nocturnal low-level jets. Diurnal, seasonal and yearly variations of surface, sub-surface and boundary layer quantities, such as wind speed, direction, temperature, atmospheric stability, soil temperature, and various atmospheric fluxes at SGP showed distinct trends useful for focused modeling studies. The applicability of surface similarity theory on ARM SGP data is also evaluated, which showed northerly flows are aligned with MO theory estimates compared to southerly flows. Boundary layer winds and direction profiles for several years from a Doppler lidar shows a consistent presence of a nocturnal low-level jet and predominant southerly wind directions through the boundary layer at SGP. The inter-annual variability at SGP is low (<3.5%), with a mean annual wind speed of approximately 7 m s -1 at 100 m above ground level. Boundary layer turbulence and moisture transport from Doppler and Raman lidars are evaluated, which provides evidence of increased water vapor mass flux into the great plains during nocturnal low-level jets. The moisture flux from nocturnal low-level jets is observed to be maximum during summer periods. A novel machine learning algorithm is implemented to accurately estimate the planetary boundary layer height, providing further insights into growth and destruction of the convective boundary layer height during various seasons and land-atmosphere conditions. The high frequency of low-level clouds during winter, spring and fall seasons is validated using the multi-sensor array and satellite estimates of cloud top height. Satellite vegetative fraction data provides insight into seasonal surface roughness and vegetation variability around SGP site.

54 ENVIRONMENTAL SCIENCES↗

Multireference Methods are Realistic and Useful Tools for Modeling Catalysis

Abstract Highly correlated systems, in particular those that include transition metals, are ubiquitous in catalysis. The significant static correlation found in such systems is often poorly accounted for using Kohn Sham density functional theory methods, as they are single determinantal in nature. Applications to catalysis of more rigorous and appropriate multiconfigurational methods have been reported in select instances, but their use remains rare. We discuss obstacles that hinder the routine application of multireference (MR) wave function theoretical calculations to catalytic systems and the current state of the art with respect to removing those obstacles.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Artificial neural network implementation of a near-ideal error prediction controller

A theory has been developed at the University of Virginia which explains the effects of including an ideal predictor in the forward loop of a linear error-sampled system. It has been shown that the presence of this ideal predictor tends to stabilize the class of systems considered. A prediction controller is merely a system which anticipates a signal or part of a signal before it actually occurs. It is understood that an exact prediction controller is physically unrealizable. However, in systems where the input tends to be repetitive or limited, (i.e., not random) near ideal prediction is possible. In order for the controller to act as a stability compensator, the predictor must be designed in a way that allows it to learn the expected error response of the system. In this way, an unstable system will become stable by including the predicted error in the system transfer function. Previous and current prediction controller include pattern recognition developments and fast-time simulation which are applicable to the analysis of linear sampled data type systems. The use of pattern recognition techniques, along with a template matching scheme, has been proposed as one realizable type of near-ideal prediction. Since many, if not most, systems are repeatedly subjected to similar inputs, it was proposed that an adaptive mechanism be used to 'learn' the correct predicted error response. Once the system has learned the response of all the expected inputs, it is necessary only to recognize the type of input with a template matching mechanism and then to use the correct predicted error to drive the system. Suggested here is an alternate approach to the realization of a near-ideal error prediction controller, one designed using Neural Networks. Neural Networks are good at recognizing patterns such as system responses, and the back-propagation architecture makes use of a template matching scheme. In using this type of error prediction, it is assumed that the system error responses be known for a particular input and modeled plant. These responses are used in the error prediction controller. An analysis was done on the general dynamic behavior that results from including a digital error predictor in a control loop and these were compared to those including the near-ideal Neural Network error predictor. This analysis was done for a second and third order system.

Mcvey, Eugene S.↗

Density Functional Tight-Binding Models for Band Structures of Transition-Metal Alloys and Surfaces across the d -Block

First-principles electronic structure simulations are an invaluable tool for understanding chemical bonding and reactions. While machine-learning models such as interatomic potentials significantly accelerate the exploration of potential energy surfaces, electronic structure information is generally lost. Particularly in the field of heterogeneous catalysis, simulated electron band structures provide fundamental insights into catalytic reactivity. This ab initio knowledge is preserved in semiempirical methods such as density functional tight binding (DFTB), which extend the accessible computational length and time scales beyond first-principles approaches. In this paper here we present Shell-Optimized Atomic Confinement (SOAC) DFTB electronic-part-only parametrizations for bulk and surface band structures of all d-block transition metals that enable efficient predictions of electronic descriptors for large structures or high-throughput studies on complex systems outside the computational reach of density functional theory.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Physical Yukawa couplings in heterotic string compactifications

One of the challenges of heterotic compactification on a CalabiYau threefold is to determine the physical (27) 3 Yukawa couplings of the resulting four-dimensional $\mathcal{N}$ = 1 theory. In general, the calculation necessitates knowledge of the Ricci-flat metric. However, in the standard embedding, which references the tangent bundle, we can compute normalized Yukawa couplings from the Weil-Petersson metric on the moduli space of complex structure deformations of the Calabi-Yau manifold. In various examples (the Fermat quintic, the intersection of two cubics in $\mathbb{P}$ 5 , and the TianYau manifold), we calculate the normalized Yukawa couplings for (2,1)-forms using the Weil-Petersson metric obtained from the Kodaira-Spencer map. In cases where $h^{1,1}$ = 1 , this is compared to a complementary calculation based on performing period integrals. A third expression for the normalized Yukawa couplings is obtained from a machine learned approximate Ricci-flat metric making use of explicit harmonic representatives. Finally, the excellent agreement between the different approaches opens the door to precision string phenomenology.

Butbaia, Giorgi↗

Monitoring Airspace Complexity and Determining Contributing Factors

The national airspace has evolved over many years to accommodate increased traffic demand [1] while simultaneously maintaining one of the safest forms of transportation [2], [3]. One of the reasons for this success is the ability of the system and the operators to adapt and accommodate to situations that routinely disrupt optimal operations. These situations may include: adverse weather, delays, early arrivals, equipment outages, and other factors that are outside the operators ability to control. These factors can lead to states where automation is unable to properly handle these issues and therefore air traffic controllers and pilots have to intervene, ultimately increasing communication between operators resulting in higher workload. As controller workload increases to handle sub-optimal operating conditions this can be viewed as an increase in complexity. The reasoning for this is because humans are now required to make tactical decisions in response to external factors, resulting in a departure from the strategic plan where operations would be more efficiently managed. Human operators control airspace complexity under rigid regulations that are constantly changing. The airspace is divided into sectors and the number of aircraft assigned to each controller is limited for safe handling. There has been past work that devised airspace complexity metrics in commercial aviation and related these metrics to controller workload (e.g., [4],[5]). The upper bounds on the system load are pre-determined. Such bounds on complexity make for a safe system, but the system cannot scale and adapt to autonomous, dense, and heterogeneous traffic, including the many types of Unmanned Aerial Vehicles (UAVs) envisioned to be added to the operations. We hypothesize that, as traffic density and heterogeneity grow, and other key metrics change, there will be phase transitions at which the way traffic should be managed changes significantly [6]. We offer a method for in-time detection of contributing factors that lead to phase transitions, characterized by increased complexity. To the best of our knowledge, there is no tool similar to our proposed effort that identifies such contributing factors or precursor patterns. To define the scope we are proposing to measure complexity from the viewpoint of the Terminal Radar Approach Control Facilities (TRACON) controller’s perspective. In particular we are analyzing arrivals into KSFO. With safety as the top concern for airspace operators, it is important to recognize that as density and heterogeneity grow, the focus of the system will change. Times of the day when the airspace has low density and heterogeneity, the flights will follow more efficient paths where the aircraft move on established routes that are more or less directly to the destination. However, when density and heterogeneity increases, the system will begin changing focus to avoiding conflicts and collisions and route the flights in a more flexible way. Higher flexibility requires more communication and coordination between controllers and pilots which the current automation is unable to handle. This paper proposes a novel approach that monitors airspace complexity at multiple scales, uses a Machine Learning-based tool that predicts when operations will transition to a regime of greater complexity, and identifies actions that can reduce the complexity while still maintaining efficient and safe operations. We demonstrate our proposed approach using data from multiple complementary sources. This includes, but is not limited to: historical aircraft surveillance data from NASA’s Sherlock Data Warehouse [7], METAR weather data, and airport configuration data from Aviation System Performance Metrics (ASPM). The surveillance data flight paths are sampled at a variable sample rate — increasing as the aircraft approaches the airport. This is due to how Sherlock manages flight track stitching between different radar facilities which have different sampling rates. The weather and performance data are logged at defined intervals throughout the day at a courser refresh rate. In addition to the logged data and metrics, we leverage pre-defined Standard Terminal Arrival Routes (STARs) procedures to characterize the path of each flight. Each flight files for one of these routes in the flight plan well before entering the terminal airspace, and approximately follows the route until it leaves the STAR, typically on the final fix of a runway transition. However, most flights do not always fly the full STAR procedure to completion [8], but the majority do adhere to the fixes within the common route of the procedure. Our approach leverages fixes in the common route of each of the STARs to build a reference path to the airport. This allows us to characterize the flight paths in what we are defining as the “maneuvering area” (the airspace between the STAR and before the flight is lined up on the runway’s final approach) to determine how off nominal the flights are to calculate its complexity score. Determining airspace complexity is a concept that does not have a concrete answer. In designing this metric, we consider what increases the workload for the air traffic controllers. Consequently more specialized vectoring maneuvers results in higher workload. Accordingly, we start with a theory: each flight has a direct path it takes from the STAR’s common route to the final approach’s outer marker fix for the flight’s landing runway. It is important to note that the direct path is only used as a reference. If the majority of the flights have a large consistent offset as compared to other routes it does not necessarily mean that those flights have higher complexity. We are merely building a distribution based on this direct path for that particular STAR and runway pair to determine the normal mode of operations for that route. Flights that are in the upper tail of these distributions will result in higher complexity scores and flights that fly in the median will represent the normal mode of operations and therefore will have lower complexity scores. Since flights following each STAR route take different paths to the airport, we have a different distribution for each STAR route and therefore can model these distributions to compute a complexity score from their respective normalized distributions. To evaluate the effectiveness of our proposed airspace complexity metric we will compare against an established approach based on trajectory clustering [9]. This unsupervised learning technique consists of the following steps: (1) identify the general maneuvering areas (waypoints) by performing $\kappa$-means or DBSCAN clustering on locations where aircraft frequently turn based on the surveillance radar track data, (2) map flight trajectories onto sequences of waypoints, and (3) cluster the sequences based on their common subsequences. From a high-level perspective, this baseline model learns nominal operations in the airspace through the sequence of waypoints that are representative of where aircraft change direction and defines deviations from the nominal operations as “complex.” Therefore, more deviations from the nominal operations correspond to higher complexity values. For our validation, we re-implemented this technique and tune model hyper-parameters to correctly detect waypoints for the arrival traffic into the San Francisco bay area. We will compute the complexity measure over a one-year period using our proposed technique as well as the baseline. Our validation will be based on each technique’s ability to detect a set of undesirable outcomes (e.g., go-arounds, holding patterns, average time in the airspace, etc.). Since our current complexity metric is derived from the offset from the direct reference path, it’s important to understand what causes these offsets. In many of the flights with high offset distance, flights performing holding patterns and S turns can be observed. These maneuvering tactics are utilized to add distance between the aircraft and the destination runway to prevent multiple flights from having conflicting arrival times. In order to predict a rise in complexity (or the precursor to complexity), it’s necessary to be able to identify these potential conflicts (which in turn, result in higher offsets). To do this, we define a “representative flight” for each STAR route and runway pair. This flight is approximately the path the flight would take if there was a clear path with no other flights in the airspace — including the time remaining to the airport. We first identify the flights for a given STAR runway pair using the offset to the reference path distributions that fall between the 44-55 percentiles. This yields the flights that conform to the most normal mode of operation. Each of these flights is partitioned based on the percent complete from the entry point into the maneuvering areas from 0\% – 100\% complete. Then for each percent “bin”, we take the median value of the flight’s latitude/longitude coordinates, airspeed, and (non causal) time remaining to the airport to construct a lookup table for each percent complete bin on a given route. As a flight enters the maneuvering area, we can find the estimated arrival time of a flight to the airport by finding the closest point to the representative path’s percent complete bin (relative to the flight’s current position at any snapshot in the airspace) and therefore retrieve the corresponding remaining time left on the “representative path”. We assume that the flight will follow the representative path to completion when deriving these estimates. We can then compare these estimated arrival times against other flights for the same snapshot in time to identify potential conflicts. If more flights are estimated to arrive within a tolerance window than there are runways available, then we have a potential conflict. We can use this derived measure along with other factors expected to add disruption to the operation such as weather and runway configuration changes as an input to machine learning tools to detect precursors that increases in our complexity measure. This novel method will assist in uncovering insights into the contributing factors that lead to increased complexity that may allow for in-time responses to avoid reaching a high complexity state in the airspace.

complexity↗

Microstructure modeling of nuclear structural materials: Recent progress and future directions

Modeling and simulation of microstructures are essential to understand the complex responses and behaviors of nuclear materials in extreme environments. The needs to assess the extended life operation as well as the growing interest in accelerating nuclear materials development and qualification have stimulated the use of high-fidelity multiscale models aided by empirical and ab initio data. This paper reviews the role of various models across different length and time scales in investigating irradiation effects on microstructure evolution and degradation, in particular the embrittlement caused by radiation induced or enhanced formation of nanoscale chemical heterogeneities. The strength and limitations of these models, including classical rate theories, cluster dynamics, phase-field methods, and atomistic models informed by ab initio energies, are discussed with seminal examples. Challenges regarding the lack of thermo-kinetic data and theoretical treatments considering chemical complexities and magnetic excitations, as well as the stabilizing effect by excess point defects in nuclear structural materials are presented, along with potential solutions based on ab initio informed surrogate energy models and statistical sampling by Monte Carlo simulations. Further, the review then highlights the opportunities to leverage the advantages of different methods by establishing hybrid models by shared variables or coupled codes and applications. Finally, the review concludes with forward-looking remarks on how the use of physics-based models can aid the improvement of machine-learning models of property degradation and vice versa.

36 MATERIALS SCIENCE↗

E(3)-equivariant graph neural networks for data-efficient and accurate interatomic potentials

Abstract This work presents Neural Equivariant Interatomic Potentials (NequIP), an E(3)-equivariant neural network approach for learning interatomic potentials from ab-initio calculations for molecular dynamics simulations. While most contemporary symmetry-aware models use invariant convolutions and only act on scalars, NequIP employs E(3)-equivariant convolutions for interactions of geometric tensors, resulting in a more information-rich and faithful representation of atomic environments. The method achieves state-of-the-art accuracy on a challenging and diverse set of molecules and materials while exhibiting remarkable data efficiency. NequIP outperforms existing models with up to three orders of magnitude fewer training data, challenging the widely held belief that deep neural networks require massive training sets. The high data efficiency of the method allows for the construction of accurate potentials using high-order quantum chemical level of theory as reference and enables high-fidelity molecular dynamics simulations over long time scales.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Securely Aggregated Coded Matrix Inversion

Coded computing is a method for mitigating straggling workers in a centralized computing network, by using erasure-coding techniques. Federated learning is a decentralized model for training data distributed across client devices. In this work we propose approximating the inverse of an aggregated data matrix, where the data is generated by clients; similar to the federated learning paradigm, while also being resilient to stragglers. To do so, we propose a coded computing method based on gradient coding. We modify this method so that the coordinator does not access the local data at any point; while the clients access the aggregated matrix in order to complete their tasks. Here, the network we consider is not centrally administrated, and the communications which take place are secure against potential eavesdroppers.

97 MATHEMATICS AND COMPUTING↗

Frame invariant neural network closures for Kraichnan turbulence

Numerical simulations of geophysical and atmospheric flows have to rely on parameterizations of subgrid scale processes due to their limited spatial resolution. Despite substantial progress in developing parameterization (or closure) models for subgrid scale (SGS) processes using physical insights and mathematical approximations, they remain imperfect and can lead to inaccurate predictions. In recent years, machine learning has been successful in extracting complex patterns from high-resolution spatio-temporal data, leading to improved parameterization models, and ultimately better coarse grid prediction. However, the inability to satisfy known physics and poor generalization hinders the application of these models for real-world problems. In this work, we put forth a frame invariant closure approach to improve the accuracy and generalizability of deep learning-based subgrid scale closure models by embedding physical symmetries directly into the structure of the neural network. Specifically, we utilized specialized layers within the convolutional neural network in such a way that desired constraints are theoretically guaranteed without the need for any regularization terms. We demonstrate our framework for a two-dimensional decaying turbulence test case mostly characterized by the forward enstrophy cascade. We show that our frame invariant SGS model (i) accurately predicts the subgrid scale source term, (ii) respects the physical symmetries such as translation, Galilean, and rotation invariance, and (iii) is numerically stable when implemented in coarse-grid simulation with generalization to different initial conditions and Reynolds number. This work opens up a possibility of connecting physics-based theories and data-driven modeling paradigms, and thus represents a promising step towards the development of physically consistent data-driven turbulence closure models.

42 ENGINEERING↗

Predicting Elastic Properties of Materials from Electronic Charge Density Using 3D Deep Convolutional Neural Networks

Materials representation plays a key role in machine learning-based prediction of materials properties and new materials discovery. Currently both graph and three-dimensional (3D) voxel representation methods are based on the heterogeneous elements of the crystal structures. Here, we propose to use electronic charge density (ECD) as a generic unified 3D descriptor for materials property prediction with the advantage of possessing close relation with the physical and chemical properties of materials. We developed an ECD-based 3D convolutional neural networks (CNNs) for predicting the elastic properties of materials, in which CNNs can learn effective hierarchical features with multiple convolving and pooling operations. Extensive benchmark experiments over 2170 $Fm\bar3m$ face-centered-cubic materials show that our ECD-based CNNs can achieve good performance for elasticity prediction. Especially, our CNN models based on the fusion of elemental Materials-Agnostic Platform for Informatics and Exploration features and ECD descriptors achieved the best fivefold cross-validation performance. More importantly, we showed that our ECD-based CNN models can achieve significantly better extrapolation performance when evaluated over nonredundant data sets, where there are few neighbor-training samples around test samples. As an additional validation, we evaluated the predictive performance of our models on 329 materials of space group $Fm\bar3m$ by comparing to density functional theory calculated values, which shows a better prediction power of our model for bulk modulus than shear modulus. Because of the unified representation power of ECD, it is expected that our ECD-based CNN approach can also be applied to predict other physical and chemical properties of crystalline materials.

36 MATERIALS SCIENCE↗

HydraGNN_Predictive_GFM_2024 - Ensemble of predictive graph foundation models for ground state atomistic materials modeling

We provide the ensemble of fifteen pre-trained graph foundation models (GFMs) for atomistic materials modeling applications. Each one of the fifteen GFMs has been trained on five open-source datasets that (once aggregated) amount to over 154 million atomistic structures, which cover over two-thirds of the natural elements of the periodic table and that comprises a broad set of organic and inorganic compounds. This vast set of atomistic structures comprises ground state configurations that are dynamically stable (i.e., equilibrated structures with atomic forces approximately close to zero values) as well as dynamically unstable structures (i.e., non-equilibrium structures with non-negligible non-zero values of atomic forces). The ensemble of datasets aggregated does NOT include excited states. The datasets have been curated to remove atomistic structures with spectral norm of the force tensor above 100 eV/angstrom. Moreover, a linear term of the energy was computed for each dataset using a linear regression model that uses the chemical concentration of each natural element as regressor. The linear term predicted by the linear regression model has been subtracted from each original energy value to perform a re-alignment of the energy values across different electronic structures approximation theories performed to generate the diverse multi-source, multi-fidelity datasets. The folder "ADIOS_files" contains the set of pre-processed datasets in Adaptable I/O System (ADIOS) format (https://www.exascaleproject.org/research-project/adios/) that have been used for the development and training of GFMs in this work. The "ADIOS_files" directory contains 6 sub-directories named as follows: - ANI1x-v3.bp - MPTrj-v3.bp - OC2020-20M-v3.bp - OC2020-v3.bp - OC2022-v3.bp - qm7x-v3.bp Each sub-directory contains the pre-processed datasets converted in Adaptable I/O System (ADIOS) format (https://www.exascaleproject.org/research-project/adios/) that have been used to the development, training, and performance testing of the ensemble go predictive graph foundation models. Each GFM was developed using HydraGNN (https://github.com/ORNL/HydraGNN) as underlying graph neural network (GNN) architecture. The multi-task learning (MTL) capability of HydraGNN was used to simultaneously train the GFMs on labeled values for direct predictions of energy (a total system property of an atomistic structure that measures the chemical stability) and atomic forces (an atomic level property of an atomistic structure that measures the dynamical stability). The hyper parameters of the GFM have been tuned using scalable hyperparameter optimization (HPO) algorithms implemented in the software DeepHyper (https://github.com/deephyper/deephyper). The pre-training of each HPO trial was performed using distributed data parallelism (DDP) to scale the training across 128 compute nodes of the exascale OLCF supercomputer Frontier. Each HPO trial was trained only for 10 epochs and an early stopping was performed to avoid wasting significant computational resources on GNN architectures that were clearly underperforming. For each HPO trial, the 'omnistat' tool developed by (AMD Research - Advanced Micro Device) was used to measure the total energy consumption in kWh. The ensemble of GFMs was obtained by selecting the fifteen best performing HPO trials. Four models have been selected for their clear advantage in accuracy, and these are the GFMs with IDs 229, 156, 147, 260. Additional eleven models have been selected based on judicious balance between accuracy and energy consumption needed for training, and these are the GFMs with IDs 165, 78, 137, 1, 175, 171, 181, 67, 179, 167, 351. Each selected GFM of the ensemble was continued to cumulate a total of at most 30 epochs. In some cases, the total number of epochs actually performed was les than 30 due to two combined factors: (1) the size of the GFM (i.e., the number of model parameters to train) and (2) the total wall-clock time for which the computational resources could be allocated on OLCF-Frontier. The "Ensemble_of_models" directory contains 15 sub-directories named as follows: - gfm_0.229 - gfm_0.156 - gfm_0.147 - gfm_0.260 - gfm_0.165 - gfm_0.78 - gfm_0.137 - gfm_0.1 - gfm_0.175 - gfm_0.171 - gfm_0.181 - gfm_0.67 - gfm_0.179 - gfm_0.167 - gfm_0.351 Each one of these sub-directories refers to one of the fifteen HPO trials that have been selected to continue the pre-training with at most 30 epochs. With each sub-directory associated with a specific HPO trial, the following files can be found: - config.json: file for argument parsing to develop and train an HydraGNN architecture - gfm_0.ID_epoch_N.pk: file with model parameters for HPO ID trial after N epochs of training The ensemble of fifteen GFM architectures was used for (1) ensemble averaging to stabilize the predictions of energy and atomic forces after pre-training for post-processing analysis and (2) ensemble uncertainty quantification (UQ). The code used to develop, pre-train, and load the pre-trained models for post-processing analysis is available on the ORNL-GitHub at the following link: https://github.com/ORNL/HydraGNN/tree/Predictive_GFM_2024

36 MATERIALS SCIENCE↗

Shortening the Design and Certification Cycle for Additively Manufactured Materials by Improved Mesoscale Simulations and Validation Experiments: Fiscal Year 2019 Status Report.

This report outlines the fiscal year (FY) 2019 status of an ongoing multi-year effort to develop a general, microstructurally-aware, continuum-level model for representing the dynamic response of material with complex microstructures. This work has focused on accurately representing the response of both conventionally wrought processed and additively manufactured (AM) 304L stainless steel (SS) as a test case. Additive manufacturing, or 3D printing, is an emerging technology capable of enabling shortened design and certification cycles for stockpile components through rapid prototyping. However, there is not an understanding of how the complex and unique microstructures of AM materials affect their mechanical response at high strain rates. To achieve our project goal, an upscaling technique was developed to bridge the gap between the microstructural and continuum scales to represent AM microstructures on a Finite Element (FE) mesh. This process involves the simulations of the additive process using the Sandia developed kinetic Monte Carlo (KMC) code SPPARKS. These SPPARKS microstructures are characterized using clustering algorithms from machine learning and used to populate the quadrature points of a FE mesh. Additionally, a spall kinetic model (SKM) was developed to more accurately represent the dynamic failure of AM materials. Validation experiments were performed using both pulsed power machines and projectile launchers. These experiments have provided equation of state (EOS) and flow strength measurements of both wrought and AM 304L SS to above Mbar pressures. In some experiments, multi-point interferometry was used to quantify the variation is observed material response of the AM 304L SS. Analysis of these experiments is ongoing, but preliminary comparisons of our upscaling technique and SKM to experimental data were performed as a validation exercise. Moving forward, this project will advance and further validate our computational framework, using advanced theory and additional high-fidelity experiments.

36 MATERIALS SCIENCE↗

2011 Quantum Control of Light & Matter Gordon Research Conference (July 31-August 5, 2011, Mount Holyoke College, South Hadley, MA)

Quantum control of light and matter is the quest to steer a physical process to a desirable outcome, employing constructive and destructive interference. Three basic questions address feasibility of quantum control: (1) The problem of controllability, does a control field exist for a preset initial and target state; (2) Synthesis, constructively finding the field that leads to the target; and (3) Optimal Control Theory - optimizing the field that carries out this task. These continue to be the fundamental theoretical questions to be addressed in the conference. How to realize control fields in the laboratory is an ongoing challenge. This task is very diverse viewing the emergence of control scenarios ranging from attoseconds to microseconds. How do the experimental observations reflect on the theoretical framework? The typical arena of quantum control is an open environment where much of the control is indirect. How are control scenarios realized in dissipative open systems? Can new control opportunities emerge? Can one null decoherence effects? An ideal setting for control is ultracold matter. The initial and final state can be defined more precisely. Coherent control unifies many fields of physical science. A lesson learned in one field can reflect on another. Currently quantum information processing has emerged as a primary target of control where the key issue is controlling quantum gate operation. Modern nonlinear spectroscopy has emerged as another primary field. The challenge is to unravel the dynamics of molecular systems undergoing strong interactions with the environment. Quantum optics where non-classical fields are to be generated and employed. Finally, coherent control is the basis for quantum engineering. These issues will be under the limelight of the Gordon conference on Quantum Control of Light and Matter.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Machine Learning Approaches to Predicting Induced Seismicity and Imaging Geothermal Reservoir Properties

This project developed machine learning (ML) methods, lab data sets, and field data to advance geothermal exploration and geothermal energy production. The work had three focus areas. One involved the development of ML methods to use microearthquakes (MEQs) for imaging geothermal reservoir properties and improving subsurface characterization – most importantly the evolution of permeability within the evolving reservoir. This part of the work included development of ML approaches for automated MEQ location, focal mechanism determination and identification of earthquake precursors. The second area focused on using MEQ signals generated by geothermal exploration and production to predict the relationship between fluid injection and seismicity. Here, we extended to reservoir scale our success in using ML to predict laboratory earthquakes and fault zone stress state. The third focus area was on lab experiments. Here, we developed new ML models for lab earthquake prediction and identification of precursors to failure to improve earthquake forecasting and early warning in geothermal settings. Major outcomes of our work include ML models that learn from MEQ signals during geothermal exploration and production to predict induced seismicity. MEQs occur naturally in connection with drilling and energy production. We developed ML methods to use the seismic waves from these events to characterize the elastic, hydraulic and poromechanical properties of reservoirs. Our work illuminated fracture geometry and the evolution of fracture permeability by incorporating seismic coda wave analysis and ML methods to relate fluid injection and seismicity. We significantly expanded laboratory earthquake prediction to include methods that use both passive measurements of microearthquakes within the lab fault zones and also active source acoustic measurements of fault zone elastic properties. These methods can now predict fault zone stress state, time to failure and the magnitude of lab earthquakes. Our work showed that repetitive stick- slip failure events during frictional sliding (the lab equivalent of earthquakes) are preceded by a cascade of micro-failure events that radiate energy in a manner that foretells unstable failure – manifest as laboratory MEQs. We documented a mapping between fracture properties and statistical attributes of elastic radiation. We extended existing works to geothermal reservoir scale and developed ML methods to determine reservoir permeability, fracture properties, and their evolution during geothermal energy production. An attractive feature of ML algorithms is their ability to handle big datasets and reveal patterns and correlations that may remain invisible to conventional analyses. Our work connected data from field, laboratory and intermediate scales to study permeability, stress, strength, fracture stiffness and geometry. At the field scale we used data from the Newberry Volcano field site, UtahFORGE, EGS Collab, and also the Bedretto underground research lab in Switzerland. These data sets are bridging the gap between the lab scale, theory, and reservoir scale. Our work produced plain language summaries to improve public understanding of DOE research. We also developed openly distributed ML and seismicity datasets for use by all researchers and we published connections between induced seismicity in geothermal areas and reservoir properties including permeability, fracture properties, and stress state. Our models are designed for the large data sets of induced seismicity typically associated with geothermal sites. We produced labeled event catalogs and used them on geothermal data to assess how ML can facilitate geothermal production and exploration. All datasets are available on the GDR Productivity: The project produced 32 publications in peer reviewed journals (two are in review). It supported the work of 6 PhD students, 40 conference presentations, 6 keynote talks at national meetings, and mentoring and professional development for 4 postdoctoral fellows.

15 GEOTHERMAL ENERGY↗

Fundamental studies of energy-and hole/electron- transfer in hydroporphyrin architectures

The long-term objective of the Bocian/Holten/Lindsey research program is to design, synthesize, and characterize tetrapyrrole-based molecular architectures that absorb sunlight, funnel energy, and separate charge with high efficiency and in a manner compatible with current and future solar-energy conversion schemes. The synthetic tetrapyrroles include porphyrins and hydroporphyrins; the latter classes of molecules encompass analogues of the naturally occurring chlorophylls and bacteriochlorophylls (e.g., chlorins, bacteriochlorins, and their derivatives). The attainment of the goals of the research program requires the close interplay of molecular design and synthesis (Lindsey group), static and time-resolved optical spectroscopic measurements (Holten group), and electrochemical, electron paramagnetic resonance, and resonance Raman studies, as well as density functional theory calculations (Bocian Group). The proposed research encompasses four interrelated themes: (1) Determination of the rates of ground-state hole/electron transfer between (hydro)porphyrins in multipigment arrays as a function of array size, distance between components, linker type, site of linker connection, and frontier molecular orbital composition. (2) Examination of excited-state energy transfer among hydroporphyrins in multipigment arrrays, including both pairwise and non-adjacent transfer, with a chief aim to identify the relative contributions of through-space (Förster) and through-bond (Dexter) mechanisms of energy transfer, including the roles of site of linker connection and frontier molecular orbital composition. (3) Elucidation of the role of substituents in tuning the spectral and electronic properties of bacteriochlorins, with a primary aim of learning how to shift the long-wavelength absorption band deeper into the near-infrared region. (4) Continued development of the software package PhotochemCAD for spectral manipulations and calculations through the compilation of a database of spectra for naturally occurring and synthetic hydroporphyrins. The availability of such data should augment efforts in the design of light-harvesting systems where spectral coverage in the red and near-infrared regions is desired. Collectively, the proposed studies will provide fundamental insights into molecular properties, interactions, and processes relevant to the design of molecular architectures for solar-energy conversion. The accomplishment of these goals is only possible through a highly synergistic program that encompasses molecular design, synthesis, and characterization.

14 SOLAR ENERGY↗