Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “attention”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Equivariant Graph Attention Network - 3D Conformers & Feature Fusion

EGAN-3F (Equivariant Graph Attention Network - 3D Conformers & Feature Fusion) presents an innovative approach for predicting binding affinity between small molecules and protein targets, a fundamental task in drug discovery. Traditional structure-based methods often depend on protein-ligand complex structures obtained from crystallography or molecular docking. In contrast, ligand-only machine learning models using 1D or 2D representations such as SMILES have been developed to predict binding affinity without structural information about the target; however, their accuracy is often limited due to the lack of 3D ligand information. EGAN-3F addresses this limitation by integrating spatially aware graph learning with traditional descriptor-based features. We systematically investigate how combining 2D and 3D molecular representations enhances binding affinity prediction from SMILES strings. This approach underscores the importance of modeling conformational diversity and incorporating chemically meaningful descriptors to improve predictive accuracy. The key innovation of EGAN-3F lies in its ability to achieve robust ligand-based binding affinity predictions without requiring protein-ligand complex structures, effectively bridging the gap between purely structural and ligand-only modeling paradigms.

Shim, Heesung [Lawrence Livermore National Laborat↗

Reconstructing Richtmyer–Meshkov instabilities from noisy radiographs using low dimensional features and attention-based neural networks

We develop an ML-based approach for density reconstruction based on transformer neural networks. This approach is demonstrated in the setting of ICF-like double shell hydrodynamic simulations wherein the parameters related to material properties and initial conditions are varied. The new method can robustly recover the complex topologies given by the Richtmyer-Meshkoff instability (RMI) from a sequence of hydrodynamic features derived from radiographic images corrupted with blur, scatter, and noise. A noise model is developed to characterize errors in extracting features from synthetic radiographs of the simulated density field. The key component of the network is a transformer encoder that acts on a sequence of features extracted from noisy radiographs. This encoder includes numerous self-attention layers that act to learn temporal dependencies in the input sequences and increase the expressiveness of the model. This approach is shown to exhibit an excellent ability to accurately recover the RMI growth rates, despite the gas-metal interface being greatly obscured by radiographic noise. Our approach can be applied in a broad array of fields involving shock physics and material science.

47 OTHER INSTRUMENTATION↗

Alarms and Attention: UX Lessons from Safety-critical monitoring

UX lessons from designing the Alarms app (a tool operators rely on to track accelerator subsystems and respond to alerts). The talk focuses on how observation, empathy, and iterative design helped us balance information, attention, and safety.

Kim, Leah [Fermilab]↗

Energy and physical resource impacts of quantum computing merit greater attention

Quantum computing research and development is growing worldwide; yet the energy and physical resource demands of future quantum-accelerated data centres are unknown. Planning for quantum computing requires strong collaboration between research communities across engineering, physics, environmental sciences, economics, policy, and energy systems and scenario modelling.

97 MATHEMATICS AND COMPUTING↗

Facial Named Entity Recognition by Attention-Based Graph Convolutional Neural Network

In the realm of facial recognition and analysis, the ability to accurately cluster large datasets of facial images stands as a cornerstone for various applications, ranging from security surveillance to user biometric identification. This project evolves a novel approach to facial data clustering by embedding facial images into a high-dimensional vector space using an advanced embedding model trained on separate data and assumes a graph-like structure on the high-dimensional vectors. We find our method works significantly better than common shallow methods.

97 MATHEMATICS AND COMPUTING↗

Extending Symmetry-Preserving Attention Networks (SPANet) for Jet Assignment in Fully Hadronic \(t\bar{t}\) Events

Fully hadronic \(t\bar{t}\) reconstruction requires assigning reconstructed jets to the two top-quark decay branches, \(t\bar{t}\to(Wb)(Wb)\to(qqb)(qqb)\). This is a combinatorially large, symmetry-rich, and frequently underconstrained set-assignment problem due to detector effects and partial reconstructability. SPANet provides a strong symmetry-preserving baseline for this task, but its standard inference eagerly commits to a single hypothesis and does not explicitly treat branch-level reconstructability decisions. We present a two-stage extension of the SPANet pipeline for fully hadronic \(t\bar{t}\) events: (i) SPANet is modified into a proposal model that generates a shortlist of candidate jet assignments; (ii) a custom dual-head set transformer is trained to re-rank these candidates and identify reconstructible branches. Our extension gives modest improvements in candidate-selection efficiency, with SPANet achieving \(69.9\%\) and our extension achieving \(71.1\%\). Finally, an oracle study of the generated shortlist shows a substantial upper bound of \(88.5\%\) on the evaluated fully reconstructable subset, suggesting that the shortlist contains significant residual information that is not fully exploited.

Lisondodi Tada, Mateo [Puerto Rico U., Mayaguez] (↗