Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Inspires”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,531 records · Page 85

Theory for Equivariant Quantum Neural Networks

Quantum neural network architectures that have little to no inductive biases are known to face trainability and generalization issues. Inspired by a similar problem, recent breakthroughs in machine learning address this challenge by creating models encoding the symmetries of the learning task. This is materialized through the usage of equivariant neural networks the action of which commutes with that of the symmetry. In this work, we import these ideas to the quantum realm by presenting a comprehensive theoretical framework to design equivariant quantum neural networks (EQNNs) for essentially any relevant symmetry group. We develop multiple methods to construct equivariant layers for EQNNs and analyze their advantages and drawbacks. Our methods can find unitary or general equivariant quantum channels efficiently even when the symmetry group is exponentially large or continuous. As a special implementation, we show how standard quantum convolutional neural networks (QCNNs) can be generalized to group-equivariant QCNNs where both the convolution and pooling layers are equivariant to the symmetry group. We then numerically demonstrate the effectiveness of a S U ( 2 ) -equivariant QCNN over symmetry-agnostic QCNN on a classification task of phases of matter in the bond-alternating Heisenberg model. Our framework can be readily applied to virtually all areas of quantum machine learning. Lastly, we discuss about how symmetry-informed models such as EQNNs provide hopes to alleviate central challenges such as barren plateaus, poor local minima, and sample complexity. Published by the American Physical Society 2024

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Effect of Nonunital Noise on Random-Circuit Sampling

In this work, drawing inspiration from the type of noise present in real hardware, we study the output distribution of random quantum circuits under practical nonunital noise sources with constant noise rates. We show that even in the presence of unital sources such as the depolarizing channel, the distribution, under the combined noise channel, never resembles a maximally entropic distribution at any depth. To show this, we prove that the output distribution of such circuits never anticoncentrates—meaning that it is never too “flat”—regardless of the depth of the circuit. This is in stark contrast to the behavior of noiseless random quantum circuits or those with only unital noise, both of which anticoncentrate at sufficiently large depths. As a consequence, our results shows that the complexity of random-circuit sampling under realistic noise is still an open question, since anticoncentration is a critical property exploited by both state-of-the-art classical hardness and easiness results. Published by the American Physical Society 2024

Physics↗

Coupled Lindblad Pseudomode Theory for Simulating Open Quantum Systems

Coupled Lindblad pseudomode theory is a promising approach for simulating non-Markovian quantum dynamics on both classical and quantum platforms, with dynamics that can be realized as a quantum channel. We provide theoretical evidence that the number of coupled pseudomodes only needs to scale as polylog⁡(𝑇/𝜖) in the simulation time 𝑇 and precision 𝜖. Inspired by the realization problem in control theory, we also develop a robust numerical algorithm for constructing the coupled modes that avoid the nonconvex optimization required by existing approaches. We demonstrate the effectiveness of our method by computing population dynamics and absorption spectra for the spin-boson model. Furthermore, this Letter provides a significant theoretical and computational improvement to the coupled Lindblad framework, which impacts a broad range of applications from classical simulations of quantum impurity problems to quantum simulations on near-term quantum platforms.

Anderson impurity model↗

Site-decorated model for unconventional frustrated magnets: Ultranarrow phase crossover and two-dimensional spin reversal transition

Here, the site-decorated Ising model is introduced to advance the understanding and experimental realization of the recently discovered one-dimensional (1D) finite-temperature ultranarrow phase crossover in an external magnetic field, while mitigating the geometric complexities of traditional bond-decorated models. The unconventional frustration and physics are clarified by exactly mapping the 1D site-decorated Ising model in a magnetic field onto a zero-field bond-decorated 𝐽 1 −𝐽 2 Ising model with conventional geometrical frustration. Furthermore, although higher-dimensional Ising models in an external field remain unsolved exactly, an exact solution for a spin-reversal transition—driven by an exotic, hidden half-ice, half-fire state induced by site decoration—is derived. This transition, triggered by a slight variation in temperature or magnetic field—without changing its direction—even in the weak-field limit, offers a promising route toward energy-efficient applications such as data storage and processing. The results suggest that site decoration offers an avenue for materials and device design, particularly in systems such as mixed 𝑑−𝑓 compounds, optical lattices, and neural networks, calling for further studies with site-decorated Heisenberg models. In addition, the site-decorated model offers a rigorous test ground for artificial intelligence (AI) in science, as the analytic derivation of the present results was not only validated but also improved by a general-purpose large language model, inspiring the use of AI as scientific discoverer.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Towards excitations and dynamical quantities in correlated lattices with density matrix embedding theory

Density matrix embedding theory (DMET) provides a framework to describe ground-state expectation values in strongly correlated systems, but its extension to dynamical quantities is still an open problem. We show one route to obtaining excitations and dynamical spectral functions by using the techniques of DMET to approximate the matrix elements that arise in a single-mode inspired excitation ansatz. We demonstrate this approach in the one-dimensional Hubbard model, comparing the neutral excitations, single-particle density of states, charge, and spin dynamical structure factors to benchmarks from the Bethe ansatz and density matrix renormalization group. Finally, our work highlights the potential of these ideas in building computationally efficient approaches for dynamical quantities.

1-dimensional systems↗

Rapid Quantum Ground State Preparation via Dissipative Dynamics

Inspired by natural cooling processes, dissipation has become a promising approach for preparing low-energy states of quantum systems. However, the potential of dissipative protocols remains unclear beyond certain commuting Hamiltonians. This work provides significant analytical and numerical insights into the power of dissipation for preparing the ground state of noncommuting Hamiltonians. For quasi-free dissipative dynamics, including certain 1D spin systems with boundary dissipation, our results reveal a new connection between the mixing time in trace distance and the spectral properties of a non-Hermitian Hamiltonian, leading to an explicit and sharp bound on the mixing time that scales polynomially with system size. For more general spin systems, we develop a tensor network-based algorithm for constructing the Lindblad jump operator and for simulating the dynamics. Using this algorithm, we demonstrate numerically that dissipative ground state preparation protocols can achieve rapid mixing for certain 1D local Hamiltonians under bulk dissipation, with a mixing time that scales logarithmically with the system size. We then prove the rapid mixing result for certain weakly interacting spin and fermionic systems in arbitrary dimensions, extending recent results for high-temperature quantum Gibbs samplers to the zero-temperature regime. Together, these results show that dissipation can be a powerful tool for ground state preparation, with potential applications across condensed matter physics, quantum materials science, and beyond.

decoherence↗

Optimizers for stabilizing likelihood-free inference

A growing number of applications in particle physics and beyond use neural networks as unbinned likelihood ratio estimators applied to real or simulated data. Precision requirements on the inference tasks demand a high-level of stability from these networks, which are affected by the stochastic nature of training. We show how physics concepts can be used to stabilize network training through a physics-inspired optimizer. In particular, the energy conserving descent (ECD) optimization framework uses classical Hamiltonian dynamics on the space of network parameters to reduce the dependence on the initial conditions while also stabilizing the result near the minimum of the loss function. We develop a version of this optimizer known as , which has few free hyperparameters with limited ranges guided by physical reasoning. We apply to representative likelihood-ratio estimation tasks in particle physics and find on average that it out-performs the widely used Adam optimizer. We expect that ECD will be a useful tool for wide array of data-limited problems, where it is computationally expensive to exhaustively optimize hyperparameters and mitigate fluctuations with ensembling.

Monte Carlo methods↗

X-ray-based technologies in emerging fuel cell research

The workshop titled `X-ray-based technologies in emerging fuel cell research', organized by Vivian Stojanoff from Brookhaven National Laboratory (BNL) and Narayanasami Sukumar from Cornell University/Advanced Photon Source-Northeastern Collaborative Access Team, was a notable segment of the National Synchrotron Light Source II and Center for Functional Nanomaterials Users' Meeting held 13–17 May 2024. This one-day event, on 13 May 2024, at BNL in New York, aimed to bring together researchers, beamline scientists, management and developers to propel fuel cell technology forward using model systems inspired by natural photosynthesis and redox enzymes. Furthermore, this summary encapsulates the key discussions, advancements and future implications of the workshop.

Xray↗

Negative linear compressibility in Se at ultra-high pressure above 120 GPa

A series of in situ synchrotron X-ray diffraction (XRD) measurements were carried out, combined with first-principles calculations, to study structural phase transitions of selenium at high pressures and room temperature. Several phase transitions were observed, among which an isostructural phase transition was found at around 120 GPa for the first time. Evolved from the rhombohedral (space group R$\bar{3}$m) structure (Se-V), the new phase (Se-V') exhibited an interesting increase of lattice parameter a at pressures from 120 to 148 GPa, known as negative linear compressibility (NLC). The discovery of NLC behavior observed in this work is mainly attributed to the accuracy and fine steps controlled by the membrane system for in situ XRD data collected with an exposure time of 0.5 s. After 140 GPa, a body-centered cubic (b.c.c.) structure Se-VI (space group Im$\bar{3}$m) was formed, which remains stable up to 210 GPa, the highest pressure achieved in this study. The bulk moduli of phases Se-V, Se-V' and Se-VI were estimated to be 83 ± 2, 321 ± 2 and 266 ± 7 GPa, respectively, according to the P–V curve fit by the third-order Birch–Murnaghan equation of state. The Se-V' phase shows a bulk modulus almost 4 times larger than that of the Se-V phase, which is mainly due to the effect of its NLC. NLC in a higher pressure range is always more significant in terms of fundamental mechanism and new materials discovery, yet it has barely been reported at pressures above 100 GPa. This will hopefully inspire future studies on potential NLC behaviors in other materials at ultra-high pressure.

36 MATERIALS SCIENCE↗

The temperature-dependent conformational ensemble of SARS-CoV-2 main protease (M pro )

The COVID-19 pandemic, instigated by the SARS-CoV-2 coronavirus, continues to plague the globe. The SARS-CoV-2 main protease, or M pro , is a promising target for the development of novel antiviral therapeutics. Previous X-ray crystal structures of M pro were obtained at cryogenic temperature or room temperature only. Here we report a series of high-resolution crystal structures of unliganded M pro across multiple temperatures from cryogenic to physiological, and another at high humidity. We interrogate these data sets with parsimonious multiconformer models, multi-copy ensemble models, and isomorphous difference density maps. Our analysis reveals a perturbation-dependent conformational landscape for M pro , including a mobile zinc ion interleaved between the catalytic dyad, mercurial conformational heterogeneity at various sites including a key substrate-binding loop, and a far-reaching intramolecular network bridging the active site and dimer interface. Our results may inspire new strategies for antiviral drug development to aid preparation for future coronavirus pandemics.

59 BASIC BIOLOGICAL SCIENCES↗

Bridging length scales in hard materials with ultra-small angle X-ray scattering – a critical review

Owing to their exceptional properties, hard materials such as advanced ceramics, metals and composites have enormous economic and societal value, with applications across numerous industries. Understanding their microstructural characteristics is crucial for enhancing their performance, materials development and unleashing their potential for future innovative applications. However, their microstructures are unambiguously hierarchical and typically span several length scales, from sub-ångstrom to micrometres, posing demanding challenges for their characterization, especially for in situ characterization which is critical to understanding the kinetic processes controlling microstructure formation. This review provides a comprehensive description of the rapidly developing technique of ultra-small angle X-ray scattering (USAXS), a nondestructive method for probing the nano-to-micrometre scale features of hard materials. USAXS and its complementary techniques, when developed for and applied to hard materials, offer valuable insights into their porosity, grain size, phase composition and inhomogeneities. We discuss the fundamental principles, instrumentation, advantages, challenges and global status of USAXS for hard materials. Using selected examples, we demonstrate the potential of this technique for unveiling the microstructural characteristics of hard materials and its relevance to advanced materials development and manufacturing process optimization. We also provide our perspective on the opportunities and challenges for the continued development of USAXS, including multimodal characterization, coherent scattering, time-resolved studies, machine learning and autonomous experiments. Our goal is to stimulate further implementation and exploration of USAXS techniques and inspire their broader adoption across various domains of hard materials science, thereby driving the field toward discoveries and further developments.

36 MATERIALS SCIENCE↗

Analysis of Control Behavior in Eco-Driving Speed Optimization Using Pontryagin’s Minimum Principle

The energy efficiency of autonomous vehicles can be improved by selecting an optimized speed profile. Energy savings can be maximized by performing control optimization with knowledge of the powertrain characteristics and future driving conditions. Previous studies have shown that Pontryagin’s minimum principle (PMP) performs well in vehicle speed optimization problems. Building on the methods proposed in previous studies, the contribution of this study is to derive meaningful observations from the concepts and results of PMP to enhance the understanding of the control problem. In particular, the switching behavior of the control mode is analyzed with supportive variables, such as ξ and mv, which dictates the changes in the control modes. Additionally, the existence of the singular control is analyzed, which helps in understanding the cruise driving in the control problem. Finally, we obtain several solutions that satisfy various boundary conditions along with a map of the reachable states, and discuss the impact of cruise driving. This is helpful for designing practical control concepts for real-world applications based on this map. Previous studies have contributed significantly to this control problem; however, this study provides a better understanding of the issue and offers guidance and inspiration for future real-world applications based on these meaningful observations.

33 ADVANCED PROPULSION SYSTEMS↗

Driver Distraction Behavior Detection using a Vision Transformer Model based on Transfer Learning Strategy

Driver distraction behavior is one of the critical factors in traffic accidents. Thus, advanced driver state detection system has become the focus in the field of intelligent vehicle. However, in practical applications, insufficient samples of driving distraction behaviors bring great challenges to training a personalized behavior distraction detection model for a specific driver. To this end, a novel transformer model based on a transfer learning strategy is proposed in this paper to accurately recognize driver distraction behavior. Inspired by the effect of the transformer network in visual recognition, we firstly present a transformer behavior distraction detection system to identify the behavior categories that cause driver distraction. Then, for the specific driving dataset in practical application scenarios, the transfer learning strategy is introduced into the driver distraction detection model to further train the general transformer network. The effectiveness of the transformer based on the transfer learning strategy is validated compared with other traditional deep learning methods. The results show that the proposed detection method has better generalization ability and higher accuracy.

Fang, Zhenwu↗

Scaling Laws of Graph Neural Networks for Atomistic Materials Modeling

Atomistic materials modeling is a critical task with wide-ranging applications, from drug discovery to materials science, where accurate predictions of the target material property can lead to significant advancements in scientific discovery. Graph Neural Networks (GNNs) represent the state-of-the-art approach for modeling atomistic material data thanks to their capacity to capture complex relational structures. While machine learning performance has historically improved with larger models and datasets, GNNs for atomistic materials modeling remain relatively small compared to large language models (LLMs), which leverage billions of parameters and terabyte-scale datasets to achieve remarkable performance in their respective domains. To address this gap, we explore the scaling limits of GNNs for atomistic materials modeling by developing a foundational model with billions of parameters, trained on extensive datasets in terabytescale. Our approach incorporates techniques from LLM libraries to efficiently manage large-scale data and models, enabling both effective training and deployment of these large-scale GNN models. This work addresses three fundamental questions in scaling GNNs: the potential for scaling GNN model architectures, the effect of dataset size on model accuracy, and the applicability of LLM-inspired techniques to GNN architectures. Specifically, the outcomes of this study include (1) insights into the scaling laws for GNNs, highlighting the relationship between model size, dataset volume, and accuracy, (2) a foundational GNN model optimized for atomistic materials modeling, and (3) a GNN codebase enhanced with advanced LLM-based training techniques. Our findings lay the groundwork for large-scale GNNs with billions of parameters and terabyte-scale datasets, establishing a scalable pathway for future advancements in atomistic materials modeling.

Li, Chaojian [ORNL] (ORCID:0000000340309777)↗

Diaspora: Resilience-Enabling Services for Real-Time Distributed Workflows

The need for real-time processing to enable automated decision making and experimental steering has driven a shift from high-performance computing workflows on a centralized system to a distributed approach that integrates remote data sources, edge devices, and diverse compute facilities. Under this paradigm, data can be processed close to the source where it is generated, thus reducing latency and bandwidth usage. System resilience is thus a key challenge, requiring distributed workflows to survive component failures and to meet stringent quality-of-service requirements, which results in the need to mitigate anomalies such as congestion and low availability of resources. To address these challenges, we propose Diaspora, a unified resilience framework that is inspired by event-driven communication patterns used in public clouds. Specifically, we propose an event fabric that extends across sites, facilities, and computations to provide timely, reliable, and accurate information about data, application, and resource status. On top of the event fabric, we build resilience-enabling services that combine QoS-aware data streaming, resilient data views, resilient compute and data resources, and anomaly detection and prediction, all of which collectively enhance workflow resilience for these scientific cases.

Rao, Nageswara↗

Optimal Management of Grid-Interactive Efficient Buildings via Safe Reinforcement Learning

Reinforcement learning (RL)-based methods have achieved significant success in managing grid-interactive efficient buildings (GEBs). However, RL does not carry intrinsic guarantees of constraint satisfaction, which may lead to severe safety consequences. Besides, in GEB control applications, most existing safe RL approaches rely only on the regularisation parameters in neural networks or penalty of rewards, which often encounter challenges with parameter tuning and lead to catastrophic constraint violations. To provide enforced safety guarantees in controlling GEBs, this paper designs a physics-inspired safe RL method whose decision-making is enhanced through safe interaction with the environment. Different energy resources in GEBs are optimally managed to minimize energy costs and maximize customer comfort. The proposed approach can achieve strict constraint guarantees based on prior knowledge of a set of developed hard steady-state rules. Simulations on the optimal management of GEBs, including heating, ventilation, and air conditioning (HVAC), solar photovoltaics, and energy storage systems, demonstrate the effectiveness of the proposed approach.

Huo, Xiang↗

Scaled-up Neuromorphic Array Communications Controller (SNACC) for Large-scale Neural Networks

Neuromorphic computing is one promising post-Moore’s law era technology, which takes inspiration from biological brains to perform computing tasks. The human brain contains billions of neurons with trillions of synapses and as neuromorphic hardware systems scale to larger and larger sizes, the communication system used to transfer information between neuromorphic elements and traditional computers must scale to keep up. In prior work, we describe the use of a separate neuromorphic array communications controller to support low-latency, high-throughput communication between our neuromorphic systems and a traditional computer. In this work, the neuromorphic array communications controller is used to support the scaling of a neuromorphic development system which uses multiple neuromorphic processors arranged in a two-dimensional array. The neuromorphic array communications controller, along with scalable local connections, is used to create a scalable neuromorphic platform to enable the development and testing of large neuromorphic network arrays.

Young, Aaron↗

Evolutionary NAS in Light of Model Stability for Accurate Continual Learning

Continual learning, the capability to learn new knowledge from streaming data without forgetting the previous knowledge, is a critical requirement for dynamic learning systems, especially for emerging edge devices such as self-driving cars and drones. However, continual learning is still facing the catastrophic forgetting problem. Previous work illustrate that model performance on continual learning is not only related to the learning algorithms but also strongly dependent on the inherited model, i.e., the model where continual learning starts. The better stability of the inherited model, the less catastrophic forgetting and thus, the inherited model should be elaborately selected. Inspired by this finding, we develop an evolutionary neural architecture search (ENAS) algorithm that emphasizes the Stability of the inherited model, namely ENAS-S. ENAS-S aims to find optimal architectures for accurate continual learning on edge devices. On CIFAR-10 and CIFAR-100, we present that ENAS-S achieves competitive architectures with lower catastrophic forgetting and smaller model size when learning from a data stream, as compared with handcrafted DNNs.

Du, Xiaocong↗