Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Information Theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Grid Topology Discovery Algorithm Evaluation of Suitability for Utility Deployment (CRADA 606 Final Report)

This work presents the results of a field-informed demonstration aimed at evaluating the practical suitability of a topology discovery algorithm for utility environments. We demonstrated an algorithm that uses a graph-theory-informed state estimation approach for model selection. In collaboration with Survalent and Peninsula Light Co., the algorithm was applied to real feeder models and field measurements from supervisory control and data acquisition (SCADA) and advanced metering infrastructure (AMI) systems to identify the operational topology of a power distribution system. The demonstration assessed the algorithm’s performance under realistic data conditions, including sparse and noisy measurements, and examined its ability to identify the most likely network configurations. The results confirmed that the approach can effectively narrow down feasible topologies, providing operators with improved situational awareness of network status. Key lessons learned emphasize the need for systematic data validation and strategic sensor placement to enhance observability. These insights inform future deployment strategies and guide refinements for broader adoption in utility operations.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Mutual-information based optimal experimental design for hyperpolarized $$^{13}$$C-pyruvate MRI

Abstract A key parameter of interest recovered from hyperpolarized (HP) MRI measurements is the apparent pyruvate-to-lactate exchange rate, $$k_{{\textrm PL}}$$ k P L , for measuring tumor metabolism. This manuscript presents an information-theory-based optimal experimental design approach that minimizes the uncertainty in the rate parameter, $$k_{{\textrm PL}}$$ k P L , recovered from HP-MRI measurements. Mutual information is employed to measure the information content of the HP measurements with respect to the first-order exchange kinetics of the pyruvate conversion to lactate. Flip angles of the pulse sequence acquisition are optimized with respect to the mutual information. A time-varying flip angle scheme leads to a higher parameter optimization that can further improve the quantitative value of mutual information over a constant flip angle scheme. However, the constant flip angle scheme, 35 and 28 degrees for pyruvate and lactate measurements, leads to an accuracy and precision comparable to the variable flip angle schemes obtained from our method. Combining the comparable performance and practical implementation, optimized pyruvate and lactate flip angles of 35 and 28 degrees, respectively, are recommended.

97 MATHEMATICS AND COMPUTING↗

Quantum entanglement correlations in double quark PDFs

Methods from Quantum Information Theory are used to scrutinize quantum correlations encoded in the two-quark density matrix over light-cone momentum fractions x 1 and x 2 . A nonperturbative three quark model light-cone wavefunction predicts significant nonclassical correlations associated with the “entanglement negativity” measure for asymmetric and small quark momentum fractions. We perform one step of QCD scale evolution of the entire density matrix, not just its diagonal (dPDF), by computing collinearly divergent corrections due to the emission of a gluon. Finally, we present first qualitative numerical results for single-step scale evolution of quantum entanglement correlations in double quark PDFs. At a higher Q 2 scale, the nonclassical correlations manifest in the dPDF for nearly symmetric momentum fractions.

Entanglement in field theory↗

Effect of Impurities on the Redox Properties of Goethite

Iron oxide minerals regulate the flux of electrons in the environment and are important hosts for trace and minor, yet critical, elements. Here, we present the first evidence of a direct link between the local coordination environments of Ni and Zn and the redox properties of their host phase goethite (α-FeOOH), the most abundant Fe(III) (oxyhydr)oxide at Earth’s surface. Here, we used aqueous redox measurements to show that the redox potential E H 0 , and hence the mineral’s stability, follows the order: pure goethite ≥ Zn-goethite > Ni-goethite. Parallel X-ray absorption and scattering measurements demonstrate, using quantum-informed analysis, that the local coordination environment of the smaller impurity, Ni, causes more bulk strain energy than Zn, which nearly accounts for the difference in E H 0 between Ni- and Zn-goethite. Our theory-informed, experimental study reveals how two common impurities affect the stability of goethite with implications for the biogeochemical reactivity of Fe(III) (oxyhydr)oxide in mediating elemental and electron fluxes in the environment.

42 ENGINEERING↗

Deforestation reshapes land-surface energy-flux partitioning

Land-use and land-cover change significantly modify local land-surface characteristics and water/energy exchanges, which can lead to atmospheric circulation and regional climate changes. In particular, deforestation accounts for a large portion of global land-use changes, which transforms forests into other land cover types, such as croplands and grazing lands. Many previous efforts have focused on observing and modeling land–atmosphere–water/energy fluxes to investigate land–atmosphere coupling induced by deforestation. However, interpreting land–atmosphere–water/energy-flux responses to deforestation is often complicated by the concurrent impacts from shifts in land-surface properties versus background atmospheric forcings. In this study, we used 29 paired FLUXNET sites, to improve understanding of how deforested land surfaces drive changes in surface-energy-flux partitioning. Each paired sites included an intact forested and non-forested site that had similar background climate. We employed transfer entropy, a method based on information theory, to diagnose directional controls between coupling variables, and identify nonlinear cause–effect relationships. Transfer entropy is a powerful tool to detective causal relationships in nonlinear and asynchronous systems. The paired eddy covariance flux measurements showed consistent and strong information flows from vegetation activity (gross primary productivity (GPP)) and physical climate (e.g. shortwave radiation, air temperature) to evaporative fraction (EF) over both non-forested and forested land surfaces. More importantly, the information transfers from radiation, precipitation, and GPP to EF were significantly reduced at non-forested sites, compared to forested sites. We then applied these observationally constrained metrics as benchmarks to evaluate the Energy Exascale Earth System Model (E3SM) land model (ELM). ELM predicted vegetation controls on EF relatively well, but underpredicted climate factors on EF, indicating model deficiencies in describing the relationships between atmospheric state and surface fluxes. Moreover, changes in controls on surface energy flux partitioning due to deforestation were not detected in the model. We highlight the need for benchmarking model simulated surface-energy fluxes and the corresponding causal relationships against those of observations, to improve our understanding of model predictability on how deforestation reshapes land surface energy fluxes.

54 ENVIRONMENTAL SCIENCES↗

Sub-quantum Fisher information

We report the quantum Fisher information (QFI) plays a crucial role in quantum information theory and in many practical applications such as quantum metrology. However, computing the QFI is generally a computationally demanding task. In this work we analyze a lower bound on the QFI which we call the sub-quantum Fisher information (sub-QFI). The bound can be efficiently estimated on a quantum computer for an n-qubit state using 2n qubits. The sub-QFI is based on the super-fidelity, an upper bound on Uhlmann's fidelity. We analyze the sub-QFI in the context of unitary families, where we derive several crucial properties including its geometrical interpretation. In particular, we prove that the QFI and the sub-QFI are maximized for the same optimal state, which implies that the sub-QFI is faithful to the QFI in the sense that both quantities share the same global extrema. Based on this faithfulness, the sub-QFI acts as an efficiently computable surrogate for the QFI for quantum sensing and quantum metrology applications. Finally, we provide additional meaning to the sub-QFI as a measure of coherence, asymmetry, and purity loss.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Automation of Vulnerability and Patch Management: Information Extraction, Association, and Optimization

Vulnerability and patch management is an integral part of a robust cybersecurity program, yet it grows increasingly complex due to the sheer amount of data that must be analyzed. Particularly in Operational Technology (OT) environments, analysis must be done manually because of the lack of automated solutions. Additionally, there are many steps in this process, from the initial discovery of the vulnerability to the implementation of its remediation, and each step in the process requires different data in order to be performed effectively. In this work, we provide approaches and strategies to assist operators in industrial or OT environments throughout the vulnerability management cycle. Security advisories provide key information about mitigation strategies, or actions that can be taken when a patch is unavailable or cannot be installed. Details of these strategies are not shared in public vulnerability databases and must be found manually. We approach this problem by designing a solution to automatically identify that information within vendor security advisories and retrieve it for operator use. We start with an approach that requires domain-specific knowledge of certain frequently-seen reference websites. Next, an approach that can work on an arbitrary website but relies on certain keywords. Finally, an approach that uses Natural Language Processing (NLP) methods and does not require specific knowledge or keywords. Each of these approaches is more general than its predecessor; we demonstrate high accuracy for all approaches Advisories also often contain details of affected products in non-standard or natural language formats. While this information can be easily understood when read by an operator, the non-standard format acts as a barrier to effective automation. We provide an approach for the first step in this process: identifying vendors in security advisories and mapping them to a standard framework for representing digital assets and software products. We evaluate five established string similarity algorithms, plus one of our own design that combines string similarity and information theory, on the task of mapping vendors to their corresponding entries in the Common Platform Enumeration (CPE) repository. Our results show that our proposed metric outperforms all others. Due to the constraints on time, finances, and personnel for organizations, Large Language Models (LLMs) may seem like attractive opportunities for security operators to speed up information gathering; however, it is still not clear whether LLMs can handle vulnerability management tasks well. To answer this question, we perform an empirical study of LLMs’ ability to provide consistent, accurate information about vulnerabilities in order to guide organizations in their adoption of LLMs. We observe poor performance for all models tested, suggesting that these models are not well-suited to the consistent retrieval of accurate vulnerability information. Finally, once vulnerabilities have been identified and any additional information has been obtained, operators must decide which remediation actions to implement based on their available resources. This already-complex problem becomes even more so when we consider that a vulnerability may have multiple avenues for remediation. We formulate this scenario as two knapsack problems and provide solutions, which we then compare against several existing strategies for vulnerability prioritization seen in real operational environments.

McClanahan, Kylie↗

Theoretically Informed Kinetics (ThInK): Establishing a modern C 0 -C 3 mechanism for combustion modeling

In contrast to the adage “Models are to be used, not believed”, combustion kinetics models have been intended to be predictive in nature. Theoretical chemical kinetics is now understood to provide a firm foundation for the reaction parameters, thereby facilitating predictive simulations of chemical reactivity, even in regimes that are poorly characterized by chemical kinetic and/or combustion experiments. In this study, we describe a theory-informed kinetics model (ThInK) for small molecule combustion chemistry (H 2 and C 1 – C 3 species) that is based on the prodigious use of theoretical predictions for reaction rate coefficients, thermochemistry, and transport parameters. The distinct features of this kinetics model, which was developed over the course of several decades, are illustrated through simulations of flame propagation and auto-ignition.

Energy transfer↗

A non-commutative Bayes' theorem

Using a diagrammatic reformulation of Bayes' theorem, we provide a necessary and sufficient condition for the existence of Bayesian inference in the setting of finite-dimensional C* -algebras. In other words, we prove an analogue of Bayes' theorem in the joint classical and quantum context. Our analogue is justified by recent advances in categorical probability theory, which have provided an abstract formulation of the classical Bayes' theorem. In the process, we further develop non-commutative almost everywhere equivalence and illustrate its important role in non-commutative Bayesian inversion. The construction of such Bayesian inverses, when they exist, involves solving a positive semidefinite matrix completion problem for the Choi matrix. This gives a solution to the open problem of constructing Bayesian inversion for completely positive unital maps acting on density matrices that do not have full support. In conclusion, we illustrate how the procedure works for several examples relevant to quantum information theory.

97 MATHEMATICS AND COMPUTING↗

Qudit Designs and Where to Find Them

Unitary t-designs are some of the most versatile tools in quantum information theory. Their applications range from randomized benchmarking and shadow tomography, to more fundamental ones such as emulating quantum chaos and establishing exponential separations between classical and quantum query complexity. While unitary designs originating from a group structure, such as the Clifford group, have proven to be incredibly useful for qubit systems, unfortunately, this is no longer true for qudits. In fact, the classification of finite-group representations rules out the existence of unitary 2-designs for arbitrary qudit dimensions. This severely limits the applicability of standard quantum information primitives when it comes to qudit systems. We overcome these limitations with a three-fold contribution. First, we introduce a general technique to construct families of weighted state t-designs in arbitrary qudit dimensions. These weighted state-designs generalize classical shadow tomography protocol from qubits to qudits. Second, we introduce a Clifford character RB that allows us to benchmark the qudit Clifford group in any dimension, including non-prime-power dimensions. And third, we establish bounds on the quantum circuit complexity of generating approximate unitary-designs from native gates in existing quantum hardware such as high-spin and cavity-QED qudits. Our work further highlights the analogy between spin and optical coherent states by proving that spin-GKP codewords form a state 2-design while spin coherent states do not; in direct analogy with the optical case. This work is structured as a pedagogical and self-contained introduction to unitary designs and their applications to qudit systems.

Anand, Namit [NASA, Ames; Unlisted, US] (ORCID:000↗

Witnessing Entanglement and Quantum Correlations in Condensed Matter: A Review

The detection and certification of entanglement and quantum correlations in materials is of fundamental and far-reaching importance, and has seen significant recent progress. It impacts both the understanding of the basic science of quantum many-body phenomena as well as the identification of systems suitable for novel technologies. Frameworks suitable to condensed matter that connect measurements to entanglement and coherence have been developed in the context of quantum information theory. These take the form of entanglement witnesses and quantum correlation measures. Here, the underlying theory of these quantities, their relation to condensed matter experimental techniques, and their application to real materials are comprehensively reviewed. In addition, their usage in, e.g., protocols, the relative advantages and disadvantages of witnesses and measures, and future prospects in, e.g., correlated electrons, entanglement dynamics, and entangled spectroscopic probes, are presented. Consideration is given to the interdisciplinary nature of this emerging research and substantial ongoing progress by providing an accessible and practical treatment from fundamentals to application. Particular emphasis is placed on quantities accessible to collective measurements, including by susceptibility and spectroscopic techniques. This includes the magnetic susceptibility witness, one-tangle, concurrence and two-tangle, two-site quantum discord, and quantum coherence measures such as the quantum Fisher information.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Parallel-in-time quantum simulation via Page and Wootters quantum time

In the past few decades, researchers have created a veritable zoo of quantum algorithms by drawing inspiration from classical computing, information theory, and even from physical phenomena. Here, we present quantum algorithms for parallel-in-time simulations that are inspired by the Page and Wootters formalism. In this framework, and thus in our algorithms, the classical time variable of quantum mechanics is promoted to the quantum realm by introducing a Hilbert space of “clock” qubits that are then entangled with the “system” qubits. We show that our algorithms can compute temporal properties over 𝑁 different times of many-body systems by only using log⁡(𝑁) clock qubits. As such, we achieve an exponential trade-off between time and spatial complexities. In addition, we rigorously prove that the entanglement created between the system qubits and the clock qubits has operational meaning, as it encodes valuable information about the system’s dynamics. We also provide a circuit depth estimation of all the protocols, showing a running time advantage in computation times over traditional sequential-in-time algorithms. In particular, for the case when the dynamics are determined by the Aubry-Andre model, we present a hybrid method for which our algorithms have a depth that only scales as 𝒪⁡(log⁡(𝑁)⁢𝑛). As a by-product, we can relate the previous schemes to the problem of equilibration of an isolated quantum system, thus indicating that our framework enables a new dimension for studying dynamical properties of many-body systems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

The expressivity of classical and quantum neural networks on entanglement entropy

Abstract Analytically continuing the von Neumann entropy from Rényi entropies is a challenging task in quantum field theory. While then-th Rényi entropy can be computed using the replica method in the path integral representation of quantum field theory, the analytic continuation can only be achieved for some simple systems on a case-by-case basis. In this work, we propose a general framework to tackle this problem using classical and quantum neural networks with supervised learning. We begin by studying several examples with known von Neumann entropy, where the input data is generated by representing$${\text {Tr}}\rho _A^n$$ Tr ρ A n with a generating function. We adopt KerasTuner to determine the optimal network architecture and hyperparameters with limited data. In addition, we frame a similar problem in terms of quantum machine learning models, where the expressivity of the quantum models for the entanglement entropy as a partial Fourier series is established. Our proposed methods can accurately predict the von Neumann and Rényi entropies numerically, highlighting the potential of deep learning techniques for solving problems in quantum information theory.

Physics↗

Ensemble Effects on Hydroxide Bond Dissociation Free Energies in Polyoxovanadate Clusters

Understanding structure-property relationships is foundational to numerous modern chemistries, such as proton-coupled electron transfer (PCET). However, an experimentally measured property is the result of the behavior from an ensemble of molecules. Neglecting ensemble effects, especially under complex chemical environments, may obfuscate these relationships and lead to discrepancies between theory and experiment. In this work, we demonstrate the impact of configurational entropy and local chemical environments on hydroxide bond dissociation free energies [BDFE- (O−H)] for a set of polyoxovanadate nanoclusters, at ambient conditions. The O−H bond strengths are investigated via density functional theory (DFT) coupled with statistical thermodynamic analysis and bilinear modeling, and compared with previous experimental results on the same systems, namely electrochemical solutions of: [V 6 O 13−x (OH) x (TRIOL R ) 2 ] −2 (x = 2, 4, 6; R = NO 2 , Me) and [V 6 O 11−x (OMe) 2 (OH) x (TRIOL NO 2 ) 2 ] −2 (x = 2, 4). Interestingly, we find that ensemble effects, even at room temperature, can account for a significant portion of the BDFE(O−H) trend with the degree of reduction via H atom binding, which cannot be fully captured by single-structure, static DFT calculations. Moreover, we find that the ensemble effects may be replicated statistically, requiring only enumeration of energetically accessible H-binding sites. With the ensemble effects resolved, we present a simple bilinear model to reconcile remaining biases between experiment and ensemble-informed theory, which corelate with clusterspecific electronic environment differences. The bilinear model achieves outstanding accuracy vs experiments with a root-mean squared error of 0.4 kcal/mol. Finally, based on the physicochemical characteristics of hydrogen interaction with polyoxometalates, we present a simple methodology that captures the BDFE(O−H) trend while dramatically reducing required DFT calculations by 98% and achieving accuracy within 1 kcal/mol. Overall, this work elucidates the roles and structural origins of configurational entropy and chemical effects on polyoxometalate hydroxide bond energies, with potential applicability to various atomically precise metal oxide systems. Importantly, it introduces models for rapid and highly accurate property calculations in connection with experiments.

Cluster chemistry↗

A robust estimator of mutual information for deep learning interpretability

Abstract We develop the use of mutual information (MI), a well-established metric in information theory, to interpret the inner workings of deep learning (DL) models. To accurately estimate MI from a finite number of samples, we present GMM-MI (pronounced ‘Jimmie’), an algorithm based on Gaussian mixture models that can be applied to both discrete and continuous settings. GMM-MI is computationally efficient, robust to the choice of hyperparameters and provides the uncertainty on the MI estimate due to the finite sample size. We extensively validate GMM-MI on toy data for which the ground truth MI is known, comparing its performance against established MI estimators. We then demonstrate the use of our MI estimator in the context of representation learning, working with synthetic data and physical datasets describing highly non-linear processes. We train DL models to encode high-dimensional data within a meaningful compressed (latent) representation, and use GMM-MI to quantify both the level of disentanglement between the latent variables, and their association with relevant physical quantities, thus unlocking the interpretability of the latent representation. We make GMM-MI publicly available in this GitHub repository.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Entanglement Cost for Infinite-Dimensional Physical Systems

We prove that the entanglement cost equals the regularized entanglement of formation for any infinite-dimensional quantum state ρ ΑΒ with finite quantum entropy on at least one of the subsystems A or B. This generalizes a foundational result in quantum information theory that was previously formulated only for operations and states on finite-dimensional systems. The extension to infinite-dimensional systems is nontrivial because the conventional tools for establishing both the direct and converse bounds, i.e., strong typicality, monotonicity, and asymptotic continuity, are no longer directly applicable. To address this problem, we construct a new entanglement dilution protocol for infinite-dimensional states implementable by local operations and a finite amount of one-way classical communication (one-way LOCC), using weak and strong typicality multiple times. We also prove the optimality of this protocol among all protocols, even under infinite-dimensional separable operations, by developing an argument based on alternative forms of monotonicity and asymptotic continuity of the entanglement of formation for infinite-dimensional states. Along the way, we derive a new integral representation for the quantum entropy of infinite-dimensional states, which we believe to be of independent interest. Our results allow us to fully characterize an important operational entanglement measure—the entanglement cost—for all infinite-dimensional physical systems.

Complexity↗

Can machine learning accelerate process understanding and decision‐relevant predictions of river water quality?

Abstract The global decline of water quality in rivers and streams has resulted in a pressing need to design new watershed management strategies. Water quality can be affected by multiple stressors including population growth, land use change, global warming, and extreme events, with repercussions on human and ecosystem health. A scientific understanding of factors affecting riverine water quality and predictions at local to regional scales, and at sub‐daily to decadal timescales are needed for optimal management of watersheds and river basins. Here, we discuss how machine learning (ML) can enable development of more accurate, computationally tractable, and scalable models for analysis and predictions of river water quality. We review relevant state‐of‐the art applications of ML for water quality models and discuss opportunities to improve the use of ML with emerging computational and mathematical methods for model selection, hyperparameter optimization, incorporating process knowledge into ML models, improving explainablity, uncertainty quantification, and model‐data integration. We then present considerations for using ML to address water quality problems given their scale and complexity, available data and computational resources, and stakeholder needs. When combined with decades of process understanding, interdisciplinary advances in knowledge‐guided ML, information theory, data integration, and analytics can help address fundamental science questions and enable decision‐relevant predictions of riverine water quality.

54 ENVIRONMENTAL SCIENCES↗

Schrödinger evolution of two-dimensional black holes

This paper systematically treats the evolving quantum state for two-dimensional black holes, with particular focus on the CGHS model, but also elucidating features generalizing to higher dimensions. This is done in Schrödinger picture(s), to exhibit the dynamic evolution of the state at intermediate times. After a review of classical solutions, also connecting to descriptions of higher-dimensional black holes, it overviews the canonical quantum treatment of the full evolution, including gravitational dynamics. Derived in an approximation to this, following conversion to “perturbation picture”, is the evolution of the quantum matter on the background geometry. Features of the evolving matter state are described, based on choice of a time slicing to put the evolution into ADM form. The choices of slicing as well as coordinates on the slices result in different quantum “pictures” for treating the evolution. If such a description is based on smooth trans-horizon slices, that avoids explicit reference to ultra-planckian modes familiar from traditional treatments, and exhibits the Hawking excitations as emerging from a “quantum atmosphere” with thickness comparable to the inverse temperature. Detailed study of the state exhibits the entanglement structure between Hawking quanta and the partner excitations inside the black hole, and the corresponding “missing information”. This explicit description also allows direct study of the evolution and features, e.g. as seen by infalling observers, of these partner excitations, helping to address various puzzles with them. Explicit treatment of the evolving state, and its extension to higher dimensions, provides further connections to information theory and a starting point for study of corrections that can unitarize evolution, arising from new quantum gravity effects — whether wormholes or something entirely different.

2D Gravity↗