Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Information Theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Thermodynamics of signal transduction systems and fluctuation theorem in a signal cascade

Biochemical chain reactions are signal transduction cascades that can transmit biological information about the intracellular environment. In this study, we modelled a chain reaction as a code string for applying information theory. Herein, we assumed that cell signal transduction selects a strategy to maximize the transduced signal per signal event duration. To investigate the same, we calculated the information transmission capacity of the reaction chain by maximizing the average entropy production rate per reaction time, indicating the idea of the entropy coding method. Moreover, we defined a signal cascade trajectory. Subsequently, we found that the logarithm of the forward and reverse transition ratio per reaction time is equal to the entropy production rate, which derives the form of the fluctuation theorem in signal transduction. Our findings suggest the application of information entropy theory for analysing signal transduction.

59 BASIC BIOLOGICAL SCIENCES↗

Vibrational Entropy of Crystalline Solids from Covariance of Atomic Displacements

The vibrational entropy of a solid at finite temperature is investigated from the perspective of information theory. Ab initio molecular dynamics (AIMD) simulations generate ensembles of atomic configurations at finite temperature from which we obtain the N-body distribution of atomic displacements, ρN. We calculate the information-theoretic entropy from the expectation value of lnρN. At a first level of approximation, treating individual atomic displacements independently, our method may be applied using Debye–Waller B-factors, allowing diffraction experiments to obtain an upper bound on the thermodynamic entropy. At the next level of approximation we correct the overestimation through inclusion of displacement covariances. We apply this approach to elemental body-centered cubic sodium and face-centered cubic aluminum, showing good agreement with experimental values above the Debye temperatures of the metals. Below the Debye temperatures, we extract an effective vibrational density of states from eigenvalues of the covariance matrix, and then evaluate the entropy quantum mechanically, again yielding good agreement with experiment down to low temperatures. Our method readily generalizes to complex solids, as we demonstrate for a high entropy alloy. Further, our method applies in cases where the quasiharmonic approximation fails, as we demonstrate by calculating the HCP/BCC transition in Ti.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Evolution of Intent and Social Influence Networks and Their Significance in Detecting COVID-19 Disinformation Actors on Social Media

Online disinformation actors are those individuals or bots who disseminate false or misleading information over social media, with the intent to sway public opinion in the information domain towards harmful social outcomes. Quantification of the degree to which users post or respond intentionally versus under social influence, remains a challenge, as individuals or organizations operating the profile are foreshadowed by their online persona. However, social influence has been shown to be measurable in the paradigm of information theory. In this paper, we introduce an information theoretic measure to quantify social media user intent, and then investigate the corroboration of intent with evolution of the social network and detection of disinformation actors related to COVID-19 discussions on Twitter. Our measurement of user intent utilizes an existing time series analysis technique for estimation of social influence using transfer entropy among the considered users. We have analyzed 4.7 million tweets originating from several countries of interest, during a 5 month period when the arrival of the first dose of COVID vaccinations were announced. Our key findings include evidence that: (i) a significant correspondence between intent and social influence; (ii) ranking over users by intent and social influence is unstable over time with evidence of shifts in the hierarchical structure; and (iii) both user intent and social influence are important when distinguishing disinformation actors from non-disinformation actors.

Gunaratne, Chathika↗

Allosterically coupled conformational dynamics in solution prepare the sterol transfer protein StarD4 to release its cargo upon interaction with target membranes

Complex mechanisms regulate the cellular distribution of cholesterol, a critical component of eukaryote membranes involved in regulation of membrane protein functions directly and through the physiochemical properties of membranes. StarD4, a member of the steroidogenic acute regulator-related lipid-transfer (StART) domain (StARD)-containing protein family, is a highly efficient sterol-specific transfer protein involved in cholesterol homeostasis. Its mechanism of cargo loading and release remains unknown despite recent insights into the key role of phosphatidylinositol phosphates in modulating its interactions with target membranes. We have used large-scale atomistic Molecular dynamics (MD) simulations to study how the dynamics of cholesterol bound to the StarD4 protein can affect interaction with target membranes, and cargo delivery. We identify the two major cholesterol (CHL) binding modes in the hydrophobic pocket of StarD4, one near S136&S147 (the Ser-mode), and another closer to the putative release gate located near W171, R92&Y117 (the Trp-mode). We show that conformational changes of StarD4 associated directly with the transition between these binding modes facilitate the opening of the gate. To understand the dynamics of this connection we apply a machine-learning algorithm for the detection of rare events in MD trajectories (RED), which reveals the structural motifs involved in the opening of a front gate and a back corridor in the StarD4 structure occurring together with the spontaneous transition of CHL from the Ser-mode of binding to the Trp-mode. Further analysis of MD trajectory data with the information-theory based NbIT method reveals the allosteric network connecting the CHL binding site to the functionally important structural components of the gate and corridor. Mutations of residues in the allosteric network are shown to affect the performance of the allosteric connection. These findings outline an allosteric mechanism which prepares the CHL-bound StarD4 to release and deliver the cargo when it is bound to the target membrane.

59 BASIC BIOLOGICAL SCIENCES↗

Optimizing the accuracy of viscoelastic characterization with AFM force–distance experiments in the time and frequency domains

Atomic Force Microscopy (AFM) force-distance (FD) experiments have emerged as an attractive alternative to traditional micro-rheology measurement techniques owing to their versatility of use in materials of a wide range of mechanical properties. Here, we show that the range of time dependent behaviour which can reliably be resolved from the typical method of FD inversion (fitting constitutive FD relations to FD data) is inherently restricted by the experimental parameters: sampling frequency, experiment length, and strain rate. Specifically, we demonstrate that violating these restrictions can result in errors in the values of the parameters of the complex modulus. In the case of complex materials, such as cells, whose behaviour is not specifically understood a priori, the physical sensibility of these parameters cannot be assessed and may lead to falsely attributing a physical phenomenon to an artifact of the violation of these restrictions. We use arguments from information theory to understand the nature of these inconsistencies as well as devise limits on the range of mechanical parameters which can be reliably obtained from FD experiments. The results further demonstrate that the nature of these restrictions depends on the domain (time or frequency) used in the inversion process, with the time domain being far more restrictive than the frequency domain. Lastly, we demonstrate how to use these restrictions to better design FD experiments to target specific timescales of a material's behaviour through our analysis of a polydimethylsiloxane (PDMS) polymer sample.

information theory↗

Fermionic systems for quantum information people

The operator algebra of fermionic modes is isomorphic to that of qubits, the difference between them is twofold: the embedding of subalgebras corresponding to mode subsets and multiqubit subsystems on the one hand, and the parity superselection in the fermionic case on the other. We discuss these two fundamental differences extensively, and illustrate these through the Jordan–Wigner representation in a coherent, self-contained, pedagogical way, from the point of view of quantum information theory. Our perspective leads us to develop useful new tools for the treatment of fermionic systems, such as the fermionic (quasi-)tensor product, fermionic canonical embedding, fermionic partial trace, fermionic products of maps and fermionic embeddings of maps. We formulate these by direct, easily applicable formulas, without mode permutations, for arbitrary partitionings of the modes. It is also shown that fermionic reduced states can be calculated by the fermionic partial trace, containing the proper phase factors. We also consider variants of the notions of fermionic mode correlation and entanglement, which can be endowed with the usual, local operation based motivation, if the parity superselection rule is imposed. We also elucidate some other fundamental points, related to joint map extensions, which make the parity superselection inevitable in the description of fermionic systems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Active learning for robust, high-complexity reactive atomistic simulations

Machine learned reactive force fields based on polynomial expansions have been shown to be highly effective for describing simulations involving reactive materials. Nevertheless, the highly flexible nature of these models can give rise to a large number of candidate parameters for complicated systems. In these cases, reliable parameterization requires a well-formed training set, which can be difficult to achieve through standard iterative fitting methods. In this paper, we present an active learning approach based on cluster analysis and inspired by Shannon information theory to enable semi-automated generation of informative training sets and robust machine learned force fields. The use of this tool is demonstrated for development of a model based on linear combinations of Chebyshev polynomials explicitly describing up to four-body interactions, for a chemically and structurally diverse system of C/O under extreme conditions. We show that this flexible training database management approach enables development of models exhibiting excellent agreement with Kohn–Sham density functional theory in terms of structure, dynamics, and speciation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Measurement of Volatile Compounds for Real-Time Analysis of Soil Microbial Metabolic Response to Simulated Snowmelt

Snowmelt dynamics are a significant determinant of microbial metabolism in soil and regulate global biogeochemical cycles of carbon and nutrients by creating seasonal variations in soil redox and nutrient pools. With an increasing concern that climate change accelerates both snowmelt timing and rate, obtaining an accurate characterization of microbial response to snowmelt is important for understanding biogeochemical cycles intertwined with soil. However, observing microbial metabolism and its dynamics non-destructively remains a major challenge for systems such as soil. Microbial volatile compounds (mVCs) emitted from soil represent information-dense signatures and when assayed non-destructively using state-of-the-art instrumentation such as Proton Transfer Reaction-Time of Flight-Mass Spectrometry (PTR-TOF-MS) provide time resolved insights into the metabolism of active microbiomes. In this study, we used PTR-TOF-MS to investigate the metabolic trajectory of microbiomes from a subalpine forest soil, and their response to a simulated wet-up event akin to snowmelt. Using an information theory approach based on the partitioning of mutual information, we identified mVC metabolite pairs with robust interactions, including those that were non-linear and with time lags. The biological context for these mVC interactions was evaluated by projecting the connections onto the Kyoto Encyclopedia of Genes and Genomes (KEGG) network of known metabolic pathways. Simulated snowmelt resulted in a rapid increase in the production of trimethylamine (TMA) suggesting that anaerobic degradation of quaternary amine osmo/cryoprotectants, such as glycine betaine, may be important contributors to this resource pulse. Unique and synergistic connections between intermediates of methylotrophic pathways such as dimethylamine, formaldehyde and methanol were observed upon wet-up and indicate that the initial pulse of TMA was likely transformed into these intermediates by methylotrophs. Increases in ammonia oxidation signatures (transformation of hydroxylamine to nitrite) were observed in parallel, and while the relative role of nitrifiers or methylotrophs cannot be confirmed, the inferred connection to TMA oxidation suggests either a direct or indirect coupling between these processes. Overall, it appears that such mVC time-series from PTR-TOF-MS combined with causal inference represents an attractive approach to non-destructively observe soil microbial metabolism and its response to environmental perturbation.

59 BASIC BIOLOGICAL SCIENCES↗

Maximized Information Gain of Next Generation Pulsed Power Using Optimized Design of Z-Machine Experiments

This project develops a Bayesian optimization approach to extracting insights from Z Machine experimental data to determine if and how these insights can be used to extrapolate to a larger facility. The primary goal is to address the scientific challenge of informing how confidently experimental conditions can be predicted on a next generation facility, the design of which requires the reliable extrapolation of current high energy density technologies to regimes yet unobserved, except by costly high-fidelity computational models. Maximizing the use of presently available data and understanding how it informs future endeavors is critically important to enable transformative pulsed power and the science of extreme conditions. We explore a Bayesian optimization approach to experimental design which combines information theory, experimental data, and computational modeling to explore how information gain can be maximized.

97 MATHEMATICS AND COMPUTING↗

Fundamental limitations on photoisomerization from thermodynamic resource theories

Small, out-of-equilibrium, and quantum systems defy simple thermodynamic expressions. Such systems are exemplified by molecular switches, which exchange heat with a bath. These molecules can photoisomerize, or change conformation, or switch, on absorbing light. The photoisomerization probability depends on kinetic details that couple the molecule’s energetics to its dissipation. Therefore, a simple, general, thermodynamic-style bound on the photoisomerization probability seems out of reach. We derive such a bound using a resource theory. The resource-theory framework is a set of mathematical tools, developed in quantum information theory, used to generalize thermodynamics to small and quantum settings. From this toolkit has been derived a generalization of the second law, the thermomajorization preorder. We use thermomajorization to upper-bound the photoisomerization probability. Then, we compare the bound with an equilibrium prediction and with a Lindbladian model. We identify a realistic parameter regime in which the Lindbladian evolution saturates the thermomajorization bound. We also quantify the energy coherence in the electronic degree of freedom, and we argue that this coherence cannot promote photoisomerization. Overall, this work illustrates how quantum-information-theoretic thermodynamics can elucidate complex quantum processes in nature, experiments, and synthetics.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

The connected wedge theorem and its consequences

In the AdS/CFT correspondence, bulk causal structure has consequences for boundary entanglement. In quantum information science, causal structures can be replaced by distributed entanglement for the purposes of information processing. In this work, we deepen the understanding of both of these statements, and their relationship, with a number of new results. Centrally, we present and prove a new theorem, the n-to-n connected wedge theorem, which considers n input and n output locations at the boundary of an asymptotically AdS 2+1 spacetime described by AdS/CFT. When a sufficiently strong set of causal connections exists among these points in the bulk, a set of n associated regions in the boundary will have extensive-in-N mutual information across any bipartition of the regions. The proof holds in three bulk dimensions for classical spacetimes satisfying the null curvature condition and for semiclassical spacetimes satisfying standard conjectures. The n-to-n connected wedge theorem gives a precise example of how causal connections in a bulk state can emerge from large-N entanglement features of its boundary dual. It also has consequences for quantum information theory: it reveals one pattern of entanglement which is sufficient for information processing in a particular class of causal networks. We argue this pattern is also necessary, and give an AdS/CFT inspired protocol for information processing in this setting. Our theorem generalizes the 2-to-2 connected wedge theorem proven in [3]. We also correct some errors in the proof presented there, in particular a false claim that existing proof techniques work above three bulk dimensions.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Thoughts on Analyzing Neutron Multiplicity Data

Bayesian methods offer many advantages for analyzing neutron multiplicity data. Ideally one would make nonparametric estimates of the the posterior distributions, the probabilities - given the data - for unknowns to take on particular values. Once one has the posterior, uncertainty quantification is very natural. We describe how different ways of formulating the statistical theory of fission chains are mathematically equivalent. When confronted with actual data and the burden of finite statistics, different methods of expressing the theory offer advantages for understanding the underlying source parameters from an information theory standpoint.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Coherent elastic neutrino-nucleus scattering: Terrestrial and astrophysical applications

Coherent elastic neutrino-nucleus scattering (CE$\nu$NS) is a process in which neutrinos scatter on a nucleus which acts as a single particle. Though the total cross section is large by neutrino standards, CE$\nu$NS has long proven difficult to detect, since the deposited energy into the nucleus is $\sim$ keV. In 2017, the COHERENT collaboration announced the detection of CE$\nu$NS using a stopped-pion source with CsI detectors, followed up the detection of CE$\nu$NS using an Ar target. The detection of CE$\nu$NS has spawned a flurry of activities in high-energy physics, inspiring new constraints on beyond the Standard Model (BSM) physics, and new experimental methods. The CE$\nu$NS process has important implications for not only high-energy physics, but also astrophysics, nuclear physics, and beyond. This whitepaper discusses the scientific importance of CE$\nu$NS, highlighting how present experiments such as COHERENT are informing theory, and also how future experiments will provide a wealth of information across the aforementioned fields of physics.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Attribution of heterogeneous stress distributions in low-grain polycrystals under conditions leading to damage

In high-purity polycrystalline metallic materials, voids tend to favor grain boundaries as nucleation sites due to the elevated stress states produced by granular interactions and the weakened grain boundary from the relative atomic disorder. To quantify the key factors of this elevated stress state, simple compression of a small multi-grain cylinder of body-centered cubic tantalum was simulated using a single crystal plasticity model that incorporates non-Schmid effects. Four increasingly complex synthetic microstructures were created to tractably incorporate grain boundary interactions, and a statistically significant number of combinations were performed by varying the initial crystallographic orientations of the microstructure. Most of these simulations produce the maximum von Mises stress on a grain boundary and less frequently at the multi-grain junctions. To build a statistical model for the maximum von Mises stress at the grain boundary, physically based features that could contribute to the elevated stress state were selected. Then, a learning algorithm based on information theory was used to identify which of these features contributed the most information to the data set. The identified features include a grain’s propensity to accommodate both elastic and plastic deformations and their directional components. The misalignment of the direction of each grain’s mechanical response was found to be strongly correlated to the magnitude of the stress near the grain boundary. For all of the synthetic microstructures, the statistical models produce a residual distribution that is nearly Gaussian with a variance of, at most, 10% of the prior distribution. The successful performance of the statistical model implies the correct identification of the physical features that cause severe stress localization in polycrystalline materials. The statistical models constructed here can be used to formulate a physically motivated void nucleation model which is sensitive to a microstructure’s propensity to produce elevated stress states. As a result, these statistical models also enable the design of material microstructures, in which the crystallographic orientation is chosen to resist void nucleation.

36 MATERIALS SCIENCE↗

Bootstrapping quantum extremal surfaces. Part I. The area operator

Quantum extremal surfaces are central to the connection between quantum information theory and quantum gravity and they have played a prominent role in the recent progress on the information paradox. We initiate a program to systematically link these surfaces to the microscopic data of the dual conformal field theory, namely the scaling dimensions of local operators and their OPE coefficients. We consider CFT states obtained by acting on the vacuum with single-trace operators, which are dual to one-particle states of the bulk theory. Focusing on AdS 3 /CFT 2 , we compute the CFT entanglement entropy to second order in the large c expansion where quantum extremality becomes important and match it to the expectation value of the bulk area operator. We show that to this order, the Virasoro identity block contributes solely to the area operator.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Analysis and optimization of seismic monitoring networks with Bayesian optimal experimental design

SUMMARY Monitoring networks increasingly aim to assimilate data from a large number of diverse sensors covering many sensing modalities. Bayesian optimal experimental design (OED) seeks to identify data, sensor configurations or experiments which can optimally reduce uncertainty and hence increase the performance of a monitoring network. Information theory guides OED by formulating the choice of experiment or sensor placement as an optimization problem that maximizes the expected information gain (EIG) about quantities of interest given prior knowledge and models of expected observation data. Therefore, within the context of seismo-acoustic monitoring, we can use Bayesian OED to configure sensor networks by choosing sensor locations, types and fidelity in order to improve our ability to identify and locate seismic sources. In this work, we develop the framework necessary to use Bayesian OED to optimize a sensor network’s ability to locate seismic events from arrival time data of detected seismic phases at the regional-scale. This framework requires five elements: (i) A likelihood function that describes the distribution of detection and traveltime data from the sensor network, (ii) A prior distribution that describes a priori belief about seismic events, (iii) A Bayesian solver that uses a prior and likelihood to identify the posterior distribution of seismic events given the data, (iv) An algorithm to compute EIG about seismic events over a data set of hypothetical prior events, (v) An optimizer that finds a sensor network which maximizes EIG. Once we have developed this framework, we explore many relevant questions to monitoring such as: how to trade off sensor fidelity and earth model uncertainty; how sensor types, number and locations influence uncertainty; and how prior models and constraints influence sensor placement.

58 GEOSCIENCES↗

The entropy of galaxy spectra: how much information is encoded?

Abstract The inverse problem of extracting the stellar population content of galaxy spectra is analysed here from a basic standpoint based on information theory. By interpreting spectra as probability distribution functions, we find that galaxy spectra have high entropy, thus leading to a rather low effective information content. The highest variation in entropy is unsurprisingly found in regions that have been well studied for decades with the conventional approach. We target a set of six spectral regions that show the highest variation in entropy – the 4000 Å break being the most informative one. As a test case with real data, we measure the entropy of a set of high-quality spectra from the Sloan Digital Sky Survey, and contrast entropy-based results with the traditional method based on line strengths. The data are classified into star-forming (SF), quiescent (Q), and active galactic nucleus (AGN) galaxies, and show – independently of any physical model – that AGN spectra can be interpreted as a transition between SF and Q galaxies, with SF galaxies featuring a more diverse variation in entropy. The high level of entanglement complicates the determination of population parameters in a robust, unbiased way, and affects traditional methods that compare models with observations, as well as machine learning (especially deep learning) algorithms that rely on the statistical properties of the data to assess the variations among spectra. Entropy provides a new avenue to improve population synthesis models so that they give a more faithful representation of real galaxy spectra.

Ferreras, Ignacio (ORCID:0000000345843127)↗

Radioisotope Identification with List-Mode Gamma Ray Data: A rigorous assessment on the value of temporal information applied to radioisotope identification.

This work explores the potential of utilizing temporal data from gamma-ray detectors, known as list-mode data, to enhance radioisotope identification. Traditional identification methods, which rely on full gamma-ray spectrum analysis, often require long dwell times and struggle with “confuser” sources, or spectra with similarly spaced spectral peaks. We hypothesize that by leveraging the probabilistic nature of nuclear decay and the time-encoded information from decay sequences and interactions with surrounding materials, we can improve classification accuracy over static spectral analysis. This research rigorously examines the temporal content of list-mode data through exploratory data analysis via correlation discovery and information theory. We further propose a basic classification model that can utilize spectral or temporal data (or both) to determine if the incorporation of temporal information can improve radioisotope identification. The findings suggest that the temporal information present in list-mode gamma-ray data has merit and should be further investigated.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗