Improving convolutional neural networks for cosmological fields with random permutation
Not provided.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Not provided.
Early detection of outbreaks caused by emergent pathogens, using epidemiological surveillance data i.e., daily case counts, is difficult. This is because the data tend to be noisy during the early epoch of the outbreak. In contrast, the spread-rate of the disease tends to be well-behaved, as it depends only on the mixing patterns of the population and the characteristics of the pathogen, neither of which behave erratically in space-time. In this report, we explore whether the spread-rate can be used for epidemiological surveillance, conditional on case count data. Estimating the spread-rate from case count data allows us to exploit exogenous information, e.g., incubation period distributions etc., which can considerably smooth out any erratic temporal behavior. Further, epidemiological dynamics are spatially correlated, and if case counts are available for multiple areal units e.g., counties, these correlations could potentially be used to suppress noise in the early epoch data. These exogenous information and structure are not exploited by conventional syndromic surveillance detectors to extract a well-behaved latent variable for monitoring purposes. The technical challenge lies in the estimation of the spread-rate field jointly over a collection of areal units; further, the spread-rate varies over time. We develop a method based on mean-field variational inference to approximately estimate the spread-rate field, using a Gaussian Random Field Model for spatial regularization. The method is tested on the estimation of spread-rate in the thirty-three counties of New Mexico and detect the arrival of the Fall 2020 COVID-19 wave in September 2020. We find that the method is scalable, but underestimates the uncertainty in the estimated spread-rate field. We detect the arrival of the Fall 2020 wave a week ahead of conventional syndromic surveillance algorithms, but our simplistic detection algorithm, based on simple anomaly detection, suffers from a high false positive rate, similar to conventional detectors.
Here we present the Probabilistic Context Neighborhood model designed for two-dimensional lattices as a variation of a Markov random field assuming discrete values. In this model, the neighborhood structure has a fixed geometry but a variable order, depending on the neighbors’ values. Our model extends the Probabilistic Context Tree model, originally applicable to one-dimensional space. It retains advantageous properties, such as representing the dependence neighborhood structure as a graph in a tree format, facilitating an understanding of model complexity. Furthermore, we adapt the algorithm used to estimate the Probabilistic Context Tree to estimate the parameters of the proposed model. We illustrate the accuracy of our estimation methodology through simulation studies. Additionally, we apply the Probabilistic Context Neighborhood model to spatial real-world data, showcasing its practical utility.
ABSTRACT The power spectrum of the non-linearly evolved large-scale mass distribution recovers only a minority of the information available on the mass fluctuation amplitude. We investigate the recovery of this information in 2D ‘slabs’ of the mass distribution averaged over ≈100 h−1 Mpc along the line of sight, as might be obtained from photometric redshift surveys. We demonstrate a Hamiltonian Monte Carlo method to reconstruct the non-Gaussian mass distribution in slabs, under the assumption that the projected field is a point-transformed Gaussian random field, Poisson-sampled by galaxies. When applied to the Quijote N-body suite at z = 0.5 and at a transverse resolution of 2 h−1 Mpc, the method recovers ∼30 times more information than the 2D power spectrum in the well-sampled limit, recovering the Gaussian limit on information. At a more realistic galaxy sampling density of 0.01 h3 Mpc−3, shot noise reduces the information gain to a factor of 5 improvement over the power spectrum at resolutions of 4 h−1 Mpc or smaller.
The ramp-reversal memory (RRM) effect in metal–insulator transition metal oxides (TMOs), a non-volatile resistance change induced by repeated temperature cycling, has attracted considerable interest in neuromorphic computing and non-volatile memory devices. Our previous defect motion model successfully explained RRM in vanadium dioxide (VO 2 ), capturing observed critical temperature shifts and memory accumulation throughout the sample. However, this approach lacked interactions between metallic and insulating domains. Here, we extend our model by combining a correlated Random Field Ising Model with defect diffusion-segregation, enabling accurate hysteresis modeling while predicting the relationship between RRM and domain interactions. Our simulations demonstrate that the maximum RRM occurs when the turnaround temperature approaches the inflection point. This peak in RRM vs. turnaround temperature is consistent with prior transport measurements, as well as our own optical measurements reported here. Significantly, we find that increasing nearest-neighbor interactions enhances the maximum memory effect, thus providing a clear mechanism for optimizing RRM performance. Since our model employs minimal assumptions, we predict that RRM should be a widespread phenomenon in materials exhibiting patterned phase coexistence of electronic domains. This work not only advances fundamental understanding of memory behavior in TMOs but also establishes a much-needed theoretical framework for optimizing device applications.
We present a topological analysis of the temperature fluctuation maps from the Planck 2020 Data Release 4 NPIPE dataset and the Planck 2018 Data Release 3 FFP10 dataset. We performed a multiscale analysis in terms of the homology characteristics of the maps, invoking relative homology to account for the analysis in the presence of masks. We performed our analysis for a range of smoothing scales spanning sub- and super-horizon scales corresponding to a full width at half maximum (FWHM) of 5',10',20',40',80',160',320', and 640', and employed simulations based on the standard model for comparison, which assumes the initial fluctuation field to be an isotropic and homogeneous Gaussian random field. Examining the behavior of topological components, represented by the 0D homology group, we find the observations to be approximately 2σ or less deviant from the simulations for all resolutions and scales for the NPIPE dataset. For the FFP10 dataset, we detect a 2.96σ deviation between the observations and simulations at N = 128, FWHM = 80'. For the topological loops, represented by the first homology group, the simulations and observations are consistent within 2σ for most resolutions and scales for both the datasets. However, for the NPIPE dataset, we observe a high deviation between the observation and simulations in the number of loops at FWHM = 320', but at a low dimensionless threshold ν = –2.5. Under a Gaussian assumption, this would amount to a deviation of ~4σ. However, the distribution in this bin is manifestly non-Gaussian and does not obey Poisson statistics either. In the absence of a true theoretical understanding, we simply note that the significance is higher than what may be resolved by 600 simulations, yielding an empirical p-value of at most 0.0016. Specifically in this case, our tests indicate that the numbers arise from a statistically stable regime, despite being based on small numbers. For the FFP10 dataset, the differences are not as strong as for the NPIPE dataset, indicating a 2.77σ deviation at this resolution and threshold. The Euler characteristic, which is the alternating sum of the ranks of relative homology groups, reflects the deviations in the components and loops. To assess the significance of combined levels for a given scale, we employed the empirical and theoretical versions of the χ 2 test as well as the nonparametric Tukey depth test. Although all statistics exhibit a stable distribution, we favor the empirical version of the χ 2 test in the final interpretation, as it indicates the most conservative differences. For the NPIPE dataset, we find that the components and loops differ at more than 95%, but agree within the 99% confidence level with respect to the base model at N = 32, FWHM = 320'. The Euler characteristic at this resolution displays a per mil deviation. In contrast, the FFP10 dataset shows that the observations are consistent with the base model within the 95% confidence level, at this and smaller scales. This is consistent with the observations of the Planck analysis pipeline via Minkowski functionals. For the largest smoothing scale, N = 16, FWHM = 640', both datasets exhibit an anomalous behavior of the loops, where FFP10 data exhibit a deviation that is larger by an order of magnitude than that of the NPIPE dataset. In contrast, the values for the topological components and the Euler characteristic agree between observations and model to within a confidence level of 99%. However, for the largest scales, the statistics are based on low numbers and may have to be regarded with caution. Even though both datasets exhibit mild to significant discrepancies, they also exhibit contrasting behaviors at various instances. Therefore, we do not find it feasible to convincingly accept or reject the null hypothesis. Disregarding the large-scale anomalies that persist at similar scales in WMAP and Planck, observations of the cosmic microwave background are largely consistent with the standard cosmological model within 2σ.
In this paper, we present a method for estimating the infection-rate of a disease as a spatial-temporal field. Our data comprises time-series case-counts of symptomatic patients in various areal units of a region. We extend an epidemiological model, originally designed for a single areal unit, to accommodate multiple units. The field estimation is framed within a Bayesian context, utilizing a parameterized Gaussian random field as a spatial prior. We apply an adaptive Markov chain Monte Carlo method to sample the posterior distribution of the model parameters condition on COVID-19 case-count data from three adjacent counties in New Mexico, USA. Our results suggest that the correlation between epidemiological dynamics in neighboring regions helps regularize estimations in areas with high variance (i.e., poor quality) data. Using the calibrated epidemic model, we forecast the infection-rate over each areal unit and develop a simple anomaly detector to signal new epidemic waves. Our findings show that anomaly detector based on estimated infection-rates outperforms a conventional algorithm that relies solely on case-counts.
We present measurements of the Minkowski functionals extracted from the SDSS-III BOSS catalogs. After defining the Minkowski functionals, we describe how an unbiased reconstruction of these statistics can be obtained from a field with masked regions and survey boundaries, validating our methodology with Gaussian random fields and mock galaxy snapshot data. From the BOSS galaxy data, we generate a set of four density fields in three dimensions corresponding to the northern and southern skies of LOWZ and CMASS catalogs, smoothing over large scales (Gaussian smoothing scale of 35 Mpc) such that the field is perturbatively non-Gaussian. We extract the Minkowski functionals from each data set separately, and measure their shapes and amplitudes by fitting a Hermite polynomial expansion. For the shape parameter of the Minkowski functional curves a0, that is related to the bispectrum of the field, we find that the LOWZ-South data presents a systematically lower value of a 0 = –0.080 ± 0.040 than its northern sky counterpart a 0 = 0.032 ± 0.024. Although the significance of this discrepancy is not very high, it potentially indicates some systematics in the data or that the matter density field exhibits anisotropy at low redshift. By assuming a standard isotropic flat ΛCDM cosmology, the amplitudes of the Minkowski functionals from the combination of northern and southern sky data give the constraints Ω c h 2 n s = 0.110 ± 0.006 and 0.111 ± 0.008 for CMASS and LOWZ, respectively, which is in agreement with the Planck ΛCDM best-fit Ω c h 2 n s = 0.116 ± 0.001.
This paper reviews current theoretical and numerical approaches to optimization problems governed by partial differential equations (PDEs) that depend on random variables or random fields. Such problems arise in many engineering, science, economics and societal decision-making tasks. This paper focuses on problems in which the governing PDEs are parametrized by the random variables/fields, and the decisions are made at the beginning and are not revised once uncertainty is revealed. Examples of such problems are presented to motivate the topic of this paper, and to illustrate the impact of different ways to model uncertainty in the formulations of the optimization problem and their impact on the solution. A linear–quadratic elliptic optimal control problem is used to provide a detailed discussion of the set-up for the risk-neutral optimization problem formulation, study the existence and characterization of its solution, and survey numerical methods for computing it. Different ways to model uncertainty in the PDE-constrained optimization problem are surveyed in an abstract setting, including risk measures, distributionally robust optimization formulations, probabilistic functions and chance constraints, and stochastic orders. Furthermore, approximation-based optimization approaches and stochastic methods for the solution of the large-scale PDE-constrained optimization problems under uncertainty are described. Some possible future research directions are outlined.
Unidirectional spin Hall magnetoresistance (USMR) has been widely reported in the heavy metal/ferromagnet bilayer systems. We observe the USMR in Pt/α-Fe 2 O 3 bilayers where the α-Fe 2 O 3 is an antiferromagnetic (AFM) insulator. Systematic field and temperature dependent measurements confirm the magnonic origin of the USMR. The appearance of AFM-USMR is driven by the imbalance of creation and annihilation of AFM magnons by spin orbit torque due to the thermal random field. However, unlike its ferromagnetic counterpart, theoretical modeling reveals that the USMR in Pt/α-Fe 2 O 3 is determined by the antiferromagtic magnon number with a non-monotonic field dependence. In conclusion, our findings extend the generality of the USMR which pave the ways for the highly sensitive detection of AFM spin state.
Images of black holes encode both astrophysical and gravitational properties. Detecting highly lensed features in images can differentiate between these two effects. We present an accretion disk emission model coupled to the Adaptive Analytical Ray Tracing (AART) code that allows a fast parameter space exploration of black hole photon ring images produced from synchrotron emission from 10 to 670 GHz. As an application, we systematically study several disk models and compute their total flux density, average radii, and optical depth. The model parameters are chosen around fiducial values calibrated to general relativistic magnetohydrodynamic (GRMHD) simulations and observations of M87*. For the parameter space studied, we characterize the transition between optically thin and thick regimes and the frequency at which the first photon ring is observable. Our results highlight the need for careful definitions of photon ring radius in the image domain, as in certain models the highly lensed photon ring is dimmer than the direct emission at certain angles. We find that at low frequencies the ring radii are set by the electron temperature, while at higher frequencies the magnetic field strength plays a more significant role, demonstrating how multifrequency analysis can also be used to infer plasma parameters. Lastly, we show how our implementation can qualitatively reproduce multifrequency black hole images from GRMHD simulations when adding time variability to our disk model through Gaussian random fields. This approach provides a new method for simulating observations from the Event Horizon Telescope and the proposed Black Hole Explorer space mission.
Abstract Interfacial proximity effects in antiferromagnetic/ferromagnetic (AFM/FM) bilayers control the exchange‐bias (EB) phenomena exploited in most spintronic devices, although still is lack of full understanding. Discordant results, including different exchange‐bias field ( H E ), coercivity ( H C ), or blocking temperature ( T B ) found even in similar systems, are usually ascribed to uncontrolled parameters, namely dissimilar interfacial defects, structure, and thicknesses. Here, it is shown in the very same sample that the magnetic domain structure during the magnetization reversal of the FM layer controls those mentioned effects. Simultaneous transport and vectorial‐resolved magnetic measurements performed in a V 2 O 3 /Co system during warming after different field cooling (FC) procedures exhibit a strong dependence on the FC angle and the domain structure of the FM layer. Remarkably, magnetization reversal analysis reveals 35 K of variation in T B and up to a factor of two in H E . These observations can be explained within the random‐field model for the interfacial exchange coupling with a fixed AFM domain structure in contact with a variable (angle‐dependent) FM domain structure. The results highlight the importance of the domain structure and magnetization reversal of the FM layer (not previously considered) in the EB phenomena, with potential to tailor interfacial effects in future spintronic devices.
The capabilities of image probe experiments are rapidly expanding, providing new information about quantum materials on unprecedented length- and timescales. Many such materials feature inhomogeneous electronic properties with intricate pattern formation on the observable surface. This rich spatial structure contains information about interactions, dimensionality, and disorder—a spatial encoding of the Hamiltonian driving the pattern formation. Image recognition techniques from machine learning are an excellent tool for interpreting information encoded in the spatial relationships in such images. Here, we develop a deep learning framework for using the rich information available in these spatial correlations in order to discover the underlying Hamiltonian driving the patterns. We first vet the method on a known case, scanning near-field optical microscopy on a thin film of VO 2 . We then apply our trained convolutional neural network architecture to new optical microscope images of a different VO 2 film as it goes through the metal-insulator transition. We find that a two-dimensional Hamiltonian with both interactions and random field disorder is required to explain the intricate, fractal intertwining of metal and insulator domains during the transition. This detailed knowledge about the underlying Hamiltonian paves the way for using the model to control the pattern formation via, e.g., tailored hysteresis protocols. Finally, we also introduce a distribution-based confidence measure on the results of a multilabel classifier, which does not rely on adversarial training. In addition, we propose a machine-learning-based criterion for diagnosing a physical system's proximity to criticality.
The classical field approximation is widely used to better understand the predictions of ultralight dark matter. Here, in this work, we use the truncated Wigner approximation method to test the classical field approximation of ultralight dark matter. This method approximates a quantum state as an ensemble of independently evolving realizations drawn from its Wigner function. The method is highly parallelizable and allows the direct simulation of quantum corrections and decoherence times in systems many times larger than have been previously studied in reference to ultralight dark matter. Our study involves simulation of systems in 1, 2, and 3 spatial dimensions. We simulate three systems, the condensation of a Gaussian random field in three spatial dimensions, a stable collapsed object in three spatial dimensions, and the merging of two stable objects in two spatial dimensions. We study the quantum corrections to the classical field theory in each case. We find that quantum corrections grow exponentially during nonlinear growth with the timescale being approximately equal to the system dynamical time. In stable systems the corrections grow quadratically. We also find that the primary effect of quantum corrections is to reduce the amplitude of fluctuations on the de Broglie scale in the spatial density. Finally, we find that the timescale associated with decoherence due to gravitational coupling to baryonic matter is at least as fast as the quantum corrections due to gravitational interactions. These results are consistent with the predictions of the classical field theory being accurate.
Investigating many-body localization (MBL) using exact numerical methods is limited by the exponential growth of the Hilbert space. However, localized eigenstates display multifractality and only extend over a vanishing fraction of the Hilbert space. Here, building on this remarkable property, we develop a simple yet efficient decimation scheme to discard the irrelevant parts of the Hilbert space of the random-field Heisenberg chain. This leads to a Hilbert space fragmentation in small clusters, allowing to access larger systems at strong disorder. The MBL transition is quantitatively predicted, together with a geometrical interpretation of MBL multifractality as a shattering of the Hilbert space.
The DOE CYDRES project is driven by the urgent need to address critical research gaps in the domain of cyber-physical security of smart buildings, including Grid-interactive Efficient Buildings (GEBs). CYDRES, a real-time advanced building resilient platform, aims to enhance the cyber-attack-immune capabilities of buildings through multi-layered prevention, detection, and adaptation mechanisms. CYDRES consists of five key modules: a multi-layer network analyzer, an Automatic Fault Detection, Diagnosis, and Prognosis (AFDDP) framework, an intelligent mode selector, a cyber-resilient control framework, and a situation awareness platform. The Network Analyzer employs a data-driven framework that includes a protocol state learning tool and a CRF (Conditional Random Field) command validator. In Hardware-In-the-Loop (HIL) testbeds, it achieved 100% detection accuracy with a false alarm rate of 3%, validating its efficacy in identifying selected cyber-attacks. The AFDDP framework leverages pattern matching, PCA (Principal Component Analysis)-based strategies, and a DBN (Dynamic Bayesian Network)-based fault diagnosis approach to pinpoint the causes of physical system abnormalities using Building Automation System (BAS) data. In HIL experiments, the AFDDP module attained a detection accuracy of over 95% with a false alarm rate below 7%. Additionally, the fault detector utilized machine learning (Random Forest) and deep learning (Multi-Layer Perceptron) methods with acoustic sensor data to achieve a 100% fault detection accuracy in Heating, Ventilation, and Air-Conditioning (HVAC) equipment. The Mode Selector offered real-time impact analysis, allowing immediate actions to protect BASs in the face of emerging threats. The cyber-resilient control framework included an adaptive Model Predictive Control (MPC) and a measurement compensator, reducing temperature violations by up to 94% and improving the total demand flexibility by up to 70% in HIL experiments. Such HIL experiments covered a cyber-attack case and a physical fault case, showcasing CYDRES’ efficiency in maintaining operational continuity during threats. The situation awareness platform in Grafana enhanced real-time threat detection and response visualization, augmenting the operational awareness for building operators. CYDRES demonstrated high technical effectiveness in various test scenarios, particularly in HIL environments. The project's phased development approach ensured efficient use of resources, highlighting its practical feasibility and readiness for commercialization. By enhancing the security and resilience of building operations, CYDRES represents a significant advance in mitigating risks associated with cyber-physical systems, thereby enhancing public confidence in the safety of modern building infrastructure. Future directions for the project include expanding testing protocols, refining AFDDP methodologies, exploring more comprehensive resilient control strategies, and testing in real commercial buildings.
Abstract Domain decomposition methods have been proved to be an effective strategy to reduce the dimension of parametric partial differential equations (PDEs). However, existing domain decomposition methods for parametric PDEs are usually intrusive, which means domain decomposition based solvers need to be implemented from scratch for each target parametric PDE. To address this issue, we develop a new non‐intrusive domain‐decomposition model reduction method for linear steady‐state PDEs with random‐field coefficients. As a variant of our previous work by Mu and Zhang, the new method only needs access to the final linear system, that is, the global stiffness matrix and the right hand side, of a deterministic PDE solver, in order to build a domain‐decomposition‐based reduced model without intrusive implementation from scratch. The key idea is to remove the interface condition between sub‐domains and rely on the correlation between columns of the linear system to couple the sub‐domains. The non‐intrusive feature enables the applicability of the proposed method to a broader class of uncertainty quantification problems, where many legacy codes/solvers can be fully reused by our method. Two numerical examples including diffusion equations with random diffusivity and convection‐dominated transport with random velocity, are provided to demonstrate the effectiveness and efficiency of our method.
With the advent of large language models (LLMs), the vast unstructured text within millions of academic papers is increasingly accessible for materials discovery—although significant challenges remain. While LLMs offer promising few- and zero-shot learning capabilities, particularly valuable in the materials domain where expert annotations are scarce, general-purpose LLMs often fail to address key materials-specific queries without further adaptation. To bridge this gap, fine-tuning LLMs on human-labeled data is essential for effective structured knowledge extraction (Liu in The Importance of Human-Labeled Data in the Era of LLMs, 2023). Here, in this study, we introduce a novel annotation schema designed to extract generic process–structure–properties relationships from scientific literature. We demonstrate the utility of this approach using a dataset of 128 abstracts, with annotations drawn from two distinct domains: high-temperature materials (Domain I) and uncertainty quantification in simulating materials microstructure (Domain II). Initially, we developed a conditional random field (CRF) model based on MatBERT—a domain-specific BERT variant—and evaluated its performance on Domain I. Subsequently, we compared this model with a fine-tuned LLM (GPT-4o from OpenAI) under identical conditions. Our results indicate that fine-tuning LLMs can significantly improve entity extraction performance over the BERT-CRF baseline on Domain I. However, when additional examples from Domain II were incorporated, the performance of the BERT-CRF model became comparable to that of the GPT-4o model. These findings underscore the potential of our schema for structured knowledge extraction and highlight the complementary strengths of both modeling approaches.