Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Convolution”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,459 records · Page 81
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Photometric identification of compact galaxies, stars, and quasars using multiple neural networks

We present MargNet, a deep learning-based classifier for identifying stars, quasars, and compact galaxies using photometric parameters and images from the Sloan Digital Sky Survey Data Release 16 catalogue. MargNet consists of a combination of convolutional neural network and artificial neural network architectures. Using a carefully curated data set consisting of 240 000 compact objects and an additional 150 000 faint objects, the machine learns classification directly from the data, minimizing the need for human intervention. MargNet is the first classifier focusing exclusively on compact galaxies and performs better than other methods to classify compact galaxies from stars and quasars, even at fainter magnitudes. This model and feature engineering in such deep learning architectures will provide greater success in identifying objects in the ongoing and upcoming surveys, such as Dark Energy Survey and images from the Vera C. Rubin Observatory.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Deep learning methods for obtaining photometric redshift estimations from images

ABSTRACT Knowing the redshift of galaxies is one of the first requirements of many cosmological experiments, and as it is impossible to perform spectroscopy for every galaxy being observed, photometric redshift (photo-z) estimations are still of particular interest. Here, we investigate different deep learning methods for obtaining photo-z estimates directly from images, comparing these with ‘traditional’ machine learning algorithms which make use of magnitudes retrieved through photometry. As well as testing a convolutional neural network (CNN) and inception-module CNN, we introduce a novel mixed-input model that allows for both images and magnitude data to be used in the same model as a way of further improving the estimated redshifts. We also perform benchmarking as a way of demonstrating the performance and scalability of the different algorithms. The data used in the study comes entirely from the Sloan Digital Sky Survey (SDSS) from which 1 million galaxies were used, each having 5-filtre (ugriz) images with complete photometry and a spectroscopic redshift which was taken as the ground truth. The mixed-input inception CNN achieved a mean squared error (MSE) =0.009, which was a significant improvement ($30{{\ \rm per\ cent}}$) over the traditional random forest (RF), and the model performed even better at lower redshifts achieving a MSE = 0.0007 (a $50{{\ \rm per\ cent}}$ improvement over the RF) in the range of z < 0.3. This method could be hugely beneficial to upcoming surveys, such as Euclid and the Vera C. Rubin Observatory’s Legacy Survey of Space and Time (LSST), which will require vast numbers of photo-z estimates produced as quickly and accurately as possible.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Estimating cluster masses from SDSS multiband images with transfer learning

ABSTRACT The total masses of galaxy clusters characterize many aspects of astrophysics and the underlying cosmology. It is crucial to obtain reliable and accurate mass estimates for numerous galaxy clusters over a wide range of redshifts and mass scales. We present a transfer-learning approach to estimate cluster masses using the ugriz-band images in the SDSS Data Release 12. The target masses are derived from X-ray or SZ measurements that are only available for a small subset of the clusters. We designed a semisupervised deep learning model consisting of two convolutional neural networks. In the first network, a feature extractor is trained to classify the SDSS photometric bands. The second network takes the previously trained features as inputs to estimate their total masses. The training and testing processes in this work depend purely on real observational data. Our algorithm reaches a mean absolute error (MAE) of 0.232 dex on average and 0.214 dex for the best fold. The performance is comparable to that given by redMaPPer, 0.192 dex. We have further applied a joint integrated gradient and class activation mapping method to interpret such a two-step neural network. The performance of our algorithm is likely to improve as the size of training data set increases. This proof-of-concept experiment demonstrates the potential of deep learning in maximizing the scientific return of the current and future large cluster surveys.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Reconstructing large-scale temperature profiles around z ∼ 6 quasars

ABSTRACT High-redshift quasars ionize He ii into He iii around them, heating the intergalactic medium in the process and creating large regions with elevated temperature. In this work, we demonstrate a method based on a convolutional neural network (CNN) to recover the spatial profile for T0, the temperature at the mean cosmic density, in quasar proximity zones. We train the neural network with synthetic spectra drawn from a Cosmic Reionization on Computers simulation. We discover that the simple CNN is able to recover the temperature profile with an accuracy of ≈1400 K in an idealized case of negligible observational uncertainties. We test the robustness of the CNN and discover that it is robust against the uncertainties in quasar host halo mass, quasar continuum, and ionizing flux. We also find that the CNN has good generality with regard to the hardness of quasar spectra. This shows that with noiseless spectra, one could use a simple CNN to distinguish gas inside or outside the He iii region created by the quasar. Because the size of the He iii region is closely related to the total quasar lifetime, this method has great potential in constraining the quasar lifetime on ∼Myr time-scales. However, noise poses a big problem for accuracy and could downgrade the accuracy to ≈2340 K even for very high signal-to-noise (≳50) spectra. Future studies are needed to reduce the error associated with noise to constrain the lifetimes of reionization epoch quasars with currently available data.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

AGNs in post-mergers from the ultraviolet near infrared optical northern survey

The kinematic disturbances associated with major galaxy mergers are known to produce gas inflows, which in turn may trigger accretion onto the supermassive black holes (SMBH) of the participant galaxies. While this effect has been studied in galaxy pairs, the frequency of active galactic nuclei (AGNs) in fully coalesced post-merger systems is poorly constrained due to the limited size or impurity of extant post-merger samples. Previously, we combined convolutional neural network (CNN) predictions with visual classifications to identify a highly pure sample of 699 post-mergers in deep r-band imaging. In the work presented here, we quantify the frequency of AGNs in this sample using three metrics: optical emission lines, mid-infrared (mid-IR) colour, and radio detection of low-excitation radio galaxies (LERGs). We also compare the frequency of AGNs in post-mergers to that in a sample of spectroscopically identified galaxy pairs. We find that AGNs identified by narrow-line optical emission and mid-IR colour have an increased incidence rate in post-mergers, with excesses of ~4 over mass- and redshift-matched controls. The optical and mid-IR AGN excesses in post-mergers exceed the values found for galaxy pairs, indicating that AGN activity in mergers peaks after coalescence. Conversely, we recover no significant excess of LERGs in post-mergers or pairs. Finally, we find that the [O III ] luminosity (a proxy for SMBH accretion rate) in post-mergers that host an optical AGN is ~0.3 dex higher on average than in non-interacting galaxies with an optical AGN, suggesting that mergers generate higher accretion rates than secular triggering mechanisms.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

A post-merger enhancement only in star-forming Type 2 Seyfert galaxies: the deep learning view

ABSTRACT Supermassive black holes require a reservoir of cold gas at the centre of their host galaxy in order to accrete and shine as active galactic nuclei (AGN). Major mergers have the ability to drive gas rapidly inwards, but observations trying to link mergers with AGN have found mixed results due to the difficulty of consistently identifying galaxy mergers in surveys. This study applies deep learning to this problem, using convolutional neural networks trained to identify simulated post-merger galaxies from survey-realistic imaging. This provides a fast and repeatable alternative to human visual inspection. Using this tool, we examine a sample of ∼8500 Seyfert 2 galaxies ($L[\mathrm{O\, {\small III}}] \sim 10^{38.5 - 42}$ erg s−1) at z < 0.3 in the Sloan Digital Sky Survey and find a merger fraction of $2.19_{-0.17}^{+0.21}$ per cent compared with inactive control galaxies, in which we find a merger fraction of $2.96_{-0.20}^{+0.26}$ per cent, indicating an overall lack of mergers among AGN hosts compared with controls. However, matching the controls to the AGN hosts in stellar mass and star formation rate reveals that AGN hosts in the star-forming blue cloud exhibit a ∼2 × merger enhancement over controls, while those in the quiescent red sequence have significantly lower relative merger fractions, leading to the observed overall deficit due to the differing M*–SFR distributions. We conclude that while mergers are not the dominant trigger of all low-luminosity, obscured AGN activity in the nearby Universe, they are more important to AGN fuelling in galaxies with higher cold gas mass fractions as traced through star formation.

Avirett-Mackenzie, M. S.↗
DOE OSTI2024

Dark energy survey year 3 results: likelihood-free, simulation-based w CDM inference with neural compression of weak-lensing map statistics

We present simulation-based cosmological wcold dark matter (wCDM) inference using dark energy survey year 3 weak-lensing maps, via neural data compression of weak-lensing map summary statistics: power spectra, peak counts, and direct map-level compression/inference with convolutional neural networks (CNN). Using simulation-based inference, also known as likelihood-free or implicit inference, we use forward-modelled mock data to estimate posterior probability distributions of unknown parameters. This approach allows all statistical assumptions and uncertainties to be propagated through the forward-modelled mock data; these include sky masks, non-Gaussian shape noise, shape measurement bias, source galaxy clustering, photometric redshift uncertainty, intrinsic galaxy alignments, non-Gaussian density fields, neutrinos, and non-linear summary statistics. We include a series of tests to validate our inference results. This paper also describes the Gower Street simulation suite: 791 full-sky pkdgrav3 dark matter simulations, with cosmological model parameters sampled with a mixed active-learning strategy, from which we construct over 3000 mock dark energy survey lensing data sets. For wCDM inference, for which we allow –1 < w < –$\frac{1}{3}$⁠, our most constraining result uses power spectra combined with map-level (CNN) inference. Using gravitational lensing data only, this map-level combination gives Ω m = 0.283$^{+0.020}_{–0.027}$⁠, S 8 = 0.804$^{+0.025}_{–0.017⁠}$, and w < –0.80 (with a 68 per cent credible interval); compared to the power spectrum inference, this is more than a factor of two improvement in dark energy parameter (Ω⁠ DE , w⁠) precision.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Measuring stomatal and guard cell metrics for plant physiology and growth using StoManager1

Abstract Automated guard cell detection and measurement are vital for understanding plant physiological performance and ecological functioning in global water and carbon cycles. Most current methods for measuring guard cells and stomata are laborious, time-consuming, prone to bias, and limited in scale. We developed StoManager1, a high-throughput tool utilizing geometrical, mathematical algorithms, and convolutional neural networks to automatically detect, count, and measure over 30 guard cell and stomatal metrics, including guard cell and stomatal area, length, width, stomatal aperture area/guard cell area, orientation, stomatal evenness, divergence, and aggregation index. Combined with leaf functional traits, some of these StoManager1-measured guard cell and stomatal metrics explained 90% and 82% of tree biomass and intrinsic water use efficiency (iWUE) variances in hardwoods, making them substantial factors in leaf physiology and tree growth. StoManager1 demonstrated exceptional precision and recall (mAP@0.5 over 0.96), effectively capturing diverse stomatal properties across over 100 species. StoManager1 facilitates the automation of measuring leaf stomatal and guard cells, enabling broader exploration of stomatal control in plant growth and adaptation to environmental stress and climate change. This has implications for global gross primary productivity (GPP) modeling and estimation, as integrating stomatal metrics can enhance predictions of plant growth and resource usage worldwide. Easily accessible open-source code and standalone Windows executable applications are available on a GitHub repository (https://github.com/JiaxinWang123/StoManager1) and Zenodo (https://doi.org/10.5281/zenodo.7686022).

Wang, Jiaxin (ORCID:0000000348085085)↗
DOE OSTI2020

Deep medical image analysis with representation learning and neuromorphic computing

Deep learning is increasingly used in medical imaging, improving many steps of the processing chain, from acquisition to segmentation and anomaly detection to outcome prediction. Yet significant challenges remain: (i) image-based diagnosis depends on the spatial relationships between local patterns, something convolution and pooling often do not capture adequately; (ii) data augmentation, the de facto method for learning three-dimensional pose invariance, requires exponentially many points to achieve robust improvement; (iii) labelled medical images are much less abundant than unlabelled ones, especially for heterogeneous pathological cases; and (iv) scanning technologies such as magnetic resonance imaging can be slow and costly, generally without online learning abilities to focus on regions of clinical interest. To address these challenges, novel algorithmic and hardware approaches are needed for deep learning to reach its full potential in medical imaging.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2026

Dark Energy Survey Year 3 results: Simulation-based 𝑤CDM inference from weak lensing and galaxy clustering maps with deep learning: Analysis design

Data-driven approaches using deep learning are emerging as powerful techniques to extract non-Gaussian information from cosmological large-scale structure. Here, this work presents the first simulation-based inference (SBI) pipeline that combines weak lensing and galaxy clustering maps in a realistic Dark Energy Survey Year 3 (DES Y3) configuration and serves as preparation for a forthcoming analysis of the survey data. We develop a scalable forward model based on the CosmoGridV1 suite of N-body simulations to generate over one million self-consistent mock realizations of DES Y3 at the map level. Leveraging this large dataset, we train deep graph convolutional neural networks on the full survey footprint in spherical geometry to learn low-dimensional features that approximately maximize mutual information with target parameters. These learned compressions enable neural density estimation of the implicit likelihood via normalizing flows in a ten-dimensional parameter space spanning cosmological 𝑤CDM, intrinsic alignment, and linear galaxy bias parameters, while marginalizing over baryonic, photometric redshift, and shear bias nuisances. To ensure robustness, we extensively validate our inference pipeline using synthetic observations derived from both systematic contaminations in our forward model and independent Buzzard galaxy catalogs. Our forecasts yield significant improvements in cosmological parameter constraints, achieving 2−3× higher figures of merit in the 𝛺 𝑚 − 𝑆 8 plane relative to our implementation of baseline two-point statistics and effectively breaking parameter degeneracies through probe combination. These results demonstrate the potential of SBI analyses powered by deep learning for upcoming Stage-IV wide-field imaging surveys.

Thomsen, A. [Zurich, ETH] (ORCID:0000000203099021)↗
DOE OSTI2025

Machine learning force field model for kinetic Monte Carlo simulations of itinerant Ising magnets

Here, we present a scalable machine learning (ML) framework for large-scale kinetic Monte Carlo (kMC) simulations of itinerant electron Ising systems. As the effective interactions between Ising spins in such itinerant magnets are mediated by conducting electrons, the calculation of energy change due to a local spin update requires solving an electronic structure problem. Such repeated electronic structure calculations could be overwhelmingly prohibitive for large systems. Assuming the locality principle, a convolutional neural network (CNN) model is developed to directly predict the effective local field and the corresponding energy change associated with a given spin update based on Ising configuration in a finite neighborhood. As the kernel size of the CNN is fixed at a constant, the model can be directly scalable to kMC simulations of large lattices. Our approach is reminiscent of the ML force field models widely used in first-principles molecular dynamics simulations. Applying our ML framework to a square-lattice double-exchange Ising model, we uncover unusual coarsening of ferromagnetic domains at low temperatures. Our work highlights the potential of ML methods for large-scale modeling of similar itinerant systems with discrete dynamical variables.

machine learning↗
DOE OSTI2020

Visualizing strange metallic correlations in the two-dimensional Fermi-Hubbard model with artificial intelligence

Strongly correlated phases of matter are often described in terms of straightforward electronic patterns. This has so far been the basis for studying the Fermi-Hubbard model realized with ultracold atoms. Here, we show that artificial intelligence (AI) can provide an unbiased alternative to this paradigm for phases with subtle, or even unknown, patterns. Long- and short-range spin correlations spontaneously emerge in filters of a convolutional neural network trained on snapshots of single atomic species. In the less well-understood strange metallic phase of the model, we find that a more complex network trained on snapshots of local moments produces an effective order parameter for the non-Fermi-liquid behavior. We report our technique can be employed to characterize correlations unique to other phases with no obvious order parameters or signatures in projective measurements, and has implications for science discovery through AI beyond strongly correlated systems.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2023

Unraveling Fano noise and the partial-charge-collection effect in x-ray spectra below 1 keV

Fano noise, readout noise, and the partial-charge-collection (PCC) effect collectively contribute to the degradation of energy spectra in charge-coupled device (CCD) measurements, especially at low energies. Here, in this work, the x rays produced by the fluorescence of fluorine (677 eV) and aluminum (1486 eV) were recorded using a Skipper-CCD, which enabled the readout noise to be reduced to 0.2 e - . Based on an analytical description of photopeak shapes resulting from the convolution of the PCC effect and Fano noise, we achieved a precise characterization of the energy spectra. This description enabled us to disentangle and quantify the contributions from both Fano noise and the PCC effect. As a result, we determined the Fano factor and the electron-hole pair creation energy. Additionally, we estimated the PCC region of the sensor and, for the first time, experimentally observed the expected skewness of photopeaks at low energies.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

Machine learning for improved current-density reconstruction from two-dimensional vector magnetic images

The reconstruction of electrical current densities from magnetic field measurements is an important technique with applications in materials science, circuit design, quality control, plasma physics, and biology. Analytic reconstruction methods exist for planar currents, but break down in the presence of high-spatial-frequency noise or large standoff distance, restricting the types of systems that can be studied. Here, we demonstrate the use of a deep convolutional neural network for current density reconstruction from two-dimensional images of vector magnetic fields acquired by a quantum diamond microscope . Trained network performance significantly exceeds analytic reconstruction for data with high noise or large standoff distances. This machine learning technique can perform quality inversions on lower-signal-to-noise-ratio data, significantly reducing the data collection time and permitting reconstructions of weaker and three-dimensional current sources. Published by the American Physical Society 2025

Reed, Niko R. (ORCID:0009000305222403)↗
DOE OSTI2020

Mixed-strategy approach to band-edge analysis and modeling in semiconductors

In semiconductor physics, the Urbach rule describes an exponential dependence of the UV-Vis absorption coefficient on photon energy at the band edge. The rule is so ubiquitously applied that a single common mechanism, variability in the local potential, is generally considered to be the cause of exponential band edges. Variability in the local potential may be caused by alloy inhomogeneity, structural defects, impurities, thermal excitation, or any other mechanism that interrupts ideal crystallinity and creates disorder. A crucial point of the Urbach rule is its development for band edges which approach linearity when plotted on a logarithmic scale. The rule was not developed in the context of nonlinear band edges with complex fine structure. Even so, this model has been applied extensively to band edges with such features. Using differential analysis and deconvolution, we develop an analytical technique capable of separating the components responsible for the fine structure observed. This approach reduces challenging signal-artifact convolution problems to a simple linear combination. Furthermore, we develop a model that can be applied to the nonlinear band-edge signals extracted. In this work, we show that in the limiting case of linearity, our model is consistent with and produces the same results as the linear Urbach model. Our model is capable of bypassing “tailing” as an indirect measure of the spread in the local potential and gives a direct measure of this quantity.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2021

Twisted bilayer graphene. V. Exact analytic many-body excitations in Coulomb Hamiltonians: Charge gap, Goldstone modes, and absence of Cooper pairing

We find exact analytic expressions for the energies and wave functions of the charged and neutral excitations above the exact ground states (at rational filling per unit cell) of projected Coulomb Hamiltonians in twisted bilayer graphene. Our exact expressions are valid for any form of the Coulomb interaction and any form of A A and A B / B A tunneling. The single charge excitation energy is a convolution of the Coulomb potential with a quantum geometric tensor of the TBG bands. The neutral excitations are (high-symmetry group) magnons, and their dispersion is analytically calculated in terms of the form factors of the active bands in TBG. The two-charge excitation energy and wave functions are also obtained, and a sufficient condition on the graphene eigenstates for obtaining a Cooper pair from Coulomb interactions is obtained. For the actual TBG bands at the first magic angle, we can analytically show that the Cooper pair binding energy is zero in all such projected Coulomb models, implying that either phonons and/or nonzero kinetic energy are needed for superconductivity. Since Vafek and Kang [Phys. Rev. Lett. 125, 257602 (2020)] showed that the kinetic energy bounds on the superexchange energy are less 10 -3 in Coulomb units, the phonon mechanism becomes then very likely. If nonetheless the superconductivity is due to kinetic terms which render the bands nonflat, one prediction of our theory is that the highest T c would not occur at the highest DOS.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2023

Deep learning Hamiltonians from disordered image data in quantum materials

The capabilities of image probe experiments are rapidly expanding, providing new information about quantum materials on unprecedented length- and timescales. Many such materials feature inhomogeneous electronic properties with intricate pattern formation on the observable surface. This rich spatial structure contains information about interactions, dimensionality, and disorder—a spatial encoding of the Hamiltonian driving the pattern formation. Image recognition techniques from machine learning are an excellent tool for interpreting information encoded in the spatial relationships in such images. Here, we develop a deep learning framework for using the rich information available in these spatial correlations in order to discover the underlying Hamiltonian driving the patterns. We first vet the method on a known case, scanning near-field optical microscopy on a thin film of V⁢O 2 . We then apply our trained convolutional neural network architecture to new optical microscope images of a different V⁢O 2 film as it goes through the metal-insulator transition. We find that a two-dimensional Hamiltonian with both interactions and random field disorder is required to explain the intricate, fractal intertwining of metal and insulator domains during the transition. This detailed knowledge about the underlying Hamiltonian paves the way for using the model to control the pattern formation via, e.g., tailored hysteresis protocols. Finally, we also introduce a distribution-based confidence measure on the results of a multilabel classifier, which does not rely on adversarial training. In addition, we propose a machine-learning-based criterion for diagnosing a physical system's proximity to criticality.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2024

Tunneling magnetoresistance in MgO tunnel junctions with Fe-based leads in empirically corrected density functional theory

The minority-spin Fe/MgO interface states are at the Fermi level in density functional theory (DFT), but experimental evidence and GW calculations place them slightly higher in energy. This small shift can strongly influence tunneling magnetoresistance (TMR) in junctions with a thin MgO barrier and its dependence on the concentration of Co in the electrodes. Here, in this study, an empirical potential correction to DFT is introduced to shift the interface states up to match the tunnel spectroscopy data. With this shift, TMR in Fe/MgO/Fe junctions exceeds 800% and 3000% at 3 and 4 monolayers (ML) of MgO, respectively. We further consider the effect of alloying of the Fe electrodes with up to 30% Co or 10% V, treating them in the coherent potential approximation (CPA). Alloying with Co broadens the interface states and brings a large incoherent minority-spin spectral weight to the Fermi level. Alloying with V brings the minority-spin resonant states close to the Fermi level. However, in both cases the minority-spin spectral weight at the Fermi level resides primarily at the periphery of the Brillouin zone, which is favorable for spin filtering. Using convolutions of k II -resolved barrier densities of states calculated in CPA, it is found that TMR is strongly reduced by alloying with Co or V but still remains above 500% at 4 ML of MgO up to 30% of Co or 5% V. At 5 ML, the TMR increases above 1000% in all systems considered. However, while TMR declines sharply with increasing bias up to 0.2 eV in the tunnel junctions with pure Fe leads, it remains almost constant up to 0.5 eV if leads are alloyed with Co.

74 ATOMIC AND MOLECULAR PHYSICS↗