Use of ML in Image-Based Simulation: CNNs for 3D Image Segmentation and Uncertainty Quantification.
Abstract not provided.
Roberts, Scott Alan↗
SEARCH · Engineering Papers
Results for “imaging simulators”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Image Collection Simulation Using High-Resolution Atmospheric Modeling
A new method is described for simulating the passive remote sensing image collection of ground targets that includes effects from atmospheric physics and dynamics at fine spatial and temporal scales. The innovation in this research is the process of combining a high-resolution weather model with image collection simulation to attempt to account for heterogeneous and high-resolution atmospheric effects on image products. The atmosphere was modeled on a 3D voxel grid by a Large-Eddy Simulation (LES) driven by forcing data constrained by local ground-based and air-based observations. The spatial scale of the atmospheric model (10–100 m) came closer than conventional weather forecast scales (10–100 km) to approaching the scale of typical commercial multispectral imagery (2 m). This approach was demonstrated through a ground truth experiment conducted at the Department of Energy Atmospheric Radiation Measurement Southern Great Plains site. In this experiment, calibrated targets (colored spectral tarps) were placed on the ground, and the scene was imaged with WorldView-3 multispectral imagery at a resolution enabling the tarps to be visible in at least 9–12 image pixels. The image collection was simulated with Digital Imaging and Remote Sensing Image Generation (DIRSIG) software, using the 3D atmosphere from the LES model to generate a high-resolution cloud mask. The high-resolution atmospheric model-predicted cloud coverage was usually within 23% of the measured cloud cover. The simulated image products were comparable to the WorldView-3 satellite imagery in terms of the variations of cloud distributions and spectral properties of the ground targets in clear-sky regions, suggesting the potential utility of the proposed modeling framework in improving simulation capabilities, as well as testing and improving the operation of image collection processes.
54 ENVIRONMENTAL SCIENCES↗
Discriminating Accretion States via Rotational Symmetry in Simulated Polarimetric Images of M87
In 2017 April, the Event Horizon Telescope observed the shadow of the supermassive black hole at the core of the elliptical galaxy Messier 87. While the original image was constructed from measurements of the total intensity, full polarimetric data were also collected, and linear polarimetric images are expected in the near future. We propose a modal image decomposition of the linear polarization field into basis functions with varying azimuthal dependence of the electric vector position angle. We apply this decomposition to images of ray traced general relativistic magnetohydrodynamics simulations of the Messier 87 accretion disk. Furthermore, for simulated images that are physically consistent with previous observations, the magnitude of the coefficient associated with rotational symmetry, β2, is a useful discriminator between accretion states. We find that at 20 μas resolution, $| {\beta }_{2}| $ is greater than 0.2 only for models of disks with horizon-scale magnetic pressures large enough to disrupt steady accretion. We also find that images with a more radially directed electric vector position angle correspond to models with higher black hole spin. Our analysis demonstrates the utility of the proposed decomposition as a diagnostic framework to improve constraints on theoretical models.
79 ASTRONOMY AND ASTROPHYSICS↗
The Blending ToolKit: A simulation framework for evaluation of galaxy detection and deblending
We present an open source Python library for simulating overlapping (i.e., blended) images of galaxies and performing self-consistent comparisons of detection and deblending algorithms based on a suite of metrics. The package, named Blending Toolkit (BTK), serves as a modular, flexible, easy-to-install, and simple-to-use interface for exploring and analyzing systematic effects related to blended galaxies in cosmological surveys such as the Vera Rubin Observatory Legacy Survey of Space and Time (LSST). BTK has three main components: (1) a set of modules that perform fast image simulations of blended galaxies, using the open source image simulation package GalSim; (2) a module that standardizes the inputs and outputs of existing deblending algorithms; (3) a library of deblending metrics commonly defined in the galaxy deblending literature. In combination, these modules allow researchers to explore the impacts of galaxy blending in cosmological surveys. Additionally, BTK provides researchers who are developing a new deblending algorithm a framework to evaluate algorithm performance and make principled comparisons with existing deblenders. BTK includes a suite of tutorials and comprehensive documentation. The source code is publicly available on GitHub at https://github.com/LSSTDESC/BlendingToolKit.
79 ASTRONOMY AND ASTROPHYSICS↗
High-pressure phase transition in 3-D printed nanolamellar high-entropy alloy by imaging and simulation insights
Abstract We report on the high-resolution imaging and molecular dynamics simulations of a 3D-printed eutectic high-entropy alloy (EHEA) Ni 40 Co 20 Fe 10 Cr 10 Al 18 W 2 consisting of nanolamellar BCC and FCC phases. The direct lattice imaging of 3D-printed samples shows the Kurdjumov–Sachs (K–S) orientation relation {111} FCC parallel to {110} BCC planes in the dual-phase lamellae. Unlike traditional iron and steels, this alloy shows an irreversible BCC-to-FCC phase transformation under high pressures. The nanolamellar morphology is maintained after pressure cycling to 30 GPa, and nano-diffraction studies show both layers to be in the FCC phase. The chemical compositions of the dual-phase lamellae after pressure recovery remain unchanged, suggesting a diffusion-less BCC–FCC transformation in this EHEA. The lattice imaging of the pressure-recovered sample does not show any specific orientation relation between the two resulting FCC phases, indicating that many grain orientations are produced during the BCC–FCC phase transformation. Molecular dynamics simulations on phase transformation in a nanolamellar BCC/FCC in K–S orientation show that phase transformation from BCC to FCC is completed under high pressures, and the FCC phase is retained on decompression aided by the stable interfaces. Our work elucidates the irreversible phase transformation under static compression, providing an understanding of the orientation relationships in 3-D printed EHEA under high pressures.
3-D Printing↗
Detector Tilt Considerations in Bragg Coherent Diffraction Imaging: A Simulation Study
This paper addresses the three-dimensional signal distortion and image reconstruction issues in X-ray Bragg coherent diffraction imaging (BCDI) in the event of a general non-orthogonal orientation of the area detector with respect to the diffracted beam. Growing interest in novel BCDI adaptations at fourth-generation synchrotron light sources has necessitated improvisations in the experimental configuration and the subsequent data analysis. One such possibly unavoidable improvisation that is envisioned in this paper is a photon-counting area detector whose face is tilted away from the perpendicular to the Bragg-diffracted beam during the acquisition of the coherent diffraction signal. We describe a likely circumstance in which one would require such a detector configuration, along with the experimental precedent at third-generation synchrotrons. Using physically accurate diffraction simulations from synthetic scatterers in the presence of such tilted detectors, we analyze the general nature of the observed signal distortion qualitatively and quantitatively and provide a prescription to correct for it during image reconstruction. Our simulations and reconstructions are based on an adaptation of the known theory of BCDI sampling geometry, as well as the recently developed projection-based methods of wavefield propagation. Such configurational modifications and their numerical remedies are potentially valuable in realizing unconventional coherent diffraction measurement geometries, eventually paving the way for the integration of BCDI into new material characterization experiments at next-generation light sources.
36 MATERIALS SCIENCE↗
OpenUniverse2024: a shared, simulated view of the sky for the next generation of cosmological surveys
The OpenUniverse2024 simulation suite is a cross-collaboration effort to produce matched simulated imaging for multiple surveys as they would observe a common simulated sky. Both the simulated data and associated tools used to produce it are intended to uniquely enable a wide range of studies to maximize the science potential of the next generation of cosmological surveys. We have produced simulated imaging for approximately 70 deg 2 of the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST) Wide-Fast-Deep survey and the Nancy Grace Roman Space Telescope High-Latitude Wide-Area Survey, as well as overlapping versions of the ELAIS-S1 Deep-Drilling Field for LSST and the High-Latitude Time-Domain Survey for Roman. OpenUniverse2024 includes (i) an early version of the updated extragalactic model called Diffsky, which substantially improves the realism of optical and infrared photometry of objects, compared to previous versions of these models; (ii) updated transient models that extend through the wavelength range probed by Roman and Rubin; and (iii) improved survey, telescope, and instrument realism based on up-to-date survey plans and known properties of the instruments. It is built on a new and updated suite of simulation tools that improves the ease of consistently simulating multiple observatories viewing the same sky. The approximately 400 TB of synthetic survey imaging and simulated universe catalogs are publicly available, and we preview some scientific uses of the simulations.
large-scale structure of Universe↗
Neutron and Gamma Imaging MCNP6 Simulations for NDSE: An Update
Explore the source record for details and available documents.
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
TEMImageNet training library and AtomSegNet deep-learning models for high-precision atom segmentation, localization, denoising, and deblurring of atomic-resolution images
Abstract Atom segmentation and localization, noise reduction and deblurring of atomic-resolution scanning transmission electron microscopy (STEM) images with high precision and robustness is a challenging task. Although several conventional algorithms, such has thresholding, edge detection and clustering, can achieve reasonable performance in some predefined sceneries, they tend to fail when interferences from the background are strong and unpredictable. Particularly, for atomic-resolution STEM images, so far there is no well-established algorithm that is robust enough to segment or detect all atomic columns when there is large thickness variation in a recorded image. Herein, we report the development of a training library and a deep learning method that can perform robust and precise atom segmentation, localization, denoising, and super-resolution processing of experimental images. Despite using simulated images as training datasets, the deep-learning model can self-adapt to experimental STEM images and shows outstanding performance in atom detection and localization in challenging contrast conditions and the precision consistently outperforms the state-of-the-art two-dimensional Gaussian fit method. Taking a step further, we have deployed our deep-learning models to a desktop app with a graphical user interface and the app is free and open-source. We have also built a TEM ImageNet project website for easy browsing and downloading of the training data.
25 ENERGY STORAGE↗
Novel usage of deep learning and high-performance computing in long-baseline neutrino oscillation experiments
Mención Internacional en el título de doctorDeep-learning methods are playing a crucial role in numerous scientific and industrialapplications. Over the past two decades, these techniques have helped in the collection,reconstruction, and analysis of large data samples in particle physics experiments. Themain topic of this PhD research is the study of deep-learning techniques in long-baselineneutrino oscillation experiments. Neutrinos are mysterious light elementary particles,and their investigation is essential to shed light on some of the remaining open questionsin physics. The work presented here describes an algorithm based on a convolutionalneural network developed to provide highly accurate and efficient selections of electronneutrino and muon neutrino interactions in the Deep Underground Neutrino Experiment(DUNE). With this algorithm, the electron neutrino (antineutrino) selection efficiencypeaks at 90% (94%) and exceeds 85% (90%) for reconstructed neutrino energies between2-5 GeV. The selection efficiency for muon neutrino (antineutrino) interactions is foundto have a maximum of 96% (97%) and exceeds 90% (95%) efficiency for reconstructedneutrino energies above 2 GeV. When considering all electron neutrino and antineutrinointeractions as signal (both those appearing from oscillations and those intrinsic tothe beam), a selection purity of 90% is achieved. These event selections are criticalto maximise the sensitivity of the experiment to CP-violating effects, key to furtherunderstand the matter-antimatter asymmetry of the Universe.In high-energy physics experiments, deep learning has also been explored for producingfast simulations and physically-motivated manipulations of simulated images. Some ofthose simulations, such as the light production and detection, are very computationallyexpensive and require novel methods to produce the necessary samples while controllingthe varied underlying physics model parameters. To do so, we invented the model-assistedgenerative adversarial network (MAGAN), first validated on simple generic case studiesand then successfully applied to the DUNE photon-detector simulation.Moreover, we also developed graph neural networks for 3D-voxel classification ofambiguities and optical crosstalk for a different particle physics experiment, most preciselyfor the proposed SuperFGD. This novel 3D-granular plastic-scintillator neutrino detectorwill be used to upgrade the near detector of the T2K neutrino oscillation experiment, and our method reports efficiencies and purities of 94-96% per event in the classificationof particle track voxels.Due to the growth and complexity of deep neural networks, researchers have beeninvestigating techniques to train those networks in a more computationally-efficient way.Many efforts have been made by the community to optimise deep-learning models byparallelising or distributing their training computation across multiple devices. In thisthesis, we study an approach based on data locality for those neural networks that cannotbenefit from scaling their computation due to a significant bottleneck in the data I/O.The research also includes a detailed study on the performance of deep neural networkson hardware accelerator boards.Los métodos de aprendizaje profundo son cada vez más utilizados en numerosas aplicacionescientíficas e industriales hoy en día. Durante las dos últimas décadas, estastécnicas se han empleado en la recolección, reconstrucción y análisis de la gran cantidadde datos generados por experimentos de física de partículas. El tema principal de estatesis doctoral es el uso de estos modelos de aprendizaje profundo en experimentos defísica de neutrinos, en concreto en los experimentos de larga distancia DUNE y T2K. Losneutrinos, partículas fundamentales neutras, de las más ligeras del Universo, pueden serclave para explicar algunas de las cuestiones todavía sin resolver en física fundamental.Entre las diferentes contribuciones que esta tesis ha hecho a su estudio, cabe destacar eldesarrollo de un algoritmo basado en una red de neuronas convolucional para seleccionarcon gran eficiencia y precisión las interacciones de neutrinos electrónicos y muónicos enel Deep Underground Neutrino Experiment (DUNE). La eficiencia de selección obtenidapara neutrinos (antineutrinos) electrónicos alcanza un máximo del 90% (94%) y supera el85% (90%) para neutrinos con energías reconstruidas en el rango 2-5 GeV. La selección deneutrinos (antineutrinos) muónicos tiene una eficiencia máxima del 96% (97%) y excedeel 90% (95%) para neutrinos con energías reconstruidas de más de 2 GeV. Considerandocomo señal todas las interacciones de neutrinos y antineutrinos electrónicos (procedentestanto de oscilaciones como intrínsecos en el haz inicial), se logra una pureza en la seleccióndel 90%. Dichas selecciones de eventos son fundamentales para maximizar la sensibilidaddel experimento a los efectos de violació...
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
Using Verified Lifting to Optimize Legacy Stencil Codes (Final Project Report)
This project investigated new techniques for compiling stencil and stencil-like computations. Stencils computations are commonly found in applications such as image processing, physical simulations, image processing, and machine learning. In recent years, many high-performance domain-specific languages (DSLs) have been proposed to optimize stencil computations. To leverage such DSLs, however, existing codes often need to be rewritten. Such rewriting is manual, labor intensive, and error-prone. To alleviate such issues, this project investigated the application of program synthesis and artificial learning techniques to enable stencil computations to automatically leverage new high-performance DSLs. Rather than constructing syntax driven rules, verified lifting uses program synthesis to search for a target code fragment to compile the given input code into. In addition, it also searches for a proof that validates how the found target code fragment preserves the semantics of the original input. Thus, the target code fragment is guaranteed to be semantically equivalent to the input.
97 MATHEMATICS AND COMPUTING↗
Imaging Enhanced Simulation Validation for Directed Energy Deposition Additive Manufacturing (Final CRADA Report – NFE-22-09107)
Directed Energy Deposition (DED) is a welding-based metal Additive Manufacturing (AM) process that relies on the programmed rastering of an electric arc or laser induced weld pool to construct a component in a layerwise fashion. The induced complex thermal field and uneven thermal contraction depends on the printed geometry and scan pattern, and as such, accumulated residual stresses and distortions are complex and difficult to predict. Several prior works have resulted in tools to combat this issue; ANSYS has developed a thermoplastic simulation package targeting DED AM, and ORNL has developed an in-situ imaging sensor package ‘Stereo Correlated Optical and Pyrometric System’ (SCOPS) that can spatially monitor temperature and full field strain. In this CRADA, these tools are compared in order to validate the results and complimentarily address the weaknesses in each other.
36 MATERIALS SCIENCE↗
Predicting wind-driven spatial deposition through simulated color images using deep autoencoders
Abstract For centuries, scientists have observed nature to understand the laws that govern the physical world. The traditional process of turning observations into physical understanding is slow. Imperfect models are constructed and tested to explain relationships in data. Powerful new algorithms can enable computers to learn physics by observing images and videos. Inspired by this idea, instead of training machine learning models using physical quantities, we used images, that is, pixel information. For this work, and as a proof of concept, the physics of interest are wind-driven spatial patterns. These phenomena include features in Aeolian dunes and volcanic ash deposition, wildfire smoke, and air pollution plumes. We use computer model simulations of spatial deposition patterns to approximate images from a hypothetical imaging device whose outputs are red, green, and blue (RGB) color images with channel values ranging from 0 to 255. In this paper, we explore deep convolutional neural network-based autoencoders to exploit relationships in wind-driven spatial patterns, which commonly occur in geosciences, and reduce their dimensionality. Reducing the data dimension size with an encoder enables training deep, fully connected neural network models linking geographic and meteorological scalar input quantities to the encoded space. Once this is achieved, full spatial patterns are reconstructed using the decoder. We demonstrate this approach on images of spatial deposition from a pollution source, where the encoder compresses the dimensionality to 0.02% of the original size, and the full predictive model performance on test data achieves a normalized root mean squared error of 8%, a figure of merit in space of 94% and a precision-recall area under the curve of 0.93.
54 ENVIRONMENTAL SCIENCES↗
Biases associated with a particular image volume metric
Image analysis area and volume metrics A 80 and V 80 , used by others, are studied as a function of image morphology, a 3D feature, and Monte Carlo noise in simulated images. The A 80 area metric is found to be stable, with consistent results (and meaning) obtainable without a detailed understanding of 3D features and/or simulation noise levels. However, the V 80 volume metric varies significantly with image morphology, 3D features, and simulation noise. If an experimental image set gives A 80 area inferences that are consistent with 2D image simulations, but V 80 volume inferences that are significantly larger than those corresponding to simulated images, then issues related to 3D features and simulation noise should be explored before conclusions are drawn related to a possible mismatch in the real physical size of experimental and simulated source volumes.
47 OTHER INSTRUMENTATION↗
A Joint Roman Space Telescope and Rubin Observatory Synthetic Wide-Field Imaging Survey
We present and validate 20 deg(2) of overlapping synthetic imaging surveys representing the full depth of the Nancy Grace Roman Space Telescope High-Latitude Imaging Survey (HLIS) and 5 yr of observations of the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST). The two synthetic surveys are summarized, with reference to the existing 300 deg(2) of LSST simulated imaging produced as part of Dark Energy Science Collaboration (DESC) Data Challenge 2 (DC2). Both synthetic surveys observe the same simulated DESC DC2 universe. For the synthetic Roman survey, we simulate for the first time fully chromatic images along with the detailed physics of the Sensor Chip Assemblies derived from lab measurements using the flight detectors. The simulated imaging and resulting pixel-level measurements of photometric properties of objects span a wavelength range of similar to 0.3-2.0 mu m. We also describe updates to the Roman simulation pipeline, changes in how astrophysical objects are simulated relative to the original DC2 simulations, and the resulting simulated Roman data products. We use these simulations to explore the relative fraction of unrecognized blends in LSST images, finding that 20-30 per cent of objects identified in LSST images with i-band magnitudes brighter than 25 can be identified as multiple objects in Roman images. These simulations provide a unique testing ground for the development and validation of joint pixel-level analysis techniques of ground- and space-based imaging data sets in the second half of the 2020s - in particular the case of joint Roman-LSST analyses.
gravitational lensing↗
Recovered supernova Ia rate from simulated LSST images
Aims.TheVera C. RubinObservatory’s Legacy Survey of Space and Time (LSST) will revolutionize time-domain astronomy by detecting millions of different transients. In particular, it is expected to increase the number of known type Ia supernovae (SN Ia) by a factor of 100 compared to existing samples up to redshift ∼1.2. Such a high number of events will dramatically reduce statistical uncertainties in the analysis of the properties and rates of these objects. However, the impact of all other sources of uncertainty on the measurement of the SN Ia rate must still be evaluated. The comprehension and reduction of such uncertainties will be fundamental both for cosmology and stellar evolution studies, as measuring the SN Ia rate can put constraints on the evolutionary scenarios of different SN Ia progenitors. Methods.We used simulated data from the Dark Energy Science Collaboration (DESC) Data Challenge 2 (DC2) and LSST Data Preview 0 to measure the SN Ia rate on a 15 deg 2 region of the “wide-fast-deep” area. We selected a sample of SN candidates detected in difference images, associated them to the host galaxy with a specially developed algorithm, and retrieved their photometric redshifts. We then tested different light-curve classification methods, with and without redshift priors (albeit ignoring contamination from other transients, as DC2 contains only SN Ia). We discuss how the distribution in redshift measured for the SN candidates changes according to the selected host galaxy and redshift estimate. Results.We measured the SN Ia rate, analyzing the impact of uncertainties due to photometric redshift, host-galaxy association and classification on the distribution in redshift of the starting sample. We find that we are missing 17% of the SN Ia, on average, with respect to the simulated sample. As 10% of the mismatch is due to the uncertainty on the photometric redshift alone (which also affects classification when used as a prior), we conclude that this parameter is the major source of uncertainty. We discuss possible reduction of the errors in the measurement of the SN Ia rate, including synergies with other surveys, which may help us to use the rate to discriminate different progenitor models.
Astronomy & Astrophysics↗
Dark Energy Survey Year 3 results: magnification modelling and impact on cosmological constraints from galaxy clustering and galaxy–galaxy lensing
We study the effect of magnification in the Dark Energy Survey Year 3 analysis of galaxy clustering and galaxy–galaxy lensing, using two different lens samples: a sample of luminous red galaxies, redMaGiC, and a sample with a redshift-dependent magnitude limit, MagLim. We account for the effect of magnification on both the flux and size selection of galaxies, accounting for systematic effects using the Balrog image simulations. We estimate the impact of magnification on the galaxy clustering and galaxy–galaxy lensing cosmology analysis, finding it to be a significant systematic for the MagLim sample. We show cosmological constraints from the galaxy clustering autocorrelation and galaxy–galaxy lensing signal with different magnifications priors, finding broad consistency in cosmological parameters in ΛCDM and wCDM. However, when magnification bias amplitude is allowed to be free, we find the two-point correlation functions prefer a different amplitude to the fiducial input derived from the image simulations. We validate the magnification analysis by comparing the cross-clustering between lens bins with the prediction from the baseline analysis, which uses only the autocorrelation of the lens bins, indicating that systematics other than magnification may be the cause of the discrepancy. We show that adding the cross-clustering between lens redshift bins to the fit significantly improves the constraints on lens magnification parameters and allows uninformative priors to be used on magnification coefficients, without any loss of constraining power or prior volume concerns.
79 ASTRONOMY AND ASTROPHYSICS↗
Optimal 1D Ly α forest power spectrum estimation – III. DESI early data
ABSTRACT The 1D power spectrum P1D of the Ly α forest provides important information about cosmological and astrophysical parameters, including constraints on warm dark matter models, the sum of the masses of the three neutrino species, and the thermal state of the intergalactic medium. We present the first measurement of P1D with the quadratic maximum likelihood estimator (QMLE) from the Dark Energy Spectroscopic Instrument (DESI) survey early data sample. This early sample of 54 600 quasars is already comparable in size to the largest previous studies, and we conduct a thorough investigation of numerous instrumental and analysis systematic errors to evaluate their impact on DESI data with QMLE. We demonstrate the excellent performance of the spectroscopic pipeline noise estimation and the impressive accuracy of the spectrograph resolution matrix with 2D image simulations of raw DESI images that we processed with the DESI spectroscopic pipeline. We also study metal line contamination and noise calibration systematics with quasar spectra on the red side of the Ly α emission line. In a companion paper, we present a similar analysis based on the Fast Fourier Transform estimate of the power spectrum. We conclude with a comparison of these two approaches and discuss the key sources of systematic error that we need to address with the upcoming DESI Year 1 analysis.
79 ASTRONOMY AND ASTROPHYSICS↗