Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Computational imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,351 records · Page 75
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Genomes to Structure and Function Workshop Report 2022

The goal of the U.S. Department of Energy (DOE) Biological and Environmental Research (BER) Program is to achieve a predictive understanding of complex biological, earth, and environmental systems with the aim of advancing the nation’s energy and infrastructure security. (https://www.energy.gov/science/ ber/biological-and-environmental-research). To pursue this goal, collaborations among experts in diverse research areas that lead to multidisciplinary projects are indispensable. The roles of DOE’s User Facilities, which offer unique and powerful resources for such research projects, are evolving, and expectations for the facilities are increasing. To respond to Users’ needs, the Joint Genome Institute (JGI) and Environmental Molecular Sciences Laboratory (EMSL) initiated the Facilities Integrating Collaborations for User Science (FICUS) program in 2014. This collaboration has grown into a popular and successful program, advancing more than 100 multidisciplinary projects to date. Similarly, the new interFacility collaborations among the JGI, EMSL, and User resources for BER structural biology and imaging at the Basic Energy Science (BES) Program’s synchrotron and neutron facilities are becoming essential for cutting-edge transdisciplinary science. To further explore the need for the BER research community to combine genomic, functional, and structural approaches to advance their research, an organizing committee was formed to develop and jointly host a 3-part workshop. The committee’s members represented seven DOE National Laboratory User Facilities (Appendix 1 lists the members). The “Genomes to Structure and Function” virtual workshop (see Appendices 2–5) was composed of three sessions. The first session, titled “Molecular Structures” (October 27– 28, 2021), highlighted diverse integrative experimental and computational approaches correlating structural data with sequencing and functional information, as well as predicting protein structures to model complex biological systems. The second session, “Intracellular Organization, and Material Synthesis and Decomposition” (December 15–16, 2021), covered imaging methods for observing, quantifying, and manipulating biosystems. The third session, “Imaging the Rhizosphere and Cellular Organization” (January 26–27, 2022) emphasized advanced and non-invasive imaging techniques applied to plant root-microbe-soil interactions.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Beyond Binary: Automated PLC Memory Forensics through RGB Image Analysis and Deep Learning

The introduction of Industry 4.0 and the evolution of industrial control systems (ICS) to adopt Internet-based technologies enhanced productivity, but have inadvertently increased their vulnerability to cyber-based malicious attacks. When an ICS system is compromised, security analysts need to identify the root cause quickly to start the recovery process and develop mitigation strategies to safeguard against future instances. Memory forensics is critical in the analysis process to ascertain what occurred. To date, approaches to analyze the persistent memory in ICS devices are limited, and almost nonexistent for volatile memory. This paper proposes an automated methodology, COMA, for PLC memory dump analysis using computer vision and deep learning techniques. Specifically, COMA converts the sequences of bytes in a PLC memory dump to RGB pixels and creates a deep learning model that learns the underlying patterns and features of pre-labeled forensic artifacts in images and segments them into distinct regions. COMA then uses the trained model to automatically segment new memory images and extract forensic artifacts. We evaluate COMA on a Schneider Electric Modicon M221 PLC involving two cyber-based attack scenarios: (i) code injection and (ii) code modification. The empirical results show that COMA can successfully detect attack artifacts in memory dumps in both scenarios.

Asmar Awad, Rima↗
DOE OSTI2025

SIDDA: SInkhorn Dynamic Domain Adaptation for image classification with equivariant neural networks

Modern neural networks (NNs) often do not generalize well in the presence of a ‘covariate shift’; that is, in situations where the training and test data distributions differ, but the conditional distribution of classification labels given the data remains unchanged. In such cases, NN generalization can be reduced to a problem of learning more robust, domain-invariant features. Domain adaptation (DA) methods include a broad range of techniques aimed at achieving this; however, these methods have struggled with the need for extensive hyperparameter tuning, which then incurs significant computational costs. In this work, we introduce SInkhorn Dynamic Domain Adaptation (SIDDA), an out-of-the-box DA training algorithm built upon the Sinkhorn divergence, that can achieve effective domain alignment with minimal hyperparameter tuning and computational overhead. We demonstrate the efficacy of our method on multiple simulated and real datasets of varying complexity, including simple shapes, handwritten digits, real astronomical observations, and remote sensing data. These datasets exhibit covariate shifts due to noise, blurring, differences between telescopes, and variations in imaging wavelengths. SIDDA is compatible with a variety of NN architectures, and it works particularly well in improving classification accuracy and model calibration when paired with symmetry-aware equivariant NNs (ENNs). We find that SIDDA consistently enhances the generalization capabilities of NNs, achieving up to a ${\approx}40\%$ improvement in classification accuracy on unlabeled target data, while also providing a more modest performance gain of $\lesssim 1\%$ on labeled source data. We also study the efficacy of DA on ENNs with respect to the varying group orders of the dihedral group DN, and find that the model performance improves as the degree of equivariance increases. Finally, if SIDDA achieves proper domain alignment, it also enhances model calibration on both source and target data, with the most significant gains in the unlabeled target domain—achieving over an order of magnitude improvement in the expected calibration error and Brier score. SIDDA’s versatility across various NN models and datasets, combined with its automated approach to domain alignment, has the potential to significantly advance multi-dataset studies by enabling the development of highly generalizable models.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Data Structure Alchemy

In an increasingly more data-driven world, the project set out to uncover the first principles of data-structure design, chart the immense design space they form, and build automation that can synthesize an optimal structure, or even a whole storage engine, for any given workload, hardware platform, and cost target. Data structures are at the center of every computational system and are directly responsible for its performance. Two core technical thrusts were defined: 1) Mapping design spaces for key data-centric abstractions (filters, hash functions, storage-engine layouts, neural-network topologies, blockchain protocols, image layouts, etc.). 2) Developing search & synthesis algorithms, initially analytical cost models, later neural-guided bi-level optimisers that navigate sextillions of candidate designs in seconds and materialise the best one as ready‐to-run code. This report distills the key insights, accomplishments, and impact.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Prediction of Solar Irradiance and Photovoltaic Solar Energy Product Based on Cloud Coverage Estimation Using Machine Learning Methods

Cloud cover estimation from images taken by sky-facing cameras can be an important input for analyzing current weather conditions and estimating photovoltaic power generation. The constant change in position, shape, and density of clouds, however, makes the development of a robust computational method for cloud cover estimation challenging. Accurately determining the edge of clouds and hence the separation between clouds and clear sky is difficult and often impossible. Toward determining cloud cover for estimating photovoltaic output, we propose using machine learning methods for cloud segmentation. We compare several methods including a classical regression model, deep learning methods, and boosting methods that combine results from the other machine learning models. To train each of the machine learning models with various sky conditions, we supplemented the existing Singapore whole sky imaging segmentation database with hazy and overcast images collected by a camera-equipped Waggle sensor node. We found that the U-Net architecture, one of the deep neural networks we utilized, segmented cloud pixels most accurately. However, the accuracy of segmenting cloud pixels did not guarantee high accuracy of estimating solar irradiance. We confirmed that the cloud cover ratio is directly related to solar irradiance. Additionally, we confirmed that solar irradiance and solar power output are closely related; hence, by predicting solar irradiance, we can estimate solar power output. This study demonstrates that sky-facing cameras with machine learning methods can be used to estimate solar power output. This ground-based approach provides an inexpensive way to understand solar irradiance and estimate production from photovoltaic solar facilities.

14 SOLAR ENERGY↗
DOE OSTI2025

Effective Defect Detection Using Instance Segmentation for NDI

Ultrasonic testing is a common Non-Destructive Inspection (NDI) method used in aerospace manufacturing. However, the complexity and size of the ultrasonic scans make it challenging to identify defects through visual inspection or machine learning models. Using computer vision techniques to identify defects from ultrasonic scans is an evolving research area. In this study, we used instance segmentation to identify the presence of defects in the ultrasonic scan images of composite panels that are representative of real components manufactured in aerospace. We used two models based on Mask- RCNN (Detectron 2) and YOLO 11 respectively. Additionally, we implemented a simple statistical pre-processing technique that reduces the burden of requiring custom-tailored pre-processing techniques. Our study demonstrates the feasibility and effectiveness of using instance segmentation in the NDI pipeline by significantly reducing data pre-processing time, inspection time, and overall costs.

computer vision techniques↗
DOE OSTI2025

Soil porous microstructure control over soil organic matter mobility: A multimethod workflow for understanding chemistry-dependent organic matter binding in soil

Soil organic matter (SOM) has attracted a great deal of interest; particularly for its potential to mitigate human derived CO 2 emissions. Studies have demonstrated that SOM plays a critical role in carbon storage and CO 2 sequestration. However, the sorption properties of SOM, which influence its transport in pore water and stabilization within the soil, remain poorly understood. This study develops a workflow to: (1) examine compound-specific advective and diffusive transport and desorption behaviors, (2) quantify desorption rates through stop-flow and continuous-flow column experiments, and (3) evaluate the impact of soil microporosity on SOM mobility using high-resolution imaging and extractions. Intact core column experiments were conducted on Uncultivated (Natural) and Cultivated soil samples, both were arid soils, collected in Washington State. X-ray computed tomography was employed to measure porosity and pore connectivity, while Fourier-transform ion cyclotron resonance mass spectrometry was used to analyze SOM composition. The findings revealed that cultivation increased total carbon and nitrogen levels due to irrigation and fertilization, enhancing carbon capture potential in arid soils. In contrast, the Natural soil, characterized by higher porosity and connectivity, contained more oxidized carbon. Pore network analysis indicated that soil compaction in the Cultivated soil may lead to longer diffusion pathways, significantly influencing SOM transport and stability.

Hydraulic Properties↗
DOE OSTI2019

New method for analysis of X-ray computed tomography scans of TRISO fuel forms

X-ray computed tomography (XCT) is a powerful characterization tool that has been used for examination of both tristructural-isotropic (TRISO) coated particles and fuel forms. Rapid, nondestructive imaging of complete specimens by XCT provides significant characterization advantages in both speed and comprehensiveness over traditional materialographic methods. This paper discusses a method that has been developed to analyze XCT images of pebble fuel forms containing ~18,000 TRISO particles each. The XCT images are three-dimensional with contrast based on relative x-ray transparency. In the case of TRISO fuel forms, XCT image intensity distinguishes between the high-density kernel, the medium-density SiC, and the low-density matrix and carbon layers. Image analysis software has been developed to process XCT data sets to extract spatial distribution information, including particle nearest-neighbor distances, local packing fraction, and fuel-free zone thickness in TRISO fuel forms. Finally, although this type of high-resolution XCT analysis is likely not feasible as a quality control measurement for commercial TRISO fuel, it is highly useful in generating feedback for the development of fuel form fabrication processes.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Simulation-trained machine learning models for Lorentz transmission electron microscopy

Understanding the collective behavior of complex spin textures, such as lattices of magnetic skyrmions, is of fundamental importance for exploring and controlling the emergent ordering of these spin textures and inducing phase transitions. It is also critical to understand the skyrmion–skyrmion interactions for applications such as magnetic skyrmion-enabled reservoir or neuromorphic computing. Magnetic skyrmion lattices can be studied using in situ Lorentz transmission electron microscopy (LTEM), but quantitative and statistically robust analysis of the skyrmion lattices from LTEM images can be difficult. In this work, we show that a convolutional neural network, trained on simulated data, can be applied to perform segmentation of spin textures and to extract quantitative data, such as spin texture size and location, from experimental LTEM images, which cannot be obtained manually. This includes quantitative information about skyrmion size, position, and shape, which can, in turn, be used to calculate skyrmion–skyrmion interactions and lattice ordering. We apply this approach to segmenting images of Néel skyrmion lattices so that we can accurately identify skyrmion size and deformation in both dense and sparse lattices. The model is trained using a large set of micromagnetic simulations as well as simulated LTEM images. This entirely open-source training pipeline can be applied to a wide variety of magnetic features and materials, enabling large-scale statistical studies of spin textures using LTEM.

McCray, Arthur R. C. (ORCID:0000000160774698)↗
DOE OSTI2021

Passive Inter-Photon Imaging

Digital camera pixels measure image intensities by converting incident light energy into an analog electrical current, and then digitizing it into a fixed-width binary representation. This direct measurement method, while conceptually simple, suffers from limited dynamic range and poor performance under extreme illumination --- electronic noise dominates under low illumination, and pixel full-well capacity results in saturation under bright illumination. We propose a novel intensity cue based on measuring inter-photon timing, defined as the time delay between detection of successive photons. Based on the statistics of inter-photon times measured by a time-resolved single-photon sensor, we develop theory and algorithms for a scene brightness estimator which works over extreme dynamic range; we experimentally demonstrate imaging scenes with a dynamic range of over ten million to one. The proposed techniques, aided by the emergence of single-photon sensors such as single-photon avalanche diodes (SPADs) with picosecond timing resolution, will have implications for a wide range of imaging applications: robotics, consumer photography, astronomy, microscopy and biomedical imaging.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Fast HARDI Uncertainty Quantification and Visualization with Spherical Sampling

In this paper, we study uncertainty quantification and visualization of orientation distribution functions (ODF), which corresponds to the diffusion profile of high angular resolution diffusion imaging (HARDI) data. The shape inclusion probability (SIP) function is the state‐of‐the‐art method for capturing the uncertainty of ODF ensembles. The current method of computing the SIP function with a volumetric basis exhibits high computational and memory costs, which can be a bottleneck to integrating uncertainty into HARDI visualization techniques and tools. We propose a novel spherical sampling framework for faster computation of the SIP function with lower memory usage and increased accuracy. In particular, we propose direct extraction of SIP isosurfaces, which represent confidence intervals indicating spatial uncertainty of HARDI glyphs, by performing spherical sampling of ODFs. Our spherical sampling approach requires much less sampling than the state‐of‐the‐art volume sampling method, thus providing significantly enhanced performance, scalability, and the ability to perform implicit ray tracing. Our experiments demonstrate that the SIP isosurfaces extracted with our spherical sampling approach can achieve up to 8164× speedup, 37282× memory reduction, and 50.2% less SIP isosurface error compared to the classical volume sampling approach. We demonstrate the efficacy of our methods through experiments on synthetic and human‐brain HARDI datasets.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Simulations of coherent scattering experiments at storage ring synchrotron radiation sources in the hard x-ray range

Detailed simulations of experiments carried out at modern light sources are directly related to the most efficient and productive use of these facilities for research in multiple branches of science and technology. The “Synchrotron Radiation Workshop” computer code with its Python interface, and Sirepo web-browser-based graphical user interface, currently supports physical optics simulations of coherent X-ray scattering and imaging experiments on user-defined virtual samples. We present examples of simulations of coherent scattering experiments that are typically performed at the Coherent Hard X-ray beamline at Brookhaven National Laboratory’s (BNL) National Synchrotron Light Source II. We also present several comparisons of the simulations with the results of actual coherent X-ray scattering experiments with nano-fabricated test samples produced at BNL’s Center for Functional Nanomaterials.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Rapid Optimization of Total Variation with Applications in Imaging, Additive Manufacturing, and Qualification

Total Variation optimization penalizes the gradient of a control variable or state. While this work focuses on image processing in particular, it has also found applications in inverse problems and topology optimization. In image processing, the goal is to maintain faithfulness to the original image while denoising and/or deblurring. Additionally, bilevel optimization over the spatially varying regularization weights can illuminate interfaces such as damage regions and other anomalies. We will address two fundamental challenges with TV-optimization: (i) the typical slow convergence of existing TV-optimization methods, and (ii) the selection of spatially varying TV parameters to promote interface detection. Additionally, we will apply such techniques to image data collected in additive manufacturing. In said context, stochasticity in build events induces flaws in the manufactured piece, compromising the integrity of said part. There is a critical need for in-situ monitoring to spot anomalies once they form, and in this setting we apply our total variation and hyperparameter solvers. We will develop a customized algorithm based on for extreme-scale TV-optimization that achieves super-linear or quadratic-convergence, a critical property for real-time, image-by-image analysis. A worst-case outcome is a preprocessing step that enhances image quality in-situ, specifically for out-of-focus and noisy images.

36 MATERIALS SCIENCE↗
DOE OSTI2019

Shear Measurement Bias Due to Spatially Varying Spectral Energy Distributions in Galaxies

Galaxy color gradients (CGs)—i.e., spectral energy distributions that vary across the galaxy profile—will impact galaxy shape measurements when the modeled point-spread function (PSF) corresponds to that for a galaxy with spatially uniform color. This paper describes the techniques and results of a study of the expected impact of galaxy CGs on weak lensing measurements with the Large Synoptic Survey Telescope (LSST) when the PSF size depends on wavelength. The bias on cosmic shear measurements from CGs is computed both for parametric bulge$+$disk galaxy simulations and for more realistic chromatic galaxy surface brightness profiles based on Hubble Space Telescope V- and I-band images in the All-Wavelength Extended Groth Strip International Survey (AEGIS). For the parametric galaxies, and for the more realistic galaxies derived from AEGIS galaxies with a sufficient signal-to-noise ratio that CG bias can be isolated, the predicted multiplicative shear biases due to CGs are found to be at least a factor of two below the LSST full-depth requirement on the total systematic uncertainty in the redshift-dependent shear calibration. The analysis code and data products are publicly available (https://github.com/sowmyakth/measure_cg_bias).

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Multiphysics Degradation Modeling of Energy Storage Materials via RKPM with a Neural Network-Enhancement

In energy storage materials, strong electrochemical-mechanical coupling and highly anisotropic material properties contribute to the formation and propagation of micro-cracking during charge/discharge cycling, resulting in reduced performance and service life. A coupled electro-chemo-mechanical reproducing kernel particle method (RKPM) formulation is developed, and a patch-test is formulated to certify optimal convergence of the proposed RKPM method for the coupled physics system. With microstructural images supplied by the National Renewable Energy Laboratory (NREL), pixel-based model construction by RKPM is then used to represent the complex material microstructures for modeling the coupled physics of these systems. Further, a neural network-enhanced reproducing kernel particle method (NN-RKPM) [1, 2] is introduced to effectively model damage and crack propagation in the material microstructures; the location, orientation, and solution transition near a localization are automatically captured by superimposed block-level NN optimizations. This NN enrichment approach allows for effective modeling of localizations via a fixed background discretization, relieving tedious efforts for adaptive refinement in traditional mesh-based methods. Applications to the heterogeneous microstructures of Li-ion battery cathodes will be presented to demonstrate the effectiveness of the proposed methods. Reference: [1] Baek, J., Chen, J. S., Susuki, K., "Neural Network enhanced Reproducing Kernel Particle Method for Modeling Localizations," International Journal for Numerical Methods in Engineering, Vol. 123, pp 4422-4454, https://doi.org/10.1002/nme.7040, 2022. [2] Baek, J., Chen, J. S., "A Neural Network-Based Enrichment of Reproducing Kernel Approximation for Modeling Brittle Fracture", Computer Methods in Applied Mechanics and Engineering Vol. 410, 116590, 2024.

electro-chemo-mechanical coupling↗
DOE OSTI2020

Efficient bi-directional coupling of 3D computational fluid-particle dynamics and 1D Multiple Path Particle Dosimetry lung models for multiscale modeling of aerosol dosimetry

The development of predictive aerosol dosimetry models has been a major focus of environmental toxicology and pharmaceutical health research for decades. One-dimensional (1D) models successfully predict overall deposition averages but fail to accurately predict local deposition. Computational fluid-particle dynamics (CFPD) models provide site-specific predictions but at a computational cost that prohibits whole lung predictions. Thus, there is a need for developing multiscale strategies to provide a realistic subject-specific picture of the fate of inhaled aerosol in the lungs. CT-based 3D/CFPD models of the large airways were bidirectionally coupled with individualized 1D Navier-Stokes airflow and particle transport based upon the widely used Multiple Path Particle Dosimetry Model (MPPD). Distribution of airflows among lobes was adjusted by measured lobar volume changes observed in CT images between FRC and FRC + 1.5 L. Additionally, as a test of the effectiveness of the coupling procedures, deposition modeling of previous 1 µm aerosol exposure studies was performed. The complete coupled model was run for 3 breaths, with the computation-intense portion being the 3D CFD Lagrangian particle tracking calculation. The average deposition per breath was 11% in the combined multiscale model with site-specific doses available in the CFPD portion of the model and airway- or region-specific deposition available for the MPPD portion. In conclusion, the key methods developed in this study enable predictions of ventilation heterogeneities and aerosol deposition across the lungs that are not captured by 3D or 1D models alone. Overall, these methods can be used as the foundation for multi-scale modeling of the full respiratory system.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Imaging of Electrothermal Filament Formation in a Mott Insulator

Resistive switching—the current- and voltage-induced change of electrical resistance—is at the core of memristive devices, which play an essential role in the emerging field of neuromorphic computing. This study is about resistive switching in a Mott insulator, which undergoes a thermally driven metal-to-insulator transition. Two distinct switching mechanisms are reported for such a system: electric-field-driven resistive switching and electrothermal resistive switching. The latter results from an instability caused by Joule heating. Here, we present the visualization of the reversible resistive switching in a planar V 2 O 3 thin-film device using high-resolution wide-field microscopy in combination with electric transport measurements. We investigate the interaction of the electrothermal instability with the strain-induced spontaneous phase separation in the V 2 O 3 thin film at the Mott transition. The photomicrographs show the formation of a narrow metallic filament with a minimum width ≲500 nm. Although the filament formation and the overall shape of the current-voltage characteristics (IVCs) are typical of an electrothermal breakdown, we also observe atypical effects such as oblique filaments, filament splitting, and hysteretic IVCs with sawtoothlike jumps at high currents in the low-resistance regime. We are able to reproduce the experimental results in a numerical model based on a two-dimensional resistor network. This model demonstrates that resistive switching in this case is indeed electrothermal and that the intrinsic heterogeneity is responsible for the atypical effects. This heterogeneity is strongly influenced by strain, thereby establishing a link between switching dynamics and structural properties.

42 ENGINEERING↗