Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Computational imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,189 records · Page 66

Malicious activity detection in a memory

A method and apparatus for monitoring a volatile memory in a computer system. Samples of compressed data from locations in the volatile memory in the computer system are read. Data in the volatile memory is reconstructed using the samples of compressed data. The data is an image of the volatile memory. The image enables determining whether an undesired process is present in the volatile memory.

Wheeler, Jason W.↗

Chemical Imaging of Atmospheric Biomass Burning Particles from North American Wildfires

The effects of biomass burning aerosols (BBA) on radiative forcing and cloud formation depend on chemical composition and the internal structures of individual particles within smoke plumes. To improve our understanding of the chemical and physical properties of BBA emitted at different times of the day and their evolution during atmospheric aging, we conducted a study as a part of the Fire Influence on Regional to Global Environments and Air Quality field campaign. Particle samples were collected onboard a research aircraft from smoke plumes from a wildfire in eastern Oregon during late afternoon and nighttime flights on August 28, 2019. A time-resolved aerosol collector was used to collect samples on substrates for offline spectromicroscopic imaging to investigate the single-particle characteristics of BBA particles. Approximately 20,400 individual particles from 10 selected samples were analyzed using computer-controlled scanning electron microscopy coupled with energy-dispersive X-ray microanalysis, revealing their elemental composition, morphology, and viscosity. Elemental microanalysis indicated that aged potassium is likely found in the form of K 2 SO 4 , KNO 3 , and possible K-organic salts. Further chemical speciation and carbon bonding mapping within individual particles were conducted using synchrotron-based scanning transmission X-ray microscopy (STXM) coupled with near edge X-ray absorption fine structure (NEXAFS) spectroscopy. Real-time, water-soluble light absorption measurements were acquired using a particle-into-liquid sampler instrument coupled to a liquid waveguide capillary cell and total organic analyzer. In the late afternoon samples, 65% of the total particle number population consisted entirely of organic components, compared to 46% in the nighttime particles. These differences were attributed to discrepancies in composition at the time of emission and to the daytime condensation and accumulation of photochemically formed secondary organic material on existing BBA particles, a process that halts at night. Microscopy images indicated that particle viscosity was lower in the nighttime particles (<10 1 Pa·s), likely due to increased relative humidity and a higher contribution from hygroscopic inorganic components. The chemical heterogeneity of individual particles was quantified using STXM-derived mixing state parameters. The nature of carbon bonding within individual particles was inferred from the extent of carbon sp 2 hybridization derived from NEXAFS spectra. Average percentages of sp 2 hybridization range between 40% and 60%, with no noticeable differences between late afternoon and nighttime flights. These findings were compared with the online optical properties of both late afternoon and nighttime smoke plumes, providing valuable insights into the complex relationship between chemical composition and optical properties of BBA particles at different times of the day.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A data-driven framework for permeability prediction of natural porous rocks via microstructural characterization and pore-scale simulation

Understanding the microstructure–property relationships of porous media is of great practical significance, based on which macroscopic physical properties can be directly derived from measurable microstructural informatics. However, establishing reliable microstructure–property mappings in an explicit manner is difficult, due to the intricacy, stochasticity, and heterogeneity of porous microstructures. In this paper, a data-driven computational framework is presented to investigate the inherent microstructure–permeability linkage for natural porous rocks, where multiple techniques are integrated together, including microscopy imaging, stochastic reconstruction, microstructural characterization, pore-scale simulation, feature selection, and data-driven modeling. A large number of 3D digital rocks with a wide porosity range are acquired from microscopy imaging and stochastic reconstruction techniques. A broad variety of morphological descriptors are used to quantitatively characterize pore microstructures from different perspectives, and they compose the raw feature pool for feature selection. Here high-fidelity lattice Boltzmann simulations are conducted to resolve fluid flow passing through porous media, from which reliable permeability references are obtained. The optimal feature set that best represents permeability is identified through a performance-oriented feature selection process, upon which a cost-effective surrogate model is rapidly fitted to approximate the microstructure-permeability mapping via data-driven modeling. This surrogate model exhibits great advantages over empirical/analytical formulas in terms of prediction accuracy and generalization capacity, which can predict reliable permeability values spanning four orders of magnitude. Besides, feature selection also greatly enhances the interpretability of the data-driven prediction model, from which new insights into the mechanism of how microstructural characteristics determine intrinsic permeability are obtained.

58 GEOSCIENCES↗

A Machine Learning Framework to Predict Images of Edge-on Protoplanetary Disks

The physical structure and properties of protoplanetary disks are typically derived from spatially resolved disk images. Edge-on disks in particular provide an important view point on the vertical structure and degree of settling of disks. Such analyses rely on radiative transfer (RT) calculations that are generally computationally intensive due to the high optical depth of disks. Here we present a machine learning framework that has the potential to dramatically speed up the forward modeling process by approximating the results of RT calculations. This framework, trained on an initial set of RT calculations, utilizes an autoencoder neural network to enable the generation of synthetic scattered light images of edge-on disks directly from a set of physical parameters. We demonstrate that this framework generates synthetic images 2–3 orders of magnitude faster than using RT calculations. These machine learning-generated images appear to approximate the RT images well, in particular preserving their size and shape. We also find a strong correlation between the latent space representations of the generated disk images and several of their associated physical parameters. Finally, we discuss potential changes to the framework, such as methods to further improve the image quality, extending the framework to multiple wavelengths, and inverting the process to infer physical parameters from observed images. Overall, these new tools have the potential to enable a more efficient and uniform analysis of edge-on disk properties and the initial conditions of planet formation.

79 ASTRONOMY AND ASTROPHYSICS↗

Contactless Position Measurement System for Remote Alignment of Highly Reflective Objects

The Contactless Position Measurement System (CPMS) permits automatic alignment of highly-reflecting components that cannot or should not be touched by human hands, such as those used in SRF cavities. CPMS also has application during maintenance of fusion reactors, when the components in the reactor are radioactive. The length of time for which humans can handle the components in order to carry out maintenance or repairs is limited. We would like to measure the relative positions of such objects so we can bring them into alignment with motorized stages, thus eliminating the need for human contact. The CPMS is a computer vision system that measures the location of highly reflective components to within a fraction of a millimeter by finding the edges of silhouette images. This is done by placing a uniform, infrared backlight behind the components, and viewing each component with two low-aberration, infrared cameras. Each of these stereoscopic cameras are located within a coordinate system we set up with reference platforms, light sources, and survey cameras distributed around the perimeter of the string assembly room, or fusion reactor. We obtain stereoscopic silhouette images of each component, and we use these to determine the position of the component within our string assembly coordinate system. The CPMS combines the silhouette images with knowledge of the dimensions of the objects to obtain the relative positions of components in its field of view. These position measurements then allow us to mechanically maneuver the components into contact. Once we know where they are, we can move the components to where they are supposed to be with motorized stages or other mechanical means, check they are in the right place, and bolt them together. In Phase I, we built a prototype infrared backlights and cameras, tested it, wrote an analysis program to fit the images. At a range of 50 cm, we are able to measure the relative positions of two stainless steel flanges with an accuracy of 150 μm rms. The next steps are to test the analysis program with motorized stages, build a full-size prototype, and implement it in an cleanroom with SRF cavity assembly. This can be done in a cost effective way given the materials with which the system is designed. As Open Source Instruments achieved more in Phase I than anticipated, despite not receiving a Phase II SBIR grant, we hope to move forward with product development and sales with a testing partner.

43 PARTICLE ACCELERATORS↗

A lightweight, user-configurable detector ASIC digital architecture with on-chip data compression for MHz X-ray coherent diffraction imaging

Today, most X-ray pixel detectors used at light sources transmit raw pixel data off the detector ASIC. With the availability of more advanced ASIC technology nodes for scientific application, more digital functionalities from the computing domains (e.g., compression) can be integrated directly into a detector ASIC to increase data velocity. In this paper, we describe a lightweight, user-configurable detector ASIC digital architecture with on-chip compression which can be implemented in 130 nm technologies in a reasonable area on the ASIC periphery. In addition, we present a design to efficiently handle the variable data from the stream of parallel compressors. The architecture includes user-selectable lossy and lossless compression blocks. The impact of lossy compression algorithms is evaluated on simulated and experimental X-ray ptychography datasets. This architecture is a practical approach to increase pixel detector frame rates towards the continuous 1 MHz regime for not only coherent imaging techniques such as ptychography, but also for other diffraction techniques at X-ray light sources.

47 OTHER INSTRUMENTATION↗

Nondestructive neutron imaging diagnosis of acidic gas reduction catalyst after 400-Hour operation in natural gas furnace

Residential natural gas furnaces are the primary space-heating devices in US homes, leading to substantial environmental impact caused by the acidic components in the furnace combustion gases. Here, to experimentally demonstrate acidic gas reduction in a furnace, a monolithic catalyst was fabricated and was called the AGR. A commercially-available condensing furnace was retrofitted with the AGR, and a 400-hour reliability and durability test was conducted. The results showed that the AGR significantly reduced acidic gases in the flue gas and produced condensate with neutral pH. Challenges were also revealed: inappropriate condensate drainage caused incomplete combustion and amorphous carbon deposits. To nondestructively survey the internal state of the AGR, neutron computed tomography (NCT) was employed to produce spatially resolved 2D and 3D representations of the 2-L, aged AGR component. The NCT results confirm the integrity of the AGR component, which consists of two blocks, without deformation or damage to AGR channels. The distribution of the particle accumulation in the middle of the top block was visibly heavier than the entrance and exit of the top block. The representative cross-section views revealed significant aggregation in the central region but not at the rim. The spatially resolved details provide in-depth diagnosis, evaluation, and understanding of the AGR. The insights can enable new AGR designs that realize a uniform and self-cleaning flow pattern, alleviate significant particle aggregation, and thus enhance AGR-enabled furnace performance. The neutron imaging method demonstrates the good potential that can diagnose faults and improve the design, optimization, and production processes of novel catalysts and other components or systems with heavy metal shell.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Measurement of Transport Properties of Woody Biomass Feedstock Particles Before and After Pyrolysis by Numerical Analysis of X-Ray Tomographic Reconstructions

Lignocellulosic biomass has a complex, species-specific microstructure that governs heat and mass transport during conversion processes. A quantitative understanding of the evolution of pore size and structure is critical to optimize conversion processes for biofuel and bio-based chemical production. Further, improving our understanding of the microstructure of biochar coproduct will accelerate development of its myriad applications. This work quantitatively compares the microstructural features and the anisotropic permeabilities of two woody feedstocks, red oak and Douglas fir, using X-ray computed tomography (XCT) before and after the feedstocks are subjected to pyrolysis. Quantitative analysis of the three-dimensional (3D) reconstructions allows for direct calculations of void fractions, pore size distributions and tortuosity factors. Next, 3D images are imported into an immersed boundary based finite volume solver to simulate gas flow through the porous structure and to directly calculate the principal permeabilities along longitudinal, radial, and tangential directions. The permeabilities of native biomass are seen to differ by three to four orders of magnitude in the different principal directions, but we find that this anisotropy is substantially reduced in the biochar formed during pyrolysis. The quantitative transport properties reported here enhance the ability of pyrolysis simulations to account for feedstock-specific effects and thereby provide a useful touchstone for the biorefining community.

09 BIOMASS FUELS↗

Videos, photos, and AI-derived grain size data associated with “High-throughput AI Video Surveys Enable Reproducible Multiscale Sediment Size Mapping, with Implications for Hydrobiogeochemical Parameterization”

NOTE: The manuscript associated with this data package is currently in review. The data may be revised based on reviewer feedback. Upon manuscript acceptance, this data package will be updated with the final dataset and additional metadata. This data package is associated with the manuscript “High-throughput AI Video Surveys Enable Reproducible Multiscale Sediment Size Mapping, with Implications for Hydrobiogeochemical Parameterization” under review. This data package includes five data types: 1) raw photos and videos from drone survey and walking smartphone surveys; 2) images derived from raw videos; 3) manual labeling of reference scales; 4) metadata for all images and photo resolution derived from artificial intelligence (AI) models or manual labels, 5) grain size data obtained from AI models for all photos, 6) metadata and grain size data after quality control, 7) summaries of sample efficiency for all data, and 8) computational fluid dynamics (CFD) data used to support hydro-biogeochemical (HBGC) parameter estimation. Such data is used to 1) demonstrate significant improvements in accuracy, efficiency, and quality control for grain size data collection with the help of AI models, 2) study the spatial heterogeneity of grain size and observation reproducibility based on tens of thousands of data points generated by the AI models, and 3) evaluate the impacts of grain size heterogeneity on key HBGC parameters across sediment-to-reach and hourly-to-yearly scales. In particular, the data package contains 116 folders and 179696 files. The files include 41 videos in .mov format, 64047 photos in .jpg format, 13541 video-derived photos in .png format, 12747 segmentation mask data in .tif format, 12747 segmentation data in .json format, 24771 .csv files that with metadata and grain size for each individual photo as well as water depth and velocity data from CFD and observation, 51791 .txt files of raw AI predicted labels, and 11 flight record data in .srt format. The summary for all metadata and grain size statistics information is included in “Scales_V3_NG.csv” and “Statistics_V3_NG.csv”. The summary for data that pass data quality control (QC) level 0-2 is included in “QCStatistics_V3_NG.csv”. The QC level 0 represents photos whose photo resolution is positive, excluding photos that miss reference scale. The QC level 1 means reference scale circularity uncertainty is less than 5% for smartphone images while representing photo resolution is larger than 0.44 mm/pixel for drone images. The QC level 2 means excluding photos whose grain number is less than 100, a minimum number of grains recommended by classic literature. The summary for each video’s name, length, frame rates, survey area, grain number, survey efficiency, etc. can be found in “QCSummary_V3_NG.csv”. The summary for site name, GPS coordinates, and number of images at each site can be found in “SitesSummary_V3_*.csv” files. Overall computational efficiency summary is reported in Table 4 of accompanying manuscript. Additionally, the nitrate concentration data used in this work was downloaded from an existing dataset published on ESS-DIVE (Boat-Dragged Sensor Hanford Reach.csv; Conner A. et al., 2020). We thank the United States Forest Service, Washington Department of Fish and Wildlife, Washington Department of Natural Resources, Cowiche Canyon Conservatory, Port of Benton, and the Confederated Tribes and Bands of the Yakama Nation for access to field locations where the data were collected. We also thank the Yakama Nation Tribal Council and Yakama Nation Fisheries for working with us to facilitate data collection and optimization of data usage according to their values and worldview.

54 ENVIRONMENTAL SCIENCES↗

Scale-up Unlearnable Examples Learning with High-performance Computing

Recent advancements in AI models, like ChatGPT, are structured to retain user interactions, which could inadvertently include sensitive healthcare data. In the healthcare field, particularly when radiologists use AI-driven diagnostic tools hosted on online platforms, there is a risk that medical imaging data may be repurposed for future AI training without explicit consent, spotlighting critical privacy and intellectual property concerns around healthcare data usage. Addressing these privacy challenges, a novel approach known as Unlearnable Examples (UEs) has been introduced, aiming to make data unlearnable to deep learning models. A prominent method within this area, called Unlearnable Clustering (UC), has shown improved UE performance with larger batch sizes but was previously limited by computational resources (e.g., a single workstation). To push the boundaries of UE performance with theoretically unlimited resources, we scaled up UC learning across various datasets using Distributed Data Parallel (DDP) training on the Summit supercomputer. Our goal was to examine UE efficacy at high-performance computing (HPC) levels to prevent unauthorized learning and enhance data security, particularly exploring the impact of batch size on UE’s unlearnability. Utilizing the robust computational capabilities of the Summit, extensive experiments were conducted on diverse datasets such as Pets, MedMNist, Flowers, and Flowers102. Our findings reveal that both overly large and overly small batch sizes can lead to performance instability and affect accuracy. However, the relationship between batch size and unlearnability varied across datasets, highlighting the necessity for tailored batch size strategies to achieve optimal data protection. The use of Summit’s high-performance GPUs, along with the efficiency of the DDP framework, facilitated rapid updates of model parameters and consistent training across nodes. Our results underscore the critical role of selecting appropriate batch sizes based on the specific characteristics of each dataset to prevent learning and ensure data security in deep learning applications. The source code is publicly available at https: // github. com/ hrlblab/ UE_ HPC .

Zhu, Yanfan [Vanderbilt University, Nashville, TN,↗

High-resolution bandpass x-ray imaging with crystal reflectors: Overcoming geometric aberrations

The imaging problem of a specular reflector is revisited. Retaining terms through the second order in the reflector surface expansion, we derive the form of the aberration-limiting aperture for arbitrary magnification, assuming no bandwidth limitations. A permissible relative aperture size of the reflector is limited by a set relative aberration tolerance and scales with the tangent of the central glancing angle of incidence. These limiting aberrations become practically insignificant near backscattering. The results extend to x-ray diffracting crystals in symmetric Bragg geometry shaped as an ellipsoid of revolution. This geometry permits polychromatic imaging for hard x-rays over a bandwidth defined by the accepted range of Bragg angles, thereby suppressing aberrations of higher orders. We assess ellipsoidal crystal imagers using ray tracing simulations for two high-magnification designs with Bragg angles far from and close to backscattering. Finally, in both cases, the ellipsoidal crystals produce images of higher quality compared to those formed by equivalent toroidal crystal imagers.

Bragg reflection↗

Sparse Data Machine Learning Integration with Theory, Experiment and Uncertainty Quantification: Process-Structure-Property-Performance of Friction Deformation Processing

Computer vision and deep learning tools that advance the ability to establish processing-structure-property-performance (PSPP) relations are presented. The Bayesian binning method for image segmentation enables quantitative analysis of microstructural features in an automated way, while the analysis of shapes and relative orientation of these features reveals local deformation maps indicative of both, material flow and residual stresses due to materials processing. The deep learning method leads to the previous knowledge agnostic mapping of empirically observed microstructural zones in friction stir welding (FSW) process and synthetic microstructure generation capability that is statistically equivalent to experimentally collected data.

97 MATHEMATICS AND COMPUTING↗

Guiding the Design of Heterogeneous Electrode Microstructures for Li-Ion Batteries: Microscopic Imaging, Predictive Modeling, and Machine Learning

Electrochemical and mechanical properties of lithium-ion battery materials are heavily dependent on their 3D microstructure characteristics. A quantitative understanding of the role played by stochastic microstructures is critical for the prediction of material properties and for guiding synthesis processes. Furthermore, tailoring microstructure morphology is also a viable way of achieving optimal electrochemical and mechanical performances of lithium-ion cells. To facilitate the establishment of microstructure-resolved modeling and design methods, a review covering spatially and temporally resolved imaging of microstructure and electrochemical phenomena, microstructure statistical characterization and stochastic reconstruction, microstructure-resolved modeling for property prediction, and machine learning for microstructure design is presented here. The perspectives on the unresolved challenges and opportunities in applying experimental data, modeling, and machine learning to improve the understanding of materials and identify paths toward enhanced performance of lithium-ion cells are presented.

25 ENERGY STORAGE↗

Improving the Concrete Crack Detection Process via a Hybrid Visual Transformer Algorithm

Inspections of concrete bridges across the United States represent a significant commitment of resources, given their biannual mandate for many structures. With a notable number of aging bridges, there is an imperative need to enhance the efficiency of these inspections. This study harnessed the power of computer vision to streamline the inspection process. Our experiment examined the efficacy of a state-of-the-art Visual Transformer (ViT) model combined with distinct image enhancement detector algorithms. We benchmarked against a deep learning Convolutional Neural Network (CNN) model. These models were applied to over 20,000 high-quality images from the Concrete Images for Classification dataset. Traditional crack detection methods often fall short due to their heavy reliance on time and resources. This research pioneers bridge inspection by integrating ViT with diverse image enhancement detectors, significantly improving concrete crack detection accuracy. Notably, a custom-built CNN achieves over 99% accuracy with substantially lower training time than ViT, making it an efficient solution for enhancing safety and resource conservation in infrastructure management. These advancements enhance safety by enabling reliable detection and timely maintenance, but they also align with Industry 4.0 objectives, automating manual inspections, reducing costs, and advancing technological integration in public infrastructure management.

42 ENGINEERING↗

Quantifying leaf symptoms of sorghum charcoal rot in images of field‐grown plants using deep neural networks

Abstract Charcoal rot of sorghum (CRS) is a significant disease affecting sorghum crops, with limited genetic resistance available. The causative agent, Macrophomina phaseolina (Tassi) Goid, is a highly destructive fungal pathogen that targets over 500 plant species globally, including essential staple crops. Utilizing field image data for precise detection and quantification of CRS could greatly assist in the prompt identification and management of affected fields and thereby reduce yield losses. The objective of this work was to implement various machine learning algorithms to evaluate their ability to accurately detect and quantify CRS in red‐green‐blue images of sorghum plants exhibiting symptoms of infection. EfficientNet‐B3 and a fully convolutional network emerged as the top‐performing models for image classification and segmentation tasks, respectively. Among the classification models evaluated, EfficientNet‐B3 demonstrated superior performance, achieving an accuracy of 86.97%, a recall rate of 0.71, and an F1 score of 0.73. Of the segmentation models tested, FCN proved to be the most effective, exhibiting a validation accuracy of 97.76%, a recall rate of 0.68, and an F1 score of 0.66. As the size of the image patches increased, both models’ validation scores increased linearly, and their inference time decreased exponentially. This trend could be attributed to larger patches containing more information, improving model performance, and fewer patches reducing the computational load, thus decreasing inference time. The models, in addition to being immediately useful for breeders and growers of sorghum, advance the domain of automated plant phenotyping and may serve as a foundation for drone‐based or other automated field phenotyping efforts. Additionally, the models presented herein can be accessed through a web‐based application where users can easily analyze their own images.

Gonzalez, Emmanuel M.↗

Improvements in Mirror Surface Measurement with Reflected Computer Vision Targets

Over the last several years, NREL has been developing a system to measure large optical surfaces of heliostat mirrors by reflecting computer vision targets. An advantage of this system, called Reflected Target Nonintrusive Assessment (ReTNA), is that it lends itself well to stitching together many images, each reflecting only part of a larger heliostat. In the last few months, this was taken to a new extreme, with a small target (<5m2) being used to measure a >25m2 long focal length heliostat. These measurements were compared with traditional fringe deflectometry methods, which require a >50m2 target, and photogrammetry. The strengths, weaknesses and limitations of ReTNA are discussed. An estimated uncertainty in this new measurement is presented, along with software improvements and a new wireless data collection system. A bill of materials for this measurement system is presented, which has been designed to use all low-cost, off-the-shelf components. Finally, the next steps for future ReTNA development are presented. Overall, ReTNA can be a valuable optics measurement system, complimentary to existing measurement techniques available for large reflective surfaces.

14 SOLAR ENERGY↗

Calibration of elastoplastic constitutive model parameters from full-field data with automatic differentiation-based sensitivities

Here, we present a framework for calibration of parameters in elastoplastic constitutive models that is based on the use of automatic differentiation (AD). The model calibration problem is posed as a partial differential equation-constrained optimization problem where a finite element (FE) model of the coupled equilibrium equation and constitutive model evolution equations serves as the constraint. The objective function quantifies the mismatch between the displacement predicted by the FE model and full-field digital image correlation data, and the optimization problem is solved using gradient-based optimization algorithms. Forward and adjoint sensitivities are used to compute the gradient at considerably less cost than its calculation from finite difference approximations. Through the use of AD, we need only to write the constraints in terms of AD objects, where all of the derivatives required for the forward and inverse problems are obtained by appropriately seeding and evaluating these quantities. We present three numerical examples that verify the correctness of the gradient, demonstrate the AD approach's parallel computation capabilities via application to a large-scale FE model, and highlight the formulation's ease of extensibility to other classes of constitutive models.

42 ENGINEERING↗