Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Rapid imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Attention-based 3D – convolutional neural network model for mechanical property predictions using visible light images in metal additive manufacturing

Additive manufacturing (AM), while commonly used for rapid prototyping and creating components with complex geometries, has not been widely adopted for critical applications across the aerospace, automotive, defense, energy, and medical industries. This is, in part, due to the challenges of controlling flaws and uncertainty in the mechanical behavior of additively manufactured components. In recent years, there has been an increase in research aimed at predicting the final mechanical properties of additively manufactured components during the printing process. To address these issues, a 3D-CNN model was trained using low-cost in situ visible-light camera data, anomaly classifications, and the chosen process parameters to predict the ultimate tensile strength (UTS), yield strength (YS), total elongation (TE), and uniform elongation (UE). The 3D-CNN layers of the model employed attention mechanisms to prioritize features in the data, thereby improving prediction accuracy. Furthermore, the effect of each process parameter and anomaly class is investigated using attention-based dynamic sigmoid weighted gates to interpret the influence each class has on the final prediction. Different combinations of the in situ data were fed into the 3D-CNN, with varying amounts of image layers, to determine the ideal combination for predicting mechanical properties in situ. Here, the 3D-CNN model achieved mean absolute percentage errors (MAPE) below 5% for both UTS and YS while using only a single camera input and under half of the available image layers.

36 MATERIALS SCIENCE↗

A new paradigm in electron microscopy: Automated microstructure analysis utilizing a dynamic segmentation convolutional neutral network

Over the past half century, the transmission electron microscope enabled insight into the fundamental arrangements and structures of materials. State-of-the-art electron microscopes can acquire large image datasets across multiple imaging modalities. However, the manual annotation process for feature or defect quantification may not be feasible with the modern microscope. Convolutional neural networks emerged to characterize individual microstructural features from an image in a cost-effective, consistent manner. However, many of these neural network approaches rely on thousands to hundreds of thousands of manual annotations of each feature type across hundreds of images to train the network for adequate performance. This work focused on the development and application of a pixel-wise defect detection machine-learning dynamic segmentation convolutional neural network with associated automated acquisition and postprocessing to identify microstructural features rapidly and quantitatively from a small initial dataset incorporating multiple imaging modes. The approach was demonstrated for characterization of superalloy 718 from both single image acquisition on multiple detectors to in-situ evolution captured with a single detector on a standard desktop computer to demonstrate the low barrier to entry required for widespread adoption. Pixel-by-pixel class identification was excellent with strong identification of chemically distinct phases, structurally distinct phases, and defect structures, thus demonstrating the new paradigm of machine learning-assisted characterization.

36 MATERIALS SCIENCE↗

Pre-training Vision Models for the Classification of Alerts from Wide-field Time-domain Surveys

Modern wide-field time-domain surveys facilitate the study of transient, variable and moving phenomena by conducting image differencing and relaying alerts to their communities. Machine learning tools have been used on data from these surveys and their precursors for more than a decade, and convolutional neural networks (CNNs), which make predictions directly from input images, saw particularly broad adoption through the 2010s. Since then, continually rapid advances in computer vision have transformed the standard practices around using such models. It is now commonplace to use standardized architectures pre-trained on large corpora of everyday images (e.g., ImageNet). In contrast, time-domain astronomy studies still typically design custom CNN architectures and train them from scratch. Here, we explore the effects of adopting various pre-training regimens and standardized model architectures on the performance of alert classification. We find that the resulting models match or outperform a custom, specialized CNN like what is typically used for filtering alerts. Moreover, our results show that pre-training on galaxy images from Galaxy Zoo tends to yield better performance than pre-training on ImageNet or training from scratch. We observe that the design of standardized architectures are much better optimized than the custom CNN baseline, requiring significantly less time and memory for inference despite having more trainable parameters. On the eve of the Legacy Survey of Space and Time and other image-differencing surveys, these findings advocate for a paradigm shift in the creation of vision models for alerts, demonstrating that greater performance and efficiency, in time and in data, can be achieved by adopting the latest practices from the computer vision field.

79 ASTRONOMY AND ASTROPHYSICS↗

Imaging and spatially resolved mass spectrometry applications in nephrology

The application of spatially resolved mass spectrometry (MS) and MS imaging approaches for studying biomolecular processes in the kidney is rapidly growing. These powerful methods, which enable label-free and multiplexed detection of many molecular classes across omics domains (including metabolites, drugs, proteins and protein post-translational modifications), are beginning to reveal new molecular insights related to kidney health and disease. Further, the complexity of the kidney often necessitates multiple scales of analysis for interrogating biofluids, whole organs, functional tissue units, single cells and subcellular compartments. Various MS methods can generate omics data across these spatial domains and facilitate both basic science and pathological assessment of the kidney. Optimal processes related to sample preparation and handling for different MS applications are rapidly evolving. Emerging technology and methods, improvement of spatial resolution, broader molecular characterization, multimodal and multiomics approaches and the use of machine learning and artificial intelligence approaches promise to make these applications even more valuable in the field of nephology. Overall, spatially resolved MS and MS imaging methods have the potential to fill much of the omics gap in systems biology analysis of the kidney and provide functional outputs that cannot be obtained using genomics and transcriptomic methods.

60 APPLIED LIFE SCIENCES↗

XRFtomo

Based on [1], XRFtomo brings together a variety of image processing tools used for preparing, processing and reconstructing 3D renditions of samples imaged using a synchrotron-based x-ray fluorescence (XRF) microprobe or nanoprobe at the Advanced Photon Source (APS). This software bridges the gap between data acquisition and visualization by providing tools to adjust for misalignment in the imaging process and tools for running reconstructions[2], all with the use of a GUI or command line. XRFtomo accepts .h5 files processed through MAPS[3] and it outputs reconstructed cross-sections, projections, sinograms, metadata, and a configuration file with last-used parameters for rapid processing the next time the program is launched. These images serve as inputs for other 3D visualization software for generating volumetric renderings and animations.

Marin, Fabrico↗

Imaging Field–Driven Melting of a Molecular Solid at the Atomic Scale

Solid–liquid phase transitions are basic physical processes, but atomically resolved microscopy has yet to capture their full dynamics. A new technique is developed for controlling the melting and freezing of self–assembled molecular structures on a graphene field–effect transistor (FET) that allows phase–transition behavior to be imaged using atomically resolved scanning tunneling microscopy. This is achieved by applying electric fields to 2,3,5,6–tetrafluoro–7,7,8,8–tetracyanoquinodimethane–decorated FETs to induce reversible transitions between molecular solid and liquid phases at the FET surface. Nonequilibrium melting dynamics are visualized by rapidly heating the graphene substrate with an electrical current and imaging the resulting evolution toward new 2D equilibrium states. An analytical model is developed that explains observed mixed–state phases based on spectroscopic measurement of solid and liquid molecular energy levels. The observed nonequilibrium melting dynamics are consistent with Monte Carlo simulations.

36 MATERIALS SCIENCE↗

Artificial intelligence-based predictive modeling for imaging neutral particle analyzers on the DIII-D tokamak

The Imaging Neutral Particle Analyzer (INPA) at DIII-D is a diagnostic system used to accurately resolve the energy and spatial distributions of fast ions in fusion plasmas. A novel artificial intelligence (AI) technique named INPA-net is based on Reservoir Computing Networks and developed here to predict active and passive signals produced by charge-exchange reactions from injected and edge-cold neutrals, respectively, in magnetically confined fusion plasmas. This model is trained using a set of 21 time domain signals between 0 s to 3.35 s that includes injected beam and thermal plasma information, and 6444 real 2D experimental images of the INPA in 12 plasma discharges at DIII-D. The trained neural network is able to forecast experimental images in real-time. The model achieves an R-squared value of 0.91, which is higher than the 0.83 value achieved by a simple linear regression model. This improvement highlights the model's enhanced predictive accuracy for measured images from the validation set. This AI approach is valuable due to its rapid response times and potential for integration into real-time plasma control systems. A version of this model capable of generating syntehic images would be useful for the real-time monitoring of fast-ion transport. A comprehensive sensitivity study reveals that INPA-net maintains high performance even with variations in the input parameters, indicating the model's robustness and reliability. While developed for the INPA, the underlying architecture is adaptable and may be applied to various 2D imaging diagnostics in fusion research.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Mapping of Benthic Habitats at Marine Renewable Energy Sites Using Multibeam Echosounder and Sediment Profile Imaging Technologies

Objectives/Scope: The goal of this work was to develop a consistent and semi-automated seafloor survey method for generating high-resolution, benthic habitat maps for environmental assessments and monitoring of marine renewable energy sites. Sediment profile and plan view imaging (SPI/PV) technology was combined with multibeam bathymetry and acoustic backscatter methods to demonstrate a rapid, cost-effective benthic mapping protocol. A key technical innovation of this project was the development of an image processing platform that automatically measures key features from the images. Methods: Multibeam echosounder (MBES) acoustic and SPI/PV surveys were conducted at three coastal areas off the U.S. west coast, including the PacWave South energy test site off of Newport, Oregon. Point data on physical and biological sediment conditions obtained from the SPI/PV imagery were used to efficiently ground-truth the high-resolution MBES bathymetry and backscatter mosaics. The SPI camera is an optical corer that obtains an undisturbed 21 by 15 cm, high-resolution, cross-sectional image of the sediment–water interface and upper sediment column. The plan view camera attached to the SPI camera frame captures a downward looking view of the seabed immediately before the SPI image is obtained. As part of this project, we developed a computer vision image processing platform (iSPI) that uses deep convolutional neural networks and other approaches to automatically identify and measure key features in the images, such as grain size and surface relief. Results: Detailed benthic habitat maps were generated using this mapping approach for three different marine settings. The sites mapped included a silt-dominated embayment; a sloping, nearshore, transitional very fine to coarse sand bottom; and a medium, sand-dominated continental shelf marine energy test site. In each case, acoustic and imaging surveys were completed in less than week, and detailed benthic habitat maps were generated within 60 days. The results were placed within the Coastal and Marine Ecological Classification Standard (CMECS) habitat mapping framework, and various combinations of the bathymetry, backscatter, and SPI and PV data were used to generate CMECS component maps. Novel Information: This project developed and demonstrated a repeatable and cost-effective approach for efficiently mapping benthic habitat conditions over broad areas of the seafloor by combining state-of-the-art acoustic and imaging techniques. The primary survey tools used in this project have been used previously in both the offshore renewable (wind) and oil and gas sectors to map and monitor benthic environments. This project’s innovations include 1) the focused use of high-resolution SPI/PV imagery to ground-truth acoustic mosaics, and 2) the development of a computer automated image analysis processing tool that both streamlines and standardizes the generation of data from the imagery and makes the data extraction process more cost-effective and repeatable.

13 HYDRO ENERGY↗

Classifying metal‐binding sites with neural networks

Abstract To advance our ability to predict impacts of the protein scaffold on catalysis, robust classification schemes to define features of proteins that will influence reactivity are needed. One of these features is a protein's metal‐binding ability, as metals are critical to catalytic conversion by metalloenzymes. As a step toward realizing this goal, we used convolutional neural networks (CNNs) to enable the classification of a metal cofactor binding pocket within a protein scaffold. CNNs enable images to be classified based on multiple levels of detail in the image, from edges and corners to entire objects, and can provide rapid classification. First, six CNN models were fine‐tuned to classify the 20 standard amino acids to choose a performant model for amino acid classification. This model was then trained in two parallel efforts: to classify a 2D image of the environment within a given radius of the central metal binding site, either an Fe ion or a [2Fe‐2S] cofactor, with the metal visible (effort 1) or the metal hidden (effort 2). We further used two sub‐classifications of the [2Fe‐2S] cofactor: (1) a standard [2Fe‐2S] cofactor and (2) a Rieske [2Fe‐2S] cofactor. The accuracy for the model correctly identifying all three defined features was >95%, despite our perception of the increased challenge of the metalloenzyme identification. This demonstrates that machine learning methodology to classify and distinguish similar metal‐binding sites, even in the absence of a visible cofactor, is indeed possible and offers an additional tool for metal‐binding site identification in proteins.

59 BASIC BIOLOGICAL SCIENCES↗

A polarimetry-based field-deployable non-interruptive mirror soiling detection method

The soiling level of heliostat mirrors in Concentrated Solar Power (CSP) fields is one of the key factors that significantly influences optical efficiency. State-of-the-art methods of monitoring heliostats soiling levels still face various challenges, including slow speed, labor-intensive operations, resolution and accuracy constraints or interruptions to solar field operations. Here, we present a rapid, cost-effective, and non-intrusive method for mirror soiling detection based on polarimetric imaging, referred to as Polarimetric Imaging-based Mirror Soiling (PIMS). The compact PIMS device is designed for integration with unmanned aerial vehicles (UAVs), enabling rapid, large-area assessments of heliostat mirrors for efficient soiling detection. Our method utilizes the correlation between the Degree of Linear Polarization (DoLP) and surface soiling level based on Mie scattering theory and Monte Carlo simulations. Field deployment of the PIMS method requires minimal device installation, and its UAV-based operation allows for soiling detection without interrupting plant activities. The PIMS method holds the potential for mirror soiling detection across various concentrated solar power (CSP) plants and can be further adapted for other types of solar fields, such as parabolic trough systems.

CSP Field↗

LSE-163: Data Products Definition Document

This document describes the data products and processing services to be delivered by the NSF-DOE Vera C. Rubin Observatory whilst performing the Legacy Survey of Space and Time (LSST). LSST will deliver three levels of data products and services. Prompt data products are computed and released within 24 hours of observation, and include images, difference images, catalogs of sources and objects detected in difference images, and catalogs of Solar System objects. Their primary purpose is to enable rapid follow-up of time-domain events. Data Release data products are computed during annual processing campaigns, and include well-calibrated single-epoch images, deep coadds, and catalogs of objects, sources, and forced sources, enabling static sky and precision time-domain science. The Science Platform will allow for the creation of User Generated data products and will enable science cases that greatly benefit from co-location of user processing and/or data within the Rubin Observatory Data Access Center. LSST will also devote 10% of observing time to programs with special cadence. Their data products will be created using the same software and hardware as Prompt and Data Release products. All data products will be made available using user-friendly databases and web services.

79 ASTRONOMY AND ASTROPHYSICS↗

A microCT-based platform to quantify drug targeting

Abstract Background Heterotopic ossification (HO) is a frequent and debilitating complication of traumatic musculoskeletal injuries and orthopedic procedures. Prophylactic dosing of botulinum toxin type A (BTxA) holds potential as a novel treatment option if accurately distributed throughout soft-tissue volumes where protection is clinically desired. We developed a high-resolution, microcomputed tomography (microCT)-based imaging strategy to assess drug distribution and validated this platform by quantifying distribution achieved via a prototype delivery system versus a single-bolus injection. Methods We injected an iodine-containing contrast agent (iodixanol 320 mg I/mL) into dissected rabbit musculature followed by microCT imaging and analysis. To contrast the performance of distributed versus bolus injections, a three-dimensional (3D) 64-cm 3 -printed soft-tissue holder was developed. A centered 2-cm 3 volume of interest (VOI) was targeted with a single-bolus injection or an equal volume distributed injection delivered via a 3D-printed prototype. VOI drug coverage was quantified as a percentage of the VOI volume that was < 1.0 mm from the injected fluid. Results The microCT-based approach enabled high-resolution quantification of injection distribution within soft tissue. The distributed dosing prototype provided significantly greater tissue coverage of the targeted VOI (72 ± 3%, mean ± standard deviation) when compared to an equal volume bolus dose (43 ± 5%, p = 0.031) while also enhancing the precision of injection targeting. Conclusions A microCT-based imaging technique precisely quantifies drug distribution within a soft-tissue VOI, providing a path to overcome a barrier for clinical translation of prophylactic inhibition of HO by BTxA. Relevance statement This platform will facilitate rapid optimization of injection parameters for clinical devices used to effectively and safely inhibit the formation of heterotopic ossification. Key points • MicroCT provides high-resolution quantification of soft-tissue drug distribution. • Distributed dosing is required to maximize soft-tissue drug coverage. • Imaging platform will enable rapid screening of 3D-printed drug distribution prototypes. Graphical Abstract

Ausk, Brandon J. (ORCID:0000000335338303)↗

Few-shot Learning for Post-disaster Structure Damage Assessment

Automating post-disaster damage assessment with remote sensing data is critical for faster surveys of structures impacted by natural disasters. One significant obstacle to training state-of-the-art deep neural networks to support this automation is that large quantities of labelled data are often required. However, obtaining those labels is particularly unrealistic to support post-disaster damage assessment in a timely manner. Few-shot learning methods could help to mitigate this by reducing the amount of labelled data required to successfully train a model while achieving satisfactory results. To this end, we explore a feature reweighting method to the YOLOv3 object detection architecture to achieve few-shot learning of damage assessment models on the xBD dataset. Our results show that the feature reweighting approach yield improved mAP over the baseline with significantly fewer labelled samples. In addition, we use t-SNE to analyze the class-specific reweighting vectors generated by the reweighting module in order to evaluate their inter-class and intra-class similarity. We find that the vectors form clusters based on class, and that these clusters overlap with visually similar classes. Those results show the potential to employ this few-shot learning strategy for rapid damage assessment with post-event remote sensing images.

Bowman, Jordan↗

Deep-ultraviolet ptychographic pocket-scope (DART): mesoscale lensless molecular imaging with label-free spectroscopic contrast

The mesoscale characterization of biological specimens has traditionally required compromises between resolution, field-of-view, depth-of-field, and molecular specificity, with most approaches relying on external labels. Here we present the Deep-ultrAviolet ptychogRaphic pockeT-scope (DART), a handheld platform that transforms label-free molecular imaging through intrinsic deep-ultraviolet spectroscopic contrast. By leveraging biomolecules’ natural absorption fingerprints and combining them with lensless ptychographic microscopy, DART resolves down to 308-nm linewidths across centimeter-scale areas while maintaining millimeter-scale depth-of-field. The system’s virtual error-bin methodology effectively eliminates artifacts from limited temporal coherence and other optical imperfections, enabling high-fidelity molecular imaging without lenses. Through differential spectroscopic imaging at deep-ultraviolet wavelengths, DART quantitatively maps nucleic acid and protein distributions with femtogram sensitivity, providing an intrinsic basis for explainable virtual staining. We demonstrate DART’s capabilities through imaging of tissue sections, cytopathology specimens, blood cells, and neural populations, revealing detailed molecular contrast without external labels. The combination of high-resolution molecular mapping and broad mesoscale imaging in a portable platform opens new possibilities from rapid clinical diagnostics, tissue analysis, to biological characterization in space exploration.

60 APPLIED LIFE SCIENCES↗

An Automated Probabilistic Asteroid Prediscovery Pipeline

We present an automated and probabilistic method to make prediscovery detections of near-Earth asteroids (NEAs) in archival survey images, with the goal of reducing orbital uncertainty immediately after discovery. We refit the Minor Planet Center's astrometry and propagate the full six-parameter covariance to survey epochs to define search regions. We build low-threshold source catalogs for viable images and evaluate every detected source in a search region as a candidate prediscovery. We eliminate false positives by refitting a new orbit to each candidate and probabilistically linking detections across images using a likelihood ratio. Applied to the Zwicky Transient Facility's (ZTF) imaging, we identify approximately 3000 recently discovered NEAs with prediscovery potential, including a doubling of the observational arc for about 500. We use archival ZTF imaging to make prediscovery detections of the potentially hazardous asteroid 2021 DG1, extending its arc by 2.5 yr and reducing future apparition sky plane uncertainty from many degrees to arcseconds. We also recover 2025 FU24 nearly 7 yr before its first known observation, when its sky plane uncertainty covers hundreds of square degrees across thousands of ZTF images. The method is survey agnostic and scalable, enabling rapid orbit refinement for new discoveries from Rubin, NEO Surveyor, and NEOMIR.

79 ASTRONOMY AND ASTROPHYSICS↗

Recent advances in nano-scale spatial resolution x-ray microscopy instrumentation at NSLS-II

X-ray microscopy is an invaluable and powerful characterization tool applied in many scientific fields, such as materials science, biology, environmental science, and energy research. In recent years it has been driven by rapid developments of novel technologies and systems resulting in imaging experiments elucidating structural inhomogeneities and chemical reactions at the nanometer scale. To obtain high spatial resolution comprehensive chemical and structural information, an X-ray microscope must be equipped with adequate capabilities and allow for simultaneous acquisition of multiple datasets. In recent years, a number of X-ray microscopes have been designed, constructed, and commissioned at NSLS-II. Here we provide an overview of the microscopy instrumentation development program at NSLS-II and specifically focus on the multilayer Laue lens-based hard X-ray nanoprobe optimized for ~10 nm spatial resolution imaging, its current status, and future upgrades along with recently constructed Kirkpatrick-Baez based scanning microscope designed for ~100 nm spatial resolution experiments.

36 MATERIALS SCIENCE↗

In Situ Li Seed Formation Enables Uniform Plating in Anode-Free Solid-State Batteries

Anode-free solid-state batteries (AFSSBs) are a promising route toward achieving high energy density. In these cells, the anode contains no pre-stored lithium (Li). Instead, all Li inventory originates from the cathode and is freshly deposited onto a bare current collector during charging. However, achieving uniform and defect-free Li plating on this bare current collector remains a major challenging, often resulting in low Li plating/stripping efficiency and rapid capacity decay. Here, for the first time, operando neutron imaging is employed to visualize Li plating/stripping behavior in an anode-free full cell with LiNi 0.82 Mn 0.07 Co 0.11 O 2 (NMC) as the cathode. Operando measurements reveal that complete stripping of Li leaves isolated Li residues on the current collector, which degrades interfacial contact between the current collector and solid-state electrolyte. To mitigate this interfacial issue and promote more uniform Li deposition, we implement a discharge cutoff voltage strategy that intentionally retains a thin residual Li layer after stripping. This thin Li layer, serving as an in situ–formed seed layer, not only enables more homogeneous subsequent Li plating but also improves interfacial contact. As a result, the anode-free cell with a controlled discharge voltage of 3.5 V exhibits excellent long-term cycling stability, maintaining a discharge capacity of 116 mAh g -1 with a retention rate of 83.4% and an average Coulombic efficiency of approximately 99.9% after 430 cycles at 0.25 C. In contrast, the cell with a conventional discharge cutoff voltage of 2.8 V exhibits rapid capacity decay, retaining only 59.7 mAh g -1 after 50 cycles with a capacity retention of 40.7%. This work offers a practical strategy to unlock the long-term viability of anode-free solid-state batteries.

25 ENERGY STORAGE↗

Relating storm-snow avalanche instabilities to data collected from the Differential Emissivity Imaging Disdrometer (DEID)

Storm-snow avalanches are challenging to forecast due to complex alpine terrain and during rapidly changing weather conditions. They can result in loss of lives and significant economic impact. We describe how a new device that continuously measures with high-frequency snowflake mass, size, density, and type, the Differential Emissivity Imaging Disdrometer (DEID), and show how the DEID can be used to aid avalanche forecasting when coupled with a storm-snow stability model. DEID measurements of snow accumulation, snow water equivalent (SWE), and snow density obtained during seventeen storms taken at the mid-Collins Snow-Study Plot at Alta Ski Area in Utah's Central Wasatch mountain range during winter 2020–2021 show excellent agreement with infrequent manual measurements. Additionally, two new variables, the Shape Density Index (SDI) and Complexity, are proposed and used to classify snowflake habit and estimate storm-snow shear strength. We illustrate how these DEID-derived data can be used to identify layers of concern in the storm snow such as density inversions, in real-time without digging snow pits. Furthermore, the DEID-data are used to run four variations of the SNOw Slope Stability model (SNOSS) for the storms investigated. The results are evaluated with data collected from tilt-board tests, infrasound measurements, and visual observations of avalanches. For a total fourteen storms analyzed, the DEID-driven SNOSS-modeled minimum stability index predicts the general stability of the storm-snow as indicated by observed avalanches, both natural and of unknown cause. Finally, the results provide a promising approach for nowcasting instabilities within storm-snow layers with a single instrument.

54 ENVIRONMENTAL SCIENCES↗