Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image generation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Tip-induced deformation of a phospholipid bilayer: Theoretical perspective of sum frequency generation imaging

The paper addresses theory of Sum Frequency Generation imaging of an atomic force microscopy tip-induced deformation of a bilayer phospholipid membrane deposited over a pore: known as a nano-drum system. Image modeling employed nonlinearities of the normal modes specific to hydrocarbon terminal methyls, which are distributed about the deformed surfaces of inner and outer leaflets. The deformed profiles are according to the solutions of shape equation for Canham-Helfrich Hamiltonian accounting properties of four membranes, which differ in elasticity and adhesion. The results indicate that in continuous deformed surfaces, the difference in the curvature of the outer and inner leaflets dominates in the imaged nonlinearity. This is different comparing to the results for a perfect bilayer spherical cap system (the subject of previous study), where nonlinear image response is dominated by the mismatch of the inner and outer leaflets’ surface areas (as projected to the image plane) at the edge of perfectly spherical structure. The results of theoretical studies, here, demonstrate that Sum Frequency Generation imaging in continuous and deformed bilayer surfaces are helpful to address curvature locally and anticipate mechanical properties of membrane. The articles discuss applicability and practical limitations of the approach. Combination of Atomic Force Microscopy and Sum Frequency Generation imaging under controlled tip-induced deformation provides a good opportunity to probe and test membranes physical properties with rigor of adopted theory.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Proton Radiography Imager:Generates Synthetic Proton Radiographs

ProRad is a computer program that is used to generate synthetic images of proton (or other charged particles) radiographs. The proton radiographs arc images that arc obtained by sending energetic protons (or electrons or positrons, for example) through 11 plasma where electric and/or magnetic fields alter the particles trajectory, Dnd the variations me imaged on RC film, image plate, or equivalent

Wilks, ScottC.↗

Proton Radiography Imager:Generates Synthetic Proton Radiographs

ProRad is a computer program that is used to generate synthetic images of proton (or other charged particles) radiographs. The proton radiographs arc images that arc obtained by sending energetic protons (or electrons or positrons, for example) through 11 plasma where electric and/or magnetic fields alter the particles trajectory, Dnd the variations me imaged on RC film, image plate, or equivalent

Wilks, Scott C.↗

WE-D-303-02: Applications of Volumetric Images Generated with a Respiratory Motion Model Based On An External Surrogate Signal

Purpose: Respiratory motion can vary significantly over the course of simulation and treatment. Our goal is to use volumetric images generated with a respiratory motion model to improve the definition of the internal target volume (ITV) and the estimate of delivered dose. Methods: Ten irregular patient breathing patterns spanning 35 seconds each were incorporated into a digital phantom. Ten images over the first five seconds of breathing were used to emulate a 4DCT scan, build the ITV, and generate a patient-specific respiratory motion model which correlated the measured trajectories of markers placed on the patients’ chests with the motion of the internal anatomy. This model was used to generate volumetric images over the subsequent thirty seconds of breathing. The increase in the ITV taking into account the full 35 seconds of breathing was assessed with ground-truth and model-generated images. For one patient, a treatment plan based on the initial ITV was created and the delivered dose was estimated using images from the first five seconds as well as ground-truth and model-generated images from the next 30 seconds. Results: The increase in the ITV ranged from 0.2 cc to 6.9 cc for the ten patients based on ground-truth information. The model predicted this increase in the ITV with an average error of 0.8 cc. The delivered dose to the tumor (D95) changed significantly from 57 Gy to 41 Gy when estimated using 5 seconds and 30 seconds, respectively. The model captured this effect, giving an estimated D95 of 44 Gy. Conclusion: A respiratory motion model generating volumetric images of the internal patient anatomy could be useful in estimating the increase in the ITV due to irregular breathing during simulation and in assessing delivered dose during treatment. This project was supported, in part, through a Master Research Agreement with Varian Medical Systems, Inc. and Radiological Society of North America Research Scholar Grant #RSCH1206.

60 APPLIED LIFE SCIENCES↗

SU-C-209-02: 3D Fluoroscopic Image Generation From Patient-Specific 4DCBCT-Based Motion Models Derived From Clinical Patient Images

Purpose: We develop a method to generate time varying volumetric images (3D fluoroscopic images) using patient-specific motion models derived from four-dimensional cone-beam CT (4DCBCT). Methods: Motion models are derived by selecting one 4DCBCT phase as a reference image, and registering the remaining images to it. Principal component analysis (PCA) is performed on the resultant displacement vector fields (DVFs) to create a reduced set of PCA eigenvectors that capture the majority of respiratory motion. 3D fluoroscopic images are generated by optimizing the weights of the PCA eigenvectors iteratively through comparison of measured cone-beam projections and simulated projections generated from the motion model. This method was applied to images from five lung-cancer patients. The spatial accuracy of this method is evaluated by comparing landmark positions in the 3D fluoroscopic images to manually defined ground truth positions in the patient cone-beam projections. Results: 4DCBCT motion models were shown to accurately generate 3D fluoroscopic images when the patient cone-beam projections contained clearly visible structures moving with respiration (e.g., the diaphragm). When no moving anatomical structure was clearly visible in the projections, the 3D fluoroscopic images generated did not capture breathing deformations, and reverted to the reference image. For the subset of 3D fluoroscopic images generated from projections with visibly moving anatomy, the average tumor localization error and the 95th percentile were 1.6 mm and 3.1 mm respectively. Conclusion: This study showed that 4DCBCT-based 3D fluoroscopic images can accurately capture respiratory deformations in a patient dataset, so long as the cone-beam projections used contain visible structures that move with respiration. For clinical implementation of 3D fluoroscopic imaging for treatment verification, an imaging field of view (FOV) that contains visible structures moving with respiration should be selected. If no other appropriate structures are visible, the images should include the diaphragm. This project was supported, in part, through a Master Research Agreement with Varian Medical Systems, Inc, Palo Alto, CA.

60 APPLIED LIFE SCIENCES↗

Sum frequency generation image reconstruction: Aliphatic membrane under spherical cap geometry

The article explores an opportunity to approach structural properties of phospholipid membranes using Sum Frequency Generation microscopy. To establish the principles of sum frequency generation image reconstruction in such systems, at first approach, we may adopt an idealistic spherical cap uniform assembly of hydrocarbon molecules. Quantum mechanical studies for decanoic acid (used here as a representative molecular system) provide necessary information on transition dipole moments and Raman tensors of the normal modes specific to methyl terminal – a typical moiety in aliphatic (and phospholipid) membranes. Relative degree of localization and frequencies of the normal modes of methyl terminals make nonlinearities of this moiety to be promising in structural analysis using Sum Frequency Generation imaging. Accordingly, the article describes derivations of relevant macroscopic nonlinearities and suggests a mapping procedure to translate amplitudes of the nonlinearities onto microscopy image plane according to geometry of spherical assembly, local molecular orientation, and optical geometry. Reconstructed images indicate a possibility to extract local curvature of bilayer envelopes of spherical character. This may have practical implications for structural extractions in membrane systems of practical relevance.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

PIV/BOS synthetic image generation in variable density environments for error analysis and experiment design

In this work, we present an image generation methodology based on ray tracing that can be used to render realistic images of Particle Image Velocimetry (PIV) and Background Oriented Schlieren (BOS) experiments in the presence of density/refractive index gradients. This methodology enables the simulation of aero-thermodynamics experiments for experiment design, error, and uncertainty analysis. Images are generated by emanating light rays from the particles or dot pattern, and propagating them through the density gradient field and the optical elements, up to the camera sensor. The rendered images are realistic, and can replicate the features of a given experimental setup, like optical aberrations and perspective effects, which can be deliberately introduced for error analysis. We demonstrate this methodology by simulating a BOS experiment with a known density field obtained from direct numerical simulations (DNS) of homogeneous buoyancy driven turbulence, and comparing the light ray displacements from ray tracing to results from BOS theory. The light ray displacements show good agreement with the reference data. This methodology provides a framework for further development of simulation tools for use in experiment design and development of image analysis tools for PIV and BOS applications. Finally, an implementation of the proposed methodology in a Python-CUDA program is made available as an open source software for researchers.

47 OTHER INSTRUMENTATION↗

WE-G-207-06: 3D Fluoroscopic Image Generation From Patient-Specific 4DCBCT-Based Motion Models Derived From Physical Phantom and Clinical Patient Images

Purpose: Respiratory-correlated cone-beam CT (4DCBCT) images acquired immediately prior to treatment have the potential to represent patient motion patterns and anatomy during treatment, including both intra- and inter-fractional changes. We develop a method to generate patient-specific motion models based on 4DCBCT images acquired with existing clinical equipment and used to generate time varying volumetric images (3D fluoroscopic images) representing motion during treatment delivery. Methods: Motion models are derived by deformably registering each 4DCBCT phase to a reference phase, and performing principal component analysis (PCA) on the resulting displacement vector fields. 3D fluoroscopic images are estimated by optimizing the resulting PCA coefficients iteratively through comparison of the cone-beam projections simulating kV treatment imaging and digitally reconstructed radiographs generated from the motion model. Patient and physical phantom datasets are used to evaluate the method in terms of tumor localization error compared to manually defined ground truth positions. Results: 4DCBCT-based motion models were derived and used to generate 3D fluoroscopic images at treatment time. For the patient datasets, the average tumor localization error and the 95th percentile were 1.57 and 3.13 respectively in subsets of four patient datasets. For the physical phantom datasets, the average tumor localization error and the 95th percentile were 1.14 and 2.78 respectively in two datasets. 4DCBCT motion models are shown to perform well in the context of generating 3D fluoroscopic images due to their ability to reproduce anatomical changes at treatment time. Conclusion: This study showed the feasibility of deriving 4DCBCT-based motion models and using them to generate 3D fluoroscopic images at treatment time in real clinical settings. 4DCBCT-based motion models were found to account for the 3D non-rigid motion of the patient anatomy during treatment and have the potential to localize tumor and other patient anatomical structures at treatment time even when inter-fractional changes occur. This project was supported, in part, through a Master Research Agreement with Varian Medical Systems, Inc., Palo Alto, CA. The project was also supported, in part, by Award Number R21CA156068 from the National Cancer Institute.

60 APPLIED LIFE SCIENCES↗

Recovery of image distorted by turbulent atmosphere using phase-conjugate image generated by difference frequency generation

We demonstrate dynamic recovery of blurred images caused by atmospheric turbulence. In particular, using a phase-conjugate wave generated by a second-order nonlinear crystal or composite, we restore the original quality of the image after the optical radiation forming the image propagates through the turbulent atmosphere. One of the key elements for our experiment is a rotating phase plate being placed in the beam path for simulating turbulent atmosphere. Using the nonlinear composite, we demonstrate that the image recovery is insensitive to the polarization of the optical radiation forming the image.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Imaging of transition charge densities involving carbon core excitations by all X-ray sum-frequency generation

X-ray diffraction signals from the time-evolving molecular charge density induced by selective core excitation of chemically inequivalent carbon atoms are calculated. A narrowband X-ray pulse selectively excites the carbon K-edge of the –CH 3 or –CH 2 F groups in fluoroethane (CH 3 –CH 2 F). Each excitation creates a distinct core coherence which depends on the character of the electronic transition. Direct propagation of the reduced single-electron density matrix, using real-time time-dependent density functional theory, provides the time-evolving charge density following interactions with external fields. Here, the interplay between partially filled valence molecular orbitals upon core excitation induces characteristic femtosecond charge migration which depends on the core–valence coherence, and is monitored by the sum-frequency generation diffraction signal.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Synthetic Scientific Image Generation with VAE, GAN, and Diffusion Model Architectures

Generative AI (genAI) has emerged as a powerful tool for synthesizing diverse and complex image data, offering new possibilities for scientific imaging applications. This review presents a comprehensive comparative analysis of leading generative architectures, ranging from Variational Autoencoders (VAEs) to Generative Adversarial Networks (GANs) on through to Diffusion Models, in the context of scientific image synthesis. We examine each model's foundational principles, recent architectural advancements, and practical trade-offs. Our evaluation, conducted on domain-specific datasets including microCT scans of rocks and composite fibers, as well as high-resolution images of plant roots, integrates both quantitative metrics (SSIM, LPIPS, FID, CLIPScore) and expert-driven qualitative assessments. Results show that GANs, particularly StyleGAN, produce images with high perceptual quality and structural coherence. Diffusion-based models for inpainting and image variation, such as DALL-E 2, delivered high realism and semantic alignment but generally struggled in balancing visual fidelity with scientific accuracy. Importantly, our findings reveal limitations of standard quantitative metrics in capturing scientific relevance, underscoring the need for domain-expert validation. We conclude by discussing key challenges such as model interpretability, computational cost, and verification protocols, and discuss future directions where generative AI can drive innovation in data augmentation, simulation, and hypothesis generation in scientific research.

Generative Adversarial Networks↗

Quantitative characterization of collagen in the fibrotic capsule surrounding implanted polymeric microparticles through second harmonic generation imaging

The collagenous capsule formed around an implant will ultimately determine the nature of its in vivo fate. To provide a better understanding of how surface modifications can alter the collagen orientation and composition in the fibrotic capsule, we used second harmonic generation (SHG) microscopy to evaluate collagen organization and structure generated in mice subcutaneously injected with chemically functionalized polystyrene particles. SHG is sensitive to the orientation of a molecule, making it a powerful tool for measuring the alignment of collagen fibers. Additionally, SHG arises from the second order susceptibility of the interrogated molecule in response to the electric field. Variation in these tensor components distinguishes different molecular sources of SHG, providing collagen type specificity. Here, we demonstrated the ability of SHG to differentiate collagen type I and type III quantitatively and used this method to examine fibrous capsules of implanted polystyrene particles. Data presented in this work shows a wide range of collagen fiber orientations and collagen compositions in response to surface functionalized polystyrene particles. Dimethylamino functionalized particles were able to form a thin collagenous matrix resembling healthy skin. These findings have the potential to improve the fundamental understanding of how material properties influence collagen organization and composition quantitatively.

59 BASIC BIOLOGICAL SCIENCES↗

Effective Labeling of Primary Somatic Stem Cells with BaTiO 3 Nanocrystals for Second Harmonic Generation Imaging

Abstract While nanoparticles are an increasingly popular choice for labeling and tracking stem cells in biomedical applications such as cell therapy, their intracellular fate and subsequent effect on stem cell differentiation remain elusive. To establish an effective stem cell labeling strategy, the intracellular nanocrystal concentration should be minimized to avoid adverse effects, without compromising the intensity and persistence of the signal necessary for long‐term tracking. Here, the use of second‐harmonic generating barium titanate nanocrystals is reported, whose achievable brightness allows for high contrast stem cell labeling with at least one order of magnitude lower intracellular nanocrystals than previously reported. Their long‐term photostability enables to investigate quantitatively at the single cell level their cellular fate in hematopoietic stem cells (HSCs) using both multiphoton and electron microscopy. It is found that the concentration of nanocrystals in proliferative multipotent progenitors is over 2.5‐fold greater compared to quiescent stem cells; this difference vanishes when HSCs enter a nonquiescent, proliferative state, while their potency remains unaffected. Understanding the nanoparticle stem cell interaction allows to establish an effective and safe nanoparticle labeling strategy into somatic stem cells that can critically contribute to an understanding of their in vivo therapeutic potential.

Sugiyama, Nami↗

Gamma-ray burst observations with new generation imaging atmospheric Cerenkov Telescopes in the FERMI era

After the launch and successful beginning of operations of the FERMI satellite, the topics related to high-energy observations of gamma-ray bursts have obtained a considerable attention by the scientific community. Undoubtedly, the diagnostic power of high-energy observations in constraining the emission processes and the physical conditions of gamma-ray burst is relevant. We briefly discuss how gamma-ray burst observations with ground-based imaging array Cerenkov telescopes, in the GeV-TeV range, can compete and cooperate with FERMI observations, in the MeV-GeV range, to allow researchers to obtain a more detailed and complete picture of the prompt and afterglow phases of gamma-ray bursts.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗