SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Improve the quantitative results obtained from 3D gamma-ray imagers for use in safeguards inspections. In FY23 the work focused on continuing to improve the numerical results obtained with gamma-ray imagers and explore approaches to project such data onto 3D structures mapped with Self Localization and Mapping (SLAM) hardware and software.
To date, chemical imaging of polymers and polymer blends has been primarily accomplished using time-of-flight secondary ion mass spectrometry (ToF-SIMS) to directly visualize the distribution of components in a complex material with spatial resolution ranging from 100 nm to 5 μm. However, in many cases, this resolution falls far short of visualizing interfaces directly. To overcome these limitations, recent work has focused on developing a SIMS detection system based on a helium ion microscope (HIM) enabling chemical imaging with a demonstrated ~14 nm spatial resolution. Here, we utilize HIM-SIMS for differentiation between the olefin-based polymers of polyethylene (PE) and polypropylene (PP). We illustrate both analyses for separating PE and PP using specific mass fragment ratios as well as demonstrate spatially resolved imaging of phase-separated domains within PE. Altogether, we demonstrate the abilities of HIM-SIMS as a multimodal chemical technique for imaging and quantification of polyolefin interfaces, which could be more broadly applied to the analysis of more complex polymeric systems.
We combine nanoindentation, herein achieved using atomic force microscopy (AFM)-based pulsed-force lithography, with tip-enhanced Raman spectroscopy (TERS) and imaging. Our approach entails indentation and multimodal characterization of otherwise flat Au substrates, followed by chemical functionalization and TERS spectral imaging of the indented nanostructures. We find that the resulting structures, which vary in shape and size depending on the tip used to produce them, may sustain nano-confined and significantly enhanced local fields. We take advantage of the latter and illustrate TERS-based ultrasensitive detection/chemical fingerprinting as well as chemical reaction imaging – all using a single platform for nano-lithography, topographic imaging, hyperspectral dark field optical microscopy, and TERS.
Here, we describe a unified framework for model-based iterative 3-D reconstruction of multimodal neutron transmission, hydrogen-scatter, and induced-fission images from low resolution data recorded using 14.1-MeV neutrons and the associated-particle imaging (API) technique. The framework, which was developed to facilitate use in challenging field-deployment scenarios, is centered around physics-based system models and a total variation (TV) constrained implementation of the simultaneous iterative reconstruction technique (SIRT). Modified to solve a statistically weighted least squares (WLS) problem, the SIRT algorithm is accelerated using ordered subsets and Nesterov’s momentum for which we derive a near-optimal value of the governing Lipschitz constant. The approach enables the reconstruction of images that are high resolution compared to the acquired data and is robust to both limited statistics and a limited number of projection angles. Moreover, the framework is fast enough to be practical. Example images are provided that demonstrate both the ability to perform fast-neutron imaging of high-atomic-number materials with low radiation dose and the benefit of multimodal neutron imaging to identify key materials.
This final report summarizes the key accomplishments of the project entitled “Plasmonics-Enhanced Optical Imaging Systems for Bioenergy Research”. The goal of this project is aimed at developing innovative and improved imaging instrumentation for visualization and quantitative characterization of biomarkers related to molecular processes and cellular function in living plants. This project focused on three specific aims: 1) Development of Advanced Multimodal Optical Sensing And Imaging Combinatory (MOSAIC) System for SERS biosensing and bioimaging. 2) Evaluation of MOSAIC technologies for sensing and imaging gene expression in plant systems using plasmonic nanoprobes. 3) Application of MOSAIC techniques to bioenergy research.
Patient-derived xenografts (PDXs) are an appealing platform for preclinical drug studies. A primary challenge in modeling drug response prediction (DRP) with PDXs and neural networks (NNs) is the limited number of drug response samples. We investigate multimodal neural network (MM-Net) and data augmentation for DRP in PDXs. The MM-Net learns to predict response using drug descriptors, gene expressions (GE), and histology whole-slide images (WSIs). We explore whether combining WSIs with GE improves predictions as compared with models that use GE alone. We propose two data augmentation methods which allow us training multimodal and unimodal NNs without changing architectures with a single larger dataset: 1) combine single-drug and drug-pair treatments by homogenizing drug representations, and 2) augment drug-pairs which doubles the sample size of all drug-pair samples. Unimodal NNs which use GE are compared to assess the contribution of data augmentation. The NN that uses the original and the augmented drug-pair treatments as well as single-drug treatments outperforms NNs that ignore either the augmented drug-pairs or the single-drug treatments. In assessing the multimodal learning based on the MCC metric, MM-Net outperforms all the baselines. Our results show that data augmentation and integration of histology images with GE can improve prediction performance of drug response in PDXs.
Herein, electroluminescence (EL) and thermal imaging are used to examine p–i–n metal halide perovskite (MHP) photovoltaic (PV) mini-modules (MA0.6FA0.4PbI3, 20 cells, 78 cm2) before and after indoor-accelerated stress testing or outdoor deployment. Distinct spatial patterns in the EL images emerge, which depend on the external stress conditions experienced by the mini-module. Imaging results highlight a distribution of dark speckle features that dominate after UV stress, attributed to widespread interfacial contact degradation. Lateral intensity gradients across cells dominate after thermal cycling (TC) stress, attributed to current crowding near scribe defects. While current–voltage analysis alone does not give full insight on the degradation process, this study shows that distinct degradation modes can be further defined by multimodal electro-optical imaging (i.e., EL combined with photoluminescence and dark lock-in thermography). Neither UV exposure nor TC-accelerated stress testing alone replicates the same degradation signatures observed after outdoor deployment, suggesting that multiple degradation modes occur under concurrent stressors outdoors. Finally, spatial characterization of degradation modes in MHP PV mini-modules before and after accelerated stress testing lays the groundwork for developing targeted accelerated stress testing procedures through comparison with outdoor aging.
Scanning transmission electron microscopy is a common tool used to study the atomic structure of materials. It is an inherently multimodal tool allowing for the simultaneous acquisition of multiple information channels. Despite its versatility, however, experimental workflows currently rely heavily on experienced human operators and can only acquire data from small regions of a sample at a time. Here, we demonstrate a flexible pipeline-based system for high-throughput acquisition of atomic-resolution structural data using an all-piezo sample stage applied to large-scale imaging of nanoparticles and multimodal data acquisition. As a result, the system is available as part of the user program of the Molecular Foundry at Lawrence Berkeley National Laboratory.
Intensity distribution functions on the image plane are derived under the assumption that a multimode optic fiber is illuminated by a light source which can be approximated by infinite uniangular beams carrying equal power. The application of the theory to a Lambertian source is discussed. Experimental results, based on the observation of the light intensity distribution imaged on an opaque screen and collected by a digital camera, are presented. The theoretical and experimental data are compared to verify that the intensity function is an accurate model for describing the realistic approach to sensor design. The limitations of the uniangular and uniform intensity distribution models are discussed on the basis of theoretical and experimental results.
Harmful algal blooms (HABs) pose a major environmental concern across the globe. In abundance, cyanobacteria, or so-called green-blue algae can produce extremely dangerous cyanotoxins that harm humans and animals. This study focused on the mapping and distribution of intracellular macro-and micronutrients of the widespread freshwater cyanobacteria Microcystis aeruginosa (M. aeruginosa). Towards a better understanding of trace metal uptake and homeostasis throughout the cell cycle, we quantitatively mapped the spatial distribution of the elements P, K, Fe, Ca, Zn, Mn, and Cu across the ultrastructure of frozen-hydrated single cells using state-of-theart X-ray nanofluorescence imaging at the Advanced Photon Source (APS) at Argonne National Laboratory. Further, bulk cellular nutrient and trace metal content correlated well with the total intracellular elemental content in individual cells obtained by quantitative synchrotron X-ray fluorescence measurements. Multi-dimensional mappings showed P and K atoms colocalized as discrete semicircular hotspots that were analyzed with respect to their stoichiometry. Elevated Cu and Ca concentrations were detected along division plane of cells. P and K were found to have similar spatial elemental distribution with about 65% and 69% of the total cellular P and K, respectively, located at the hotspots. The P and K colocalization were refined further using nanotomography, showing a K envelope surrounding the P core. Inorganic P and organic P compounds were specified using solution-state 31 P nuclear magnetic resonance (NMR) spectroscopy from M. aeruginosa. Of the total extracted P determined by 31 P NMR spectroscopy, 47% were found to be nucleotides while only 11% were polyphosphates. Multimodal X-ray imaging provides a better understanding of intracellular biochemical processes in cyanobacteria, helping us monitor and combat an emerging environmental threat.
Machine learning (ML) is relied on for materials spectroscopy. It is challenging to make ML models fail because statistical correlations can mimic the physics without causality. Here, using a benchmark band-excitation piezoresponse force microscopy polarization spectroscopy (BEPS) dataset the pitfalls of the so-called “better”, “faster”, and “less-biased” ML of electromechanical switching are demonstrated and overcome. Using a toy and real experimental dataset, it is demonstrated how linear nontemporal ML methods result in physically reasonable embedding (eigenvalues) while producing nonsensical eigenvectors and generated spectra, promoting misleading interpretations. A new method of unsupervised multimodal hyperspectral analysis of BEPS is demonstrated using long-short-term memory (LSTM) β-variational autoencoders (β-VAEs) . By including LSTM neurons, the ordinal nature of ferroelectric switching is considered. Further, to improve the interpretability of the latent space, a variational Kullback–Leibler-divergency regularization is imposed . Finally, regularization scheduling of β as a disentanglement metric is leveraged to reduce user bias. Combining these experiment-inspired modifications enables the automated detection of ferroelectric switching mechanisms, including a complex two-step, three-state one. Ultimately, this work provides a robust ML method for the rapid discovery of electromechanical switching mechanisms in ferroelectrics and is applicable to other multimodal hyperspectral materials spectroscopies.
Proteins play a vital role in different biological processes by forming complexes through precise folding with exclusive inter- and intra-molecular interactions. Understanding the structural and regulatory mechanisms underlying protein complex formation provides insights into biophysical processes. Furthermore, the principle of protein assembly gives guidelines for new biomimetic materials with potential applications in medicine, energy, and nanotechnology. Atomic force microscopy (AFM) is a powerful tool for investigating protein assembly and interactions across spatial scales (single molecules to cells) and temporal scales (milliseconds to days). It has significantly contributed to understanding nanoscale architectures, inter- and intra-molecular interactions, and regulatory elements that determine protein structures, assemblies, and functions. This review describes recent advancements in elucidating protein assemblies with in situ AFM. We discuss the structures, diffusions, interactions, and assembly dynamics of proteins captured by conventional and high-speed AFM in near-native environments and recent AFM developments in the multimodal high-resolution imaging, bimodal imaging, live cell imaging, and machine-learning-enhanced data analysis. These approaches show the significance of broadening the horizons of AFM and enable unprecedented explorations of protein assembly for biomaterial design and biomedical research.
The prediction of ice cloud formation in the atmosphere remains challenging. Free tropospheric aerosols can act as ice nucleating particles (INPs), affecting cloud properties and precipitation. The physicochemical properties of free tropospheric particles are modified upon long-range transport by different atmospheric processes. These modifications affect the ice formation potential of individual particles. We investigated free tropospheric particles collected at the remote Pico Mountain Observatory at 2225m a.s.l. in the North Atlantic Ocean using multimodal microspectroscopy and chemical imaging techniques. We probed their ice nucleation activity using an ice nucleation stage interfaced with an environmental scanning electron microscope. Retroplume analysis, chemical imaging, and micro-spectroscopy analysis indicated that the size-resolved chemical composition, mixing state, and phase state of the articles with similar aging times but different transport patterns were substantially different. Relative humidity-dependent glass transition temperatures estimated from meteorological conditions were consistent with the observed organic component of the particles' phase. More viscous (solid and semi-solid-like) particles are more ice active in deposition mode at temperature ranging from 205-220 K than those less viscous particles. Finally, this study provides a better understanding of the phase and mixing state of long range transported free tropospheric aerosols and their role in ice cloud formation.
Resonant field enhancement in optical cavities is provided over only narrow linewidths and for specific spatial modes. Consequently, spectrally restrictive planar Fabry-Pérot cavities have not contributed to date to white-light imaging, which necessitates a highly multimoded broadband field to satisfy the resonance condition. It is shown that introducing judicious angular-dispersion circumvents the fundamental trade-off between cavity linewidth and finesse in a Fabry-Pérot cavity by exciting a 130-nm-bandwidth achromatic resonance across the visible spectrum, which far exceeds the finesse-limited linewidth (0.5 nm), and even exceeds the free spectral range (45 nm). This omni-resonant configuration enables broadband color-imaging over a 100-nm-bandwidth in the visible with minimal spherical and chromatic aberrations. Omni-resonant imaging is demonstrated using coherent and incoherent light, and spatially extended and localized fields comprising stationary and moving objects. This work paves the way to harnessing broadband resonant enhancements for spatially structured fields, as needed for example in solar windows.
Zero-shot and prompt-based models have excelled at visual reasoning tasks by leveraging large-scale natural image corpora, but they often fail on sparse and domain-specific scientific image data. We introduce Zenesis, a no-code interactive computer vision platform designed to reduce data readiness bottlenecks in scientific imaging workflows. Zenesis integrates lightweight multimodal adaptation for zero-shot inference on raw scientific data, human-in-the-loop refinement, and heuristic-based temporal enhancement. We validate our approach on Focused Ion Beam Scanning Electron Microscopy (FIB-SEM) datasets of catalyst-loaded membranes. Zenesis outperforms baselines, achieving an average accuracy of 0.947, Intersection over Union (IoU) of 0.858, and Dice score of 0.923 on amorphous catalyst samples; and 0.987 accuracy, 0.857 IoU, and 0.923 Dice on crystalline samples. These results represent a significant performance gain over conventional methods such as Otsu thresholding and standalone models like the Segment Anything Model (SAM). Zenesis enables effective image segmentation in domains where annotated datasets are limited, offering a scalable solution for scientific discovery.
The rising interest in designing fibres via spinning techniques combining the properties of various polymeric materials into advanced functionalised materials is directed towards targeted biomedical applications such as drug delivery, wearable sensors or tissue engineering. Understanding how these functional polymers exhibit multiscale structures ranging from the molecular level to nano-, micro-and millimetre scale is a key prerequisite for their challenging applications that can be addressed by a non-destructive X-ray based analytical approach. X-ray multimodalities combining X-ray imaging, scattering and diffraction allow the study of morphology, molecular structure, and the analysis of nano-domain size and shape, crystallinity and preferential orientation in 3D arrangements. The incorporation of X-ray analytics in the design process of polymeric fibers via their nanostructure under non-ambient conditions (i.e. temperature, mechanical load, humidity…) allows for efficient optimization of the fabrication process as well as quality control along the product lifetime under operating environmental conditions. Here, we demonstrate the successful collaboration between the laboratory of Biomimetic Textiles and Membranes and the Center of X-ray Analytics at Empa for the design, characterisation and optimisation of advanced functionalised polymeric fibrous material systems.
CEPS has undertaken an extended study of long lava flows on the terrestrial planets, their location, morphology, and potential modes of emplacement. As part of this ongoing investigation, we have concentrated on a single large flow in Tharsis, with noted similarities to several terrestrial analogs. An impressive series of lava flows emerges from the topographic saddle between Ascraeus and Pavonis Mons. The most prominent of these (hereafter referred to as the 'Saddle Flow') has distinct margins that can be traced for over 480 km in the Viking images, although its exact source cannot be identified. A multimodal approach is utilized in the examination of the Saddle Flow, including image interpretation (VIKING and THEMIS, MOLA topographic analysis and flow profiling, downflow behavior statistical analysis, rheologic modeling, and GIS modeling and integration.
Neutron imaging is a powerful tool used for inspecting internal structures and studying macroscale particle dynamics. This work is performed at the Multimodal Advanced Radiography Station (MARS), which is the cold-neutron imaging beamline at the High-Flux Isotope Reactor at Oak Ridge National Laboratory. Herein is a summary of recent upgrades to instrumentation, software, and methods, driven by needs from the user community. Planned upgrades within the next decade are included that will significantly enhance instrument capability and performance.