Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Super-resolution”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Downscaled Earth System Model Data for Resilient Energy System Planning

The second-generation Sup3rCC dataset provides high-resolution meteorological data generated through the downscaling of multiple earth system models (ESMs) from the Coupled Model Intercomparison Project Phase 6 (CMIP6). This downscaling is performed through application of a generative machine learning approach called Super-Resolution for Renewable Resource Data (sup3r). This dataset builds on the first-generation Sup3rCC data by applying improved bias correction methods and adding downscaled precipitation to the output variables. In this presentation, we explore the output characteristics of the dataset and various validation analyses. We also present and discuss plans for the integration of this data into power system planning models using a decision-making under deep uncertainty (DMDU) methodology.

97 MATHEMATICS AND COMPUTING↗

Development of high throughput light-sheet fluorescence lifetime imaging microscopy for 3D functional imaging of metabolic pathways in plant and microorganisms (Final Technical Report)

This research program will enable new biochemical contrast in the nanosecond lifetime domain through use of the recently demonstrated electro-optic fluorescence lifetime imaging technique (EO-FLIM) for wide-field lifetime imaging. The Stanford/Stanford Linear Accelerator Center multidisciplinary collaboration -- physics, applied physics, and structural biology -- will develop a light-sheet fluorescence lifetime imaging microscope for functional studies of microbial and plant metabolic pathways and dynamic interactions between plants and microorganisms in the rhizosphere. The proposed approach overcomes the imaging time bottleneck associated with existing fluorescence lifetime imaging methods. Initial demonstrations have shown a factor of 100,000 improvement in photon throughput compared to existing methods. High photon efficiency allowed the first wide-field fluorescence lifetime imaging of single molecules. Recent work has improved the technique’s repetition rate to enable compatibility with mode-locked lasers and demonstrated the combination of wide-field fluorescence lifetime imaging with super-resolution localization microscopy, observations of single molecule dynamics, and observation of donor lifetime quenching in single-molecule imaging. These results were achieved on standard camera sensors and would not have been possible with other wide-field approaches. The throughput and photon economy of the EO-FLIM method enables new BER-relevant imaging opportunities. In particular, scanned single- and two-photon light-sheet excitation will be used to achieve volumetric imaging with time-domain contrast.

47 OTHER INSTRUMENTATION↗

A Survey of Machine Learning-Based Physics Event Generation

Event generators in high-energy nuclear and particle physics play an important role in facilitating studies of particle reactions. We survey the state of the art of machine learning (ML) efforts at building physics event generators. We review ML generative models used in ML-based event generators and their specific challenges, and discuss various approaches of incorporating physics into the ML model designs to overcome these challenges. Finally, we explore some open questions related to super-resolution, fidelity, and extrapolation for physics event generation based on ML technology.

Alanazi, Yasir↗

Deconstruction by C. thermocellum —from microbe mediated to dynamic redistribution of cellulosomes

Clostridium thermocellum is one of the most efficient microorganisms for the deconstruction of cellulosic biomass. To achieve this high level of cellulolytic activity, C. thermocellum uses large multienzyme complexes known as cellulosomes to break down complex polysaccharides, notably cellulose, found in plant cell walls. The attachment of bacterial cells to the nearby substrate via the cellulosome has been hypothesized to be the reason for this high efficiency. The region lying between the cell and the substrate has shown great variation and dynamics that are affected by the growth stage of cells and the substrate used for growth. Here, we used both super-resolution imaging and machine-learning approaches to study the distribution of C. thermocellum cellulosomes at different stages of growth. We show that C. thermocellum initially retains its cellulosomes primarily on the cell surface but then relocates large cellulosome clusters to the interface with biomass, therefore depleting its cell surface of cellulosomes. These results indicate dynamic redistribution of cellulosomes during growth, with a functional shift toward substrate-associated degradation later during growth on biomass.

09 BIOMASS FUELS↗

Super-localisation of a point-like emitter in a resonant environment: Correction of the mirage effect

In this paper, we show that it is possible to overcome one of the fundamental limitations of super-resolution microscopy: the necessity to be in an optically homogeneous environment. Using recent modal approximation results from [ 10 , 7 ], we show, as a proof of concept, that it is possible to recover the position of a single point-like emitter in a known resonant environment from far-field measurements, with a precision two orders of magnitude below the classical Rayleigh limit. The procedure does not involve solving any partial differential equation, is computationally light (optimisation in \begin{document}$ \mathbb{R}^d $\end{document} with \begin{document}$ d $\end{document} of the order of \begin{document}$ 10 $\end{document} ) and is therefore suited for the recovery of a very large number of single emitters.

Mathematics↗

Fast and accurate learned multiresolution dynamical downscaling for precipitation

Abstract. This study develops a neural-network-based approach for emulating high-resolution modeled precipitation data with comparable statistical properties but at greatly reduced computational cost. The key idea is to use combination of low- and high-resolution simulations (that differ not only in spatial resolution but also in geospatial patterns) to train a neural network to map from the former to the latter. Specifically, we define two types of CNNs, one that stacks variables directly and one that encodes each variable before stacking, and we train each CNN type both with a conventional loss function, such as mean square error (MSE), and with a conditional generative adversarial network (CGAN), for a total of four CNN variants. We compare the four new CNN-derived high-resolution precipitation results with precipitation generated from original high-resolution simulations, a bilinear interpolater and the state-of-the-art CNN-based super-resolution (SR) technique. Results show that the SR technique produces results similar to those of the bilinear interpolator with smoother spatial and temporal distributions and smaller data variabilities and extremes than the original high-resolution simulations. While the new CNNs trained by MSE generate better results over some regions than the interpolator and SR technique do, their predictions are still biased from the original high-resolution simulations. The CNNs trained by CGAN generate more realistic and physically reasonable results, better capturing not only data variability in time and space but also extremes such as intense and long-lasting storms. The new proposed CNN-based downscaling approach can downscale precipitation from 50 to 12 km in 14 min for 30 years once the network is trained (training takes 4 h using 1 GPU), while the conventional dynamical downscaling would take 1 month using 600 CPU cores to generate simulations at the resolution of 12 km over the contiguous United States.

54 ENVIRONMENTAL SCIENCES↗

DSGAN

This study develops a neural network-based approach for emulating high-resolution modeled precipitation data with comparable statistical properties but at greatly reduced computational cost. The key idea is to use combination of low-and high- resolution simulations to train a neural network to map from the former to the latter. Specifically, we define two types of CNNs, one that stacks variables directly and one that encodes each variable before stacking, and we train each CNN type both with a conventional loss function, such as mean square error (MSE), and with a conditional generative adversarial network (CGAN), for a total of four CNN variants. We compare the four new CNN-derived high-resolution precipitation results with precipitation generated from original high resolution simulations, a bilinear interpolater and the state-of-the-art CNN-based super-resolution (SR) technique. Results show that the SR technique produces results similar to those of the bilinear interpolator with smoother spatial and temporal distributions and smaller data variabilities and extremes than the original high resolution simulations. While the new CNNs trained by MSE generate better results over some regions than the interpolator and SR technique do, their predictions are still not as close as the original high resolution simulations. The CNNs trained by CGAN generate more realistic and physically reasonable results, better capturing not only data variability in time and space but also extremes such as intense and long-lasting storms. The new proposed CNN-based downscaling approach can downscale precipitation from 50~km to 12~km in 14~min for 30~years

LIU, ZHENGCHUN↗

In situ Detection of Plasma Induced Surface Interaction based on Deep Learning based Visual Diagnostics (Technical Report)

It is characteristic for many plasma devices to undergo plasma-material interaction leading to surface erosion. These processes, often not easily detectable, lead to changes in device performance and lifespan. State-of-the-art lifetime tests and wear experiments require over 1000s hours. A self-consistent model for accurately predicting the erosion's effects is not available. In situ detection of these processes is not a trivial task since the surface variations at the early stages have a micron scale. Such limitations not only restrict testing and prediction capabilities but also slow the development of new thrusters and limit mission duration. To address these challenges, an in-situ diagnostic for real-time erosion assessment has been developed, aiming to expedite lifetime testing and broaden experimental campaigns. Several works were dedicated to real-time and in situ monitoring of material erosion during plasma exposure using laser holography, microscopy, and with telemicroscopes. However, the applicability of these approaches is limited due to complexity, cost and less flexibility as they often require placing diagnostic equipment inside the vacuum chamber. In collaboration with Princeton Collaborative Research Facility (PCRF), Princeton Plasma Physics Laboratory (PPPL), a new diagnostic approach is developed, where geometry modifications to the ceramic channel walls were introduced that would result in accelerated channel erosion. We employed Long-distance microscope (LDM) imagery, combined with Deep-Learning based Shape from focus or depth from focus (DFF or SFF) approach, that provides an accessible and cost-effective solution. LDM employs focus variation techniques to continuously capture multiple images of the target object at distinct focal planes. DFF, an optical focus variation method, generates a 3D topographical surface depth map from a sequence of variably focused images. Combined with the developed diagnostic, this approach offers a controllable means to study erosion under accelerated conditions. In this work, we develop Neural Network-based DFF algorithm applicable for LDM data to quantitatively evaluate plasma induced surface modification from LDM data. Next, we develop Deep Learning-based super-resolution depth map image reconstruction technique to increase the resolution of depth maps obtained from DFF algorithm to improve the accuracy of erosion measurements. Thirdly, we develop several image processing techniques to remove noise and improve the quality of depth map image. Here we report the results of initial tests for this approach. An experimental setup designed and built in PPPL was employed that consists of a 3-cm gridded ion source that produces a neutralized argon beam with energies up to 600 eV. A hexagonal boron nitride (h-BN) ceramic target, designed based on computational predictions, was used. Tests were conducted to reconstruct the complex geometry of the target under the lighting conditions of the operated ion source.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

High-Resolution Meteorology with Climate Change Impacts from Global Climate Model Data Using Generative Machine Learning

As renewable energy generation increases, the impacts of weather and climate on energy generation and demand become critical to the reliability of the energy system. However, these impacts are often overlooked. Global climate models (GCMs) can be used to understand possible changes to our climate, but their coarse resolution makes them difficult to use in energy system modelling. Here we present open-source generative machine learning methods that produce meteorological data at a nominal spatial resolution of 4 km at an hourly frequency based on inputs from 100 km daily-average GCM data. These methods run 40 times faster than traditional downscaling methods and produce data that have high-resolution spatial and temporal attributes similar to historical datasets. We demonstrate that these methods can be used to downscale projected changes in wind, solar and temperature variables across multiple GCMs including projections for more frequent low-wind and high-temperature events in the Eastern United States.

climate change↗

Contribution of advanced fluorescence nano microscopy towards revealing mitotic chromosome structure

The organization of chromatin into higherorder structures and its condensation process represent one of the key challenges in structural biology. This is important for elucidating several disease states. To address this long-standing problem, development of advanced imaging methods has played an essential role in providing understanding into mitotic chromosome structure and compaction. Amongst these are two fast evolving fluorescence imaging technologies, specifically fluorescence lifetime imaging (FLIM) and superresolution microscopy (SRM). FLIM in particular has been lacking in the application of chromosome research while SRM has been successfully applied although not widely. Furthermore, both these techniques are capable of providing fluorescence imaging with nanometer information. SRM or "nanoscopy" is capable of generating images of DNA with less than 50 nm resolution while FLIM when coupled with energy transfer may provide less than 20 nm information. Here, we discuss the advantages and limitations of both methods followed by their contribution to mitotic chromosome studies. Furthermore, we highlight the future prospects of how advancements in new technologies can contribute in the field of chromosome science.

59 BASIC BIOLOGICAL SCIENCES↗

Biased localization of actin binding proteins by actin filament conformation

The assembly of actin filaments into distinct cytoskeletal structures plays a critical role in cell physiology, but how proteins localize differentially to these structures within a shared cytoplasm remains unclear. Here, we show that the actin-binding domains of accessory proteins can be sensitive to filament conformational changes. Using a combination of live cell imaging and in vitro single molecule binding measurements, we show that tandem calponin homology domains (CH1–CH2) can be mutated to preferentially bind actin networks at the front or rear of motile cells. We demonstrate that the binding kinetics of CH1–CH2 domain mutants varies as actin filament conformation is altered by perturbations that include stabilizing drugs and other binding proteins. These findings suggest that conformational changes of actin filaments in cells could help to direct accessory binding proteins to different actin cytoskeletal structures through a biophysical feedback loop.

42 ENGINEERING↗

Imaging a terahertz superfluid plasmon in a two-dimensional superconductor

The superconducting gap defines the fundamental energy scale for the emergence of dissipationless transport and collective phenomena in a superconductor. In layered high-temperature cuprate superconductors, in which the Cooper pairs are confined to weakly coupled two-dimensional (2D) copper–oxygen (CuO 2 ) planes, terahertz (THz) spectroscopy at subgap millielectronvolt (meV) energies has provided crucial insights into the collective superfluid response perpendicular to the superconducting layers. However, within the CuO 2 planes, the collective superfluid response manifests as plasmonic charge oscillations at energies far exceeding the superconducting gap, obscured by strong dissipation. Here, in this study, we present spectroscopic evidence of a below-gap, 2D superfluid plasmon in few-layer Bi 2 Sr 2 CaCu 2 O 8+x and spatially resolve its deeply subdiffractive THz electrodynamics. By placing the superconductor in the near field of a spintronic THz emitter, we reveal this distinct resonance—absent in bulk samples and observed only in the superconducting phase—and determine its plasmonic nature by mapping the geometric anisotropy and dispersion. Crucially, these measurements offer a direct view of the momentum-dependent and frequency-dependent superconducting transition in two dimensions.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Label-free nanoscopy of cell metabolism by ultrasensitive reweighted visible stimulated Raman scattering

Nanoscopic imaging of cell metabolism is hindered by the incompatibility of small metabolites with fluorescent dyes and the limited resolution of imaging mass spectrometry. We present ultrasensitive reweighted visible stimulated Raman scattering (URV-SRS), a label-free vibrational nanoscopy technique that enables multiplexed detection of metabolic nanostructures within cells. We developed an extensively chirped spectral focusing visible SRS microscope that achieves a detection limit of 4,000 molecules and introduced a self-supervised learning-based denoiser to robustly suppress non-independent SRS noise by over 7.2 dB. The instrumentation-based signal enhancement and computation-based noise suppression synergistically improved the detection sensitivity by 50 times over near-infrared SRS. Leveraging this enhanced sensitivity, we further pushed the resolution to nanoscopic levels by introducing Fourier reweighting to amplify sub-100 nm spatial frequencies previously overwhelmed by noise. Validated by Fourier ring correlation, URV-SRS achieves a lateral resolution of 86 nm in cellular imaging. Here, we applied URV-SRS to elucidate the reprogramming of metabolic nanostructures associated with virus replication in Vero E6 host cells and to compositionally delineate subcellular fatty acid synthesis in engineered Escherichia coli, demonstrating its capability towards nanoscopic spatial metabolomics.

59 BASIC BIOLOGICAL SCIENCES↗

Sneaking in SpyCatcher using cell penetrating peptides for in vivo imaging

Abstract In vivo imaging of protein complexes is a powerful method for understanding the underlying biological function of these key biomolecules. Though the engineering of small, high affinity nanobodies have become more prevalent, the off-rates of these tags may result in incomplete or partial labeling of proteins in live cells. The SpyCatcher003 and SpyTag split protein system allow for irreversible, covalent binding to a short target peptide unlike nanobody-affinity based probes. However, delivering these tags into a cell without disrupting its normal function is a key challenge. Cell penetrating peptides (CPPs) are short peptide sequences that facilitate the transduction of otherwise membrane-impermeable ‘cargo’ , such as proteins, into cells. Here we report on our efforts to engineer and characterize CPP-SpyCatcher003 fusions as modular imaging probes. We selected three CPPs, CUPID, Pentratin, and pVEC, to engineer fusion protein probes for superresolution microscopy, with the aim to eliminate prior permeabilization treatments that could introduce imaging artifacts. We find that fusing the CPP sequences to SpyCatcher003 resulted in dimer and multimer formation as determined by size exclusion chromatography, dynamic light scattering, and SDS resistant dimers on SDS-PAGE gels. By isolating and labeling the monomeric forms of the engineered protein, we show these constructs retained their ability to bind SpyTag and all three CPP sequences remain membrane active, as assessed by CD spectroscopy in the presence of SDS detergent. Using fluorescence and super resolution Lattice structured illumination microscopy (Lattice SIM) imaging we show that the CPPs did not enhance uptake of SpyCatcher by E. coli, however with Caulobacter crescentus cells, we show that Penetratin, and to a lesser degree CUPID, does enhance uptake. Our results demonstrate the ability of the CPP-SpyCatcher003 to label targets within living cells, providing the groundwork for using split protein systems for targeted in vivo imaging.

59 BASIC BIOLOGICAL SCIENCES↗

Ferrimagnetic spin waves in honeycomb and triangular layers of Mn{sub 3}Si{sub 2}Te{sub 6}.

A detailed analysis of the ferrimagnetic ground state of Mn 3 Si 2 Te 6 has been performed using inelastic neutron scattering. Although the proposed valence of the nominal Mn 2+ ions would have quenched orbital angular momentum, a significant exchange anisotropy exists in Mn 3 Si 2 Te 6 . This apparent exchange anisotropy is a manifestation of a weak spin-orbit coupling in the layered material. We employ a detailed simulation of the spin-wave spectrum coupling traditional refinement of dispersion parameters to image analysis techniques, while including Monte Carlo simulations of the instrumental resolution to accurately identify the exchange couplings to the third nearest neighbor. An independent validation of our results is made by comparing our final Hamiltonian to heat capacity measurements.

Sala, G.↗

Deep Hierarchical Super Resolution for Scientific Data

We present a novel technique for hierarchical super resolution (SR) with neural networks (NNs), which upscales volumetric data represented with an octree data structure to a high-resolution uniform gridwith minimal seam artifacts on octree node boundaries. Our method uses existing state-of-the-art SR models and adds flexibility to upscale input data with varying levels of detail across the domain, instead of only uniform grid data that are supported in previous approaches.The key is to use a hierarchy of SR NNs, each trained to perform 2x SR between two levels of detail, with a hierarchical SR algorithm that minimizes seam artifacts by starting from the coarsest level of detail and working up.We show that our hierarchical approach outperforms baseline interpolation and hierarchical upscaling methods, and demonstrate the usefulness of our proposed approach across three use cases including data reduction using hierarchical downsampling+SR instead of uniform downsampling+SR, computation savings for hierarchical finite-time Lyapunov exponent field calculation, and super-resolving low-resolution simulation results for a high-resolution approximation visualization.

97 MATHEMATICS AND COMPUTING↗

Development of Strong Anaerobic Fluorescent Reporters for Clostridium acetobutylicum and Clostridium ljungdahlii Using HaloTag and SNAP-tag Proteins

One of the biggest limitations in the study and engineering of anaerobic Clostridium organisms is the lack of strong fluorescent reporters capable of strong and real-time fluorescence. Recently, we developed a strong fluorescent reporter system for Clostridium organisms based on the FAST protein. Here, we report the development of two new strong fluorescent reporter systems for Clostridium organisms based on the HaloTag and SNAP-tag proteins, which produce strong fluorescent signals when covalently bound to fluorogenic ligands. These new fluorescent reporters are orthogonal to the FAST ligands and to each other, allowing for simultaneous labeling and visualization. We used HaloTag and SNAP-tag to label the strictly anaerobic organisms Clostridium acetobutylicum and Clostridium ljungdahlii. We have also identified a new strong promoter for protein expression in C. acetobutylicum, based on the phosphotransacetylase gene (pta) from C. ljungdahlii. Furthermore, the HaloTag and the SNAP-tag, in combination with the previously described FAST system, were successfully used to measure cell populations in bacterial mixed cultures and showed the simultaneous orthogonal labeling of HaloTag and SNAP-tag together with the FAST protein reporter. Finally, we show the expression of recombinant fusion protein of FAST and the ZapA division protein (from C. acetobutylicum) in C. ljungdahlii. The availability of multiple strong fluorescent reporters is a major addition to the genetic toolkit of Here, Clostridium and other anaerobes that will lead to better understanding of these unique organisms.

59 BASIC BIOLOGICAL SCIENCES↗