Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “multimodal imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

NSUF Rad-AFM: Nanoscale Material Property Measurements of Radioactive Materials

Many advances in our understanding of radiation induced damage mechanisms are due to imaging techniques including transmission electron microscopy and scanning electron microscopy. However, the effect of these radiation induced defects characterized on the atomic to micrometer scale are often interpreted by changes in bulk material properties measured in the hundreds of microns to cm scale. In order to bridge this gap, additional tools need to be developed for use with radioactive materials. To this end a new Asylum Infinity multimodal atomic force microscope (AFM) has been added to the library of Nuclear Science User Facility (NSUF) instruments for use on radioactive materials. This instrument is housed in the Radiochemical Processing Laboratory (RPL) which is a Department of Energy Hazard Category II Non-Reactor Nuclear Facility operated by Battelle at Pacific Northwest National Laboratory. This allows for the handling, sample preparation, and characterization of highly radioactive materials providing a unique capability to understand fundamental properties of nuclear materials and the effects of radiation induced damage.

Riechers, Shawn L.↗
DOE OSTI2024

Addressing Critical Problems in Materials Science Through Multiscale and Multimode Characterization (Project 1); Characterization and Optimization of Novel Triple-Conducting Oxide Materials for Energy Applications (Project 2) (CRADA Final Report)

PROJECT 1: Address critical problems in materials science and simultaneously advance the state-of-the-art in multiscale and multimode characterization using the combined advanced analytical capabilities and expertise of Colorado School of Mines (CSM) and the National Renewable Energy Laboratory (NREL). The primary effort of the Phase I of this CRADA is to establish the International Center for Multiscale Characterization using shared resources at both NREL and CSM. Phase II will focus on capability development and marketing, choosing candidate materials science issues in the areas of structure imaging, chemical composition mapping, and correlating properties and performance of materials for impact in energy-related, environmental and critical materials areas. The CRADA will be modified to include specific topics of concern in materials science to industry member partners. Advanced analytical capabilities and expertise at CSM and NREL will be used to advance materials understanding and performance through characterization of multiscale phenomena including structural imaging, chemical composition mapping, and other techniques correlating properties and performance of materials. PROJECT 2: As part of the International Center for Materials Characterization, work under Modification #1 will be led by Colorado School of Mines (CSM), working in collaboration with NREL staff to mentor and advise CSM postdoctoral researchers on set up of diffusion annealing experiments. The purpose of the modification is to provide for NREL staff to mentor and advise CSM postdoctoral researchers on set up of diffusion annealing experiments, including mentoring and advising the CSM-NREL team on proper Secondary Ion Mass Spectrometry (SIMS) data analysis as needed. SIMS measurements of 10-20 samples will be performed at NREL during the project duration.

08 HYDROGEN↗
DOE OSTI2025

Phylogenomic discovery and engineering of nitrogen fixation into the bioenergy woody crop poplar

Biological nitrogen fixation (BNF) is a key process enabling plants in specific lineages to convert atmospheric dinitrogen (N₂) into bioavailable ammonia through symbioses with diazotrophic microbes. Expanding this capability beyond native nitrogen-fixing clades into non-nodulating crops would reduce synthetic fertilizer use, lowering energy inputs and environmental impacts in agriculture. Supported by DOE Funding Award DE-SC0018247, the NitFix project advanced foundational knowledge required to engineer root-nodule symbioses in new host species. The team generated the most comprehensive phylogenomic analysis to date of all known nodulating lineages, resolving the evolutionary history of nitrogen-fixing symbiosis and identifying core gene suites retained across nodulating taxa. Through multimodal genomics, transcriptomics, and functional analyses in Medicago truncatula and related species, the project mapped regulatory networks underlying nodule organogenesis, bacterial infection, and nitrogen-fixation efficiency. Key discoveries include the identification of conserved signaling modules for rhizobial recognition, transcription factors controlling nodule differentiation, and metabolic pathways integrating fixed nitrogen into plant growth. The project also developed enabling tools—including optimized transformation pipelines, gene-editing workflows, and imaging-based phenotyping—to accelerate engineering efforts in emerging models. Together, these results refine the mechanistic framework of symbiotic nitrogen fixation and highlight transferable components essential for rewiring these traits into non-nodulating crops.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Multimodal Tip-Enhanced Nonlinear Optical Nanoimaging of Plasmonic Silver Nanocubes

Optical field localization at plasmonic tip-sample nanojunctions has enabled high spatial resolution chemical analysis through tip-enhanced linear optical spectroscopies, including Raman scattering and photoluminescence. In this work, we illustrate that nonlinear optical processes, including parametric four-wave mixing (4WM), second harmonic/sum-frequency generation (SHG and SFG), and two-photon photoluminescence (TPPL), can be enhanced at plasmonic junctions and spatio-spectrally resolved simultaneously with few-nm spatial resolution under ambient conditions. More importantly, through a detailed analysis of our spectral nano-images, we find that the efficiencies of the local nonlinear signals are determined by sharp tip-sample junction resonances that vary over the few-nanometer length scale because of the corrugated nature of the probe. Namely, plasmon resonances centered at or around the different nonlinear signals are tracked through TPPL, and they are found to selectively enhance nonlinear signals with closely matched optical resonances.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Spectroscopic pressure investigation of a novel high energy system

This work here combines a novel multimodal spectroscopic technique, O–PTIR and Raman spectroscopy, which allows for the simultaneous collection of infrared and Raman spectra, with traditional diamond anvil cell techniques to explore pressure induced phase transitions in a high energy material. Two phase transitions are revealed, with the first transition emerging below 0.23 GPa, to a higher order phase, followed by a broad transition to a lower order phase. Aside from the pressure studies, hyperspectral imaging was performed, confirming the homogeneous nature of the system.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Droplet breakup by multimodal nonlinear Rayleigh Taylor instability

A droplet impacted by a shock wave will undergo a process of fragmentation due to the development of interfacial hydrodynamic instabilities. The interface experiences variable acceleration and shear that result in the development of both inertial (Rayleigh–Taylor) and shear (Kelvin–Helmholtz) instabilities. These perturbations grow in time and drive the fragmentation and breakup of the deformed droplet. Experiments are performed on nominally 0.86 mm water droplet subjected to a Mach 7.6 detonation wave, resulting in a high Weber number (~36,000) breakup event. Perturbation growth is measured from a series of high-speed (> MHz) shadowgraph images. It is proposed that, given the size of the large-scale perturbations observed in experiments, these instabilities are growing in the non-linear regime and can be described by bubble-merger models for nonlinear mixing. Calculations are performed for the growth rates and size of these instabilities using deformation and external flow models to establish the time-dependent boundary conditions. The concurrence of the measured perturbation widths and the predictions of the simple model lend credence to the theory. This novel approach serves to open a new avenue in the characterization of droplet breakup via hydrodynamic instabilities.

Droplet breakup↗
DOE OSTI2025

Bridging multimodal microscopy for advanced characterization on nuclear fuel using machine learning

Uranium dioxide (UO 2 ), widely used as driver fuel in light water reactors, experiences microstructure and property change by nuclear fission reactions. This paper bridges the characterization of fresh UO 2 fuel at different length scales, serving as a baseline for future post irradiation examination of irradiated UO 2 fuel. To characterize the microstructural change of nuclear fuel, modern approaches cover a wide range of length scales through different characterization techniques, such as mm scale for Synchrotron-based X-ray computed tomography (SXCT) and microscale for focused ion beam (FIB) and scanning electron microscopy (SEM). It is challenging to bridge the data and knowledge of the same sample in different length scales. This paper proposed a deep learning framework leveraging transfer learning to detect microstructural defects, trained from a sparse FIB, SEM, and SXCT images. The proposed model achieved superior performance in defect segmentation on multiscale microscopic data compared to four of the latest deep learning models.

36 MATERIALS SCIENCE↗
NASA NTRS2009

NASA Tech Briefs, November 2009

Topics covered include: Cryogenic Chamber for Servo-Hydraulic Materials Testing; Apparatus Measures Thermal Conductance Through a Thin Sample from Cryogenic to Room Temperature; Rover Attitude and Pointing System Simulation Testbed; Desktop Application Program to Simulate Cargo-Air-Drop Tests; Multimodal Friction Ignition Tester; Small-Bolt Torque-Tension Tester; Integrated Spacesuit Audio System Enhances Speech Quality and Reduces Noise; Hardware Implementation of a Bilateral Subtraction Filter; Simple Optoelectronic Feedback in Microwave Oscillators; Small X-Band Oscillator Antennas; Free-Space Optical Interconnect Employing VCSEL Diodes; Discrete Fourier Transform Analysis in a Complex Vector Space; Miniature Scroll Pumps Fabricated by LIGA; Self-Assembling, Flexible, Pre-Ceramic Composite Preforms; Flight-speed Integral Image Analysis Toolkit; Work Coordination Engine; Multi-Mission Automated Task Invocation Subsystem; Autonomously Calibrating a Quadrupole Mass Spectrometer; Determining Spacecraft Reaction Wheel Friction Parameters; Composite Silica Aerogels Opacified with Titania; Multiplexed Colorimetric Solid-Phase Extraction; Detecting Airborne Mercury by Use of Polymer/Carbon Films; Lattice-Matched Semiconductor Layers on Single Crystalline Sapphire Substrate; Pressure-Energized Seal Rings to Better Withstand Flows; Rollerjaw Rock Crusher; Microwave Sterilization and Depyrogenation System; Quantifying Therapeutic and Diagnostic Efficacy in 2D Microvascular Images; NiF2/NaF:CaF2/Ca Solid-State High-Temperature Battery Cells; Critical Coupling Between Optical Fibers and WGM Resonators; Microwave Temperature Profiler Mounted in a Standard Airborne Research Canister; Alternative Determination of Density of the Titan Atmosphere; Solar Rejection Filter for Large Telescopes; Automated CFD for Generation of Airfoil Performance Tables; Progressive Classification Using Support Vector Machines; Active Learning with Irrelevant Examples; A Data Matrix Method for Improving the Quantification of Element Percentages of SEM/EDX Analysis; Deployable Shroud for the International X-Ray Observatory; Improved Model of a Mercury Ring Damper; Optoelectronic pH Meter: Further Details; X-38 Advanced Sublimator; and Solar Simulator Represents the Mars Surface Solar Environment.

Source record↗
DOE OSTI2026

Enabling robust, stable, and accurate nonlinear optical measurements from squeezed light generated in hot rubidium vapor

The feasibility of nonlinear optical (NLO) imaging and spectroscopy using low intensity quantum states of light including entangled photon and squeezed light sources, such as those driven by two-photon absorption (TPA), has been a topic of ongoing debate. An unambiguous identification of the appreciable quantum advantage in such quantum light applications could enable NLO imaging of biological samples without photodegradation and phototoxicity. Recently, we have constructed a two-mode squeezed light source based on four-wave mixing in 85Rb vapor, which is capable of 7.9 dB of intensity-difference squeezing (IDS), corresponding to 8.7 dB upon electronic noise correction. In this talk, we discuss the stability of our system, including implementation details on achieving and maintaining 8.7 dB of IDS for several hours, and ensuring the two spatially multimode beams are properly overlapped in a sample with minimal optical loss.

Allen, Harry [ORNL] (ORCID:0000000190253914)↗
DOE OSTI2023

Large two-photon cross sections and low-threshold multiphoton lasing of CdS/CdSe/CdS quantum shells

Colloidal quantum shells are spherical semiconductor quantum wells, which have shown strong promise as optical materials, particularly in classes of experiments requiring multiple excitons. The two-photon properties of CdS/CdSe/CdS quantum shell samples are studied here to demonstrate large non-linear absorption cross-sections while retaining advantageous multiexciton physics conferred by the geometrical structure. The quantum shells have large two-phonon cross sections (0.4–7.9 × 10 6 GM), which highlights their potential use in upconversion imaging in which large per particle two-photon absorption is critical. Time-resolved measurements confirmed that the quantum shells have long biexciton lifetime (>10 ns in the largest core samples reported here) and large gain bandwidth (>300 meV). The combination of these attributes with large two-photon cross sections makes the CdS/CdSe/CdS quantum shells excellent gain media for two-photon excitation. With a broad gain bandwidth and long gain lifetime, quantum shell solids support multimodal amplified spontaneous emission from excitons, biexcitons, and higher excited states. In conclusion, thresholds for amplified spontaneous emission and lasing, which are as low as 1 mJ cm −2 , are comparable to, or lower than, the thresholds reported for other colloidal materials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Sputter-Deposited Mo Thin Films: Multimodal Characterization of Structure, Surface Morphology, Density, Residual Stress, Electrical Resistivity, and Mechanical Response

Multimodal datasets of materials are rich sources of information which can be leveraged for expedited discovery of process–structure–property relationships and for designing materials with targeted structures and/or properties. For this data descriptor article, we provide a multimodal dataset of magnetron sputter-deposited molybdenum (Mo) thin films, which are used in a variety of industries including high temperature coatings, photovoltaics, and microelectronics. In this dataset we explored a process space consisting of 27 unique combinations of sputter power and Ar deposition pressure. Here, the phase, structure, surface morphology, and composition of the Mo thin films were characterized by x-ray diffraction, scanning electron microscopy, atomic force microscopy, and Rutherford backscattering spectrometry. Physical properties—namely, thickness, film stress and sheet resistance—were also measured to provide additional film characteristics and behaviors. Additionally, nanoindentation was utilized to obtain mechanical load-displacement data. The entire dataset consists of 2072 measurements including scalar values (e.g., film stress values), 2D linescans (e.g., x-ray diffractograms), and 3D imagery (e.g., atomic force microscopy images). An additional 1889 quantities, including film hardness, modulus, electrical resistivity, density, and surface roughness, were derived from the experimental datasets using traditional methods. Minimal analysis and discussion of the results are provided in this data descriptor article to limit the authors’ preconceived interpretations of the data. Overall, the data modalities are consistent with previous reports of refractory metal thin films, ensuring that a high-quality dataset was generated. The entirety of this data is committed to a public repository in the Materials Data Facility.

36 MATERIALS SCIENCE↗
DOE OSTI2024

In situ coherent x-ray scattering reveals polycrystalline structure and discrete annealing events in strongly coupled nanocrystal superlattices

Solution-phase bottom up self-assembly of nanocrystals into superstructures such as ordered superlattices is an attractive strategy to generate functional materials of increasing complexity, including very recent advances that incorporate strong interparticle electronic coupling. While the self-assembly kinetics in these systems have been elucidated and related to the product characteristics, the weak interparticle bonding interactions suggest the superstructures formed could continue to order within the solution long after the primary nucleation and growth have occurred, even though the mechanism of annealing remains to be elucidated. Here, we use a combination of Bragg coherent diffractive imaging and x-ray photon correlation spectroscopy to create real-space maps of supercrystalline order along with a real-time view of the strain fluctuations in aging strongly coupled nanocrystal superlattices while they remain suspended and immobilized in solution. By combining the results, we deduce that the self-assembled superstructures are polycrystalline, initially comprising multiple nucleation sites, and that shear avalanches at grain boundaries continue to increase crystallinity long after growth has substantially slowed. This multimodal approach should be generalizable to characterize a breadth of materials in their native chemical environments, thus extending the reach of high-resolution coherent x-ray characterization to the benefit of a much wider range of physical systems. Published by the American Physical Society 2024

36 MATERIALS SCIENCE↗
NASA NTRS2016

Developing Atmospheric Retrieval Methods for Direct Imaging Spectroscopy of Gas Giants in Reflected Light I: Methane Abundances and Basic Cloud Properties

Reflected light spectroscopy and photometry of cool, directly imaged extrasolar giant planets are expected to be performed in the next decade by space-based telescopes equipped with optical wavelength coronagraphs and integral field spectrographs, such as the Wide-Field Infrared Survey Telescope (WFIRST). We are developing a new atmospheric retrieval methodology to help assess the science return and inform the instrument design for such future missions, and ultimately interpret the resulting observations. Our retrieval technique employs an albedo model coupled with both a Markov chain Monte Carlo Ensemble Sampler (emcee) and a multimodal nested sampling algorithm (MultiNest) to map the posterior distribution. This combination makes the global evidence calculation more robust for any given model, and highlights possible discrepancies in the likelihood maps. Here we apply this methodology to simulated spectra of cool giant planets. As a proof-of-concept, our current atmospheric model contains 1 or 2 cloud layers, methane as a major absorber, and a H2-He background gas. This 6-to-9 parameter model is appropriate for Jupiter-like planets and can be easily expanded in the future. In addition to deriving the marginal likelihood distribution and confidence intervals for the model parameters, we perform model selection to determine the significance of methane and cloud detection as a function of expected signal-to-noise, in the presence of spectral noise correlations. After internal validation, the method is applied to realistic reflected-light spectra of Jupiter, Saturn, and HD 99492 c, a likely observing target. We find that the presence or absence of clouds and methane can be determined with high accuracy, while parameters uncertainties are model-dependent.

spectroscopy↗
NASA NTRSDate not supplied

PACE OCI Short-Wave Infrared Detection Assembly Optical System Design, Alignment, and Environmental Test

The Ocean Color Instrument (OCI), which will be integrated with the Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) satellite, will collect science data that will be used to monitor the health of Earth’s oceans and atmosphere. The Short-Wave Infrared (SWIR) Detection Assembly (SDA), built and characterized by Utah State University Space Dynamics Laboratory (SDL), is a subsystem of OCI consisting of 32 channels covering seven discrete optical bands of interest. A total of 16 SWIR Detection Subassemblies (SDSs) compose the SDA and house the cold optical system. The science data optical input for each SDS is supplied by a 0.22 NA multimode fiber interfacing with a fiber adapter. The diverging light from the fiber is collimated, split by a dichroic beamsplitter to two separate channels, filtered by the science filter, and then reimaged onto the single-element detectors with a final 0.76 NA. Aspheric, diamond-turned powered elements are used throughout the optical design. Fabrication and alignment tolerance analysis/budgets are balanced to ensure the optical system meets throughput requirements. All systems are aligned at ambient temperature using an InSb camera and an in-line illumination microscope system to directly image the active detector area through the science filters. Compensators used during alignment are detector focus and decenter, which are adjusted via photoetched shims in increments of 25 µm. Average focus and centering errors were less than 8 µm among all 32 flight and 10 flight spare detectors. Each SDS spectral response and conversion gain was verified at operational temperature of -65°C in vacuum.

OCI↗
NASA NTRS1999

Multimodality stereotactic brain tissue identification: the NASA smart probe project

Real-time tissue identification can benefit procedures such as stereotactic brain biopsy, functional neurosurgery and brain tumor excision. Optical scattering spectroscopy has been shown to be effective at discriminating cancer from noncancerous conditions in the colon, bladder and breast. The NASA Smart Probe extends the concept of 'optical biopsy' by using neural network techniques to combine the output from 3 microsensors contained within a cannula 2. 7 mm in diameter (i.e. the diameter of a stereotactic brain biopsy needle). Experimental data from 5 rats show the clear differentiation between tissues such as brain, nerve, fat, artery and muscle that can be achieved with optical scattering spectroscopy alone. These data and previous findings with other modalities such as (1) analysis of the image from a fiberoptic neuroendoscope and (2) the output from a microstrain gauge suggest the Smart Probe multiple microsensor technique shows promise for real-time tissue identification in neurosurgical procedures. Copyright 2000 S. Karger AG, Basel.

Non-programmatic↗
DOE OSTI2022

Multimode Characterization Approach for Understanding Cell-Level PV Performance and Degradation

Cell-level degradation processes impact the economic viability and large-scale deployment prospects for both established and emerging photovoltaic (PV) technologies. This project addresses the need to develop experimental and device-modeling approaches for studying cell-level degradation processes in photovoltaic (PV) devices using a variety of characterization techniques that provide access to complementary material and device properties. Our results demonstrate that by coupling characterization results with device modeling it is possible to develop comprehensive understanding of processes leading to performance limitations and degradation. This project developed a suite of novel measurement techniques including pulsed-light-bias operando X-ray and photoelectron spectroscopy (popXPS), light-biased scanning microwave impedance microscopy (sMIM), and near-field transport imaging (TI). In addition, operando characterization methodologies and in situ stressing capabilities have been developed and applied for techniques including electron-beam-induced current (EBIC), cathodoluminescence (CL), and Kelvin probe force microscopy (KPFM). Device-physics models were developed and applied to simulate correlative, multi-mode measurements to extract material and device parameters that control performance degradation. These characterization and modeling techniques were applied in a multi-mode approach to probe cell-level degradation mechanisms in Cd(Se,Te) and hybrid perovskite PV devices. Together these efforts contribute to foundational PV degradation science by establishing a framework for understanding PV performance degradation at the cell level and benefit the U.S. PV industry by providing resources in the form of novel experimental capabilities, knowledge gained, and available expertise that can accelerate research and development of improved PV device materials and architectures. The project provided a comprehensive understanding of degradation in baseline Cd(Se,Te) solar cells provided by our collaborators at Colorado State University (CSU). EBIC and CL-based measurements and revealed unusual collection and recombination profiles in these devices, which underwent significant changes with during stressing. KPFM and operando XPS measurements showed that device stressing permanently alters energy-band alignments at the (Mg,Zn)O/Cd(Se,Te) interface, which in turn account for an observed loss in fill factor. Studies on hybrid perovskite devices were hampered to a significant extent by delays related to the pandemic. Nevertheless, a set of hybrid perovskite devices (supplied through an NREL-industry partnership) were stress tested and characterized with techniques including EBIC, sMIM, popXPS/popUPS and optically excited TI. Available results from these measurements informed the device modeling effort and suggest that defects and related band offsets at the C60/LiF/hybrid perovskite interface are the primary source of degradation in these devices.

14 SOLAR ENERGY↗
DOE OSTI2022

Fluorescence-coupled micropipette aspiration assay to examine calcium mobilization caused by red blood cell mechanosensing

Abstract Mechanical stimuli such as tension, compression, and shear stress play critical roles in the physiological functions of red blood cells (RBCs) and their homeostasis, ATP release, and rheological properties. Intracellular calcium (Ca 2+ ) mobilization reflects RBC mechanosensing as they transverse the complex vasculature. Emerging studies have demonstrated the presence of mechanosensitive Ca 2+ permeable ion channels and their function has been implicated in the regulation of RBC volume and deformability. However, how these mechanoreceptors trigger Ca 2+ influx and subsequent cellular responses are still unclear. Here, we introduce a fluorescence-coupled micropipette aspiration assay to examine RBC mechanosensing at the single-cell level. To achieve a wide range of cell aspirations, we implemented and compared two negative pressure adjusting apparatuses: a homemade water manometer (− 2.94 to 0 mmH 2 O) and a pneumatic high-speed pressure clamp (− 25 to 0 mmHg). To visualize Ca 2+ influx, RBCs were pre-loaded with an intensiometric probe Cal-520 AM, then imaged under a confocal microscope with concurrent bright-field and fluorescent imaging at acquisition rates of 10 frames per second. Remarkably, we observed the related changes in intracellular Ca 2+ levels immediately after aspirating individual RBCs in a pressure-dependent manner. The RBC aspirated by the water manometer only displayed 1.1-fold increase in fluorescence intensity, whereas the RBC aspirated by the pneumatic clamp showed up to threefold increase. These results demonstrated the water manometer as a gentle tool for cell manipulation with minimal pre-activation, while the high-speed pneumatic clamp as a much stronger pressure actuator to examine cell mechanosensing directly. Together, this multimodal platform enables us to precisely control aspiration and membrane tension, and subsequently correlate this with intracellular calcium concentration dynamics in a robust and reproducible manner.

Wang, Haoqing↗
DOE OSTI2024

Co-orchestration of multiple instruments to uncover structure–property relationships in combinatorial libraries

The rapid growth of automated and autonomous instrumentation brings forth opportunities for the co-orchestration of multimodal tools that are equipped with multiple sequential detection methods or several characterization techniques to explore identical samples. This is exemplified by combinatorial libraries that can be explored in multiple locations via multiple tools simultaneously or downstream characterization in automated synthesis systems. In co-orchestration approaches, information gained in one modality should accelerate the discovery of other modalities. Correspondingly, an orchestrating agent should select the measurement modality based on the anticipated knowledge gain and measurement cost. Herein, we propose and implement a co-orchestration approach for conducting measurements with complex observables, such as spectra or images. The method relies on combining dimensionality reduction by variational autoencoders with representation learning for control over the latent space structure and integration into an iterative workflow via multi-task Gaussian Processes (GPs). This approach further allows for the native incorporation of the system's physics via a probabilistic model as a mean function of the GPs. We illustrate this method for different modes of piezoresponse force microscopy and micro-Raman spectroscopy on a combinatorial Sm-BiFeO3 library. However, the proposed framework is general and can be extended to multiple measurement modalities and arbitrary dimensionality of the measured signals.

47 OTHER INSTRUMENTATION↗