Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “real time experiments”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Lightweight jet reconstruction and identification as an object detection task

We apply object detection techniques based on deep convolutional blocks to end-to-end jet identification and reconstruction tasks encountered at the CERN large hadron collider (LHC). Collision events produced at the LHC and represented as an image composed of calorimeter and tracker cells are given as an input to a Single Shot Detection network. The algorithm, named PFJet-SSD performs simultaneous localization, classification and regression tasks to cluster jets and reconstruct their features. This all-in-one single feed-forward pass gives advantages in terms of execution time and an improved accuracy w.r.t. traditional rule-based methods. A further gain is obtained from network slimming, homogeneous quantization, and optimized runtime for meeting memory and latency constraints of a typical real-time processing environment. We experiment with 8-bit and ternary quantization, benchmarking their accuracy and inference latency against a single-precision floating-point. We show that the ternary network closely matches the performance of its full-precision equivalent and outperforms the state-of-the-art rule-based algorithm. Finally, we report the inference latency on different hardware platforms and discuss future applications.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2020

Attosecond XUV probing of vibronic quantum superpositions in Br 2 +

Ultrafast laser excitation can create coherent superpositions of electronic states in molecules and trigger ultrafast flow of electron density on a few femtosecond timescale. While recent attosecond experiments have addressed real-time observation of these primary photochemical processes, the underlying roles of simultaneous nuclear motions and how they modify and disturb the valence electronic motion remain uncertain. In this work, we investigate coherent electronic-vibrational dynamics induced among multiple vibronic levels of ionic bromine (Br 2 + ), including both spin-orbit (X 2 Π 3/2,g – X 2 Π 1/2,g ) and valence (A 2 Π 3/2,u – 4 Σ 3/2,u ) electronic superpositions, using attosecond transient absorption spectroscopy. Decay, revival, and apparent frequency shifts of electronic coherences are measured via characteristic quantum beats on the Br-3d core-level absorption signals. Quantum-mechanical simulations attribute the observed electronic decoherence to broadened phase distributions of nuclear wave packets on anharmonic potentials. Molecular vibronic structure is further revealed to be imprinted as discrete progressions in electronic beat frequencies. These results provide a future basis to interpret complex charge-migration dynamics in polyatomic systems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Real-time streaming tomographic reconstruction with on-demand data capturing and 3D zooming to regions of interest

Complex dynamic tomographic experiments at brilliant X-ray light sources require real-time feedback on the sample changes with respect to environmental conditions, selecting representative regions of interest for high-resolution scanning, and on-demand data saving mechanisms for storing only relevant projections acquired by fast area detectors and reducing data volumes. Here the implementation details of a 3D real-time imaging monitoring instrument, with zooming to a volume of interest with easy-to-use visualization via ImageJ , a tool familiar to most beamline users, is presented. The instrument relies on optimized data flow between the detector and processing machines and is implemented on commodity computers. The instrument has been developed at beamline 2-BM of the Advanced Photon Source, where the automatic lens changing mechanism for zooming is implemented with an Optique Peter microscope. Performance tests demonstrate the ability to process more than 3 GB of projection data per second and generate real-time 3D zooming with different magnification. These new capabilities are essential for new APS Upgrade instruments such as the projection microscope under development at beamline 32-ID. The efficacy of the proposed instrument was demonstrated during an in situ tomographic experiment on ice and gas hydrate formation in porous samples.

3D zooming↗
DOE OSTI2024

Multi-Source Machine Learning and Thermoplastics Enhanced Aerostructure Manufacturing (mTEAM)

RTX Technology Research Center (RTRC), together with Collins Aerospace (Collins) and Oak Ridge National Laboratory (ORNL) has developed an Artificial Intelligence (AI) / Machine Learning (ML) guided solution to advance the manufacturing and assembly of high performance and lightweight thermoplastic composite (TPC) aerospace products. The solution aims to lower risk, cost and lead time for induction heating based welding and consolidation processes for TPC structure. The cost and lead time of part and material specific process development for induction welding (IW) and induction consolidation will be reduced by replacing traditional empirical methods with optimization methods that merge AI/ML and physics-based process simulations and process experiments with sensing and controls. TPC-IW process development is empirical in nature, and uncertainties in material & process behavior exist near & far from the induction coil. Physics-based simulations can be leveraged directly for process optimization but can be too computationally expensive to run in high fidelity and real time to do robust process optimization. The key impact of successful TPC induction consolidation and welding is cost & lead time reduction for part & material specific consolidation and welding recipes. This is an enabler for more rapid deployment of TPC structures via joining assembly, which can reduce energy & cost intensive usage of autoclaves & ovens. The solution aimed to advance the U.S. Department of Energy’s interests in using thermoplastics and automation in composite manufacturing for improvement of products for existing markets via increased production speeds, reduced costs, and lowered use of energy. Welded TPC structures can offer significant weight & energy savings for high-value commercial aerospace & industrial applications compared to metal & thermoset composite structures assembled by mechanical fastening and/or adhesive bonding. The project was organized into two Budget Periods. Budget Period 1 (BP1) was 15 months and its goal was to perform ML process optimization framework development & deployment on lab-coupon aerostructure components. A Go/No-Go Review was performed at the end of BP1 to verify fulfilment of key tasks & milestones to justify a Go Decision to move into the next Budget Period. Budget Period 2 (BP2) was 12 months and its goal was the deployment of the ML framework for ML process optimization of pilot industrial scale aerostructure components. The overall project aim was to develop & demonstrate ML-enhanced modeling framework that learns process-property mapping from multiple data sources at different fidelities. During BP1, the team accomplished key tasks & milestones to demonstrate the concept of multi-source ML for TPC aerostructure consolidation and assembly. First, the team completed documentation of induction based TPC heating requirements including baseline metrics to compare measured results against. Next the team completed demonstration of data generation from physics-based simulations for ML surrogate model generation and demonstrated the integration of physics-based simulation data into multi-source AI/ML algorithms. In parallel, the team established the lab-coupon scale induction welding system and completed a process to label and reduce generated data from physics-based simulation and experiments for ML surrogate models to enable multi-source ML model training & testing. To complete BP1, the team integrated physics-based simulation data and experimental data into multi-source ML algorithms. This was based on the team completing ML deployment of the induction welding on a lab system at RTRC and AI/ML deployment on existing induction welding line at Collins. ORNL visited both Collins and RTRC sites to witness the TPC induction welding process. Then, ORNL designed and constructed a new version of their vision-based sensing system better adapted to acquire process signals of the TPC induction welding process for process anomaly and defect detection. In BP2, the team accomplished key tasks & milestones to scale up multi-source ML for TPC aerostructure consolidation and assembly from the lab-coupon scale to the pilot-industrial scale. In BP2, the team demonstrated real time anomaly & defect detection via experiments performed by ORNL & RTRC. The team completed ML-optimization heating trials for TPC induction consolidation at Collins, and the team confirmed pilot industrial scale experimental data from Collins was compatible with the developed ML pipeline from RTRC. The team completed sub-element scale ML process optimization demonstration at RTRC, where the team leveraged RTRC’s robotic TPC welding setup to de-risk the ML process optimization by performing ML analysis of recorded temperatures to account for complex part features. Then, the team applied its ML-derived control strategies and ML process optimization framework at Collins to the pilot-industrial scale on a demo skin-stiffener part representative of a nacelle aerostructure fan cowl section. The key innovation is the AI/ML framework enabling effective process development of high performance, lightweight, energy efficient TPCs for composite aircraft structures.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Real time detection of multiple stable MHD eigenmode growth rates towards kink/tearing modes avoidance in DIII-D tokamak plasmas

Abstract Real time detection of time evolving growth rates of multiple stable magnetohydrodynamic (MHD) eigenmodes has been achieved in DIII-D tokamak experiments via multi-mode three-dimensional (3D) active MHD spectroscopy. The measured evolution of the multi-modes’ growth rates is in good accordance with the variation of the plasma β N . Using experimental equilibria, resistive MARS-F simulations found the two least stable modes to have comparable growth rates to those experimentally measured. Real time and offline calculations of the modes’ growth rates show comparable results and indicate that cleaner system input and output signals will improve the accuracy of the real time stability detection. Moreover, the shortest real time updating time window of multi-mode eigenvalues can be about 2 ms in DIII-D experiments. This real time monitoring of stable, macroscopic kink and tearing modes thus provides an effective tool for avoidance of the most common causes of tokamak disruption.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Wind/Wave Testing of a 1:70-Scale Performance-Matched Model of the IEA Wind 15 MW Reference Wind Turbine with Real-Time ROSCO Control and Floating Feedback

Experimental results from the Floating Offshore-wind and Controls Advanced Laboratory (FOCAL) experimental program, which tested a performance-matched model of the IEA Wind 15 MW Reference Turbine on a 1:70 scale floating semisubmersible platform, are compared with OpenFAST simulations. Four experimental campaigns were performed, and data from the fourth campaign, which focused on wind and wave testing of the scaled floating wind turbine system, are considered. Simulations of wave-only, wind-only, and wind/wave environments are performed in OpenFAST, and results for key metrics are compared with the experiment. Performance of the real-time Reference OpenSource COntroller (ROSCO) in above-rated wind conditions, including the effects of the floating feedback loop, are investigated. Results show good agreement in mean values for key metrics, and hydrodynamic effects are matched well. Differences in the surge resonant behavior of the platform are identified and discussed. The effect of the controller and floating feedback loop is evident in both the experiment and OpenFAST, showing significant reduction in platform pitch response and tower base bending load near the platform pitch natural frequency.

17 WIND ENERGY↗
DOE OSTI2025

PvaPy streaming framework for real-time data processing

User facility upgrades, new measurement techniques, advances in data analysis algorithms as well as advances in detector capabilities result in an increasing amount of data collected at X-ray beamlines. Some of these data must be analyzed and reconstructed on demand to help execute experiments dynamically and modify them in real time. In turn, this requires a computing framework for real-time processing capable of moving data quickly from the detector to local or remote computing resources, processing data, and returning results to users. In this paper, we discuss the streaming framework built on top of PvaPy, a Python API for the EPICS pvAccess protocol. We describe the framework architecture and capabilities, and discuss scientific use cases and applications that benefit from streaming workflows implemented on top of this framework. We also illustrate the framework's performance in terms of achievable data-processing rates for various detector image sizes.

EPICS pvAccess↗
DOE OSTI2022

Path Integral Monte Carlo Simulations of Iron Plasmas (Final Technical Report)

This documents is the final technical report for our grant entitled "Path Integral Monte Carlo Simulations of Iron Plasmas" that focused on developing path integral Monte Carlo (PIMC) computer simulations. This techniques will be developed to study plasmas composed of heavier elements including iron and other third row elements. Equations of state (EOS) and transport properties will be derived in the regime of warm dense matter (WDM) and dense plasmas where existing first-principles methods cannot be applied. While standard density functional theory (DFT) has been used to accurately predict the structure of many solids and liquids up to temperatures on the order of 100,000 K, this method is not applicable at much higher temperature because the number of partially occupied electronic orbitals reaches intractably large numbers or the use of finite-temperature free energy functionals in orbital-free DFT introduces an uncontrolled approximation. Here we focus on PIMC methods that become more and more efficient with increasing temperatures and still include all electronic correlation effects. In this approach, electronic excitations increase the efficiency rather than reduce it. While it had commonly been assumed this method could only be applied to elements without core electrons, we showed that PIMC with free-particle nodes works well for first-row elements (PRL 108 (2012) 115502). Most recently, we extended the applicability range of all-electron PIMC to second-row elements by adopting localized nodal surfaces (PRL 115 (2015) 176403). To simulate third-row elements efficiently under WDM conditions, we propose a new method to remove core electrons by introducing pseudo-nodes. We explain our approach step by step and present preliminary results. We focus our method development on getting PIMC simulations of iron to work because of its fundamental importance for WDM and astrophysics. Then we move on to krypton and copper-doped beryllium, a ICF ablator material. We plan to continue working on key second-row material such as Na, Mg, MgO, Al, silica, and silicon-doped plastic ablators. Our collaborators at LLNL, will use our PIMC EOS data both as comparisons to existing semi-empirical, EOS-generating schemes, and as input for continuum radiation hydrodynamics simulations. We will establish an efficient pipeline from PIMC to macroscopic continuum studies of materials response. An emphasis will be placed on benchmarking such methods for plasmas of heavy elements at the very high temperatures (~100 eV) and low densities that are generated when Hohlraum radiation heats the ablator material in indirect drive laser experiments. Results from changes to the EOS will be of immeasurable importance to the designers at the National Ignition Facility (NIF) and at other facilities. Starting with our EOS of Cu-doped Be, our second collaborator at LLE, will perform real-time simulations of laser fusion experiments at the Omega laser and at the NIF to determine how sensitive the compression path depends on the ablator EOS. Since our collaborator also has experience in performing orbital-free DFT calculations, we propose to compare predictions from this method with PIMC results. In joint publications, we plan to analyze the accuracy of different free-energy functionals in order to understand why existing orbital-free DFT calculations do not predict compression peaks along the shock Hugoniot curve that we see with PIMC. The peaks are caused by the ionization of various electron shells. Their accurate characterization is important to compare with experimental results. We will break new ground by developing PIMC techniques that can simulate iron and all other third row elements in the plasma and WDM regimes. We introduce the concept of pseudo-nodes for the efficient treatment of the core-electrons. The EOS and transport properties will be derived and published online in the form of a new WDM database. Our PIMC EOS calculations will benchmark and possibly replace semi-analytical EOS tables like QEOS or SESAME, which will impact the hydrocode simulation community and will affect the design of NIF targets. Our PIMC results will help to improve the accuracy of orbital-free DFT simulations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Qualitative and quantitative enhancement of parameter estimation for model-based diagnostics using automatic differentiation with an application to inertial fusion

Parameter estimation using observables is a fundamental concept in the experimental sciences. Mathematical models that represent the physical processes can enable reconstructions of the experimental observables and greatly assist in parameter estimation by turning it into an optimization problem which can be solved by gradient-free or gradient-based methods. In this work, the recent rise in flexible frameworks for developing differentiable scientific computing programs is leveraged in order to dramatically accelerate data analysis of a common experimental diagnostic relevant to laser–plasma and inertial fusion experiments, Thomson scattering. A differentiable Thomson-scattering data analysis tool is developed that uses reverse-mode automatic differentiation (AD) to calculate gradients. By switching from finite differencing to reverse-mode AD, three distinct outcomes are achieved. First, gradient descent is accelerated dramatically to the extent that it enables near real-time usage in laser–plasma experiments. Second, qualitatively novel quantities which require $\mathcal{O}(10^3)$ parameters can now be included in the analysis of data which enables unprecedented measurements of small-scale laser–plasma phenomena. Third, uncertainty estimation approaches that leverage the value of the Hessian become accurate and efficient because reverse-mode AD can be used for calculating the Hessian.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Normality of I-V Measurements Using ML

There is an increased interest in instrument-computing ecosystems (ICEs) that support science workflows empowered by AI-automated experiments and computations in diverse areas. In particular, electrochemistry ICEs are promising for accelerating the design and discovery of electrochemical systems for energy storage and conversion, by automating significant parts of workflows that combine synthesis and characterization experiments with computations. They require the integration of flow controllers, solvent containers, pumps, fraction collectors, and potentiostats, all connected to an electrochemical cell, as illustrated in Fig. 1. These are specialized instruments with custom software that is not originally designed for network integration. We developed network and software solutions for electrochemical workflows that adapt system and instrument settings in real-time for multiple rounds of experiments. In particular, we developed Python wrappers for Application Programming Interfaces (APIs) of instrument commands and Pyro client-server modules that enable them to be executed from remote computers. The entire workflow is orchestrated by a Jupyter notebook running on a remote computer.

Al Najjar, Anees↗
DOE OSTI2023

Enabling Real-time Scattering Data Analysis with Scalable Optimization [Slides]

Diffraction experiments produce datasets with rich multidimensional physics information such as microstructure, equations of state, crystal structure, elastoplastic properties, and other key inputs to LANL mission-essential multiphysics models. This information is typically extracted through a process called Rietveld refinement, which involves selecting appropriate models of the instrument, crystal structure, and microstructure, identifying suitable starting values, and then fitting often hundreds of model parameters using a sequence of empirical parameter turnon/off sequences within a non-global gradient-based optimization. Extensive user expertise is required to properly setup a refinement, identify appropriate models, and select initial parameter values close to truth, such that the refinement will yield parameter values that are optimally predictive. This is a very tedious manual process performed far after the beamline campaign has ended. As facilities have become capable of generating larger volumes of data, the limitation in throughput due to Rietveld refinement has led to a dramatic increase in unanalyzed data as opposed to an intended increase in new science. In our FY22 TED, we demonstrated an integrated toolset providing near real-time automated Rietveld analysis. If this toolset can be optimized to provide automated Rietveld analysis in real-time, this could alleviate the bottleneck in unanalyzed diffraction data, aid in decision-making during experiments, and increase efficiency of the facility.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2025

Digital Twin for Chemical Science: a case study on water interactions on the Ag(111) surface

Directly visualizing chemical trajectories offers insights into catalysis, gas-phase reactions and photoinduced dynamics. Tracking the transformation of chemical species is best achieved by coupling theory and experiment. Here we developed Digital Twin for Chemical Science (DTCS) v.01, which integrates theory, experiment and their bidirectional feedback loops into a unified platform for chemical characterization. DTCS addresses a core question: given a set of experimental conditions, what is the expected outcome and why? It consists of a forward solver that takes a chemical reaction network and predicts spectra under experimental conditions, and an inverse solver that infers kinetics from measured spectra. We applied DTCS to ambient-pressure X-ray photoelectron spectroscopy measurements of the Ag–H2O interface as an example. This approach enables real-time knowledge extraction and guides experiments until a stopping condition is met based on accuracy and degeneracy. As a step toward autonomous chemical characterization, DTCS provides mechanistic knowledge in a verified, standardized manner.

Chemistry↗
DOE OSTI2025

Bridging the gap: Deploying AI-based Models in Real-Time Fusion Plasma Control Systems

Achieving reliable real-time control in fusion plasma experiments requires strict timing guarantees across entire control algorithms. In earlier work by Abbate et al. (2023), we demonstrated the feasibility of neural-network-based control algorithms on the DIII-D tokamak using the internally developed open-source Keras2C library for model conversion into C (Conlin et al. (2021)). However, the initial implementations relied on data buffering and branching logic outside the neural network code, causing variability in execution times. Subsequent deployments on DIII-D and KSTAR—including the RTCAKENN algorithm for kinetic profile reconstruction—proved that minimizing branching and buffering throughout the pipeline yields consistent millisecond-level cycle times under real experimental conditions (Shousha et al. (2023)). However, keeping pace with rapidly evolving AI frameworks (e.g. PyTorch) is challenging. Finally, we, therefore, propose a community-driven open-source effort to expand the tool, enabling real-time deployment across diverse systems that require strictly bounded execution times.

AI-based models↗
DOE OSTI2022

Design and Closed‐Loop Motion Planning of an Untethered Swimming Soft Robot Using 2D Discrete Elastic Rods Simulations

Despite tremendous progress in the development of untethered soft robots in recent years, existing systems lack the mobility, model‐based control, and motion planning capabilities of their piecewise rigid counterparts. As in conventional robotic systems, the development of versatile locomotion of soft robots is aided by the integration of hardware design and control with modeling tools that account for their unique mechanics and environmental interactions. Here, a framework for physics‐based modeling, motion planning, and control of a fully untethered swimming soft robot is introduced. This framework enables offline co‐design in the simulation of robot parameters and gaits to produce effective open‐loop behaviors and enables closed‐loop planning over motion primitives for feedback control of a frog‐inspired soft robot testbed. This pipeline uses a discrete elastic rods (DERs) physics engine that discretizes the soft robot as many stretchable and bendable rods. On hardware, an untethered aquatic soft robot that performs frog‐like rowing behaviors is engineered. Hardware validation verifies that the simulation has sufficient accuracy to find the best candidates for sets of parameters offline. The simulator is then used to generate a trajectory library of the robot's motion in simulation that is used in real‐time closed‐loop path following experiments on hardware.

Huang, Xiaonan↗
DOE OSTI2025

Electron microscopy data on irradiation effects in glassy carbon, nuclear graphite, pyrolytic carbon, and carbon fibers

Glassy carbon, a monoatomic allotrope of carbon, is a candidate material for components in fission nuclear power systems due to its radiation tolerance. This article presents comprehensive electron microscopy data revealing the effects of neutron and electron irradiation on glassy carbon. For comparison, additional data are provided for pyrolytic graphite and carbon fibers, materials that exhibit similar structural behavior under irradiation. In situ electron irradiation experiments further illustrate the real-time microstructural evolution of glassy carbon during exposure. The dataset is organized into five parts: (1) transmission electron microscopy (TEM) micrographs of as-received and neutron-irradiated glassy carbon; (2) TEM micrographs of neutron-irradiated graphite; (3) TEM micrographs of unirradiated and irradiated carbon–carbon composites; (4) TEM micrographs of pyrolytic carbon specimens in both conditions; (5) scanning transmission electron microscopy (STEM) micrographs of as-received and neutron-irradiated glassy carbon and (6) in situ electron irradiation data of a glassy carbon particle. These datasets provide valuable insights into radiation-induced structural changes in carbon-based materials relevant to nuclear applications.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Efficient proactive vehicle relocation for on-demand mobility service with recurrent neural networks

One major challenge for on-demand mobility service (OMS) providers is to seamlessly match empty vehicles with trip requests so that the total vacant mileage is minimized. In this work, we develop an innovative data-driven approach for devising efficient vehicle relocation policy for OMS that (1) proactively relocates vehicles before the demand is observed and (2) reduces the inequality among drivers' income so that the proactive relocation policy is fair and is likely to be followed by drivers. Our approach represents the fusion of optimization and machine learning methods, which comprises three steps: First, we formulate the optimal proactive relocation as an optimal/stable matching problems and solve for global optimal solutions based on historical data. Second, the optimal solutions are then grouped and fed to train the deep learning models which consist of fully connected layers and long short-term memory networks. Low rank approximation is introduced to reduce the model complexity and improve the training performances. Finally, we use the trained model to predict the relocation policy which can be implemented in real time. We conduct comprehensive numerical experiments and sensitivity analyses to demonstrate the performances of the proposed method using New York City taxi data. Here, the results suggest that our method will reduce empty mileage per trip by 54-70% under optimal matching strategy, and a 25-32% reduction can also be achieved by following stable matching strategy. We also validate that the predicted relocation policies are robust in the presence of uncertain passenger demand level and passenger trip-requesting behavior.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2025

Electron beam characterization via quantum coherent electric field imaging

We demonstrate an all-optical, minimally invasive electron beam (𝑒−beam) characterization using Rydberg electrometry. An 𝑒-beam passes through a localized detector volume containing thermal Rb atoms that are optically excited in a quantum superposition of ground and Rydberg states. The 𝑒-beam's electric field perturbs atomic coherence and modifies resonance fluorescence in a narrow spectral region near the two-photon optical transition. Imaging Rb fluorescence provides a map of the electric field from the 𝑒-beam via Rydberg state Stark shifts and allows us to reconstruct the 𝑒-beam width, centroid position, and current. For an 𝑒-beam of 20 keV and electron currents of 20–40 µ⁢A, we measured the centroid position with an accuracy of ≤ 8 µ⁢m and width to within 100 µ⁢m, limited by the experimental sensitivity of electric field reconstruction of ∼0.02 V/cm. This method is suitable for a wide range of electron energies and currents, and can be adopted for nuclear and high-energy experiments for minimally invasive real-time diagnostics and profiling of charged particle beams.

Behary, Rob [College of William and Mary, Williams↗
DOE OSTI2023

SpeckleNN: a unified embedding for real-time speckle pattern classification in X-ray single-particle imaging with limited labeled examples

With X-ray free-electron lasers (XFELs), it is possible to determine the three-dimensional structure of noncrystalline nanoscale particles using X-ray single-particle imaging (SPI) techniques at room temperature. Classifying SPI scattering patterns, or `speckles', to extract single-hits that are needed for real-time vetoing and three-dimensional reconstruction poses a challenge for high-data-rate facilities like the European XFEL and LCLS-II-HE. Here, we introduce SpeckleNN, a unified embedding model for real-time speckle pattern classification with limited labeled examples that can scale linearly with dataset size. Trained with twin neural networks, SpeckleNN maps speckle patterns to a unified embedding vector space, where similarity is measured by Euclidean distance. We highlight its few-shot classification capability on new never-seen samples and its robust performance despite having only tens of labels per classification category even in the presence of substantial missing detector areas. Without the need for excessive manual labeling or even a full detector image, our classification method offers a great solution for real-time high-throughput SPI experiments.

47 OTHER INSTRUMENTATION↗