Polydiacetylene Sensor Arrays as Multimodal Tamper Indicators
Explore the source record for details and available documents.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
This international collaborative research project between Johns Hopkins University (JHU) and the Technical University of Munich (TUM) investigated how the human brain processes and integrates multiple types of sensory information, such as touch and force, with the goal of improving prosthetic limbs for amputees and advancing sensory capabilities in humanoid robots. The research advanced our understanding of how the brain responds to sensory feedback in upper-limb amputees. Through experiments in which amputees received electrical stimulation while performing phantom hand movements, we demonstrated that sensory feedback activates the cortical sensorimotor and multisensory regions, and that these regions communicate dynamically during stimulation. Experiments with intact-limb participants explored the integration of visual, haptic, and force feedback, as well as in virtual reality motor training, further showing how the brain processes multimodal sensory information. In addition, this research inspired work on examining the reliability of where amputees perceive sensations over time, which contributed to a successful doctoral fellowship for continued investigation. Our collaborators at TUM improved multimodal sensor technology combining tactile and thermal feedback for humanoid robots, demonstrating the feasibility of integrating multiple sensor types into a unified system for detecting and responding to environmental stimuli. The experimental methods and analysis techniques developed across both teams, including functional network analysis and multimodal sensor integration, provide a foundation for future research in prosthetics and robotics. This research benefits the public by generating knowledge about how amputees process restored sensory information. Advances in humanoid sensing contribute to safer human-robot interaction. The project also fostered international collaboration and cross-disciplinary training: one TUM doctoral student spent a summer at JHU working on multimodal sensor integration, while two JHU students traveled to TUM to host workshops on neuromorphic sensory encoding and sensory integration.
Since the 1960’s, there has been interest in V-4Cr-4Ti and similar alloys as candidates for low activation structural materials for advanced nuclear reactors. V-4Cr-4Ti was produced using arc melting and subsequently subjected to large strain extrusion machining to produce a multimodal microstructure largely composed of nanocrystalline and ultrafine grain sizes. In-situ thermal stability of the multimodal V-4Cr-4Ti to 800 °C shows the formation of vanadium carbides with negligible grain growth. In-situ dual-beam 16 KeV He+ and 1 MeV Kr2+ ion irradiation performed at 700 °C to a final dose of ~5 displacements per atom show the formation of small He cavities well distributed throughout the system, with preferential clustering at grain boundaries. This work provides insight into how the increased fraction of grain boundaries affect the simultaneous dual beam ion irradiation response of multimodal V – 4 wt.% Cr – 4 wt.% Ti at elevated temperatures. Analysis of the cavities reveal an areal density of 0.024±0.007 cavities/nm2 and swelling of 0.236% after the dual-beam ion irradiation. Nanoindentation shows a ~50% increase in hardening after the ion irradiation at 700 °C.
Recent angle-resolved photoemission spectroscopy (ARPES) experiments on the kagome metal CsV_{3}Sb_{5} revealed distinct multimodal dispersion kinks and nodeless superconducting gaps across multiple electron bands. The prominent photoemission kinks suggest a definitive coupling between electrons and certain collective modes, yet the precise nature of this interaction and its connection to superconductivity remain to be established. Here, employing the state-of-the-art ab initio many-body perturbation theory computation, we present direct evidence that electron-phonon (e-ph) coupling induces the multimodal photoemission kinks in CsV_{3}Sb_{5}, and profoundly, drives the nodeless s-wave superconductivity, showcasing the diverse manifestations of the e-ph coupling. Our calculations well capture the experimentally measured kinks and their fine structures, and reveal that vibrations from different atomic species dictate the multimodal behavior. Results from anisotropic GW-Eliashberg equations predict a phonon-mediated superconductivity with nodeless s-wave gaps, in excellent agreement with various ARPES and scanning tunneling spectroscopy measurements. Despite the universal origin of the e-ph coupling, the contributions of several characteristic phonon vibrations vary in different phenomena, highlighting a versatile role of e-ph coupling in shaping the low-energy excitations of kagome metals.
The formation of insoluble gaseous defects in materials due to nuclear transmutation or ion implantation involves the diffusion of impurity atoms to form atomic defect clusters that coalesce into bubbles or cavities and ultimately degrade the material properties. Transmission electron microscopy (TEM) is limited in its ability to resolve sub-nanometer gas clusters whereas X-ray diffraction (XRD) provides information pertaining to local atomic changes. Here, in this study, helium (He) implanted ultrafine grained tungsten is explored through a multimodal defect characterization campaign combining TEM-informed Small Angle X-ray Scattering (SAXS) analysis, XRD lattice parameter measurements, and nanoscale He cluster quantification from a region of reciprocal space accessible via Wide Angle X-ray Scattering (WAXS). Moderate elevated temperature implantations are shown to produce high concentrations of sub-nanoscale He clusters and small, homogeneously distributed cavities, which collectively are linked to lattice expansion and further substantiated through complementary atomistic simulations. Increased implantation temperatures encourage the diffusion of these defects to the grain boundaries (GBs), leading to lattice relaxation and the growth of large GB cavities manifesting as bimodal size distributions in the SAXS analysis. Overall, our results demonstrate the utility of multimodal synchrotron X-ray analysis in bridging the gap between microscale He cavity quantification and atomic-scale defect analysis.
The emergence of the Smart Cities paradigm and the rapid expansion and integration of Internet of Things (IoT) technologies within this context have created unprecedented opportunities for high-resolution behavioral analytics, urban optimization, and context-aware services. However, this same proliferation intensifies privacy risks, particularly those arising from cross-modal data linkage across heterogeneous sensing platforms. To address these challenges, this paper introduces a comprehensive, statistically grounded framework for generating synthetic, multimodal IoT datasets tailored to Smart City research. The framework produces behaviorally plausible synthetic data suitable for preliminary privacy risk assessment and as a benchmark for future re-identification studies, as well as for evaluating algorithms in mobility modeling, urban informatics, and privacy-enhancing technologies. As part of our approach, we formalize probabilistic methods for synthesizing three heterogeneous and operationally relevant data streams—cellular mobility traces, payment terminal transaction logs, and Smart Retail nutrition records—capturing the behaviors of a large number of synthetically generated urban residents over a 12-week period. The framework integrates spatially explicit merchant selection using K-Dimensional (KD)-tree nearest-neighbor algorithms, temporally correlated anchor-based mobility simulation reflective of daily urban rhythms, and dietary-constraint filtering to preserve ecological validity in consumption patterns. In total, the system generates approximately 116 million mobility pings, 5.4 million transactions, and 1.9 million itemized purchases, yielding a reproducible benchmark for evaluating multimodal analytics, privacy-preserving computation, and secure IoT data-sharing protocols. To show the validity of this dataset, the underlying distributions of these residents were successfully validated against reported distributions in published research. We present preliminary uniqueness and cross-modal linkage indicators; comprehensive re-identification benchmarking against specific attack algorithms is planned as future work. This framework can be easily adapted to various scenarios of interest in Smart Cities and other IoT applications. By aligning methodological rigor with the operational needs of Smart City ecosystems, this work fills critical gaps in synthetic data generation for privacy-sensitive domains, including intelligent transportation systems, urban health informatics, and next-generation digital commerce infrastructures.
Machine learning (ML) methods for predictive maintenance (PdM) are emerging as effective proactive strategies for diagnosing equipment degradation and enabling effective decision-making. However, explainability and trustworthiness of artificial intelligence are two salient challenges that need to be addressed for wider deployment of these technologies in nuclear power plants (NPPs). Large language models (LLMs) offer a unique approach to tackle these challenges by explaining PdM, work orders, diagnosis results, and ML algorithms to users, who may not be familiar with ML and PdM in general. Moreover, by dynamically retrieving relevant information from technical documents and evaluating factuality of LLM generation, the accuracy and relevance of LLM generations can be improved. This work demonstrates using LLMs to explain the causes and consequences of circulating water system failures based on multiyear NPP work orders. This work tests the capability of multimodal LLM approaches in explaining the differences in the circulating water system from both the Salem and Hope Creek NPPs using both text and image resources. This work also demonstrates the use of multimodal LLMs in describing the diagnosis tab of a predictive maintenance software named VIsualization for PrEdictive maintenance Recommendation (VIPER) to users.
Immersive analytics (IA) leverages virtual reality, augmented reality, and mixed reality to transform how users interact with complex datasets across domains such as science, industry, and education. These immersive technologies offer spatial and multimodal environments that foster intuitive exploration, but they also introduce challenges related to cognitive load, interface design, and system performance. Here, this article presents a comprehensive review of visualization techniques, interaction models, and multimodal inputs utilized in IA. Drawing on case studies in scientific visualization, industrial training, and educational communication, we examine both the potential and limitations of current systems. Finally, we propose future research directions, focusing on real‐time collaboration, adaptive user interfaces, and scalable data exploration strategies to advance the field.
Thin‐film solid‐state metal dealloying (thin‐film SSMD) is a promising method for fabricating nanostructures with controlled morphology and efficiency, offering advantages over conventional bulk materials processing methods for integration into practical applications. Although machine learning (ML) has facilitated the design of dealloying systems, the selection of key thermal treatment parameters for nanostructure formation remains largely unknown and dependent on experimental trial and error. To overcome this challenge, a workflow enabling high‐throughput characterization of thermal treatment parameters is demonstrated using a laser‐based thermal treatment to create temperature gradients on single thin‐film samples of Nb‐Al/Sc and Nb‐Al/Cu. This continuous thermal space enables observation of dealloying transitions and the resulting nanostructures of interest. Through synchrotron X‐ray multimodal and high‐throughput characterization, critical transitions and nanostructures can be rapidly captured and subsequently verified using electron microscopy. The key temperatures driving chemical reactions and morphological evolutions are clearly identified. While the oxidation may influence nanostructure formation during thin‐film treatment, the dealloying process at the dealloying front involves interactions solely between the dealloying elements, highlighting the availability and viability of the selected systems. Further, this approach enables efficient exploration of the dealloying process and validation of ML predictions, thereby accelerating the discovery of thin‐film SSMD systems with targeted nanostructures.
This study leverages high-resolution differential-aperture X-ray structural microscopy (DAXM) to probe the local dislocation structure in deformed 304L-stainless steel at small strain, by measuring the lattice rotation and deviatoric elastic strain with a sub-micron resolution. For a single grain in a polycrystalline specimen, the measured lattice rotation field over the measured volume exhibited a multimodal distribution while the deviatoric elastic strain showed a single-mode distribution. An unsupervised Cauchy mixture machine learning model was developed to resolve the multimodal distribution of the lattice rotation. By mapping the lattice rotation data associated with each Cauchy peak in the model back onto the measured volume, we identify contiguous regions of the crystal rotated near the average values corresponding to the peaks of the overall rotation distribution. These regions represent the grain subdivision in the microstructure. Finally, the dislocation density tensor was also computed and its norm was laid over the rotation field to detect the subgrain boundaries. This step provided a validation of the Cauchy mixture model for the analysis of the lattice rotation distribution. The current study highlights the integration of advanced X-ray microscopy techniques with data-driven analysis methods to uncover detailed microstructure scales in deformed crystals.
Abstract Creating radio galaxy catalogues from next-generation deep surveys requires automated identification of associated components of extended sources and their corresponding infrared hosts. In this paper, we introduce RadioGalaxyNET, a multimodal dataset, and a suite of novel computer vision algorithms designed to automate the detection and localization of multi-component extended radio galaxies and their corresponding infrared hosts. The dataset comprises 4 155 instances of galaxies in 2 800 images with both radio and infrared channels. Each instance provides information about the extended radio galaxy class, its corresponding bounding box encompassing all components, the pixel-level segmentation mask, and the keypoint position of its corresponding infrared host galaxy. RadioGalaxyNET is the first dataset to include images from the highly sensitive Australian Square Kilometre Array Pathfinder (ASKAP) radio telescope, corresponding infrared images, and instance-level annotations for galaxy detection. We benchmark several object detection algorithms on the dataset and propose a novel multimodal approach to simultaneously detect radio galaxies and the positions of infrared hosts.
Abstract The transport of chemical species in rocks is affected by their structural heterogeneity to yield a wide spectrum of local solute concentrations. To quantify such imperfect mixing, advanced methodologies are needed that augment the traditional breakthrough curve analysis by probing solute concentration within the fluids locally. Here, we demonstrate the application of asynchronous, multimodality imaging by X‐ray computed tomography (XCT) and positron emission tomography (PET) to the study of passive tracer experiments in laboratory rock cores. The four‐dimensional concentration maps measured by PET reveal specific signatures of the transport process, which we have quantified using fundamental measures of mixing and spreading. We observe that the extent of solute spreading correlate strongly with the strength of subcore‐scale porosity heterogeneity measured by XCT, while dilution is enhanced in rocks containing substantial sub‐micron porosity. We observe that the analysis of different metrics is necessary, as they can differ in their sensitivity to the strength and forms of heterogeneity. The multimodality imaging approach is uniquely suited to probe the fundamental difference between spreading and mixing in heterogeneous media. We propose that when multi‐dimensional data is available, mixing and spreading can be independently quantified using the same metric. We also demonstrate that one‐dimensional transport models have limited predictive ability toward the internal evolution of the solute concentration, when the model is solely calibrated against the effluent breakthrough curves. The data set generated in this study can be used to build realistic digital rock models and to benchmark transport simulations that account deterministically for rock property heterogeneity.
In recent years, a self-consistent optical thermodynamic framework has emerged that offers a systematic methodology to understand, harness and exploit the complex collective dynamics of multimode nonlinear systems. These developments now allow consideration of a series of longstanding problems in optics, including the prospect of funnelling the entire power flowing in a multimode system into its ground state, for which no methodology currently exists. Here, we demonstrate an all-optical Joule-Thomson expansion process mediated by photon-photon interactions whereby the temperature of the optical gas drops abruptly to zero. Our experiments in various configurations of coupled multicore nonlinear waveguide arrangements illustrate how light undergoing expansion-induced cooling can be channelled from arbitrary input states into the fundamental mode with near-unity efficiency. We show that the stability of the post-expansion state is ensured through an irreversible process of energy conversion. The all-optical thermodynamic phenomena explored in this study may enable innovative techniques where various uncorrelated but identical sources are merged into a unified spatially coherent state, offering a route for direct beam combining.
Optical switches and bifurcation rely on the nonlinear response of materials. Here, we demonstrate linear temporal bifurcation responses in a passive multimode microresonator, with strongly coupled chaotic and whispering gallery modes (WGMs). In microdisks, the chaotic modes exhibit broadband transfer within the deformed cavities, but their transient response is less explored and yields a random output of the analog signal distributed uniformly from “0” to “1.” Here, we build chaotic states by perturbing the multimode microring resonators with densely packed silicon nanocrystals on the waveguide surface. In vivo measurements reveal random and “digitized” output that ONLY populates around 0 and 1 intensity levels. The bus waveguide mode couples first to chaotic modes, then either dissipates or tunnels into stable WGMs. This binary pathway generates high-contrast, digitized outputs. In conclusion, the fully passive device enables real-time conversion of periodic clock signals into binary outputs with contrasts exceeding 12.3 dB, data rates of up to 10 7 · bits per second, and 20 dB dynamic range.
Modern industries increasingly rely on multi-sensor technologies to acquire complex, high-dimensional data streams, enabling advanced monitoring and control systems. One critical application is online anomaly detection in electrical smart grids, where multivariate and multimodal sensing technologies play a vital role. However, detecting anomalies in such time-series data is challenging due to their inherent temporal dependencies and stochastic behavior. Traditional approaches based on supervised and semi-supervised learning methods depend on labeled datasets, which are often unavailable in real-world scenarios. While unsupervised methods have emerged as promising alternatives, these methods are highly susceptible to noise and outliers commonly present in sensing applications. Furthermore, deep learning-based anomaly detection methods, despite their performance, are often criticized for their black-box nature, limiting their applicability in safety-critical and online environments where interpretability and explainability are paramount. In this work, we propose an unsupervised anomaly clustering method leveraging a cyclic alignment-based offset detection algorithm for multivariate time-series signals. The proposed method is applied to multivariate data collected from vibrational, voltage, and magnetic field sensors deployed in a local grid substation. Our results demonstrate the robustness of the algorithm in accurately clustering various anomalies/events across different sensing modalities. Additionally, we compare the effectiveness of the proposed approach against a simple pattern-based anomaly detection method, which performs well for univariate data but fails to generalize to multivariate and multimodal time-series data.
The lack of high-power integrated lasers has been limiting silicon photonics. Despite much progress in chip-scale laser integration, power output remains below levels required for key applications due to low energy efficiency at high pumping currents. Here we break this power limitation by coupling a broad-area multimode gain chip to a silicon-nitride ring resonator and single-mode filter. The resulting optical feedback causes the multimode-gain chip to concentrate its power into a single highly coherent mode. Our device produces more than 150 mW of power and 400 kHz linewidth. We achieve these metrics while maintaining a small footprint of 3 mm 2 .