Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “multimodal network”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS1992

Optical multiple access techniques for on-board routing

The purpose of this research contract was to design and analyze an optical multiple access system, based on Code Division Multiple Access (CDMA) techniques, for on board routing applications on a future communication satellite. The optical multiple access system was to effect the functions of a circuit switch under the control of an autonomous network controller and to serve eight (8) concurrent users at a point to point (port to port) data rate of 180 Mb/s. (At the start of this program, the bit error rate requirement (BER) was undefined, so it was treated as a design variable during the contract effort.) CDMA was selected over other multiple access techniques because it lends itself to bursty, asynchronous, concurrent communication and potentially can be implemented with off the shelf, reliable optical transceivers compatible with long term unattended operations. Temporal, temporal/spatial hybrids and single pulse per row (SPR, sometimes termed 'sonar matrices') matrix types of CDMA designs were considered. The design, analysis, and trade offs required by the statement of work selected a temporal/spatial CDMA scheme which has SPR properties as the preferred solution. This selected design can be implemented for feasibility demonstration with off the shelf components (which are identified in the bill of materials of the contract Final Report). The photonic network architecture of the selected design is based on M(8,4,4) matrix codes. The network requires eight multimode laser transmitters with laser pulses of 0.93 ns operating at 180 Mb/s and 9-13 dBm peak power, and 8 PIN diode receivers with sensitivity of -27 dBm for the 0.93 ns pulses. The wavelength is not critical, but 830 nm technology readily meets the requirements. The passive optical components of the photonic network are all multimode and off the shelf. Bit error rate (BER) computations, based on both electronic noise and intercode crosstalk, predict a raw BER of (10 exp -3) when all eight users are communicating concurrently. If better BER performance is required, then error correction codes (ECC) using near term electronic technology can be used. For example, the M(8,4,4) optical code together with Reed-Solomon (54,38,8) encoding provides a BER of better than (10 exp -11). The optical transceiver must then operate at 256 Mb/s with pulses of 0.65 ns because the 'bits' are now channel symbols.

Mendez, Antonio J.↗
DOE OSTI2026

CRCNS21 Computational Models of Multisensory Integration by Upper Limb in Humanoids and Amputees

This international collaborative research project between Johns Hopkins University (JHU) and the Technical University of Munich (TUM) investigated how the human brain processes and integrates multiple types of sensory information, such as touch and force, with the goal of improving prosthetic limbs for amputees and advancing sensory capabilities in humanoid robots. The research advanced our understanding of how the brain responds to sensory feedback in upper-limb amputees. Through experiments in which amputees received electrical stimulation while performing phantom hand movements, we demonstrated that sensory feedback activates the cortical sensorimotor and multisensory regions, and that these regions communicate dynamically during stimulation. Experiments with intact-limb participants explored the integration of visual, haptic, and force feedback, as well as in virtual reality motor training, further showing how the brain processes multimodal sensory information. In addition, this research inspired work on examining the reliability of where amputees perceive sensations over time, which contributed to a successful doctoral fellowship for continued investigation. Our collaborators at TUM improved multimodal sensor technology combining tactile and thermal feedback for humanoid robots, demonstrating the feasibility of integrating multiple sensor types into a unified system for detecting and responding to environmental stimuli. The experimental methods and analysis techniques developed across both teams, including functional network analysis and multimodal sensor integration, provide a foundation for future research in prosthetics and robotics. This research benefits the public by generating knowledge about how amputees process restored sensory information. Advances in humanoid sensing contribute to safer human-robot interaction. The project also fostered international collaboration and cross-disciplinary training: one TUM doctoral student spent a summer at JHU working on multimodal sensor integration, while two JHU students traveled to TUM to host workshops on neuromorphic sensory encoding and sensory integration.

42 ENGINEERING↗
DOE OSTI2024

U.S. Freight Transload Facilities Dataset

The U.S. Freight Transload Facilities Dataset provides location information (latitude, longitude, zip, city, county, state)for more than 9,000 facilities across 50 U.S. States where freight may be transferred between waterways, railways, and roadways. The dataset lists the known modes and available direction(s) for freight transfers at each facility as of 2024. The U.S. Freight Transload Facilities dataset was built by mining and fusing several public sources, such as the USACE Master Docks Plus, the USDOT National Transportation Atlas Database (NTAD), files from the Intermodal Association of North America (IANA), and the industry publication Bulk Transloader. The dataset constitutes a key piece of a multimodal freight transportation network and routing algorithm developed by USACE-ERDC. The dataset is shared as a .csv file. The dataset is published for research purposes and should not be considered exhaustive or authoritative.

Peterson, Steven [ORNL] (ORCID:0000000287672998)↗
DOE OSTI2024

The Zwicky Transient Facility Bright Transient Survey. III. BTSbot: Automated Identification and Follow-up of Bright Transients with Deep Learning

Abstract The Bright Transient Survey (BTS) aims to obtain a classification spectrum for all bright ( m peak ≤ 18.5 mag) extragalactic transients found in the Zwicky Transient Facility (ZTF) public survey. BTS critically relies on visual inspection (“scanning”) to select targets for spectroscopic follow-up, which, while effective, has required a significant time investment over the past ∼5 yr of ZTF operations. We present BTSbot , a multimodal convolutional neural network, which provides a bright transient score to individual ZTF detections using their image data and 25 extracted features. BTSbot is able to eliminate the need for daily human scanning by automatically identifying and requesting spectroscopic follow-up observations of new bright transient candidates. BTSbot recovers all bright transients in our test split and performs on par with scanners in terms of identification speed (on average, ∼1 hr quicker than scanners). We also find that BTSbot is not significantly impacted by any data shift by comparing performance across a concealed test split and a sample of very recent BTS candidates. BTSbot has been integrated into Fritz and Kowalski , ZTF’s first-party marshal and alert broker, and now sends automatic spectroscopic follow-up requests for the new transients it identifies. Between 2023 December and 2024 May, BTSbot selected 609 sources in real time, 96% of which were real extragalactic transients. With BTSbot and other automation tools, the BTS workflow has produced the first fully automatic end-to-end discovery and classification of a transient, representing a significant reduction in the human time needed to scan.

Rehemtulla, Nabeel (ORCID:0000000256832389)↗
NASA NTRS1991

Multiple-mode reconfigurable electro-optic switching network for optical fiber sensor array

This paper reports the first switching network compatible with multimode fibers. A one-to-many cascaded reconfigurable interconnection was built. A thin glass substrate was used as the guiding medium which provides not only higher coupling efficiency from multimode fiber to waveguide but also better tolerance of phase-matching conditions. Involvement of a total-internal-reflection hologram and multimode waveguide eliminates interface problems between fibers and waveguides. The DCG polymer graft has proven to be reliable from -180 C to +200 C. Survivability of such an electrooptic system in harsh environments is further ensured. LiNbO3 was chosen as the E-O material because of its stability at high temperatures (phase-transition temperature of more than 1000 C) and maturity of E-O device technology. Further theoretical calculation was conducted to provide the optimal interaction length and device capacitance.

Chen, Ray T.↗
DOE OSTI2023

Data augmentation and multimodal learning for predicting drug response in patient-derived xenografts from gene expressions and histology images

Patient-derived xenografts (PDXs) are an appealing platform for preclinical drug studies. A primary challenge in modeling drug response prediction (DRP) with PDXs and neural networks (NNs) is the limited number of drug response samples. We investigate multimodal neural network (MM-Net) and data augmentation for DRP in PDXs. The MM-Net learns to predict response using drug descriptors, gene expressions (GE), and histology whole-slide images (WSIs). We explore whether combining WSIs with GE improves predictions as compared with models that use GE alone. We propose two data augmentation methods which allow us training multimodal and unimodal NNs without changing architectures with a single larger dataset: 1) combine single-drug and drug-pair treatments by homogenizing drug representations, and 2) augment drug-pairs which doubles the sample size of all drug-pair samples. Unimodal NNs which use GE are compared to assess the contribution of data augmentation. The NN that uses the original and the augmented drug-pair treatments as well as single-drug treatments outperforms NNs that ignore either the augmented drug-pairs or the single-drug treatments. In assessing the multimodal learning based on the MCC metric, MM-Net outperforms all the baselines. Our results show that data augmentation and integration of histology images with GE can improve prediction performance of drug response in PDXs.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Multimodal Freight Energy Model for Emerging Freight Technology Analysis

While freight movement represents a small portion of the volume in the transportation sector, they are a critical contributor for energy consumed in that sector. To reduce logistics costs, energy consumption and negative environmental impact, emerging technologies, such as digitalization of logistics and alternative powertrain, have been developed and extended applications in freight. These trends are expected to grow and provide opportunities for greater efficiencies in freight movement and corresponding energy use. Still, the complexity of freight systems present challenges in evaluating these benefits, especially in the multimodal inter-city freight. Addressing the research need, this paper develops a multimodal freight energy modeling framework for the analysis of emerging freight technology scenarios. The framework is a bi-level optimization problem: network cost minimization problem (lower-level) and energy minimization problem (upper-level). The lower-level problem is a mode-path assignment problem in multimodal inter-city freight networks, where commodity-specific congestion effects on trans-shipment links are considered. For this model, an inverse modeling approach is applied to infer parameters of the lower-level model. The upper-level problem is designed to search for an optimal scenario that has the lowest energy consumption among different levels of technology applications. The proposed model is empirically tested to analyze truck load-pooling and multimodal load-pooling scenarios through stand-alone and mixed applications using freight shipments originating from or destined to the Chicago region. This framework can be used to explore the impact of emerging freight technologies on mode-path freight flow and energy consumption in the national multimodal freight network.

ADVANCED PROPULSION SYSTEMS↗
NASA NTRS1986

Optical fiber characteristics and standards; Proceedings of the Meeting, Cannes, France, November 25-27, 1985

Papers are presented on outside vapor deposition, the plasma activated CVD process for large scale production of telecommunication fibers, axial lateral plasma deposition technology from plastic clad silica, coatings for optical fibers, primary coating characterization, and radiation-induced time dependent attenuation in a fiber. Topics discussed include fibers with high tensile strength, the characteristics and specifications of airborne fiber optic components, the baseband frequency response of multimode fibers, and fibers for local and broadband networks. Consideration is given to industrial measurements for single mode and multimode fibers, the characterization of source power distribution in a multimode fiber by a splice offset technique, the measurement of chromatic dispersion in a single mode optical, and the effect of temperature on the refracted near-field optical fiber profiling technique.

Bouillie, Remy↗
DOE OSTI2023

Large-scale cascading of first-order FBG array in a highly multimode coreless fiber using femtosecond laser for distributed thermal sensing

This research focuses on the performance analysis and characterization of a fiber Bragg gratings (FBGs) array, consisting of 10 first-order FBGs inscribed by a femtosecond (FS) laser in a highly multimode coreless fiber. The study evaluates the FBG array's ability to function as a distributed thermal sensing (DTS) platform, with the coreless fiber chosen as the sensing element due to its immunity to dopant migration at high temperatures. The design of a large cascaded first-order FBG array effectively eliminates unwanted harmonic peaks across a wide spectrum range. In contrast, higher-order FBGs introduce limitations due to the overlapping of Bragg peaks with harmonics. The FBG array's performance is evaluated by measuring the reflection spectrum of each grating at different temperatures, showing a high temperature sensitivity of 15.05 pm/°C at a Bragg wavelength of 1606.3 nm, with a linear response in the temperature range of 24 - 1100 °C. The FBG array was designed for a spatial resolution of 5 mm. A mode scrambler in the sensing network is employed, which suppresses multimodal interference, characterizes FBG peak visibility, and stabilizes the interference spectrum. The stability of the FBG array is also assessed over 24 hrs at 1100 °C, and it is observed to be stable during thermal treatment. Heat treatment at 1100°C improves the signal to noise ratio of the FBG array, demonstrating the robustness and suitability of the proposed FBG array on highly multimode coreless fiber as a potential sensing platform for DTS applications in harsh environmental conditions, overcoming the issues of dopant migration presented by dopes silica optical fibers at high temperatures.

47 OTHER INSTRUMENTATION↗
DOE OSTI2026

Neural-Network-Enhanced COTSIM: Advancing Predictive Capabilities for Fast DIII-D Simulations

Sustaining fusion reactions in tokamaks requires heating plasma to thermonuclear temperatures while maintaining confinement and stability. Neutral beam injection (NBI) provides heating, current drive, torque, and fueling, while electron cyclotron (EC) waves are widely used for heating and current drive; together, these actuators shape the plasma current, temperature, and density profiles. The control-oriented tokamak simulator (COTSIM), a predictive, control-oriented code, has been enhanced with neural-network surrogates for transport and sources. Turbulent transport is predicted by MMMnet—a neural-network version of the updated multimode model (MMM 9.0.10)—with significantly reduced computation time relative to MMM; neoclassical transport follows the Chang–Hinton model. NUBEAMnet, a surrogate of the Monte Carlo NUBEAM module, predicts beam-driven heating, current, and torque. EC heating and current drive use a control-oriented, empirically scaled source model; plasma resistivity follows the Spitzer formulation; bootstrap current uses the Sauter model. Equilibrium is computed using both prescribed and fixed-boundary solvers (FBSs), and the pedestal structure is modeled with an empirical pedestal model. For a representative DIII-D discharge, COTSIM predicts electron and ion temperature and safety-factor profiles in close agreement with TRANSP predictive and interpretive simulations while extending predictions through the pedestal region to the plasma edge (versus 80% of the minor radius in TRANSP). Furthermore, the equivalent COTSIM simulation runs in under 3 min compared to about 2 h for TRANSP, enabling rapid scenario planning, optimization of tokamak operation, and between-pulse control design.

Control-oriented tokamak simulator (COTSIM)↗
DOE OSTI2023

Direct Visualization of Charge Migration in Bilayer Tantalum Oxide Films by Multimodal Imaging

Inspired by biological neuromorphic computing, artificial neural networks based on crossbar arrays of bilayer tantalum oxide memristors have shown to be promising alternatives to conventional complementary metal-oxide-semiconductor (CMOS) architectures. In order to understand the driving mechanism in these oxide systems, tantalum oxide films are resistively switched by conductive atomic force microscopy (C-AFM), and subsequently imaged by kelvin probe force microscopy (KPFM) and spatially resolved time-of-flight secondary ion mass spectrometry (ToF-SIMS). These workflows enable induction and analysis of the resistive switching mechanism as well as control over the resistively switched region of the film. In this work it is shown that the resistive switching mechanism is driven by both current and electric field effects. Reversible oxygen motion is enabled by applying low (<1 V) electric fields, while high electric fields generate irreversible breakdown of the material (>1 V). Fully understanding oxygen motion and electrical effects in bilayer oxide memristor systems is a fundamental step toward the adoption of memristors as a neuromorphic computing technology.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Scalable algorithms for physics-informed neural and graph networks

Physics-informed machine learning (PIML) has emerged as a promising new approach for simulating complex physical and biological systems that are governed by complex multiscale processes for which some data are also available. In some instances, the objective is to discover part of the hidden physics from the available data, and PIML has been shown to be particularly effective for such problems for which conventional methods may fail. Unlike commercial machine learning where training of deep neural networks requires big data, in PIML big data are not available. Instead, we can train such networks from additional information obtained by employing the physical laws and evaluating them at random points in the space–time domain. Such PIML integrates multimodality and multifidelity data with mathematical models, and implements them using neural networks or graph networks. Here, we review some of the prevailing trends in embedding physics into machine learning, using physics-informed neural networks (PINNs) based primarily on feed-forward neural networks and automatic differentiation. For more complex systems or systems of systems and unstructured data, graph neural networks (GNNs) present some distinct advantages, and here we review how physics-informed learning can be accomplished with GNNs based on graph exterior calculus to construct differential operators; we refer to these architectures as physics-informed graph networks (PIGNs). We present representative examples for both forward and inverse problems and discuss what advances are needed to scale up PINNs, PIGNs and more broadly GNNs for large-scale engineering problems.

42 ENGINEERING↗
DOE OSTI2025

An Efficient Storage-Driven Machine Learning Model for Performance in the Era of Multimodal Scientific Data

Scientific workflows are increasingly relying on machine learning (ML), simulation, and hybrid techniques to predict, understand, and optimize the behavior of complex experiments. High-performance computing has greatly improved researchers’ ability to acquire diverse data modalities in these workflows. Recent studies suggest that the performance of machine learning models can be improved by integrating data from various sources. Unfortunately, these workloads pose unprecedent pressure on the network storage to meet the demands associated with accessing these multimodal data. To mitigate the impact of intensive IO, we propose a solution that utilizes a multi-tier High-Performance Computing (HPC) distributed storage and data processing framework, placing computation where the data resides for better performance. By adopting this project, the scientific community will gain new opportunities to explore multimodal storage-driven possibilities, integrating multiple scientific data sources with advanced streaming frameworks. Additionally, our framework effectively utilizes computing resources and bridges the gaps identified by HPC experts. Our proposed approach tackles scalability and persistence challenges by leveraging native persistency, which has posed difficulties in traditional approaches. Furthermore, we seek to enhance fault-tolerance and load-balance of computations by leveraging real-time streaming in diverse scientific computing environments, thereby propelling advanced scientific computing research into the next generation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Deep Learning on Multimodal Chemical and Whole Slide Imaging Data for Predicting Prostate Cancer Directly from Tissue Images

Prostate cancer is one of the most common cancers globally and is the second most common cancer in the male population in the US. Here we develop a study based on correlating the hematoxylin and eosin (H&E)-stained biopsy data with MALDI mass-spectrometric imaging data of the corresponding tissue to determine the cancerous regions and their unique chemical signatures and variations of the predicted regions with original pathological annotations. We obtain features from high-resolution optical micrographs of whole slide H&E stained data through deep learning and spatially register them with mass spectrometry imaging (MSI) data to correlate the chemical signature with the tissue anatomy of the data. We then use the learned correlation to predict prostate cancer from observed H&E images using trained coregistered MSI data. This multimodal approach can predict cancerous regions with ~80% accuracy, which indicates a correlation between optical H&E features and chemical information found in MSI. Further, we show that such paired multimodal data can be used for training feature extraction networks on H&E data which bypasses the need to acquire expensive MSI data and eliminates the need for manual annotation saving valuable time. Two chemical biomarkers were also found to be predicting the ground truth cancerous regions. This study shows promise in generating improved patient treatment trajectories by predicting prostate cancer directly from readily available H&E-stained biopsy images aided by coregistered MSI data.

60 APPLIED LIFE SCIENCES↗
NASA NTRS2000

Optimization of Connector Position Offset for Bandwidth Enhancement of a Multimode Optical Fiber Link

The multimode fiber bandwidth enhancement techniques to meet the Gigabit Ethernet standards for local area networks (LAN) of the Kennedy Space Center and other NASA centers have been discussed. Connector with lateral offset coupling between single mode launch fiber cable and the multimode fiber cable has been thoroughly investigated. An optimization of connector position offset for 8 km long optical fiber link at 1300 nm with 9 micrometer diameter single mode fiber (SMF) and 50 micrometer diameter multimode fiber (MMF) coupling has been obtained. The optimization is done in terms of bandwidth, eye-pattern, and bit pattern measurements. It is simpler, is a highly practical approach and is cheaper as no additional cost to manufacture the offset type of connectors is involved.

Rawat, Banmali↗
NASA NTRS2020

NASA Next-Generation Sensing Technologies for Earth & Planetary Science

Dr. Ved Chirayath's seminar will highlight new sensing technologies and airborne platforms he is developing for Earth & Space Science as director of the NASA Silicon Valley Laboratory for Advanced Sensing. His talk will feature recent work on Fluid Lensing, the first remote sensing technology capable of imaging through ocean waves in 3D at sub-cm resolutions, MiDAR, a next-generation active hyperspectral remote sensing and optical communications instrument, airborne gas sensing of multipollutant combustion sources, and a plasma actuated unmanned aerial vehicle (UAV) that utilized high-voltage dielectric discharge devices to achieve the first plasma controlled flight in history.Fluid Lensing and the NASA FluidCam instrument have been used extensively to provide distortion-free 3D multispectral imagery from UAVs of shallow marine systems around the world. MiDAR is being deployed on aircraft and underwater remotely operated vehicles (ROVs) as a new method to remotely sense living and nonliving structures in extreme environments as an analog for future Ocean Worlds robotic exploration missions. Finally, Chirayath will present preliminary results from NeMO-Net, a supercomputer-based neural network that uses a citizen science video game for global multimodal coral reef benthic habitat mapping, fusing remote sensing data from Fluid Lensing, MiDAR, NASA's Earth Observing System, and commercial satellites, to better understand the present and past dynamics of shallow marine systems. Together, these maturing technologies present promising new ways in which to explore terrestrial, marine, and aerial systems on Earth, and, ultimately, aid in the search for extraterrestrial life within our solar system and beyond.

Chirayath, Ved↗
DOE OSTI2023

Multimodal representation learning for predicting molecule–disease relations

Motivation: Predicting molecule–disease indications and side effects is important for drug development and pharmacovigilance. Comprehensively mining molecule–molecule, molecule–disease and disease–disease semantic dependencies can potentially improve prediction performance. Methods: We introduce a Multi-Modal REpresentation Mapping Approach to Predicting molecular-disease relations (M2REMAP) by incorporating clinical semantics learned from electronic health records (EHR) of 12.6 million patients. Specifically, M2REMAP first learns a multimodal molecule representation that synthesizes chemical property and clinical semantic information by mapping molecule chemicals via a deep neural network onto the clinical semantic embedding space shared by drugs, diseases and other common clinical concepts. To infer molecule–disease relations, M2REMAP combines multimodal molecule representation and disease semantic embedding to jointly infer indications and side effects. Results: We extensively evaluate M2REMAP on molecule indications, side effects and interactions. Results show that incorporating EHR embeddings improves performance significantly, for example, attaining an improvement over the baseline models by 23.6% in PRC-AUC on indications and 23.9% on side effects. Further, M2REMAP overcomes the limitation of existing methods and effectively predicts drugs for novel diseases and emerging pathogens. Availability and implementation: The code is available at https://github.com/celehs/M2REMAP, and prediction results are provided at https://shiny.parse-health.org/drugs-diseases-dev/.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

High spatial resolution neutron imaging of lithium-ion batteries: Correlating microstructure and lithium transport

Thick electrodes for lithium-ion batteries can increase the overall energy density, but increasing the electrode thickness introduces charge transport limitations. These limitations may be mitigated through proper electrode structuring. Here, high spatial resolution neutron imaging was used to understand the correlation between microstructure and lithium transport in lithium-ion anodes. Batteries with distinct graphite anode microstructures were produced and studied with high spatial resolution in operando neutron radiography to observe the effects of structure on transport. High spatial resolution neutron computed tomography was performed following in operando neutron radiography. X-ray computed tomography and scanning electron microscopy were used to observe the finer scale anode structure to complement neutron imaging. Solvent-free anodes containing a tightly-packed layered structure confined lithium movement close to the separator. This structure limited capacity, but supported better rate capability. Conversely, a more open pore structure in the wet cast anodes yielded higher capacity with reduced rate capability. Together, these results show that lithium distributions can be controlled by the macroscopic structure of the electrodes, the microstructural pore network, and the microscale active areas that support electrochemical reactions. Furthermore, multimodal imaging applying the complementary strengths of neutron and X-ray methods is shown as a tool for advancing battery design.

25 ENERGY STORAGE↗