SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Reviews the development of a multimode space weather system. The system assimilates a range of ionospheric, electrodynamic and thermospheric data models.
Proteins play a vital role in different biological processes by forming complexes through precise folding with exclusive inter- and intra-molecular interactions. Understanding the structural and regulatory mechanisms underlying protein complex formation provides insights into biophysical processes. Furthermore, the principle of protein assembly gives guidelines for new biomimetic materials with potential applications in medicine, energy, and nanotechnology. Atomic force microscopy (AFM) is a powerful tool for investigating protein assembly and interactions across spatial scales (single molecules to cells) and temporal scales (milliseconds to days). It has significantly contributed to understanding nanoscale architectures, inter- and intra-molecular interactions, and regulatory elements that determine protein structures, assemblies, and functions. This review describes recent advancements in elucidating protein assemblies with in situ AFM. We discuss the structures, diffusions, interactions, and assembly dynamics of proteins captured by conventional and high-speed AFM in near-native environments and recent AFM developments in the multimodal high-resolution imaging, bimodal imaging, live cell imaging, and machine-learning-enhanced data analysis. These approaches show the significance of broadening the horizons of AFM and enable unprecedented explorations of protein assembly for biomaterial design and biomedical research.
Advanced materials that maintain their mechanical performance under elevated temperatures, corrosive environments, and a range of static and evolving stresses are needed to improve the efficiency and reduce the environmental impact of a wide spectrum of energy technologies. For instance, cost-efficient alloys that can withstand high temperatures (e.g., 700 °C) have a critical role in improving the efficiency and economics of power generation to support decarbonization of the energy sector; such is true of both the nuclear and fossil energy sectors. Considering both the threats of the energy crisis, namely soaring costs of greenhouse gas emission-producing energy and climate change, it is essential to increase the pace of material discovery and enable rapid paths for material qualification to advance clean energy technologies. Conventionally, alloy development has followed a slow Edisonian process that uses repeated cycles of making, characterizing, and modifying to arrive at optimum composition and processing conditions to achieve the desired component performance. This optimization is followed by the necessary stepwise materials qualification. Furthermore, the increasing adoption of sound data management and physics-informed machine learning represents the next step in the acceleration of materials design and development. In the integrated computational materials engineering (ICME) approach, computational modeling and simulation data from different length and time scales can be combined with complex microstructural details from multimodal experimental characterization and selective property testing to close the design loop for rapid alloy development.
Instruction finetuning is a popular paradigm to align large language models (LLM) with human intent. Despite its popularity, this idea is less explored in improving the LLMs to align existing foundation models with scientific disciplines, concepts and goals. In this work, we present SciTune as a tuning framework to improve the ability of LLMs to follow scientific multimodal instructions. To test our methodology, we use a human-generated scientific instruction tuning dataset and train a large multimodal model LLaMA-SciTune that connects a vision encoder and LLM for science-focused visual and language understanding. LLaMA-SciTune significantly outperforms the state-of-the-art models in the generated figure types and captions in multiple scientific multimodal benchmarks. In comparison to the models that are fine-tuned with machine generated data only, LLaMA-SciTune surpasses human performance on average and in many sub-categories on the ScienceQA benchmark.
Theoretical understanding of the dependence of sea state bias (SSB) on wind wave conditions has been achieved only for the case of a unidirectional wind-driven sea. Recent analysis of Geosat and TOPEX altimeter data showed that additional factors, such as swell, ocean currents, and complex directional properties of realistic wave fields, may influence SSB behavior. Here we investigate effects of two-dimensional multimodal wave spectra using a numerical model of radar reflection from a random, non-Gaussian surface. A recently proposed ocean wave spectrum is employed to describe sea surface statistics. The following findings appear to be of particular interest: (1) Sea swell has an appreciable effect in reducing the SSB coefficient compared with the pure wind sea case but has less effect on the actual SSB owing to the corresponding increase in significant wave height. (2) Hidden multimodal structure (the two-dimensional wavenumber spectrum contains separate peaks, for swell and wind seas, while the frequency spectrum looks unimodal) results in an appreciable change of SSB. (3) For unimodal, purely wind-driven seas, the influence of the angular spectral width is relatively unimportant; that is, a unidirectional sea provides a good qualitative model for SSB if the swell is absent. (4) The pseudo wave age is generally much better fo parametrization the SSB coefficient than the actual wave age (which is ill-defined for a multimodal sea) or wind speed. (5) SSB can be as high as 5% of the significant wave height, which is significantly greater than predicted by present empirical model functions tuned on global data sets. (6) Parameterization of SSB in terms of wind speed is likely to lead to errors due to the dependence on the (in practice, unknown) fetch.
Reliable real-time monitoring is valuable for maintaining the operational integrity of modern electrical smart grids. Deployment of heterogeneous sensing technologies in substations has enabled high-resolution, multichannel waveform monitoring, but also introduces challenges for anomaly detection due to noise, baseline drift, and modality-dependent signal characteristics. In this work, we present a computationally efficient unsupervised method for multimodal event detection based on Rolling Root Mean Square based Event Detection (RRMSED). The method is developed using in-house, field deployed sensors collecting data at a utility substation. The sensing system comprises voltage and current sensors, triaxial accelerometers, and magnetometers, collectively capturing electrical, vibrational, and magnetic waveform measurements at high temporal resolution. RRMSED operates by extracting rolling RMS energy features and their first-order temporal differences from consecutive waveform segments for each channel and then applying channel-specific statistical thresholds learned from historical data. A persistence-based exceedance logic is employed to robustly identify transient events while suppressing impulsive noise, and to provide precise temporal localization with high resolution. The framework is designed for continuous server-side operation and can be deployed in real time without requiring complex models. Experiments on simulated waveform data with known ground truth demonstrate low false positive (FP) and false negative (FN) rates. Application to real substation data shows RRMSED to identify events that are not captured by conventional monitoring indicators including fast transient detection algorithm currently deployed in the system. These results indicate that rolling RMS based features provide an effective and practical basis for real-time multimodal event detection in smart-grid substations.
Exponential growth of data from Earth Observation (EO) assets has necessitated the development of sophisticated methods for data interpretation and management. NASA’s New Observing Strategy (NOS) approach aims to coordinate operations among complex heterogenous systems of constellations, requiring advanced Artificial Intelligence and Machine Learning (AI/ML) techniques. Despite significant advancements in AI/ML across various domains, the EO and machine learning for satellite (SatML) fields remain fragmented, often relying on adapted techniques rather than domain-specific solutions. We present a novel end-to-end data fusion framework tailored specifically for EO and SatML, addressing this gap by facilitating rapid development of AI/ML applications. This framework, called, Multimodal Earth Observation Workflow for Machine Learning (MEOW-ML), sup- ports the entire AI/ML lifecycle, from dataset manipulation, to model training, evaluation, and logging, and is designed to expedite the development of next-generation NOS deployments and SOTA in EO. We apply our framework to predict canopy height model (CHM) derived from lidar data. We integrate multiple data modalities through a hierarchical, multi-path model architecture, effectively identifying and leveraging the unique strengths of each data source to enhance predictive accuracy. Our experiments demonstrate that the multi-path architecture outperforms traditional single-path models and provides significant advantages in both accuracy and computational efficiency.
The multimodal friction ignition tester (MFIT) is a testbed for experiments on the thermal and mechanical effects of friction on material specimens in pressurized, oxygen-rich atmospheres. In simplest terms, a test involves recording sensory data while rubbing two specimens against each other at a controlled normal force, with either a random stroke or a sinusoidal stroke having controlled amplitude and frequency. The term multimodal in the full name of the apparatus refers to a capability for imposing any combination of widely ranging values of the atmospheric pressure, atmospheric oxygen content, stroke length, stroke frequency, and normal force. The MFIT was designed especially for studying the tendency toward heating and combustion of nonmetallic composite materials and the fretting of metals subjected to dynamic (vibrational) friction forces in the presence of liquid oxygen or pressurized gaseous oxygen test conditions approximating conditions expected to be encountered in proposed composite material oxygen tanks aboard aircraft and spacecraft in flight. The MFIT includes a stainless-steel pressure vessel capable of retaining the required test atmosphere. Mounted atop the vessel is a pneumatic cylinder containing a piston for exerting the specified normal force between the two specimens. Through a shaft seal, the piston shaft extends downward into the vessel. One of the specimens is mounted on a block, denoted the pressure block, at the lower end of the piston shaft. This specimen is pressed down against the other specimen, which is mounted in a recess in another block, denoted the slip block, that can be moved horizontally but not vertically. The slip block is driven in reciprocating horizontal motion by an electrodynamic vibration exciter outside the pressure vessel. The armature of the electrodynamic exciter is connected to the slip block via a horizontal shaft that extends into the pressure vessel via a second shaft seal. The reciprocating horizontal motion can be chosen to be random with a flat spectrum over the frequency range of 10 Hz to 1 kHz, or to be sinusoidal at any peak-to-peak amplitude up to 0.8 in. (.2 cm) and fixed or varying frequency up to 1 kHz. The temperatures of the specimen and of the vessel are measured by thermocouples. A digital video camera mounted outside the pressure vessel is aimed into the vessel through a sapphire window, with its focus fixed on the interface between the two specimens. A position transducer monitors the displacement of the pneumatic-cylinder shaft. The pressure in the vessel is also monitored. During a test, the output of the video camera, the temperatures, and the pneumatic-shaft displacement are monitored and recorded. The test is continued for a predetermined amount of time (typically, 10 minutes) or until either (1) the output of the position transducer shows a sudden change indicative of degradation of either or both specimens, (2) ignition or another significant reaction is observed, or (3) pressure in the vessel increases beyond a pre-set level that triggers an automatic shutdown.
Abstract Although metabolic syndrome (MetS) is linked to an elevated risk of cardiovascular disease (CVD), the cardiac-specific risk mechanism is unknown. Obesity, hypertension, and diabetes (all MetS components) are the most common form of CVD and represent risk factors for worse COVID-19 outcomes compared to their non MetS peers. Here, we use obese Yorkshire pigs as a highly relevant animal model of human MetS, where pigs develop the hallmarks of human MetS and reproducibly mimics the myocardial pathophysiology in patients. Myocardium-specific mass spectroscopy-derived metabolomics, proteomics, and transcriptomics enabled the identity and quality of proteins and metabolites to be investigated in the myocardium to greater depth. Myocardium-specific deregulation of pro-inflammatory markers, propensity for arterial thrombosis, and platelet aggregation was revealed by computational analysis of differentially enriched pathways between MetS and control animals. While key components of the complement pathway and the immune response to viruses are under expressed, key N6-methyladenosin RNA methylation enzymes are largely overexpressed in MetS. Blood tests do not capture the entirety of metabolic changes that the myocardium undergoes, making this analysis of greater value than blood component analysis alone. Our findings create data associations to further characterize the MetS myocardium and disease vulnerability, emphasize the need for a multimodal therapeutic approach, and suggests a mechanism for observed worse outcomes in MetS patients with COVID-19 comorbidity.
Capturing complete internal anatomies of plant organs and tissues within their relevant morphological context remains a key challenge in plant science. While plant growth and development are inherently multiscale, conventional light, fluorescence, and electron microscopy platforms are typically limited to imaging of plant microstructure from small flat samples that lack a direct spatial context to, and represent only a small portion of, the relevant plant macrostructures. We demonstrate technical advances with a lab-based X-ray microscope (XRM) that bridge the imaging gap by providing multiscale high-resolution three-dimensional (3D) volumes of intact plant samples from the cell to the whole plant level. Serial imaging of a single sample is shown to provide sub-micron 3D volumes co-registered with lower magnification scans for explicit contextual reference. High-quality 3D volume data from our enhanced methods facilitate sophisticated and effective computational segmentation. Advances in sample preparation make multimodal correlative imaging workflows possible, where a single resin-embedded plant sample is scanned via XRM to generate a 3D cell-level map, and then used to identify and zoom in on sub-cellular regions of interest for high-resolution scanning electron microscopy. In total, we present the methodologies for use of XRM in the multiscale and multimodal analysis of 3D plant features using numerous economically and scientifically important plant systems.
This paper addresses two challenges in Bayesian calibration: 1) computational speed of existing sampling algorithms, and 2) calibration with spatio-temporal responses. The commonly used Markov Chain Monte Carlo (MCMC) approaches require many sequential model evaluations making the computational expense prohibitive. This paper proposes an efficient sampling algorithm: iterative importance sampling with genetic algorithm (IISGA). While iterative importance sampling enables computational efficiency, the genetic algorithm enables robustness by preventing sample degeneration and avoids getting stuck in multimodal search spaces. An inflated likelihood further enables robustness in high-dimensional parameter spaces by enlarging the target distribution. Spatio-temporal data complicate both surrogate modeling, which is necessary for expensive computational models, and the likelihood estimation. In this work, singular value decomposition is investigated for reducing the high-dimensional field data to a lower-dimensional space prior to Bayesian calibration. Then the likelihood is formulated and Bayesian inference is performed in the lower-dimension, latent space. An illustrative example is provided to demonstrate IISGA relative to existing sampling methods, and then IISGA is employed to calibrate a thermal battery model with 26 uncertain calibration parameters and spatio-temporal response data.
A number of optical communication lines are now in use at the Kennedy Space Center (KSC) for the transmission of voice, computer data, and video signals. Presently, all of these channels utilize a single carrier wavelength centered near 1300 nm. The theoretical bandwidth of the fiber far exceeds the utilized capacity. Yet, practical considerations limit the usable bandwidth. The fibers have the capability of transmitting a multiplicity of signals simultaneously in each of two separate bands (1300 and 1550 nm). Thus, in principle, the number of transmission channels can be increased without installing new cable if some means of wavelength division multiplexing (WDM) can be utilized. The main goal of these experiments was to demonstrate that a factor of 2 increase in bandwidth utilization can share the same fiber in both a unidirectional configuration and a bidirectional mode of operation. Both signal and multimode fiber are installed at KSC. The great majority is multimode; therefore, this effort concentrated on multimode systems.
A number of optical communication lines are now in use at NASA-Kennedy for the transmission of voice, computer data, and video signals. Now, all of these channels use a single carrier wavelength centered near 1300 or 1550 nm. Engineering tests in the past have given indications of the growth of systematic and random noise in the RF spectrum of a fiber network as the number of connector pairs is increased. This noise seems to occur when a laser transmitter is used instead of a LED. It has been suggested that the noise is caused by back reflections created at connector fiber interfaces. Experiments were performed to explore the effect of reflection on the transmitting laser under conditions of reflective feedback. This effort included computer integration of some of the instrumentation in the fiber optic lab using the Lab View software recently acquired by the lab group. The main goal was to interface the Anritsu Optical and RF spectrum analyzers to the MacIntosh II computer so that laser spectra and network RF spectra could be simultaneously and rapidly acquired in a form convenient for analysis. Both single and multimode fiber is installed at Kennedy. Since most are multimode, this effort concentrated on multimode systems.
The Fe/Gd multilayer system hosts a number of magnetic phases, such as stripe, mixed stripe and skyrmion, skyrmion lattice, and isolated skyrmions for a wide range of temperature and magnetic field. We report different Hall transport signals in a Fe/Gd system through multimodal correlative resonant soft x-ray scattering (RSXS), Hall effect, magneto-optic Kerr effect, and transmission x-ray microscopy measurements. The simultaneous nature of the RSXS and Hall transport measurements allowed us to accurately connect various features in the transport data with the specific magnetic phases. We found that the topological Hall effect (THE) shows peaks with opposite signs, which we attribute to two different mechanisms. Our multimodal correlative study indicates that the sign reversal in THE occurs when the system transforms to and from a skyrmion lattice and low density isolated skyrmion phases. We propose that the skyrmion lattice contributes to the THE through a Berry phase induced emergent magnetic field mechanism in one case, and a skew scattering mechanism corresponding to the isolated low density skyrmion state.
Abstract Multimodal in-situ experiments are the wave of the future, as this approach will permit multispectral data collection and analysis during real-time nanoscale observation. In contrast, the evolution of technique development in the electron microscopy field has generally trended toward specialization and subsequent bifurcation into more and more niche instruments, creating a challenge for reintegration and backward compatibility for in-situ experiments on state-of-the-art microscopes. We do not believe this to be a requirement in the field; therefore, we propose an adaptive instrument that is designed to allow nearly simultaneous collection of data from aberration-corrected transmission electron microscopy (TEM), probe-corrected scanning transmission electron microscopy, ultrafast TEM, and dynamic TEM with a flexible in-situ testing chamber, where the entire instrument can be modified as future technologies are developed. The value would be to obtain a holistic understanding of the underlying physics and chemistry of the process-structure–property relationships in materials exposed to controlled extreme environments. Such a tool would permit the ability to explore, in-situ, the active reaction mechanisms in a controlled manner emulating those of real-world applications with nanometer and nanosecond resolution. If such a powerful tool is developed, it has the potential to revolutionize our materials understanding of nanoscale mechanisms and transients. Graphical Abstract
Abstract The Bright Transient Survey (BTS) aims to obtain a classification spectrum for all bright ( m peak ≤ 18.5 mag) extragalactic transients found in the Zwicky Transient Facility (ZTF) public survey. BTS critically relies on visual inspection (“scanning”) to select targets for spectroscopic follow-up, which, while effective, has required a significant time investment over the past ∼5 yr of ZTF operations. We present BTSbot , a multimodal convolutional neural network, which provides a bright transient score to individual ZTF detections using their image data and 25 extracted features. BTSbot is able to eliminate the need for daily human scanning by automatically identifying and requesting spectroscopic follow-up observations of new bright transient candidates. BTSbot recovers all bright transients in our test split and performs on par with scanners in terms of identification speed (on average, ∼1 hr quicker than scanners). We also find that BTSbot is not significantly impacted by any data shift by comparing performance across a concealed test split and a sample of very recent BTS candidates. BTSbot has been integrated into Fritz and Kowalski , ZTF’s first-party marshal and alert broker, and now sends automatic spectroscopic follow-up requests for the new transients it identifies. Between 2023 December and 2024 May, BTSbot selected 609 sources in real time, 96% of which were real extragalactic transients. With BTSbot and other automation tools, the BTS workflow has produced the first fully automatic end-to-end discovery and classification of a transient, representing a significant reduction in the human time needed to scan.
SIR-C represents a significant advance in spaceborne SAR system capabilities. The design approach is responsive to the requirements identified by the Science Steering Committee. This multimode feature of the sensor will provide science investigators with new dimensions in acquiring and interpreting scientific data. The flexibility of the SIR-C design will provide a core instrument which will meet the needs of SAR data users into the 1990's and serve as a foundation for ultimate incorporation into the EOS platform.
NASA's Moon to Mars Objectives outline a strategic vision for human spaceflight culminating in crewed missions to Mars. A critical component of this objective is the development of systems that are capable of being Earth-Independent Operated (EIO). A key aspect of EIO is the ability to rapidly detect, diagnose, and respond to anomalies in crew-supporting habitat and connected systems. To address this, the Dynamic Anomaly Response and Integrated Analysis (DARIA) architecture has been developed. DARIA incorporates a network of compact, wireless sensing devices called the System for Telemetry Amalgamation of Multimodal PrognosticS (STAMPS) for increased state awareness of EIO habitats. Able to perform on-the-fly data acquisition, STAMPS are connected to integrated anomaly data dashboards for crew visualization. DARIA is designed to seamlessly integrate into various off-world environments, including the International Space Station, Lunar Gateway, Artemis Base Camp, and future Mars habitats. By leveraging Commercial Off-The-Shelf (COTS) hardware, the NASA Internet of Things (NASA IoT) framework, and EIO fault detection methods, DARIA provides a cost-effective and adaptable solution for anomaly detection and response in EIO habitats.