Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “multimodal data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Magellan imaging radar mission to Venus

The Magellan imaging-radar mapping mission has collected and processed data from the spacecraft in an elliptical orbit around Venus. A brief description is given of the mission and the spacecraft, followed by a more detailed description of the radar system design, which used earth-orbiting SAR experience and several innovations in its design to operate from an orbit around another planet. The radar sensor, ground processing, and data products are described. This multimode radar is the only science instrument on the mission and has the objective of mapping at least 70 percent of the planet surface. It has three modes: SAR, altimetry, and passive radiometry. The radar system has produced maps of almost all of the Venusian surface with a resolution better than 600-m equivalent optical line pair, and the best resolution obtained is equivalent to less than 300 m. Some of the early radar images are shown.

Johnson, William T. K.↗

AI Foundation Models for Science: An Open Collaborative Initiative

Foundation Models (FMs), AI models designed to replace task-specific models, are increasingly being recognized for their versatility across numerous downstream applications. These models, trained using self-supervised techniques on any type of sequence data, circumvent the need for large annotated datasets, a major bottleneck in traditional AI model development. FMs can be applied to downstream tasks using few-shot learning and fine-tuning, significantly reducing the need for large labeled training datasets and computational resources. However, the development of FMs requires substantial resources, including access to data and compute power, expertise in the latest models, and specialized scientific knowledge for systematic evaluation. It is challenging for a single group to possess all these capabilities. To address this, NASA IMPACT has initiated an open collaborative effort, leveraging partnerships with the private sector and other groups within and outside NASA, to jointly build FMs. The overarching goal is to develop a consistent and collaborative approach to building FMs for high-value science datasets. This initiative has fostered collaboration within NASA and with external partners, including IBM Research, Clark University, DOE’s ORNL, ESA, and USGS. The effort focuses on identifying key datasets with a wide range of downstream applications, pretraining and building FMs using modified transformer architectures, evaluating compute infrastructure needs, and sharing models, pretraining and fine-tuning code, and data with the community. Furthermore, it aims to train the Earth science community to fine-tune these models for various downstream applications. Our initial effort resulted in the creation of a 100 million parameter HLS Geospatial Model within six months, which was released on HuggingFace. We are now expanding our scope to include data from weather and climate models and investigating multimodal models. We invite those interested in participating in this effort to join us by sharing their use cases, expertise, or data.

Rahul Ramachandran↗

THz dichroic plates for use at high angles of incidence

The design of a high frequency dichroic plate consisting of an electrically thick self supporting metallic mesh that can be used in a linearly polarized quasi-optical system at high angles of incidence is described. The measured and computed performance of a 2.5-inch aperture mesh is given. This mesh has a 3-dB cutoff frequency of 875 GHz and less than 0.75 dB of transmission loss from 950-1350 GHz at incidence angles of 0, 30, and 45 degrees. The results of a multimode waveguide analysis corroborate the measured data.

Siegel, Peter H.↗

A least-squares parameter estimation algorithm for switched hammerstein systems with applications to the VOR

A "Multimode" or "switched" system is one that switches between various modes of operation. When a switch occurs from one mode to another, a discontinuity may result followed by a smooth evolution under the new regime. Characterizing the switching behavior of these systems is not well understood and, therefore, identification of multimode systems typically requires a preprocessing step to classify the observed data according to a mode of operation. A further consequence of the switched nature of these systems is that data available for parameter estimation of any subsystem may be inadequate. As such, identification and parameter estimation of multimode systems remains an unresolved problem. In this paper, we 1) show that the NARMAX model structure can be used to describe the impulsive-smooth behavior of switched systems, 2) propose a modified extended least squares (MELS) algorithm to estimate the coefficients of such models, and 3) demonstrate its applicability to simulated and real data from the Vestibulo-Ocular Reflex (VOR). The approach will also allow the identification of other nonlinear bio-systems, suspected of containing "hard" nonlinearities.

Evaluation Studies↗

Far-field radiation of aft turbofan noise

Approximate expressions were developed for the noise radiation from the aft duct. The results of approximate aft radiation equation compare favorably to more exact Wiener-Hopf radiation results. Refraction as well as convective effects in the multiple flow streams is considered. The peak in the radiation pattern, which occurs nearly at engine sideline, is composed of modes with relatively large cut-off ratios. This implies that aft fan radiation will be inherently more difficult to suppress that the fan inlet noise. The theoretical multimodal radiation pattern is compared to experimental data for the first two harmonics of blade passage frequency for three full scale fans at two speeds. The agreement between theory and experiment is quite good.

Rice, E. J.↗

Polarized View of Supercooled Liquid Water Clouds

Supercooled liquid water (SLW) clouds, where liquid droplets exist at temperatures below 0 C present a well known aviation hazard through aircraft icing, in which SLW accretes on the airframe. SLW clouds are common over the Southern Ocean, and climate-induced changes in their occurrence is thought to constitute a strong cloud feedback on global climate. The two recent NASA field campaigns POlarimeter Definition EXperiment (PODEX, based in Palmdale, California, January-February 2013) and Studies of Emissions and Atmospheric Composition, Clouds and Climate Coupling by Regional Surveys (SEAC4RS, based in Houston, Texas in August- September 2013) provided a unique opportunity to observe SLW clouds from the high-altitude airborne platform of NASA's ER-2 aircraft. We present an analysis of measurements made by the Research Scanning Polarimeter (RSP) during these experiments accompanied by correlative retrievals from other sensors. The RSP measures both polarized and total reflectance in 9 spectral channels with wavelengths ranging from 410 to 2250 nm. It is a scanning sensor taking samples at 0.8deg intervals within 60deg from nadir in both forward and backward directions. This unique angular resolution allows for characterization of liquid water droplet size using the rainbow structure observed in the polarized reflectances in the scattering angle range between 135deg and 165deg. Simple parametric fitting algorithms applied to the polarized reflectance provide retrievals of the droplet effective radius and variance assuming a prescribed size distribution shape (gamma distribution). In addition to this, we use a non-parametric method, Rainbow Fourier Transform (RFT),which allows retrieval of the droplet size distribution without assuming a size distribution shape. We present an overview of the RSP campaign datasets available from the NASA GISS website, as well as two detailed examples of the retrievals. In these case studies we focus on cloud fields with spatial features varying between glaciated and liquid phases at altitudes as high as 10 km, which correspond to temperatures close to the homogeneous freezing temperature of pure water drops (about -35 C or colder). The multimodal droplet size distributions retrieved from RSP data in these cases are consistent with the multi-layer cloud structure observed by correlative Cloud Physics Lidar (CPL) measurements.

Clouds↗

TDRS multimode transponder program. Phase 1: Design

The use of geosynchronous tracking and data relay satellites (TDRS) which can serve both low data rate users at VHF and high data rate users at other frequencies is considered. The effects of radio frequency interference from the earth and of multipath propagation due to reflections from the earth are expected to pose problems for the TDRS system at VHF. Investigations suggest several modulation techniques that offer promise to overcome these problems. This report provides a complete design of a VHF/UHF multimode transponder and its associated ground support equipment. The transponder is designed for installation aboard an aircraft and will demonstrate candidate modulation techniques to provide the required information for the design of an eventual VHF/UHF transponder suitable for installation in a user satellite, capable of operating as part of a TDRS system.

Cnossen, R. S.↗

Visualizing Distributions from Multi-Return Lidar Data to Understand Forest Structure

Spatially distributed probability density functions (pdfs) are becoming relevant to the Earth scientists and ecologists because of stochastic models and new sensors that provide numerous realizations or data points per unit area. One source of these data is from multi-return airborne lidar, a type of laser that records multiple returns for each pulse of light sent towards the ground. Data from multi-return lidar is a vital tool in helping us understand the structure of forest canopies over large extents. This paper presents several new visualization tools that allow scientists to rapidly explore, interpret and discover characteristic distributions within the entire spatial field. The major contribution from-this work is a paradigm shift which allows ecologists to think of and analyze their data in terms of the distribution. This provides a way to reveal information on the modality and shape of the distribution previously not possible. The tools allow the scientists to depart from traditional parametric statistical analyses and to associate multimodal distribution characteristics to forest structures. Examples are given using data from High Island, southeast Alaska.

Kao, David L.↗

New computer system for aircraft noise prediction

The purpose of the Aircraft Noise Prediction Office (ANOPO) at Langley Research Center is to provide a focal point for NASA's aircraft noise prediction activities and an appropriate interface with other agencies and industry. An interim prediction system is now in operation, which includes a program for source modeling leading to noise prediction for a single event, two complementary multiple event prediction programs which predict NEF contours on the basis of interpolation of noise, thrust, and altitude data, and the FAA data base for the commercial fleet. An integrated multimode aircraft noise prediction program has been designed, and a mechanism for continuously providing current prediction technology to be incorporated in the program has been implemented.

Raney, J. P.↗

Spline methods for approximating quantile functions and generating random samples

Two cubic spline formulations are presented for representing the quantile function (inverse cumulative distribution function) of a random sample of data. Both B-spline and rational spline approximations are compared with analytic representations of the quantile function. It is also shown how these representations can be used to generate random samples for use in simulation studies. Comparisons are made on samples generated from known distributions and a sample of experimental data. The spline representations are more accurate for multimodal and skewed samples and to require much less time to generate samples than the analytic representation.

Schiess, J. R.↗

Concurrent Image Processing Executive (CIPE). Volume 1: Design overview

The design and implementation of a Concurrent Image Processing Executive (CIPE), which is intended to become the support system software for a prototype high performance science analysis workstation are described. The target machine for this software is a JPL/Caltech Mark 3fp Hypercube hosted by either a MASSCOMP 5600 or a Sun-3, Sun-4 workstation; however, the design will accommodate other concurrent machines of similar architecture, i.e., local memory, multiple-instruction-multiple-data (MIMD) machines. The CIPE system provides both a multimode user interface and an applications programmer interface, and has been designed around four loosely coupled modules: user interface, host-resident executive, hypercube-resident executive, and application functions. The loose coupling between modules allows modification of a particular module without significantly affecting the other modules in the system. In order to enhance hypercube memory utilization and to allow expansion of image processing capabilities, a specialized program management method, incremental loading, was devised. To minimize data transfer between host and hypercube, a data management method which distributes, redistributes, and tracks data set information was implemented. The data management also allows data sharing among application programs. The CIPE software architecture provides a flexible environment for scientific analysis of complex remote sensing image data, such as planetary data and imaging spectrometry, utilizing state-of-the-art concurrent computation capabilities.

Lee, Meemong↗

Concurrent Image Processing Executive (CIPE)

The design and implementation of a Concurrent Image Processing Executive (CIPE), which is intended to become the support system software for a prototype high performance science analysis workstation are discussed. The target machine for this software is a JPL/Caltech Mark IIIfp Hypercube hosted by either a MASSCOMP 5600 or a Sun-3, Sun-4 workstation; however, the design will accommodate other concurrent machines of similar architecture, i.e., local memory, multiple-instruction-multiple-data (MIMD) machines. The CIPE system provides both a multimode user interface and an applications programmer interface, and has been designed around four loosely coupled modules; (1) user interface, (2) host-resident executive, (3) hypercube-resident executive, and (4) application functions. The loose coupling between modules allows modification of a particular module without significantly affecting the other modules in the system. In order to enhance hypercube memory utilization and to allow expansion of image processing capabilities, a specialized program management method, incremental loading, was devised. To minimize data transfer between host and hypercube a data management method which distributes, redistributes, and tracks data set information was implemented.

Lee, Meemong↗

Picturing Data With Uncertainty

NASA is in the business of creating maps for scientific purposes to represent important biophysical or geophysical quantities over space and time. For example, maps of surface temperature over the globe tell scientists where and when the Earth is heating up; regional maps of the greenness of vegetation tell scientists where and when plants are photosynthesizing. There is always uncertainty associated with each value in any such map due to various factors. When uncertainty is fully modeled, instead of a single value at each map location, there is a distribution expressing a set of possible outcomes at each location. We consider such distribution data as multi-valued data since it consists of a collection of values about a single variable. Thus, a multi-valued data represents both the map and its uncertainty. We have been working on ways to visualize spatial multi-valued data sets effectively for fields with regularly spaced units or grid cells such as those in NASA's Earth science applications. A new way to display distributions at multiple grid locations is to project the distributions from an individual row, column or other user-selectable straight transect from the 2D domain. First at each grid cell in a given slice (row, column or transect), we compute a smooth density estimate from the underlying data. Such a density estimate for the probability density function (PDF) is generally more useful than a histogram, which is a classic density estimate. Then, the collection of PDFs along a given slice are presented vertically above the slice and form a wall. To minimize occlusion of intersecting slices, the corresponding walls are positioned at the far edges of the boundary. The PDF wall depicts the shapes of the distributions very dearly since peaks represent the modes (or bumps) in the PDFs. We've defined roughness as the number of peaks in the distribution. Roughness is another useful summary information for multimodal distributions. The uncertainty of the multi-valued data can also be interpreted by the number of peaks and the widths of the peaks as shown by the PDF walls.

Kao, David↗

Prediction of Cognitive States During Flight Simulation Using Multimodal Psychophysiological Sensing

The Commercial Aviation Safety Team found the majority of recent international commercial aviation accidents attributable to loss of control inflight involved flight crew loss of airplane state awareness (ASA), and distraction was involved in all of them. Research on attention-related human performance limiting states (AHPLS) such as channelized attention, diverted attention, startle/surprise, and confirmation bias, has been recommended in a Safety Enhancement (SE) entitled "Training for Attention Management." To accomplish the detection of such cognitive and psychophysiological states, a broad suite of sensors was implemented to simultaneously measure their physiological markers during a high fidelity flight simulation human subject study. Twenty-four pilot participants were asked to wear the sensors while they performed benchmark tasks and motion-based flight scenarios designed to induce AHPLS. Pattern classification was employed to predict the occurrence of AHPLS during flight simulation also designed to induce those states. Classifier training data were collected during performance of the benchmark tasks. Multimodal classification was performed, using pre-processed electroencephalography, galvanic skin response, electrocardiogram, and respiration signals as input features. A combination of one, some or all modalities were used. Extreme gradient boosting, random forest and two support vector machine classifiers were implemented. The best accuracy for each modality-classifier combination is reported. Results using a select set of features and using the full set of available features are presented. Further, results are presented for training one classifier with the combined features and for training multiple classifiers with features from each modality separately. Using the select set of features and combined training, multistate prediction accuracy averaged 0.64 +/- 0.14 across thirteen participants and was significantly higher than that for the separate training case. These results support the goal of demonstrating simultaneous real-time classification of multiple states using multiple sensing modalities in high fidelity flight simulators. This detection is intended to support and inform training methods under development to mitigate the loss of ASA and thus reduce accidents and incidents.

Harrivel, Angela R.↗

NASA Next-Generation Sensing Technologies for Earth & Planetary Science

Dr. Ved Chirayath's seminar will highlight new sensing technologies and airborne platforms he is developing for Earth & Space Science as director of the NASA Silicon Valley Laboratory for Advanced Sensing. His talk will feature recent work on Fluid Lensing, the first remote sensing technology capable of imaging through ocean waves in 3D at sub-cm resolutions, MiDAR, a next-generation active hyperspectral remote sensing and optical communications instrument, airborne gas sensing of multipollutant combustion sources, and a plasma actuated unmanned aerial vehicle (UAV) that utilized high-voltage dielectric discharge devices to achieve the first plasma controlled flight in history.Fluid Lensing and the NASA FluidCam instrument have been used extensively to provide distortion-free 3D multispectral imagery from UAVs of shallow marine systems around the world. MiDAR is being deployed on aircraft and underwater remotely operated vehicles (ROVs) as a new method to remotely sense living and nonliving structures in extreme environments as an analog for future Ocean Worlds robotic exploration missions. Finally, Chirayath will present preliminary results from NeMO-Net, a supercomputer-based neural network that uses a citizen science video game for global multimodal coral reef benthic habitat mapping, fusing remote sensing data from Fluid Lensing, MiDAR, NASA's Earth Observing System, and commercial satellites, to better understand the present and past dynamics of shallow marine systems. Together, these maturing technologies present promising new ways in which to explore terrestrial, marine, and aerial systems on Earth, and, ultimately, aid in the search for extraterrestrial life within our solar system and beyond.

Chirayath, Ved↗

Sonic-boom-induced building structure responses including damage.

Concepts of sonic-boom pressure loading of building structures and the associated responses are reviewed, and results of pertinent theoretical and experimental research programs are summarized. The significance of sonic-boom load time histories, including waveshape effects, are illustrated with the aid of simple structural elements such as beams and plates. Also included are discussions of the significance of such other phenomena as three-dimensional loading effects, air cavity coupling, multimodal responses, and structural nonlinearities. Measured deflection, acceleration, and strain data from laboratory models and full-scale building tests are summarized, and these data are compared, where possible, with predicted values. Damage complaint and claim experience due both to controlled and uncontrolled supersonic flights over communities are summarized with particular reference to residential, commercial, and historic buildings. Sonic-boom-induced building responses are compared with those from other impulsive loadings due to natural and cultural events and from laboratory simulation tests.

Clarkson, B. L.↗

High-Performance Scanning Acousto-Ultrasonic System

A high-performance scanning acousto-ultrasonic system, now undergoing development, is designed to afford enhanced capabilities for imaging microstructural features, including flaws, inside plate specimens of materials. The system is expected to be especially helpful in analyzing defects that contribute to failures in polymer- and ceramic-matrix composite materials, which are difficult to characterize by conventional scanning ultrasonic techniques and other conventional nondestructive testing techniques. Selected aspects of the acousto-ultrasonic method have been described in several NASA Tech Briefs articles in recent years. Summarizing briefly: The acousto-ultrasonic method involves the use of an apparatus like the one depicted in the figure (or an apparatus of similar functionality). Pulses are excited at one location on a surface of a plate specimen by use of a broadband transmitting ultrasonic transducer. The stress waves associated with these pulses propagate along the specimen to a receiving transducer at a different location on the same surface. Along the way, the stress waves interact with the microstructure and flaws present between the transducers. The received signal is analyzed to evaluate the microstructure and flaws. The specific variant of the acousto-ultrasonic method implemented in the present developmental system goes beyond the basic principle described above to include the following major additional features: Computer-controlled motorized translation stages are used to automatically position the transducers at specified locations. Scanning is performed in the sense that the measurement, data-acquisition, and data-analysis processes are repeated at different specified transducer locations in an array that spans the specimen surface (or a specified portion of the surface). A pneumatic actuator with a load cell is used to apply a controlled contact force. In analyzing the measurement data for each pair of transducer locations in the scan, the total (multimode) acousto-ultrasonic response of the specimen is utilized. The analysis is performed by custom software that extracts parameters of signals in the time and frequency domains. The computer hardware and software provide both real-time and postscan processing and display options. For example, oscilloscope displays of waveforms and power spectral densities are available in real time. Images can be computed while scanning continues. Signals can be digitally preprocessed and/or post-processed by filtering, windowing, time-segmenting, and running-waveform-averaging algorithms. In addition, the software affords options for off-line simulation of the waveform-data-acquisition and scanning processes. In tests, the system has been shown to be capable of characterizing microstructural changes and defects in SiC/SiC and C/SiC ceramic-matrix composites. Delaminations, variations in density, microstructural changes attributable to infiltration by silicon, and crack-space indications (defined in the next sentence) have been revealed in images formed from several time- and frequency-domain parameters of scanning acousto-ultrasonic signals. The crack-space indications were image features that were not revealed by other nondestructive testing methods and are so named because they turned out to mark locations where cracking eventually occurred.

Roth, Don↗

PACE OCI Short-Wave Infrared Detection Assembly Optical System Design, Alignment, and Environmental Test

The Ocean Color Instrument (OCI), which will be integrated with the Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) satellite, will collect science data that will be used to monitor the health of Earth’s oceans and atmosphere. The Short-Wave Infrared (SWIR) Detection Assembly (SDA), built and characterized by Utah State University Space Dynamics Laboratory (SDL), is a subsystem of OCI consisting of 32 channels covering seven discrete optical bands of interest. A total of 16 SWIR Detection Subassemblies (SDSs) compose the SDA and house the cold optical system. The science data optical input for each SDS is supplied by a 0.22 NA multimode fiber interfacing with a fiber adapter. The diverging light from the fiber is collimated, split by a dichroic beamsplitter to two separate channels, filtered by the science filter, and then reimaged onto the single-element detectors with a final 0.76 NA. Aspheric, diamond-turned powered elements are used throughout the optical design. Fabrication and alignment tolerance analysis/budgets are balanced to ensure the optical system meets throughput requirements. All systems are aligned at ambient temperature using an InSb camera and an in-line illumination microscope system to directly image the active detector area through the science filters. Compensators used during alignment are detector focus and decenter, which are adjusted via photoetched shims in increments of 25 µm. Average focus and centering errors were less than 8 µm among all 32 flight and 10 flight spare detectors. Each SDS spectral response and conversion gain was verified at operational temperature of -65°C in vacuum.

OCI↗