Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “signal visualization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRS1981

Vestibular and oculomotor physiology; Proceedings of the International Meeting, New York, NY, September 22-25, 1980

Papers are presented showing recent progress in the understanding of the processing of visual and vestibular signals by the central nervous system to produce eye movements and postural responses. Specific topics include the directional sensitivity of hair cells to hair bundle deflection, the effects of gravity on rotatory nystagmus, the reticulovestibular organization associated with horizontal fast eye movement, the pathways controlling the extraocular eye muscles, the organization of visual-vestibular interaction in vestibular neurons, motion sickness due to vision reversal in stroboscopic light, and vestibular habituation during sinusoidal rotation. Attention is also given to vestibulo-ocular, vestibulocollic and cervicocollic reflexes, visual mossy fiber inputs to the flocculus, directional plasticity of the vestibulo-ocular reflex, the relation of active head rotation with eye-head coordination, instability in the optokinetic-vestibular system as an explanation for periodic alternating nystagmus, the effects of visual and nonvisual fixation on vestibular nystagmus, interaction of saccades with the vestibulo-ocular reflex, and the role of the plantar mechanoreceptor in equilibrium control.

Cohen, B.↗
DOE OSTI2024

Unsupervised multimodal fusion of in-process sensor data for advanced manufacturing process monitoring

Effective monitoring of manufacturing processes is crucial for maintaining product quality and operational efficiency. Modern manufacturing environments often generate vast amounts of complementary multimodal data, including visual imagery from various perspectives and resolutions, hyperspectral data, and machine health monitoring information such as actuator positions, accelerometer readings, and temperature measurements. However, fusing and interpreting this complex, high-dimensional data presents significant challenges, particularly when labeled datasets are unavailable or impractical to obtain. This paper presents a novel approach to multimodal sensor data fusion in manufacturing processes, inspired by the Contrastive Language-Image Pre-training (CLIP) model. We leverage contrastive learning techniques to correlate different data modalities without the need for labeled data, overcoming limitations of traditional supervised machine learning methods in manufacturing contexts. Our proposed method demonstrates the ability to handle and learn encoders for five distinct modalities: visual imagery, audio signals, laser position (x and y coordinates), and laser power measurements. By compressing these high-dimensional datasets into low-dimensional representational spaces, our approach facilitates downstream tasks such as process control, anomaly detection, and quality assurance. The unsupervised nature of our method makes it broadly applicable across various manufacturing domains, where large volumes of unlabeled sensor data are common. We evaluate the effectiveness of our approach through a series of experiments, demonstrating its potential to enhance process monitoring capabilities in advanced manufacturing systems. This research contributes to the field of smart manufacturing by providing a flexible, scalable framework for multimodal data fusion that can adapt to diverse manufacturing environments and sensor configurations. The proposed method paves the way for more robust, data-driven decision-making in complex manufacturing processes.

Contrastive Learning↗
NASA NTRS1987

Effects of proposed preflight adaptation training on eye movements, self-motion perception, and motion sickness - A progress report

The preflight adaptation trainer (PAT) was designed to produce rearranged relationships between visual and otolith signals analogous to those experienced in space. Investigations have been undertaken with three prototype trainers. The results indicated that exposure to the PAT sensory rearrangement altered self-motion perception, induced motion sickness, and changed the amplitude and phase of the horizontal eye movements evoked by roll stimulation. However, the changes were inconsistent.

Parker, D. E.↗
DOE OSTI2024

Dimensionally Aligned Signal Projection Algorithms Library

Dimensionally aligned signal projection (DASP) algorithms are used to analyze fast Fourier transforms (FFTs) and generate visualizations that help focus on the harmonics for specific signals. At a high level, these algorithms extract the FFT segments around each harmonic frequency center, and then align them in equally sized arrays ordered by increasing distance from the base frequency. This allows for a focused view of the harmonic frequencies, which, among other use cases, can enable machine learning algorithms to more easily identify salient patterns. This work seeks to provide an effective open-source implementation of the DASP algorithms proposed by Vann et al. (2018) as well as functionality to help explore and test how these algorithms work with an interactive dashboard and signal-generation tool. The DASP library is implemented in Python and contains four types of algorithms for implementing these feature engineering techniques: fixed harmonically aligned signal projection (HASP), decimating HASP, interpolating HASP, and frequency aligned signal projection (FASP). Each algorithm returns a numerical array, which can be visualized as an image. The HASP algorithms are variations of the algorithms originally presented by Vann et al. (2018). For consistency, FASP, which is the terminology used for the short-time Fourier transform (STFT), has been implemented as part of the library to provide a similar interface to the STFT of the raw signal. Additionally, the library contains an algorithm to generate artificial signals with basic customizations such as the base frequency, sample rate, duration, number of harmonics, noise, and number of signals. Finally, the library provides multiple interactive visualizations, each of which is implemented using IPyWidgets and works in a Jupyter environment. A dashboard-style visualization is provided, which contains some common signal-processing visual components (signal, FFT, spectogram) updating in unison with the HASP functions (see Figure 1 below). Separate from the dashboard, an independent visualization is provided for each of the DASP algorithms as well as for the artifical signal generator. These visualizations are included in the library to aid in developing an intuitive understanding how the algorithms are affected by different input signals and parameter selections.

harmonics↗
NASA NTRS2002

Contour completion through depth interferes with stereoacuity

Local disparity signals must interact in visual cortex to represent boundaries and surfaces of three-dimensional (3D) objects. We investigated how disparity signals interact in 3D contours and in 3D surfaces generated from the contours. We compared flat (single disparity) stimuli with curved (multi-disparity) stimuli. We found no consistent differences in sensitivity to contours vs. surfaces; for equivalent amounts of disparity, however, observers were more sensitive to flat stimuli than curved stimuli. Poor depth sensitivity for curved stimuli cannot be explained by the larger range of disparities present in the curved surface, nor by disparity averaging, nor by poor sensitivity to the largest disparity in the stimulus. Surprisingly, sensitivity to surfaces curved in depth was improved by removing portions of the surface and thus removing disparity information. Stimulus configuration had a profound effect on stereo thresholds that cannot be accounted for by disparity-energy models of V1 processing. We suggest that higher-level 3D contour or 3D shape mechanisms are involved.

Non-NASA Center↗
NASA NTRS1994

Effects of Spaceflight and Hindlimb Suspension on the Posture and Gait of Rats

Instability of posture and gait in astronauts following spaceflight (SF) is thought to result from muscle atrophy and from changes in sensory-motor integration in the CNS (central nervous system) that occur during adaptation to microgravity (micro-G). Individuals are thought to have developed, during SF, adaptive changes for the processing of proprioceptive, vestibular and visual sensory inputs with reduced weighting of gravity-based signals and increased weighting of visual and tactile cues. This sensory-motor rearrangement in the CNS apparently occurs to optimize neuromuscular system function for effective movement and postural control in micro-G. However, these adaptive changes are inappropriate for the 1 g environment and lead to disruptions in posture and gait on return to Earth. Few reports are available on the effects of SF on the motor behavior of animals. Rats studied following 18.5 - 19.5 days of SF in the COSMOS program were described as being ..'inert, apathetic, slow'.. and generally unstable. The hindlimbs of these rats were ..'thrust out from the body with fingers pulled apart and the shin unnaturally pronated'. On the 6th postflight day motor behavior was described as similar to that observed in preflight observations. Improved understanding of the mechanisms leading to these changes can be obtained in animal models through detailed analysis of neural and molecular mechanisms related to gait. To begin this process the posture and gait of rats were examined following exposure to either SF or hindlimb suspension (HLS), and during recovery from these conditions.

Fox, R. A.↗
NASA NTRS1988

Role of orientation reference selection in motion sickness

Previous experiments with moving platform posturography have shown that different people have varying abilities to resolve conflicts among vestibular, visual, and proprioceptive sensory signals used to control upright posture. In particular, there is one class of subjects with a vestibular disorder known as benign paroxysmal positional vertigo (BPPV) who often are particularly sensitive to inaccurate visual information. That is, they will use visual sensory information for the control of their posture even when that visual information is inaccurate and is in conflict with accurate proprioceptive and vestibular sensory signals. BPPV has been associated with disorders of both posterior semicircular canal function and possibly otolith function. The present proposal hopes to take advantage of the similarities between the space motion sickness problem and the sensory orientation reference selection problems associated with the BPPV syndrome. These similarities include both etiology related to abnormal vertical canal-otolith function, and motion sickness initiating events provoked by pitch and roll head movements. The objectives of this proposal are to explore and quantify the orientation reference selection abilities of subjects and the relation of this selection to motion sickness in humans.

Peterka, Robert J.↗
DOE OSTI2025

A single-cell atlas of the bobtail squid visual and nervous system highlights molecular principles of convergent evolution

Abstract The cephalopod and vertebrate visual systems are a textbook example of convergent evolution with unknown molecular underpinnings. Here we characterize 98,537 single-cell transcriptomes in the bobtail squidEuprymna berryito understand how the cephalopod retina and optic lobes relate to the vertebrate retina. We confirm the overall relative simplicity of the cephalopod retina but identify two related photoreceptor cell subtypes expressing distinct r-opsins. By contrast, the adult optic lobe contains a diverse repertoire of neuronal and glial cell types, with a predominance of dopaminergic neurons. We show that cephalopod-specific gene duplicates probably contributed to this cell type diversification. Comparing neuronal cell population in the optic lobes of hatchlings and adults, we reveal a switch towards dopaminergic neurotransmitter usage with age, indicative of a maturation process. We further identify an FMRF-amide-based retrograde signal from the optic lobe towards the retina that supports the functional analogy of the cephalopod optic lobe cortex and the vertebrate inner retina in visual signal processing from a molecular standpoint. Finally, comparative analyses with vertebrate and arthropod cells suggest a scenario in which two photoreceptor types and two neuronal populations may have already been present in the eye of the bilaterian ancestor.

Environmental Sciences & Ecology↗
NASA NTRS1992

Color matrix display simulation based upon luminance and chromatic contrast sensitivity of early vision

This paper describes the design and operation of a new simulation model for color matrix display development. It models the physical structure, the signal processing, and the visual perception of static displays, to allow optimization of display design parameters through image quality measures. The model is simple, implemented in the Mathematica computer language, and highly modular. Signal processing modules operate on the original image. The hardware modules describe backlights and filters, the pixel shape, and the tiling of the pixels over the display. Small regions of the displayed image can be visualized on a CRT. Visual perception modules assume static foveal images. The image is converted into cone catches and then into luminance, red-green, and blue-yellow images. A Haar transform pyramid separates the three images into spatial frequency and direction-specific channels. The channels are scaled by weights taken from human contrast sensitivity measurements of chromatic and luminance mechanisms at similar frequencies and orientations. Each channel provides a detectability measure. These measures allow the comparison of images displayed on prospective devices and, by that, the optimization of display designs.

Martin, Russel A.↗
DOE OSTI2026

A non-intrusive framework using acoustic signals and deep learning for boiling diagnostics in visual-limited environments

Accurate monitoring of boiling heat transfer is critical for safeguarding high-power systems operating in environments where conventional optical diagnostics are hindered by radiation fields or restricted visual accessibility. This study presents a non-intrusive framework that integrates hydroacoustic sensing with deep learning to infer near-wall boiling characteristics and enable predictive thermal assessment without visual access. In a prototypical subcooled flow-boiling facility representative of the Isotope Production Facility (IPF) at Los Alamos, hydrophones capture boiling-induced acoustic emissions that are transformed into background-removed Short-Time Fourier Transform (STFT) spectrograms. A convolutional neural network (CNN) then regresses heat flux, wall superheat, and key bubble parameters directly from these spectrograms. The CNN achieved predictive accuracy under nominal conditions and demonstrated robustness and generalization under acoustic noise for Signal-to-Noise Ratios (SNRs) down to approximately 0 dB. When integrated into an ANSYS CFX wall-boiling model, the acoustically inferred parameters reproduced boiling curve and critical heat flux (CHF) values consistent with image-based benchmarks. Furthermore, the model retained reliable performance under moderate variations in bulk temperature, flow rate, and hydrophone placement, confirming its generalizability across practical boundary conditions. These results demonstrate the feasibility of hydroacoustic-based deep learning as a viable path toward real-time, radiation-tolerant boiling diagnostics and predictive thermal safety assessment in inaccessible systems such as the IPF.

42 ENGINEERING↗
NASA NTRS2005

Near-Earth Object Astrometric Interferometry

Using astrometric interferometry on near-Earth objects (NEOs) poses many interesting and difficult challenges. Poor reflectance properties and potentially no significant active emissions lead to NEOs having intrinsically low visual magnitudes. Using worst case estimates for signal reflection properties leads to NEOs having visual magnitudes of 27 and higher. Today the most sensitive interferometers in operation have limiting magnitudes of 20 or less. The main reason for this limit is due to the atmosphere, where turbulence affects the light coming from the target, limiting the sensitivity of the interferometer. In this analysis, the interferometer designs assume no atmosphere, meaning they would be placed at a location somewhere in space. Interferometer configurations and operational uncertainties are looked at in order to parameterize the requirements necessary to achieve measurements of low visual magnitude NEOs. This analysis provides a preliminary estimate of what will be required in order to take high resolution measurements of these objects using interferometry techniques.

Werner, Martin R.↗
NASA NTRS2005

Mission Functionality for Deflecting Earth-Crossing Asteroids/Comets

Using astrometric interferometry on near-Earth objects (NEOs) poses many interesting and difficult challenges. Poor reflectance properties and potentially no significant active emissions lead to NEOs having intrinsically low visual magnitudes. Using worst case estimates for signal reflection properties leads to NEOs having visual magnitudes of 27 and higher. Today the most sensitive interferometers in operation have limiting magnitudes of 20 or less. The main reason for this limit is due to the atmosphere, where turbulence affects the light coming from the target, limiting the sensitivity of the interferometer. In this analysis, the interferometer designs assume no atmosphere, meaning they would be placed at a location somewhere in space. Interferometer configurations and operational uncertainties are looked at in order to parameterize the requirements necessary to achieve measurements of low visual magnitude NEOs. This analysis provides a preliminary estimate of what will be required in order to take high resolution measurements of these objects using interferometry techniques.

Park, Sang-Young↗
NASA NTRS1972

Visually directed pointing as a function of target distance, direction, and available cues.

In pointing at visual targets without sight of the hand, large errors occur. There is a tendency to overreach targets, and this tendency is much greater (about 25 cm) when convergence is the only cue to distance than when there are many cues (2 to 11 cm). Angular errors of up to 10 deg also occur. These tend to be to the side opposite the sighting eye, when the favored hand is used. The variance of the pointing response with convergence alone is reduced by approximately half with the introduction of several spatial cues. These results are interpreted as indicating that, for a target within the reach of the arm and with convergence alone as a cue, the depth signal produced by the visual system corresponds to a greater distance than that produced when many cues are available. The results are also consistent with the hypothesis that perceived direction tends to approximate direction from the sighting eye.

Foley, J. M.↗
NASA NTRS1987

Role of orientation reference selection in motion sickness, supplement 2S

Previous experiments with moving platform posturography have shown that different people have varying abilities to resolve conflicts among vestibular, visual, and proprioceptive sensory signals. The conceptual basis of the present proposal hinges on the similarities between the space motion sickness problem and the sensory orientation reference selection problems associated with benign paroxysmal positional vertigo (BPPV) syndrome. These similarities include both etiology related to abnormal vertical canal-otolith function, and motion sickness initiating events provoked by pitch and roll head movements. The objectives are to explore and quantify the orientation reference selection abilities of subjects and the relation of this selection to motion sickness in humans. The overall objectives are to determine: if motion sickness susceptibility is related to sensory orientation reference selection abilities of subjects; if abnormal vertical canal-otolith function is the source of abnormal posture control strategies and if it can be quantified by vestibular and oculomotor reflex measurements, and if it can be quantified by vestibular and oculomotor reflex measurements; and quantifiable measures of perception of vestibular and visual motion cues can be related to motion sickness susceptibility and to orientation reference selection ability.

Peterka, Robert J.↗
DOE OSTI2026

Block Island Acoustic Data Analysis and Peak Detection Tools

This dataset contains acoustic signal analysis tools and processed datasets for pile driving noise characterization during Block Island Wind Farm construction (October 25, 2015), including peak detection algorithms, signal extraction methods, and visualization products for multi-channel hydrophone array data.

17 WIND ENERGY↗
NASA NTRS1988

The mixing mechanism by organised turbulence structures in a plane jet excited by a novel method

The effect on a plane subsonic turbulent jet of controlled high-amplitude periodic oscillations applied to the nozzle is investigated experimentally. A variable-speed motor and a gear-cam mechanism are used to make the lips of the nozzle reciprocate in opposite directions at the desired frequency. Velocity profiles, flow visualizations, and pressure-signal traces are presented and analyzed in detail. The complex vortex processes involved in the oscillation-induced spreading and entrainment of the jet are explored, and a critical Strouhal number for vortex formation and amplification is determined. The oscillation technique is found to augment the thrust of a jet/duct-diffuser configuration by a factor of 1.20; the thrust increases with oscillation frequency up to 20 Hz and remains constant if the frequency is further increased.

Badri Narayanan, M. A.↗