SEARCH · Engineering Papers

Results for “Vision”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,657 records · Page 92

All sources NASA NTRS DOE OSTI

DOE OSTI2026

Intelligent Experiments Through Real-time AI: Fast Data Processing and Autonomous Detector Control for sPHENIX and Future EIC Detectors (Final Report)

The overall vision of this project was to integrate real-time artificial intelligence (AI) directly into the data acquisition and detector-control systems of nuclear physics experiments, including both fast online event selection and an autonomous detector-control feedback loop. The work carried out under the award focused on the fast online event-selection half of that vision: the efficient recording of low-momentum heavy-flavor (HF) hadron decays in proton-proton collisions at the sPHENIX experiment at the Relativistic Heavy Ion Collider (RHIC)—an observable that requires fast tracking and topological trigger selection not previously demonstrated at RHIC, and that is essential for QCD studies at future facilities such as the Electron-Ion Collider (EIC). The autonomous detector-control (GPU-based feedback) component named in the project title remained a design concept and was not implemented under this award. The Massachusetts Institute of Technology (MIT) group led the offline simulation and data processing needed to train the machine-learning (ML) models, the translation of trained models to Field-Programmable Gate Array (FPGA) firmware using the hls4ml framework, and the physics validation of heavy-flavor reconstruction. Over the award period, the team developed and hardware-tested the principal components of an AI-based heavy-flavor trigger on simulated and recorded sPHENIX tracker data: a software Bipartite Graph Attention Network (BiGAT) trigger model reaching > 95% signal efficiency at 99% background rejection; an FPGA-native hit clusterizer matching the offline clustering; smaller networks synthesized to FPGA within the required sub-10 µs latency; and an assembled decoder–clusterizer–inference firmware chain exercised on the FELIX readout board. A complete, fully integrated hardware demonstrator was not finished within the award period. This report documents the project goals, the MIT group’s contributions, the technical accomplishments, and the outlook toward applications at the future EIC ePIC detector.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2022

An EvoDevo Study of Salmonid Visual Opsin Dynamics and Photopigment Spectral Sensitivity

Salmonids are ideal models as many species follow a distinct developmental program from demersal eggs and a large yolk sac to hatching at an advanced developmental stage. Further, these economically important teleosts inhabit both marine- and freshwaters and experience diverse light environments during their life histories. At a genome level, salmonids have undergone a salmonid-specific fourth whole genome duplication event (Ss4R) compared to other teleosts that are already more genetically diverse compared to many non-teleost vertebrates. Thus, salmonids display phenotypically plastic visual systems that appear to be closely related to their anadromous migration patterns. This is most likely due to a complex interplay between their larger, more gene-rich genomes and broad spectrally enriched habitats; however, the molecular basis and functional consequences for such diversity is not fully understood. This study used advances in genome sequencing to identify the repertoire and genome organization of visual opsin genes (those primarily expressed in retinal photoreceptors) from six different salmonids [Atlantic salmon ( Salmo salar ), brown trout ( Salmo trutta ), Chinook salmon ( Oncorhynchus tshawytcha ), coho salmon ( Oncorhynchus kisutch ), rainbow trout ( Oncorhynchus mykiss ), and sockeye salmon ( Oncorhynchus nerka )] compared to the northern pike ( Esox lucius ), a closely related non-salmonid species. Results identified multiple orthologues for all five visual opsin classes, except for presence of a single short-wavelength-sensitive-2 opsin gene. Several visual opsin genes were not retained after the Ss4R duplication event, which is consistent with the concept of salmonid rediploidization. Developmentally, transcriptomic analyzes of Atlantic salmon revealed differential expression within each opsin class, with two of the long-wavelength-sensitive opsins not being expressed before first feeding. Also, early opsin expression in the retina was located centrally, expanding dorsally and ventrally as eye development progressed, with rod opsin being the dominant visual opsin post-hatching. Modeling by spectral tuning analysis and atomistic molecular simulation, predicted the greatest variation in the spectral peak of absorbance to be within the Rh2 class, with a ∼40 nm difference in λ max values between the four medium-wavelength-sensitive photopigments. Overall, it appears that opsin duplication and expression, and their respective spectral tuning profiles, evolved to maximize specialist color vision throughout an anadromous lifecycle, with some visual opsin genes being lost to tailor marine-based vision.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2020

MicroRNAs as diagnostic and prognostic biomarkers of age-related macular degeneration: advances and limitations

A main cause of vision loss in the elderly is age-related macular degeneration (AMD). Among the cellular, biochemical, and molecular changes linked to this disease, inflammation and angiogenesis appear as being crucial in AMD pathogenesis and progression. There are two forms of the disease: dry AMD, accounting for 80–90% of cases, and wet AMD. The disease usually begins as dry AMD associated with retinal pigment epithelium and photoreceptor degeneration, whereas wet AMD is associated with choroidal neovascularization resulting in severe vision impairment. The new vessels are largely malformed, leading to blood and fluid leakage within the disrupted tissue, which provokes inflammation and scar formation and results in retinal damage and detachment. MicroRNAs are dysregulated in AMD and may facilitate the early detection of the disease and monitoring disease progression. Two recent reviews of microRNAs in AMD had indicated weaknesses or limitations in four earlier investigations. Studies in the last three years have shown considerable progress in overcoming some of these concerns and identifying specific microRNAs as biomarkers for AMD. Further large-scale studies are warranted using appropriate statistical methods to take into account gender and age disparity in the study populations and confounding factors such as smoking status.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2024

Real World Use Case Evaluation of Radar Retro-reflectors for Autonomous Vehicle Lane Detection Applications

Lane detection plays a critical role in autonomous vehicles for safe and reliable navigation. Lane detection is traditionally accomplished using a camera sensor and computer vision processing. The downside of this traditional technique is that it can be computationally intensive when high quality images at a fast frame rate are used and has reliability issues from occlusion such as, glare, shadows, active road construction, and more. This study addresses these issues by exploring alternative methods for lane detection in specific scenarios caused from road construction-induced lane shift and sun glare. Specifically, a U-Net, a convolutional network used for image segmentation, camera-based lane detection method is compared with a radar-based approach using a new type of sensor previously unused in the autonomous vehicle space: radar retro-reflectors. This evaluation is performed using ground truth data, obtained by measuring the lane positions and transforming them into pixel coordinates. The performance of each method is assessed using the statistical R2 score, indicating the correlation between the detected lane lines and the ground truth. The results show that the U-Net camera-based method exhibits limitations in accurately detecting and aligning the lane lines, particularly in challenging scenarios. However, the radar-based lane detection method demonstrates a strong correlation with the ground truth which implies that the use of this sensor may improve current reliability issues from conventional camera lane detection approach. Furthermore, the study highlights the limitations of the U-Net model for camera lane detection, especially in scenarios with sun glare. This study shows that infrastructure-based radar retro-reflectors can improve autonomous vehicle lane detection reliability. The integration of different sensor modalities and the development of advanced computer vision algorithms are crucial for improving the accuracy, reliability, and energy efficiency of lane detection systems. Addressing these challenges contributes to the advancement of autonomous vehicles and the realization of safer and more efficient transportation systems.

Brown, Nicolas E.↗

DOE OSTI2017

PlantCV v2: Image analysis software for high-throughput plant phenotyping

Systems for collecting image data in conjunction with computer vision techniques are a powerful tool for increasing the temporal resolution at which plant phenotypes can be measured non-destructively. Computational tools that are flexible and extendable are needed to address the diversity of plant phenotyping problems. We previously described the Plant Computer Vision (PlantCV) software package, which is an image processing toolkit for plant phenotyping analysis. The goal of the PlantCV project is to develop a set of modular, reusable, and repurposable tools for plant image analysis that are open-source and community-developed. Here in this paper we present the details and rationale for major developments in the second major release of PlantCV. In addition to overall improvements in the organization of the PlantCV project, new functionality includes a set of new image processing and normalization tools, support for analyzing images that include multiple plants, leaf segmentation, landmark identification tools for morphometrics, and modules for machine learning.

59 BASIC BIOLOGICAL SCIENCES↗

NASA NTRS1973

Digital enhancement of multispectral MSS data for maximum image visibility

A systematic approach to the enhancement of images has been developed. This approach exploits two principal features involved in the observation of images: the properties of human vision and the statistics of the images being observed. The rationale of the enhancement procedure is as follows: in the observation of some features of interest in an image, the range of objective luminance-chrominance values being displayed is generally limited and does not use the whole perceptual range of vision of the observer. The purpose of the enhancement technique is to expand and distort in a systematic way the grey scale values of each of the multispectral bands making up a color composite, to enhance the average visibility of the features being observed.

Algazi, V. R.↗

NASA NTRS1973

Robot computer problem solving system

A robot computer problem solving system which represents a robot exploration vehicle in a simulated Mars environment is described. The model exhibits changes and improvements made on a previously designed robot in a city environment. The Martian environment is modeled in Cartesian coordinates; objects are scattered about a plane; arbitrary restrictions on the robot's vision have been removed; and the robot's path contains arbitrary curves. New environmental features, particularly the visual occlusion of objects by other objects, were added to the model. Two different algorithms were developed for computing occlusion. Movement and vision capabilities of the robot were established in the Mars environment, using LISP/FORTRAN interface for computational efficiency. The graphical display program was redesigned to reflect the change to the Mars-like environment.

Merriam, E. W.↗

NASA NTRS1975

Man-machine interactive imaging and data processing using high-speed digital mass storage

The role of vision in teleoperation has been recognized as an important element in the man-machine control loop. In most applications of remote manipulation, direct vision cannot be used. To overcome this handicap, the human operator's control capabilities are augmented by a television system. This medium provides a practical and useful link between workspace and the control station from which the operator perform his tasks. Human performance deteriorates when the images are degraded as a result of instrumental and transmission limitations. Image enhancement is used to bring out selected qualities in a picture to increase the perception of the observer. A general purpose digital computer, an extensive special purpose software system is used to perform an almost unlimited repertoire of processing operations.

Alsberg, H.↗

NASA NTRS1975

The Mark 3 Haploscope

A computer-operated binocular vision testing device was developed as one part of a system designed for NASA to evaluate the visual function of astronauts during spaceflight. This particular device, called the Mark 3 Haploscope, employs semi-automated psychophysical test procedures to measure visual acuity, stereopsis, phoria, fixation disparity, refractive state and accommodation/convergence relationships. Test procedures are self-administered and can be used repeatedly without subject memorization. The Haploscope was designed as one module of the complete NASA Vision Testing System. However, it is capable of stand-alone operation. Moreover, the compactness and portability of the Haploscope make possible its use in a broad variety of testing environments.

Decker, T. A.↗

NASA NTRS1975

Intermodal transfer in temporal discrimination

This study determined if training for accuracy in temporal discrimination would transfer across sensory modalities. A fractionation method was used in which subjects bisected the durations of acoustic and visual signals at three standard intervals (6, 12, and 18 sec). Absolute error was the performance index. Half of the subjects were trained with acoustic stimuli and then tested in vision; the remainder were trained in vision and tested in audition. Similar negatively accelerated acquisition functions were noted for both modalities. Positive intermodal transfer, characterized by symmetry across modalities, was obtained at all standard durations. The results were considered to provide support for the notion that a common mechanism underlies temporal discriminations in different sensory systems.

Warm, J. S.↗

NASA NTRS1984

The Malcolm horizon: History and future

The development of the Malcolm Horizon, a peripheral vision horizon used in flight simulation, is discussed. A history of the horizon display is presented as well as a brief overview of vision physiology, and the role balance plays is spatial orientation. Avenues of continued research in subconscious cockpit instrumentation are examined.

Malcolm, R.↗

NASA NTRS1984

The peripheral visual cue assessment facility at Ames Research Center

The Peripheral Visual Cue Assessment Facility was established to study various responses to controlled dynamic stimuli that could be considered as visual analogs of some real world counterparts such as the horizon. Careful stimulus control permits specific responses to be traced to specific stimulus dynamics. The ability of the visual system to assess various kinds of stimulus motion is examined. A major emphasis is placed upon the peripheral vision field, which plays an important role in a pilot's assessment of where he is in space, where he is going, how fast he is travelling, and what angular and linear rates of movement is taking place. The facility was designed to be able to carry out carefully controlled psychophysical vision research over a wide angular range.

Haines, R. F.↗

NASA NTRS1985

IPLIB (Image processing library) user's manual

IPLIB is a collection of HP FORTRAN 77 subroutines and functions that facilitate the use of a COMTAL image processing system driven by an HP-1000 computer. It is intended for programmers who want to use the HP 1000 to drive the COMTAL Vision One/20 system. It is assumed that the programmer knows HP 1000 FORTRAN 77 or at least one FORTRAN dialect. It is also assumed that the programmer has some familiarity with the COMTAL Vision One/20 system.

Faulcon, N. D.↗

NASA NTRS1985

Image gathering and processing - Information and fidelity

In this paper we formulate and use information and fidelity criteria to assess image gathering and processing, combining optical design with image-forming and edge-detection algorithms. The optical design of the image-gathering system revolves around the relationship among sampling passband, spatial response, and signal-to-noise ratio (SNR). Our formulations of information, fidelity, and optimal (Wiener) restoration account for the insufficient sampling (i.e., aliasing) common in image gathering as well as for the blurring and noise that conventional formulations account for. Performance analyses and simulations for ordinary optical-design constraints and random scences indicate that (1) different image-forming algorithms prefer different optical designs; (2) informationally optimized designs maximize the robustness of optimal image restorations and lead to the highest-spatial-frequency channel (relative to the sampling passband) for which edge detection is reliable (if the SNR is sufficiently high); and (3) combining the informationally optimized design with a 3 by 3 lateral-inhibitory image-plane-processing algorithm leads to a spatial-response shape that approximates the optimal edge-detection response of (Marr's model of) human vision and thus reduces the data preprocessing and transmission required for machine vision.

Huck, F. O.↗

NASA NTRS1987

Effects of Control Parameters on a Robot Welder

Gains and weighting factors in vision-based controller evaluated. Report describes study of trajectory control in vision-based robotic welder. Covers evaluation of user-programmable parameters that dictate control response to perceived error in tracking weld seam.

Gangl, K. J.↗

NASA NTRS1985

Visual monitoring of autonomous life sciences experimentation

The goal of this research project is the development of a computer vision system to monitor and control life sciences experimentation on board space stations. The vision system is organized as a multiprocessor system with distributed processes selectively analyzing hierarchical imagery in order to monitor and control the appropriate instrumentation.

Blank, G. E.↗

NASA NTRS1986

Optical correlator use at Johnson Space Center

For automation and robotics in the Space Station era, NASA's Johnson Space Center is pursuing several means of synthetic vision. The optical correlator is one such means. The deformable mirror device will form the basis of the first correlator in this project. In-house and contracted effort is being used. Initial in-house activities will concentrate on an impulse deconvolution technique and on a programmable retina for spatial remappings of an image prior to correlation. The retina will permit a form of edge extraction and other primitive operations. Additionally, it will be used as a research tool for assisting persons with low vision.

Juday, Richard D.↗

NASA NTRS1988

Lightweight Video-Camera Head

Compact, lightweight video camera head constructed by remounting lens and charge-coupled-device image detector from small commercial video camera in separate assembly. Useful in robotics, artificial vision, and vision guidance systems. Designed to be mounted on visor of helmet to monitor motions of eyes in experiments on vestibulo-ocular reflexes.

Proctor, David R.↗