SEARCH · Engineering Papers

Results for “Visioning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

All sources NASA NTRS DOE OSTI

DOE OSTI2021

A METHODOLOGY TO SUPPORT THE DEVELOPMENT OF A NEW STATE VISION FOR THE UNITED STATES NUCLEAR INDUSTRY

A new strategy in the way in which the United States nuclear power plants (NPPs) are operated, maintained, and supported is needed. One such strategy is to transform the NPP operating model through a business-driven approach that leverages technology to enable new capabilities that improve performance and reduce cost. This paper presents a methodology for developing an achievable yet transformative new state vision that ensures continued safe and efficient operations of the United States NPP fleet. This work builds on existing guidance and leverages previous research to comprehensively address both bottom-up (i.e., utility needs) and top-down (i.e., first principles) considerations important for developing a new state vision. The proposed methodology is intended to provide industry-wide guidance for developing a new state vision that leverages both the selected vendor’s capabilities in a way that meets the utility’s modernization goals while ensuring state-of-the-art systems engineering and human factors engineering principles are applied that promote overall plant safety, performance, and efficiency.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2023

Ultrafast structural changes direct the first molecular events of vision

Vision is initiated by the rhodopsin family of light-sensitive G protein-coupled receptors (GPCRs). A photon is absorbed by the 11-cis retinal chromophore of rhodopsin, which isomerizes within 200 femtoseconds to the all-transconformation, thereby initiating the cellular signal transduction processes that ultimately lead to vision. However, the intramolecular mechanism by which the photoactivated retinal induces the activation events inside rhodopsin remains experimentally unclear. Here we use ultrafast time-resolved crystallography at room temperature to determine how an isomerized twisted all-trans retinal stores the photon energy that is required to initiate the protein conformational changes associated with the formation of the G protein-binding signalling state. The distorted retinal at a 1-ps time delay after photoactivation has pulled away from half of its numerous interactions with its binding pocket, and the excess of the photon energy is released through an anisotropic protein breathing motion in the direction of the extracellular space. Notably, the very early structural motions in the protein side chains of rhodopsin appear in regions that are involved in later stages of the conserved class A GPCR activation mechanism. Our study sheds light on the earliest stages of vision in vertebrates and points to fundamental aspects of the molecular mechanisms of agonist-mediated GPCR activation.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2026

Pre-training Vision Models for the Classification of Alerts from Wide-field Time-domain Surveys

Modern wide-field time-domain surveys facilitate the study of transient, variable and moving phenomena by conducting image differencing and relaying alerts to their communities. Machine learning tools have been used on data from these surveys and their precursors for more than a decade, and convolutional neural networks (CNNs), which make predictions directly from input images, saw particularly broad adoption through the 2010s. Since then, continually rapid advances in computer vision have transformed the standard practices around using such models. It is now commonplace to use standardized architectures pre-trained on large corpora of everyday images (e.g., ImageNet). In contrast, time-domain astronomy studies still typically design custom CNN architectures and train them from scratch. Here, we explore the effects of adopting various pre-training regimens and standardized model architectures on the performance of alert classification. We find that the resulting models match or outperform a custom, specialized CNN like what is typically used for filtering alerts. Moreover, our results show that pre-training on galaxy images from Galaxy Zoo tends to yield better performance than pre-training on ImageNet or training from scratch. We observe that the design of standardized architectures are much better optimized than the custom CNN baseline, requiring significantly less time and memory for inference despite having more trainable parameters. On the eve of the Legacy Survey of Space and Time and other image-differencing surveys, these findings advocate for a paradigm shift in the creation of vision models for alerts, demonstrating that greater performance and efficiency, in time and in data, can be achieved by adopting the latest practices from the computer vision field.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2025

DeepAndes: A Self-Supervised Vision Foundation Model for Multispectral Remote Sensing Imagery of the Andes

By mapping sites at large scales usingremotely sensed data, archaeologists can generate unique insights into long-term demographic trends, interregional social networks, and human adaptations in the past. Remote sensing surveys complement field-based approaches, and their reach can be especially great when combined with deep learning and computer vision techniques. However, conventional supervised deep learning methods face challenges in annotating fine-grained archaeological features at scale. In addition, while recent vision foundation models have shown remarkable success in learning large-scale remote sensing data with minimal annotations, most off-the-shelf solutions are designed for RGB images rather than multispectral satellite imagery, such as the eight-band data used in our study. In this article, we introduce DeepAndes, a transformer-based vision foundation model trained on three million multispectral satellite images, specifically tailored for Andean archaeology. DeepAndes incorporates a customized DINOv2 self-supervised learning algorithm optimized for eight-band multispectral imagery, marking the first foundation model designed explicitly for the Andes region. We evaluate its image understanding performance through imbalanced image classification, image instance retrieval, and pixel-level semantic segmentation tasks. Our experiments show that DeepAndes achieves superior F1 scores, mean average precision, and Dice scores in few-shot learning scenarios, significantly outperforming models trained from scratch or pretrained on smaller datasets. This underscores the effectiveness of large-scale self-supervised pretraining in archaeological remote sensing.

Guo, Junlin [Vanderbilt Univ., Nashville, TN (Unit↗

DOE OSTI2024

Vision Transformers Explained Series

Since their introduction in 2017 with Attention is All You Need¹, transformers have established themselves as the state of the art for natural language processing (NLP). In 2021, An Image is Worth 16x16 Words successfully adapted transformers for computer vision tasks. Since then, numerous transformer-based architectures have been proposed for computer vision. This article walks through the Vision Transformer (ViT) as laid out in An Image is Worth 16x16 Words.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2026

A Smart Vision-Aided RICH (Robotic Interface Control and Handling) System for VULCAN

High-flux neutron beams and high-efficiency detectors enable rapid neutron diffraction measurements at the Engineering Materials Diffractometer (VULCAN) at the Spallation Neutron Source (SNS), Oak Ridge National Laboratory (ORNL). To optimize beam time utilization, efficient sample exchange, alignment, and automated measurements are essential. Recent advances in artificial intelligence (AI) have expanded the capabilities of robotic systems. Here, we report the development of a Robotic Interactive Control and Handling (RICH) system for sample handling at VULCAN, designed to support high-throughput experiments and reduce overhead time. The RICH system employs a six-axis desktop robot integrated with AI-based computer vision models capable of recognizing and localizing samples in real time from instrument and depth-resolving cameras. Vision algorithms combine these detections to align samples with designated measurement positions or place them within complex sample environments such as furnaces. This integration of machine learning-assisted vision with robotic handling demonstrates the feasibility of autonomous sample detection and preparation, offering a pathway toward fully unmanned neutron scattering experiments.

automation↗

DOE OSTI2024

In Search of Optimum Fresh-Cut Raw Material: Using Computer Vision Systems as a Sensory Screening Tool for Browning-Resistant Romaine Lettuce Accessions

The popularity of ready-to-eat (RTE) salads has prompted novel technology to prolong the shelf life of their ingredients. Fresh-cut romaine lettuce is widely used in RTE salads; however, its tendency to quickly discolor continues to be a challenge for the industry. Selecting the ideal lettuce accessions for use in RTE salads is essential to ensure maximum shelf life, and it is critical to have a practical way to assess and compare the quality of multiple lettuce accessions that are being considered for use in fresh-cut applications. Thus, in this work we aimed to determine whether a computer vision system (CVS) composed of image acquisition, processing, and analysis could be effective to detect visual quality differences among 16 accessions of fresh-cut romaine lettuce during postharvest storage. The CVS involved a post-capturing color correction, effective image segmentation, and calculation of a browning index, which was tested as a predictor of quality and shelf life of fresh-cut romaine lettuce. The results demonstrated that machine vision software can be implemented to replace or supplement the scoring of a trained panel and instrumental quality measurements. Overall visual quality, a key sensory parameter that determines food preferences and consumer behavior, was highly correlated with the browning index, with a Pearson correlation coefficient of −0.85. Other important sensory decision parameters were also strongly or moderately correlated with the browning index, with Pearson correlation coefficients of −0.84 for freshness, 0.79 for off odor, and 0.57 for browning. The ranking of the accessions according to quality acceptability from the sensory evaluation produced a similar pattern to those obtained with the CVS. This study revealed that multiple lettuce accessions can be effectively benchmarked for their performance as fresh-cut sources via a CVS-based method. Future opportunities and challenges in using machine vision image processing to predict consumer preferences for RTE salad greens is also discussed.

Agriculture↗

NASA NTRS1973

Landing performance by low-time private pilots after the sudden loss of binocular vision - Cyclops II

Study of low-time general aviation pilots, who, in a series of spot landings, were suddenly deprived of binocular vision by patching either eye on the downwind leg of a standard, closed traffic pattern. Data collected during these landings were compared with control data from landings flown with normal vision during the same flight. The sequence of patching and the mix of control and monocular landings were randomized to minimize the effect of learning. No decrease in performance was observed during landings with vision restricted to one eye, in fact, performance improved. This observation is reported at a high level of confidence (p less than 0.001). These findings confirm the previous work of Lewis and Krier and have important implications with regard to aeromedical certification standards.

Lewis, C. E., Jr.↗

NASA NTRS1979

Robotic vision

Robotic vision, involving the use of a vision system to control a process, is discussed. Design and selection of active sensors employing radiation of radio waves, sound waves, and laser light, respectively, to light up unobservable features in the scene are considered, as are design and selection of passive sensors, which rely on external sources of illumination. The segmentation technique by which an image is separated into different collections of contiguous picture elements having such common characteristics as color, brightness, or texture is examined, with emphasis on the edge detection technique. The IMFEX (image feature extractor) system performing edge detection and thresholding at 30 frames/sec television frame rates is described. The template matching and discrimination approach to recognize objects are noted. Applications of robotic vision in industry for tasks too monotonous or too dangerous for the workers are mentioned.

Williams, D. S.↗

NASA NTRS1979

Some influences of vision on susceptibility to motion sickness

Two experiments were performed to evaluate the influence of vision on susceptibility to motion sickness during exposure to constant patterns of vestibular stimulation. The motion profile involved accelerating subjects at 20 deg/sec per sec to 300 deg/sec, maintaining them at that constant velocity for 30 sec, and decelerating them to a rapid stop in about 1.5 sec. The number of stops tolerated by a subject before reaching the motion sickness endpoint served as his score. In Experiment 1, subjects were tested twice with their eyes open and twice with their eyes blindfolded. They tolerated fewer sudden stops when permitted sight of the experimental chamber. In Experiment 2, the effect of having the eyes open or closed at different stages of the motion profile was evaluated. Having the eyes open during any stage of the test was more stressful than having the eyes closed, but this was especially true during the sudden stops. The findings are discussed in terms of their general implications for understanding (1) situations in which vision alone elicits symptoms of motion sickness, and (2) situations involving vestibular stimulation where vision heightens susceptibility.

Lackner, J. R.↗

NASA NTRS1981

Computational vision

The range of fundamental computational principles underlying human vision that equally apply to artificial and natural systems is surveyed. There emerges from research a view of the structuring of vision systems as a sequence of levels of representation, with the initial levels being primarily iconic (edges, regions, gradients) and the highest symbolic (surfaces, objects, scenes). Intermediate levels are constrained by information made available by preceding levels and information required by subsequent levels. In particular, it appears that physical and three-dimensional surface characteristics provide a critical transition from iconic to symbolic representations. A plausible vision system design incorporating these principles is outlined, and its key computational processes are elaborated.

Barrow, H. G.↗

NASA NTRS1981

Computer vision

The field of computer vision is surveyed and assessed, key research issues are identified, and possibilities for a future vision system are discussed. The problems of descriptions of two and three dimensional worlds are discussed. The representation of such features as texture, edges, curves, and corners are detailed. Recognition methods are described in which cross correlation coefficients are maximized or numerical values for a set of features are measured. Object tracking is discussed in terms of the robust matching algorithms that must be devised. Stereo vision, camera control and calibration, and the hardware and systems architecture are discussed.

Gennery, D.↗

NASA NTRS1984

Computer vision for real-time orbital operations. Center directors discretionary fund

Machine vision research is examined as it relates to the NASA Space Station program and its associated Orbital Maneuvering Vehicle (OMV). Initial operation of OMV for orbital assembly, docking, and servicing are manually controlled from the ground by means of an on board TV camera. These orbital operations may be accomplished autonomously by machine vision techniques which use the TV camera as a sensing device. Classical machine vision techniques are described. An alternate method is developed and described which employs a syntactic pattern recognition scheme. It has the potential for substantial reduction of computing and data storage requirements in comparison to the Two-Dimensional Fast Fourier Transform (2D FFT) image analysis. The method embodies powerful heuristic pattern recognition capability by identifying image shapes such as elongation, symmetry, number of appendages, and the relative length of appendages.

Vinz, F. L.↗

NASA NTRS1984

Peripheral vision displays: The future

Several areas of research relating to peripheral vision displays used by aircraft pilots are outlined: fiber optics, display color, and holography. Various capacities and specifications of gas and solid state lasers are enumerated. These lasers are potential sources of green light for the peripheral vision displays. The relative radiance required for rod and cone vision at different wavelengths is presented graphically. Calculated and measured retinal sensitivities (foveal and peripheral) are given for wavelength produced by various lasers.

Assenhein, H. M.↗

NASA NTRS1984

A production peripheral vision display system

A small number of peripheral vision display systems in three significantly different configurations were evaluated in various aircraft and simulator situations. The use of these development systems enabled the gathering of much subjective and quantitative data regarding this concept of flight deck instrumentation. However, much was also learned about the limitations of this equipment which needs to be addressed prior to wide spread use. A program at Garrett Manufacturing Limited in which the peripheral vision display system is redesigned and transformed into a viable production avionics system is discussed. Modular design, interchangeable units, optical attenuators, and system fault detection are considered with respect to peripheral vision display systems.

Heinmiller, B.↗

NASA NTRS1984

Some thoughts on the implementation of pilot night vision devices for helicopters

Night vision enhancement devices greatly expand the range and quality of services by extending night operational capabilities. Evolving military tactical concepts for helicopters survivability and battlefield effectiveness necessitate nap-of-the-earth (NOE) flying under both day and night conditions. From a pilot workload standpoint, flying a helicopter NOE in day VFR conditions with minimum clearance between rotors and obstacles is quite demanding. Doing the same job at night is several times more difficult. There are two general categories of night vision devices in operation in helicopter aviation: the Night Vision Goggles (NVG) and forward looking infrared (FLIR) system. The capabilities and limitations of those two devices are discussed.

Tucker, G. E.↗

NASA NTRS1985

Fuzzy vision - Multiple inputs speed image understanding

The fuzzy vision system designed for the interpretation of multiple successive images is described. The system is noise insensitive and can be mapped directly onto parallel processing hardware. The system consists of a region generator and a viewer which access a common semantic net; the components and operation of these subsystems are examined. The advantages and disadvantages of the fuzzy vision system are discussed. Diagrams of the region generator, viewer, and a semantic net are provided. An example depicting the operation of the fuzzy vision system is presented.

Meier, R. J., Jr.↗

NASA NTRS1986

A stereo model based upon mechanisms of human binocular vision

A model for stereo vision, which is based on the human-binocular vision system, is proposed. Data collected from studies of neurophysiology of the human binocular system are discussed. An algorithm for the implementation of this stereo vision model is derived. The algorithm is tested on computer-generated and real scene images. Examples of a computer-generated image and a grey-level image are presented. It is noted that the proposed method is computationally efficient for depth perception, and the results indicate accuracies that are noise tolerant.

Griswold, N. C.↗