Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Computer vision”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51

Automatic optical detection and classification of marine animals around MHK converters using machine vision

Optical systems provide valuable information for evaluating interactions and associations between organisms and MHK energy converters and for capturing potentially rare encounters between marine organisms and MHK device. The deluge of optical data from cabled monitoring packages makes expert review time-consuming and expensive. We propose algorithms and a processing framework to automatically extract events of interest from underwater video. The open-source software framework consists of background subtraction, filtering, feature extraction and hierarchical classification algorithms. This principle classification pipeline was validated on real-world data collected with an experimental underwater monitoring package. An event detection rate of 100% was achieved using robust principal components analysis (RPCA), Fourier feature extraction and a support vector machine (SVM) binary classifier. The detected events were then further classified into more complex classes – algae | invertebrate | vertebrate, one species | multiple species of fish, and interest rank. Greater than 80% accuracy was achieved using a combination of machine learning techniques.

16 TIDAL AND WAVE POWER↗

Distributed Cross-Channel Hierarchical Aggregation for Foundation Models

Vision-based scientific foundation models hold significant promise for advancing scientific discovery and innovation. This potential stems from their ability to aggregate images from diverse sources—such as varying physical groundings or data acquisition systems—and to learn spatio-temporal correlations using transformer architectures. However, tokenizing and aggregating images can be compute-intensive, a challenge not fully addressed by current distributed methods. In this work, we introduce the Distributed Cross-Channel Hierarchical Aggregation (D-CHAG) approach designed for datasets with a large number of channels across image modalities. Our method is compatible with any model-parallel strategy and any type of vision transformer architecture, significantly improving computational efficiency. We evaluated D-CHAG on hyperspectral imaging and weather forecasting tasks. When integrated with tensor parallelism and model sharding, our approach achieved up to a 75% reduction in memory usage and more than doubled sustained throughput on up to 1,024 AMD GPUs on the Frontier Supercomputer.

Tsaris, Aristeidis (aris) [ORNL] (ORCID:0000000277↗

Accelerating Computational Materials Discovery with Machine Learning and Cloud High-Performance Computing: from Large-Scale Screening to Experimental Validation

High-throughput computational materials discovery has promised significant acceleration of the design and discovery of new materials for many years. Despite a surge in interest and activity, the constraints imposed by large-scale computational resources present a significant bottleneck. Furthermore, examples of large-scale computational discovery carried through experimental validation remain scarce, especially for materials with product applicability. In this paper, we demonstrate how this vision became reality by first combining state-of-the-art artificial intelligence (AI) models and traditional physics-based models on cloud high performance computing (HPC) resources to quickly navigate through more than 32 million candidates and predict around half a million potentially stable materials. Focusing on solid-state electrolytes for battery applications, our discovery pipeline further identified 18 promising candidates with new compositions and rediscovered a decade’s worth of collective knowledge in the field as a byproduct. By employing around one thousand virtual machines in the cloud, this process took less than 80 hours. We then synthesized and experimentally characterized the structures and conductivities of our top candidates, the Na x Li 3-x YCl 6 (0.5 ≤ x ≤ 2.5) series, demonstrating the potential of these compounds to serve as solid electrolytes. Additional candidate materials are currently under experimental investigation that could offer more examples of the computational discovery of new phases of Li- and Na-conducting solid electrolytes. We believe this unprecedented approach of synergistically integrating AI models and cloud HPC not only accelerates materials discovery but also showcases the potency of AI-guided experimentation in unlocking transformative scientific breakthroughs with real-world applications.

36 MATERIALS SCIENCE↗

Comparison of Active and Passive Head Impulse Testing of the Horizontal Vestibulo-Ocular Reflex: Exploring the Feasibility of Different Approaches for Spaceflight

INTRODUCTION: Astronauts experience a wide variety of sensorimotor disturbances primarily due to microgravity-induced vestibular adaptations during spaceflight. Head Impulse Testing (HIT) will be conducted during the Complement of Integrated Protocols for Human Exploration Research program(CIPHER) Vestibular Health study to examine changes in the horizontal vestibulo-ocular reflex in response to high-velocity head movements to detect changes in peripheral vestibular function [1,2]. However, correct interpretation will require consideration of potential artifacts and the constraints of conducting this test across different phases of the mission. Therefore, the aims of our study were to (1) examine reliability across different test operators, and (2) compare results of active (aHIT) versus passive (pHIT) approaches to evaluate the feasibility of self-administered versus operator-assisted approaches. A comparison of responses with visual viewing of a wall target (default condition) versus vision occluded evaluated the influence of other oculomotor control influence across conditions, and comparison with computer-generated rotator head impulse tests (rHIT) examined the variability associated with the ocular responses independent of the variability in executing the head movements themselves. METHODS: Seventeen non-astronaut volunteers (male n=12, age=22.9 ± 3.0; female n=5, age=27.0 ± 6.0, mean ± std) completed HIT testing using video-oculography (VOG) goggles and a high-torque rotator system. The test order was counterbalanced across conditions: (1) passive head-on-torso (pHIT, default condition for flight study) using two operators (Op1 and Op2), (2) active head-on-torso (aHIT, subject initiated), and (3) passive head and torso using rotary chair (rHIT). Eye and head movement data were processed to obtain gain in each direction. The main outcome measures were average gain and asymmetry [1], as well as the percentage of acceptable trials not excluded due to insufficient head amplitude or recording artifacts. RESULTS: While the pHIT gains were similar with vision (1.032 ± 0.043) and vision occluded (1.029 ± 0.038) conditions, the percentage of acceptable trials was greater with vision (Op1 = 93.0%, Op2 = 93.2%) versus occluded (Op1 = 70.7%, Op2 = 67.6%). The reliability between operators was greater for pHIT gain (Intraclass Correlation, ICC = 0.66, p = 0.001) than for pHIT asymmetry (ICC = 0.57, p = 0.01). The percentage of acceptable trials reduced by ~20% during the self-administered aHITs for both visual conditions and tended to be lower than computer-generated rHITs (76% versus 83%). While the aHIT gains were not significantly different than pHIT gains for vision or vision occluded conditions, these measures were poorly correlated. Both aHIT and pHIT gains were significantly greater than the rHIT gains, presumably due to the reduced velocities from the rotator. The asymmetry measures were poorly correlated across pHIT, aHIT, and rHIT conditions, although none of the subjects had asymmetries greater than 16%. DISCUSSION: Our findings support the feasibility of using the standard pHIT methodology for spaceflight. Similarities between visual conditions reflect that these responses are mediated by the peripheral lateral canals rather than other oculomotor mechanisms. The inter-tester reliability was acceptable despite differences in the tester training. In addition to concerns of non-vestibular mechanisms introduced during self-administered aHITs [2], operator-assisted pHITs resulted in higher percentage of acceptable trials and should result in more efficient and reliable measures during spaceflight.

M R Ehrenburg↗

Optimizing colormaps with consideration for color vision deficiency to enable accurate interpretation of scientific data

Color vision deficiency (CVD) affects more than 4% of the population and leads to a different visual perception of colors. Though this has been known for decades, colormaps with many colors across the visual spectra are often used to represent data, leading to the potential for misinterpretation or difficulty with interpretation by someone with this deficiency. Until the creation of the module presented here, there were no colormaps mathematically optimized for CVD using modern color appearance models. While there have been some attempts to make aesthetically pleasing or subjectively tolerable colormaps for those with CVD, our goal was to make optimized colormaps for the most accurate perception of scientific data by as many viewers as possible. We developed a Python module, cmaputil , to create CVD-optimized colormaps, which imports colormaps and modifies them to be perceptually uniform in CVD-safe colorspace while linearizing and maximizing the brightness range. The module is made available to the science community to enable others to easily create their own CVD-optimized colormaps. In this paper, we present an example CVD-optimized colormap created with this module that is optimized for viewing by those without a CVD as well as those with red-green colorblindness. This colormap, cividis, enables nearly-identical visual-data interpretation to both groups, is perceptually uniform in hue and brightness, and increases in brightness linearly.

59 BASIC BIOLOGICAL SCIENCES↗

Zero-Trust Architecture for Autonomous Edge Computing

We are at the apex of an aviation revolution where autonomy will play a central role in enabling complex, multi-agent systems to communicate, interact, and collaborate on a myriad of applications spanning autonomous swarms to wild-fire management. Autonomy is not an absolute but rather a spectrum ranging from a system requiring significant human intervention to one requiring little to none [1]. For example, the extreme, in the case of an autonomous aircraft, is one that operates independently in the airspace interacting with all other elements (air traffic controllers, other pilots) as if it were a human pilot. Critical to this vision is an architecture that enables autonomous agents to interact with minimal latency. Edge computing is an emerging architecture where compute and storage is pushed to the ‘edge’ of the network in order to minimize the round-trip time from agent to resource thereby mitigating the latency associated with cloud-only based approaches. Additionally, services can generate massive amounts of data (e.g., video feeds), which may require analysis in near real-time. Moving this data to the cloud for further processing may not be feasible due to latency, bandwidth, and cost. Privacy, security, and reliability can also be improved by edge computing architectures. However, this geo-distributed and dynamic* architecture complicates the establishment of unambiguous network security boundaries and can lead to vulnerabilities including man in the middle attacks, replay attacks, physical security breaches of edge nodes, signal interception, etc. This motivates the need for zero-trust architectures [2–4] which de-emphasize the notion of static network perimeters and, as the name implies, do not instill any innate trust in any particular agent. It is required that all agents must be authorized and approved in every transaction. In this paper, we present a zero-trust architecture suitable for edge-computing applications that demand significant low-latency, security, privacy, and reliability.

zero trust↗

Vision based obstacle detection and grouping for helicopter guidance

Electro-optical sensors can be used to compute range to objects in the flight path of a helicopter. The computation is based on the optical flow/motion at different points in the image. The motion algorithms provide a sparse set of ranges to discrete features in the image sequence as a function of azimuth and elevation. For obstacle avoidance guidance and display purposes, these discrete set of ranges, varying from a few hundreds to several thousands, need to be grouped into sets which correspond to objects in the real world. This paper presents a new method for object segmentation based on clustering the sparse range information provided by motion algorithms together with the spatial relation provided by the static image. The range values are initially grouped into clusters based on depth. Subsequently, the clusters are modified by using the K-means algorithm in the inertial horizontal plane and the minimum spanning tree algorithms in the image plane. The object grouping allows interpolation within a group and enables the creation of dense range maps. Researchers in robotics have used densely scanned sequence of laser range images to build three-dimensional representation of the outside world. Thus, modeling techniques developed for dense range images can be extended to sparse range images. The paper presents object segmentation results for a sequence of flight images.

Sridhar, Banavar↗

The EPEC Algorithm for Vision Guided Manipulation: Analysis and Validation

This paper describes the simulated performance and experimental validation of a computationally efficient algorithm for improving positioning accuracy of robot arms using low speed feedback from fixed stereo cameras. The algorithm, called End-Effector Position Error Compensation (EPEC) is robust to visual occlusion of the end-effector and does not require high fidelity calibration of either the arm or stereo camera. The algorithm works by calculating an error vector between the locations of a fiducial on the arm's end-effector as predicted by arm kinematics and detected by a stereo camera triangulation. With this knowledge, the commanded target pose is adjusted to compensate for positioning errors. A simulation environment where arbitrary error can be introduced into arm-camera systems is introduced and used to provide an assessment of the performance of the algorithm under both ideal and degraded conditions.

manipulations↗

Development of utility generic functional requirements for electronic work packages and computer-based procedures - 273

The Nuclear Electronic Work Packages - Enterprise Requirements (NEWPER) initiative is a step toward a vision of implementing an eWP framework that includes many types of eWPs. This will enable immediate paper-related cost savings in work management and provide a path to future labor efficiency gains through enhanced integration and process improvement in support of the Nuclear Promise (Nuclear Energy Institute 2016). The NEWPER initiative was organized by the Nuclear Information Technology Strategic Leadership (NITSL) group, which is an organization that brings together leaders from the nuclear utility industry and regulatory agencies to address issues involved with information technology used in nuclear-power utilities. NITSL strives to maintain awareness of industry information technology-related initiatives and events and communicates those events to its membership. NITSL and Light Water Reactor Sustainability Program researchers have been coordinating activities, including joint organization of NEWPER-related meetings and report development. The main goal of the NEWPER initiative was to develop a set of utility generic functional requirements for eWP systems. This set of requirements will support each utility in their process of identifying plant-specific functional and non-functional requirements. The NEWPER initiative has 140 members where the largest group of members consists of 19 commercial U.S. nuclear utilities and eleven of the most prominent vendors of eWP solutions. Through the NEWPER initiative two sets of functional requirements were developed; functional requirements for electronic work packages and functional requirements for computer-based procedures. This paper will describe the development process as well as a summary of the requirements. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

ObstacleSense: Low-Power Neuromorphic Vision for Corridor Obstacle Awareness in Low-Level ADAS

The automotive industry’s pursuit of Level 5 autonomy is constrained by substantial perception-compute power requirements, often reaching 1, 000 + watts in full autonomy stacks. Reducing this energy burden requires rethinking perception not only at the high-end autonomy level, but also at the foundational Advanced Driver Assistance Systems (ADAS) level where low-power, safety-critical sensing can have broad impact. Neuromorphic vision provides a promising starting point: HD Dynamic Vision Sensors (DVS) can operate below 100 mW at the sensor level by reporting only asynchronous brightness changes. However, low-power sensing alone is insufficient if downstream perception reintroduces dense, energy-intensive computation. In particular, many event-driven object-detection pipelines still rely on CNN backbones, while purely spiking alternatives often trade away accuracy or ignore deployment constraints. We introduce ObstacleSense, a highly compact, CNN-free hybrid ANN–SNN framework for Level 0–1 forward-corridor obstacle awareness. Instead of performing full-scene object detection with a convolutional feature backbone, ObstacleSense targets the safety-critical question of whether the ego corridor is occupied and how far the nearest obstacle is. The architecture combines polarity-conditioned event encoding, lightweight temporal spiking dynamics, axial spatial mixing, and coarse-to-fine range estimation within a regular fixed-grid compute pattern. This design avoids the dense CNN backbone commonly used in event-based detection while maintaining a small state footprint suitable for eventual small-FPGA deployment. Before hardware mapping, we evaluate the software implementation using a model-side power proxy derived from MACs, weight and activation traffic, and spiking state updates under shared FP16 assumptions. On simulated CARLA event corpora, the deployment-oriented model achieves 0.9464 objectness F1, 0.9978 grid-level mAP, and 0.8987 m distance Mean Absolute Error at an estimated 1.92 mW proxy cost, while maintaining performance on unseen generalization test sequences.

Johnson-Scott, Zac [ORNL]↗

A Blockchain-Enabled Sustainable Safety Management Framework for Connected Vehicles

The notion of an intelligent transportation system (ITS) aims to boost the performance of transportation networks, which has gained more and more traction in both academic and commercial circles. ITS is a constantly evolving vision that combines cutting-edge transportation approaches with new information, communication, computers, and other technology. ITS should discover consequence routes to enhance the sustainability, safety, and trustworthiness of the entire transportation system utilizing emerging technologies. In this paper, a sustainable safety management framework for connected vehicles is proposed by integrating blockchain. It introduces smart transportation equipment called an AI-enabled vehicle smart device (AVSD) for vehicular communications. AVSD can reduce energy consumption by decreasing the computational costs in vehicular communications. Smart contracts are used to identify vehicles automatically and establish secure communication among vehicles and emergency service stations (ESSs) like hospitals, police stations, and fire stations. The experiment results show that the proposed framework provides a communication environment for sustainable safety and security using the introduced smart transportation device. In conclusion, the proposed blockchain-enabled sustainable safety management framework has the potential to improve safety and sustainability in the transportation industry by creating a secure, decentralized, and transparent platform for managing safety data and promoting safe and sustainable driving behaviors.

42 ENGINEERING↗

Chromatic information and feature detection in fast visual analysis

The visual system is able to recognize a scene based on a sketch made of very simple features. This ability is likely crucial for survival, when fast image recognition is necessary, and it is believed that a primal sketch is extracted very early in the visual processing. Such highly simplified representations can be sufficient for accurate object discrimination, but an open question is the role played by color in this process. Rich color information is available in natural scenes, yet artist's sketches are usually monochromatic; and, black-andwhite movies provide compelling representations of real world scenes. Also, the contrast sensitivity of color is low at fine spatial scales. We approach the question from the perspective of optimal information processing by a system endowed with limited computational resources. We show that when such limitations are taken into account, the intrinsic statistical properties of natural scenes imply that the most effective strategy is to ignore fine-scale color features and devote most of the bandwidth to gray-scale information. We find confirmation of these information-based predictions from psychophysics measurements of fast-viewing discrimination of natural scenes. As a result, we conclude that the lack of colored features in our visual representation, and our overall low sensitivity to high-frequency color components, are a consequence of an adaptation process, optimizing the size and power consumption of our brain for the visual world we live in.

97 MATHEMATICS AND COMPUTING↗

Water NSTF Design, Instrumentation, and Test Planning

The following report serves as a formal introduction to the water-based Natural convection Shutdown heat removal Test Facility (NSTF) program at Argonne. Since 2005, this US Department of Energy (DOE) sponsored program has conducted large scale experimental testing to generate high-quality and traceable validation data for guiding design decisions of the Reactor Cavity Cooling System (RCCS) concept for advanced reactor designs. The most recent facility iteration, and focus of this report, is the operation of a 1/2 scale model of a water-RCCS concept. Several features of the NSTF prototype align with the conceptual design that has been publicly released for the AREVA 625 MWt SC-HTGR. The design of the NSTF also retains all aspects common to a fundamental boiling water thermosiphon, and thus is well poised to provide necessary experimental data to advance basic understanding of natural circulation phenomena and contribute to computer code validation. Overall, the NSTF program operates to support the DOE vision of aiding US vendors in design choices of future reactor concepts, advancing the maturity of codes for licensing, and ultimately developing safe and reliable reactor technologies. In this report, the top-level program objectives, testing requirements, and unique considerations for the water cooled test assembly are discussed, and presented in sufficient depth to support defining the program’s overall scope and purpose. A discussion of the proposed 6-year testing program is then introduced, which outlines the specific strategy and testing plan for facility operations. The proposed testing plan has been developed to meet the toplevel objective of conducting high-quality test operations that span across a broad range of single- and two-phase operating conditions. Details of characterization, baseline test cases, accident scenario, and parametric variations are provided, including discussions of later-stage test cases that examine the influence of geometric variations and off-normal configurations. The facility design follows, including as-built dimensions and specifications of the various mechanical and liquid systems, design choices for the test section, water storage tank, and network piping. Specifications of the instrumentation suite are then presented, along with specific information on performance windows, measurement uncertainties, and installation locations. Finally, descriptions of the control systems and heat removal networks are provided, which have been engineered to support precise quantification of energy balances and facilitate well-controlled test operations.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Real-time tracking using stereo and motion: Visual perception for space robotics

The state-of-the-art in computing technology is rapidly attaining the performance necessary to implement many early vision algorithms at real-time rates. This new capability is helping to accelerate progress in vision research by improving our ability to evaluate the performance of algorithms in dynamic environments. In particular, we are becoming much more aware of the relative stability of various visual measurements in the presence of camera motion and system noise. This new processing speed is also allowing us to raise our sights toward accomplishing much higher-level processing tasks, such as figure-ground separation and active object tracking, in real-time. This paper describes a methodology for using early visual measurements to accomplish higher-level tasks; it then presents an overview of the high-speed accelerators developed at Teleos to support early visual measurements. The final section describes the successful deployment of a real-time vision system to provide visual perception for the Extravehicular Activity Helper/Retriever robotic system in tests aboard NASA's KC135 reduced gravity aircraft.

Nishihara, H. Keith↗

RCA: Modeling Tools for CLmax Prediction

TACP06 is aimed at further research in maturing eddy-resolving modeling tools, in their accuracy and efficiency, and demonstrating the tools for application to the prediction of aircraft maximum lift (CLmax). The goal is to achieve CLmaxprediction accuracy of the same level as in aircraft certification flight tests. This will require comparison of various modeling approaches against experimental results from the planned wind tunnel tests, down selecting an approach, further maturing the technology and validating against flight test data. Advances in computational fluid dynamics (CFD) over the last several decadeshas fundamentally changed the aerospace design process. Advanced simulation capabilities not only enable reductions in ground-based and in-flight testing requirements, but also provide added physical insight, enable superior designs at reduced cost and risk, and open upnew frontiers in aerospace vehicle design and performance. The NASA sponsored CFD Vision 2030 Study, while highlighting these accomplishments, brought out several challenges and deficiencies in the computational technology and developed a research roadmap for advancing the state-of-the-art required for enabling NASA missions in aeronautics and space applications. Based on TC TACP01 research completed in May 2018, it became clear that unsteady flow simulation capability is needed for expanding the role of CFD across the entire flight envelope to enable design of future advanced aircraft and space vehicles, and that capability will be the primary outcome of this technical challenge.

Mujeeb R Malik↗

Integrated Computational-Experimental Development of Lithium-Air Batteries for Electric Aircraft

The primary obstacle to enable NASA's vision of Green Aviation is the extraordinary energy storage requirements for electric aircraft. Significant advances in high energy, rechargeable, safe batteries are required to enable electric aviation. Boeing's SUGAR and NASA studies have identified 400 Wh/kg as the threshold energy density for general aviation and 750 Wh/kg for commercial regional air service. State of the Art Lithium Ion Battery (LIB) technology currently has a density of 200 Wh/kg and is expected to plateau at 300 Wh/kg due to fundamental chemistry limitations making it unsuitable for future electric aircraft. Additional demanding requirements include high power, rechargeability, and high safety. Such battery technology does not currently exist. The recent considerable activity in battery research (DOE, Tesla Gigafactory, etc) overwhelmingly has been geared towards reducing cost and improving safety of LIB technology in order to promote the adoption of electric automobiles; and thus it is expected to have little impact on electric aviation development. New battery materials will be needed for the "Beyond Li Ion" (BLI) technologies required for high energy, safe electric aviation. Li-Air batteries have the highest known theoretical energy density (3400 Wh/kg) and therefore and if realized promises to transform the global transportation system. These high energy batteries have the potential to meet the energy storage challenges of current and future NASA aeronautics and space missions in addition to many terrestrial transportation applications as well. However, this technology requires significant components development and integration, as it is currently unable to achieve aircraft requirements. The objective of this project is to leverage modern computational materials methods combined with battery multiphysics tools to develop radically advanced compatible cathode and electrolyte materials, build several Li-Air cells, and flight-demonstrate the corresponding Li-Air battery packs. A significant problem for current Lithium-Air batteries is large scale decomposition of the battery electrolyte during operation leading to battery failure after a handful of charge/discharge cycles. Therefore, development of large scale, ultra-high energy, rechargeable, and safe Lithium-Air batteries require highly stable electrolytes that are resistant to decomposition under operating conditions. A NASA-based cross-organizational "dream team" of high-powered experts combined integrated supercomputer modeling, fundamental chemistry analysis, advanced material science, and battery cell development to tackle this very challenging, multidisciplinary problem. The ultimate goal for the team is to develop an integrated experimental/computational infrastructure to produce a reliable predictive capability for the selection of optimal components, their fabrication parameters, and "design rules" of novel cell components for advanced ultra-high energy batteries that can meet energy storage challenges of NASA missions and many terrestrial transportation applications.

Li-air battery↗

Synthetic Vision Systems

A synthetic vision system is an aircraft cockpit display technology that presents the visual environment external to the aircraft using computer-generated imagery in a manner analogous to how it would appear to the pilot if forward visibility were not restricted. The purpose of this chapter is to review the state of synthetic vision systems, and discuss selected human factors issues that should be considered when designing such displays.

Prinzel, L.J.↗

Computing 3-D structure of rigid objects using stereo and motion

Work performed as a step toward an intelligent automatic machine vision system for 3-D imaging is discussed. The problem considered is the quantitative 3-D reconstruction of rigid objects. Motion and stereo are the two clues considered in this system. The system basically consists of three processes: the low level process to extract image features, the middle level process to establish the correspondence in the stereo (spatial) and motion (temporal) modalities, and the high level process to compute the 3-D coordinates of the corner points by integrating the spatial and temporal correspondences.

Nguyen, Thinh V.↗