Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “computer vision”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51

Terrain Portrayal for Head-Down Displays Experiment

The General Aviation Element of the Aviation Safety Program's Synthetic Vision Systems (SVS) Project is developing technology to eliminate low visibility induced General Aviation (GA) accidents. SVS displays present computer generated 3-dimensional imagery of the surrounding terrain on the Primary Flight Display (PFD) to greatly enhance pilot's situation awareness (SA), reducing or eliminating Controlled Flight into Terrain, as well as Low-Visibility Loss of Control accidents. SVS-conducted research is facilitating development of display concepts that provide the pilot with an unobstructed view of the outside terrain, regardless of weather conditions and time of day. A critical component of SVS displays is the appropriate presentation of terrain to the pilot. An experimental study has been conducted at NASA Langley Research Center (LaRC) to explore and quantify the relationship between the realism of the terrain presentation and resulting enhancements of pilot SA and pilot performance. Composed of complementary simulation and flight test efforts, Terrain Portrayal for Head-Down Displays (TP-HDD) experiments will help researchers evaluate critical terrain portrayal concepts. The experimental effort is to provide data to enable design trades that optimize SVS applications, as well as develop requirements and recommendations to facilitate the certification process. This paper focuses on the experimental set-up and preliminary qualitative results of the TP-HDD simulation experiment. In this experiment a fixed based flight simulator was equipped with various types of Head Down flight displays, ranging from conventional round dials (typical of most GA aircraft) to glass cockpit style PFD's. The variations of the PFD included an assortment of texturing and Digital Elevation Model (DEM) resolution combinations. A test matrix of 10 terrain display configurations (in addition to the baseline displays) were evaluated by 27 pilots of various backgrounds and experience levels. Qualitative (questionnaires) and quantitative (pilot performance and physiological) data were collected during the experimental runs. Preliminary results indicate that all of the evaluation pilots favored SVS displays over standard gauges, in terms of terrain awareness, SA, and perceived pilot performance. Among the terrain portrayal concepts tested, most pilots preferred the higher-resolution DEM. In addition, with minimal training, low-hour VFR evaluation pilots were able to negotiate a precision approach using SVS displays with a tunnel in the sky guidance concept.

Hughes, Monica F.↗

Format for Interchange and Display of 3D Terrain Data

Visible Scalable Terrain (ViSTa) is a software format for production, interchange, and display of three-dimensional (3D) terrain data acquired by stereoscopic cameras of robotic vision systems. ViSTa is designed to support scalability of data, accuracy of displayed terrain images, and optimal utilization of computational resources. In a ViSTa file, an area of terrain is represented, at one or more levels of detail, by coordinates of isolated points and/or vertices of triangles derived from a texture map that, in turn, is derived from original terrain images. Unlike prior terrain-image software formats, ViSTa includes provisions to ensure accuracy of texture coordinates. Whereas many such formats are based on 2.5-dimensional terrain models and impose additional regularity constraints on data, ViSTa is based on a 3D model without regularity constraints. Whereas many prior formats require external data for specifying image-data coordinate systems, ViSTa provides for the inclusion of coordinate-system data within data files. ViSTa admits highspeed loading and display within a Java program. ViSTa is designed to minimize file sizes and maximize compressibility and to support straightforward reduction of resolution to reduce file size for Internet-based distribution.

Backes, Paul↗

Improved Collision-Detection Method for Robotic Manipulator

An improved method has been devised for the computational prediction of a collision between (1) a robotic manipulator and (2) another part of the robot or an external object in the vicinity of the robot. The method is intended to be used to test commanded manipulator trajectories in advance so that execution of the commands can be stopped before damage is done. The method involves utilization of both (1) mathematical models of the robot and its environment constructed manually prior to operation and (2) similar models constructed automatically from sensory data acquired during operation. The representation of objects in this method is simpler and more efficient (with respect to both computation time and computer memory), relative to the representations used in most prior methods. The present method was developed especially for use on a robotic land vehicle (rover) equipped with a manipulator arm and a vision system that includes stereoscopic electronic cameras. In this method, objects are represented and collisions detected by use of a previously developed technique known in the art as the method of oriented bounding boxes (OBBs). As the name of this technique indicates, an object is represented approximately, for computational purposes, by a box that encloses its outer boundary. Because many parts of a robotic manipulator are cylindrical, the OBB method has been extended in this method to enable the approximate representation of cylindrical parts by use of octagonal or other multiple-OBB assemblies denoted oriented bounding prisms (OBPs), as in the example of Figure 1. Unlike prior methods, the OBB/OBP method does not require any divisions or transcendental functions; this feature leads to greater robustness and numerical accuracy. The OBB/OBP method was selected for incorporation into the present method because it offers the best compromise between accuracy on the one hand and computational efficiency (and thus computational speed) on the other hand.

Leger, Chris↗

Physiological Health Challenges for Human Missions to Mars

During the next decades, manned space missions are expected to be aiming at the Lagrange points, near Earth asteroids, and Mars flyby and/or landing. The question is therefore: Are we ready to go? To answer this with a yes, we are currently using the International Space Station to develop an integrated human physiological countermeasure suite. The integrated countermeasure suite will most likely encounter: 1) Exercise devices for aerobic, dynamic and resistive exercise training; 2) sensory‐motor computer training programs and anti‐motion sickness medication for preparing EVAs and G‐transitions; 3) lower limb bracelets for preventing and/or treating the VIIP (vision impairment and intracranial pressure) syndrome; 4) nutritional components for maintenance of bone, muscle, the cardiovascular system and preventing oxidative stress and damage and immune deficiencies (e. g. omega‐3 fatty acids, PRO/K, anti‐oxidants and less salt and iron); 5) bisphosphonates for preventing bone degradation.; 6) lower body compression garment and oral salt and fluid loading for landing on a planetary surface to combat orthostatic intolerance; 7) laboratory analysis equipment for individualized monitoring of biomarkers in blood, urine and saliva for estimation of health status in; 8) advanced ultrasound techniques for monitoring bone and cardiovascular health; and 9) computer modeling programs for individual health status assessments of efficiency and subsequent adjustments of countermeasures. In particular for future missions into deep space, we are concerned with the synergistic effects of weightlessness, radiation, operational constraints and other spaceflight environmental factors. Therefore, increased collaboration between physiological, behavioral, radiation and space vehicle design disciplines are strongly warranted. Another venue we are exploring in NASA's Human Research Program is the usefulness of artificial gravity for mitigating the health risks of long duration weightlessness.

Norsk, Peter↗

Probabilistic Neural Computing with Stochastic Devices

Abstract The brain has effectively proven a powerful inspiration for the development of computing architectures in which processing is tightly integrated with memory, communication is event‐driven, and analog computation can be performed at scale. These neuromorphic systems increasingly show an ability to improve the efficiency and speed of scientific computing and artificial intelligence applications. Herein, it is proposed that the brain's ubiquitous stochasticity represents an additional source of inspiration for expanding the reach of neuromorphic computing to probabilistic applications. To date, many efforts exploring probabilistic computing have focused primarily on one scale of the microelectronics stack, such as implementing probabilistic algorithms on deterministic hardware or developing probabilistic devices and circuits with the expectation that they will be leveraged by eventual probabilistic architectures. A co‐design vision is described by which large numbers of devices, such as magnetic tunnel junctions and tunnel diodes, can be operated in a stochastic regime and incorporated into a scalable neuromorphic architecture that can impact a number of probabilistic computing applications, such as Monte Carlo simulations and Bayesian neural networks. Finally, a framework is presented to categorize increasingly advanced hardware‐based probabilistic computing technologies.

Misra, Shashank↗

Intelligent vision system for autonomous vehicle operations

A complex optical system consisting of a 4f optical correlator with programmatic filters under the control of a digital on-board computer that operates at video rates for filter generation, storage, and management is described.

Scholl, Marija S.↗

Missileborne Artificial Vision System (MAVIS)

Several years ago when INTEL and China Lake designed the ETANN chip, analog VLSI appeared to be the only way to do high density neural computing. In the last five years, however, digital parallel processing chips capable of performing neural computation functions have evolved to the point of rough equality with analog chips in system level computational density. The Naval Air Warfare Center, China Lake, has developed a real time, hardware and software system designed to implement and evaluate biologically inspired retinal and cortical models. The hardware is based on the Adaptive Solutions Inc. massively parallel CNAPS system COHO boards. Each COHO board is a standard size 6U VME card featuring 256 fixed point, RISC processors running at 20 MHz in a SIMD configuration. Each COHO board has a companion board built to support a real time VSB interface to an imaging seeker, a NTSC camera, and to other COHO boards. The system is designed to have multiple SIMD machines each performing different corticomorphic functions. The system level software has been developed which allows a high level description of corticomorphic structures to be translated into the native microcode of the CNAPS chips. Corticomorphic structures are those neural structures with a form similar to that of the retina, the lateral geniculate nucleus, or the visual cortex. This real time hardware system is designed to be shrunk into a volume compatible with air launched tactical missiles. Initial versions of the software and hardware have been completed and are in the early stages of integration with a missile seeker.

Andes, David K.↗

VISION: a modular AI assistant for natural human-instrument interaction at scientific user facilities

Scientific user facilities, such as synchrotron beamlines, are equipped with a wide array of hardware and software tools that require a codebase for human-computer-interaction. This often necessitates developers to be involved to establish connection between users/researchers and the complex instrumentation. The advent of generative AI presents an opportunity to bridge this knowledge gap, enabling seamless communication and efficient experimental workflows. Here we present a modular architecture for the Virtual Scientific Companion by assembling multiple AI-enabled cognitive blocks that each scaffolds large language models (LLMs) for a specialized task. With VISION, we performed LLM-based operation on the beamline workstation with low latency and demonstrated the first voice-controlled experiment at an x-ray scattering beamline. The modular and scalable architecture allows for easy adaptation to new instruments and capabilities. Development on natural language-based scientific experimentation is a building block for an impending future where a science exocortex—a synthetic extension to the cognition of scientists—may radically transform scientific practice and discovery.

36 MATERIALS SCIENCE↗

Technology transfer of operator-in-the-loop simulation

The technology developed for operator-in-the-loop simulation in space teleoperation has been applied to Caterpillar's backhoe, wheel loader, and off-highway truck. On an SGI workstation, the simulation integrates computer modeling of kinematics and dynamics, real-time computational and visualization, and an interface with the operator through the operator's console. The console is interfaced with the workstation through an IBM-PC in which the operator's commands were digitized and sent through an RS-232 serial port. The simulation gave visual feedback adequate for the operator in the loop, with the camera's field of vision projected on a large screen in multiple view windows. The view control can emulate either stationary or moving cameras. This simulator created an innovative engineering design environment by integrating computer software and hardware with the human operator's interactions. The backhoe simulation has been adopted by Caterpillar in building a virtual reality tool for backhoe design.

Yae, K. H.↗

ESMD Space Grant Faculty Report

The strength of the Exploration Systems Mission Directorate ESMD Faculty Project lies in its ability to meet National Aeronautics Space Administration NASA's Strategic Educational Outcome 1 by developing a sustainable and long-term integration of student involvement at academic institutions with all NASA Centers. This outcome is achieved by a three-fold approach: 1) by collecting Senior Design projects pertaining to Constellation work performed at each of the ten NASA Centers, 2) by engaging students at Minority Serving Institutions in the art of systems engineering and systems design of technologies required for space exploration, and 3) by identifying potential internships at each Center relative to exploration that provide students who are supported by their institutional Space Grant to engage in on-going mission-level and explorative systems designs. The objectives of the ESMD Faculty Project are to: 1. Aid the Centers (both Education Offices and associated technical organizations) in providing relevant opportunities for the ESMD Space Grant Program to support student and faculty in Senior Design projects 2. Enable better matches between the ESMD work required and what the Space Grant Consortia can do to effectively contribute to NASA programs 3. Provide the Space Grant Consortia an opportunity to strengthen relations with the NASA Centers 4. Develop better collective understanding of the U.S. Space Exploration Policy by the Center, Space Grant, faculty, Education Office, and students 5. Enable Space Grant institution faculty to better prepare their students to meet current and future NASA needs 6. Enable the Center Education Offices to strengthen their ties to their technical organizations and Space Grant Consortia 7. Aid KSC in gaining a greater and more detailed understanding of each of the Center activities Senior Design projects are intended to stimulate undergraduate students on current NASA activities related to lunar, Mars, and other planetary missions and to bring out innovative and novel ideas that can be used to complement those currently under development at respective NASA Centers. Additionally, such academic involvement would better the prospects for graduating seniors to pursue graduate studies and to seek careers in the space industry with a strong sense for systems engineering and understanding of design concepts. Internships, on the other hand, are intended to provide hands-on experience to students by engaging them in diverse state-of-the-art technology development, prototype bread-boarding, computer modeling and simulations, hardware and software testing, and other activities that provide students a strong perspective of NASA's vision and mission in enhancing the knowledge of Earth and space planetary sciences. Ten faculty members, each from a Space Grant Consortium-affiliated university, worked at ten NASA Centers for five weeks between June 2 and July 3, 2008. The project objectives listed above were achieved. In addition to collecting data on Senior Design ideas and identifying possible internships that would benefit NASA/ESMD, the faculty fellows promoted and collected data when required for other ESMD-funded programs and helped the Center's Education Office, as,needed. 4

Guo, Jiang↗

Comprehensive Material Characterization and Simultaneous Model Calibration for Improved Computational Simulation Credibility

Computational simulation is increasingly relied upon for high-consequence engineering decisions, and a foundational element to solid mechanics simulations is a credible material model. Our ultimate vision is to interlace material characterization and model calibration in a real-time feedback loop, where the current model calibration results will drive the experiment to load regimes that add the most useful information to reduce parameter uncertainty. The current work investigated one key step to this Interlaced Characterization and Calibration (ICC) paradigm, using a finite load-path tree to incorporate history/path dependency of nonlinear material models into a network of surrogate models that replace computationally-expensive finite-element analyses. Our reference simulation was an elastoplastic material point subject to biaxial deformation with a Hill anisotropic yield criterion. Training data was generated using either a space-filling or adaptive sampling method, and surrogates were built using either Gaussian process or polynomial chaos expansion methods. Surrogate error was evaluated to be on the order of 10 ⁻5 and 10 ⁻3 percent for the space-filling and adaptive sampling training data, respectively. Direct Bayesian inference was performed with the surrogate network and with the reference material point simulator, and results agreed to within 3 significant figures for the mean parameter values, with a reduction in computational cost over 5 orders of magnitude. These results bought down risk regarding the surrogate network and facilitated a successful FY22-24 full LDRD proposal to research and develop the complete ICC paradigm.

36 MATERIALS SCIENCE↗

Pyomo.GDP: an ecosystem for logic based modeling and optimization development

We present three core principles for engineering-oriented integrated modeling and optimization tool sets—intuitive modeling contexts, systematic computer-aided reformulations, and flexible solution strategies—and describe how new developments in Pyomo.GDP for Generalized Disjunctive Programming (GDP) advance this vision. We describe a new logical expression system implementation for Pyomo.GDP allowing for a more intuitive description of logical propositions. The logical expression system supports automated reformulation of these logical constraints to linear constraints. We also describe two new logic-based global optimization solver implementations built on Pyomo.GDP that exploit logical structure to avoid “zero-flow” numerical difficulties that arise in nonlinear network design problems when nodes or streams disappear. These new solvers also demonstrate the capability to link to external libraries for expanded functionality within an integrated implementation. We present these new solvers in the context of a flexible array of solution paths available to GDP models. Finally, we present results on a new library of GDP models demonstrating the value of multiple solution approaches.

42 ENGINEERING↗

Synthetic estimation filters for a control system

Hybrid optical correlators, which use spatial light modulators and solid state imagers to interface computers and optical Fourier correlators, will allow the rapid changing of filters and digital pre- or post-correlation processing in vision systems. However, optical correlation (particulary with phase-only filtration) is notoriously sensitive to mismatches of rotation and magnification between the reference image and the input image. Such sharpness is not always desirable if the correlation pattern is to be used in a control system. Two methods of conforming the response of an inherently sharp-response optical correlation to an in plane rotation between reference and object images are discussed. The objective is to condition the correlation for better suitability to a vision-controlled system. The first method is controlled convolutional blurring of a reference image followed by construction of a matched filter (perhaps implemented as a phase-only filter). An alternative is discussed in more detail: it is a synthesis from sharp filters, so weighted as to produce a specified off-center behavior.

Juday, Richard D.↗

Advanced flight computers for planetary exploration

Research concerning flight computers for use on interplanetary probes is reviewed. The history of these computers from the Viking mission to the present is outlined. The differences between ground commercial computers and computers for planetary exploration are listed. The development of a computer for the Mariner Mark II comet rendezvous asteroid flyby mission is described. Various aspects of recently developed computer systems are examined, including the Max real time, embedded computer, a hypercube distributed supercomputer, a SAR data processor, a processor for the High Resolution IR Imaging Spectrometer, and a robotic vision multiresolution pyramid machine for processsing images obtained by a Mars Rover.

Stephenson, R. Rhoads↗

Jet Propulsion Laboratory/Kennedy Space Center telerobotic inspection and manipulation demonstration

The goal of this effort is to demonstrate telerobotic inspection and mainpulation of space shuttle payloads in the presence of substantial communications time delays between the operator station and the robotic work space. The processing of space shuttle payloads provides a variety of tasks which are typical of both space shuttle ground operations and Space Station in-flight operations, and communications time delays are inevitable in space operations where the operator station will be light-seconds away from the telerobot. With this demonstration we hope to show the efficacy and safety of robotic technology for ground and space operations. Our approach is to develop an experimental telerobotic system with the remote sensing, actuation and reflex portions located at KSC in Florida, while the operator control station will be located at Jet Propulsion Laboratory (JPL) in California. The JPL portion of the system includes a high-level operator interface, intelligent spatial planning and machine vision, while the KSC portion includes the robot arm, end effectors, cameras and proximity sensors, and the necessary control and communications computers and software. The communications between JPL and KSC are over a limited-bandwidth network channel (19200 baud) with unpredictable and unrepeatable time delays. In FY89 we integrated a basic version of the robotic, communications, and computer hardware, and we developed the software to perform an operator-supervised inspection of a PAM-D satellite upper stage rocket motor and its shuttle support cradle. The demonstration, though severely limited by the bulk of the available computer arm, showed the potential of telerobotics for inspection tasks. In the future, we plan to develop additional capabilities which will allow manipulation tasks to be performed, including removal of dust covers and lens caps, insertion of connectors and batteries, and installation of payload objects.

Wilcox, Brian↗

Visual end-effector position error compensation for planetary robotics

This paper describes a vision-guided manipulation algorithm that improves arm end-effector positioning to subpixel accuracy and meets the highly restrictive imaging and computational constraints of a planetary robotic flight system. Analytical, simulation-based, and experimental analyses of the algorithm's effectiveness and sensitivity to camera and arm model error is presented along with results on several prototype research systems and ground-in-the-loop technology experiments on the Mars Exploration Rover (MER) vehicles. A computationally efficient and robust subpixel end-effector fiducial detector that is instrumental to the algorithm's ability to achieve high accuracy is also described along with its validation results on MER data.

Nickels, Kevin↗

Synthetic Vision Systems in GA Cockpit-Evaluation of Basic Maneuvers Performed by Low Time GA Pilots During Transition from VMC to IMC

An experimental investigation was conducted to study the effectiveness of modern flight displays in general aviation cockpits for mitigating Low Visibility Loss of Control and the Controlled Flight Into Terrain accidents. A total of 18 General Aviation (GA) pilots with private pilot, single engine land rating, with no additional instrument training beyond private pilot license requirements, were recruited to evaluate three different display concepts in a fixed-based flight simulator at the NASA Langley Research Center's General Aviation Work Station. Evaluation pilots were asked to continue flight from Visual Meteorological Conditions (VMC) into Instrument Meteorological Conditions (IMC) while performing a series of 4 basic precision maneuvers. During the experiment, relevant pilot/vehicle performance variables, pilot control inputs and physiological data were recorded. Human factors questionnaires and interviews were administered after each scenario. Qualitative and quantitative data have been analyzed and the results are presented here. Pilot performance deviations from the established target values (errors) were computed and compared with the FAA Practical Test Standards. Results of the quantitative data indicate that evaluation pilots committed substantially fewer errors when using the Synthetic Vision Systems (SVS) displays than when they were using conventional instruments. Results of the qualitative data indicate that evaluation pilots perceived themselves to have a much higher level of situation awareness while using the SVS display concept.

Takallu, M. A.↗

A History of High-Performance Computing

Faster than most speedy computers. More powerful than its NASA data-processing predecessors. Able to leap large, mission-related computational problems in a single bound. Clearly, it s neither a bird nor a plane, nor does it need to don a red cape, because it s super in its own way. It's Columbia, NASA s newest supercomputer and one of the world s most powerful production/processing units. Named Columbia to honor the STS-107 Space Shuttle Columbia crewmembers, the new supercomputer is making it possible for NASA to achieve breakthroughs in science and engineering, fulfilling the Agency s missions, and, ultimately, the Vision for Space Exploration. Shortly after being built in 2004, Columbia achieved a benchmark rating of 51.9 teraflop/s on 10,240 processors, making it the world s fastest operational computer at the time of completion. Putting this speed into perspective, 20 years ago, the most powerful computer at NASA s Ames Research Center, home of the NASA Advanced Supercomputing Division (NAS), ran at a speed of about 1 gigaflop (one billion calculations per second). The Columbia supercomputer is 50,000 times faster than this computer and offers a tenfold increase in capacity over the prior system housed at Ames. What s more, Columbia is considered the world s largest Linux-based, shared-memory system. The system is offering immeasurable benefits to society and is the zenith of years of NASA/private industry collaboration that has spawned new generations of commercial, high-speed computing systems.

Source record↗