SEARCH · Engineering Papers

Results for “machine vision”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

All sources NASA NTRS DOE OSTI

NASA NTRSDate not supplied

ArcjetCV: Automating Recession Tracking

Arc jet Computer Vision (arcjetCV) is a software application built to automate time-resolved recession tracking of edges in test videos, specifically for tracking material recession and the shock-material standoff. This provides a new capability to resolve and validate new physics associated with non-linear processes and an essential step to reduce testing, modeling, and validation uncertainties for heatshield material performance. ArcticCV uses several types of machine learning (convolutional neural net: CNN, decision tree: DT, k-means unsupervised clustering: KM) to automate the video processing pipeline. These include inferring the start/stop of time segments of interest (1D CNN), measuring the time-dependent 2D recession of the material samples (2D CNN, DT), measuring the time-dependent shock standoff distance (2D CNN, DT), and post-processing cleaning of the recession data (KM). The software also provides a graphical user interface for ease of use. The results of using this tool on arc jet videos show non-linear time-dependent effects can be important for certain materials and characterizing certain failure modes.

Recession tracking↗

NASA NTRSDate not supplied

ArcjetCV: Automating Arc Jet Analysis

Recession tracking↗

NASA NTRSDate not supplied

Safety Assessment of a Machine Learning-Based Aircraft Emergency Braking System: A Case Study

Machine Learning (ML) is revolutionizing many technological fields, but its use in aviation remains restricted due to stringent certification requirements. Efforts by the aviation community to establish standards for certifying ML-based systems are progressing, yet challenges persist, particularly with safety assessment methods for ML-based systems. This research addresses these challenges through a case study of an autonomous emergency braking system utilizing a computer vision deep neural network (DNN). We demonstrate a safety assessment process tailored to ML-specific concerns, such as low integrity and performance variability in quantitative safety analysis. This study can serve as an illustrative example to facilitate the discussion and convergence on certification aspects for ML-based systems within the aviation community.

Safety certification↗

DOE OSTI2024

Power System Waveform Datasets for Machine Learning

The desire for increased visibility across the electricity grid will necessarily increase the deployment of sensing and measurement devices and associated data management needs to unprecedented levels. For the existing sensing and measurement infrastructure, there remains a great amount of “value” yet to be extracted through advanced data management and analytics. Availability of more data will not, by itself, lead to changes in grid visibility, security, and resiliency. To create the predictive and prescriptive environment required to enable new markets and transactions for customer revenue and a reliable grid, the data must be collected, organized, evaluated, and analyzed using sophisticated algorithms to provide actionable information allowing operators and customers to reliably manage an increasingly complex grid. Progress in artificial intelligence (AI) has been largely driven by large, publicly available datasets that can be used to train AI algorithms such as MNIST, a database of handwritten images of digits, and ImageNet, an image database of everyday objects. These types of publicly available databases of real-world training datasets have been largely credited for advancement of image processing, computer vision, and deep learning algorithms that these use cases deploy. However, in the power systems industry to date, there are few databases with proper event labeling, and data access to a publicly available collection of power system event waveforms that will allow users to interact with grid signature data. Publicly available datasets of power system event waveforms, such as the DOE/EPRI dataset, often lack critical metadata or contain limited examples of each event type, and data formats vary widely across these datasets.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2024

Quarterly Research Performance Progress Report (Q8)

As part of Task 1, we have started by testing our modeling capabilities by reproducing isothermal DFIT simulations presented in the literature. Once satisfied with the results we have started by targeting the modeling of the DFITs at conducted at well 58-32. We have a identified a specific test (cycle 4 in zone 2) as the most interesting to be model with GEOS hydraulic fracturing module. Thus, we have first produced results with an isothermal model and adjusted model parameters to get a satisfying match with field pressure data. The, we have added thermal effects and compared the modeling results with and without thermal effects to estimate how thermal effects may influence test interpretation. Models seem to suggest that, for small volumes of fluid, thermal effects are moderate. In Task 2, we have adapted GEOS phase-field formulation to be able to simulate near-wellbore hydraulic fracture nucleation and propagation. We have devised a novel formulation that, compared to other existing ones, incorporates rock strengths. We have submitted a journal publication about our work. We are currently employing this phase-field formulation to model the experiments taking place at U Pitt and help us understand the effect of various parameters. In Task 3, we have built a model of the region surround well 16A and have started modeling stage 3 stimulation because of its simpler planar geometry. After calibrating simulation parameters using known analytical solutions, we have simulated the stage 3 stimulation using our isothermal hydraulic fracturing module, varying the permeability field, the stress conditions including different physics to get a better understanding of the numerical challenges and of the effects of varying these parameters on the simulation results. In Task 4 laboratory experimentation, a set of specialized drilling and injection tools has been customized and constructed to accommodate an inclined well with an orientation of up to 30 degrees relative to material anisotropy or principal stress axes. These inclined samples have also undergone thermal stress and hydraulic fracturing at a temperature of 190 degrees Celsius. Furthermore, both vertical and deviated sampling testing setups enable an extended analysis of post-peak pressure behaviors, facilitating post-test pressure analyses such as the G-function, step rate, and fracture reopening measurements. Thus, the key components of in-situ stress estimation can be extracted and validated through our experiment, providing a solid foundation for validating existing in-situ stress estimation theories or proposing new ones. Simultaneously, we are integrating computer vision techniques with traditional experimental fracture observation methods such as multi-overcore/slicing and water-penetration fracture observation. This combination will prove beneficial in populating the hydraulic fracture patterns database, generated under challenging EGS conditions. This approach aims to deepen our understanding of the complexities in EGS reservoirs and pave the way for future data-driven investigations. Additionally, PITT has also equipped the ELE International compression machine, which is now prepared for conducting indirect tensile and fracture toughness tests. These tests will aid in characterizing how rock fabrics influence the resulting fracture patterns. Additionally, we have completed the required personnel training and gained access to Scanning Electron Microscopy (SEM) and Energy Dispersive Spectroscopy (EDS) for conducting more detailed characterization and analysis of rock fabrics, as well as the examination of thermal and hydraulically induced fracture patterns. Thus, the PITT team has effectively demonstrated the capabilities of our experimental apparatuses in exploring the thermal effects, well deviation angles, material anisotropy, and operational choices (such as circulation rate, injection fluid viscosity, and injection rate) and their impact on pressure responses and fracture trajectories under the Utah FORGE conditions.

15 GEOTHERMAL ENERGY↗

NASA NTRSDate not supplied

arcjetCV: automating recession extraction from video

Arc jet Computer Vision (arcjetCV)[1][2] is a software application built to automate time-resolved recession tracking of edges in test videos, specifically for tracking material recession and the shock-material standoff. This provides a new capability to resolve and validate new physics associated with non-linear processes and an essential step to reduce testing, modeling, and validation uncertainties for heatshield material performance. ArcticCV uses several types of machine learning (convolutional neural net: CNN, decision tree: DT, k-means unsupervised clustering: KM) to automate the video processing pipeline. These include inferring the start/stop of time segments of interest (1D CNN), measuring the time-dependent 2D recession of the material samples (2D CNN, DT), measuring the time-dependent shock standoff distance (2D CNN, DT), and post-processing cleaning of the recession data (KM). The software also provides a graphical user interface for ease of use. The results of using this tool on arc jet videos show non-linear time-dependent effects can be important for certain materials and characterizing certain failure modes.

Recession tracking↗

DOE OSTI2025

Molecular simulation and artificial intelligence for the circular economy of bioenergy and bioproducts

The concept of the circular bioeconomy is a carbon neutral, sustainable system with zero waste. One vision for such an economy is based upon lignocellulosic biomass. This lignocellulosic circular bioeconomy requires CO 2 absorption from biomass growth and the efficient deconstruction of recalcitrant biomass into solubilized and fractionated biopolymers, which are then used as precursors for the sustainable production of high-quality liquid fuels, chemical bioproducts, and bio-based materials. Here, in this study, we summarize the roles that molecular dynamics (MD) simulations and machine learning (ML) are playing in overcoming several fundamental challenges hindering the adoption of a circular bioeconomy. Specifically, we discuss the role of MD and ML/AI in overcoming lignocellulose recalcitrance by designing biomass pretreatment methods to efficiently produce solubilized cellulose/lignin/hemicellulose and of that in improving energy-intensive manufacturing of biomass-based materials and their structural and mechanical properties. Quantum mechanical methods and MD simulations, in addition to offering a mechanistic understanding of biomass deconstruction and biomaterials design, can provide meaningful structural, energetics, and physiochemical properties as inputs to train AI/ML models. The ML models can guide the experimental prioritization of materials/solvents and process parameters that significantly accelerate the development of biofuel and biomaterial components of the circular bioeconomy.

Smith, Jeremy C. [Oak Ridge National Laboratory (O↗

DOE OSTI2025

Backpropagation-based learning with local derivative approximation and memory replay in biologically plausible neural systems

When learning, the brain modifies individual synaptic connections to reach a desired behavior. Animal and human brains have been shown to be incredibly capable of learning complex and varied functions across a wide variety of tasks. In recent years, artificial neural networks, inspired by human and animal brains, have shown great capabilities in learning a wide variety of difficult tasks. However, artificial neural networks primarily teach themselves through the use of backpropagation, a learning method which has no clear analogue within the brain. Additionally, Artificial Neural Networks primarily use continuous activation functions, which differ significantly from the spiking neuronal behavior present in the brain. In this paper, we discuss and demonstrate a biologically plausible learning method that approximates backpropagation through two techniques on Spiking Neural Networks. First, we show that the local temporal derivatives that are necessary for backpropagation can be approximately recovered through reconstruction using spike timings. Second, we show that through learning during a sleep phase, inspired by neuroscience research into memory replay, the localized parallel feedback path can learn to approximate the derivative through the forward path weight matrix, thus solving the weight transport problem. Lastly, we demonstrate that the combination of these two methods can approach or exceed the accuracy of backpropagation-based methods for a variety of neuromorphic vision tasks while maintaining biological plausibility.

42 ENGINEERING↗

DOE OSTI2024

Considerations for Introducing Artificial Intelligence into Nuclear Power Plants

Advanced computational tools and techniques such as artificial intelligence and machine learning (AI/ML) can transform the nuclear power industry. This is necessary given that the economic viability of the existing fleet is in jeopardy and its labor-centric approach to operations and maintenance. Currently, AI/ML research is being undertaken for reactor system design and analysis including fault and accident prognosis, nuclear risk analysis such as plant safety and security evaluation, and plant operations and maintenance including predictive maintenance. Applications include both existing and advanced reactor technologies with the aim of improving operational and business efficiencies. Most every aspect of the organization can benefit, from instrumentation and control, to work planning, to human-machine interactions and business management. AI/ML in nuclear can simplify complex problems and produce more effective decision-making. Nonetheless, careful consideration must be given to the implementation of an AI/ML initiative. The aims of this research are to 1) review barriers to AI/ML adoption within the nuclear power industry, and 2) suggest potential solutions. These barriers are organized along five distinct categories (Figure 1) that are interconnected. The first are historical barriers that track the industry’s development over the decades including worldwide nuclear events that shaped public perceptions. The resulting federal scrutiny and intense safety culture that emerged are discussed. Technical barriers to AI/ML adoption are considerable, and include data privacy concerns, data governance, and the current lack of AI/ML expert knowledge at the plants. The main business case barrier remains cost, but an absence of an industry-wide vision and wide-scale adoption also produces reluctance. Stakeholder readiness is reviewed with special attention given to regulatory readiness. The 5-year strategic plan for AI readiness recently published by the U.S. Nuclear Regulatory Commission is highlighted. Last, adoption barriers at the user level are addressed including the importance of user experience and explainable AI. The AI adoption barriers described here are inter-related and ideally should be addressed in a holistic fashion.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2023

Invertible neural networks for real-time control of extrusion additive manufacturing

Material extrusion additive manufacturing (AM) has enabled an elegant fabrication pathway for a vast material library. Nonetheless, each material requires optimization of printing parameters generally determined through significant trial-and-error testing. To eliminate arduous, iteration-based optimization approaches, many researchers have used machine learning (ML) algorithms which provide opportunities for automated process optimization. Here, in this work, we demonstrate the use of an ML-driven approach for real-time material extrusion print-parameter optimization through in-situ monitoring of printed line geometry. To do this, we use deep invertible neural networks (INNs) which can solve both forward and inverse, or optimization, problems using a single network. By combining in-situ computer vision and deep INNs, the printing parameters can be autonomously optimized to print a target line width in 1.2 s. Furthermore, defects that occur during printing can be rapidly identified and corrected autonomously. The methods developed and presented in this work eliminate user-intensive, time-consuming, and iterative parameter discovery approaches that currently limit accelerated implementation of extrusion-based AM processes. Furthermore, the presented approach can be generalized to provide real-time monitoring and optimization pathways for increasingly complex AM environments.

36 MATERIALS SCIENCE↗

DOE OSTI2024

Dynamic STEM-EELS for single-atom and defect measurement during electron beam transformations

This study introduces the integration of dynamic computer vision–enabled imaging with electron energy loss spectroscopy (EELS) in scanning transmission electron microscopy (STEM). This approach involves real-time discovery and analysis of atomic structures as they form, allowing us to observe the evolution of material properties at the atomic level, capturing transient states traditional techniques often miss. Rapid object detection and action system enhances the efficiency and accuracy of STEM-EELS by autonomously identifying and targeting only areas of interest. This machine learning (ML)–based approach differs from classical ML in that it must be executed on the fly, not using static data. We apply this technology to V-doped MoS 2 , uncovering insights into defect formation and evolution under electron beam exposure. This approach opens uncharted avenues for exploring and characterizing materials in dynamic states, offering a pathway to increase our understanding of dynamic phenomena in materials under thermal, chemical, and beam stimuli.

47 OTHER INSTRUMENTATION↗

DOE OSTI2025

Automating Testing of DUNE Electronics via a Finite State Machine

The Deep Underground Neutrino Experiment (DUNE) is a flagship international collaboration designed to study neutrinos tiny, nearly massless particles that may hold answers to fundamental questions about the Universe. Fermilab s Robotic Test Stand (RTS) plays a critical role in ensuring the quality of approximately 50,000 Application-Specific Integrated Circuit (ASIC) chips that will be used in DUNE s massive liquid argon detectors. These electronics will be inside the cryostat; therefore, they will need to have a high yield of working chips and low noise. To improve the automation and reliability of the RTS, this project focused on designing and implementing a Python-based finite state machine (FSM) to manage chip handling workflows. The FSM was developed as a modular software framework to coordinate robotic arm movements, manage chip tray positions, and monitor system states during testing. Key features include robust error handling routines, a pause/resume system for safe mid-cycle interruptions, and a simulation mode for iterative testing without hardware dependencies. The system was designed to prepare for seamless integration with RTS hardware components such as the robotic arm and vision system. This integration will streamline collaboration and enable efficient deployment of updates across the six total institutions performing testing. The outcomes of this internship contribute to Fermilab s mission to advance high-energy physics and support the DOE s national goals by directly improving the testing of equipment to be used in DUNE. The project also provided valuable experience in software design and contributing to the success of DUNE.

Kang, Caleb [William Rainey Harper Coll.]↗

DOE OSTI2025

Automating Testing of DUNE Electronics via a Finite State Machine

The Deep Underground Neutrino Experiment (DUNE) is a flagship international collaboration designed to study neutrinos—tiny, nearly massless particles that may hold answers to fundamental questions about the Universe. Fermilab’s Robotic Test Stand (RTS) plays a critical role in ensuring the quality of approximately 50,000 Application-Specific Integrated Circuit (ASIC) chips that will be used in DUNE’s massive liquid argon detectors. These electronics will be inside the cryostat; therefore, they will need to have a high yield of working chips and low noise. To improve the automation and reliability of the RTS, this project focused on designing and implementing a Python-based finite state machine (FSM) to manage chip handling workflows. The FSM was developed as a modular software framework to coordinate robotic arm movements, manage chip tray positions, and monitor system states during testing. Key features include robust error handling routines, a pause/resume system for safe mid-cycle interruptions, and a simulation mode for iterative testing without hardware dependencies. The system was designed to prepare for seamless integration with RTS hardware components such as the robotic arm and vision system. This integration will streamline collaboration and enable efficient deployment of updates across the six institutions performing testing. The outcomes of this internship contribute to Fermilab’s mission to advance high-energy physics and support the DOE’s national goals by directly improving the testing of equipment to be used in DUNE. The project also provided valuable experience in software design and contributing to the success of DUNE.

Kang, Caleb [Fermilab]↗

DOE OSTI2025

Exocortex Network for AI-Augmented Human-Led Scientific Expedition

AI advances in science can be viewed along two main directions with a fluid boundary: enhancing efficiency through automation and smart tools to accelerate tasks that humans can already perform; and enabling exploration into uncharted territories and potentially toward AGI. These advances manifest in the AI cognitive core through the development and explainability of foundation models; in the physical embodiment of instruments and facilities; and in the integrated agency of AI workflows exemplified by the science exocortex. To address the role of humans in this evolving landscape, in this Perspective, we suggest a third direction: the development of personalized agents that form human-centered networks, supporting both efficiency and exploration while ensuring that AI remains aligned with human vision.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS2007

Human Space Exploration: The Moon, Mars, and Beyond

America is returning to the Moon in preparation for the first human footprint on Mars, guided by the U.S. Vision for Space Exploration. This presentation will discuss NASA's mission, the reasons for returning to the Moon and going to Mars, and how NASA will accomplish that mission in ways that promote leadership in space and economic expansion on the new frontier. The primary goals of the Vision for Space Exploration are to finish the International Space Station, retire the Space Shuttle, and build the new spacecraft needed, to return people to the Moon and go to Mars. The Vision commits NASA and the nation to an agenda of exploration that also includes robotic exploration and technology development, while building on lessons learned over 50 years of hard-won experience. Why the Moon? Many questions about the Moon's potential resources and how its history is linked to that of Earth were spurred by the brief Apollo explorations of the 1960s and 1970s. This new venture will carry more explorers to more diverse landing sites with more capable tools and equipment for extended expeditions. The Moon also will serve as a training ground before embarking on the longer, more difficult trip to Mars. NASA plans to build a lunar outpost at one of the lunar poles, learn to live off the land, and reduce dePendence on Earth for longer missions. America needs to extend its ability to survive in hostile environments close to our home planet before astronauts will reach Mars, a planet very much like Earth. NASA has worked with scientists to define lunar exploration goals and is addressing the opportunities for a range of scientific study on Mars. In order to reach the Moon and Mars within a lifetime and within budget, NASA is building on common hardware, shared knowledge, and unique experience derived from the Apollo Saturn, Space Shuttle and contemporary commercial launch vehicle programs. The journeys to the Moon and Mars will require a variety of vehicles, including the Ares I Crew Launch Vehicle, which transports the Orion Crew Exploration Vehicle, and the Ares V Cargo Launch Vehicle, which transports the Lunar Surface Access Module. The architecture for the lunar missions will use one launch to ferry the crew into orbit, where it will rendezvous with the Lunar Module in the Earth Departure Stage, which will then propel the combination into lunar orbit. The imperative to explore space with the combination of astronauts and robots will be the impetus for inventions such as solar power and water and waste recycling. This next chapter in NASA's history promises to write the next chapter in American history, as well. It will require this nation to provide the talent to develop tools, machines, materials, processes, technologies, and capabilities that can benefit nearly all aspects of life on Earth. Roles and responsibilities are shared between a nationwide Government and industry team. The Exploration Launch Projects Office at the Marshall Space Flight Center manages the design, development, testing, and evaluation of both vehicles and serves as lead systems integrator. A little over a year after it was chartered, the Exploration Launch Projects team is testing engine components, refining vehicle designs, performing wind tunnel tests, and building hardware for the first flight test of Ares I-l, scheduled for spring 2009. The U.S. Vision for Space Exploration lays out a roadmap for a long-term venture of discovery. This endeavor will inspire and attract the best and brightest students to power this nation successfully to the Moon, Mars, and beyond. If one equates the value proposition for space with simple dollars and cents, the potential of the new space economy is tremendous, from orbital space delivery services for the International Space Station to mining and solar energy collection on the Moon and asteroids. The Vision for Space Exploration is fundamentally about bringing the resources of the solar system within the economic sphere of humaind. Given the immense size of our solar system, the amount of available material and energy within it present an enormous economic opportunity.

Sexton, Jeffrey D.↗

NASA NTRSDate not supplied

GeoAI advances in specific landform mapping

Landform mapping (also referred to as geomorphology or geomorphometry) can be divided into two domains: general and specific (Evans 2012). Whereas general landform mapping categorizes all elements of the study area into landform classes, such as ridges, valleys, peaks, and depressions, the mapping of specific landforms requires the delineation (even if fuzzy) of individual landforms. The former is mainly driven by physical properties such as elevation, slope, and curvature. The latter, however, must consider the cognitive (human) reasoning that discriminates individual landforms in addition to these physical properties (Arundel and Sinha 2018). Both mapping forms are important. General geomorphometry is needed to understand geological and ecological processes and as boundary layer input to climate and environmental models. Specific geomorphometry supports such activities as disaster management and recovery, emergency response, transportation, and navigation. In the United States, individual landforms of interest are named in the U.S. Geological Survey (USGS) Geographic Names Information System, a point dataset captured specifically to digitize geographic names from the USGS Historical Topographic Map Collection (HTMC). Named landform extent is represented only by the name placement in the HTMC. Recent work has investigated CNN-based deep learning methods to capture these extents in machine-readable form. These studies first relied on physical properties (Arundel et al. 2020) and then included the HTMC as a band in RGB images in limited testing (Arundel et al. 2023). Results from the HTMC dataset surpassed those using just physical properties and using the HTMC alone performed best due to the hillshading and elevation (contour) data incorporated into the topographic maps. However, results fell short of an operational capacity to map all named landforms in the United States. Thus, our current work expands upon past research by focusing on the HTMC and physical information as inputs and the named landform label extents. Specifically, we propose to leverage pre-trained foundation models for segmentation and optical character recognition (OCR) models to jointly map landforms in the United States. Our approach aims to bridge the disparities among the independent information sources to facilitate informed decision-making. The modeling pipeline performs (1) segmentation using the physical information and (2) information extraction using OCR, in parallel. Then a computer vision approach merges the two branches into a labeled segmentation. References: Arundel, Samantha T., Wenwen Li, and Sizhe Wang. 2020. “GeoNat v1.0: A Dataset for Natural Feature Mapping with Artificial Intelligence and Supervised Learning.” Transactions in GIS 24 (3): 556–72. https://doi.org/10.1111/tgis.12633. Arundel, Samantha T, and Gaurav Sinha. 2018. “Validating GEOBIA Based Terrain Segmentation and Classification for Automated Delineation of Cognitively Salient Landforms BT - Proceedings of Workshops and Posters at the 13th International Conference on Spatial Information Theory (COSIT 2017).” In Proceedings of Workshops and Posters at the 13th International Conference on Spatial Information Theory (COSIT 2017), Lecture Notes in Geoinformation and Cartography, edited by Paolo Fogliaroni, Andrea Ballatore, and Eliseo Clementini, 9–14. Cham: Springer International Publishing. Arundel, Samantha T., Gaurav Sinha, Wenwen Li, David P. Martin, Kevin G. McKeehan, and Philip T. Thiem. 2023. “Historical Maps Inform Landform Cognition in Machine Learning.” Abstracts of the ICA 6 (August): 1–2. https://doi.org/10.5194/ica-abs-6-10-2023. Evans, Ian S. 2012. “Geomorphometry and Landform Mapping: What Is a Landform?” Geomorphology 137 (1): 94–106. https://doi.org/10.1016/j.geomorph.2010.09.029.

machine learning↗

DOE OSTI2020

Deep learning approaches for neural decoding across architectures and recording modalities

Decoding behavior, perception or cognitive state directly from neural signals is critical for brain–computer interface research and an important tool for systems neuroscience. In the last decade, deep learning has become the state-of-the-art method in many machine learning tasks ranging from speech recognition to image segmentation. The success of deep networks in other domains has led to a new wave of applications in neuroscience. In this article, we review deep learning approaches to neural decoding. Here, we describe the architectures used for extracting useful features from neural recording modalities ranging from spikes to functional magnetic resonance imaging. Furthermore, we explore how deep learning has been leveraged to predict common outputs including movement, speech and vision, with a focus on how pretrained deep networks can be incorporated as priors for complex decoding targets like acoustic speech or images. Deep learning has been shown to be a useful tool for improving the accuracy and flexibility of neural decoding across a wide range of tasks, and we point out areas for future scientific development.

59 BASIC BIOLOGICAL SCIENCES↗

NASA NTRS1966

A computer simulation experiment of supervisory control of remote manipulation

A computer simulation of a remote manipulation task and a rate-controlled manipulator is described. Some low-level automatic decision making ability which could be used at the operator's discretion to augment his direct continuous control was built into the manipulator. Experiments were made on the effect of transmission delay, dynamic lag, and intermittent vision on human manipulative ability. Delay does not make remote manipulation impossible. Intermittent visual feedback, and the absence of rate information in the display presented to the operator do not seem to impair the operator's performance. A small-capacity visual feedback channel may be sufficient for remote manipulation tasks, or one channel might be time-shared between several operators. In other experiments the operator called in sequence various on-site automatic control programs of the machine, and thereby acted as a supervisor. The supervisory mode of operation has some advantages when the task to be performed is difficult for a human controlling directly.

Mccandlish, S. G.↗