SEARCH · Engineering Papers

Results for “pilot learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

All sources NASA NTRS DOE OSTI

NASA NTRS2014

Imagery Integration Team

The Human Exploration Science Office (KX) provides leadership for NASA's Imagery Integration (Integration 2) Team, an affiliation of experts in the use of engineering-class imagery intended to monitor the performance of launch vehicles and crewed spacecraft in flight. Typical engineering imagery assessments include studying and characterizing the liftoff and ascent debris environments; launch vehicle and propulsion element performance; in-flight activities; and entry, landing, and recovery operations. Integration 2 support has been provided not only for U.S. Government spaceflight (e.g., Space Shuttle, Ares I-X) but also for commercial launch providers, such as Space Exploration Technologies Corporation (SpaceX) and Orbital Sciences Corporation, servicing the International Space Station. The NASA Integration 2 Team is composed of imagery integration specialists from JSC, the Marshall Space Flight Center (MSFC), and the Kennedy Space Center (KSC), who have access to a vast pool of experience and capabilities related to program integration, deployment and management of imagery assets, imagery data management, and photogrammetric analysis. The Integration 2 team is currently providing integration services to commercial demonstration flights, Exploration Flight Test-1 (EFT-1), and the Space Launch System (SLS)-based Exploration Missions (EM)-1 and EM-2. EM-2 will be the first attempt to fly a piloted mission with the Orion spacecraft. The Integration 2 Team provides the customer (both commercial and Government) with access to a wide array of imagery options - ground-based, airborne, seaborne, or vehicle-based - that are available through the Government and commercial vendors. The team guides the customer in assembling the appropriate complement of imagery acquisition assets at the customer's facilities, minimizing costs associated with market research and the risk of purchasing inadequate assets. The NASA Integration 2 capability simplifies the process of securing one-of-a-kind imagery assets and skill sets, such as ground-based fixed and tracking cameras, crew-in the-loop imaging applications, and the integration of custom or commercial-off-the-shelf sensors onboard spacecraft. For spaceflight applications, the Integration 2 Team leverages modeling, analytical, and scientific resources along with decades of experience and lessons learned to assist the customer in optimizing engineering imagery acquisition and management schemes for any phase of flight - launch, ascent, on-orbit, descent, and landing. The Integration 2 Team guides the customer in using NASA's world-class imagery analysis teams, which specialize in overcoming inherent challenges associated with spaceflight imagery sets. Precision motion tracking, two-dimensional (2D) and three-dimensional (3D) photogrammetry, image stabilization, 3D modeling of imagery data, lighting assessment, and vehicle fiducial marking assessments are available. During a mission or test, the Integration 2 Team provides oversight of imagery operations to verify fulfillment of imagery requirements. The team oversees the collection, screening, and analysis of imagery to build a set of imagery findings. It integrates and corroborates the imagery findings with other mission data sets, generating executive summaries to support time-critical mission decisions.

Calhoun, Tracy↗

NASA NTRS2018

Learn to Fly Test Setup and Concept of Operations

The NASA Learn-to-Fly (L2F) project recently completed a series of flight demonstrations of its learning algorithm for flight control at Fort A. P. Hill in Virginia. This paper discusses the test setup and concept of operations (ConOps) used by the L2F team. Unmanned airframe demonstrators for testing the research algorithms included a modified commercial off-the-shelf subscale powered airplane, plus four gliders – two of which had an unconventional configuration and were fabricated using a “rapid” prototyping technique. Avionics system similarities and differences between the test aircraft are described, as well as ground testing in preparation for flight. The ConOps discussion includes the development of a tethered helium balloon drop launch technique for the glider demonstrators. This launch method was chosen for its potential to be inexpensive and allow for rapid turn-around for multiple glider launches – but it also presented challenges, such as balloon tether avoidance, high angle of attack, low dynamic pressure initial conditions, and susceptibility to winds. A remotely piloted approach employing high-end hobbyist radio controlled (R/C) hardware was used for the powered demonstrator. This approach accommodated the interaction between the R/C flight system and the research flight control computer, engaging the L2F algorithm at varying initial conditions and artificially reducing the aircraft stability to stress the algorithm.

Riddick, Stephen E↗

NASA NTRSDate not supplied

The Lunar Lab Initiative

Analogous to terrestrial Antarctic basecamps at our south pole, space exploration outposts will be a combination of habitation and science-focused assets. The Artemis Exploration Roadmap endeavors to establish a sustained human presence on the lunar south pole starting in 2028. Within the planned Artemis Base Camp, most efforts to date have focused on the habitation assets or a mixture of science and habitation assets . With the recent advent of commercial lunar landing capabilities, the trade space can be further expanded to include dedicated science focused assets that ensure adequate science capability. To that end, the Forge, an innovation team initiative created at the Johnson Space Center (JSC), explored alternative ways to increase the science capabilities within the basecamp. The Forge uses structured brainstorming and facilitation to increase innovation within the assigned team, while executing its process in a rapid turnaround fashion for ideation and design study. As a pilot study for the Forge, a multi-disciplinary team investigated a lunar lab module to augment the lunar surface plans for Artemis. This formulation study evaluated the scientific and operational considerations for this dedicated crew space that would increase the capabilities of lunar surface science operations. The trade space evaluated single lunar lander delivery versus multiple lunar lander delivery for module assembly, alternative structural designs, the science instrument outfitting with mapping to scientific goals to maximize lunar science objectives, and how the lab would be operated. The lab operations options explored a stand-alone facility, as well as a facility integrated into a larger lunar surface complex, while evaluating crew usage and habitability considerations. The resulting alternatives were evaluated by the Forge team with a set of metrics to determine their originality, feasibility, and science performance, and thereby provide a recommendation to the lunar architecture planning team. Lessons learned from the lunar lab study were compiled to improve the process and tools for future Forge studies. Forward work, open issues, and challenges to further refine the design of the various science-focused asset options were also documented. By providing a robust science capability at humanity’s furthest outpost, we can plan for a sustained human lunar presence once the initial lunar surface access capability is well established.

Lunar outpost↗

NASA NTRS1986

Improving Organizational Productivity in NASA

Recognizing that NASA has traditionally been in the forefront of technological change, the NASA Administrator challenged the Agency in 1982 to also become a leader in developing and applying advanced technology and management practices to increase productivity. One of the activities undertaken by the Agency to support this ambitious productivity goal was participation in a 2-year experimental action research project devoted to learning more about improving and assessing the performance of professional organizations. Participating with a dozen private sector organizations, NASA explored the usefulness of a productivity improvement process that addressed all aspects of organizational performance. This experience has given NASA valuable insight into the enhancement of professional productivity. More importantly, it has provided the Agency with a specific management approach that managers and supervisors can effectively use to emphasize and implement continuous improvement. This report documents the experiences of the five different NASA installations participating in the project, describes the improvement process that was applied and refined, and offers recommendations for expanded application of that process. Of particular interest is the conclusion that measuring white collar productivity may be possible, and at a minimum, the measurement process itself is beneficial to management. Volume I of the report provides a project overview, significant findings, and recommendations. Volume II presents individual case studies of the NASA pilot projects that were part of the action research effort.

Source record↗

NASA NTRSDate not supplied

Management of Operations under Visual Flight Rules in UTM for Disaster Response Missions

The disaster response domain has experienced an increased focus in recent years due to the rise in number and scale of events, lessons learned from past experience, and emerging technologies that make possible a more coordinated and effective response. As part of this focus, JAXA and NASA have been collaborating on the integration of manned and unmanned aircraft in support of disaster response operations through integrated testing of their respective mission planning and optimization system (Disaster Relief Aircraft Information Sharing Network, or D-NET) and an automated UAS traffic management system (e.g., UTM). In 2018, JAXA and NASA jointly participated in a large-scale disaster drill in Japan where the integration of systems was successfully demonstrated through real-time data exchanges, visualization, and decision making as part of the coordinated airspace management of a manned helicopter in VFR conditions and unmanned small UAS operating in common areas. This work details a flight test consisting of two flights that were conducted December 2019 near the Chofu Aerodrome in Tokyo, which focused on the evaluation of pilots operating under Visual Flight Rules (VFR) communicating through D-NET and sharing intent and position information within UTM. This work contributes to defining the necessary requirements for digital coordination between manned and unmanned operations. UTM requires the use of operation volumes, which are spatial and temporal volumes that encompass UAS flight trajectories and account for technical performance errors and deviations due to disturbances (e.g., wind). A series of flights, representing different missions, used landmark-based operation volumes and conformance of the aircraft to those operation volumes were tracked within UTM. Experienced disaster response helicopter pilots provided insight on the development of the operation plans and their usability during disaster response operations. Results from the flight test supported the suggested benefits of using landmarks for planning and positional awareness and highlighted the need for future research in advanced visualization capabilities to support operations that consider both system constraints and flight deck/airspace management interaction.

disaster response↗

NASA NTRS2002

Wire Detection Algorithms for Navigation

In this research we addressed the problem of obstacle detection for low altitude rotorcraft flight. In particular, the problem of detecting thin wires in the presence of image clutter and noise was studied. Wires present a serious hazard to rotorcrafts. Since they are very thin, their detection early enough so that the pilot has enough time to take evasive action is difficult, as their images can be less than one or two pixels wide. Two approaches were explored for this purpose. The first approach involved a technique for sub-pixel edge detection and subsequent post processing, in order to reduce the false alarms. After reviewing the line detection literature, an algorithm for sub-pixel edge detection proposed by Steger was identified as having good potential to solve the considered task. The algorithm was tested using a set of images synthetically generated by combining real outdoor images with computer generated wire images. The performance of the algorithm was evaluated both, at the pixel and the wire levels. It was observed that the algorithm performs well, provided that the wires are not too thin (or distant) and that some post processing is performed to remove false alarms due to clutter. The second approach involved the use of an example-based learning scheme namely, Support Vector Machines. The purpose of this approach was to explore the feasibility of an example-based learning based approach for the task of detecting wires from their images. Support Vector Machines (SVMs) have emerged as a promising pattern classification tool and have been used in various applications. It was found that this approach is not suitable for very thin wires and of course, not suitable at all for sub-pixel thick wires. High dimensionality of the data as such does not present a major problem for SVMs. However it is desirable to have a large number of training examples especially for high dimensional data. The main difficulty in using SVMs (or any other example-based learning method) is the need for a very good set of positive and negative examples since the performance depends on the quality of the training set.

Kasturi, Rangachar↗

NASA NTRSDate not supplied

Chimeric Mouse Models for Space Radiation Risk Investigations

Assessment of human health risks associated with space radiation exposure is based largely on the knowledge learned from studies in which animals, mostly rodents, are exposed to high-LET radiation on the ground. It has been recognized that translation of animal results to meaningful implications for human disease can be challenging, particularly for certain risk categories such as the high-LET radiation effects in the central nervous system (CNS). Considering limitations in utilizing non-human primates and clinical studies in humans, chimeric animals can potentially bridge the knowledge gap between rodents and humans. In a chimeric animal, a specific organ or a cell type is replaced with respective human cells that are functional. A number of chimeric mouse models have been developed in the medical research community to study human diseases, and some of the models can potentially be used for NASA applications. Here we investigate use of mice engrafted with human hepatocytes, which have been used in studies of genotoxicity from carcinogen exposures, for assessment of space radiation damage. In a pilot study, we use PXB mice whose livers contain >90% human cells and have been found to function nearly identically to human liver tissues. These mice were exposed to gamma rays for investigations of DNA damage, transcriptomics, and histopathological changes in the humanized livers. Results obtained from PXB mice were compared non-engrafted control animals from the same background strain that are exposed to identical conditions. Preliminary data from histopathological analysis suggest chimeric mouse models are suitable for investigations of space radiation risks, as the humanized liver tissue exhibited changes induced by radiation and was markedly distinct from the liver tissue from the control animals (Fox Chase SCID mice).

Radiation effects↗

NASA NTRSDate not supplied

Chimeric Mouse Models for Space Radiation Risk Investigations

Radiation effects↗

NASA NTRS2005

Adaptable Constrained Genetic Programming: Extensions and Applications

An evolutionary algorithm applies evolution-based principles to problem solving. To solve a problem, the user defines the space of potential solutions, the representation space. Sample solutions are encoded in a chromosome-like structure. The algorithm maintains a population of such samples, which undergo simulated evolution by means of mutation, crossover, and survival of the fittest principles. Genetic Programming (GP) uses tree-like chromosomes, providing very rich representation suitable for many problems of interest. GP has been successfully applied to a number of practical problems such as learning Boolean functions and designing hardware circuits. To apply GP to a problem, the user needs to define the actual representation space, by defining the atomic functions and terminals labeling the actual trees. The sufficiency principle requires that the label set be sufficient to build the desired solution trees. The closure principle allows the labels to mix in any arity-consistent manner. To satisfy both principles, the user is often forced to provide a large label set, with ad hoc interpretations or penalties to deal with undesired local contexts. This unfortunately enlarges the actual representation space, and thus usually slows down the search. In the past few years, three different methodologies have been proposed to allow the user to alleviate the closure principle by providing means to define, and to process, constraints on mixing the labels in the trees. Last summer we proposed a new methodology to further alleviate the problem by discovering local heuristics for building quality solution trees. A pilot system was implemented last summer and tested throughout the year. This summer we have implemented a new revision, and produced a User's Manual so that the pilot system can be made available to other practitioners and researchers. We have also designed, and partly implemented, a larger system capable of dealing with much more powerful heuristics.

Janikow, Cezary Z.↗

NASA NTRS1992

Teaching, learning, and planetary exploration

The progress accomplished in the first five months of the three-year grant period of Teaching, Learning, and Planetary Exploration is presented. The objectives of this project are to discover new education products and services based on space science, particularly planetary exploration. An Exploration in Education is the umbrella name for the education projects as they are seen by teachers and the interested public. As described in the proposal, our approach consists of: (1) increasing practical understanding of the potential role and capabilities of the research community to contribute to basic education using new discoveries; (2) developing an intellectual framework for these contributions by supplying criteria and templates for the teacher's stories; (3) attracting astronomers, engineers, and technical staff to the project and helping them form productive education partnerships for the future, (4) exploring relevant technologies and networks for authoring and communicating the teacher's stories; (5) enlisting the participation of potential user's of the teacher's stories in defining the products; (6) actually producing and delivering many educationally useful teacher's stories; and (7) reporting the pilot study results with critical evaluation. Technical progress was made by assembling our electronic publishing stations, designing electronic publications based on space science, and developing distribution approaches for electronic products. Progress was made addressing critical issues by developing policies and procedures for securing intellectual property rights and assembling a focus group of teachers to test our ideas and assure the quality of our products. The following useful materials are being produced: the TOPS report; three electronic 'PictureBooks'; one 'ElectronicArticle'; three 'ElectronicReports'; ten 'PrinterPosters'; and the 'FaxForum' with an initial complement of printed materials. We have coordinated with planetary scientists and astronomers both at the technical and policy level to assure the efficiency and ultimate utility of these efforts to derive educational benefits from the space science and exploration program as a whole.

Brown, Robert A.↗

NASA NTRS2011

Integration of Weather Avoidance and Traffic Separation

This paper describes a dynamic convective weather avoidance concept that compensates for weather motion uncertainties; the integration of this weather avoidance concept into a prototype 4-D trajectory-based Airborne Separation Assurance System (ASAS) application; and test results from a batch (non-piloted) simulation of the integrated application with high traffic densities and a dynamic convective weather model. The weather model can simulate a number of pseudo-random hazardous weather patterns, such as slow- or fast-moving cells and opening or closing weather gaps, and also allows for modeling of onboard weather radar limitations in range and azimuth. The weather avoidance concept employs nested "core" and "avoid" polygons around convective weather cells, and the simulations assess the effectiveness of various avoid polygon sizes in the presence of different weather patterns, using traffic scenarios representing approximately two times the current traffic density in en-route airspace. Results from the simulation experiment show that the weather avoidance concept is effective over a wide range of weather patterns and cell speeds. Avoid polygons that are only 2-3 miles larger than their core polygons are sufficient to account for weather uncertainties in almost all cases, and traffic separation performance does not appear to degrade with the addition of weather polygon avoidance. Additional "lessons learned" from the batch simulation study are discussed in the paper, along with insights for improving the weather avoidance concept. Introduction

Consiglio, Maria C.↗

NASA NTRS2006

Sensing Super-position: Visual Instrument Sensor Replacement

Maluf, David A.↗

NASA NTRS2007

Sensing Super-Position: Human Sensing Beyond the Visual Spectrum

The coming decade of fast, cheap and miniaturized electronics and sensory devices opens new pathways for the development of sophisticated equipment to overcome limitations of the human senses. This paper addresses the technical feasibility of augmenting human vision through Sensing Super-position by mixing natural Human sensing. The current implementation of the device translates visual and other passive or active sensory instruments into sounds, which become relevant when the visual resolution is insufficient for very difficult and particular sensing tasks. A successful Sensing Super-position meets many human and pilot vehicle system requirements. The system can be further developed into cheap, portable, and low power taking into account the limited capabilities of the human user as well as the typical characteristics of his dynamic environment. The system operates in real time, giving the desired information for the particular augmented sensing tasks. The Sensing Super-position device increases the image resolution perception and is obtained via an auditory representation as well as the visual representation. Auditory mapping is performed to distribute an image in time. The three-dimensional spatial brightness and multi-spectral maps of a sensed image are processed using real-time image processing techniques (e.g. histogram normalization) and transformed into a two-dimensional map of an audio signal as a function of frequency and time. This paper details the approach of developing Sensing Super-position systems as a way to augment the human vision system by exploiting the capabilities of Lie human hearing system as an additional neural input. The human hearing system is capable of learning to process and interpret extremely complicated and rapidly changing auditory patterns. The known capabilities of the human hearing system to learn and understand complicated auditory patterns provided the basic motivation for developing an image-to-sound mapping system. The human brain is superior to most existing computer systems in rapidly extracting relevant information from blurred, noisy, and redundant images. From a theoretical viewpoint, this means that the available bandwidth is not exploited in an optimal way. While image-processing techniques can manipulate, condense and focus the information (e.g., Fourier Transforms), keeping the mapping as direct and simple as possible might also reduce the risk of accidentally filtering out important clues. After all, especially a perfect non-redundant sound representation is prone to loss of relevant information in the non-perfect human hearing system. Also, a complicated non-redundant image-to-sound mapping may well be far more difficult to learn and comprehend than a straightforward mapping, while the mapping system would increase in complexity and cost. This work will demonstrate some basic information processing for optimal information capture for headmounted systems.

Maluf, David A.↗

NASA NTRSDate not supplied

GL4U: GeneLab for Colleges and Universities

GeneLab for Colleges and Universities (GL4U) will provide space biology-relevant training in bioinformatics to the next generation of scientists through direct and indirect approaches. The GeneLab (GL) team will host two annual data processing bootcamps, one for college-level students (direct) and one for college educators (indirect – Training of Trainers), in which participants learn to analyze space-relevant omics data hosted on GL. The first bootcamp took place in early June 2021 with about 30 SJSU undergraduate students and covered space biology-specific lectures and hands-on instruction using Jupyter Notebooks (JNs) for RNA sequence (RNAseq) data analysis. All training materials including the enclosed files listed below will be made publicly available on GitHub. RNAseq Bootcamp Lectures (attached in combined file): Introduction to NASA, Space Biology, GeneLab, and the Command Line: NASA_GL_CL_Intro_FINAL.pdf - DRAFT from initial submission NASA_SB_GL_CL_Intro_FULL.pdf - FINAL version presented during the bootcamp - only minor edits from the draft version RNAseq and Data Processing Overview: RNAseq_Overview_FINAL.pdf - DRAFT from initial submission RNAseq_Overview_FULL.pdf - FINAL version presented during the bootcamp - only minor edits from the draft version Overview of the Statistics Used for RNAseq Data Analysis: SJSU_Statistics_Intro_Lecture_FINAL.pdf - DRAFT from initial submission Statistics_Overview_FULL.pdf - FINAL version presented during the bootcamp - only minor edits from the draft version Completed JNs in HTML format (attached in combined file): Unix_Intro_JN_06-2021_completed.html R_Intro_JN_06-2021_completed.html RNAseq_fastq_to_counts_JN_06-2021_completed.html RNAseq_DGE_JN_06-2021_completed.html RNAseq Bootcamp Recordings (attached): GL4U_RNAseq_Bootcamp_June_2021_Pilot_Day1_Part_1_of_5.mp4 GL4U_RNAseq_Bootcamp_June_2021_Pilot_Day1_Part_2_of_5.mp4 GL4U_RNAseq_Bootcamp_June_2021_Pilot_Day1_Part_3_of_5.mp4 *There were issues with the part 4 recording so that is not available GL4U_RNAseq_Bootcamp_June_2021_Pilot_Day1_Part_5_of_5.mp4 GL4U_RNAseq_Bootcamp_June_2021_Pilot_Day2_Part_1_of_3.mp4 GL4U_RNAseq_Bootcamp_June_2021_Pilot_Day2_Part_2_of_3.mp4 GL4U_RNAseq_Bootcamp_June_2021_Pilot_Day2_Part_3_of_3.mp4 GL4U_RNAseq_Bootcamp_June_2021_Pilot_Day3_Part_1_of_4.mp4 GL4U_RNAseq_Bootcamp_June_2021_Pilot_Day3_Part_2_of_4.mp4 GL4U_RNAseq_Bootcamp_June_2021_Pilot_Day3_Part_3_of_4.mp4 GL4U_RNAseq_Bootcamp_June_2021_Pilot_Day3_Part_4_of_4.mp4 GL4U_RNAseq_Bootcamp_June_2021_Pilot_Day4_Part_1_of_4.mp4 GL4U_RNAseq_Bootcamp_June_2021_Pilot_Day4_Part_2_of_4.mp4 GL4U_RNAseq_Bootcamp_June_2021_Pilot_Day4_Part_3_of_4.mp4 GL4U_RNAseq_Bootcamp_June_2021_Pilot_Day4_Part_4_of_4.mp4 GL4U_RNAseq_Bootcamp_June_2021_Pilot_Day5_Part_1_of_4.mp4 GL4U_RNAseq_Bootcamp_June_2021_Pilot_Day5_Part_2_of_4.mp4 GL4U_RNAseq_Bootcamp_June_2021_Pilot_Day5_Part_3_of_4.mp4 GL4U_RNAseq_Bootcamp_June_2021_Pilot_Day5_Part_4_of_4.mp4

GeneLab↗

NASA NTRS2022

Run Time Assurance for Electric Vertical Takeoff and Landing Aircraft

NASA is conducting research to demonstrate and evaluate the application of Run Time Assurance (RTA) as a means to assure safety in Electric Vertical Takeoff and Landing (eVTOL) aircraft with highly automated or autonomous flight capability supervised by a single onboard pilot. The work described in this report demonstrates an application of RTA and examines the implications for design and analysis of aircraft functions and systems; aircraft safety hazards; safety assurance; development assurance; and pilot tasks and performance. This research effort also seeks to assess the efficacy of the combined application of traditional Functional Hazard Analysis (FHA) and the more modern System Theoretic Process Analysis (STPA) techniques to perform hazard analyses on aircraft with complex automated and autonomous systems and an onboard pilot. During the research effort we developed architectural designs of two alternate eVTOL aircraft, generally following the process characterized in the SAE standards ARP4754 and ARP4761. The design has focused on the control architectures of these aircraft, which are identical except that one incorporates RTA techniques to reduce the criticality of some key software components. Artifacts of this process include a taxonomy of aircraft-level functions, aircraft-level architecture diagrams, aircraft-level functional hazard assessments (AFHA), function allocations onto aircraft systems and subsystems, functional block diagrams for a select set of control-related functions, and system-level functional hazard assessments (SFHA) for those functions. This project has highlighted the notion that DAL D is something of a sweet spot for low-confidence controllers in an RTA-based design. Among the many activities described in DO-178C, the activities related to requirement verifiability, algorithmic accuracy, and test coverage can be the most challenging for the kinds of advanced control techniques that may be desirable in novel UAM designs, such as adaptive control, machine-learning, artificial intelligence, numerical search, and Monte Carlo based algorithms. Moreover, the standard requires that development teams demonstrate that errors leading to unacceptable failure conditions have been removed from the software. The RTA architecture, which cordons off the low-confidence function, makes it much easier to show this for these kinds of algorithms. With regard to the use of STPA and FHA as complementary hazard analysis techniques, our research effort led us to the conclusion that STPA should be used to derive requirements for hardware and software systems and/or components. Also, STPA is a natural complement to other processes in ARP4754A involving design studies and iteration.

Run-time assurance↗

NASA NTRS2017

An Unobtrusive System to Measure, Assess, and Predict Cognitive Workload in Real-World Environments

Across many careers, individuals face alternating periods of high and low attention and cognitive workload, which can result in impaired cognitive functioning and can be detrimental to job performance. For example, some professions (e.g., fire fighters, emergency medical personnel, doctors and nurses working in an emergency room, pilots) require long periods of low workload (boredom), followed by sudden, high-tempo operations during which they may be required to respond to an emergency and perform at peak cognitive levels. Conversely, other professions (e.g., air traffic controllers, market investors in financial industries, analysts) require long periods of high workload and multitasking during which the addition of just one more task results in cognitive overload resulting in mistakes. An unobtrusive system to measure, assess, and predict cognitive workload could warn individuals, their teammates, or their supervisors when steps should be taken to augment cognitive readiness. In this talk I will describe an approach to this problem that we have found to be successful across work domains including: (1) a suite of unobtrusive, field-ready neurophysiological, physiological, and behavioral sensors that are chosen to best suit the target environment; (2) custom algorithms and statistical techniques to process and time-align raw data originating from the sensor suite; (3) probabilistic and statistical models designed to interpret the data into the human state of interest (e.g., cognitive workload, attention, fatigue); (4) and machine-learning techniques to predict upcoming performance based on the current pattern of events, and (5) display of each piece of information depending on the needs of the target user who may or may not want to drill down into the functioning of the system to determine how conclusions about human state and performance are determined. I will then focus in on our experimental results from our custom functional near-infrared spectroscopy sensor, designed to operate in real-world environments to be worn comfortably (e.g., positioned into a baseball cap or a surgeons cap) to measure changes in brain blood oxygenation without adding burden to the individual being assessed.

workload collection↗

NASA NTRS2011

Development of Tools and Techniques for Processing STORRM Flight Data

While at JSC for the summer of 2011, I was assigned to work on the sensor test for Orion relative-navigation risk mitigation (STORRM) development test objective (DTO). The STORRM DTO was flown on-board Endeavor during STS-134. The objective of the STORRM DTO is to test the visual navigation system (VNS), which will be used as the primary relative navigation sensor for the Orion spacecraft. The VNS is a flash lidar system intended to provide both line of sight and range information during rendezvous and proximity operations. The STORRM DTO also serves as a testbed for the high-resolution docking camera. This docking camera will be used to provide piloting cues for the crew during proximity operations. These instruments were mounted next to the trajectory control sensor (TCS) in Endeavour s payload bay. My principle objective for the summer was to generate a best estimated trajectory (BET) for Endeavor using the flight data collected by the VNS during rendezvous and the unprecedented re-rendezvous with the ISS. I processed the raw images from the VNS to produce range and bearing measurements. I then aggregated these measurements and extracted the measurements corresponding to individual reflectors. I combined the information contained in these measurements with data from the Endeavour's inertial sensors using Kalman smoothing techniques to ultimately produce a BET. This work culminated with a final presentation of the result to division management. Development of this tool required that traditional linear smoothing techniques be modified in a novel fashion to permit for the inclusion of non-linear measurements. This internship has greatly helped me further my career by providing exposure to real engineering projects. I also have benefited immensely from the mentorship of the engineers working on these projects. Many of the lessons I learned and experiences I had are of particular value because then can only be found in a place like JSC.

Robinson, Shane↗

NASA NTRS1999

Context-Specific Adaptation of Gravity-Dependent Vestibular Reflex Responses

Stabilization of the eyes and head during body movements is important for maintaining balance and keeping the images of objects stationary on our retinas. Impairment of this ability can lead to disorientation and reduced performance in sensorimotor tasks such as piloting of spacecraft. In the absence of a normal earth gravity field, the dynamics of head stabilization, and the interpretation of vestibular signals that sense gravity and linear acceleration, are subject to change. Transitions between different gravitoinertial force environments - as during different phases of space flight - provide an extreme test of the adaptive mechanisms that maintain these reflexive abilities. It is vitally important to determine human adaptive capabilities in such a circumstance, so that we can know to what extent the sensorimotor skills acquired in one gravity environment will transfer to others. Our work lays the foundation for understanding these capabilities, and for determining how we can aid the processes of adaptation and readaptation. An integrated set of experiments addresses this issue. We use the general approach of adapting some type of reflexive eye movement (saccades, the angular vestibulo-ocular reflex (AVOR), the linear vestibulo-ocular reflex (LVOR)), or the vestibulo-collic reflex (VCR), to a particular change in gain or phase in one condition of gravitoiner-tial force, and adapting to a different gain or phase (or asking for no change) in a second gravitoinertial force condition, and then seeing if the gravitoinertial force itself - the context cue - can recall the previously learned adapted responses. The majority of the experiments in the laboratory use the direction of vertical gaze or the direction of gravity (head tilt) as the context cue. This allows us to study context-specificity in a ground-based setting. One set of experiments, to be performed in parabolic flight, specifically uses the magnitude of gravitoinertial force as a context cue. This is a much better analog of the situation encountered in space flight. Various experiments investigate the behavioral properties, neurophysiological basis, and anatomical substrate of context-specific learning mechanisms. We use otolith (gravity) signals as the contextual cue for switching between adapted states of the saccadic system, the angular and linear vestibulo-ocular reflexes, and the VCR. (By LVOR we mean the oculomotor response - horizontal, vertical, and torsional - to linear translation of the head and body.) We are studying the effect of context on adaptation of saccade gain, phase and gain of the AVOR and LVOR, on ocular counterrolling (OCR) in response to static head tilt, and on head/neck reflexes (VCR) in response to rotation in different orientations. Such research is particularly germane to potential problems of postural and oculomotor control upon exposure to different gravitational environments.

Shelhamer, Mark J.↗