Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “human activity recognition”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS2016

Integrating Spaceflight Human System Risk Research

NASA is working to increase the likelihoods of human health and performance success during exploration missions, and subsequent crew long-term health. To manage the risks in achieving these goals, a system modeled after a Continuous Risk Management framework is in place. "Human System Risks" (Risks) have been identified, and approximately 30 are being actively addressed by NASA's Human Research Program (HRP). Research plans for each of HRP's Risks have been developed and are being executed. Ties between the research efforts supporting each Risk have been identified, however, this has been in an ad hoc fashion. There is growing recognition that solutions developed to address the full set of Risks covering medical, physiological, behavioral, vehicle, and organizational aspects of the exploration missions must be integrated across Risks and disciplines. We will discuss how a framework of factors influencing human health and performance in space is being applied as the backbone for bringing together sometimes disparate information relevant to the individual Risks. The resulting interrelated information is allowing us to identify and visualize connections between Risks and research efforts in a systematic and standardized way. We will discuss the applications of the visualizations and insights to research planning, solicitation, and decision-making processes.

Mindock, J.↗
NASA NTRS1993

A strip chart recorder pattern recognition tool kit for Shuttle operations

During Space Shuttle operations, Mission Control personnel monitor numerous mission-critical systems such as electrical power; guidance, navigation, and control; and propulsion by means of paper strip chart recorders. For example, electrical power controllers monitor strip chart recorder pen traces to identify onboard electrical equipment activations and deactivations. Recent developments in pattern recognition technologies coupled with new capabilities that distribute real-time Shuttle telemetry data to engineering workstations make it possible to develop computer applications that perform some of the low-level monitoring now performed by controllers. The number of opportunities for such applications suggests a need to build a pattern recognition tool kit to reduce software development effort through software reuse. We are building pattern recognition applications while keeping such a tool kit in mind. We demonstrated the initial prototype application, which identifies electrical equipment activations, during three recent Shuttle flights. This prototype was developed to test the viability of the basic system architecture, to evaluate the performance of several pattern recognition techniques including those based on cross-correlation, neural networks, and statistical methods, to understand the interplay between an advanced automation application and human controllers to enhance utility, and to identify capabilities needed in a more general-purpose tool kit.

Hammen, David G.↗
NASA NTRS2016

Internship Abstract and Final Reflection

The primary objective for this internship is the evaluation of an embedded natural language processor (NLP) as a way to introduce voice control into future space suits. An embedded natural language processor would provide an astronaut hands-free control for making adjustments to the environment of the space suit and checking status of consumables procedures and navigation. Additionally, the use of an embedded NLP could potentially reduce crew fatigue, increase the crewmember's situational awareness during extravehicular activity (EVA) and improve the ability to focus on mission critical details. The use of an embedded NLP may be valuable for other human spaceflight applications desiring hands-free control as well. An embedded NLP is unique because it is a small device that performs language tasks, including speech recognition, which normally require powerful processors. The dedicated device could perform speech recognition locally with a smaller form-factor and lower power consumption than traditional methods.

Sandor, Edward↗
NASA NTRS2016

Integrating Spaceflight Human System Risk Research

NASA is working to increase the likelihood of human health and performance success during exploration missions as well as to maintain the subsequent long-term health of the crew. To manage the risks in achieving these goals, a system modelled after a Continuous Risk Management framework is in place. "Human System Risks" (Risks) have been identified, and approximately 30 are being actively addressed by NASA's Human Research Program (HRP). Research plans for each of HRP's Risks have been developed and are being executed. Inter-disciplinary ties between the research efforts supporting each Risk have been identified; however, efforts to identify and benefit from these connections have been mostly ad hoc. There is growing recognition that solutions developed to address the full set of Risks covering medical, physiological, behavioural, vehicle, and organizational aspects of exploration missions must be integrated across Risks and disciplines. This paper discusses how a framework of factors influencing human health and performance in space is being applied as the backbone for bringing together sometimes disparate information relevant to the individual Risks. The resulting interrelated information enables identification and visualization of connections between Risks and research efforts in a systematic and standardized manner. This paper also discusses the applications of the visualizations and insights into research planning, solicitation, and decision-making processes.

Mindock, Jennifer↗
NASA NTRS1990

Close binding of identity and location in visual feature perception

The binding of identity and location information in disjunctive feature search was studied. Ss searched a heterogeneous display for a color or a form target, and reported both target identity and location. To avoid better than chance guessing of target identity (by choosing the target less likely to have been seen), the difficulty of the two targets was equalized adaptively; a mathematical model was used to quantify residual effects. A spatial layout was used that minimized postperceptual errors in reporting location. Results showed strong binding of identity and location perception. After correction for guessing, no perception of identity without location was found. A weak trend was found for accurate perception of target location without identity. We propose that activated features generate attention-calling "interrupt" signals, specifying only location; attention then retrieves the properties at that location.

Orientation↗
NASA NTRS1998

STS-90 Day 03 Highlights

On this third day of the STS-90 mission, the flight crew, Cmdr. Richard A. Searfoss, Pilot Scott D. Altman, and Mission Specialists Richard M. Linnehan, Dafydd Rhys Williams and Kathryn P. Hire, and Payload Specialists Jay C. Buckey and James A. Pawelczyk continue to conduct both human and animal research experiments in the Spacelab module. During the morning, the payload crew members Linnehan, Williams, Buckey and Pawelczyk performs transfer activities with the Animal Enclosure Module, setting up the General Purpose Work Station (GPWS) and operations with the ball catch experiment. In the afternoon, their attention will be on injections and dissections of some of the research animals and an objects recognition test.

Source record↗
NASA NTRS2013

Gesture-Based Robot Control with Variable Autonomy from the JPL Biosleeve

This paper presents a new gesture-based human interface for natural robot control. Detailed activity of the user's hand and arm is acquired via a novel device, called the BioSleeve, which packages dry-contact surface electromyography (EMG) and an inertial measurement unit (IMU) into a sleeve worn on the forearm. The BioSleeve's accompanying algorithms can reliably decode as many as sixteen discrete hand gestures and estimate the continuous orientation of the forearm. These gestures and positions are mapped to robot commands that, to varying degrees, integrate with the robot's perception of its environment and its ability to complete tasks autonomously. This flexible approach enables, for example, supervisory point-to-goal commands, virtual joystick for guarded teleoperation, and high degree of freedom mimicked manipulation, all from a single device. The BioSleeve is meant for portable field use; unlike other gesture recognition systems, use of the BioSleeve for robot control is invariant to lighting conditions, occlusions, and the human-robot spatial relationship and does not encumber the user's hands. The BioSleeve control approach has been implemented on three robot types, and we present proof-of-principle demonstrations with mobile ground robots, manipulation robots, and prosthetic hands.

BioSleeve↗
NASA NTRS2012

The International Space Station: New Capabilities for Disaster Response and Humanitarian Aid

The International Space Station (ISS) has been acquiring Earth imagery since 2000, primarily in the form of astronaut photography using hand-held film and digital cameras. Recent additions of more sophisticated multispectral and hyperspectral sensor systems have expanded both the capabilities and relevance of the ISS to basic research, applied Earth science, and development of new sensor technologies. Funding opportunities established within NASA, the US National Laboratories and the international partner organizations have generated instrument proposals that will further enhance these capabilities. With both internal and external sensor location options, and the availability of both automated and human-tended operational environments, the ISS is a unique platform within the constellation of Earth-observing satellites currently in orbit. Current progress and challenges associated with development of ISS terrestrial remote sensing capabilities in the area of disaster response and support of relief efforts will be presented. The ISS orbit allows for imaging of the Earth's surface at varying times of day and night, providing opportunities for data collection over approximately 95% of the populated regions. These opportunities are distinct from--yet augment--the data collection windows for the majority of sensors on polar-orbiting satellites. In addition to this potential for "being in the right place at the right time" to collect critical information on an evolving disaster, the presence of a human crew also allows for immediate recognition of an event from orbit, notification of relevant organizations on the ground, and re-tasking of available remote sensing resources to support humanitarian response and relief efforts. Challenges to establishing an integrated response capability are both technical (coordination of sensor targeting and data collection, rapid downlink and posting of data to a central accessible hub, timely generation and distribution of relevant data products) and operational (notification and engagement of sensor support teams, international partner agency sanction of astronaut support activities). To better collaborate on common issues and strengthen applications, including using the data to support disaster response, we established an ISS Program Science Forum Working Group for Earth Observations comprised of representatives from the international partner agencies. This international forum welcomes input and support from relevant United Nations task groups regarding our disaster response and humanitarian aid to enable development of the ISS capabilities in this area for greatest value to the international community.

Stefanov, William↗
NASA NTRS2000

Neural activation during response competition

The flanker task, introduced by Eriksen and Eriksen [Eriksen, B. A., & Eriksen, C. W. (1974). Effects of noise letters upon the identification of a target letter in a nonsearch task. Perception & Psychophysics, 16, 143--149], provides a means to selectively manipulate the presence or absence of response competition while keeping other task demands constant. We measured brain activity using functional magnetic resonance imaging (fMRI) during performance of the flanker task. In accordance with previous behavioral studies, trials in which the flanking stimuli indicated a different response than the central stimulus were performed significantly more slowly than trials in which all the stimuli indicated the same response. This reaction time effect was accompanied by increases in activity in four regions: the right ventrolateral prefrontal cortex, the supplementary motor area, the left superior parietal lobe, and the left anterior parietal cortex. The increases were not due to changes in stimulus complexity or the need to overcome previously learned associations between stimuli and responses. Correspondences between this study and other experiments manipulating response interference suggest that the frontal foci may be related to response inhibition processes whereas the posterior foci may be related to the activation of representations of the inappropriate responses.

Brain Mapping/methods↗
NASA NTRS1986

Machine vision and the OMV

The orbital Maneuvering Vehicle (OMV) is intended to close with orbiting targets for relocation or servicing. It will be controlled via video signals and thruster activation based upon Earth or space station directives. A human operator is squarely in the middle of the control loop for close work. Without directly addressing future, more autonomous versions of a remote servicer, several techniques that will doubtless be important in a future increase of autonomy also have some direct application to the current situation, particularly in the area of image enhancement and predictive analysis. Several techniques are presentet, and some few have been implemented, which support a machine vision capability proposed to be adequate for detection, recognition, and tracking. Once feasibly implemented, they must then be further modified to operate together in real time. This may be achieved by two courses, the use of an array processor and some initial steps toward data reduction. The methodology or adapting to a vector architecture is discussed in preliminary form, and a highly tentative rationale for data reduction at the front end is also discussed. As a by-product, a working implementation of the most advanced graphic display technique, ray-casting, is described.

Mcanulty, M. A.↗
NASA NTRS2003

Sleep deprivation influences some but not all processes of supervisory attention

Does one night of sleep deprivation alter processes of supervisory attention in general or only a specific subset of such processes? Twenty college-aged volunteers, half female, performed a choice reaction time task. A cue indicated that compatible (e.g., right button, right-pointing arrow) or incompatible (e.g., left button, right-pointing arrow) responses were to be given to a stimulus that followed 50 or 500 ms later. The paradigm assessed response inhibition, task-shifting skill, and task strategy-processes inherent in supervisory attention. Performance, along with heart rate, was assessed for 12 hr following normal sleep or a night of complete sleep deprivation. Sleep deprivation altered neither preparation for task shifting nor response inhibition. The ability to use preparatory bias to speed performance did decrease with sleep deprivation. Sleep deprivation appears to selectively affect this supervisory attention process, which is perceived as an active effort to cope with a challenging task.

NASA Discipline Regulatory Physiology↗
NASA NTRS1998

Nonverbal working memory of humans and monkeys: rehearsal in the sketchpad?

Investigations of working memory tend to focus on the retention of verbal information. The present experiments were designed to characterize the active maintenance rehearsal process used in the retention of visuospatial information. Rhesus monkeys (Macaca mulatta; N = 6) were tested as well as humans (total N = 90) because these nonhuman primates have excellent visual working memory but, unlike humans, cannot verbally recode the stimuli to employ verbal rehearsal mechanisms. A series of experiments was conducted using a distractor-task paradigm, a directed forgetting procedure, and a dual-task paradigm. No evidence was found for an active maintenance process for either species. Rather, it appears that information is maintained in the visuospatial sketchpad without active rehearsal.

Non-NASA Center↗
NASA NTRS2012

Tactile Data Entry for Extravehicular Activity

In the task-saturated environment of extravehicular activity (EVA), an astronaut's ability to leverage suit-integrated information systems is limited by a lack of options for data entry. In particular, bulky gloves inhibit the ability to interact with standard computing interfaces such as a mouse or keyboard. This paper presents the results of a preliminary investigation into a system that permits the space suit gloves themselves to be used as data entry devices. Hand motion tracking is combined with simple finger gesture recognition to enable use of a virtual keyboard, while tactile feedback provides touch-based context to the graphical user interface (GUI) and positive confirmation of keystroke events. In human subject trials, conducted with twenty participants using a prototype system, participants entered text significantly faster with tactile feedback than without (p = 0.02). The results support incorporation of vibrotactile information in a future system that will enable full touch typing and general mouse interactions using instrumented EVA gloves.

Adams, Richard J.↗
NASA NTRS2015

International Space Station Earth Observations Working Group

The multilateral Earth Observations Working Group (EOWG) was chartered in May 2012 in order to improve coordination and collaboration of Earth observing payloads, research, and applications on the International Space Station (ISS). The EOWG derives its authority from the ISS Program Science Forum, and a NASA representative serves as a permanent co-chair. A rotating co-chair position can be occupied by any of the international partners, following concurrence by the other partners; a JAXA representative is the current co-chair. Primary functions of the EOWG include, 1) the exchange of information on plans for payloads, from science and application objectives to instrument development, data collection, distribution and research; 2) recognition and facilitation of opportunities for international collaboration in order to optimize benefits from different instruments; and 3) provide a formal ISS Program interface for collection and application of remotely sensed data collected in response to natural disasters through the International Charter, Space and Major Disasters. Recent examples of EOWG activities include coordination of bilateral data sharing protocols between NASA and TsNIIMash for use of crew time and instruments in support of ATV5 reentry imaging activities; discussion of continued use and support of the Nightpod camera mount system by NASA and ESA; and review and revision of international partner contributions on Earth observations to the ISS Program Benefits to Humanity publication.

Stefanov, William L.↗
NASA NTRS2018

Overview of Artificial Intelligence (AI) at NASA Goddard

Artificial Intelligence (AI) is a collection of advanced technologies that allows machines to think and act, both humanly and rationally, through sensing, comprehending, acting and learning. AI's foundations lie at the intersection of several traditional fields Philosophy, Mathematics, Economics, Neuroscience, Psychology and Computer Science. Although the inception of AI started in the 1950's, it has recently made a strong comeback in all aspects of society and all over the world; this is mainly due to the timely combination of increased data volumes, advanced and mature algorithms, and improvements in computing power and storage. Current AI applications include big data analytics, robotics, intelligent sensing, assisted decision making, and speech recognition just to name a few. During the Tour, we will show a few examples of the current AI activities at NASA Goddard.

Le Moigne, Jacqueline↗
NASA NTRS2002

Pittsburgh Public School District / Carnegie Mellon University Robotics Team Participation in the US First Competition

FIRST, For Inspiration and Recognition of Science and Technology, is an international program designed to encourage junior and senior high school students to participate in science and technology related activities. FIRST attempts to increase enthusiasm for technology by providing a competitive environment in which to demonstrate robotics technology designed for a particular set of tasks. Carnegie Mellon University provided student members of the project the opportunity to complete the design, construction, testing, and operation of a robot. Electrical, mechanical, and programming skills were stressed, with both adult and senior students acting as mentors for more junior members. Teamwork and integration was also stressed in order to provide students with a realistic feel for project-based work. Finally, an emphasis was placed on recruiting students with greater difficulty in entering technological fields: girls and ethnic minorities and students leaning toward humanities (especially art). Carnegie Mellon built a relationship with Taylor Allderdice High School that lasted four years. For four years, the success of the project increased each year. Each term, the students successfully designed and built a working robot that could fully participate in the competition. The enthusiasm of the students has been the cornerstone of the recruit of new students, keeping the project growing and vital. Carnegie Mellon's participation with Allderdice has been an overall great success.

Stroupe, Ashley↗
NASA NTRS2006

Comprehensive Environmental Informatics System (CEIS) Integrating Crew and Vehicle Environmental Health

Integrated Vehicle Health Management (IVHM) systems have been pursued as highly integrated systems that include smart sensors, diagnostic and prognostics software for assessments of real-time and life-cycle vehicle health information. Inclusive to such a system is the requirement to monitor the environmental health within the vehicle and the occupants of the vehicle. In this regard an enterprise approach to informatics is used to develop a methodology entitled, Comprehensive Environmental Informatics System (CEIS). The hardware and software technologies integrated into this system will be embedded in the vehicle subsystems, and maintenance operations, to provide both real-time and life-cycle health information of the environment within the vehicle cabin and of its occupants. This comprehensive information database will enable informed decision making and logistics management. One key element of the CEIS is interoperability for data acquisition and archive between environment and human system monitoring. With comprehensive components the data acquired in this system will use model based reasoning systems for subsystem and system level managers, advanced on-board and ground-based mission and maintenance planners to assess system functionality. Knowledge databases of the vehicle health state will be continuously updated and reported for critical failure modes, and routinely updated and reported for life cycle condition trending. Sufficient intelligence, including evidence-based engineering practices which are analogous to evidencebased medicine practices, will be included in the CEIS to result in more rapid recognition of off-nominal operation to enable quicker corrective actions. This will result from better information (rather than just data) for improved crew/operator situational awareness, which will produce significant vehicle and crew safety improvements, as well as increasing the chance for mission success, future mission planning as well as training. Other benefits include improved reliability, increase safety in operations and cost of operations. The cost benefits stem from significantly reduced processing and operations manpower, predictive maintenance for systems and subjects. The improvements in vehicle functionality and cost will result from increased prognostic and diagnostic capability due to the detailed total human exploration system health knowledge from CEIS. A collateral benefit is that there will be closer observations of the vehicle occupants as wrist watch sized devices are worn for continuous health monitoring. Additional database acquisition will stem from activities in countermeasure practices to ensure peak performance capability by occupants of the vehicle. The CEIS will provide data from advanced sensing technologies and informatics modeling which will be useful in problem troubleshooting, and improving NASA s awareness of systems during operation.

Nall, Mark E.↗
NASA NTRS2008

Evolution of the Mobile Information SysTem (MIST)

The Mobile Information SysTem (MIST) had its origins in the need to determine whether commercial off the shelf (COTS) technologies could improve intervehicular activities (IVA) on International Space Station (ISS) crew maintenance productivity. It began with an exploration of head mounted displays (HMDs), but quickly evolved to include voice recognition, mobile personal computing, and data collection. The unique characteristic of the MIST lies within its mobility, in which a vest is worn that contains a mini-computer and supporting equipment, and a headband with attachments for a HMD, lipstick camera, and microphone. Data is then captured directly by the computer running Morae(TM) or similar software for analysis. To date, the MIST system has been tested in numerous environments such as two parabolic flights on NASA's C-9 microgravity aircraft and several mockup facilities ranging from ISS to the Altair Lunar Sortie Lander. Functional capabilities have included its lightweight and compact design, commonality across systems and environments, and usefulness in remote collaboration. Human Factors evaluations of the system have proven the MIST's ability to be worn for long durations of time (approximately four continuous hours) with no adverse physical deficits, moderate operator compensation, and low workload being reported as measured by Corlett Bishop Discomfort Scale, Cooper-Harper Ratings, and the NASA Total Workload Index (TLX), respectively. Additionally, through development of the system, it has spawned several new applications useful in research. For example, by only employing the lipstick camera, microphone, and a compact digital video recorder (DVR), we created a portable, lightweight data collection device. Video is recorded from the participants point of view (POV) through the use of the camera mounted on the side of the head. Both the video and audio is recorded directly into the DVR located on a belt around the waist. This data is then transferred to another computer for video editing and analysis. Another application has been discovered using simulated flight, in which, a kneeboard is replaced with mini-computer and the HMD to project flight paths and glide slopes for lunar ascent. As technologies evolve, so will the system and its application for research and space system operations.

Litaker, Harry L., Jr.↗