Engineering topics

Jorgensen, Charles

Publications and source records attributed to Jorgensen, Charles.

12 records

NASA NTRS2008

Electronic Escape Trails for Firefighters

A proposed wireless-communication and data-processing system would exploit recent advances in radio-frequency identification devices (RFIDs) and software to establish information lifelines between firefighters in a burning building and a fire chief at a control station near but outside the building. The system would enable identification of trails that firefighters and others could follow to escape from the building, including identification of new trails should previously established trails become blocked. The system would include a transceiver unit and a computer at the control station, portable transceiver units carried by the firefighters in the building, and RFID tags that the firefighters would place at multiple locations as they move into and through the building (see figure). Each RFID tag, having a size of the order of a few centimeters, would include at least standard RFID circuitry and possibly sensors for measuring such other relevant environmental parameters as temperature, levels of light and sound, concentration of oxygen, concentrations of hazardous chemicals in smoke, and/or levels of nuclear radiation. The RFID tags would be activated and interrogated by the firefighters and control-station transceivers. Preferably, RFID tags would be configured to communicate with each other and with the firefighters units and the control station in an ordered sequence, with built-in redundancy. In a typical scenario, as firefighters moved through a building, they would scatter many RFID tags into smoke-obscured areas by use of a compressed-air gun. Alternatively or in addition, they would mark escape trails by dropping RFID tags at such points of interest as mantraps, hot spots, and trail waypoints. The RFID tags could be of different types, operating at different frequencies to identify their functions, and possibly responding by emitting audible beeps when activated by signals transmitted by transceiver units carried by nearby firefighters.

Jorgensen, Charles↗

NASA NTRS2007

Applications for Subvocal Speech

A research and development effort now underway is directed toward the use of subvocal speech for communication in settings in which (1) acoustic noise could interfere excessively with ordinary vocal communication and/or (2) acoustic silence or secrecy of communication is required. By "subvocal speech" is meant sub-audible electromyographic (EMG) signals, associated with speech, that are acquired from the surface of the larynx and lingual areas of the throat. Topics addressed in this effort include recognition of the sub-vocal EMG signals that represent specific original words or phrases; transformation (including encoding and/or enciphering) of the signals into forms that are less vulnerable to distortion, degradation, and/or interception; and reconstruction of the original words or phrases at the receiving end of a communication link. Potential applications include ordinary verbal communications among hazardous- material-cleanup workers in protective suits, workers in noisy environments, divers, and firefighters, and secret communications among law-enforcement officers and military personnel in combat and other confrontational situations.

Jorgensen, Charles↗

NASA NTRS2006

SSRL Emergency Response Shore Tool

The SSRL Emergency Response Shore Tool (wherein SSRL signifies Smart Systems Research Laboratory ) is a computer program within a system of communication and mobile-computing software and hardware being developed to increase the situational awareness of first responders at building collapses. This program is intended for use mainly in planning and constructing shores to stabilize partially collapsed structures. The program consists of client and server components, runs in the Windows operating system on commercial off-the-shelf portable computers, and can utilize such additional hardware as digital cameras and Global Positioning System devices. A first responder can enter directly, into a portable computer running this program, the dimensions of a required shore. The shore dimensions, plus an optional digital photograph of the shore site, can then be uploaded via a wireless network to a server. Once on the server, the shore report is time-stamped and made available on similarly equipped portable computers carried by other first responders, including shore wood cutters and an incident commander. The staff in a command center can use the shore reports and photographs to monitor progress and to consult with structural engineers to assess whether a building is in imminent danger of further collapse.

Mah, Robert W.↗

NASA NTRS2006

Generating Control Commands From Gestures Sensed by EMG

An effort is under way to develop noninvasive neuro-electric interfaces through which human operators could control systems as diverse as simple mechanical devices, computers, aircraft, and even spacecraft. The basic idea is to use electrodes on the surface of the skin to acquire electromyographic (EMG) signals associated with gestures, digitize and process the EMG signals to recognize the gestures, and generate digital commands to perform the actions signified by the gestures. In an experimental prototype of such an interface, the EMG signals associated with hand gestures are acquired by use of several pairs of electrodes mounted in sleeves on a subject s forearm (see figure). The EMG signals are sampled and digitized. The resulting time-series data are fed as input to pattern-recognition software that has been trained to distinguish gestures from a given gesture set. The software implements, among other things, hidden Markov models, which are used to recognize the gestures as they are being performed in real time. Thus far, two experiments have been performed on the prototype interface to demonstrate feasibility: an experiment in synthesizing the output of a joystick and an experiment in synthesizing the output of a computer or typewriter keyboard. In the joystick experiment, the EMG signals were processed into joystick commands for a realistic flight simulator for an airplane. The acting pilot reached out into the air, grabbed an imaginary joystick, and pretended to manipulate the joystick to achieve left and right banks and up and down pitches of the simulated airplane. In the keyboard experiment, the subject pretended to type on a numerical keypad, and the EMG signals were processed into keystrokes. The results of the experiments demonstrate the basic feasibility of this method while indicating the need for further research to reduce the incidence of errors (including confusion among gestures). Topics that must be addressed include the numbers and arrangements of electrodes needed to acquire sufficient data; refinements in the acquisition, filtering, and digitization of EMG signals; and methods of training the pattern- recognition software. The joystick and keyboard simulations were chosen for the initial experiments because they are familiar to many computer users. It is anticipated that, ultimately, interfaces would utilize EMG signals associated with movements more nearly natural than those associated with joysticks or keyboards. Future versions of the pattern-recognition software are planned to be capable of adapting to the preferences and day-today variations in EMG outputs of individual users; this capability for adaptation would also make it possible to select gestures that, to a given user, feel the most nearly natural for generating control signals for a given task (provided that there are enough properly positioned electrodes to acquire the EMG signals from the muscles involved in the gestures).

Wheeler, Kevin R.↗

NASA NTRS2006

Multimodal Platform Control for Robotic Planetary Exploration Missions

Planetary exploration missions pose unique problems for astronauts seeking to coordinate and control exploration vehicles. These include working in an environment filled with abrasive dust (e.g., regolith compositions), a desire to have effective hands-free communication, and a desire to have effective analog control of robotic platforms or end effectors. Requirements to operate in pressurized suits are particularly problematic due to the increased bulk and stiffness of gloves. As a result, researchers are considering alternative methods to perform fine movement control, for example capitalizing on higher-order voice actuation commands to perform control tasks. This paper presents current research at NASA s Neuro Engineering Laboratory that explores one method-direct bioelectric interpretation-for handling some of these problems. In this type of control system, electromyographic (EMG) signals are used both to facilitate understanding of acoustic speech in pressure-regulated suits 2nd to provide smooth analog control of a robotic platform, all without requiring fine-gained hand movement. This is accomplished through the use of non-invasive silver silver-chloride electrodes located on the forearm, throat, and lower chin, positioned so as to receive electrical activity originating from the muscles during contraction. For direct analog platform control, a small Personal Exploration Rover (PER) built by Carnegie Mellon University Robotics is controlled using forearm contraction duration and magnitudes, measured using several EMG channels. Signal processing is used to translate these signals into directional platform rotation rates and translational velocities. higher order commands were generated by differential contraction patterns called "clench codes."

Jorgensen, Charles↗

NASA NTRS2006

Improving Situational Awareness for First Responders via Mobile Computing

This project looks to improve first responder incident command, and an appropriately managed flow of situational awareness using mobile computing techniques. The prototype system combines wireless communication, real-time location determination, digital imaging, and three-dimensional graphics. Responder locations are tracked in an outdoor environment via GPS and uploaded to a central server via GPRS or an 802. II network. Responders can also wireless share digital images and text reports, both with other responders and with the incident commander. A pre-built three dimensional graphics model of the emergency scene is used to visualize responder and report locations. Responders have a choice of information end points, ranging from programmable cellular phones to tablet computers. The system also employs location-aware computing to make responders aware of particular hazards as they approach them. The prototype was developed in conjunction with the NASA Ames Disaster Assistance and Rescue Team and has undergone field testing during responder exercises at NASA Ames.

Betts, Bradley J.↗

NASA NTRS2005

Small Vocabulary Recognition Using Surface Electromyography in an Acoustically Harsh Environment

This paper presents results of electromyographic-based (EMG-based) speech recognition on a small vocabulary of 15 English words. The work was motivated in part by a desire to mitigate the effects of high acoustic noise on speech intelligibility in communication systems used by first responders. Both an off-line and a real-time system were constructed. Data were collected from a single male subject wearing a fireghter's self-contained breathing apparatus. A single channel of EMG data was used, collected via surface sensors at a rate of 104 samples/s. The signal processing core consisted of an activity detector, a feature extractor, and a neural network classifier. In the off-line phase, 150 examples of each word were collected from the subject. Generalization testing, conducted using bootstrapping, produced an overall average correct classification rate on the 15 words of 74%, with a 95% confidence interval of [71%, 77%]. Once the classifier was trained, the subject used the real-time system to communicate and to control a robotic device. The real-time system was tested with the subject exposed to an ambient noise level of approximately 95 decibels.

Betts, Bradley J.↗

NASA NTRS2005

Improving Situational Awareness for First Responders via Mobile Computing

This project looks to improve first responder situational awareness using tools and techniques of mobile computing. The prototype system combines wireless communication, real-time location determination, digital imaging, and three-dimensional graphics. Responder locations are tracked in an outdoor environment via GPS and uploaded to a central server via GPRS or an 802.11 network. Responders can also wirelessly share digital images and text reports, both with other responders and with the incident commander. A pre-built three dimensional graphics model of a particular emergency scene is used to visualize responder and report locations. Responders have a choice of information end points, ranging from programmable cellular phones to tablet computers. The system also employs location-aware computing to make responders aware of particular hazards as they approach them. The prototype was developed in conjunction with the NASA Ames Disaster Assistance and Rescue Team and has undergone field testing during responder exercise at NASA Ames.

Betts, Bradley J.↗

NASA NTRS2003

Subauditory Speech Recognition based on EMG/EPG Signals

Sub-vocal electromyogram/electro palatogram (EMG/EPG) signal classification is demonstrated as a method for silent speech recognition. Recorded electrode signals from the larynx and sublingual areas below the jaw are noise filtered and transformed into features using complex dual quad tree wavelet transforms. Feature sets for six sub-vocally pronounced words are trained using a trust region scaled conjugate gradient neural network. Real time signals for previously unseen patterns are classified into categories suitable for primitive control of graphic objects. Feature construction, recognition accuracy and an approach for extension of the technique to a variety of real world application areas are presented.

Jorgensen, Charles↗

NASA NTRS2000

Bioelectric Control of a 757 Class High Fidelity Aircraft Simulation

This paper presents results of a recent experiment in fine grain Electromyographic (EMG) signal recognition, We demonstrate bioelectric flight control of 757 class simulation aircraft landing at San Francisco International Airport. The physical instrumentality of a pilot control stick is not used. A pilot closes a fist in empty air and performs control movements which are captured by a dry electrode array on the arm, analyzed and routed through a flight director permitting full pilot outer loop control of the simulation. A Vision Dome immersive display is used to create a VR world for the aircraft body mechanics and flight changes to pilot movements. Inner loop surfaces and differential aircraft thrust is controlled using a hybrid neural network architecture that combines a damage adaptive controller (Jorgensen 1998, Totah 1998) with a propulsion only based control system (Bull & Kaneshige 1997). Thus the 757 aircraft is not only being flown bioelectrically at the pilot level but also demonstrates damage adaptive neural network control permitting adaptation to severe changes in the physical flight characteristics of the aircraft at the inner loop level. To compensate for accident scenarios, the aircraft uses remaining control surface authority and differential thrust from the engines. To the best of our knowledge this is the first time real time bioelectric fine-grained control, differential thrust based control, and neural network damage adaptive control have been integrated into a single flight demonstration. The paper describes the EMG pattern recognition system and the bioelectric pattern recognition methodology.

Jorgensen, Charles↗

NASA NTRS2000

Neuroelectric Virtual Devices

This paper presents recent results in neuroelectric pattern recognition of electromyographic (EMG) signals used to control virtual computer input devices. The devices are designed to substitute for the functions of both a traditional joystick and keyboard entry method. We demonstrate recognition accuracy through neuroelectric control of a 757 class simulation aircraft landing at San Francisco International Airport using a virtual joystick as shown. This is accomplished by a pilot closing his fist in empty air and performing control movements that are captured by a dry electrode array on the arm which are then analyzed and routed through a flight director permitting full pilot outer loop control of the simulation. We then demonstrate finer grain motor pattern recognition through a virtual keyboard by having a typist tap his traders on a typical desk in a touch typist position. The EMG signals are then translated to keyboard presses and displayed. The paper describes the bioelectric pattern recognition methodology common to both examples. Figure 2 depicts raw EMG data from typing, the numeral '8' and the numeral '9'. These two gestures are very close in appearance and statistical properties yet are distinguishable by our hidden Kharkov model algorithms. Extensions of this work to NASA emissions and robotic control are considered.

Wheeler, Kevin↗

NASA NTRS1997

System and Method for Modeling the Flow Performance Features of an Object

The method and apparatus includes a neural network for generating a model of an object in a wind tunnel from performance data on the object. The network is trained from test input signals (e.g., leading edge flap position, trailing edge flap position, angle of attack, and other geometric configurations, and power settings) and test output signals (e.g., lift, drag, pitching moment, or other performance features). In one embodiment, the neural network training method employs a modified Levenberg-Marquardt optimization technique. The model can be generated 'real time' as wind tunnel testing proceeds. Once trained, the model is used to estimate performance features associated with the aircraft given geometric configuration and/or power setting input. The invention can also be applied in other similar static flow modeling applications in aerodynamics, hydrodynamics, fluid dynamics, and other such disciplines. For example, the static testing of cars, sails, and foils, propellers, keels, rudders, turbines, fins, and the like, in a wind tunnel, water trough, or other flowing medium.

Jorgensen, Charles↗