Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “speech perception”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

Required attention for synthesized speech perception for three levels of linguistic redundancy

The study evaluates the attention required for synthesized speech perception with reference to three levels of linguistic redundancy. Twelve commercial airline pilots were individually tested for 16 cockpit warning messages eight of which consisted of two monosyllabic key words and eight of which consisted of two polysyllabic key words. Three levels of linguistic redundancy were identified: monosyllabic words, polysyllabic words, and sentences. The experiment contained a message familiarization phase and a message recognition phase. It was found that: (1) when the messages are part of a previously learned and recently heard set, and the subject is familiar with the phrasing, the attention needed to recognize the message is not a function of the level of linguistic redundancy, and (2) there is a quantitative and qualitative difference between recognition and comprehension processes; only in the case of active comprehension does additional redundancy reduce attention requirements.

Simpson, C. A.↗

A pilot study: Auditory steady-state responses (ASSR) can be measured in human fetuses using fetal magnetoencephalography (fMEG)

Auditory steady-state responses (ASSRs) are ongoing evoked brain responses to continuous auditory stimuli that play a role for auditory processing of complex sounds and speech perception. Transient auditory event-related responses (AERRs) have previously been recorded using fetal magnetoencephalography (fMEG) but involve different neurological pathways. Previous studies in children and adults demonstrated that the cortical components of the ASSR are significantly affected by state of consciousness and by maturational changes in neonates and young infants. To our knowledge, this is the first study to investigate ASSRs in human fetuses. 47 fMEG sessions were conducted with 24 healthy pregnant women in three gestational age groups (30–32 weeks, 33–35 weeks and 36–39 weeks). The stimulation consisted of amplitude-modulated (AM) tones with a duration of one second, a carrier frequency (CF) of 500 Hz and a modulation frequency (MF) of 27 Hz or 42 Hz. Both tones were presented in a random order with equal probability adding up to 80–100 repetitions per tone. The ASSR across trials was quantified by assessing phase synchrony in the cortical signals at the stimulation frequency. Ten out of 47 recordings were excluded due to technical problems or maternal movements. Analysis of the included 37 fetal recordings revealed a statistically significant response for the phase coherence between trials for the MF of 27 Hz but not for 42 Hz. An exploratory subgroup analysis moreover suggested an advantage in detectability for fetal behavioral state 2F (active asleep) compared to 1F (quiet asleep) detected using fetal heart rate. In conclusion, this pilot study is the first description of a method to detect human ASSRs in fetuses. The findings warrant further investigations of the developing fetal brain.

59 BASIC BIOLOGICAL SCIENCES↗

Direct comparison of the impact of head tracking, reverberation, and individualized head-related transfer functions on the spatial perception of a virtual speech source

A study of sound localization performance was conducted using headphone-delivered virtual speech stimuli, rendered via HRTF-based acoustic auralization software and hardware, and blocked-meatus HRTF measurements. The independent variables were chosen to evaluate commonly held assumptions in the literature regarding improved localization: inclusion of head tracking, individualized HRTFs, and early and diffuse reflections. Significant effects were found for azimuth and elevation error, reversal rates, and externalization.

NASA Discipline Space Human Factors↗

Speech communication

Computer analysis of speech, vowel perception by children, and articulatory activity during production of intervocalic fricative consonants

COMPUTER METHOD↗

Assessment methods for determining small changes in hearing performance over time

Although the behavioral pure-tone threshold audiogram is considered the gold standard for quantifying hearing loss, assessment of speech understanding, especially in noise, is more relevant to quality of life but is only partly related to the audiogram. Metrics of speech understanding in noise are therefore an attractive target for assessing hearing over time. However, speech-in-noise assessments have more potential sources of variability than pure-tone threshold measures, making it a challenge to obtain results reliable enough to detect small changes in performance. Here, this review examines the benefits and limitations of speech-understanding metrics and their application to longitudinal hearing assessment, and identifies potential sources of variability, including learning effects, differences in item difficulty, and between- and within-individual variations in effort and motivation. We conclude by recommending the integration of non-speech auditory tests, which provide information about aspects of auditory health that have reduced variability and fewer central influences than speech tests, in parallel with the traditional audiogram and speech-based assessments.

60 APPLIED LIFE SCIENCES↗

Voice input/output capabilities at Perception Technology Corporation

Condensed resumes of key company personnel at the Perception Technology Corporation are presented. The staff possesses recognition, speech synthesis, speaker authentication, and language identification. Hardware and software engineers' capabilities are included.

Ferber, Leon A.↗

Multichannel spatial auditory display for speech communications

A spatial auditory display for multiple speech communications was developed at NASA/Ames Research Center. Input is spatialized by the use of simplified head-related transfer functions, adapted for FIR filtering on Motorola 56001 digital signal processors. Hardware and firmware design implementations are overviewed for the initial prototype developed for NASA-Kennedy Space Center. An adaptive staircase method was used to determine intelligibility levels of four-letter call signs used by launch personnel at NASA against diotic speech babble. Spatial positions at 30 degrees azimuth increments were evaluated. The results from eight subjects showed a maximum intelligibility improvement of about 6-7 dB when the signal was spatialized to 60 or 90 degrees azimuth positions.

NASA Discipline Space Human Factors↗

Motion Planning in a Society of Intelligent Mobile Agents

The majority of the work on this grant involved formal modeling of human-computer integration. We conceptualize computer resources as a multiagent system so that these resources and human collaborators may be modeled uniformly. In previous work we had used modal for this uniform modeling, and we had developed a process-algebraic agent abstraction. In this work, we applied this abstraction (using CSP) in uniformly modeling agents and users, which allowed us to use tools for investigating CSP models. This work revealed the power of, process-algebraic handshakes in modeling face-to-face conversation. We also investigated specifications of human-computer systems in the style of algebraic specification. This involved specifying the common knowledge required for coordination and process-algebraic patterns of communication actions intended to establish the common knowledge. We investigated the conditions for agents endowed with perception to gain common knowledge and implemented a prototype neural-network system that allows agents to detect when such conditions hold. The literature on multiagent systems conceptualizes communication actions as speech acts. We implemented a prototype system that infers the deontic effects (obligations, permissions, prohibitions) of speech acts and detects violations of these effects. A prototype distributed system was developed that allows users to collaborate in moving proxy agents; it was designed to exploit handshakes and common knowledge Finally. in work carried over from a previous NASA ARC grant, about fifteen undergraduates developed and presented projects on multiagent motion planning.

Esterline, Albert C.↗

Perception and performance in flight simulators: The contribution of vestibular, visual, and auditory information

The pilot's perception and performance in flight simulators is examined. The areas investigated include: vestibular stimulation, flight management and man cockpit information interfacing, and visual perception in flight simulation. The effects of higher levels of rotary acceleration on response time to constant acceleration, tracking performance, and thresholds for angular acceleration are examined. Areas of flight management examined are cockpit display of traffic information, work load, synthetic speech call outs during the landing phase of flight, perceptual factors in the use of a microwave landing system, automatic speech recognition, automation of aircraft operation, and total simulation of flight training.

Source record↗

On the nature and evolution of the neural bases of human language

The traditional theory equating the brain bases of language with Broca's and Wernicke's neocortical areas is wrong. Neural circuits linking activity in anatomically segregated populations of neurons in subcortical structures and the neocortex throughout the human brain regulate complex behaviors such as walking, talking, and comprehending the meaning of sentences. When we hear or read a word, neural structures involved in the perception or real-world associations of the word are activated as well as posterior cortical regions adjacent to Wernicke's area. Many areas of the neocortex and subcortical structures support the cortical-striatal-cortical circuits that confer complex syntactic ability, speech production, and a large vocabulary. However, many of these structures also form part of the neural circuits regulating other aspects of behavior. For example, the basal ganglia, which regulate motor control, are also crucial elements in the circuits that confer human linguistic ability and abstract reasoning. The cerebellum, traditionally associated with motor control, is active in motor learning. The basal ganglia are also key elements in reward-based learning. Data from studies of Broca's aphasia, Parkinson's disease, hypoxia, focal brain damage, and a genetically transmitted brain anomaly (the putative "language gene," family KE), and from comparative studies of the brains and behavior of other species, demonstrate that the basal ganglia sequence the discrete elements that constitute a complete motor act, syntactic process, or thought process. Imaging studies of intact human subjects and electrophysiologic and tracer studies of the brains and behavior of other species confirm these findings. As Dobzansky put it, "Nothing in biology makes sense except in the light of evolution" (cited in Mayr, 1982). That applies with as much force to the human brain and the neural bases of language as it does to the human foot or jaw. The converse follows: the mark of evolution on the brains of human beings and other species provides insight into the evolution of the brain bases of human language. The neural substrate that regulated motor control in the common ancestor of apes and humans most likely was modified to enhance cognitive and linguistic ability. Speech communication played a central role in this process. However, the process that ultimately resulted in the human brain may have started when our earliest hominid ancestors began to walk.

Review, Tutorial↗

Deep learning approaches for neural decoding across architectures and recording modalities

Decoding behavior, perception or cognitive state directly from neural signals is critical for brain–computer interface research and an important tool for systems neuroscience. In the last decade, deep learning has become the state-of-the-art method in many machine learning tasks ranging from speech recognition to image segmentation. The success of deep networks in other domains has led to a new wave of applications in neuroscience. In this article, we review deep learning approaches to neural decoding. Here, we describe the architectures used for extracting useful features from neural recording modalities ranging from spikes to functional magnetic resonance imaging. Furthermore, we explore how deep learning has been leveraged to predict common outputs including movement, speech and vision, with a focus on how pretrained deep networks can be incorporated as priors for complex decoding targets like acoustic speech or images. Deep learning has been shown to be a useful tool for improving the accuracy and flexibility of neural decoding across a wide range of tasks, and we point out areas for future scientific development.

59 BASIC BIOLOGICAL SCIENCES↗

Atoms for peace and the nonproliferation treaty: unintended consequences

In April 2009, President Obama revived nonproliferation and arms control efforts with a speech calling for the worldwide abolition of nuclear weapons. His speech correctly acknowledged the threat of nuclear terrorism and the vulnerabilities of the related unsecure nuclear materials. Unfortunately, the president did not mention and has not mentioned in any speech the threat posed by at-risk radiological materials. Nonproliferation efforts have a well documented history of focus on special nuclear materials (fissionable weapons usable materials or SNM), and other key materials (chemical and biological) and technologies for a Weapon of Mass Destruction (WMD). Such intense focus on WMD related materials/technologies is essential for international safety and security and merit continued attention and funding. However, the perception that radioactive sealed sources (sources) are of less concern than WMD is unfortunate. These perceptions are based solely on the potentially enormous and tragic consequences associated with their deliberate or accidental misuse and proliferation concerns. However, there is a documented history of overemphasis on the nuclear threat at the expense of ignoring the far more likely and also devastating chemical and biological threats. The radiological threat should not be minimized or excluded from policy discussions and decisions on these far ranging scopes of threat to the international community. Sources have a long history of use; and a wider distribution worldwide than fissile materials. Pair this with their broad ranges in isotopes/activities along with scant national and international attention and mechanisms for their safe and secure management and it is not difficult to envision a deadly threat. Arguments that minimize or divert attention away from sources may have the effect of distracting necessary policy attention on preventing/mitigating a radiological dispersal event. The terrorist attacks on 9/11 should be a clear reminder of the inherent danger of diminishing or dismissing lower-level threats in exchange for enhanced focus on high priority special nuclear materials with the basis for this emphasis being solely on the magnitude of the consequences of a single event. Mitigating all possible or likely terrorist attacks is impossible; however, weaponized sources, in the form of a radiological dispersal device, have been a declared target material of Al-Qaida. Eisenhower's Atoms for Peace initiative promoted the spread of the paradoxical beneficial yet destructive properties of the atom. Typically, the focus of nonproliferation efforts focuses on the fissile materials associated with Weapons of Mass Destruction, with less emphasis on radioactive materials that could be used for a Weapon of Mass Disruption. Most nonproliferation policy discussion involves securing or preventing the diversion of weapons grade fissile materials (uranium (U) with concentration of over 90% of the isotope {sup 235}U (HEU) and plutonium with more than 90% of the isotope {sup 239}Pu), with scant attention given to the threat posed by a prolific quantity of sources spread worldwide. Further acerbating the problem of inattention, it appears that the momentum of the continued evolution in the beneficial applications of sources will only increase in the near future. Several expert studies have demonstrated on the potentially devastating economic, psychological and public health impacts of terrorist use of a radiological dispersal or radiation emitting device (ROD/RED) in a metropolis. The development of such a weapon, from the acquisition of the radioactive material to the technical knowledge needed to fashion it into an ROD, is many orders of magnitude easier than diverting enough fissile material for and fabrication/acquisition of a nuclear weapon. Unlike nuclear weapons, worldwide, there are many well documented accounts of accidental and purposeful diversions of radioactive materials from regulatory control. As of the end of 2008, the International Atomic Energy Agency's (IAEA) Illicit Trafficking Database had logged 1562 incidents, of which only 18 include weapons grade nuclear materials. As much as 66% of the radioactive material involved in these incidents was not recovered. Since 2004, there has been a 75% increase in incidents of unrecoverable material, much of which is labeled dangerous with potential for deterministic health affects if misused. This makes clear that a black market of illicit trade in sources exists. The incidents reported to the IAEA's database rely only on voluntary state reporting; therefore, the number of lost or stolen sources is expected to be much higher.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

The effect of simultaneous exposure on the attention selection and integration of segments and lexical tones by Urdu-Cantonese bilingual speakers

In the perceptual learning of lexical tones, an automatic and robust attention-to-phonology system enables native tonal listeners to adapt to acoustically non-optimal speech, such as phonetic conflicts in daily communications. Previous tone research reveals that non-native listeners who do not linguistically employ lexical tones in their mother tongue may find it challenging to attend to the tonal dimension or integrate it with the segmental features. However, it is unknown whether the attentional interference initially caused by a maternal attentional system would continue influencing the non-optimal tone perception for simultaneous bilingual teenagers. From an endpoint in the age of language acquisition, we investigate whether the tone-specific attention mechanism developed by the Urdu-Cantonese simultaneous bilinguals is automatic enough to assist them in adapting to a phonetically-conflicting environment. Three groups of teenagers engaged in a four-condition ABX task: Urdu-Cantonese simultaneous bilinguals, Cantonese native listeners, and Urdu-speaking, late learners of Cantonese. The results showed that although the simultaneous bilinguals could phonologically process Cantonese tones in a Cantonese-like way under a conflict-free listening condition, they still failed in adapting to the phonetic conflicts, especially the segment-induced ones. It thus demonstrated that the simultaneous exposure and years of regular education in Hong Kong local schools still could not automatically guarantee simultaneous bilingual processing of Cantonese tones. In interpreting the findings, it hypothesized that, except for simultaneous exposure, the development of a tone-specific attention mechanism is also likely to be L1-inhibitory, tone experience-driven, and language-specific for simultaneous bilinguals.

Ning, Jinghong↗

Seventh Annual Workshop on Space Operations Applications and Research (SOAR 1993), volume 2

This document contains papers presented at the Space Operations, Applications and Research Symposium (SOAR) Symposium hosted by NASA/Johnson Space Center (JSC) on August 3-5, 1993, and held at JSC Gilruth Recreation Center. The symposium was cosponsored by NASA/JSC and U.S. Air Force Materiel Command. SOAR included NASA and USAF programmatic overviews, plenary session, panel discussions, panel sessions, and exhibits. It invited technical papers in support of U.S. Army, U.S. Navy, Department of Energy, NASA, and USAF programs in the following areas: robotics and telepresence, automation and intelligent systems, human factors, life support, and space maintenance and servicing. SOAR was concerned with Government-sponsored research and development relevant to aerospace operations. More than 100 technical papers, 17 exhibits, a plenary session, several panel discussions, and several keynote speeches were included in SOAR '93. These proceedings, along with comments and suggestions made by panelists and keynote speakers, will be used to assess progress made in joint USAF/NASA projects and activities to identify future collaborative/jolnt programs. SOAR '93 was the responsibility of the USAF NASA Space Technology Interdependency Group Operations Committee. Symposium proceedings include papers presented by experts from NASA, the USAF, USA, and USN, U.S. Department of Energy, universities, and industry.

Navigation↗