SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Appropriateness of stimulus-reinforcement contingency in instrumental differential conditioning of eyelid response to arithmetic concepts of right and wrong
Arithmetic correctness as discriminandum in classical and differential eyelid conditioning
Fixed-ratio punishment by timeout of concurrent variable-interval behavior in pigeons
Periodic shock in rats maintained on variable-interval schedule of reinforcement interspersed with sequence of three different stimulus conditions
On long-duration trips outside of the magnetosphere, astronauts will be exposed to protons and to heavy particles which can affect their performance of required tasks. It is essential to determine the range of behaviors that might be affected by exposure to these types of radiation in order to understand the nature of behavioral deficits and to develop effective countermeasures. The present experiment examined the ability of rats to make an operant response following exposure to protons (250 MeV, 4 Gy) or 56Fe particles (1 GeV/n, 1 or 2 Gy). Following irradiation, rats were trained to press a lever in order to obtain food reinforcement. They were then placed on an ascending fixed-ratio schedule from FR-1 (each lever press rewarded with a food pellet) through FR-35 (35 lever presses required for 1 food pellet). Rats exposed to 4 Gy of protons or 1 Gy of 56Fe particles responded similarly to controls, increasing their rate of responding as the ratio increased. However, rats exposed to 2 Gy of 56Fe particles failed to increase their rate of responding at ratios greater than FR-20, indicating that rats exposed to 2 Gy of 56Fe particles cannot respond appropriately to increasing work requirements.
Four rhesus monkeys (Macaca mulatta) were tested on joystick-based computer tasks in which they could choose to be reinforced either with pellets-only or with pellets + video. A variety of videotapes were used to reinforce task performance. The monkeys significantly preferred to be rewarded with a pellet and 10 s of a blank screen than a pellet plus 10 s of videotape. When they did choose to see videotaped images, however, they were significantly more likely to view video of themselves than video of their roommate or of unfamiliar conspecifics. These data support earlier findings of individual differences in preference for video reinforcement, and have clear implications for the study of face-recognition and self-recognition by nonhuman primates.
This study describes video-task acquisition in two nonhuman primate species. The subjects were seven rhesus monkeys (Macaca mulatta) and seven chimpanzees (Pan troglodytes). All subjects were trained to manipulate a joystick which controlled a cursor displayed on a computer monitor. Two criterion levels were used: one based on conceptual knowledge of the task and one based on motor performance. Chimpanzees and rhesus monkeys attained criterion in a comparable number of trials using a conceptually based criterion. However, using a criterion based on motor performance, chimpanzees reached criterion significantly faster than rhesus monkeys. Analysis of error patterns and latency indicated that the rhesus monkeys had a larger asymmetry in response bias and were significantly slower in responding than the chimpanzees. The results are discussed in terms of the relation between object manipulation skills and video-task acquisition.
This article deals with systems at multiple levels, at least from cell to organization. It also deals with learning, decision making, and other behavior at multiple levels. Technological development of a human behavioral ecosystem appropriate to space environments requires an analytic and synthetic orientation, explicitly experimental in nature, dictated by scientific and pragmatic considerations, and closely approximating procedures of established effectiveness in other areas of natural science. The conceptual basis of such an approach has its roots in environmentalism which has two main features: (1) knowledge comes from experience rather than from innate ideas, divine revelation, or other obscure sources; and (2) action is governed by consequences rather than by instinct, reason, will, beliefs, attitudes or even the currently fashionable cognitions. Without an experimentally derived data base founded upon such a functional analysis of human behavior, the overgenerality of "ecological systems" approaches render them incapable of ensuring the successful establishment of enduring space habitats. Without an experimentally derived function account of individual behavioral variability, a natural science of behavior cannot exist. And without a natural science of behavior, the social sciences will necessarily remain in their current status as disciplines of less than optimal precision or utility. Such a functional analysis of human performance should provide an operational account of behavior change in a manner similar to the way in which Darwin's approach to natural selection accounted for the evolution of phylogenetic lines (i.e., in descriptive, nonteleological terms). Similarly, as Darwin's account has subsequently been shown to be consonant with information obtained at the cellular level, so too should behavior principles ultimately prove to be in accord with an account of ontogenetic adaptation at a biochemical level. It would thus seem obvious that the most productive conceptual and methodological approaches to long-term research investments focused upon human behavior in space environments will require multidisciplinary inputs from such wide-ranging fields as molecular biology, environmental physiology, behavioral biology, architecture, sociology, and political science, among others.
Psychology experiment to show if information is reinforcing and if negative discriminative stimulus is both positively and negatively reinforcing
The author reviews and comments on the book Equivalence relations and behavior: a research story by Murray Sidman. Sidman's book reports his research about equivalence relations and competencies in children with mental retardation and how it relates to behavior. Sidman used the idea of stimulus-stimulus relations among features of the environment to develop his theories about equivalence relations. Experimental work with children and animals demonstrated their ability to use equivalence relations to learn new tasks. The subject received feedback and reinforcement for specific choices made during training, then was presented with new choices during testing. Results of the tests indicate that subjects were able to establish relations and retrieve them in different situations.
Physiological self-regulation training is a behavioral medicine intervention that has demonstrated capability to improve psychophysiological coping responses to stressful experiences and to foster optimal behavioral and cognitive performance. Once developed, these psychophysiological skills require regular practice for maintenance. A concomitant benefit of these physiologically monitored practice sessions is the opportunity to track crew psychophysiological responses to the challenges of the practice task in order to detect shifts in adaptability that may foretell performance degradation. Long-duration missions will include crew recreation periods that will afford physiological self-regulation training opportunities. However, to promote adherence to the regimen, the practice experience that occupies their recreation time must be perceived by the crew as engaging and entertaining throughout repeated reinforcement sessions on long-duration missions. NASA biocybernetic technologies and publications have developed a closed-loop concept that involves adjusting or modulating (cybernetic, for governing) a person's task environment based upon a comparison of that person's physiological responses (bio-) with a training or performance criterion. This approach affords the opportunity to deliver physiological self-regulation training in an entertaining and motivating fashion and can also be employed to create a conditioned association between effective performance state and task execution behaviors, while enabling tracking of individuals psychophysiological status over time in the context of an interactive task challenge. This paper describes the aerospace spin-off technologies in this training application area as well as the current spin-back application of the technologies to long-duration missions - the Recreation Embedded State Tuning for Optimal Readiness and Effectiveness (RESTORE) concept. The RESTORE technology is designed to provide a physiological self-regulation training countermeasure for maintaining and reinforcing cognitive readiness, resilience under psychological stress, and effective mood states in long-duration crews. The technology consists of a system for delivering physiological self-regulation training and for tracking crew central and autonomic nervous system function; the system interface is designed to be experienced as engaging and entertaining throughout repeated training sessions on long-duration missions. Consequently, this self-management technology has threefold capability for recreation, behavioral health problem prophylaxis and remediation, and psychophysiological assay. The RESTORE concept aims to reduce the risk of future manned exploration missions by enhancing the capability of individual crewmembers to self-regulate cognitive states through recreation-embedded training protocols to effectively deal with the psychological toll of long-duration space flight.
Primate research of the 20th century has established the validity of Darwin's postulation of psychological as well as biological continuity between humans and other primates, notably the great apes. Its data make clear that Descartes' view of animals as unfeeling 'beast-machines' is invalid and should be discarded. Traditional behavioristic frameworks, that emphasize the concepts of stimulus, response, and reinforcement and an 'empty-organism' psychology, are in need of major revisions. Revised frameworks should incorporate the fact that, in contrast to the lifeless databases of the 'hard' sciences, the database of psychology entails properties novel to life and its attendant phenomena. The contributions of research this century, achieved by field and laboratory researchers from around the world, have been substantial, indeed revolutionary. It is time to celebrate the progress of our field, to anticipate its significance, and to emphasize conservation of primates in their natural habitats.
Exposure to low doses of 56Fe particles produces changes in neural function and behavior. The present experiments were designed to examine the effects of irradiation on the acquisition of a dopamine-mediated conditioned place preference (CPP). In the CPP procedure, rats are given an injection of the dopamine agonist amphetamine in one distinctive compartment and a saline injection in a different compartment of a three-compartment apparatus. Control rats develop a preference for the amphetamine-paired compartment. In contrast, rats exposed to 1 Gy of 56Fe particles fail to develop a similar preference. The results of the experiment indicate that exposure to low doses of heavy particles can disrupt the neural mechanisms that mediate the reinforcement of behavior.
Cognitive behavioral-training (CBT) is an evidence-based practice commonly used to help treat insomnia, and is part of NASA's countermeasure regimen for Fatigue Management. CBT addresses the life style and habits of individuals that are maladaptive to managing stress and fatigue. This includes addressing learned behavioral responses that may cause stress and lead to an increased sense of fatigue. While the initial cause of onset of fatigue in the individual may be no longer present, the perception and engrained anticipation of fatigue persist and cause an exaggerated state of tension. CBT combined with relaxation training allows the individual to unlearn the maladaptive beliefs and behaviors and replace them with routines and techniques that allow cognitive restructuring and resultant relief from stress. CBT allows for elimination in individuals of unwanted ruminating thoughts and anticipatory anxiety by, for example, training the individuals to practice stressful situations in a relaxed state. As a result of CBT, relaxation can be accomplished in many ways, such as progressive muscle relaxation, meditation and guided imagery. CBT is not therapy, but rather the synthesis of behavioral countermeasures. CBT utilizes progressive relaxation as a means of reinforcing educational and cognitive countermeasures. These countermeasures include: masking, elimination of distracting thoughts, anxiety control, split attention, cognitive restructuring and other advanced psychological techniques.
Reinforcing effect of informative stimulus that is not positive discriminative stimulus
Agency beliefs influence how humans learn from different contexts and outcomes. Research demonstrates that stressors, such as exposure to early-life adversity (ELA), are associated with both agency beliefs and learning, but how these processes interact remains unclear. The current study investigated whether exposure to ELA influences agency and interacts with reinforcement learning in adults. Replicating prior behavioral and computational work, ELA resulted in decreased learning, while increased adversity severity was associated with decreased latent agency beliefs. These findings suggest that exposure to adversity in childhood has a nuanced impact on reinforcement learning and agency beliefs in adulthood.
Three adaptive single-neuron models based on neural analogies of behavior modification episodes are proposed, which attempt to bridge the gap between psychology and neurophysiology. The proposed models capture the predictive nature of Pavlovian conditioning, which is essential to the theory of adaptive/learning systems. The models learn to anticipate the occurrence of a conditioned response before the presence of a reinforcing stimulus when training is complete. Furthermore, each model can find the most nonredundant and earliest predictor of reinforcement. The behavior of the models accounts for several aspects of basic animal learning phenomena in Pavlovian conditioning beyond previous related models. Computer simulations show how well the models fit empirical data from various animal learning paradigms.