Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “interacting agent systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Controller Inhibition of Automated Conflict Resolutions in a Maximum NextGen Condition

With the continued projection of increases in air traffic density, operations in the National Airspace System are expected to exceed human capabilities in the near future. In order to address the bottleneck of human workload capacity, highly automated safety-critical systems are under development to support air traffic controllers. A human-in-the-loop experiment examined controllers transition through four NextGen automation stages: Current-Day, Minimum, Moderate, and Maximum. Maximum NextGen simulated a fully automated environment where the automation was responsible for detecting and resolving conflicts within simulation parameters in high-density airspace. By allocating these tasks to the automation, the controllers task changed. The human moved to primarily a supervisory position- typically only regaining control over separation assurance tasks during conflict situations deferred by the automation. While tasks were allocated a-priori between the controller and automated agent, controllers maintained authority to inhibit the automation from interacting with particular aircraft. Preliminary work is complete, where significant differences were found in inhibition frequency between simulation participants. However, the contexts in which the controllers inhibited the automation, and their reasons for doing so, remain unclear. This analysis attempts to identity factors contributing to human controllers inhibition of the automation in the Maximum NextGen condition.

adaptable automation↗

Evaluating disease surveillance strategies for early outbreak detection in contact networks with varying community structure

Disease surveillance systems allow public health agencies to respond to emerging diseases before they become widespread. Developing such systems requires identifying optimal ways to monitor in the context of an epidemic outbreak; this problem is known as sensor selection. Contact networks represent the dynamics of interaction in a population and are used to model how a disease spreads in a population and to explore strategies of sensor selection. We evaluated five sensor selection strategies on their ability to provide an early warning of a COVID-like outbreak in synthetic contact networks encapsulated in four network scenarios. Three of these scenarios assessed different aspects of community structure. The fourth scenario employed a contact network representing the population and interactions of 6.8 million people in New York City, constructed from an agent-based simulation using census and transportation data. This scenario exemplifies how sensor selection strategies may perform in a real-world, urban context. Our findings suggest that the choice of the optimal strategy depends heavily on the community structure of the network. Strategies that select highly connected nodes or maximize network coverage are the optimal surveillance strategy for outbreak detection in many network community structures. However, a naive implementation of these strategies may fail to provide an early warning at all—including in the New York City scenario. Moreover, these methods are impractical for real-world use as they require knowledge of the underlying contact network. Instead, a selection strategy that starts with a set of random nodes and then performs a random walk through a chain of neighbors reliably provides early warnings without requiring prior knowledge of the network. We find this method, called “random chain”, to be the most pragmatic for implementation in a real-world disease surveillance context.

60 APPLIED LIFE SCIENCES↗

Traveling Weather Disturbances in Mars Southern Extratropics: Sway of the Great Impact Basins

As on Earth, between late autumn and early spring on Mars middle and high latitudes within its atmosphere support strong mean thermal contrasts between the equator and poles (i.e. "baroclinicity"). Data collected during the Viking era and observations from both the Mars Global Surveyor (MGS) and Mars Reconnaissance Orbiter (MRO) indicate that this strong baroclinicity supports vigorous, large-scale eastward traveling weather systems (i.e. transient synoptic-period waves). Within a rapidly rotating, differentially heated, shallow atmosphere such as on Earth and Mars, such large-scale, extratropical weather disturbances are critical components of the global circulation. These wave-like disturbances act as agents in the transport of heat and momentum, and moreover generalized tracer quantities (e.g., atmospheric dust, water vapor and water-ice clouds) between low and high latitudes of the planet. The character of large-scale, traveling extratropical synoptic-period disturbances in Mars' southern hemisphere during late winter through early spring is investigated using a high-resolution Mars global climate model (Mars GCM). This global circulation model imposes interactively lifted (and radiatively active) dust based on a threshold value of the instantaneous surface stress. Compared to observations, the model exhibits a reasonable "dust cycle" (i.e. globally averaged, a more dusty atmosphere during southern spring and summer occurs). In contrast to their northern-hemisphere counterparts, southern synoptic-period weather disturbances and accompanying frontal waves have smaller meridional and zonal scales, and are far less intense synoptically. Influences of the zonally asymmetric (i.e. east-west varying) topography on southern large-scale weather disturbances are examined. Simulations that adapt Mars' full topography compared to simulations that utilize synthetic topographies emulating essential large-scale features of the southern middle latitudes indicate that Mars' transient barotropic/baroclinic eddies are significantly influenced by the great impact basins of this hemisphere (e.g., Argyre and Hellas). In addition, the occurrence of a southern storm zone in late winter and early spring is keyed particularly to the western hemisphere via orographic influences arising from the Tharsis highlands, and the Argyre and Hellas impact basins. Geographically localized transient-wave activity diagnostics are constructed that illuminate fundamental differences amongst such simulations and these are described.

Weather disturbances↗

Expedition Memory: Towards Agent-based Web Services for Creating and Using Mars Exploration Data.

Explorers ranging over kilometers of rugged, sometimes "feature-less" terrain for over a year could be overwhelmed by tracking and sharing what they have done and learned. An automated system based on the existing Mobile Agents design [ I ] and Mars Exploration Rover experience [2], could serve as an "expedition memory" that would be indexed by voice as wel1 as a web interface, linking people, places, activities, records (voice notes, photographs, samples). and a descriptive scientific ontology. This database would be accessible during EVAs by astronauts, annotated by the remote science team, linked to EVA plans, and allow cross indexing between sites and expeditions. We consider the basic problem, our philosophical approach, technical methods, and uses of the expedition memory for facilitating long-term collaboration between Mars crews and Earth support teams. We emphasize that a "memory" does not mean a database per se, but an interactive service that combines different resources, and ultimately could be like a helpful librarian.

Clancey, William J.↗

Apex Reference Manual 3.0 Beta

Apex is a toolkit for constructing software that behaves intelligently and responsively in demanding task environments. Reflecting its origin at NASA where Apex continues to be developed, current applications include: a) Providing autonomous mission management and tactical control capabilities for unmanned aerial vehicles including an autonomous surveillance helicopter and a simulation prototype of an unmanned fixed-wing aircraft to be used for wildfire mapping; b) Simulating human air traffic controllers, pilots and astronauts to help predict how people might respond to changes in equipment or procedures; and c) Predicting the precise duration and sequence of routine human behaviors based on a human-computer interaction engineering technique called CPM-GOMS. Among Apex s components are a set of implemented reasoning services, such as those for reactive planning and temporal pattern recognition; a software architecture that embeds and integrates these services and allows additional reasoning elements to be added as extensions; a formal language for specifying agent knowledge; a simulation environment to facilitate prototyping and analysis; and Sherpa, a set of tools for visualizing autonomy logic and runtime behavior. In combination, these are meant to provide a flexible and usable framework for creating, testing, and deploying intelligent agent software. Overall, our goal in developing Apex is to lower economic barriers to developing intelligent software agents. New ideas about how to extend or modify the system are evaluated in terms of their impact in reducing the time, expertise, and inventiveness required to build and maintain applications. For example, potential enhancements to the AI reasoning capabilities in the system are reviewed not only for usefulness and distinctiveness, but also for their impact on the readability and general usability of Apex s behavior representation language (PDL) and on the transparency of resulting behavior. A second central part of our approach is to iteratively refine Apex based on lessons learned from as diverse a set of applications as possible. Many applications have been developed by users outside the core development team including engineers, researchers, and students. Usability is thus a central concern for every aspect of Apex visible to a user, including PDL, Sherpa, the Apex installation process, APIs, and user documentation. Apex users vary in their areas of expertise and in their familiarity with autonomy technology. Focusing on usability, a development philosophy summarized by the project motto "Usable Autonomy," has been important part of enabling diverse users to employ Apex successfully and to provide feedback needed to guide iterative, user-centered refinement.

Freed, Michael A.↗

Application of the DNAS framework expansion to occupant population synthesis

Research in occupant behaviour is now using a more elaborate framework of building occupant interaction. Researchers often face challenges in collecting data, particularly for the data to meet the minimum number of required data points and the data interoperability requirements. Researchers address the first issue with the synthetic population and the latter with data ontologies. While synthetic population is commonly used to address the first issue, data ontology development is used to address the latter. The two solutions are complementary to each other. One of the known ontologies in building occupant behaviour research is the Drivers-Needs-Actions-Systems (DNAS) ontology, which has been used by building modelers to describe energy-related occupant behaviour. This paper describes the ontology-based synthetic population generation that can be used in the agent-based modeling (ABM) applications. This paper considers multiple data sources, including ASHRAE Thermal Comfort DB II and IEA Annex 66 data sets. A case study of an office building is used to present the workflow of DNAS framework expansion, synthetic population generation, and agent-based modeling.

Chandra Putra, Handi↗

Compliant Task Execution and Learning for Safe Mixed-Initiative Human-Robot Operations

We introduce a novel task execution capability that enhances the ability of in-situ crew members to function independently from Earth by enabling safe and efficient interaction with automated systems. This task execution capability provides the ability to (1) map goal-directed commands from humans into safe, compliant, automated actions, (2) quickly and safely respond to human commands and actions during task execution, and (3) specify complex motions through teaching by demonstration. Our results are applicable to future surface robotic systems, and we have demonstrated these capabilities on JPL's All-Terrain Hex-Limbed Extra-Terrestrial Explorer (ATHLETE) robot.

multi-agent collaboration↗

Synoptic Traveling Weather Systems on Mars: Effects of Radiatively-Active Water Ice Clouds

Atmospheric aerosols on Mars are critical in determining the nature of its thermal structure, its large-scale circulation, and hence the overall climate of the planet. We conduct multi-annual simulations with the latest version of the NASA Ames Mars global climate model (GCM), gcm2.3+, that includes a modernized radiative-transfer package and complex water-ice cloud microphysics package which permit radiative effects and interactions of suspended atmospheric aerosols (e.g., water ice clouds, water vapor, dust, and mutual interactions) to influence the net diabatic heating. Results indicate that radiatively active water ice clouds profoundly affect the seasonal and annual mean climate. The mean thermal structure and balanced circulation patterns are strongly modified near the surface and aloft. Warming of the subtropical atmosphere at altitude and cooling of the high latitude atmosphere at low levels takes place, which increases the mean pole-to-equator temperature contrast (i.e., "baroclinicity"). With radiatively active water ice clouds (RAC) compared to radiatively inert water ice clouds (nonRAC), significant changes in the intensity of the mean state and forced stationary Rossby modes occur, both of which affect the vigor and intensity of traveling, synoptic period weather systems. Such weather systems not only act as key agents in the transport of heat and momentum beyond the extent of the Hadley circulation, but also the transport of trace species such as water vapor, water ice-clouds, dust and others. The northern hemisphere (NH) forced Rossby waves and resultant wave train are augmented in the RAC case: the modes are more intense and the wave train is shifted equatorward. Significant changes also occur within the subtropics and tropics. The Rossby wave train sets up, combined with the traveling synoptic period weather systems (i.e., cyclones and anticyclones), the geographic extent of storm zones (or storm tracks) within the NH. A variety of circulation features will be presented which indicate contrasts between the RAC and nonRAC cases, and which highlight key effects radiatively-active clouds have on physical and dynamical processes active in the current climate of Mars.

Atmospheric aerosols↗

Synoptic Traveling Weather Systems on Mars: Effects of Radiatively-Active Water Ice Clouds

Atmospheric aerosols on Mars are critical in determining the nature of its thermal structure, its large-scale circulation, and hence the overall climate of the planet. We conduct multi-annual simulations with the latest version of the NASA Ames Mars global climate model (GCM), gcm2.3+, that includes a modernized radiative-transfer package and complex water-ice cloud microphysics package which permit radiative effects and interactions of suspended atmospheric aerosols (e.g., water ice clouds, water vapor, dust, and mutual interactions) to influence the net diabatic heating. Results indicate that radiatively active water ice clouds profoundly affect the seasonal and annual mean climate. The mean thermal structure and balanced circulation patterns are strongly modified near the surface and aloft. Warming of the subtropical atmosphere at altitude and cooling of the high latitude atmosphere at low levels takes place, which increases the mean pole-to-equator temperature contrast (i.e., "baroclinicity"). With radiatively active water ice clouds (RAC) compared to radiatively inert water ice clouds (nonRAC), significant changes in the intensity of the mean state and forced stationary Rossby modes occur, both of which affect the vigor and intensity of traveling, synoptic period weather systems.Such weather systems not only act as key agents in the transport of heat and momentum beyond the extent of the Hadley circulation, but also the transport of trace species such as water vapor, water ice-clouds, dust and others. The northern hemisphere (NH) forced Rossby waves and resultant wave train are augmented in the RAC case: the modes are more intense and the wave train is shifted equatorward. Significant changes also occur within the subtropics and tropics. The Rossby wave train sets up, combined with the traveling synoptic period weather systems (i.e., cyclones and anticyclones), the geographic extent of storm zones (or storm tracks) within the NH. A variety of circulation features will be presented which indicate contrasts between the RAC and nonRAC cases, and which highlight key effects radiatively-active clouds have on physical and dynamical processes active in the current climate of Mars.

GCM-global climate model↗

Synoptic Traveling Weather Systems on Mars: Effects of Radiatively-Active Water Ice Clouds

Atmospheric aerosols on Mars are critical in determining the nature of its thermal structure, its large-scale circulation, and hence the overall climate of the planet. We conduct multi-annual simulations with the latest version of the NASA Ames Mars global climate model (GCM), gcm2.3+, that includes a modernized radiative-transfer package and complex water-ice cloud microphysics package which permit radiative effects and interactions of suspended atmospheric aerosols (e.g., water ice clouds, water vapor, dust, and mutual interactions) to influence the net diabatic heating. Results indicate that radiatively active water ice clouds profoundly affect the seasonal and annual mean climate. The mean thermal structure and balanced circulation patterns are strongly modified near the surface and aloft. Warming of the subtropical atmosphere at altitude and cooling of the high latitude atmosphere at low levels takes place, which increases the mean pole-to-equator temperature contrast (i.e., "baroclinicity"). With radiatively active water ice clouds (RAC) compared to radiatively inert water ice clouds (nonRAC), significant changes in the intensity of the mean state and forced stationary Rossby modes occur, both of which affect the vigor and intensity of traveling, synoptic period weather systems. Such weather systems not only act as key agents in the transport of heat and momentum beyond the extent of the Hadley circulation, but also the transport of trace species such as water vapor, water ice-clouds, dust and others. The northern hemisphere (NH) forced Rossby waves and resultant wave train are augmented in the RAC case: the modes are more intense and the wave train is shifted equatorward. Significant changes also occur within the subtropics and tropics. The Rossby wave train sets up, combined with the traveling synoptic-period weather systems (i.e., cyclones and anticyclones), the geographic extent of storm zones (or storm tracks) within the NH. A variety of circulation features will be presented which indicate contrasts between the RAC and nonRAC cases, and which highlight key effects radiatively-active clouds have on physical and dynamical processes active in the current climate of Mars.

NASA Ames Mars global climate model (GCM)↗

Linking Individual Variation in Movement Behavior to Infection Dynamics in Highly Mobile Species

Animal movements are linked to infectious disease dynamics in wildlife through multiple mechanisms across various spatial and temporal scales. For example, infections can impede the movement of infected individuals, but infected hosts can also disperse infectious agents as they move. Individuals inevitably vary in their responses to infections and their roles in determining infection dynamics, which means that considering variation among individuals – whether across species, across time, or within populations – is important for understanding movement-disease relationships and their implications for epidemiology. Here, I draw on studies from multiple systems to examine how variation in movement behavior links to infectious disease epidemiology. For example, a comparative study of habitat selection across multiple waterfowl species highlights that diel behavioral patterns, rather than individual or seasonal variation, is the most important driver of the risk of overlap between waterfowl and poultry farms, and therefore for the risk of avian influenza spillover. Together, these studies show that individual traits interact with the environment to influence the roles of individuals for infectious disease ecology.

Claire Stewart Teitelbaum↗

National User Resource for Biological Accelerator Mass Spectrometry Annual Report

The National User Resource for Biological Accelerator Mass Spectrometry (User Resource) will provide isotopic analysis (primarily radiocarbon or 14C) by accelerator mass spectrometry (AMS) for NIH- funded researchers across the United States and will be the only User Resource of its type in the United States. The User Resource will provide measurement capability and expertise to a research community that requires highly sensitive, quantitative isotope analyses. Since commissioning a new accelerator mass spectrometer in June 2014, we have measured over 4000 samples a year for collaborators and service users. The User Resource will enable us to continue to meet these research needs, as well as provide for new users whose research programs would benefit from AMS as a measurement tool. The User Resource’s forte will be ultra-high sensitivity quantitation of radiocarbon and selected other radioisotopes for research studies where isotopes are required. Radioisotope labeling studies have been and will continue to be an important tool for addressing many complex biomedical science problems. AMS is a specialized and unique type of mass spectrometry that provides absolute quantitation of radiocarbon and other relevant radioisotopes with extreme sensitivity, having limits of detection in real samples on the order of a few attomol/mg of sample at measurement precisions of ~3%. It is the only instrumental method capable of quantifying radioisotope-labeled agents routinely in real-world samples with such precision and sensitivity. The sensitivity of AMS allows for the quantification of radiolabeled metabolites in extremely complex matrices of cells and organisms at very low concentrations and in small samples. AMS allows studies to be conducted without perturbing metabolism leading to more relevant quantification of metabolic rates and pathways. In addition, it enables quantification of pharmacokinetic and metabolic properties of toxicants at environmentally relevant concentrations in model systems as well as the ability to quantify pharmacokinetics and other molecular endpoints directly in humans. Such quantitative assessments can 1) improve risk assessment for toxicants, 2) address safety and efficacy considerations for therapeutic entities, 3) deepen understanding of xenobiotic and intermediary metabolism, 4) help understand the interactions between critical molecular pathways, and 5) improve efforts to model and predict various metabolic and biological states. These capabilities have been applied in a number of areas including research in carcinogenesis, toxicology, nutrition, pharmacology/drug development and basic biological science.

59 BASIC BIOLOGICAL SCIENCES↗

National User Resource for Biological Accelerator Mass Spectrometry

The National User Resource for Biological Accelerator Mass Spectrometry (User Resource) will provide isotopic analysis (primarily radiocarbon or 14C) by accelerator mass spectrometry (AMS) for NIH- funded researchers across the United States and will be the only User Resource of its type in the United States. The User Resource will provide measurement capability and expertise to a research community that requires highly sensitive, quantitative isotope analyses. Since commissioning a new accelerator mass spectrometer in June 2014, we have measured over 4000 samples a year for collaborators and service users. The User Resource will enable us to continue to meet these research needs, as well as provide for new users whose research programs would benefit from AMS as a measurement tool. The User Resource’s forte will be ultra-high sensitivity quantitation of radiocarbon and selected other radioisotopes for research studies where isotopes are required. Radioisotope labeling studies have been and will continue to be an important tool for addressing many complex biomedical science problems. AMS is a specialized and unique type of mass spectrometry that provides absolute quantitation of radiocarbon and other relevant radioisotopes with extreme sensitivity, having limits of detection in real samples on the order of a few attomol/mg of sample at measurement precisions of ~3%. It is the only instrumental method capable of quantifying radioisotope-labeled agents routinely in real-world samples with such precision and sensitivity. The sensitivity of AMS allows for the quantification of radiolabeled metabolites in extremely complex matrices of cells and organisms at very low concentrations and in small samples. AMS allows studies to be conducted without perturbing metabolism leading to more relevant quantification of metabolic rates and pathways. In addition, it enables quantification of pharmacokinetic and metabolic properties of toxicants at environmentally relevant concentrations in model systems as well as the ability to quantify pharmacokinetics and other molecular endpoints directly in humans. Such quantitative assessments can 1) improve risk assessment for toxicants, 2) address safety and efficacy considerations for therapeutic entities, 3) deepen understanding of xenobiotic and intermediary metabolism, 4) help understand the interactions between critical molecular pathways, and 5) improve efforts to model and predict various metabolic and biological states. These capabilities have been applied in a number of areas including research in carcinogenesis, toxicology, nutrition, pharmacology/drug development and basic biological science. As a NIGMS National Resource the National User Resource for Biological Accelerator Mass Spectrometry will help NIH funded scientists achieve a deeper understanding of the etiology of human health concerns by (1) enabling the quantification of pharmacokinetics and other molecular endpoints directly in humans; (2) offering the ability to conduct quantitative studies using biologics such as proteins or lipids, and thereby reducing the amount of radioisotope usage in biomedical labs; and (3) enabling more relevant studies of metabolic pathways in health and disease through the use of much lower, more biologically-relevant, concentrations of metabolic substrates in cells and intact organisms. Such studies support NIGMS’s basic biomedical research areas that contribute to the understanding of fundamental cellular and physiological principles and enable research supported by the Biophysics, Biomedical Technology, and Computational Biosciences (BBCB); Genetics and Molecular, Cellular, and Developmental Biology (GMCDB); Pharmacology, Physiology, Biological Chemistry (PPBC) and Training, Workforce Development, and Diversity (TWD) Divisions.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

National User Resource for Biological Accelerator Mass Spectrometry (Final Report)

The National User Resource for Biological Accelerator Mass Spectrometry (User Resource) will provide isotopic analysis (primarily radiocarbon or 14C) by accelerator mass spectrometry (AMS) for NIH- funded researchers across the United States and will be the only User Resource of its type in the United States. The User Resource will provide measurement capability and expertise to a research community that requires highly sensitive, quantitative isotope analyses. Since commissioning a new accelerator mass spectrometer in June 2014, we have measured over 4000 samples a year for collaborators and service users. The User Resource will enable us to continue to meet these research needs, as well as provide for new users whose research programs would benefit from AMS as a measurement tool. The User Resource’s forte will be ultra-high sensitivity quantitation of radiocarbon and selected other radioisotopes for research studies where isotopes are required. Radioisotope labeling studies have been and will continue to be an important tool for addressing many complex biomedical science problems. AMS is a specialized and unique type of mass spectrometry that provides absolute quantitation of radiocarbon and other relevant radioisotopes with extreme sensitivity, having limits of detection in real samples on the order of a few attomol/mg of sample at measurement precisions of ~3%. It is the only instrumental method capable of quantifying radioisotope-labeled agents routinely in real-world samples with such precision and sensitivity. The sensitivity of AMS allows for the quantification of radiolabeled metabolites in extremely complex matrices of cells and organisms at very low concentrations and in small samples. AMS allows studies to be conducted without perturbing metabolism leading to more relevant quantification of metabolic rates and pathways. In addition, it enables quantification of pharmacokinetic and metabolic properties of toxicants at environmentally relevant concentrations in model systems as well as the ability to quantify pharmacokinetics and other molecular endpoints directly in humans. Such quantitative assessments can 1) improve risk assessment for toxicants, 2) address safety and efficacy considerations for therapeutic entities, 3) deepen understanding of xenobiotic and intermediary metabolism, 4) help understand the interactions between critical molecular pathways, and 5) improve efforts to model and predict various metabolic and biological states. These capabilities have been applied in a number of areas including research in carcinogenesis, toxicology, nutrition, pharmacology/drug development and basic biological science. As a NIGMS National Resource the National User Resource for Biological Accelerator Mass Spectrometry will help NIH funded scientists achieve a deeper understanding of the etiology of human health concerns by (1) enabling the quantification of pharmacokinetics and other molecular endpoints directly in humans; (2) offering the ability to conduct quantitative studies using biologics such as proteins or lipids, and thereby reducing the amount of radioisotope usage in biomedical labs; and (3) enabling more relevant studies of metabolic pathways in health and disease through the use of much lower, more biologically-relevant, concentrations of metabolic substrates in cells and intact organisms. Such studies support NIGMS’s basic biomedical research areas that contribute to the understanding of fundamental cellular and physiological principles and enable research supported by the Biophysics, Biomedical Technology, and Computational Biosciences (BBCB); Genetics and Molecular, Cellular, and Developmental Biology (GMCDB); Pharmacology, Physiology, Biological Chemistry (PPBC) and Training, Workforce Development, and Diversity (TWD) Divisions. Over the next five years, our goals are to: 1. Improve the efficiency of operation for AMS measurements through installation of new interfaces to our AMS systems, technical modifications to improve gas accepting ion source efficiency and upgrading our data analysis software for improved ease of use and data reporting. 2. Increase the accessibility and visibility of ultra-sensitive 14C measurements for the biomedical research community by training of new investigators and expanding our national user base. 3. Provide high throughput, ultra-sensitive 14C analysis for the NIGMS and NIH user community.

47 OTHER INSTRUMENTATION↗

Reinforcement Learning in a Nonstationary Environment: The El Farol Problem

This paper examines the performance of simple learning rules in a complex adaptive system based on a coordination problem modeled on the El Farol problem. The key features of the El Farol problem are that it typically involves a medium number of agents and that agents' pay-off functions have a discontinuous response to increased congestion. First we consider a single adaptive agent facing a stationary environment. We demonstrate that the simple learning rules proposed by Roth and Er'ev can be extremely sensitive to small changes in the initial conditions and that events early in a simulation can affect the performance of the rule over a relatively long time horizon. In contrast, a reinforcement learning rule based on standard practice in the computer science literature converges rapidly and robustly. The situation is reversed when multiple adaptive agents interact: the RE algorithms often converge rapidly to a stable average aggregate attendance despite the slow and erratic behavior of individual learners, while the CS based learners frequently over-attend in the early and intermediate terms. The symmetric mixed strategy equilibria is unstable: all three learning rules ultimately tend towards pure strategies or stabilize in the medium term at non-equilibrium probabilities of attendance. The brittleness of the algorithms in different contexts emphasize the importance of thorough and thoughtful examination of simulation-based results.

Bell, Ann Maria↗

Application of Human-Autonomy Teaming to an Advanced Ground Station for Reduced Crew Operations

Within human factors there is burgeoning interest in the "human-autonomy teaming" (HAT) concept as a way to address the challenges of interacting with complex, increasingly autonomous systems. The HAT concept comes out of an aspiration to interact with increasingly autonomous systems as a team member, rather than simply use automation as a tool. The authors, and others, have proposed core tenets for HAT that include bi-directional communication, automation and system transparency, and advanced coordination between human and automated teammates via predefined, dynamic task sequences known as "plays." It is believed that, with proper implementation, HAT should foster appropriate teamwork, thus increasing trust and reliance on the system, which in turn will reduce workload, increase situation awareness, and improve performance. To this end, HAT has been demonstrated and/or studied in multiple applications including search and rescue operations, healthcare and medicine, autonomous vehicles, photography, and aviation. The current paper presents one such effort to apply HAT. It details the design of a HAT agent, developed by Human Automation Teaming Solutions, Inc., to facilitate teamwork between the automation and the human operator of an advanced ground dispatch station. This dispatch station was developed to support a NASA project investigating a concept called Reduced Crew Operations (RCO); consequently, we have named the agent R-HATS. Part of the RCO concept involves a ground operator providing enhanced support to a large number of aircraft with a single pilot on the flight deck. When assisted by R-HATS, operators can monitor and support or manage a large number of aircraft and use plays to respond in real-time to complicated, workload-intensive events (e.g., an airport closure). A play is a plan that encapsulates goals, tasks, and a task allocation strategy appropriate for a particular situation. In the current implementation, when a play is initiated by a user, R-HATS determines what tasks need to be completed and has the ability to autonomously execute them (e.g., determining diversion options and uplinking new routes to aircraft) when it is safe and appropriate. R-HATS has been designed to both support end users and researchers in RCO and HAT. Additionally, R-HATS and its underlying architecture were developed with generalizability in mind as a modular software applicable outside of RCO/aviation domains. This paper will also discuss future further development and testing of RHATS.

automation↗

SMART-COM – Scalable Multi-Agent Adaptive Resolution Tools for Collaborative Outage Management

The purpose of this grant was to conduct scientific research and prototype applications to support NPP outage staff in their adaptive decision-making in efficient scheduling and resource allocation while preventing violation of safety technical specifications. The project contributed to scientific knowledge and engineering methods in (1) user interface design, (2) scheduling optimization and risk estimation, and (2) natural language processing that would benefit the nuclear power plants in minimizing schedule overruns and even unexpected shutdowns. The research team conducted site visits at a test reactor facility and an operating nuclear power plant to gather necessary information and inputs for research and development of a software application to support NPP staff in executing their outages. The final software application consisted of three modules. First, the natural language processing module supports interactive processing of technical documentation to build a database for outage staff to query non-permissible actions on system components. This module can alleviate outage staff from reviewing extensive documentation and minimize violation of technical specifications, especially in time-sensitive situations. Second, the schedule optimization module schedules outage activities and compute risk indices that outperform existing software and current practice. This module can reduce completion time of an outage that typically have too many activities for human to optimize based on current practice that does not apply the latest operations research. Finally, the visualization module presents progress and risk information of the overall outage and individual activities, as well as enabling access to the natural language processing and schedule optimization modules. This module can provide outage staff with situation awareness that are necessary to make risk-informed decisions in response to unexpected events during the execution of an outage.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Neuroprotection trek--the next generation: neuromodulation II. Applications--epilepsy, nerve regeneration, neurotrophins

Three examples of neuroprotective applications of electrical stimulation-neuromodulation-are considered: (1) the diagnosis and treatment of epilepsy, (2) the augmentation of peripheral nerve regeneration after transection, and (3) the interaction between electrical stimulation and neurotrophins (notably brain derived neurotrophic factor [BDNF]) in various neuroprotective situations. The research cited demonstrates clear benefit from appropriate electrical stimulation in the treatment of (1) certain patients with medication-refractory epilepsy, and (2) the functional regeneration of peripheral nerves after transection and surgical repair. Furthermore, neuromodulation of peripheral nerve regeneration has been associated with an increase in the neurotrophin BDNF. The roles of BDNF and other neurotrophins in several disorders of the nervous system are discussed in the context of neuromodulation and its augmentation of neurotrophins. Neuromodulation-at least in part through its effect on BDNF and other neurotrophins-will likely play a major role in the treatment (and possibly prevention) of disorders of the nervous system for which neuroproteive pharmacologic agents have traditionally been sought.

Review↗