SEARCH · Engineering Papers

Results for “Agents”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,135 records · Page 63

All sources NASA NTRS DOE OSTI

NASA NTRS2000

Optimal Reward Functions in Distributed Reinforcement Learning

We consider the design of multi-agent systems so as to optimize an overall world utility function when (1) those systems lack centralized communication and control, and (2) each agents runs a distinct Reinforcement Learning (RL) algorithm. A crucial issue in such design problems is to initialize/update each agent's private utility function, so as to induce best possible world utility. Traditional 'team game' solutions to this problem sidestep this issue and simply assign to each agent the world utility as its private utility function. In previous work we used the 'Collective Intelligence' framework to derive a better choice of private utility functions, one that results in world utility performance up to orders of magnitude superior to that ensuing from use of the team game utility. In this paper we extend these results. We derive the general class of private utility functions that both are easy for the individual agents to learn and that, if learned well, result in high world utility. We demonstrate experimentally that using these new utility functions can result in significantly improved performance over that of our previously proposed utility, over and above that previous utility's superiority to the conventional team game utility.

Wolpert, David H.↗

NASA NTRS2001

Highly Effective, Low Toxicity, Low Environmental Impact Total Flooding Fire Suppressants

Halon 1301 (CF3Br) has been used for decades as the primary fire suppression agent for areas where powder agents cannot be used because of concerns for sensitive equipment. Halon 1301 is an excellent extinguishing agent, effective at about 3% in air and quite non-toxic. It has an effective exposure limit much greater than its extinguishing concentration, so it can be used in normally occupied areas. The ability of a chemical to destroy stratospheric ozone is its ozone-depletion potential (ODP). ODP is the amount of ozone destroyed per pound of a chemical, relative to the standard CFC-11 with an ODP = 1.0. Because halons have been implicated in stratospheric ozone depletion, their production was stopped at the end of 1995 under the provisions of the Montreal Protocol plus later amendments. In the US, the Clean Air Act Amendments of 1990, Presidential directives, and DoD Directive 6050.9 implemented this phaseout. These regulations and penalties have provided strong incentives for US businesses to decrease CFC use. The Omnibus Budget Reconciliation Act of 1989 mandates high Federal taxes on CFCs and halons, designed to price them out of the market. The taxes also capture for the government the windfall profits that would otherwise go to producers as scarcity drives up prices. Several replacements have been developed for Halon 1301. One is carbon dioxide, which has been used as a firefighting agent for many years. However, a high concentration of carbon dioxide is necessary to inert fuels. The effective concentration for inerting with carbon dioxide is approximately 29%, which is above the concentration lethal to humans. HFC-227ea is being used extensively to replace Halon 1301 systems in nominally occupied areas and some normally unoccupied areas. However, since the effective concentration of HFC-227ea is about three to four times that of Halon 1301 the extinguishing systems have to be larger and new extinguishing systems have to be installed. HFC-125 is also being sold as an extinguishing agent (Nimitz). It has problems similar to HFC-227ea, with a greater concentration needed for effectiveness and the need to use a larger system. This is a particularly onerous penalty in aircraft and spacecraft, where weight and space are extremely important, and substitution is often impossible in existing aircraft due to space limitations.

Glass, S. M.↗

NASA NTRS2002

Radiation Effect on Human Tissue

Predicting the occurrence of human cancer following exposure of an epidemiologic population to any agent causing genetic damage is a difficult task. To an approximation, this is because the uncertainty of uniform exposure to the damaging agent, and the uncertainty of uniform processing of that damage within a complex set of biological variables, degrade the confidence of predicting the delayed expression of cancer as a relatively rare event within clinically normal individuals. This situation begs the need for alternate controlled experimental models that are predictive for the development of human cancer following exposures to agents causing genetic damage. Such models historically have not been of substantial proven value. It is more recently encouraging, however, that developments in molecular and cell biology have led to an expanded knowledge of human carcinogenesis, and of molecular markers associated with that process. It is therefore appropriate to consider new laboratory models developed to accomodate that expanded knowledge in order to assess the cancer risks associated with exposures to genotoxic agents. When ionizing radiation of space is the genotoxic agent, then a series of additional considerations for human cancer risk assessment must also be applied. These include the dose of radiation absorbed by tissue at different locations in the body, the quality of the absorbed radiation, the rate at which absorbed dose accumulates in tissue, the way in which absorbed dose is measured and calculated, and the alterations in incident radiation caused by shielding materials. It is clear that human cancer risk assessment for damage caused by ionizing radiation is a multidisciplinary responsibility, and that within this responsibility no single discipline can hold disproportionate sway if a risk assessment model of radiation-induced human cancer is to be developed that has proven value. Biomolecular and cellular markers from the work reported here are considered for use in assessing human cancer risk related to exposure to space radiation. This potential use must be integrated within the specified multidisciplinary context in order to create a new tool of molecular epidemiology that can hopefully then realistically assess this cancer risk.

Richmond, Robert C.↗

NASA NTRS2002

A Biologically Inspired Cooperative Multi-Robot Control Architecture

A prototype cooperative multi-robot control architecture suitable for the eventual construction of large space structures has been developed. In nature, there are numerous examples of complex architectures constructed by relatively simple insects, such as termites and wasps, which cooperatively assemble their nests. The prototype control architecture emulates this biological model. Actions of each of the autonomous robotic construction agents are only indirectly coordinated, thus mimicking the distributed construction processes of various social insects. The robotic construction agents perform their primary duties stigmergically i.e., without direct inter-agent communication and without a preprogrammed global blueprint of the final design. Communication and coordination between individual agents occurs indirectly through the sensed modifications that each agent makes to the structure. The global stigmergic building algorithm prototyped during the initial research assumes that the robotic builders only perceive the current state of the structure under construction. Simulation studies have established that an idealized form of the proposed architecture was indeed capable of producing representative large space structures with autonomous robots. This paper will explore the construction simulations in order to illustrate the multi-robot control architecture.

Howsman, Tom↗

NASA NTRS2003

A Real-Time Rover Executive based On Model-Based Reactive Planning

This paper reports on the experimental verification of the ability of IDEA (Intelligent Distributed Execution Architecture) effectively operate at multiple levels of abstraction in an autonomous control system. The basic hypothesis of IDEA is that a large control system can be structured as a collection of interacting control agents, each organized around the same fundamental structure. Two IDEA agents, a system-level agent and a mission-level agent, are designed and implemented to autonomously control the K9 rover in real-time. The system is evaluated in the scenario where the rover must acquire images from a specified set of locations. The IDEA agents are responsible for enabling the rover to achieve its goals while monitoring the execution and safety of the rover and recovering from dangerous states when necessary. Experiments carried out both in simulation and on the physical rover, produced highly promising results.

Bias, M. Bernardine↗

NASA NTRS2003

Collectives for Multiple Resource Job Scheduling Across Heterogeneous Servers

Efficient management of large-scale, distributed data storage and processing systems is a major challenge for many computational applications. Many of these systems are characterized by multi-resource tasks processed across a heterogeneous network. Conventional approaches, such as load balancing, work well for centralized, single resource problems, but breakdown in the more general case. In addition, most approaches are often based on heuristics which do not directly attempt to optimize the world utility. In this paper, we propose an agent based control system using the theory of collectives. We configure the servers of our network with agents who make local job scheduling decisions. These decisions are based on local goals which are constructed to be aligned with the objective of optimizing the overall efficiency of the system. We demonstrate that multi-agent systems in which all the agents attempt to optimize the same global utility function (team game) only marginally outperform conventional load balancing. On the other hand, agents configured using collectives outperform both team games and load balancing (by up to four times for the latter), despite their distributed nature and their limited access to information.

Tumer, K.↗

NASA NTRS2003

Providing Effective Access to Shared Resources: A COIN Approach

Managers of systems of shared resources typically have many separate goals. Examples are efficient utilization of the resources among its users and ensuring no user's satisfaction in the system falls below a preset minimal level. Since such goals will usually conflict with one another, either implicitly or explicitly the manager must determine the relative importance of the goals, encapsulating that into an overall utility function rating the possible behaviors of the entire system. Here we demonstrate a distributed, robust, and adaptive way to optimize that overall function. Our approach is to interpose adaptive agents between each user and the system, where each such agent is working to maximize its own private utility function. In turn, each such agent's function should be both relatively easy for the agent to learn to optimize, and 'aligned' with the overall utility function of the system manager - an overall function that is based on but in general different from the satisfaction functions of the individual users. To ensure this we enhance the COllective INtelligence (COIN) framework to incorporate user satisfaction functions in the overall utility function of the system manager and accordingly in the associated private utility functions assigned to the users agents. We present experimental evaluations of different COIN-based private utility functions and demonstrate that those COIN-based functions outperform some natural alternatives.

Airiau, Stephane↗

NASA NTRS2004

Providing Effective Access to Shared Resources: A COIN Approach

Managers of systems of shared resources typically have many separate goals. Examples are efficient utilization of the resources among its users and ensuring no user s satisfaction in the system falls below a preset minimal level. Since such goals will usually conflict with one another, either implicitly or explicitly the manager must determine the relative importance of the goals, encapsulating that into an overall utility function rating the possible behaviors of the entire system. Here we demonstrate a distributed, robust, and adaptive way to optimize that overall function. Our approach is to interpose adaptive agents between each user and the system, where each such agent is working to maximize its own private utility function. In turn, each such agent's function should be both relatively easy for the agent to learn to optimize, and "aligned" with the overall utility function of the system manager - an overall function that is based on but in general different from the satisfaction functions of the individual users. To ensure this we enhance the Collective INtelligence (COIN) framework to incorporate user satisfaction functions in the overall utility function of the system manager and accordingly in the associated private utility functions assigned to the users agents. We present experimental evaluations of different COIN-based private utility functions and demonstrate that those COIN-based functions outperform some natural alternatives.

Airiau, Stephane↗

NASA NTRS2004

Fire Suppression in Low Gravity Using a Cup Burner

Longer duration missions to the moon, to Mars, and on the International Space Station increase the likelihood of accidental fires. The goal of the present investigation is to: (1) understand the physical and chemical processes of fire suppression in various gravity and O2 levels simulating spacecraft, Mars, and moon missions; (2) provide rigorous testing of numerical models, which include detailed combustion-suppression chemistry and radiation sub-models; and (3) provide basic research results useful for advances in space fire safety technology, including new fire-extinguishing agents and approaches.The structure and extinguishment of enclosed, laminar, methane-air co-flow diffusion flames formed on a cup burner have been studied experimentally and numerically using various fire-extinguishing agents (CO2, N2, He, Ar, CF3H, and Fe(CO)5). The experiments involve both 1g laboratory testing and low-g testing (in drop towers and the KC-135 aircraft). The computation uses a direct numerical simulation with detailed chemistry and radiative heat-loss models. An agent was introduced into a low-speed coflowing oxidizing stream until extinguishment occurred under a fixed minimal fuel velocity, and thus, the extinguishing agent concentrations were determined. The extinguishment of cup-burner flames, which resemble real fires, occurred via a blowoff process (in which the flame base drifted downstream) rather than the global extinction phenomenon typical of counterflow diffusion flames. The computation revealed that the peak reactivity spot (the reaction kernel) formed in the flame base was responsible for attachment and blowoff of the trailing diffusion flame. Furthermore, the buoyancy-induced flame flickering in 1g and thermal and transport properties of the agents affected the flame extinguishment limits.

Takahashi, Fumiaki↗

NASA NTRS2004

Fire Suppression in Low Gravity Using a Cup Burner

Longer duration missions to the moon, to Mars, and on the International Space Station increase the likelihood of accidental fires. The goal of the present investigation is to: (1) understand the physical and chemical processes of fire suppression in various gravity and O2 levels simulating spacecraft, Mars, and moon missions; (2) provide rigorous testing of numerical models, which include detailed combustion suppression chemistry and radiation sub-models; and (3) provide basic research results useful for advances in space fire safety technology, including new fire-extinguishing agents and approaches. The structure and extinguishment of enclosed, laminar, methane-air co-flow diffusion flames formed on a cup burner have been studied experimentally and numerically using various fire-extinguishing agents (CO2, N2, He, Ar, CF3H, and Fe(CO)5). The experiments involve both 1g laboratory testing and low-g testing (in drop towers and the KC-135 aircraft). The computation uses a direct numerical simulation with detailed chemistry and radiative heat-loss models. An agent was introduced into a low-speed coflowing oxidizing stream until extinguishment occurred under a fixed minimal fuel velocity, and thus, the extinguishing agent concentrations were determined. The extinguishment of cup-burner flames, which resemble real fires, occurred via a blowoff process (in which the flame base drifted downstream) rather than the global extinction phenomenon typical of counterflow diffusion flames. The computation revealed that the peak reactivity spot (the reaction kernel) formed in the flame base was responsible for attachment and blowoff of the trailing diffusion flame. Furthermore, the buoyancy-induced flame flickering in 1g and thermal and transport properties of the agents affected the flame extinguishment limits.

Takahashi, Fumiaki↗

NASA NTRS2004

A Stigmergic Cooperative Multi-Robot Control Architecture

In nature, there are numerous examples of complex architectures constructed by relatively simple insects, such as termites and wasps, which cooperatively assemble their nests. A prototype cooperative multi-robot control architecture which may be suitable for the eventual construction of large space structures has been developed which emulates this biological model. Actions of each of the autonomous robotic construction agents are only indirectly coordinated, thus mimicking the distributed construction processes of various social insects. The robotic construction agents perform their primary duties stigmergically, i.e., without direct inter-agent communication and without a preprogrammed global blueprint of the final design. Communication and coordination between individual agents occurs indirectly through the sensed modifications that each agent makes to the structure. The global stigmergic building algorithm prototyped during the initial research assumes that the robotic builders only perceive the current state of the structure under construction. Simulation studies have established that an idealized form of the proposed architecture was indeed capable of producing representative large space structures with autonomous robots. This paper will explore the construction simulations in order to illustrate the multi-robot control architecture.

Howsman, Thomas G.↗

NASA NTRS2005

Control Algorithms and Simulated Environment Developed and Tested for Multiagent Robotics for Autonomous Inspection of Propulsion Systems

The NASA Glenn Research Center and academic partners are developing advanced multiagent robotic control algorithms that will enable the autonomous inspection and repair of future propulsion systems. In this application, on-wing engine inspections will be performed autonomously by large groups of cooperative miniature robots that will traverse the surfaces of engine components to search for damage. The eventual goal is to replace manual engine inspections that require expensive and time-consuming full engine teardowns and allow the early detection of problems that would otherwise result in catastrophic component failures. As a preliminary step toward the long-term realization of a practical working system, researchers are developing the technology to implement a proof-of-concept testbed demonstration. In a multiagent system, the individual agents are generally programmed with relatively simple controllers that define a limited set of behaviors. However, these behaviors are designed in such a way that, through the localized interaction among individual agents and between the agents and the environment, they result in self-organized, emergent group behavior that can solve a given complex problem, such as cooperative inspection. One advantage to the multiagent approach is that it allows for robustness and fault tolerance through redundancy in task handling. In addition, the relatively simple agent controllers demand minimal computational capability, which in turn allows for greater miniaturization of the robotic agents.

Wong, Edmond↗

NASA NTRS2008

Assessment of Composite Delamination Self-Healing Via Micro-Encapsulation

Composite skin/stringer flange debond specimens manufactured from composite prepreg containing interleaf layers with a polymer based healing agent encapsulated in thin walled spheres were tested. As a crack develops and grows in the base polymer, the spheres fracture releasing the healing agent. The agent reacts with catalyst and polymerizes healing the crack. In addition, through-thickness reinforcement, in the form of pultruded carbon z-pins were included near the flange tips to improve the resistance to debonding. Specimens were manufactured with 14 plies in the skin and 10 plies in the stiffener flange. Three-point bend tests were performed to measure the skin/stiffener debonding strength and the recovered strength after healing. The first three tests performed indicated no healing following unloading and reloading. Micrographs showed that delaminations could migrate to the top of the interleaf layer due to the asymmetric loading, and hence, bypass most of the embedded capsules. For two subsequent tests, specimens were clamped in reverse bending before reloading. In one case, healing was observed as evidenced by healing agent that leaked to the specimen edge forming a visible "scar". The residual strength measured upon reloading was 96% of the original strength indicating healing had occurred. Hence, self-healing is possible in fiber reinforced composite material under controlled conditions, i.e., given enough time and contact with pressure on the crack surfaces. The micro-encapsulation technique may prove more robust when capsule sizes can be produced that are small enough to be embedded in the matrix resin without the need for using an interleaf layer. However, in either configuration, the amount of healing that can occur may be limited to the volume of healing agent available relative to the crack volume that must be filled.

O'Brien, T. Kevin↗

NASA NTRS2005

Towards the Verification of Human-Robot Teams

Human-Agent collaboration is increasingly important. Not only do high-profile activities such as NASA missions to Mars intend to employ such teams, but our everyday activities involving interaction with computational devices falls into this category. In many of these scenarios, we are expected to trust that the agents will do what we expect and that the agents and humans will work together as expected. But how can we be sure? In this paper, we bring together previous work on the verification of multi-agent systems with work on the modelling of human-agent teamwork. Specifically, we target human-robot teamwork. This paper provides an outline of the way we are using formal verification techniques in order to analyse such collaborative activities. A particular application is the analysis of human-robot teams intended for use in future space exploration.

Fisher, Michael↗

NASA NTRS2010

Bio-Contamination Control for Spacesuit Garments - A Preliminary Study

This paper outlines a preliminary study to review, test, and improve upon the current state of spacesuit bio-contamination control. The study includes an evaluation of current and advanced suit materials, ground and on-orbit cleaning methods, and microbial test and analysis methods. The first aspect of this study was to identify potential anti-microbial textiles and cleaning agents, and to review current microbial test methods. The anti-microbial cleaning agent and textile market survey included a review of current commercial-off-the-shelf (COTS) products that could potentially be used as future space flight hardware. This review included replacements for any of the softgood layers that may become contaminated during an extravehicular activity (EVA), including the pressure bladder, liquid cooling garment, and ancillary comfort undergarment. After a series of COTS anti-microbial textiles and clean ing agents were identified, a series of four tests were conducted: (1) a stacked configuration test that was conducted in order to review how bio-contamination would propagate through the various suit layers, (2) a individual materials test that evaluated how well each softgood layer either promoted or repressed growth, (3) a cleaning agent test that evaluated the efficacy on each of the baseline bladders, and (4) an evaluation of various COTS anti-microbial textiles. All antimicrobial COTS materials tested appeared to control bacteria colony forming unit (CFU) growth better than the Thermal Comfort Undergarment (TCU) and ACES Liquid Cooling Garment (LCG)/EMU Liquid Cooling Ventilation Garment (LCVG) materials currently in use. However, a comparison of fungi CFU growth in COTS to current suit materials appeared to vary per material. All cleaning agents tested in this study appeared to inhibit the level of bacteria and fungi growth to acceptable levels for short duration tests. While several trends can be obtained from the current analysis, a series of test improvements are described for future microbial testing.

Rhodes, Richard↗

NASA NTRS2011

Modeling Being "Lost": Imperfect Situation Awareness

Being "lost" is an exemplar of imperfect Situation Awareness/Situation Understanding (SA/SU) -- information/knowledge that is uncertain, incomplete, and/or just wrong. Being "lost" may be a geo-spatial condition - not knowing/being wrong about where to go or how to get there. More broadly, being "lost" can serve as a metaphor for uncertainty and/or inaccuracy - not knowing/being wrong about how one fits into a larger world view, what one wants to do, or how to do it. This paper discusses using agent based modeling (ABM) to explore imperfect SA/SU, simulating geo-spatially "lost" intelligent agents trying to navigate in a virtual world. Each agent has a unique "mental map" -- its idiosyncratic view of its geo-spatial environment. Its decisions are based on this idiosyncratic view, but behavior outcomes are based on ground truth. Consequently, the rate and degree to which an agent's expectations diverge from ground truth provide measures of that agent's SA/SU.

Middleton, Victor E.↗

NASA NTRS2012

Loading, Release, Biodegradation, and Biocompatibility of a Nanovector Delivery System

A nanovector multistage system has been created to overcome or bypass sequential barriers within the human body, in order to deliver a therapeutic or imaging agent to a specific location. This innovation consists of a composition that includes two or more stages of particles, such that smaller, later-stage particles are contained in the larger, early-stage particles. An active agent, such as a therapeutic agent or imaging agent, is preferentially delivered and/or localized to a particular target site in the body of a subject. The multistage composition overcomes multiple biological barriers in the body. The multistage composition also allows for simultaneous delivery and localization at the same or different target sites of multiple active agents.

Ferrai, Mauro↗

NASA NTRSDate not supplied

A Framework for Assessment of Autonomy Challenges in Air Traffic Management

Traditionally, air traffic management services have been provided by air traffic controllers and managers stationed in ground facilities, employed or contracted by the public sector, and supported by automation. These centralized, human-centric air traffic management services do not scale to accommodate increasing demands from conventional and new entrant operations for access to the national airspace system. One transformation that provides much needed scalability is increasing the level of autonomy of air traffic management by enabling edge agents of the system, including vehicles, operators, and third-party service suppliers, to collectively self-manage independently from the centralized service providers and enabling the automation to also take on more independent traffic management responsibility from the human agents. This paper identifies challenges to increasing the level of autonomy of air traffic management services. It describes a framework to enable a systematic identification of these challenges. The framework consists of a functional breakdown of air traffic management services and several dimensions characterizing different autonomy scales. The autonomy dimensions include the automation level between human and machine agents, the locus of control between centralized and distributed edge agents, cognitive activities for autonomous situation awareness and decision making, intelligence levels ranging from skill-based to expertise-based autonomous behavior, and uncertainty levels of the dynamics and environment in which autonomous agents operate. Several challenges are identified and categorized using the different dimensions of the autonomy framework.

automation, autonomy framework, collective autonom↗