Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “agents”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2019

Can magnetic resonance imaging differentiate among transurethral bulking agent, urethral diverticulum, and periurethral cyst?

Purpose: To evaluate magnetic resonance imaging findings that differentiate among periurethral bulking agents (primarily collagen), urethral diverticulum, and periurethral cyst. Methods: We searched our radiologic database retrospectively from 2001 to 2017 for periurethral cystic lesions, identifying a total of 50 patients with 68 lesions. Final diagnoses in 68 lesions were bulking agents (27), urethral diverticula (29), and periurethral cysts (12). Two abdominal radiologists, blinded to clinical history, independently evaluated T1, T2, and post-contrast images. The readers assessed number, morphological features, location, connection to urethra and mass effect, signal intensity, and enhancement for each lesion. Fisher exact test and logistic regression analysis were performed for each univariate significant feature. The operative and pathologic reports were the reference standard. Results: Magnetic resonance imaging features found more often in bulking agents versus urethral diverticulum were multiple lesions (P = 0.011), upper or upper-mid-urethral location (P ≤ 0.0001), lack of internal fluid/fluid level (P = 0.002), no urethral connection (P = 0.005), T1 isointensity, and T2 mild hyperintensity compared to muscles but lower T2 signal than urine (P < 0.0001). Most cases of urethral diverticula and periurethral cysts were detected at mid- and lower urethra. Urethral diverticula were larger than bulking agents and periurethral cysts (P = 0.005 and P = 0.023) (mean diameter = 24, 16, 15 mm, respectively). Most bulking agents (93%) and urethral diverticula (90%) showed mass effect on urethra, while periurethral cysts (75%) did not (P < 0.0001). Conclusion: Signal intensity and lesion characterization on magnetic resonance imaging can significantly differentiate bulking agent from urethral diverticulum and periurethral cyst. Radiologists should consider differential diagnosis of a bulking agent, especially when distinguishing characteristics described here are present to prevent incorrect diagnosis and ultimately unnecessary surgical intervention.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2016

Characterization of geopolymer fly-ash based foams obtained with the addition of Al powder or H{sub 2}O{sub 2} as foaming agents

Recent innovations in geopolymer technology have led to the development of various different types of geopolymeric products, including highly porous geopolymer-based foams, which are formed by the addition of foaming agents to a geopolymer fly-ash based matrix. These agents decompose, or react with the liquid matrix or oxygen in the matrix, resulting in the release of gases which form pores prior to the hardening of the gel. The hardened structure has good mechanical and thermal properties, and can therefore be used for applications in acoustic panels and in lightweight pre-fabricated components for thermal insulation purposes. This study presents the results of the pore-forming process in the case when two different foaming agents, i.e. aluminium powder amounting to 0.07, 0.13 and 0.20 mass. % and H{sub 2}O{sub 2} amounting to 0.5, 1.0, 1.5 and 2.0 mass. %, were added to a fly-ash geopolymer matrix. The physical, mechanical, and microstructural properties of the thus obtained foams, and the effects of the type and amount of the added foaming agent, are presented and discussed. Highly porous structures were obtained in the case of both of the investigated foaming agents, with overall porosities up to 59% when aluminium powder was added, and of up 48% when H{sub 2}O{sub 2} was added. In the latter case, when 2% of the H{sub 2}O{sub 2} foaming agent was added, finer pores (with diameters up to 500 μm) occurred in the structure, whereas somewhat larger pores (some had diameters greater than 1 mm) occurred when the same amount of aluminium powder was added. The mechanical properties of the investigated foams depended on their porosity. In the case of highly porous structures a compressive strength of 3.3 MPa was nevertheless achieved for the samples containing 0.2% of aluminium powder, and 3.7 MPa for those containing 2.0% of H{sub 2}O{sub 2}. - Highlights: • Preparation of geopolymer foams based on fly ash with the addition of Al powder or H{sub 2}O{sub 2} as foaming agents • Determination of density, porosity and mechanical properties of such foams • Characterization of foaming process by means of X-ray micro-tomography (μcT)

36 MATERIALS SCIENCE↗
DOE OSTI2025

Developing aqueous solubilizing agents as an alternative to solvent extraction

Here, advancing separations science is important for the entire field of chemistry. One partitioning technique that would benefit from improvement is solvent extraction. Despite its effective and widespread use, the method suffers from some problems: generation of flammable organic waste, lengthy process times, and safety concerns associated with contacting organic solvents with acidic aqueous solutions. We developed an alternative separation method inspired by solvent extraction that side-steps those issues. Toward this end, we identified that the functionality of an extractant (an agent used in solvent extraction to pull analytes from the aqueous phase into the organic phase) would change if it was modified for water solubility. In this alternative scenario, the extractant transforms into an “aqueous solubilizing agent.” We discovered that adding this aqueous solubilizing agent alongside a precipitating agent caused the contaminants to precipitate, but not the analyte. This separation concept was demonstrated within the bounds of one of the most difficult partitioning problems, separating minor actinides (Am 3+ ) from lanthanides (Ln 3+ ). We discovered that the (HSO 3 Ph) 4 BTP (aq) aqueous solubilizing agent prevented Am 3+ (aq) from precipitating with Ln 3+ (aq) when f-element precipitating agents (NaF (aq) or HF (aq) ) were added. This separation boasts impressive Am 3+ (aq) recovery yield (90 ± 2 %), near quantitative Ln 3+ (aq) removal, and high separation factors [>3000, Am 3+ (aq) vs. Nd 3+ (aq) ]. It seems likely – given the large number of candidate extractants that could be modified for aqueous solubility and the numerous combinations of existing solubilizing and precipitating agents – that this alternative approach could be used broadly in place of solvent extraction and solve other important separation problems.

(HSO3Ph)4BTP(aq)↗
DOE OSTI2023

Protection against Chemical Warfare Agents and Biological Threats Using Metal–Organic Frameworks as Active Layers

The SARS-CoV-2 pandemic outbreak and the unfortunate misuse of toxic chemical warfare agents (CWAs) highlight the importance of developing functional materials to protect against these chemical and pathogen threats. Metal–organic frameworks (MOFs), which comprise a tunable class of crystalline porous materials built from inorganic nodes and organic linkers, have emerged as a class of heterogeneous catalysts capable of rapid detoxification of multiple classes of these harmful chemical or biological hazards. In particular, zirconium-based MOFs (Zr-MOFs) feature Lewis acidic nodes that serve as active sites for a wide range of catalytic reactions, including the hydrolysis of organophosphorus nerve agents within seconds in basic aqueous solutions. In addition, postsynthetic modification of Zr-MOFs enables the release of active species capable of reacting with and deactivating harmful pathogens. Despite this impressive performance, utilizing Zr- MOFs in powder form is not practical for application in masks or protective uniforms. To address this challenge, our team sought to develop MOF/fiber composite systems that could be adapted for use under realistic operating conditions to protect civilians, military personnel, and first responders from harmful pathogens and chemical warfare agents. Over the last several years, our group has designed and fabricated reactive and biocidal MOF/fiber composites that effectively capture and deactivate these toxic species. In this Account, we describe the evolution of these porous and reactive MOF/fiber composites and focus on key design challenges and considerations. First, we devised a scalable method for the integration of Zr-MOFs onto textile substrates using aqueous precursor solutions and without using pretreated textiles, highlighting the potential scalability of this method. Moving beyond standard textiles, we also developed a microbial synthesis strategy to prepare hierarchically porous MOF/bacterial cellulose nanofiber composite sponges that can both capture and detoxify nerve agents when exposed to contaminated gas flows. The mass loading of the MOF in the nanofibrous composite sponge is up to 90%, affording higher work capacities compared to those of textile-fiber-based composites with relatively lower MOF loadings. Next, we demonstrated that heterogeneous polymeric bases are suitable replacements for volatile liquid bases typically used in solution-phase reactions, and we showed that these composite systems are capable of effectively hydrolyzing nerve agents in the solid state by using only water that is present as humidity. Moreover, incorporating a reactive dye precursor into the composite affords a dual function sensing and detoxifying material that changes color from white to orange upon reaction with the byproduct following nerve agent hydrolysis, demonstrating the versatility of this platform for use in decontamination applications. We then created chlorine-loaded MOF/fiber composites that act as biocidal and reactive textiles that are capable of not only detoxifying sulfur-mustard-based chemical warfare agents and simulants but also deactivating both bacteria and the SARS-CoV-2 virus within minutes of exposure. Lastly, we synthesized a mixed-metal Ti/Zr-MOF coating on cotton fibers to afford a photoactive biocidal cloth that shows fast and broad-spectrum biocidal performance against viruses and Gram-positive and Gram-negative bacteria under visible light irradiation. Given the tunable, multifunctional nature of these MOF/fiber composites, we believe that this Account will offer new insights for the rational design and preparation of functional MOF/fiber composites and pave the way toward the development of next-generation reactive and protective textiles.

36 MATERIALS SCIENCE↗
DOE OSTI2015

Oxidative phosphorylation-dependent regulation of cancer cell apoptosis in response to anticancer agents

Cancer cells tend to develop resistance to various types of anticancer agents, whether they adopt similar or distinct mechanisms to evade cell death in response to a broad spectrum of cancer therapeutics is not fully defined. Current study concludes that DNA-damaging agents (etoposide and doxorubicin), ER stressor (thapsigargin), and histone deacetylase inhibitor (apicidin) target oxidative phosphorylation (OXPHOS) for apoptosis induction, whereas other anticancer agents including staurosporine, taxol, and sorafenib induce apoptosis in an OXPHOS-independent manner. DNA-damaging agents promoted mitochondrial biogenesis accompanied by increased accumulation of cellular and mitochondrial ROS, mitochondrial protein-folding machinery, and mitochondrial unfolded protein response. Induction of mitochondrial biogenesis occurred in a caspase activation-independent mechanism but was reduced by autophagy inhibition and p53-deficiency. Abrogation of complex-I blocked DNA-damage-induced caspase activation and apoptosis, whereas inhibition of complex-II or a combined deficiency of OXPHOS complexes I, III, IV, and V due to impaired mitochondrial protein synthesis did not modulate caspase activity. Mechanistic analysis revealed that inhibition of caspase activation in response to anticancer agents associates with decreased release of mitochondrial cytochrome c in complex-I-deficient cells compared with wild type (WT) cells. Gross OXPHOS deficiencies promoted increased release of apoptosis-inducing factor from mitochondria compared with WT or complex-I-deficient cells, suggesting that cells harboring defective OXPHOS trigger caspase-dependent as well as caspase-independent apoptosis in response to anticancer agents. Interestingly, DNA-damaging agent doxorubicin showed strong binding to mitochondria, which was disrupted by complex-I-deficiency but not by complex-II-deficiency. Thapsigargin-induced caspase activation was reduced upon abrogation of complex-I or gross OXPHOS deficiency whereas a reverse trend was observed with apicidin. Together, these finding provide a new strategy for differential mitochondrial targeting in cancer therapy.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

The onset of rare earth metallosis begins with renal gadolinium-rich nanoparticles from magnetic resonance imaging contrast agent exposure

The leitmotifs of magnetic resonance imaging (MRI) contrast agent-induced complications range from acute kidney injury, symptoms associated with gadolinium exposure (SAGE)/gadolinium deposition disease, potentially fatal gadolinium encephalopathy, and irreversible systemic fibrosis. Gadolinium is the active ingredient of these contrast agents, a non-physiologic lanthanide metal. The mechanisms of MRI contrast agent-induced diseases are unknown. Mice were treated with a MRI contrast agent. Human kidney tissues from contrast-naïve and MRI contrast agent-treated patients were obtained and analyzed. Kidneys (human and mouse) were assessed with transmission electron microscopy and scanning transmission electron microscopy with X-ray energy-dispersive spectroscopy. MRI contrast agent treatment resulted in unilamellar vesicles and mitochondriopathy in renal epithelium. Electron-dense intracellular precipitates and the outer rim of lipid droplets were rich in gadolinium and phosphorus. We conclude that MRI contrast agents are not physiologically inert. The long-term safety of these synthetic metal–ligand complexes, especially with repeated use, should be studied further.

36 MATERIALS SCIENCE↗
DOE OSTI2026

AutoLabs: cognitive multi-agent systems with self-correction for autonomous chemical experimentation

The automation of chemical research through self-driving laboratories (SDLs) promises to accelerate scientific discovery, yet the reliability and granular performance of the underlying AI agents remain critical, under-examined challenges. In this work, we introduce AutoLabs, a self-correcting, multi-agent architecture designed to autonomously translate natural-language instructions into executable protocols for a high-throughput liquid handler. The system engages users in dialogue, decomposes experimental goals into discrete tasks for specialized agents, performs tool-assisted stoichiometric calculations, and iteratively self-corrects its output before generating a hardware-ready file. We present a comprehensive evaluation framework featuring five benchmark experiments of increasing complexity, from simple sample preparation to multi-plate timed syntheses. Through a systematic ablation study of 20 agent configurations, we assess the impact of reasoning capacity, architectural design (single- vs. multi-agent), tool use, and self-correction mechanisms. Our results demonstrate that agent reasoning capacity is the most critical factor for success, reducing quantitative errors in chemical amounts (nRMSE) by over 85% in complex tasks. When combined with a multi-agent architecture and iterative self-correction, AutoLabs approaches expert-authored reference procedures on the benchmark (F1-score > 0.89) on challenging multi-plate syntheses. These findings establish a clear blueprint for developing robust and trustworthy AI partners for autonomous laboratories, highlighting the synergistic effects of modular design, advanced reasoning, and self-correction to ensure both performance and reliability in high-stakes scientific applications. Code: https://github.com/pnnl/autolabs

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

ToPolyAgent: AI agents for coarse-grained bead-spring topological polymer simulations

We introduce ToPolyAgent, a multi-agent AI framework for performing coarse-grained molecular dynamics (MD) simulations of topological polymers through natural language instructions. By integrating large language models (LLMs) with domain-specific computational tools, ToPolyAgent supports both interactive and autonomous simulation workflows across diverse polymer architectures, including linear, ring, brush, and star polymers, as well as dendrimers. The system consists of four LLM-powered agents: a Config Agent for generating initial polymer–solvent configurations, a Simulation Agent for executing LAMMPS-based MD simulations and conformational analyses, a Report Agent for compiling markdown reports, and a Workflow Agent for streamlined autonomous operations. Interactive mode incorporates user feedback loops for iterative refinements, while autonomous mode enables end-to-end task execution from detailed prompts. We demonstrate ToPolyAgent's versatility through case studies involving diverse polymer architectures under varying solvent conditions, thermostats, and simulation lengths. Furthermore, we highlight its potential as a research assistant by directing it to investigate the effect of interaction parameters on the linear polymer conformation, and the influence of grafting density on the persistence length of the brush polymer. By coupling natural language interfaces with rigorous simulation tools, ToPolyAgent lowers barriers to complex computational workflows and advances AI-driven materials discovery in polymer science. It lays the foundation for autonomous and extensible multi-agent scientific research ecosystems.

Ding, Lijie [Oak Ridge National Laboratory (ORNL),↗
DOE OSTI2016

SU-F-T-379: Dosimetric Impacts of Topical Agents and Dressings On Skin in Radiotherapy

Purpose: This study investigated the superficial dose enhancement in the application of topical agents, clinical materials (thermal mask and bolus) and dressings in megavoltage photon beam radiotherapy. Different topical skin agents, clinical materials and dressings were evaluated and compared for their skin dosimetric impacts on the patients during radiation treatment. Methods: Superficial dose enhancements, or percentage doses with and without the studying materials, were measured using the 6 MV (Field size = 10×10 cm{sup 2}) photon beams produced by a Varian TrueBeam linear accelerator. Twelve topical agents, five dressings (dry and wet conditions) and three clinical materials were studied. A solid water phantom was used with a MOSFET dose detector (TN-1002RD, Thomson and Nielsen Electronic, Ottawa, Ontario, Canada) located under a 1-mm PMMA slab to measure the skin dose. The distance between the radiation source and phantom surface was set to 100 cm in all measurements. The topical agents were distributed evenly with 1.5 mm thickness using our specific sample holder on the phantom surface. Extrapolations were made of 0.5 mm thickness for the agents to provide meaningful clinical value. Results: By comparing surface doses without studying materials, it is found that no topical agents had superficial dose enhancement higher than the clinical materials namely, thermoplastic mask (128%), 5-mm Superflab™ bolus (158%) and 10-mm Superflab™ bolus (171%) regarding the same thickness. Superficial dose enhancement of dry dressing did not exceed 110.5%, while wet dressings produced higher dose enhancements (133% for wet Mepilex lite and 141% for wet Mepilex Ag transfer). Conclusion: It is concluded that the evaluated topical agents and dry dressings did not increase the superficial dose to a concerning level, even using excessive thickness in every fraction of radiation treatment. Wet dressings were found producing the bolus effect, but was still substantially less than applying a thin 5-mm bolus.

43 PARTICLE ACCELERATORS↗
DOE OSTI2024

Towards a High Fidelity Training Environment for Autonomous Cyber Defense Agents

Cyber defenders are overwhelmed by the frequency and scale of attacks against their networks. This problem will only be exacerbated as attackers leverage AI to automate their workflows. Autonomous cyber defense capabilities could aid defenders by automating operations and adapting dynamically to novel threats. However, existing training environments fall short in areas such as generalization, explainability, scalability, and transferability, making it intractable to train agents that will be effective in real networks. In this paper we take an important step towards creating autonomous cyber defense agents — we present a high fidelity training environment called Cyberwheel that includes both simulation and emulation capabilities. Cyberwheel simplifies customization of the training network and easily allows redefining the agent’s reward function, observation space, and action space to support rapid experimentation of novel approaches to agent design. It also provides visibility into agent behaviors necessary for agent evaluation and sufficient documentation / examples to lower the barrier to entry. As an example use case of Cyberwheel, we present initial results training an autonomous agent to deploy cyber deception strategies in simulation.

Oesch, T↗
DOE OSTI2025

Agentic AI vs ML-Based Autotuning: A Comparative Study for Loop Reordering Optimization

High Performance Computing (HPC) applications rely heavily on code optimizations to achieve good performance on modern CPU and GPU architectures. Traditional Machine Learning auto-tuning approaches have demonstrated success in exploring high-dimensional spaces, but they often require expensive compile-run evaluations and lack adaptability for large HPC applications. The recent advances in Large Language Models (LLMs) and Agentic AI systems raise intriguing questions about the potential of these approaches to address specific optimization methodologies. This work aims to answer an essential question for the HPC community: “How Agentic AI Systems Compare to Traditional ML Autotuning Techniques?” To address this question, we present a comparative analysis between a traditional ML-based optimization approach and an Agentic AI system, evaluating their respective capabilities and limitations for loop-level optimization. In addition, we introduced a new Agentic AI system named LoopGen-AI using three different Large Language Models: GPT-4.1, Claude 4.0, and Gemini 2.5. A key finding is that LoopGen-AI achieves competitive per-formance with only a few program runs, the reasoning logs from the agents revealed that their decisions rely heavily on the combination of semantic understanding of the target kernel with dynamic feedback from the environment, highlighting a promising new dimension in performance tuning. In contrast, ML-based autotuners focus on statistical exploration, and require orders of magnitude more runs to reach peak performance. Additionally, our analysis shows that prompt engineering, particularly using Persona + Context Manager patterns, significantly impacts the effectiveness of Agentic AI. Our results indicate that while Agentic AI systems are not yet a complete replacement for ML-based autotuners, it can effectively complement traditional methods.

Rosas, Miguel Romero↗
DOE OSTI2024

The safety of magnetic resonance imaging contrast agents

Gadolinium-based contrast agents are increasingly used in clinical practice. While these pharmaceuticals are verified causal agents in nephrogenic systemic fibrosis, there is a growing body of literature supporting their role as causal agents in symptoms associated with gadolinium exposure after intravenous use and encephalopathy following intrathecal administration. Gadolinium-based contrast agents are multidentate organic ligands that strongly bind the metal ion to reduce the toxicity of the metal. The notion that cationic gadolinium dissociates from these chelates and causes the disease is prevalent among patients and providers. We hypothesize that non-ligand-bound (soluble) gadolinium will be exceedingly low in patients. Soluble, ionic gadolinium is not likely to be the initial step in mediating any disease. The Kidney Institute of New Mexico was the first to identify gadolinium-rich nanoparticles in skin and kidney tissues from magnetic resonance imaging contrast agents in rodents. In 2023, they found similar nanoparticles in the kidney cells of humans with normal renal function, likely from contrast agents. We suspect these nanoparticles are the mediators of chronic toxicity from magnetic resonance imaging contrast agents. This article explores associations between gadolinium contrast and adverse health outcomes supported by clinical reports and rodent models.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1993

Agent oriented programming: An overview of the framework and summary of recent research

This is a short overview of the agent-oriented programming (AOP) framework. AOP can be viewed as an specialization of object-oriented programming. The state of an agent consists of components called beliefs, choices, capabilities, commitments, and possibly others; for this reason the state of an agent is called its mental state. The mental state of agents is captured formally in an extension of standard epistemic logics: beside temporalizing the knowledge and belief operators, AOP introduces operators for commitment, choice and capability. Agents are controlled by agent programs, which include primitives for communicating with other agents. In the spirit of speech-act theory, each communication primitive is of a certain type: informing, requesting, offering, etc. This document describes these features in more detail and summarizes recent results and ongoing AOP-related work.

Shoham, Yoav↗
NASA NTRS1994

Instructable autonomous agents

In contrast to current intelligent systems, which must be laboriously programmed for each task they are meant to perform, instructable agents can be taught new tasks and associated knowledge. This thesis presents a general theory of learning from tutorial instruction and its use to produce an instructable agent. Tutorial instruction is a particularly powerful form of instruction, because it allows the instructor to communicate whatever kind of knowledge a student needs at whatever point it is needed. To exploit this broad flexibility, however, a tutorable agent must support a full range of interaction with its instructor to learn a full range of knowledge. Thus, unlike most machine learning tasks, which target deep learning of a single kind of knowledge from a single kind of input, tutorability requires a breadth of learning from a broad range of instructional interactions. The theory of learning from tutorial instruction presented here has two parts. First, a computational model of an intelligent agent, the problem space computational model, indicates the types of knowledge that determine an agent's performance, and thus, that should be acquirable via instruction. Second, a learning technique, called situated explanation specifies how the agent learns general knowledge from instruction. The theory is embodied by an implemented agent, Instructo-Soar, built within the Soar architecture. Instructo-Soar is able to learn hierarchies of completely new tasks, to extend task knowledge to apply in new situations, and in fact to acquire every type of knowledge it uses during task performance - control knowledge, knowledge of operators' effects, state inferences, etc. - from interactive natural language instructions. This variety of learning occurs by applying the situated explanation technique to a variety of instructional interactions involving a variety of types of instructions (commands, statements, conditionals, etc.). By taking seriously the requirements of flexible tutorial instruction, Instructo-Soar demonstrates a breadth of interaction and learning capabilities that goes beyond previous instructable systems, such as learning apprentice systems. Instructo-Soar's techniques could form the basis for future 'instructable technologies' that come equipped with basic capabilities, and can be taught by novice users to perform any number of desired tasks.

Huffman, Scott Bradley↗
NASA NTRS2000

A Cybernetic Approach to the Modeling of Agent Communities

In an earlier paper [1] examples of agent technology in a NASA context were presented. Both groundbased and space-based applications were addressed. This paper continues the discussion of one aspect of the Goddard Space Flight Center's continuing efforts to develop a community of agents that can support both ground-based and space-based systems autonomy. The paper focuses on an approach to agent-community modeling based on the theory of viable systems developed by Stafford Beer. It gives the status of an initial attempt to capture some of the agent-community behaviors in a viable system context. This paper is expository in nature and focuses on a discussion of the modeling of some of the underlying concepts and infrastructure that will serve as the basis of more detailed investigative work into the behavior of agent communities. The paper is organized as follows. First, a general introduction to agent community requirements is presented. Secondly, a brief introduction to the cybernetic concept of a viable system is given. This concept forms the foundation of the modeling approach. Then the concept of an agent community is modeled in the cybernetic context.

Truszkowski, Walt↗
NASA NTRS2002

Brahms Mobile Agents: Architecture and Field Tests

We have developed a model-based, distributed architecture that integrates diverse components in a system designed for lunar and planetary surface operations: an astronaut's space suit, cameras, rover/All-Terrain Vehicle (ATV), robotic assistant, other personnel in a local habitat, and a remote mission support team (with time delay). Software processes, called agents, implemented in the Brahms language, run on multiple, mobile platforms. These mobile agents interpret and transform available data to help people and robotic systems coordinate their actions to make operations more safe and efficient. The Brahms-based mobile agent architecture (MAA) uses a novel combination of agent types so the software agents may understand and facilitate communications between people and between system components. A state-of-the-art spoken dialogue interface is integrated with Brahms models, supporting a speech-driven field observation record and rover command system (e.g., return here later and bring this back to the habitat ). This combination of agents, rover, and model-based spoken dialogue interface constitutes a personal assistant. An important aspect of the methodology involves first simulating the entire system in Brahms, then configuring the agents into a run-time system.

Clancey, William J.↗
NASA NTRS2003

Scoping Planning Agents With Shared Models

In this paper we provide a formal framework to define the scope of planning agents based on a single declarative model. Having multiple agents sharing a single model provides numerous advantages that lead to reduced development costs and increase reliability of the system. We formally define planning in terms of extensions of an initial partial plan, and a set of flaws that make the plan unacceptable. A Flaw Filter (FF) allows us to identify those flaws relevant to an agent. Flaw filters motivate the Plan Identification Function (PIF), which specifies when an agent is is ready hand control to another agent for further work. PIFs define a set of plan extensions that can be generated from a model and a plan request. FFs and PIFs can be used to define the scope of agents without changing the model. We describe an implementation of PIFsand FFswithin the context of EUROPA, a constraint-based planning architecture, and show how it can be used to easily design many different agents.

Bedrax-Weiss, Tania↗
NASA NTRS2004

Time-Extended Policies in Mult-Agent Reinforcement Learning

Reinforcement learning methods perform well in many domains where a single agent needs to take a sequence of actions to perform a task. These methods use sequences of single-time-step rewards to create a policy that tries to maximize a time-extended utility, which is a (possibly discounted) sum of these rewards. In this paper we build on our previous work showing how these methods can be extended to a multi-agent environment where each agent creates its own policy that works towards maximizing a time-extended global utility over all agents actions. We show improved methods for creating time-extended utilities for the agents that are both "aligned" with the global utility and "learnable." We then show how to crate single-time-step rewards while avoiding the pi fall of having rewards aligned with the global reward leading to utilities not aligned with the global utility. Finally, we apply these reward functions to the multi-agent Gridworld problem. We explicitly quantify a utility's learnability and alignment, and show that reinforcement learning agents using the prescribed reward functions successfully tradeoff learnability and alignment. As a result they outperform both global (e.g., team games ) and local (e.g., "perfectly learnable" ) reinforcement learning solutions by as much as an order of magnitude.

Tumer, Kagan↗