Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “agent based”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31
All sourcesNASA NTRSDOE OSTI
NASA NTRS2013

Analysis of Traffic Conflicts in a Mixed-Airspace Evaluation of Airborne Separation Assurance

A pair of human-in-the-loop simulation evaluations of a distributed air/ground separation assurance system have been conducted to investigate the function allocation between humans and automation systems as well as ground-based and airborne agents in the Next Generation Air Transportation System and beyond. This paper focuses on an analysis of certain critical conflicts observed between self-separating aircraft and ground-managed traffic in the same airspace. The principal cause of each conflict is identified and potential mitigations are discussed, such as: the sharing of trajectory intent information between the ground and the air; more cautious trajectory planning by the self-separating aircraft; and more equitable rules-of-the-road between the self-separating aircraft and ground-managed aircraft. This analysis will inform the ongoing design of an airborne separation assurance automation tool.

Lewis, Timothy A.↗
NASA NTRS2017

Surface Monitoring of CFRP Structures for Adhesive Bonding

Adhesive bonding of composite materials requires reliable monitoring and detection of surface contaminants to assure robust and durable bonded structures. Surface treatment and effective monitoring prior to bonding is essential in order to obtain a surface free from contaminants that may degrade structural performance. Two techniques which monitor the effectiveness of the laser surface treatment of carbon fiber reinforced polymer (CFRP) materials are being investigated: laser induced breakdown spectroscopy (LIBS) and optically stimulated electron emission (OSEE). The applicability of LIBS to detect silicone contaminants on CFRP composites is studied using ~35 ns Nd:YAG laser pulses at 355 nm with a pulse energy of 45 mJ. The LIBS regime in which pulse energies are < 100 mJ is referred to as mLIBS. CFRP surfaces were contaminated with polydimethylsiloxane (PDMS), a major component of silicone based mold release agents. The presence of PDMS is found by inspecting the Si I emission line at 288.2 nm. Untreated CFRP samples and CFRP contaminated with PDMS were tested. The PDMS areal density ranged from 0.36 Â+/- 0.04 to 0.51 Â+/- 0.16 mg/cm2. The results demonstrate the successful detection of PDMS on CFRP using mLIBS. In addition, OSEE was used to measure CFRP surface cleanliness pre- and post-treatment by laser ablation on specimens contaminated with PDMS coatings from 8 nm to 1311 nm in thickness. The results showed a significant increase in the OSEE photocurrent after laser surface treatment.

Ledesma, Rodolfo↗
NASA NTRSDate not supplied

Joint Communication Resource Allocation and Velocity Selection in Urban Air Mobility via Multi-agent Reinforcement Learning

With traffic congestion problems becoming more severe in urban areas, the National Aeronautics and Space Administration promotes the Urban Air Mobility (UAM) concept, which envisages a safe and efficient air transportation system. However, the increased communication demands in UAM can exacerbate the spectrum scarcity. Therefore, a new communication resource allocation solution is necessary. In this paper, we focus on uplink UAM communications, where multiple aerial vehicles (AV) perform cargo/passenger delivery tasks. With predefined flight paths, AVs make decisions on communication resource allocation and velocity selection to complete their missions under safety constraints. Accordingly, we formulate a joint optimization problem to minimize the weighted sum of the total travel time and communication outage time. We first model the optimization problem as a Markov game and propose a multi-agent reinforcement learning based solution. Simulation results corroborate the effectiveness of the proposed solution.

Ruixuan Han↗
DOE OSTI2023

Large-Eddy Simulation of Flow Over Boeing Gaussian Bump Using Multiagent Reinforcement Learning Wall Model: Preprint

We develop a wall model for large-eddy simulation (LES) that takes into account various pressure-gradient effects using multi-agent reinforcement learning. The model is trained using low-Reynolds-number flow over periodic hills with agents distributed on the wall at various computational grid points. It utilizes a wall eddy-viscosity formulation as the boundary condition to apply the modeled wall shear stress. Each agent receives states based on local instantaneous flow quantities at an off-wall location, computes a reward based on the estimated wall-shear stress, and provides an action to update the wall eddy viscosity at each time step. The trained wall model is validated in wall-modeled LES of flow over periodic hills at higher Reynolds numbers, and the results show the effectiveness of the model on flow with pressure gradients. The analysis of the trained model indicates that the model is capable of distinguishing between the various pressure gradient regimes present in the flow. To further assess the robustness of the developed wall model, simulations of flow over the Boeing Gaussian bump are conducted at a Reynolds number of 2 x 10^6, based on the free-stream velocity and the bump width. The results of mean skin friction and pressure on the bump surface, as well as the velocity statistics of the flow field, are compared to those obtained from equilibrium wall model (EQWM) simulations and published experimental data sets. The developed wall model is found to successfully capture the acceleration and deceleration of the turbulent boundary layer on the bump surface, providing better predictions of skin friction near the bump peak and exhibiting comparable performance to the EQWM with respect to the wall pressure and velocity field. We also conclude that the subgrid-scale model is crucial to the accurate prediction of the flow field, in particular the prediction of separation.

boundary layer↗
NASA NTRS2009

Workflow Agents vs. Expert Systems: Problem Solving Methods in Work Systems Design

During the 1980s, a community of artificial intelligence researchers became interested in formalizing problem solving methods as part of an effort called "second generation expert systems" (2nd GES). How do the motivations and results of this research relate to building tools for the workplace today? We provide an historical review of how the theory of expertise has developed, a progress report on a tool for designing and implementing model-based automation (Brahms), and a concrete example how we apply 2nd GES concepts today in an agent-based system for space flight operations (OCAMS). Brahms incorporates an ontology for modeling work practices, what people are doing in the course of a day, characterized as "activities." OCAMS was developed using a simulation-to-implementation methodology, in which a prototype tool was embedded in a simulation of future work practices. OCAMS uses model-based methods to interactively plan its actions and keep track of the work to be done. The problem solving methods of practice are interactive, employing reasoning for and through action in the real world. Analogously, it is as if a medical expert system were charged not just with interpreting culture results, but actually interacting with a patient. Our perspective shifts from building a "problem solving" (expert) system to building an actor in the world. The reusable components in work system designs include entire "problem solvers" (e.g., a planning subsystem), interoperability frameworks, and workflow agents that use and revise models dynamically in a network of people and tools. Consequently, the research focus shifts so "problem solving methods" include ways of knowing that models do not fit the world, and ways of interacting with other agents and people to gain or verify information and (ultimately) adapt rules and procedures to resolve problematic situations.

Clancey, William J.↗
DOE OSTI2026

ToPolyAgent: AI agents for coarse-grained bead-spring topological polymer simulations

We introduce ToPolyAgent, a multi-agent AI framework for performing coarse-grained molecular dynamics (MD) simulations of topological polymers through natural language instructions. By integrating large language models (LLMs) with domain-specific computational tools, ToPolyAgent supports both interactive and autonomous simulation workflows across diverse polymer architectures, including linear, ring, brush, and star polymers, as well as dendrimers. The system consists of four LLM-powered agents: a Config Agent for generating initial polymer–solvent configurations, a Simulation Agent for executing LAMMPS-based MD simulations and conformational analyses, a Report Agent for compiling markdown reports, and a Workflow Agent for streamlined autonomous operations. Interactive mode incorporates user feedback loops for iterative refinements, while autonomous mode enables end-to-end task execution from detailed prompts. We demonstrate ToPolyAgent's versatility through case studies involving diverse polymer architectures under varying solvent conditions, thermostats, and simulation lengths. Furthermore, we highlight its potential as a research assistant by directing it to investigate the effect of interaction parameters on the linear polymer conformation, and the influence of grafting density on the persistence length of the brush polymer. By coupling natural language interfaces with rigorous simulation tools, ToPolyAgent lowers barriers to complex computational workflows and advances AI-driven materials discovery in polymer science. It lays the foundation for autonomous and extensible multi-agent scientific research ecosystems.

Ding, Lijie [Oak Ridge National Laboratory (ORNL),↗
NASA NTRS2018

Cooperative Automation Supporting Pilot-Dispatch Negotiation of Enroute Trajectory Change Requests

The advent of advanced technologies in communication, navigation, and surveillance is enabling more integration between the aircraft and the ground systems in managing air traffic operations. As a result, automation has evolved to provide the flight crew, air traffic controllers, and traffic flow managers with capabilities for collaborating on information access, analysis, and decision making. In this paper, we investigate different cooperative schemes between these agents, supported by automation, in managing dynamic trajectory changes while the flight is en route to improve flight and system performance. The analysis was conducted using an abstract cognitive tasking framework to identify trajectory change tasks independently from the agent performing them. Cooperation schemes were then derived by assessing different levels of cooperation on each task between the air and ground agents and their automation. The assessment was based on which automation-supported agent is more capable of performing the task and the expected benefit mechanisms that result from cooperating. The cooperation schemes were compared based on a qualitative, but objective, assessment of the benefits expected from cooperation.

air-ground integration↗
DOE OSTI2021

Improved adhesion of polyurethane-based nanocomposite coatings to tin surface through silane coupling agents

Conformal coatings with higher adhesion strength is critical for mitigating the growth of whiskers from the pure tin (Sn) or Sn-rich surfaces of the Pb-free electronics. Silane coupling agents have the ability to form a durable bond between polymeric coatings and metallic materials. The main goal of this paper is to investigate the effect of silane agents on the adhesion behavior of polyurethane (PU), polyurethane acrylate (PUA) and both coatings filled with silicone rubber (SR) nanoparticles on the tin solder pads. It was found that an isocyanate-based silane provided excellent adhesion for PU and PU + SR coatings and an acrylic-based silane for PUA and PUA + SR coatings on the tin surface. This was due to the reaction bond formation between the silane coupling agent and the coating. Hence, the selection of silane coupling agents with the organofunctional group similar to the coating material is crucial to improve the adhesion properties of the coating.

36 MATERIALS SCIENCE↗
NASA NTRS2002

Brahms Mobile Agents: Architecture and Field Tests

We have developed a model-based, distributed architecture that integrates diverse components in a system designed for lunar and planetary surface operations: an astronaut's space suit, cameras, rover/All-Terrain Vehicle (ATV), robotic assistant, other personnel in a local habitat, and a remote mission support team (with time delay). Software processes, called agents, implemented in the Brahms language, run on multiple, mobile platforms. These mobile agents interpret and transform available data to help people and robotic systems coordinate their actions to make operations more safe and efficient. The Brahms-based mobile agent architecture (MAA) uses a novel combination of agent types so the software agents may understand and facilitate communications between people and between system components. A state-of-the-art spoken dialogue interface is integrated with Brahms models, supporting a speech-driven field observation record and rover command system (e.g., return here later and bring this back to the habitat ). This combination of agents, rover, and model-based spoken dialogue interface constitutes a personal assistant. An important aspect of the methodology involves first simulating the entire system in Brahms, then configuring the agents into a run-time system.

Clancey, William J.↗
NASA NTRS1995

Investigation of the Prebiotic Synthesis of Amino Acids and RNA Bases from CO2 Using FeS/H2S As a Reducing Agent

An autotrophic theory of the origin of metabolism and life has been proposed in which carbon dioxide is reduced by ferrous sulfide and hydrogen sulfide by means of a reversed citric acid cycle, leading to the production of amino acids. Similar processes have been proposed for purine synthesis. Ferrous sulfide is a strong reducing agent in the presence of hydrogen sulfide and can produce hydrogen as well as reduce alkenes, alkynes, and thiols to saturated hydrocarbons and reduce ketones to thiols. However, the reduction of carbon dioxide has not been demonstrated. We show here that no amino acids, purities, or pyrimidines are produced from carbon dioxide with the ferrous sulfide and hydrogen sulfide system. Furthermore, this system does not produce amino acids from carboxylic acids by reductive amination and carboxylation. Thus, the proposed autotrophic theory, using carbon dioxide, ferrous sulfide, and hydrogen sulfide, lacks the robustness needed to be a geological process and is, therefore, unlikely to have played a role In the origin of metabolism or the origin of life.

Keefe, Anthony D.↗
NASA NTRS1995

Investigation of the Prebiotic Synthesis of Amino Acids and RNA Bases from CO2 using FeS/H2S as a Reducing Agent

An autotrophic theory of the origin of metabolism and life has been proposed in which carbon dioxide is reduced by ferrous sulfide and hydrogen sulfide by means of a reversed citric acid cycle, leading to the production of amino acids. Similar processes have been proposed for purine synthesis. Ferrous sulfide is a strong reducing agent in the presence of hydrogen sulfide and can produce hydrogen as well as reduce alkenes, alkynes, and thiols to saturated hydrocarbons and reduce ketones to thiols. However, the reduction of carbon dioxide has not been demonstrated. We show here that no amino acids, purines, or pyrimidines are produced from carbon dioxide with the ferrous sulfide and hydrogen sulfide system. Furthermore, this system does not produce amino acids from carboxylic acids by reductive amination and carboxylation. Thus, the proposed autotrophic theory, using carbon dioxide, ferrous sulfide, and hydrogen sulfide, lacks the robustness needed to be a geological process and is, therefore, unlikely to have played a role in the origin of metabolism or the origin of life.

Keefe, Anthony D.↗
DOE OSTI2025

Harnessing Machine Learning for Agnostic Biodetection

The United States’ current list-based approach to biodefense is limited because it considers only known biological agents. Alternatively, developing and adopting a system based on agent-agnostic signatures would enable detection and characterization of both known and novel agents, thereby engendering greater adaptability in the face of an evolving threat landscape. Machine learning (ML) could aid in such a transition, as it can recognize and encode highly complex patterns from multiple input data modalities and has already demonstrated success in many healthcare and defense applications. Functionalizing ML for environmental biodetection requires understanding current technical capabilities. In this article, we provide a systematic review of existing ML platforms and discuss anticipated development efforts needed to achieve effective ML-enabled, agnostic biodetection.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

The role of information structures in game-theoretic multi-agent learning

Multi-agent learning (MAL) studies how agents learn to behave optimally and adaptively from their experience when interacting with other agents in dynamic environments. The outcome of a MAL process is jointly determined by all agents’ decision-making. Hence, each agent needs to think strategically about others’ sequential moves, when planning future actions. The strategic interactions among agents makes MAL go beyond the direct extension of single-agent learning to multiple agents. With the strategic thinking, each agent aims to build a subjective model of others decision-making using its observations. Such modeling is directly influenced by agents’ perception during the learning process, which is called the information structure of the agent’s learning. As it determines the input to MAL processes, information structures play a significant role in the learning mechanisms of the agents. This review creates a taxonomy of MAL and establishes a unified and systematic way to understand MAL from the perspective of information structures. Here we define three fundamental components of MAL: the information structure (i.e., what the agent can observe), the belief generation (i.e., how the agent forms a belief about others based on the observations), as well as the policy generation (i.e., how the agent generates its policy based on its belief). In addition, this taxonomy enables the classification of a wide range of state-of-the-art algorithms into four categories based on the belief-generation mechanisms of the opponents, including stationary, conjectured, calibrated, and sophisticated opponents. We introduce Value of Information (VoI) as a metric to quantify the impact of different information structures on MAL. Finally, we discuss the strengths and limitations of algorithms from different categories and point to promising avenues of future research.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Reinforcement-Learning-Based Smart Water Heater Control: An Actual Deployment

Utilizing smart control algorithms for electric water heaters (EWHs) is essential for fully harnessing the demand response (DR) potential of EWHs. For this reason, the use of reinforcement learning (RL) algorithms for EWHs has received increasing attention in recent years. However, existing RL approaches are either simulation-based or use pretrained RL agents. To this end, this paper presents the real-world deployment of a set of model-free RL approaches that aim to minimize the electricity cost of a EWH under a time-of-use electricity pricing policy using standard DR commands (e.g., shed, load up). The experiment results showed that the RL agents can help save electricity cost in the range of 11% to 14% compared to the baseline operation. This study demonstrated that RL-based EWH controllers can be deployed in real world without any prior training and can still save electricity cost.

deep learning↗
DOE OSTI2025

Multi-Agent Hierarchical Deep Reinforcement Learning for HVAC Control With Flexible DERs

As electricity consumption in commercial and residential buildings continues to rise, reducing energy costs presents an increasing challenge. Heating, ventilating, and air-conditioning (HVAC) systems, which typically account for 40%-50% of a building's energy use, are prime targets for energy savings. Intelligent control of HVAC temperature through the exploitation of HVAC load flexibility brings significant potential to reduce energy consumption and electricity expenses. The nonlinear models of HVAC systems challenge traditional control methods, while the uncertainty introduced by HVAC load flexibility complicates distributed energy resource (DER) management using conventional optimal dispatch techniques. In response to these challenges, we propose a hierarchical multi-agent deep reinforcement learning (DRL) approach. The lower-level agents focus on balancing comfort and energy conservation, while the upper-level DRL agents optimize the use of DERs to reduce peak demand based on the control outcomes of the HVAC by the lower-level agents. Here, in the upper-level agents, we incorporate a multi-agent structure based on ensemble learning, which acts based on historical and current data without relying on precise load forecasting to address the delayed rewarding issue in DRL. This allows for the effective reduction of energy costs. The proposed method is tested using a real-world microgrid comprising 413 buildings in Southern California, and the results demonstrate that our approach can significantly reduce overall electricity bills while ensuring the comfort of consumers and residents.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Evaluation of 6-OxP-CD, an Oxime-based cyclodextrin as a viable medical countermeasure against nerve agent poisoning: Experimental and molecular dynamic simulation studies on its inclusion complexes with cyclosarin, soman and VX

The ability of the cyclodextrin-oxime construct 6-OxP-CD to bind and degrade the nerve agents Cyclosarin (GF), Soman (GD) and S -[2-[Di(propan-2-yl)amino]ethyl] O -ethyl methylphosphonothioate (VX) has been studied using 31 P-nuclear magnetic resonance (NMR) under physiological conditions. While 6-OxP-CD was found to degrade GF instantaneously under these conditions, it was found to form an inclusion complex with GD and significantly improve its degradation (t 1/2 ~ 2 hrs) relative over background (t 1/2 ~ 22 hrs). Consequently, effective formation of the 6-OxP-CD:GD inclusion complex results in the immediate neutralization of GD and thus preventing it from inhibiting its biological target. In contrast, NMR experiments did not find evidence for an inclusion complex between 6-OxP-CD and VX, and the agent’s degradation profile was identical to that of background degradation (t 1/2 ~ 24 hrs). As a complement to this experimental work, molecular dynamics (MD) simulations coupled with Molecular Mechanics-Generalized Born Surface Area (MM-GBSA) calculations have been applied to the study of inclusion complexes between 6-OxP-CD and the three nerve agents. These studies provide data that informs the understanding of the different degradative interactions exhibited by 6-OxP-CD with each nerve agent as it is introduced in the CD cavity in two different orientations (up and down). For its complex with GF, it was found that the oxime in 6-OxP-CD lies in very close proximity (P GF …O Oxime ~ 4–5 Å) to the phosphorus center of GF in the ‘down GF ’ orientation for most of the simulation accurately describing the ability of 6-OxP-CD to degrade this nerve agent rapidly and efficiently. Further computational studies involving the center of masses (COMs) for both components (GF and 6-OxP-CD) also provided some insight on the nature of this inclusion complex. Distances between the COMs (ΔCOM) lie closer in space in the ‘down GF ’ orientation than in the ‘up GF ’ orientation; a correlation that seems to hold true not only for GF but also for its congener, GD. In the case of GD, calculations for the ‘down GD ’ orientation showed that the oxime functional group in 6-OxP-CD although lying in close proximity (P GD …O Oxime ~ 4–5 Å) to the phosphorus center of the nerve agent for most of the simulation, adopts another stable conformation that increase this distance to ~ 12–14 Å, thus explaining the ability of 6-OxP-CD to bind and degrade GD but with less efficiency as observed experimentally (t 1/2 ~ 4 hr. vs. immediate). Lastly, studies on the VX:6-OxP-CD system demonstrated that VX does not form a stable inclusion complex with the oxime-bearing cyclodextrin and as such does not interact in a way that is conducive to an accelerated degradation scenario. Collectively, these studies serve as a basic platform from which the development of new cyclodextrin scaffolds based on 6-OxP-CD can be designed in the development of medical countermeasures against these highly toxic chemical warfare agents.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

A New Approach to Distributed Hypothesis Testing and Non-Bayesian Learning: Improved Learning Rate and Byzantine-Resilience

Here, we study a setting where a group of agents, each receiving partially informative private signals, seek to collaboratively learn the true underlying state of the world (from a finite set of hypotheses) that generates their joint observation profiles. To solve this problem, we propose a distributed learning rule that differs fundamentally from existing approaches, in that it does not employ any form of “belief-averaging”. Instead, agents update their beliefs based on a min-rule. Under standard assumptions on the observation model and the network structure, we establish that each agent learns the truth asymptotically almost surely. As our main contribution, we prove that with probability 1, each false hypothesis is ruled out by every agent exponentially fast, at a network-independent rate that is strictly larger than existing rates. We then develop a computationally-efficient variant of our learning rule that is provably resilient to agents who do not behave as expected (as represented by a Byzantine adversary model) and deliberately try to spread misinformation.

42 ENGINEERING↗
DOE OSTI2021

Prediction of moisture transfer in cement-based materials: Use of a porous network model to access transfer parameters

Knowing the water transport phenomena is fundamental for understanding the durability of cement-based materials. The moisture content within cementitious materials is of primary importance because it has a direct influence on mechanical (shrinkage, creep) and chemical (penetration of aggressive agents) degradation. Many models based on the determination of the transfer properties of the material under study already exist but require fitting of the parameters to find the experimental kinetics. Transfer parameters are generally estimated from the empirical approaches developed for soils by Van Genuchten and the water vapour diffusion reduction factor is often calculated via Millington's semi-empirical model. In this paper, we make a proposal to improve the prediction of moisture transfer, through mechanisms such as drying, capillary imbibition and water vapour permeability in cement-based materials, by using a porous network model to access the transfer parameters.

36 MATERIALS SCIENCE↗