Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Agents”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Multi-Agent Safe Policy Learning for Power Management of Networked Microgrids

This paper presents a supervised multi-agent safe policy learning (SMAS-PL) method for optimal power management of networked microgrids (MGs) in distribution systems. While unconstrained reinforcement learning (RL) algorithms are black-box decision models that could fail to satisfy grid operational constraints, our proposed method considers AC power flow equations and other operational limits. Accordingly, the training process employs the gradient information of operational constraints to ensure that the optimal control policy functions generate safe and feasible decisions. Furthermore, we have developed a distributed consensus-based optimization approach to train the agents’ policy functions while maintaining MGs’ privacy and data ownership boundaries. After training, the learned optimal policy functions can be safely used by the MGs to dispatch their local resources, without the need to solve a complex optimization problem from scratch. Lastly, numerical experiments have been devised to verify the performance of the proposed method.

, policy gradient↗
DOE OSTI2021

Additive Manufacturing of Porous Ceramics With Foaming Agent

The macro-porous ceramics has promising durability and thermal insulation performance. As porous ceramics find more and more applications across many industries, a cost-effective and scalable additive manufacturing technique for fabricating macro-porous ceramics is highly desirable. Herein, we reported a facile additive manufacturing approach to fabricate porous ceramics and control the printed porosity. Several printable ceramic inks were prepared, and the foaming agent was added to generate gaseous bubbles in the ink, followed by the direct ink writing and the ambient-pressure and room-temperature drying to create the three-dimensional geometries. In this work, a set of experimental studies were performed to optimize the printing quality. The results revealed the optimal process parameters for printing the foamed ceramic ink with a high spatial resolution and fine surface quality. Varying the concentration of the foaming agent enables the controllability of the structural porosity. The maximum porosity can reach 85%, with a crack-free internal porous structure. The tensile tests showed that the printed macro-porous ceramics possessed enhanced durability with the addition of fiber. With a high-fidelity three-dimensional (3D) printing process and the precise controllability of the porosity, we showed that the printed samples exhibited a remarkably low thermal conductivity and durable mechanical strength.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Using mixed methods to construct and analyze a participatory agent-based model of a complex Zimbabwean agro-pastoral system

Complex social-ecological systems can be difficult to study and manage. Simulation models can facilitate exploration of system behavior under novel conditions, and participatory modeling can involve stakeholders in developing appropriate management processes. Participatory modeling already typically involves qualitative structural validation of models with stakeholders, but with increased data and more sophisticated models, quantitative behavioral validation may be possible as well. In this study, we created a novel agent-basedmodel applied to a specific context: Zimbabwean non-governmental organization the Muonde Trust has been collecting data on their agro-pastoral system for the last 35 years and had concerns about land-use planning and the effectiveness of management interventions in the face of climate change. We collaboratively created an agent-based model of their system using their data archive, qualitatively calibrating it to the observed behavior of the real system without tuning any parameters to match specific quantitative outputs. We then behaviorally validated the model using quantitative community-based data and conducted a sensitivity analysis to determine the relative impact of underlying parameter assumptions, Indigenous management interventions, and different rainfall variation scenarios. We found that our process resulted in a model which was successfully structurally validated and sufficiently realistic to be useful for Muonde researchers as a discussion tool. The model was inconsistently behaviorally validated, however, with some model variables matching field data better than others. We observed increased model system instability due to increasing variability in underlying drivers (rainfall), and also due to management interventions that broke feedbacks between the components of the system. Interventions that smoothed year-to-year variation rather than exaggerating it tended to improve sustainability. The Muonde trust has used the model to successfully advocate to local leaders for changes in land-use planning policy that will increase the sustainability of their system.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Biphasic response of human iPSC-derived neural network activity following exposure to a sarin-surrogate nerve agent

Organophosphorus nerve agents (OPNA) are hazardous environmental exposures to the civilian population and have been historically weaponized as chemical warfare agents (CWA). OPNA exposure can lead to several neurological, sensory, and motor symptoms that can manifest into chronic neurological illnesses later in life. There is still a large need for technological advancement to better understand changes in brain function following OPNA exposure. The human-relevant in vitro multi-electrode array (MEA) system, which combines the MEA technology with human stem cell technology, has the potential to monitor the acute, sub-chronic, and chronic consequences of OPNA exposure on brain activity. However, the application of this system to assess OPNA hazards and risks to human brain function remains to be investigated. In a concentration-response study, we have employed a human-relevant MEA system to monitor and detect changes in the electrical activity of engineered neural networks to increasing concentrations of the sarin surrogate 4-nitrophenyl isopropyl methylphosphonate (NIMP). We report a biphasic response in the spiking (but not bursting) activity of neurons exposed to low (i.e., 0.4 and 4 μM) versus high concentrations (i.e., 40 and 100 μM) of NIMP, which was monitored during the exposure period and up to 6 days post-exposure. Regardless of the NIMP concentration, at a network level, communication or coordination of neuronal activity decreased as early as 60 min and persisted at 24 h of NIMP exposure. Once NIMP was removed, coordinated activity was no different than control (0 μM of NIMP). Interestingly, only in the high concentration of NIMP did coordination of activity at a network level begin to decrease again at 2 days post-exposure and persisted on day 6 post-exposure. Notably, cell viability was not affected during or after NIMP exposure. Also, while the catalytic activity of AChE decreased during NIMP exposure, its activity recovered once NIMP was removed. Gene expression analysis suggests that human iPSC-derived neurons and primary human astrocytes resulted in altered genes related to the cell’s interaction with the extracellular environment, its intracellular calcium signaling pathways, and inflammation, which could have contributed to how neurons communicated at a network level.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

An Overview of Biofilm Formation–Combating Strategies and Mechanisms of Action of Antibiofilm Agents

Biofilm formation on surfaces via microbial colonization causes infections and has become a major health issue globally. The biofilm lifestyle provides resistance to environmental stresses and antimicrobial therapies. Biofilms can cause several chronic conditions, and effective treatment has become a challenge due to increased antimicrobial resistance. Antibiotics available for treating biofilm-associated infections are generally not very effective and require high doses that may cause toxicity in the host. Therefore, it is essential to study and develop efficient anti-biofilm strategies that can significantly reduce the rate of biofilm-associated healthcare problems. In this context, some effective combating strategies with potential anti-biofilm agents, including plant extracts, peptides, enzymes, lantibiotics, chelating agents, biosurfactants, polysaccharides, organic, inorganic, and metal nanoparticles, etc., have been reviewed to overcome biofilm-associated healthcare problems. From their extensive literature survey, it can be concluded that these molecules with considerable structural alterations might be applied to the treatment of biofilm-associated infections, by evaluating their significant delivery to the target site of the host. To design effective anti-biofilm molecules, it must be assured that the minimum inhibitory concentrations of these anti-biofilm compounds can eradicate biofilm-associated infections without causing toxic effects at a significant rate.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Magnetic and Impedance Analysis of Fe 2 O 3 Nanoparticles for Chemical Warfare Agent Sensing Applications

A dire need for real-time detection of toxic chemical compounds exists in both civilian and military spheres. In this paper, we demonstrate that inexpensive, commercially available Fe 2 O 3 nanoparticles are capable of selective sensing of chemical warfare agents (CWAs) using frequency-dependent impedance spectroscopy, with additional potential as an orthogonal magnetic sensor. X-ray magnetic circular dichroism analysis shows that Fe 2 O 3 nanoparticles possess moderately lowered moment upon exposure to 2-chloroethyl ethyl sulfide (2-CEES) and diisopropyl methylphosphonate (DIMP) and significantly lowered moment upon exposure to dimethyl methylphosphonate (DMMP) and dimethyl chlorophosphate (DMCP). Associated X-ray absorption spectra confirm a redox reaction in the Fe 2 O 3 nanoparticles due to CWA structural analog exposure, with differentiable energy-dependent features that suggest selective sensing is possible, given the correct method. Impedance spectroscopy performed on samples dosed with DMMP, DMCP, and tabun (GA, chemical warfare nerve agent) showed strong, differentiable, frequency-dependent responses. The frequency profiles provide unique “shift fingerprints” with which high specificity can be determined, even amongst similar analytes. The results suggest that frequency-dependent impedance fingerprinting using commercially available Fe 2 O 3 nanoparticles as a sensor material is a feasible route to selective detection.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Integration of Decentralized Graph-Based Multi-Agent Reinforcement Learning with Digital Twin for Traffic Signal Optimization

Machine learning (ML) methods, particularly Reinforcement Learning (RL), have gained widespread attention for optimizing traffic signal control in intelligent transportation systems. However, existing ML approaches often exhibit limitations in scalability and adaptability, particularly within large traffic networks. This paper introduces an innovative solution by integrating decentralized graph-based multi-agent reinforcement learning (DGMARL) with a Digital Twin to enhance traffic signal optimization, targeting the reduction of traffic congestion and network-wide fuel consumption associated with vehicle stops and stop delays. In this approach, DGMARL agents are employed to learn traffic state patterns and make informed decisions regarding traffic signal control. The integration with a Digital Twin module further facilitates this process by simulating and replicating the real-time asymmetric traffic behaviors of a complex traffic network. The evaluation of this proposed methodology utilized PTV-Vissim, a traffic simulation software, which also serves as the simulation engine for the Digital Twin. The study focused on the Martin Luther King (MLK) Smart Corridor in Chattanooga, Tennessee, USA, by considering symmetric and asymmetric road layouts and traffic conditions. Comparative analysis against an actuated signal control baseline approach revealed significant improvements. Experiment results demonstrate a remarkable 55.38% reduction in Eco_PI, a developed performance measure capturing the cumulative impact of stops and penalized stop delays on fuel consumption, over a 24 h scenario. In a PM-peak-hour scenario, the average reduction in Eco_PI reached 38.94%, indicating the substantial improvement achieved in optimizing traffic flow and reducing fuel consumption during high-demand periods. These findings underscore the effectiveness of the integrated DGMARL and Digital Twin approach in optimizing traffic signals, contributing to a more sustainable and efficient traffic management system.

42 ENGINEERING↗
NASA NTRS2021

Towards the Development of a Multi-Agent Cognitive Networking System for the Lunar Environment

This paper details the development of a multi-agent cognitive system intended to optimize networking performance in the lunar environment. NASA’s current concept of the future of lunar communication, LunaNet [1], outlines a complex network of networks. Challenges such as scalability, interoperability and reliability must first be addressed to successfully fulfill this vision. Machine intelligence can greatly reduce the reliance on human operators and enable efficient operations for tasks such as scheduling and network management. The application of machine learning, artificial intelligence, and other automated decision-making techniques can be used to allow network nodes to intelligently sense and adapt to changes in the environment such as link disruptions, new nodes joining the network, and support for a diverse range of protocols. Cognitive networking seeks to evolve these technologies into an autonomous system with improved science data return, reliability, and scalability. In this paper, we study three main areas a means to further develop cognitive networking capabilities: networking and flight software development, analysis of wireless data for modeling and simulation, and development of algorithms for a multi-agent system.

Cognitive Networking↗
NASA NTRS2022

Towards the Development of a Multi-Agent Cognitive Networking System for the Lunar Environment

This paper details the development of a multi-agent cognitive system intended to optimize networking performance in the lunar environment. One concept of the future of lunar communication, LunaNet, outlines a complex network of networks. Challenges such as scalability, interoperability, and reliability must first be addressed to successfully fulfill this vision. Machine intelligence can greatly reduce the reliance on human operators and enable efficient operations for tasks such as scheduling and network management. Machine learning, artificial intelligence, and other automated decision-making techniques can be used to allow network nodes to intelligently sense and adapt to changes in the environment such as link disruptions, new nodes joining the network, and support for a diverse range of protocols. Cognitive networking seeks to evolve these technologies into an autonomous system with improved science data return, reliability, and scalability. In this paper, we study four main areas as a means to further develop cognitive networking capabilities: networking protocol development, analysis of wireless data for modeling and simulation, development of algorithms for a multi-agent system, and spectrum sensing technology.

cognitive networking↗
DOE OSTI2024

Integration of Decentralized Graph-Based Multi-Agent Reinforcement Learning with Digital Twin for Traffic Signal Optimization

Machine learning (ML) methods, particularly Reinforcement Learning (RL), have gained widespread attention for optimizing traffic signal control in intelligent transportation systems. However, existing ML approaches often exhibit limitations in scalability and adaptability, particularly within large traffic networks. This paper introduces an innovative solution by integrating decentralized graph-based multi-agent reinforcement learning (DGMARL) with a Digital Twin to enhance traffic signal optimization, targeting the reduction of traffic congestion and network-wide fuel consumption associated with vehicle stops and stop delays. In this approach, DGMARL agents are employed to learn traffic state patterns and make informed decisions regarding traffic signal control. The integration with a Digital Twin module further facilitates this process by simulating and replicating the real-time asymmetric traffic behaviors of a complex traffic network. The evaluation of this proposed methodology utilized PTV-Vissim, a traffic simulation software, which also serves as the simulation engine for the Digital Twin. The study focused on the Martin Luther King (MLK) Smart Corridor in Chattanooga, Tennessee, USA, by considering symmetric and asymmetric road layouts and traffic conditions. Comparative analysis against an actuated signal control baseline approach revealed significant improvements. Experiment results demonstrate a remarkable 55.38% reduction in Eco_PI, a developed performance measure capturing the cumulative impact of stops and penalized stop delays on fuel consumption, over a 24 h scenario. In a PM-peak-hour scenario, the average reduction in Eco_PI reached 38.94%, indicating the substantial improvement achieved in optimizing traffic flow and reducing fuel consumption during high-demand periods. These findings underscore the effectiveness of the integrated DGMARL and Digital Twin approach in optimizing traffic signals, contributing to a more sustainable and efficient traffic management system.

actuated signal control↗
DOE OSTI2022

Composition‐Conditioning Agent for Doped Spiro‐OMeTAD to Realize Highly Efficient and Stable Perovskite Solar Cells

Abstract The doped Spiro‐OMeTAD hole transport layer (HTL) formed using the lithium bis(trifluoromethane) sulfonimide salt and 4‐tert‐butylpyridine with phenethylammonium iodide surface treatment on a perovskite film has continuously dominated the record power conversion efficiencies (PCEs) of perovskite solar cells (pero‐SCs). However, unstable HTL compositions and iodide salts can cause severe device degradation. In this study, an HTL composition‐conditioning agent (CCA), Spiro‐BD‐2OEG, is designed, which contains a Spiro‐OMeTAD‐like backbone, functional pyridine units, and oligo (ethylene glycol) chains. This finely designed CCA presents good miscibility with Spiro‐OMeTAD and its dopants and acts as a conditioning agent through weak bond interactions. As a result, the CCA‐regulated HTL shows a pinhole‐free and smooth morphology with enhanced Spiro‐OMeTAD ordering and improves dopant stability. In addition, the gradient‐distributed CCA in the HTL can narrow the energy level offset with the valence band of the perovskite. The resultant pero‐SCs exhibit an excellent PCE of 24.19% without any interface treatment and weak size dependence. A remarkable PCE of 22.63% is obtained even for a 1.004‐cm 2 device. Importantly, the strategy shows good universality and significantly promotes the long‐term stability of the pero‐SCs based on the classical doped Spiro‐OMeTAD.

Chemistry↗
DOE OSTI2021

Carbon fiber/epoxy vitrimer composite patch cured with bio‐based curing agents for one‐step repair metallic sheet and its recyclability

Abstract Vitrimers have gained a great deal of attention from researchers, yet research on its application is still lacking. This study, a novel bio‐based vitrimer was developed from epoxy (EP) and bio‐based curing agents, that is, cashew nut shell liquid (CNSL) and citric acid (CA), and then reinforced by carbon fiber. The vitrimers with different ratios of acid to epoxy (R ratio) at 0.30–0.40 contained ester and ether linkages. All EP/CA/CNSL vitrimers showed the stress relaxation over 70–100°C due to transesterification. The vitrimers were applied as polymer matrices for the carbon fiber composites and then used as repair patches. By using the carbon fiber‐reinforced vitrimer with the R ratio of 0.30, patch repair on a damaged alloy sheet revealed that approximately 98% of the tensile strength of the damaged alloy sheet was recovered. The vitrimer can be dissolved from carbon fiber composite to recover carbon fiber. The recovered carbon fiber retained good tensile strength compared to the pristine composite. Based on this study, the EP/CA/CNSL vitrimers showed the comparable thermomechanical properties with the epoxy vitrimer cured by the petroleum‐based curing agent. The vitrimer composite patch could therefore be an alternative new repair method to extend the service life of damaged structures.

Lorwanishpaisarn, Narubeth↗
DOE OSTI2020

Using AI Simulations to Dynamically Model Multi-agent Multi-team Energy Systems

The complexity of energy systems is well known as they are complex and intricate systems. As a result, many extant studies have used many simplifications or generalizations that do not accurately reflect the nature of this complex system. In particular, most HVAC systems are modeled as a single unit, or several large units, rather than as a hierarchical composite (e.g., as a floor rather than as a collection of disparate rooms). The net result of this is that the simulations are too generic to perform meaningful analysis, machine learning, or integrated simulation. We propose using a multi-agent multi-team strategic simulations framework called SiMAMT to better define, model, simulate, and learn the HVAC environment. SiMAMT allows us to create distinct models for each type of room, hierarchically aggregate them into units (like floors, or sections), and then into larger sets (like buildings or a campus), and then perform a simulation that interacts with each sub-element individually, the teams of sub-elements collectively, and the entire set in aggregation. Further, and most importantly, we additionally model another ‘team’ within the simulation framework - the users of the systems. Again, each individual is modeled distinctly, aggregated into sub-sets, then collected into large sets. Each user, or agent, is performing on their own but with respect to the larger team goals. This provides a simulation that has a much higher model fidelity and more applicable results that match the real-world.

Franklin, D. Michael↗
DOE OSTI2024

Potential biological control agents of Geosmithia morbida restrict fungal pathogen growth via mycoparasitism and antibiosis

Abstract Thousand cankers disease of Juglans (walnut) and Pterocarya (wingnut) spp. (Fagales: Juglandaceae) is caused by the fungal pathogen Geosmithia morbida Kolarík, Freeland, Utley, and Tisserat (Hypocreales: Bionectriaceae) and bark beetle pest/vector, Pityophthorus juglandis Blackman (Coleoptera: Curculionidae). To further the development of biological management strategies for thousand cankers disease, we assessed the ability of 14 endophytic Trichoderma (Hypocreales: Hypocreaceae) isolates and the commercially available isolate T. afroharzianum strain KRL-AG2 to inhibit the in vitro growth of three different G. morbida isolates via mycoparasitism and antibiosis. To identify factors that may affect field success of candidate biological control agents, we quantified the growth responses of Trichoderma spp. and the commercially available entomopathogenic fungus, Beauveria bassiana (Bals.-Criv.) Vuill. (Hypocreales: Cordycipitaceae) strain GHA, to the plant secondary metabolite and antimicrobial compound, juglone in vitro. A total of 12 Trichoderma isolates (from six different Trichoderma species) demonstrated antagonistic activity towards G. morbida in dual-plate assays. Juglone consistently reduced the growth of B. bassiana strain GHA and 14 of the 15 screened Trichoderma isolates in vitro. Additionally, one metabolite-producing Trichoderma isolate, TN4-47, completely inhibited the growth of all three G. morbida isolates across all tested metabolite concentrations and had comparatively greater tolerance to juglone compared to other Trichoderma isolates. Future lines of research should focus on characterizing the active antagonistic compound present in the metabolite filtrates, determine the mode of action of the active component(s), and elucidate how abiotic and biotic factors may influence the growth, persistence, and antagonistic activity of candidate biological control agents in planta .

59 BASIC BIOLOGICAL SCIENCES↗