Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “agent”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Unbundling Smart Meter Services Through Spatio-Temporal Decomposition Agents in DER-rich Environment

Smart meters and the advanced metering infrastructure (AMI) facilitate distribution system operators (DSOs) to gather information on energy consumption at the customer level. With the increasing penetration of building-level intermittent distributed energy resources (DERs) behind the meter, DER information is not available to DSOs. At the same time, smart meter enables users to participate in grid, with real-time information. Information for behind the meter is needed by user to coordinate building level assets for maximum benefits. The concept of unbundled smart meter (USM) needs agents to decompose smart meter measurements to provide service to DSO as well as customers. In this paper, we propose a Spatio-Temporal Decomposition Agent (STDA) for USM based on Artificial Intelligence (AI). STDA can help users optimize their energy usage, help DSO to utilize building assets for the grid operation. The energy usage strategy developed by STDA is suitable for different users, and can be customized by deep learning (DL) models according to the different energy consumption habits of each user. The power prediction performance results of various DL models and evaluation using a set of data from a Hawaii utility is presented. Furthermore, STDA integration with Home Energy management Systems (HEMS) to manage resources is presented and validated. STDA pre-processes the measurements before model training, and provides the spatio-temporal decomposed forecasting.

42 ENGINEERING↗
DOE OSTI2020

Multi-Agent Safe Policy Learning for Power Management of Networked Microgrids

This paper presents a supervised multi-agent safe policy learning (SMAS-PL) method for optimal power management of networked microgrids (MGs) in distribution systems. While unconstrained reinforcement learning (RL) algorithms are black-box decision models that could fail to satisfy grid operational constraints, our proposed method considers AC power flow equations and other operational limits. Accordingly, the training process employs the gradient information of operational constraints to ensure that the optimal control policy functions generate safe and feasible decisions. Furthermore, we have developed a distributed consensus-based optimization approach to train the agents’ policy functions while maintaining MGs’ privacy and data ownership boundaries. After training, the learned optimal policy functions can be safely used by the MGs to dispatch their local resources, without the need to solve a complex optimization problem from scratch. Lastly, numerical experiments have been devised to verify the performance of the proposed method.

, policy gradient↗
DOE OSTI2021

Additive Manufacturing of Porous Ceramics With Foaming Agent

The macro-porous ceramics has promising durability and thermal insulation performance. As porous ceramics find more and more applications across many industries, a cost-effective and scalable additive manufacturing technique for fabricating macro-porous ceramics is highly desirable. Herein, we reported a facile additive manufacturing approach to fabricate porous ceramics and control the printed porosity. Several printable ceramic inks were prepared, and the foaming agent was added to generate gaseous bubbles in the ink, followed by the direct ink writing and the ambient-pressure and room-temperature drying to create the three-dimensional geometries. In this work, a set of experimental studies were performed to optimize the printing quality. The results revealed the optimal process parameters for printing the foamed ceramic ink with a high spatial resolution and fine surface quality. Varying the concentration of the foaming agent enables the controllability of the structural porosity. The maximum porosity can reach 85%, with a crack-free internal porous structure. The tensile tests showed that the printed macro-porous ceramics possessed enhanced durability with the addition of fiber. With a high-fidelity three-dimensional (3D) printing process and the precise controllability of the porosity, we showed that the printed samples exhibited a remarkably low thermal conductivity and durable mechanical strength.

36 MATERIALS SCIENCE↗
DOE OSTI2019

A Cooperative Multi-Agent Deep Reinforcement Learning Framework for Real-Time Residential Load Scheduling

Internet-of-Things (IoT) enabled monitoring and control capabilities are enabling increasing numbers of household users with controllable loads to actively participate in smart grid energy management. Realizing an efficient real-time energy management system that takes advantage of these developments requires novel techniques for managing the increased complexity of the control action space in resolving multiple challenges such as the uncertainty in energy prices and renewable energy output along with the need to satisy physical grid constraints such as transformer capacity. Addressing these challenges, we develop a multi-household energy management framework for residential units connected to the same transformer and containing DERs such as PV, ESS and controllable loads. The goal of our framework is to schedule controllable household appliances and ESS such that the cost of procuring electricity from the utility over a horizon is minimized while physical grid constraints are satisfied at each scheduling step. Traditional energy management frameworks either perform global optimization to satisfy grid constraints but suffer from high computational complexity (for example Integer Program, Mixed Integer Programming frameworks and centralized reinforcement learning) or perform decentralized real-time energy management without satisfying global grid constraints (for example multi-agent reinforcement learning with no cooperation). In contrast, we propose a cooperative multiagent reinforcement learning (MARL) framework that i) operates in real-time, and ii) performs explicit collaboration to satisfy global grid constraints. The novelty in our framework is two fold. Firstly, our framework trains multiple independent learners (IL) for each household in parallel using historical data and performs real-time inferencing of control actions using the most recent system state. Secondly, our framework contains a low complexity knapsack based cooperation agent which combines the outputs of ILs to minimize cost while satisfying grid constraints. Simulation results show that our cooperative MARL approach achieves significant cost improvement over centralized reinforcement learning and day-ahead planning baselines. Moreover, our approach strictly satisfies physical constraints with no apriori knowledge of system dynamics while the baseline approaches have occasional violations. We also measure the training and inference time by ranging the number of households from 1 to 25. Results show that our cooperative MARL approach scales best among various approaches.

14 SOLAR ENERGY↗
DOE OSTI2020

Using mixed methods to construct and analyze a participatory agent-based model of a complex Zimbabwean agro-pastoral system

Complex social-ecological systems can be difficult to study and manage. Simulation models can facilitate exploration of system behavior under novel conditions, and participatory modeling can involve stakeholders in developing appropriate management processes. Participatory modeling already typically involves qualitative structural validation of models with stakeholders, but with increased data and more sophisticated models, quantitative behavioral validation may be possible as well. In this study, we created a novel agent-basedmodel applied to a specific context: Zimbabwean non-governmental organization the Muonde Trust has been collecting data on their agro-pastoral system for the last 35 years and had concerns about land-use planning and the effectiveness of management interventions in the face of climate change. We collaboratively created an agent-based model of their system using their data archive, qualitatively calibrating it to the observed behavior of the real system without tuning any parameters to match specific quantitative outputs. We then behaviorally validated the model using quantitative community-based data and conducted a sensitivity analysis to determine the relative impact of underlying parameter assumptions, Indigenous management interventions, and different rainfall variation scenarios. We found that our process resulted in a model which was successfully structurally validated and sufficiently realistic to be useful for Muonde researchers as a discussion tool. The model was inconsistently behaviorally validated, however, with some model variables matching field data better than others. We observed increased model system instability due to increasing variability in underlying drivers (rainfall), and also due to management interventions that broke feedbacks between the components of the system. Interventions that smoothed year-to-year variation rather than exaggerating it tended to improve sustainability. The Muonde trust has used the model to successfully advocate to local leaders for changes in land-use planning policy that will increase the sustainability of their system.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Biphasic response of human iPSC-derived neural network activity following exposure to a sarin-surrogate nerve agent

Organophosphorus nerve agents (OPNA) are hazardous environmental exposures to the civilian population and have been historically weaponized as chemical warfare agents (CWA). OPNA exposure can lead to several neurological, sensory, and motor symptoms that can manifest into chronic neurological illnesses later in life. There is still a large need for technological advancement to better understand changes in brain function following OPNA exposure. The human-relevant in vitro multi-electrode array (MEA) system, which combines the MEA technology with human stem cell technology, has the potential to monitor the acute, sub-chronic, and chronic consequences of OPNA exposure on brain activity. However, the application of this system to assess OPNA hazards and risks to human brain function remains to be investigated. In a concentration-response study, we have employed a human-relevant MEA system to monitor and detect changes in the electrical activity of engineered neural networks to increasing concentrations of the sarin surrogate 4-nitrophenyl isopropyl methylphosphonate (NIMP). We report a biphasic response in the spiking (but not bursting) activity of neurons exposed to low (i.e., 0.4 and 4 μM) versus high concentrations (i.e., 40 and 100 μM) of NIMP, which was monitored during the exposure period and up to 6 days post-exposure. Regardless of the NIMP concentration, at a network level, communication or coordination of neuronal activity decreased as early as 60 min and persisted at 24 h of NIMP exposure. Once NIMP was removed, coordinated activity was no different than control (0 μM of NIMP). Interestingly, only in the high concentration of NIMP did coordination of activity at a network level begin to decrease again at 2 days post-exposure and persisted on day 6 post-exposure. Notably, cell viability was not affected during or after NIMP exposure. Also, while the catalytic activity of AChE decreased during NIMP exposure, its activity recovered once NIMP was removed. Gene expression analysis suggests that human iPSC-derived neurons and primary human astrocytes resulted in altered genes related to the cell’s interaction with the extracellular environment, its intracellular calcium signaling pathways, and inflammation, which could have contributed to how neurons communicated at a network level.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

An Overview of Biofilm Formation–Combating Strategies and Mechanisms of Action of Antibiofilm Agents

Biofilm formation on surfaces via microbial colonization causes infections and has become a major health issue globally. The biofilm lifestyle provides resistance to environmental stresses and antimicrobial therapies. Biofilms can cause several chronic conditions, and effective treatment has become a challenge due to increased antimicrobial resistance. Antibiotics available for treating biofilm-associated infections are generally not very effective and require high doses that may cause toxicity in the host. Therefore, it is essential to study and develop efficient anti-biofilm strategies that can significantly reduce the rate of biofilm-associated healthcare problems. In this context, some effective combating strategies with potential anti-biofilm agents, including plant extracts, peptides, enzymes, lantibiotics, chelating agents, biosurfactants, polysaccharides, organic, inorganic, and metal nanoparticles, etc., have been reviewed to overcome biofilm-associated healthcare problems. From their extensive literature survey, it can be concluded that these molecules with considerable structural alterations might be applied to the treatment of biofilm-associated infections, by evaluating their significant delivery to the target site of the host. To design effective anti-biofilm molecules, it must be assured that the minimum inhibitory concentrations of these anti-biofilm compounds can eradicate biofilm-associated infections without causing toxic effects at a significant rate.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Magnetic and Impedance Analysis of Fe 2 O 3 Nanoparticles for Chemical Warfare Agent Sensing Applications

A dire need for real-time detection of toxic chemical compounds exists in both civilian and military spheres. In this paper, we demonstrate that inexpensive, commercially available Fe 2 O 3 nanoparticles are capable of selective sensing of chemical warfare agents (CWAs) using frequency-dependent impedance spectroscopy, with additional potential as an orthogonal magnetic sensor. X-ray magnetic circular dichroism analysis shows that Fe 2 O 3 nanoparticles possess moderately lowered moment upon exposure to 2-chloroethyl ethyl sulfide (2-CEES) and diisopropyl methylphosphonate (DIMP) and significantly lowered moment upon exposure to dimethyl methylphosphonate (DMMP) and dimethyl chlorophosphate (DMCP). Associated X-ray absorption spectra confirm a redox reaction in the Fe 2 O 3 nanoparticles due to CWA structural analog exposure, with differentiable energy-dependent features that suggest selective sensing is possible, given the correct method. Impedance spectroscopy performed on samples dosed with DMMP, DMCP, and tabun (GA, chemical warfare nerve agent) showed strong, differentiable, frequency-dependent responses. The frequency profiles provide unique “shift fingerprints” with which high specificity can be determined, even amongst similar analytes. The results suggest that frequency-dependent impedance fingerprinting using commercially available Fe 2 O 3 nanoparticles as a sensor material is a feasible route to selective detection.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Integration of Decentralized Graph-Based Multi-Agent Reinforcement Learning with Digital Twin for Traffic Signal Optimization

Machine learning (ML) methods, particularly Reinforcement Learning (RL), have gained widespread attention for optimizing traffic signal control in intelligent transportation systems. However, existing ML approaches often exhibit limitations in scalability and adaptability, particularly within large traffic networks. This paper introduces an innovative solution by integrating decentralized graph-based multi-agent reinforcement learning (DGMARL) with a Digital Twin to enhance traffic signal optimization, targeting the reduction of traffic congestion and network-wide fuel consumption associated with vehicle stops and stop delays. In this approach, DGMARL agents are employed to learn traffic state patterns and make informed decisions regarding traffic signal control. The integration with a Digital Twin module further facilitates this process by simulating and replicating the real-time asymmetric traffic behaviors of a complex traffic network. The evaluation of this proposed methodology utilized PTV-Vissim, a traffic simulation software, which also serves as the simulation engine for the Digital Twin. The study focused on the Martin Luther King (MLK) Smart Corridor in Chattanooga, Tennessee, USA, by considering symmetric and asymmetric road layouts and traffic conditions. Comparative analysis against an actuated signal control baseline approach revealed significant improvements. Experiment results demonstrate a remarkable 55.38% reduction in Eco_PI, a developed performance measure capturing the cumulative impact of stops and penalized stop delays on fuel consumption, over a 24 h scenario. In a PM-peak-hour scenario, the average reduction in Eco_PI reached 38.94%, indicating the substantial improvement achieved in optimizing traffic flow and reducing fuel consumption during high-demand periods. These findings underscore the effectiveness of the integrated DGMARL and Digital Twin approach in optimizing traffic signals, contributing to a more sustainable and efficient traffic management system.

42 ENGINEERING↗
DOE OSTI2019

Distributed Solar Technoeconomic Agent Characteristics dSTAC

These data files summarize key techno-economic metrics used in the NREL dGen model for modeling adoption of distributed solar by representative residential commercial and industrial entities for each county in the continental United States. As described further below many of the metrics are derived as summaries of outputs from dGen. Specifically each county and sector in these file are summarized as a single agent that is the weighted average of 10 statistically-representative agents weighed by the statistical frequency. The dGen simulation used to derive this dataset was conducted in 2018 using the NREL 2018 Standard Scenario Mid Case assumptions https//www.nrel.gov/docs/fy19osti/71913.pdf.

agent-based modeling↗
NASA NTRS2021

Towards the Development of a Multi-Agent Cognitive Networking System for the Lunar Environment

This paper details the development of a multi-agent cognitive system intended to optimize networking performance in the lunar environment. NASA’s current concept of the future of lunar communication, LunaNet [1], outlines a complex network of networks. Challenges such as scalability, interoperability and reliability must first be addressed to successfully fulfill this vision. Machine intelligence can greatly reduce the reliance on human operators and enable efficient operations for tasks such as scheduling and network management. The application of machine learning, artificial intelligence, and other automated decision-making techniques can be used to allow network nodes to intelligently sense and adapt to changes in the environment such as link disruptions, new nodes joining the network, and support for a diverse range of protocols. Cognitive networking seeks to evolve these technologies into an autonomous system with improved science data return, reliability, and scalability. In this paper, we study three main areas a means to further develop cognitive networking capabilities: networking and flight software development, analysis of wireless data for modeling and simulation, and development of algorithms for a multi-agent system.

Cognitive Networking↗
NASA NTRS2022

Towards the Development of a Multi-Agent Cognitive Networking System for the Lunar Environment

This paper details the development of a multi-agent cognitive system intended to optimize networking performance in the lunar environment. One concept of the future of lunar communication, LunaNet, outlines a complex network of networks. Challenges such as scalability, interoperability, and reliability must first be addressed to successfully fulfill this vision. Machine intelligence can greatly reduce the reliance on human operators and enable efficient operations for tasks such as scheduling and network management. Machine learning, artificial intelligence, and other automated decision-making techniques can be used to allow network nodes to intelligently sense and adapt to changes in the environment such as link disruptions, new nodes joining the network, and support for a diverse range of protocols. Cognitive networking seeks to evolve these technologies into an autonomous system with improved science data return, reliability, and scalability. In this paper, we study four main areas as a means to further develop cognitive networking capabilities: networking protocol development, analysis of wireless data for modeling and simulation, development of algorithms for a multi-agent system, and spectrum sensing technology.

cognitive networking↗
DOE OSTI2024

Integration of Decentralized Graph-Based Multi-Agent Reinforcement Learning with Digital Twin for Traffic Signal Optimization

Machine learning (ML) methods, particularly Reinforcement Learning (RL), have gained widespread attention for optimizing traffic signal control in intelligent transportation systems. However, existing ML approaches often exhibit limitations in scalability and adaptability, particularly within large traffic networks. This paper introduces an innovative solution by integrating decentralized graph-based multi-agent reinforcement learning (DGMARL) with a Digital Twin to enhance traffic signal optimization, targeting the reduction of traffic congestion and network-wide fuel consumption associated with vehicle stops and stop delays. In this approach, DGMARL agents are employed to learn traffic state patterns and make informed decisions regarding traffic signal control. The integration with a Digital Twin module further facilitates this process by simulating and replicating the real-time asymmetric traffic behaviors of a complex traffic network. The evaluation of this proposed methodology utilized PTV-Vissim, a traffic simulation software, which also serves as the simulation engine for the Digital Twin. The study focused on the Martin Luther King (MLK) Smart Corridor in Chattanooga, Tennessee, USA, by considering symmetric and asymmetric road layouts and traffic conditions. Comparative analysis against an actuated signal control baseline approach revealed significant improvements. Experiment results demonstrate a remarkable 55.38% reduction in Eco_PI, a developed performance measure capturing the cumulative impact of stops and penalized stop delays on fuel consumption, over a 24 h scenario. In a PM-peak-hour scenario, the average reduction in Eco_PI reached 38.94%, indicating the substantial improvement achieved in optimizing traffic flow and reducing fuel consumption during high-demand periods. These findings underscore the effectiveness of the integrated DGMARL and Digital Twin approach in optimizing traffic signals, contributing to a more sustainable and efficient traffic management system.

actuated signal control↗
DOE OSTI2014

Perylene-diimide-based nanoparticles as highly efficient photoacoustic agents for deep brain tumor imaging in living mice

In order to promote preclinical and clinical applications of photoacoustic imaging, novel photoacoustic contrast agents are highly desired for molecular imaging of diseases, especially for deep tumor imaging. In this paper, perylene-3,4,9,10-tetracarboxylic diiimide-based near-infrared-absorptive organic nanoparticles are reported as an efficient agent for photoacoustic imaging of deep brain tumors in living mice with enhanced permeability and retention effect

60 APPLIED LIFE SCIENCES↗