Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “agent based”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,153 records · Page 64

Aqueous vinylidene fluoride polymer coating composition

A water-based coating composition which may be air dried to form durable, fire resistant coatings includes dispersed vinylidene fluoride polymer particles, emulsified liquid epoxy resin and a dissolved emulsifying agent for said epoxy resin which agent is also capable of rapidly curing the epoxy resin upon removal of the water from the composition.

Bartoszek, Edward J.↗

Making Macroscopic Assemblies of Aligned Carbon Nanotubes

A method of aligning and assembling single-wall carbon nanotubes (SWNTs) to fabricate macroscopic structures has been invented. The method entails suspending SWNTs in a fluid, orienting the SWNTs by use of a magnetic and/or electric field, and then removing the aligned SWNTs from suspension in such a way as to assemble them while maintaining the alignment. SWNTs are essentially tubular extensions of fullerene molecules. It is desirable to assemble aligned SWNTs into macroscopic structures because the common alignment of the SWNTs in such a structure makes it possible to exploit, on a macroscopic scale, the unique mechanical, chemical, and electrical properties that individual oriented SWNTs exhibit at the molecular level. Because of their small size and high electrical conductivity, carbon nanotubes, and especially SWNTs, are useful for making electrical connectors in integrated circuits. Carbon nanotubes can be used as antennas at optical frequencies, and as probes in scanning tunneling microscopes, atomic-force microscopes, and the like. Carbon nanotubes can be used with or instead of carbon black in tires. Carbon nanotubes are useful as supports for catalysts. Ropes of SWNTs are metallic and, as such, are potentially useful in some applications in which electrical conductors are needed - for example, they could be used as additives in formulating electrically conductive paints. Finally, macroscopic assemblies of aligned SWNTs can serve as templates for the growth of more and larger structures of the same type. The great variety of tubular fullerene molecules and of the structures that could be formed by assembling them in various ways precludes a complete description of the present method within the limits of this article. It must suffice to present a typical example of the use of one of many possible variants of the method to form a membrane comprising SWNTs aligned substantially parallel to each other in the membrane plane. The apparatus used in this variant of the method (see figure) includes a reservoir containing SWNTs dispersed in a suspending agent (for example, dimethylformamide) and a reservoir containing a suitable solvent (for example, water mixed with a surfactant). By use of either pressurized gas supplied from upstream or suction from downstream, the suspension of SWNTs and the solvent are forced to mix and flow into a tank. A filter inside the tank contains pores small enough to prevent the passage of most SWNTs, but large enough to allow the passage of molecules of the solvent and suspending agent. The filter is oriented perpendicular to the flow path. A magnetic field parallel to the plane of the filter is applied. The success of the method is based on the tendency of SWNTs to become aligned with their longitudinal axes parallel to an applied magnetic field. The alignment energy of an SWNT increases with the length of the SWNT and the magnetic-field strength. In order to obtain an acceptably small degree of statistical deviation of SWNTs of a given length from alignment with a magnetic field, one must make the field strong enough so that the thermal energy associated with rotation of an SWNT away from alignment is less than the alignment energy.

Smalley, Richard E.↗

Towards Autonomous Lunar Resource Excavation via Deep Reinforcement Learning

To support sustainable infrastructure on the Moon, NASA needs to leverage lunar resources for in-situ processing and construction. NASA’s Regolith Advanced Surface Systems Operations Robot (RASSOR) is principally designed to mine and deliver regolith for these tasks. To reliably perform these operations on the lunar surface, RASSOR's sensors and control systems need to be robust and maximize information extracted from a reduced sensor payload. Herein, we present our findings from the Intelligent Capabilities Enhanced RASSOR project. We created reduced-order simulation environments in which we applied reinforcement learning algorithms to learn autonomous trenching controllers and produced state estimation architectures. We developed two simulations: a 2D excavation simulation used to facilitate parameter selection, and a 3D simulation developed using a game physics engine to simulate simplified soil interactions and incorporate robotic agents parameterized by dynamic models. Within these simulations, we learned autonomous excavation routines that exceed excavation efficiency measures as compared against RASSOR's existing control and teleoperation-based methods.

RASSOR↗

Towards Autonomous Lunar Resource Excavation via Deep Reinforcement Learning

To support sustainable infrastructure on the Moon, NASA needs to leverage lunar resources for in-situ processing and construction. NASA’s Regolith Advanced Surface Systems Operations Robot (RASSOR) is principally designed to mine and deliver regolith for these tasks. To reliably perform these operations on the lunar surface, RASSOR's sensors and control systems need to be robust and maximize information extracted from a reduced sensor payload. Herein, we present our findings from the Intelligent Capabilities Enhanced RASSOR project. We created reduced-order simulation environments in which we applied reinforcement learning algorithms to learn autonomous trenching controllers and produced state estimation architectures. We developed two simulations: a 2D excavation simulation used to facilitate parameter selection, and a 3D simulation developed using a game physics engine to simulate simplified soil interactions and incorporate robotic agents parameterized by dynamic models. Within these simulations, we learned autonomous excavation routines that exceed excavation efficiency measures as compared against RASSOR's existing control and teleoperation-based methods.

RASSOR↗

Metal-organic frameworks for the adsorption and catalytic transformations of carbon dioxide

Novel crystalline porous materials known as metal-organic frameworks (MOFs) and methods for their synthesis are provided herein. The MOFs include a M6(μ3-OH)8(OH)8(μ2,η2-(O2C)2cyclam)8 cluster, and a metal atom coordinated to the one or more cyclam of the cluster, wherein M is Zr or Hf, and the metal atom is any one of Cu, Ni, Cr, Ru, Co, and Gd. The MOFs can be used as an adsorbent, alone or in a medium with other components, of CO2. The MOFs can also be used as a catalyst for the transformation of CO2 and epoxides to cyclic carbonates. The MOFs can also be used in the electrochemical catalytic reduction of CO2. The MOFs can also be used for photocatalytic CO2 reduction for the production of carbon-based fossil fuels. The MOFs can also be used for light-induced nitric oxide (NO) release. The MOFs can also be used as magnetic resonance imaging (MRI) agents.

Morris, Amanda Jean↗

Battery electrode coatings applied by waterborne electrodeposition

The present invention is directed towards an electrodepositable coating composition comprising (a) a fluoropolymer; (b) an electrochemically active material and/or electrically conductive agent; (c) a pH-dependent rheology modifier; and (d) an aqueous medium comprising water; wherein water is present in an amount of at least 45% by weight, based on the total weight of the electrodepositable coating composition. Also disclosed herein is a method of coating a substrate, as well as coated substrates and electrical storage devices.

Oakes, Landon J.↗

Proto-Examples of Data Access and Visualization Components of a Potential Cloud-Based GEOSS-AI System

Once a research or application problem has been identified, one logical next step is to search for available relevant data products. Thus, an early component of a potential GEOSS-AI system, in the continuum between observations and end point research, applications, and decision making, would be one that enables transparent data discovery and access by users. Such a component might be effected via the systems data agents. Presumably, some kind of data cataloging has already been implemented, e.g., in the GEOSS Common Infrastructure (GCI). Both the agents and cataloging could also leverage existing resources external to the system. The system would have some means to accept and integrate user-contributed agents. The need or desirability for some data format internal to the system should be evaluated. Another early component would be one that facilitates browsing visualization of the data, as well as some basic analyses.Three ongoing projects at the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) provide possible proto-examples of potential data access and visualization components of a cloud-based GEOSS-AI system. 1. Reorganizing data archived as time-step arrays to point-time series (data rods), as well as leveraging the NASA Simple Subset Wizard (SSW), to significantly increase the number of data products available, at multiple NASA data centers, for production as on-the-fly (virtual) data rods. SSWs data discovery is based on OpenSearch. Both pre-generated and virtual data rods are accessible via Web services. 2. Developing Web Feature Services to publish the metadata, and expose the locations, of pre-generated and virtual data rods in the GEOSS Portal and enable direct access of the data via Web services. SSW is also leveraged to increase the availability of both NASA and non-NASA data.3.Federating NASA Giovanni (Geospatial Interactive Online Visualization and Analysis Interface), for multi-sensor data exploration, that would allow each cooperating data center, currently the NASA Distributed Active Archive Centers (DAACs), to configure its own Giovanni deployment, while also allowing all the deployments to incorporate each others data. A federated Giovanni comprises Giovanni Virtual Machines, which can be run on local servers or in the cloud.

access↗

How Autonomous Intelligent Systems Can Facilitate Earth-independent Medical Care: Going Beyond Telepresence

During the last decade, teleoperated robotic systems have extended humans’ sensorimotor competence to digitally fly beyond the physical barrier of distance and scale and thus transmit sensorimotor skills of the human through direct communication. Telepresence capabilities have enabled tele-physical remote access at small scales thanks to telerobotic mediums. Although the concept was initially motivated by space applications, such technologies quickly have expanded into the medical domain and resulted in teleoperated medical robots, including telerobotic surgical systems (such as the da Vinci surgical system). Effective telepresence fundamentally depends on an agile, reliable, and secure communication medium that can transmit real-time information between the operator and a remote device. However, direct telepresence may not be achievable for long-duration exploration spaceflight missions. Thus, autonomous systems and local intelligence represent potential solutions to the aforementioned issues. One example solution employs demonstration systems which enable learning from the pre-captured inputs of a skilled human operator. These will be computationally modeled and later probabilistically replicated toward the completion of remote physical tasks when direct telepresence is not viable - such as under communication blackout conditions. In other words, trained autonomous systems (e.g., robots) can perform remote operations that mimic the physical performance of experts during remote operations/training. Beyond learning the physics of the task, autonomous agents can also be used to conduct algorithmic decision-making that mimics the higher-level cognition of the expert. Thus, using an autonomous system, pre-trained cognitive and manipulation-based skills can be leveraged (acquired during pre-mission events) to produce digital twins of an intelligent operator. Such systems can be used for the real-time conduction of intricate tasks in complex and unstructured environments. Such systems will operationalize “cognitive digital twins” and can expand the reach of human cognition and manipulation through the power of data-driven learning from demonstration algorithms. This system category will be discussed as a fully autonomous operation in this talk. In addition to the above, we will also propose and discuss the possibility of partial-automation using remote intelligence and remote sensing. In contrast to full automation, partial automation can close the loop through a local operator equipped with augmented sensory awareness through wearable systems. Such technologies will allow the local operator to conduct delicate tasks while being guided using sensory augmentation and being monitored to gauge her/his level of cognitive focus and performance. The difference with the previous category is that a remote human will conduct the task. Further, rather than making a digital twin of human cognition, we will augment the control inputs of the local human to match those of the skilled expert operator who is not accessible in real-time. Going beyond classic telepresence and thus approaching intelligent telepresence, our vision is that autonomous agents will eventually enable the safe, consistent and efficient delivery of complex, remote and smart medical care during space exploration across operators in an Earth-independent fashion. We will discuss our collective vision from NASA and MERIIT@NYU lab in this talk.

Telepresence↗

Autonomous Navigation, Dynamic Path and Work Flow Planning in Multi-Agent Robotic Swarms Project

Kennedy Space Center has teamed up with the Biological Computation Lab at the University of New Mexico to create a swarm of small, low-cost, autonomous robots, called Swarmies, to be used as a ground-based research platform for in-situ resource utilization missions. The behavior of the robot swarm mimics the central-place foraging strategy of ants to find and collect resources in an unknown environment and return those resources to a central site.

Technology Portfolio System↗

Mucus-derived glycans are inhibitory signals for Salmonella Typhimurium SPI-1-mediated invasion

Mucus forms a critical barrier against enteric pathogens like Salmonella enterica serovar Typhimurium. While in vivo studies indicate that secreted, gel-forming mucins and specifically core 3 glycosylation are protective against S. Typhimurium, the molecular mechanisms involved remain unclear. Here, we demonstrate that native intestinal mucins inhibit Salmonella invasion of colonic epithelial cells by downregulating the type 3 secretion system through suppression of the key virulence regulator, HilD. Our study identifies mucin glycans and specific mucin sugars, namely N-acetyl galactosamine and N-acetyl glucosamine, as the components responsible for mucin’s anti-virulence effect, likely via functional or direct interaction with HilD’s putative carbohydrate-binding domain. Notably, we find that the native presentation of these sugars is important for activity. These insights provide a mechanistic foundation for mucin-based strategies to combat enteric infections and, given the prevalence of homologous AraC-type regulators in other pathogens, suggest mucins’ potential as broad-spectrum anti-virulence agents.

60 APPLIED LIFE SCIENCES↗

A high-fidelity building performance simulation test bed for the development and evaluation of advanced controls

We present an open-source building performance simulation test bed, the Advanced Controls Test Bed (ACTB), that interfaces high-fidelity Spawn of EnergyPlus building models, with advanced controllers implemented in Python. Additionally, the ACTB leverages the Building Optimization Testing and Alfalfa platforms for managing simulations, providing an external clock, a representational state transfer (REST) application programming interface (API), and key performance indicators for evaluating the effectiveness of control strategies. The REST API allows the development of external controllers programmed in languages such as Python, which provides flexibility and a rich choice of scientific libraries for designing control sequences. We present three test cases based on the U.S. Department of Energy's Reference Small Office Building to demonstrate the ACTB's capabilities: (a) rule-based controls compliant with ASHRAE Guideline 36 control sequences; (b) an economic model predictive control implemented using do-mpc; and (c) a deep Q-network reinforcement learning agent implemented using OpenAI Gym.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Reinforcement Learning-Based Secondary Control Strategy for Voltage and Frequency Regulation in Islanded Inverter-Based Microgrids

This paper presents a reinforcement learning (RL) approach for secondary voltage and frequency control in islanded inverter-based microgrids. The proposed control strategy aims to restore voltage and frequency deviations caused by the primary droop control while ensuring proper power sharing between distributed generators. The RL agent is designed to provide correction signals to the primary control, considering communication delays and system constraints. The effectiveness of the proposed control strategy is validated through simulation results in MATLAB/Simulink environment, demonstrating superior performance in maintaining voltage and frequency within the nominal values.

Rodriguez Martinez, Omar Felipe [University of Pue↗

Code for Value Decomposition Graph Network and environment for AMR on linear advection

This is the code for the paper [Multi-Agent Reinforcement Learning for Adaptive Mesh Refinement](https://arxiv.org/abs/2211.00801), published at AAMAS 2023. It contains the implementation of a new algorithm, called Value Decomposition Graph Network (VDGN), for applying multi-agent reinforcement learning to the problem of adaptive mesh refinement (AMR). It also contains the implementation of a multi-agent environment for AMR on a linear advection problem. VDGN is the first learning algorithm to display anticipatory refinement behavior in AMR, and it outperforms local error threshold-based heuristic strategies.

Yang, Jiachen↗

The Confluence of Gangis and Eos Chasmas (5-12 deg S, 31-41 deg W): Geologic, Hydrologic, and Exobiologic Considerations for Landing Site at the East End of Valles Marineris

Over its 3,500 km length, Valles Marineris exhibits an enormous range of geologic and environmental diversity. At its western end, the canyon is dominated by the tectonic complex of Noctis Labyrinthus; while in the east it grades into an extensive region of chaos where scoured channels and streamlined islands provide evidence of catastrophic floods that spilled into the northern plains. In the central portion of the system, debris derived from the massive interior layered deposits of Candor and Ophir Chasmas spills into the central trough. In other areas, 6 km-deep exposures of Hesperian and Noachian-age canyon wall stratigraphy have collapsed in massive landslides that extend many tens of kilometers across the canyon floor. Ejecta from interior craters, aeolian sediments, and possible volcanics emanating from structurally controlled vents along the base of the scarps, further contribute to the canyon's geologic complexity. Following the initial rifting that gave birth to Valles Marineris, water appears to have been a principal agent in the canyon's geomorphic development an agent whose significance is given added weight by its potential role in both sustaining and preserving evidence of past life. In this regard, the interior layered deposits of Candor, Ophir, and Hebes Chasmas, have been identified as possible lucustrine sediments that may have been laid down in long-standing ice-covered lakes. The potential survival and growth of native organisms in such an environment, or in the aquifers whose disruption gave birth to the chaotic terrain and outflow channels to the north and east of the canyon, raises the possibility that fossil indicators of life may be present in the local sediment and rock. Because of the enormous distances over which these diverse environments occur, identifying a single landing site that maximizes the opportunity for scientific return is not a simple task. However, given the fluvial history and narrow geometry of the canyon, the presence of a single exit at its eastern end provides an opportunity for sampling that appears unequaled elsewhere in the system.

George, J. A.↗

Distributed topology control algorithm for multihop wireless netoworks

We present a network initialization algorithmfor wireless networks with distributed intelligence. Each node (agent) has only local, incomplete knowledge and it must make local decisions to meet a predefined global objective. Our objective is to use power control to establish a topology based onthe relative neighborhood graph which has good overall performance in terms of power usage, low interference, and reliability.

topology control distributed algorithm wireless ne↗

Rational Polymer Design of Stretchable Poly(ionic liquid) Membranes for Dual Applications

Many functional polymeric materials are inherently fragile at ambient conditions. Consequently, making them elastic and flexible is a challenging task, and such achievement is especially meaningful in a wide range of applications including separation membranes and stretchable devices. Poly(ionic liquids) (PILs), such as vinyl-imidazolium-based polymers, are known to be “brittle” functional polymers due to their “glassy” nature at ambient temperature. We herein developed a viable approach to enable glassy PILs with high flexibility and good elasticity via a rational molecular design of chemical composition and polymer architectures. The reversible addition/fragmentation chain transfer agents (RAFT-CTAs) were attached to the flexible poly(dimethylsiloxane) (PDMS) backbones. The polymerization of functional ionic liquid monomers from RAFT-CTAs provided grafted copolymers with the functional side chains, which were further cross-linked by di-functional PDMS. Poly(ethylene glycol) methacrylate is copolymerized with ionic liquid monomers to reduce the glass transition temperature (Tg), providing higher chain mobility and elasticity at ambient temperature. The synthesized elastic PIL-based membranes (E-PILs) have dramatically improved stretchability, reaching 122–422%. In addition to significantly improved extensibility, the synthesized E-PILs also exhibit higher ionic conductivity, critical for potential applications in solid-state batteries. Moreover, in comparison to glassy solid PIL membranes, the E-PILs also exhibited enhanced flexibility and excellent gas-separation performance.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Attention Enabled Multi-Agent DRL for Decentralized Volt-VAR Control of Active Distribution System Using PV Inverters and SVCs

This paper proposes attention enabled multi-agent deep reinforcement learning (MADRL) framework for active distribution network decentralized Volt-VAR control. Using the unsupervised clustering, the whole distribution system can be decomposed into several sub-networks according to the voltage and reactive power sensitivity relationships. Then, the distributed control problem of each sub-network is modeled as Markov games and solved by the improved MADRL algorithm, where each sub-network is modeled as an adaptive agent. An attention mechanism is developed to help each agent focus on specific information that is mostly related to the reward. All agents are centrally trained offline to learn the optimal coordinated Volt-VAR control strategy and executed in a decentralized manner to make online decisions with only local information. Compared with other distributed control approaches, the proposed method can effectively deal with uncertainties, achieve fast decision makings, and significantly reduce the communication requirements. Comparison results with model-based and other data-driven methods on IEEE 33-bus and 123-bus systems demonstrate the benefits of the proposed approach.

distribution network↗

Additive‐Free Oxidized Spiro‐MeOTAD Hole Transport Layer Significantly Improves Thermal Solar Cell Stability

Perovskite solar cells are among the most promising new solar technologies, already surpassing polycrystalline silicon solar cell efficiencies. The stability of the highest efficiency devices at elevated temperature is, however, poor. These cells typically use Spiro-MeOTAD as the hole transporting layer. It is generally believed that additives, required for enhancing electrical conductivity and optimizing energy level alignment, are responsible for the reduced stability—inferring that Spiro-MeOTAD based hole transporting layers are intrinsically unstable. Here, a reliable noble metal free synthesis of Spiro-MeOTAD (bis(trifluoromethane)sulfonimide) 4 is presented which is used as the oxidizing agent. No additives are added to the partially oxidized Spiro-MeOTAD hole-transporting layer. Device efficiencies up to 24.2% are achieved. Electrical conductivity is largely developed by the first 1% oxidation. Further oxidation shifts the energy levels away from the vacuum level, which allows tuning of the energy level alignment without the use of additives—contradicting the current understanding of this system. Without additives, devices demonstrate significant improvement in stability at elevated temperatures up to 85 °C under one sun over 1400 h continuous illumination. The remaining degradation is pinpointed to ion migration and reactions in the perovskite layer which may be further suppressed with compositional engineering and adequate ion barrier layers.

14 SOLAR ENERGY↗