Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “agent based”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35

Comparison of Carbon Dioxide and Helium as Fire Extinguishing Agents for Spacecraft

The effects of radiation heat transfer in microgravity compared to convection heat transfer in earth gravity for opposed-flow (downward) over thermally-thick fuel using low density foam fuel were investigated. Microgravity experiments on flame spread over thermally-thick fuels were conducted using foam fuels to obtain low density and thermal conductivity, and thus large flame spread rate compared to dense fuels such as PMMA. And thereby valid microgravity results were obtained even in 2.2 second drop-tower experiments not to mention for the longer duration tests in Zero Gravity Facility. Contrast to the conventional understanding, it was found that steady flame spread can occur over thick fuels in quiescent microgravity environments, especially when radiatively-active diluent gases such as CO2 were employed. This is proposed to result from radiative heat transfer from the flame to the fuel surface, which could lead to steady spread even when the amount of the heat transfer via conduction from the flame to the fuel bed is negligible. Radiative effects are more significant at microgravity conditions because the flame is thicker and thus the volume of radiating combustion products is larger as well. These results suggested that helium may be a better inert or extinguishment agent on both a mass and a mole bases at microgravity even though CO2 is much better on a mole bases at earth gravity, and these are relevant to studies of fire safety in manned spacecraft, particularly the International Space Station that uses CO2 fire extinguishers. CO2 may not be as effective as an extinguishing agent at microgravity as it is at earth gravity in some conditions because of the differences in spread mechanisms between the two cases. In particular, the difference between conduction-dominated heat transport to the fuel bed at earth gravity and radiation-dominated heat transport at microgravity indicates that radiatively-inert diluent such as helium could be preferable in microgravity applications. Helium may be a superior fire suppression agent at microgravity on several bases. First, helium is more effective than CO2 on a mole basis (thus pressure times storage volume basis) at microgravity, meaning that the size and weight of storage bottles would be smaller for the same fire-fighting capability. Second; helium is much more effective on a mass basis (by about 11 times) at microgravity. Third; helium has no physiological activity, unlike CO2 that affects human respiration. Fourth, as compared to N2 or CO2, is not very soluble in water and thus has fewer tendencies to cause bloodstream bubble formation following rapid spacecraft cabin depressurization.

Gokoglu, Suleyman↗

QUICR-learning for Multi-Agent Coordination

Coordinating multiple agents that need to perform a sequence of actions to maximize a system level reward requires solving two distinct credit assignment problems. First, credit must be assigned for an action taken at time step t that results in a reward at time step t > t. Second, credit must be assigned for the contribution of agent i to the overall system performance. The first credit assignment problem is typically addressed with temporal difference methods such as Q-learning. The second credit assignment problem is typically addressed by creating custom reward functions. To address both credit assignment problems simultaneously, we propose the "Q Updates with Immediate Counterfactual Rewards-learning" (QUICR-learning) designed to improve both the convergence properties and performance of Q-learning in large multi-agent problems. QUICR-learning is based on previous work on single-time-step counterfactual rewards described by the collectives framework. Results on a traffic congestion problem shows that QUICR-learning is significantly better than a Q-learner using collectives-based (single-time-step counterfactual) rewards. In addition QUICR-learning provides significant gains over conventional and local Q-learning. Additional results on a multi-agent grid-world problem show that the improvements due to QUICR-learning are not domain specific and can provide up to a ten fold increase in performance over existing methods.

Agogino, Adrian K.↗

Molecular-Level Insights into the NMR Relaxivity of Gadobutrol Using Quantum and Classical Molecular Simulations

MRI is an indispensable diagnostic tool in modern medicine; however, understanding the molecular-level processes governing NMR relaxation of water in the presence of MRI contrast agents remains a challenge, hindering the molecular-guided development of more effective contrast agents. By using quantum-based polarizable force fields, the first-of-its-kind molecular dynamics (MD) simulations of Gadobutrol are reported where the 1 H NMR longitudinal relaxivity r 1 of the aqueous phase is determined without any adjustable parameters. The MD simulations of r 1 dispersion (i.e., frequency dependence) show good agreement with measurements at frequencies of interest in clinical MRI. Importantly, the simulations reveal key insights into the molecular level processes leading to r 1 dispersion by decomposing the NMR dipole–dipole autocorrelation function G(t) into a discrete set of molecular modes, analogous to the eigenmodes of a quantum harmonic oscillator. The molecular modes reveal important aspects of the underlying mechanisms governing r 1 , such as its multiexponential nature and the importance of the second eigenmodal decay. By simply analyzing the MD trajectories on a parameter-free approach, the Gadobutrol simulations show that the outer-shell water contributes ∼50% of the total relaxivity r 1 compared to the inner-shell water, in contrast to simulations of (nonchelated) gadolinium-aqua where the outer shell contributes only ∼15% of r 1 . The deviation between simulations and measurements of r 1 below clinical MRI frequencies is used to determine the low-frequency electron-spin relaxation time for Gadobutrol, in good agreement with independent studies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Adaptive planning for applications with dynamic objectives

We devise a qualitative control layer to be integrated into a real-time multi-agent reactive planner. The reactive planning system consists of distributed planning agents attending to various perspectives of the task environment. Each perspective corresponds to an objective. The set of objectives considered are sometimes in conflict with each other. Each agent receives information about events as they occur, and a set of actions based on heuristics can be taken by the agents. Within the qualitative control scheme, we use a set of qualitative feature vectors to describe the effects of applying actions. A qualitative transition vector is used to denote the qualitative distance between the current state and the target state. We will then apply on-line learning at the qualitative control level to achieve adaptive planning. Our goal is to design a mechanism to refine the heuristics used by the reactive planner every time an action is taken toward achieving the objectives, using feedback from the results of the actions. When the outcome is compared with expectations, our prior objectives may be modified and a new set of objectives (or a new assessment of the relative importance of the different objectives) can be introduced. Because we are able to obtain better estimates of the time-varying objectives, the reactive strategies can be improved and better prediction can be achieved.

Hadavi, Khosrow↗

Reflexive reasoning for distributed real-time systems

This paper discusses the implementation and use of reflexive reasoning in real-time, distributed knowledge-based applications. Recently there has been a great deal of interest in agent-oriented systems. Implementing such systems implies a mechanism for sharing knowledge, goals and other state information among the agents. Our techniques facilitate an agent examining both state information about other agents and the parameters of the knowledge-based system shell implementing its reasoning algorithms. The shell implementing the reasoning is the Distributed Artificial Intelligence Toolkit, which is a derivative of CLIPS.

Goldstein, David↗

Exploratory study on the effects of novel diamine curing agents and isocyanate precursors on the properties of new epoxy and urethane adhesives

The effects of novel aromatic diamine structures on the adhesive properties of epoxy and polyurethane adhesives were studied. Aromatic diamines based on benzophenone and diphenyl-methane isomers were evaluated as curing agents for epoxy resins and benzophenone and diphenyl-methane based diamine isomers were evaluated as curing agents for polyurethane adhesives. Polyurethane adhesives were prepared based on m, m prime-diisocyanato-diphenyl-methane and m, m prime-diisocyanato-benzophenone. The m, m prime-diisocayanato-diphenyl-methane based adhesive had properties comparable to state-of-the-art adhesives. The m, m prime-diisocyanato-benzophenone based adhesive was extremely reactive.

Glasgow, D. G.↗

Deep Learning-Based Negotiation Strategy Selection for Cooperative Conflict Resolution in Urban Air Mobility

This paper presents a collaborative conflict resolution technique using deep neural network-based intelligent search of the solution space. This approach offers a rapid convergence to a mutually acceptable solution for real-time conflict resolution, suitable for urban air mobility operations. Furthermore, the presented technique allows operational flexibility to the urban air mobility agents where these agents can collaboratively devise the solution via integrative negotiation, based on their local utility functions, as long as such a solution does not violate the global safety thresholds. The presented machine-to-machine negotiation method is built on our prior work on holistic assessment of the airspace and potential conflict detection implemented at-the-edge, onboard the unmanned aircraft systems. This paper extends the prior work to augment decision-making at-the-edge, thereby, promising a true distributed control architecture for urban air mobility. In this approach, each agent (a) builds a potential in-flight conflict map, (b) identifies the conflicting agents, (c) dynamically prepares a list of alternatives based on its current utility functions, (d) negotiates with the conflicting agents to pick one of these alternatives, and (e) implements the negotiated alternative to mutually resolve the conflict. Note that such an approach does not require a contingency plan to be made pre-flight, as the conflict resolution strategies are decided and negotiated in real time based on the present state of the agent. The contingency plan, if available, can serve as an input to the real-time conflict resolution strategy formulation, and also can be used as a fallback plan in case the negotiation fails and the impacted agents need to switch to a rule-based/supervisory resolution mode from the discussed distributed resolution mode. The presented collaborative negotiation-based conflict resolution technique incorporates a time-dependent reward function to catalyze collaborative resolution by incentivizing the agents with local and global rewards beneficial to their business operations.

Advanced Air Mobility↗

A Novel Multiagent Resource Sharing Algorithm for Control of Advanced Energy Systems

This paper implements a novel resource sharing control strategy on a fuel cell–gas turbine hybrid power system at the National Energy Technology Laboratory’s Hybrid Performance Facility (Hyper). In a fuel cell–gas turbine hybrid power system, the simultaneous interaction of the gas turbine and the fuel cell creates a tightly coupled environment characterized by conflicting dynamics. In this paper, a model-free control approach is applied to solve the tightly coupled control problem posed by this challenging environment. Specifically, this control problem is presented as a resource sharing problem that can be solved using a resource sharing algorithm that is defined based on the distribution construction concept. This algorithm creates computational agents and solves the problem through the distribution and redistribution of shared resources defined as blocks. Furthermore, two agents were created; the first agent (agent 1) controls the gas turbine speed by adjusting the electric load, and the second agent (agent 2) controls the cathode mass flow through the fuel cell using the cold-air bypass valve. A parametric study was performed over the course of 15 experimental tests for both agents 1 and 2 through an evaluation of the responses based on setpoint changes. The algorithm was shown to have behavior comparable to a previously implemented multi-input multioutput state-space controller, which was designed through a model-based control approach. The resource sharing algorithm was able to find stable performance during run-time operations without any prior system knowledge identification on the power plant and without creating models used in traditional control strategies.

25 ENERGY STORAGE↗

A Self-Organizing Nano Grid (SONG) for Energy Access Clusters

In this paper, a bottom-up dc Self-Organizing Nano Grid (SONG) for rural electrification at ultra-low-cost through a flexible and scalable topology is presented. The proposed nano grid requires no communication and uses dc-bus signaling to convey excess energy in the system through the bus voltage, allowing independent agents to conduct energy transactions based on their needs in a decentralized manner. Moreover, this article proposes a concept that uses a novel multi-source, multi-segment droop control strategy with demand coordination, allowing for dynamic self-balancing of the system under fluctuating operating conditions. The unique use of a surplus photovoltaic (PV) power droop mode precisely estimates energy availability to minimize load chattering that helps in stabilizing the dc-bus. In addition, this architecture uses standard dc/dc converters for a low-cost, modular, Plug and Play ( PnP ) solution with highly automated operation, enabling local assembly, operation, and maintenance by non-technical personnel. The proposed SONG concept was validated in simulation and with a 700W, laboratory-scale, custom made nano grid system. The simulation and experimental test cases show the feasibility of the SONG system by demonstrating the proposed multi-source, multi-segment droop control strategy without load chattering under varying operating conditions.

dc-dc converter↗

Datum: A Scientific Metadata Catalog

The data catalog market is currently flooded with a myriad of different products, but none serve the scientific community well. There are cloud-native tools like Databricks, Snowflake,to on-premise solutions like Collibra and Datahub. The common failing of all these tools however, is their inability to serve the scientific data community directly. Most catalogs are targeted towards financial, health, or user data - not sensor or scientific domain data. They also prioritize integrations that often don’t exist or are just starting to be used in the scientific realm - all while ignoring common scientific tools and file types. Datum is a catalog which targets the scientific data directly, including the tools and networks in which those tools are used. We work with the producers and consumers of the data where they are, targeting cloud and on-premise with a focus on classified networks. Datum is an Erlang/Elixir application. Technical Features Note: The features listed below are still under development and may change, slightly, upon final delivery of the product. File Formats - Datum has the ability to read additional metadata and provides processing pipelines for the following file formats: Plain Text, PDF, LaTeX, HTML, Open Document Format (.odt), XML, CSV/TSV (and other standard delimiters), OpenDocument Database and Spreadsheets, Geo-Referenced TIFF, Common Data Format, HDF/HDF5, LabView TDMS, Excel, DeltaTables, Parquet, Apache Iceberg, Apache Hudi and many others. Metadata Collection - Scanners for the local and networked file systems and cloud storage providers. Network integration with common databases such as MSSQL and MySQL. User Plugin System - Users are able to provide either file processing, metadata extraction, or sampling plugins in the programming language of their choice. Authentication/Authorization -: OIDC integration, SCIM provisioning and EntraID integration out of the box. Full user and group management system with a “least privilege” operating mode. Governance - Customizable data governance platform; dictate and enforce required metadata, enforce data embargos, and enforce user agreements and NDAs before data access. Ability to create health checks on data, rejecting abandoned or poorly curated data and automatically removing it from the search index. Ability for users to submit corrections. Search - Semantic search is a first class citizen. No licenses to expensive, external software required. Integrated use of vectors and vector-based search allows for AI agent integration at all levels of operation. Metadata Model - Display and control data’s lineage and connections to other data and data directories. Data is modeled after a filesystem - an organization instantly recognizable and navigable by most any user. CLI and SDK - Ships with a Command Line Interface (CLI) tool and with a fully-featured Python SDK. This allows for rapid and programmatic use of Datum by every level of user. Minimal Infrastructure - Datum ships as a single executable file and can be run on any operating system and most CPU architectures. Datum has no reliance on external databases, search indexing tools, or other outside services - and it runs equally well on edge computing devices, cloud services, or in a clustered HPC environment.

darrington, john↗

Passivated Interfaces and Surface Recombination Velocities in Halide Perovskites

Surfaces and charge-extracting contacts remain major sources of non-radiative recombination loss; limiting the performance of perovskite PV compared to theoretical limits. We investigate mixed-cation mixed-halide perovskites and demonstrate that, with chemical surface passivation, they can achieve >4 μs minority carrier lifetimes, and >20% external PL quantum yields (PLQY), and nearly single-exponential decay kinetics. This high PLQY observed corresponds to ~97% of the Shockley-Queisser theoretical quasi-fermi level splitting, a first for MA-free mixed-cation mixed-halide compositions. The high PLQY and long PL lifetimes allow us to measure average surface recombination velocities (SRV) <10cm/s, with a champion low of ~1cm/s (a conservative estimate). We show how such improvements in SRV should lead to an absolute improvement in PCE of >4% even with the best of contact alignments. We investigate different MA-free high bandgap compositions, including bandgaps relevant for tandem applications (1.7-1.8eV), and demonstrate performance improvements across all these compositions with our surface passivation strategy. Lastly, using a combination of surface characterization techniques, we show Lewis base interactions of the passivating agent with the perovskite surfaces.

14 SOLAR ENERGY↗

Passivated Interfaces and Surface Recombination Velocities in Halide Perovskites

Surfaces and charge-extracting contacts remain major sources of non-radiative recombination loss; limiting the performance of perovskite PV compared to theoretical limits. We investigate mixed-cation mixed-halide perovskites and demonstrate that, with chemical surface passivation, they can achieve >4 μs minority carrier lifetimes, and >20% external PL quantum yields (PLQY), and nearly single-exponential decay kinetics. This high PLQY observed corresponds to ~97% of the Shockley-Queisser theoretical quasi-fermi level splitting, a first for MA-free mixed-cation mixed-halide compositions. The high PLQY and long PL lifetimes allow us to measure average surface recombination velocities (SRV) <10cm/s, with a champion low of ~1cm/s (a conservative estimate). We show how such improvements in SRV should lead to an absolute improvement in PCE of >4% even with the best of contact alignments. We investigate different MA-free high bandgap compositions, including bandgaps relevant for tandem applications (1.7-1.8eV), and demonstrate performance improvements across all these compositions with our surface passivation strategy. Lastly, using a combination of surface characterization techniques, we show Lewis base interactions of the passivating agent with the perovskite surfaces.

passivation↗

Optimized purification methods for metallic contaminant removal from directly recycled Li-ion battery cathodes

Metallic contaminants pose a significant challenge to the viability of directly recycling Li-ion batteries. To date, few strategies exist to selectively remove metallic impurities from mixtures of shredded end-of-life material (black mass; BM) without concurrently damaging the structure and electrochemical performance of the target active material. We herein present tailored methods to selectively ionize two major contaminants—Al and Cu—while retaining a representative cathode (LiNi 0.33 Mn 0.33 Co 0.33 O 2 ; NMC-111) intact. This BM purification process is conducted at moderate temperatures in a KOH-based solution matrix. We rationally evaluate approaches to increase both the kinetic corrosion rate and the thermodynamic solubility of Al 0 and Cu 0 , and evaluate the impact of these treatment conditions on the structure, chemistry, and electrochemical performance of NMC. Specifically, we explore the impacts of chloride-based salts, a strong chelating agent, elevated temperature, and sonication on the rate and extent of contaminant corrosion, while concurrently evaluating the effects on NMC. The reported BM purification process is then demonstrated on samples of “simulated BM” containing a practically relevant 1 wt% concentration of Al or Cu. Increasing the kinetic energy of the purifying solution matrix through elevated temperature and sonication accelerates the corrosion of metallic Al and Cu, such that ∼100% corrosion of 75 μm Al and Cu particles is achieved within 2.5 hr. Further, we determine that effective mass transport of ionized species critically impacts the efficacy of Cu corrosion, and that saturated Cl – hinders rather than accelerates Cu corrosion by increasing solution viscosity and introducing competitive pathways for Cu surface passivation. The purification conditions do not induce bulk structural damage to NMC, and electrochemical capacity is maintained in half-cell format. Testing in full cells suggests that a limited quantity of residual surface species are present after treatment, which initially disrupt electrochemical behavior at the graphite anode but are subsequently consumed. Process demonstration on simulated BM suggests that contaminated samples—which prior to treatment show catastrophic electrochemical performance—can be recovered to pristine electrochemical capacity. The reported BM purification method offers a compelling and commercially viable solution to address contamination, particularly in the “fine” fraction of BM where contaminant sizes are on the same order of magnitude as NMC and where traditional separation approaches are unfeasible. Thus, this optimized BM purification technique offers a pathway towards viable direct recycling of BM feedstocks that would otherwise be unusable.

25 ENERGY STORAGE↗

A CLIPS/X-window interface

The design and implementation of an interface between the C Language Integrated Production System (CLIPS) expert system development environment and the graphic user interface development tools of the X-Window system are described. The underlying basis of the CLIPS/X-Window is a client-server model in which multiple clients can attach to a single server that interprets, executes, and returns operation results, in response to client action requests. Implemented in an AIX (UNIX) operating system environment, the interface has been successfully applied in the development of graphics interfaces for production rule cooperating agents in a knowledge-based computer aided design (CAD) system. Initial findings suggest that the client-server model is particularly well suited to a distributed parallel processing operational mode in a networked workstation environment.

Pohl, Kym Jason↗

Teamwork Reasoning and Multi-Satellite Missions

NASA is rapidly moving towards the use of spatially distributed multiple satellites operating in near Earth orbit and Deep Space. Effective operation of such multi-satellite constellations raises many key research issues. In particular, the satellites will be required to cooperate with each other as a team that must achieve common objectives with a high degree of autonomy from ground based operations. The multi-agent research community has made considerable progress in investigating the challenges of realizing such teamwork. In this report, we discuss some of the teamwork issues that will be faced by multi-satellite operations. The basis of the discussion is a particular proposed mission, the Magnetospheric MultiScale mission to explore Earth's magnetosphere. We describe this mission and then consider how multi-agent technologies might be applied in the design and operation of these missions. We consider the potential benefits of these technologies as well as the research challenges that will be raised in applying them to NASA multi-satellite missions. We conclude with some recommendations for future work.

Marsella, Stacy C.↗

Radio Frequency Plasma Synthesis of Boron Nitride Nanotubes (BNNTs) for Structural Applications: Part I

It is evident that nanotubes, such as carbon, boron nitride and even silicon, offer great potential for many aerospace applications. The opportunity exists to harness the extremely high strength and stiffness exhibited by high-purity, low-defect nanotubes in structural materials. Even though the technology associated with carbon nanotube (CNT) development is mature, the mechanical property benefits have yet to be fully realized. Boron nitride nanotubes (BNNTs) offer similar structural benefits, but exhibit superior chemical and thermal stability. A broader range of potential structural applications results, particularly as reinforcing agents for metal- and ceramic- based composites. However, synthesis of BNNTs is more challenging than CNTs mainly because of the higher processing temperatures required, and mass production techniques have yet to emerge. A promising technique is radio frequency plasma spray (RFPS), which is an inductively coupled, very high temperature process. The lack of electrodes and the self- contained, inert gas environment lend themselves to an ultraclean product. It is the aim of this White Paper to survey the state of the art with regard to nano-material production by analyzing the pros and cons of existing methods. The intention is to combine the best concepts and apply the NASA Langley Research Center (LaRC) RFPS facility to reliably synthesize large quantities of consistent, high-purity BNNTs.

Hales, Stephen J.↗

Memetic Engineering as a Basis for Learning in Robotic Communities

This paper represents a new contribution to the growing literature on memes. While most memetic thought has been focused on its implications on humans, this paper speculates on the role that memetics can have on robotic communities. Though speculative, the concepts are based on proven advanced multi agent technology work done at NASA - Goddard Space Flight Center and Lockheed Martin. The paper is composed of the following sections : 1) An introductory section which gently leads the reader into the realm of memes. 2) A section on memetic engineering which addresses some of the central issues with robotic learning via memes. 3) A section on related work which very concisely identifies three other areas of memetic applications, i.e., news, psychology, and the study of human behaviors. 4) A section which discusses the proposed approach for realizing memetic behaviors in robots and robotic communities. 5) A section which presents an exploration scenario for a community of robots working on Mars. 6) A final section which discusses future research which will be required to realize a comprehensive science of robotic memetics.

Robotics↗

Dynamic Spectrum Allocation in Urban Air Transportation System via Deep Reinforcement Learning

The emerging concepts of Urban Air Mobility (UAM) and Advanced Air Mobility (AAM) open a new paradigm for urban air transportation. A big challenge is that these new aerial vehicles will quickly saturate the already crowded aviation spectrum, which is an essential resource to ensure reliable communications for safe operations. In this paper, we consider an air transportation system where multiple aerial vehicles are operated to transport passengers or cargo from different sources to destinations along their pre-defined paths. During the flight, the minimum communication Quality of Service (QoS) requirement must be achieved to ensure flight safety. Our objective is to minimize the average mission completion time by jointly optimizing the velocity selection and spectrum allocation for all aerial vehicles. We formulate the optimization problem as a multi-stage Markov Decision Process (MDP) where the optimization variables are coupled together. A multi-agent Deep Reinforcement Learning (DRL) based solution is proposed where Value Decomposition Networks (VDN) algorithm is utilized to take discrete actions. Additionally, we propose a heuristic greedy algorithm as a baseline solution. Simulation results show that our learning based solution outperforms the heuristic greedy algorithm and another Orthogonal Multiple Access (OMA) solution in minimizing the mission completion time.

Ruixuan Han↗