Results for “agent based” — Page 70

NASA NTRS2008

Model Error Budgets

An error budget is a commonly used tool in design of complex aerospace systems. It represents system performance requirements in terms of allowable errors and flows these down through a hierarchical structure to lower assemblies and components. The requirements may simply be 'allocated' based upon heuristics or experience, or they may be designed through use of physics-based models. This paper presents a basis for developing an error budget for models of the system, as opposed to the system itself. The need for model error budgets arises when system models are a principle design agent as is increasingly more common for poorly testable high performance space systems.

error budgets↗

NASA NTRS2011

Process Algebra Approach for Action Recognition in the Maritime Domain

The maritime environment poses a number of challenges for autonomous operation of surface boats. Among these challenges are the highly dynamic nature of the environment, the onboard sensing and reasoning requirements for obeying the navigational rules of the road, and the need for robust day/night hazard detection and avoidance. Development of full mission level autonomy entails addressing these challenges, coupled with inference of the tactical and strategic intent of possibly adversarial vehicles in the surrounding environment. This paper introduces PACIFIC (Process Algebra Capture of Intent From Information Content), an onboard system based on formal process algebras that is capable of extracting actions/activities from sensory inputs and reasoning within a mission context to ensure proper responses. PACIFIC is part of the Behavior Engine in CARACaS (Cognitive Architecture for Robotic Agent Command and Sensing), a system that is currently running on a number of U.S. Navy unmanned surface and underwater vehicles. Results from a series of experimental studies that demonstrate the effectiveness of the system are also presented.

process algebras↗

NASA NTRSDate not supplied

Discovery and Analysis of Rare High-Impact Failure Modes using Adversarial RL-Informed Sampling

Adaptive learning agents have tremendous potential to handle critical tasks currently performed by humans. Unfortunately, due to their complexity, it can be difficult to verify that these learning agents do not have critical failure modes. Standard verification and validation methods often do not apply directly to learning agents and Monte Carlo methods have difficulty covering even a small fraction of the state space, especially in multiagent systems or over long time horizons. To overcome this difficulty, we demonstrate an adaptive stress-testing method based on reinforcement learning of correlations that raise the probability of failure. This approach has three key properties: (1) it is able to find rare failure modes with far greater sample efficiency than Monte Carlo methods, (2) it can estimate the true probability of a failure mode despite the inherent bias in the learning method, and (3) it is capable of learning and resampling compact representations of multimodal failure spaces. These properties are important in practice as we need to find disparate failure modes while accounting for their actual relevance. This is a significant advantage over traditional adaptive stress testing methods that give abstract likelihoods of particular failure instances, but cannot estimate the probability of a broader failure mode. We test our algorithm on a simple problem from the aviation domain where an autonomous aircraft lands in gusty wind conditions. The results suggest that we can find failure modes with far fewer samples than the Monte Carlo approach and simultaneously estimate the probability of failure.

reinforcement learning↗

NASA NTRSDate not supplied

Discovery and Analysis of Rare High-Impact Failure Modes using Adversarial RL-Informed Sampling

Adaptive learning agents have tremendous potential to handle critical tasks currently performed by humans. Unfortunately, due to their complexity, it can be difficult to verify that these learning agents do not have critical failure modes. Standard verification and validation methods often do not apply directly to learning agents and Monte Carlo methods have difficulty covering even a small fraction of the state space, especially in multiagent systems or over long time horizons. To overcome this difficulty, we demonstrate an adaptive stress-testing method based on reinforcement learning of correlations that raise the probability of failure. This approach has three key properties: (1) it is able to find rare failure modes with far greater sample efficiency than Monte Carlo methods, (2) it can estimate the true probability of a failure mode despite the inherent bias in the learning method, and (3) it is capable of learning and resampling compact representations of multimodal failure spaces. These properties are important in practice as we need to find disparate failure modes while accounting for their actual relevance. This is a significant advantage over traditional adaptive stress testing methods that give abstract likelihoods of particular failure instances, but cannot estimate the probability of a broader failure mode. We test our algorithm on a simple problem from the aviation domain where an autonomous aircraft lands in gusty wind conditions. The results suggest that we can find failure modes with far fewer samples than the Monte Carlo approach and simultaneously estimate the probability of failure.

Validation↗

NASA NTRSDate not supplied

Discovery and Analysis of Rare High-Impact Failure Modes using Adversarial RL-Informed Sampling

Adaptive learning agents have tremendous potential to handle critical tasks currently performed by humans. Unfortunately, due to their complexity, it can be difficult to verify that these learning agents do not have critical failure modes. Standard verification and validation methods often do not apply directly to learning agents and Monte Carlo methods have difficulty covering even a small fraction of the state space, especially in multiagent systems or over long time horizons. To overcome this difficulty, we demonstrate an adaptive stress-testing method based on reinforcement learning of correlations that raise the probability of failure. This approach has three key properties: (1) it is able to find rare failure modes with far greater sample efficiency than Monte Carlo methods, (2) it can estimate the true probability of a failure mode despite the inherent bias in the learning method, and (3) it is capable of learning and resampling compact representations of multimodal failure spaces. These properties are important in practice as we need to find disparate failure modes while accounting for their actual relevance. This is a significant advantage over traditional adaptive stress testing methods that give abstract likelihoods of particular failure instances, but cannot estimate the probability of a broader failure mode. We test our algorithm on a simple problem from the aviation domain where an autonomous aircraft lands in gusty wind conditions. The results suggest that we can find failure modes with far fewer samples than the Monte Carlo approach and simultaneously estimate the probability of failure.

Validation↗

DOE OSTI2023

Two-Stage Deep Reinforcement Learning for Distribution System Voltage Regulation and Peak Load Management: Preprint

The growing integration of distributed solar photovoltaic (PV) in distribution systems could result in adverse effects during grid operation. This paper develops a soft actor critic-based deep reinforcement learning (SAC-DRL) solution to simultaneously control PV inverters and battery energy storage systems for voltage regulation and peak load demand shaving. The novel two-stage framework, featured with two different control agents, is applied for daytime and nighttime operation to enhance the control performance. Comparison results with other control methods on a real feeder in Western Colorado demonstrate that the proposed method can provide advanced voltage regulation with modest active power curtailment for peak demand reduction.

deep reinforcement learning↗

DOE OSTI2024

MURP: Multi-Agent Ultra-Wideband Relative Pose Estimation With Constrained Communications in 3D Environments

Not Available

3D Environment↗

NASA NTRS2010

Incorporation of alpha-Ketoglutaric Acid as a Fixed Bed Scrubber Media for the Neutralization of Hydrazine Family Hypergolic Fuels

A candidate scrubber media, alpha-ketoglutaric acid (aKGA) adsorbed onto a silica-based substrate was examined as a potential alternative to the hydrazine-family hypergolic fuel neutralization techniques currently utilized at NASA/Kennedy Space Center (KSC). Helvenson et. al. has indicated that aKGA will react with hydrazines to produce non-hazardous, possibly biodegradable products. Furthermore, the authors have previously tested and demonstrated the use of aKGA aqueous solutions as a replacement neutralizing agent for citric acid, which is currently used as a scrubbing agent in liquid scrubbers at KSC. Specific properties examined include reaction efficiency, the loading capacity of aKGA onto various silica substrates, and the comparison of aKGA media performance to that of the citric acid vapor scrubber systems at KSC and a commercial vapor scrubber media. Preliminary investigations showed hydrophobic aerogel particles to be an ideal substrate for the deposition of the aKGA. Current studies have shown that the laboratory produced aKGA-Aerogel absorbent media are more efficient and cost effective than a commercially available fixed bed scrubber media, although much less cost effective than liquid-based citric acid scrubbers (although possibly safer and less labor intensive). A comparison of all three alternative scrubber technologies (liquid aKGA, solid-phase aKGA, and commercially available sorbent materials) is given considering both hypergolic neutralization capabilities and relative costs (as compared to the current citric acid scrubbing technology in use at NASA/KSC).

DeVor, R. W.↗

NASA NTRS2019

The Shapeshifter: A Morphing, Multi-Agent, Multi-Modal Robotic Platform for the Exploration of Titan

In this report, we present a robotic platform, the Shapeshifter, that allows multi-domain and redundant mobility on Saturn's moon Titan - and potentially other bodies with atmospheres. The Shapeshifter is a collection of simple and a affordable robotic units, called Cobots, comparable to personal palm-size quadcopters. By attaching and detaching with each other, multiple Cobots can shape-shift into novel structures, capable of (a) rolling on a at surface, to increase the traverse range, (b) flying in a flight array formation, and (c) swimming on or under liquid. A ground station, called the Home-base, complements the robotic platform, hosting science instrumentation and providing power to recharge the batteries of the Cobots. Our Phase I study had the objective of providing an initial assessment of the feasibility of the proposed robotic platform architecture, and in particular (a) to characterize the expected science return of a mission to the Sotra-Patera region on Titan; (b) to verify the mechanical and algorithmic feasibility of building a multi-agent platform capable of flying, docking, rolling and un-docking; (c) to evaluate the increased range and efficiency of rolling on Titan w.r.t to flying; (d) to define a case-study of a mission for the exploration of the cryovolcano Sotra-Patera on Titan, whose expected variety of geological features challenges conventional mobility platforms.

Agha-mohammadi, Ali-akbar↗

DOE OSTI2020

A Strategy for Constructing Pore‐Space‐Partitioned MOFs with High Uptake Capacity for C 2 Hydrocarbons and CO 2

Abstract Introduction of pore partition agents into hexagonal channels of MIL‐88 type (acs topology) endows materials with high tunability in gas sorption. Here, we report a strategy to partition acs framework into pacs (partitioned acs) crystalline porous materials (CPM). This strategy is based on insertion of in situ synthesized 4,4′‐dipyridylsulfide (dps) ligands. One third of open metal sites in the acs net are retained in pacs MOFs; two thirds are used for pore‐space partition. The Co 2 V‐pacs MOFs exhibit near or at record high uptake capacities for C 2 H 2 , C 2 H 4 , C 2 H 6 , and CO 2 among MOFs. The storage capacity of C 2 H 2 is 234 cm 3 g −1 (298 K) and 330 cm 3 g −1 (273 K) at 1 atm for CPM‐733‐dps (the Co 2 V‐BDC form, BDC=1,4‐benzenedicarboxylate). These high uptake capacities are accomplished with low heat of adsorption, a feature desirable for low‐energy‐cost adsorbent regeneration. CPM‐733‐dps is stable and shows no loss of C 2 H 2 adsorption capacity following multiple adsorption–desorption cycles.

Wang, Yong↗

DOE OSTI2020

A Strategy for Constructing Pore-Space-Partitioned MOFs with High Uptake Capacity for C 2 Hydrocarbons and CO 2

Introduction of pore partition agents into hexagonal channels of MIL-88 type (acs topology) endows materials with high tunability in gas sorption. Here, we report a strategy to partition acs framework into pacs (partitioned acs) crystalline porous materials (CPM). This strategy is based on insertion of in situ synthesized 4, 4'-dipyridylsulfide (dps) ligands. As a result, one third of open metal sites in the parent acs net are retained in pacs MOFs, while two thirds are used for pore space partition. The newly synthesized Co 2 V-pacs MOFs, with optimized pore space and open metal sites, exhibit near or at record high uptake capacities for C 2 H 2 , C 2 H 4 , C 2 H 6 , and CO 2 among MOFs. For example, the storage capacity of C 2 H 2 is 234 cm 3 /g -1 (298 K) and 330 cm 3 /g -1 (273K) at 1 atm for CPM-733-dps (the Co 2 V-BDC form, BDC=1,4-benzenedicarboxylate), higher than benchmark MOFs such as MOF-74 and all other pacs members. These high uptake capacities are accomplished with low heat of adsorption, a feature desirable for low-energy-cost adsorbent regeneration. CPM-733-dps is stable and shows no loss of C 2 H 2 adsorption capacity following multiple adsorption–desorption cycles.

25 ENERGY STORAGE↗

DOE OSTI2020

A multi-physics constitutive model to predict hydrolytic aging in quasi-static behaviour of thin cross-linked polymers

The effect of hydrolytic aging on mechanical quasi-static responses of rubber-like materials, in particular, the idealized Mullins effect and permanent set have been modeled. The effect of hydrolytic damage on the mechanical integrity of the polymer matrix is modeled as the direct competition of two micro-structural phenomena (i) chain scission and (ii) reduction of cross-links. Both phenomena and their correlation were modeled and thus, the strain energy of the polymer matrix is written with respect to three independent mechanisms; i) the shrinking original matrix that has not been attacked by water, ii) conversion of the first network to a new network due to the reduction of the cross-links, and iii) energy loss from network degradation due to water attacks to polymer active agents. The proposed model satisfies the Clausius-Duhem inequality and is thus physically feasible. The model is validated with respect to sets of our experimental data and other sets available in the literature. The proposed model is based on the assumption of homogeneous diffusion and mainly relevant for thin samples. In view of its accuracy, interpret-ability, and deep insight it provides into the nature of damage accumulation, the model is a good choice for further implementation in FE applications.

42 ENGINEERING↗

DOE OSTI2020

Optically tunable mesoscale CdSe morphologies via inorganic phototropic growth

Inorganic phototropic growth using only spatially conformal illumination generated Se–Cd films that exhibited precise light-defined mesoscale morphologies including highly ordered, anisotropic, and periodic ridge and trench nanotextures over entire macroscopic substrates. Growth was accomplished via a light-induced electrochemical method using an optically and chemically isotropic solution, an unpatterned substrate, and unstructured, incoherent, low-intensity illumination in the absence of chemical directing agents or physical templates and masks. The morphologies were defined by the illumination inputs: the nanotexture long axes aligned parallel to the optical E-field vector, and the feature sizes and periods scaled with the wavelength. Optically based modeling of the growth closely reproduced the experimental results, confirming the film morphologies were fully determined by the light–matter interactions during growth. Solution processing of the Se–Cd films resulted in stoichiometric, crystalline CdSe films that also exhibited ordered nanotextures, demonstrating that inorganic phototropic growth can effect tunable, template-free generation of ordered CdSe nanostructures over macroscopic length scales.

36 MATERIALS SCIENCE↗

DOE OSTI2023

Data-Driven Affinely Adjustable Robust Volt/VAr Control

Recent years have seen the increasing proliferation of distributed energy resources with intermittent power outputs, posing new challenges to the voltage management in distribution networks. To this end, this paper proposes a data-driven affinely adjustable robust Volt/VAr control (AARVVC) scheme, which modulates the smart inverter’s reactive power in an affine function of its active power, based on the voltage sensitivities with respect to real/reactive power injections. To achieve a fast and accurate estimation of voltage sensitivities, we propose a data-driven method based on deep neural network (DNN), together with a rule-based bus-selection process using the bidirectional search method. Our method only uses the operating statuses of selected buses as inputs to DNN, thus significantly improving the training efficiency and reducing information redundancy. Finally, a distributed consensus-based solution, based on the alternating direction method of multipliers (ADMM), for the AARVVC is applied to decide the inverter’s reactive power adjustment rule with respect to its active power. Only limited information exchange is required between each local agent and the central agent to obtain the slope of the reactive power adjustment rule, and there is no need for the central agent to solve any (sub)optimization problems. Finally, numerical results on the modified IEEE-123 bus system validate the effectiveness and superiority of the proposed data-driven AARVVC method.

24 POWER TRANSMISSION AND DISTRIBUTION↗

NASA NTRS1973

The examination of urine samples for pathogenic microbes by the luciferase assay for ATP. 1: The effect of the presence of fungi, fungal like bacteria and kidney cells in urine samples

A method for accurately determining urinary tract infections in man is introduced. The method is based on adenosine triphosphate (ATP) concentration in urine samples after removing nonbacterial ATP. Adenosine triphosphate concentration is measured from the bioluminescent reaction of luciferase when mixed with ATP. An examination was also made of the effectiveness of rupturing agents on monkey kidney cells Candia albicans, a Rhodotorula species, and a Streptomyces species in determining whether these cells could contribute ATP to the bacterial ATP value of a urine sample.

Bush, V. N.↗

NASA NTRS1980

Comparative study of choleretic agents in anesthetized rats as well as in restrained and and unrestrained rats, with or without compensation for biliary loss

Tests were conducted on Wistar rats by using 3 control choleretic agents: 1-phenyl-1-hydroxy n-pentane, dehydrocholic acid, and phenyl-dimethylacetic acid. The effects of these agents were compared in different experimental conditions. The comparative study of choleretic agents in anesthetized rats, in restrained and unrestrained rats, with or without compensation for biliary loss by the biliary secretion of restrained or unrestrained rats does not show, in systematic pharmecodynamic investigations, an obvious superiority over the methods based on the simple technique.

Labrid, C.↗

DOE OSTI2020

Ultrathin, ternary alloy PtRuFe nanowires, and methods of making same

The present invention provides a method of producing ternary metal-based nanowire networks. The method comprises combining an aqueous mixture of a platinum hydrate, a ruthenium hydrate, and an iron hydrate with a solution of hexadecyltrimethylammonium bromide in chloroform to form an inverse micellar network; adding a reducing agent to reduce metal ions within the inverse micellar network; and isolating the nanowires. The relative amounts of the platinum, ruthenium and iron in the mixture correlate to the atomic ratio of the platinum, ruthenium and iron in the ternary nanowires. The diameters of the ternary nanowires are from about 0.5 nm to about 5 nm.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

DOE OSTI2024

Stabilizing a low temperature phase change material based on Glaubers salt

The aim of this research is to enhance the performance of Glauber's salt (sodium sulfate decahydrate, SSD) as a phase change material (PCM) for thermal energy storage applications, as well as for shipping of temperature-sensitive materials. The study investigates the effects of modifying SSD with potassium chloride (KCl) and ammonium chloride (NH 4 Cl) to achieve lower phase transition temperatures of between +6 °C and + 13 °C. Sodium polyacrylate (PAAS) is employed as a thickening agent to prevent phase separation, and borax is used as a nucleating agent to suppress supercooling. Various ratios of KCl:NH 4 Cl are tested, and the impact of PAAS concentration on phase segregation is explored. The results show that a 2 wt% concentration of PAAS effectively prevents phase separation. Samples with a KCl:NH 4 Cl ratio of 1:1.83 exhibit stable phase transition behavior and maintain latent heat values within the range of 130–140 J/g after 30 thermal cycles. Maintaining a total KCl and NH 4 Cl proportion of 10 wt% is crucial to achieve the desired lower melting temperature. As a result, the study highlights the significance of thermal cycling in improving the stability of the PCM. The optimized SSD-based eutectic PCM formulations hold promise for applications in the cold chain industry.

25 ENERGY STORAGE↗