Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “agent based”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33
All sourcesNASA NTRSDOE OSTI
NASA NTRS2017

Distributed Spatiotemporal Motion Planning for Spacecraft Swarms in Cluttered Environments

This paper focuses on trajectory planning for spacecraft swarms in cluttered environments, like debris fields or the asteroid belt. Our objective is to reconfigure the spacecraft swarm to a desired formation in a distributed manner while minimizing fuel and avoiding collisions among themselves and with the obstacles. In our prior work we proposed a novel distributed guidance algorithm for spacecraft swarms in static environments.1 In this paper, we present the Multi-Agent Moving-Obstacles Spherical Expansion and Sequential Convex Programming (MAMO SE–SCP) algorithm that extends our prior work to include spatiotemporal constraints such as time-varying, moving obstacles and desired time-varying terminal positions. In the MAMO SE–SCP algorithm, each agent uses a spherical-expansion-based sampling algorithm to cooperatively explore the time-varying environment, a distributed assignment algorithm to agree on the terminal position for each agent, and a sequential-convex-programming-based optimization step to compute the locally-optimal trajectories from the current location to the assigned time-varying terminal position while avoiding collision with other agent and the moving obstacles. Simulations results demonstrate that the proposed distributed algorithm can be used by a spacecraft swarm to achieve a time-varying, desired formation around an object of interest in a dynamic environment with many moving and tumbling obstacles.

Hadaegh, Fred Y.↗
NASA NTRS2001

Ontolology Negotiation Between Scientific Archives

This paper describes an approach to ontology negotiation between information agents. Ontologies are declarative (data driven) expressions of an agent's "world": the objects, operations, facts, and rules that constitute the logical space within which an agent performs. Ontology negotiation enables agents to cooperate in performing a task, even if they are based on different ontologies. 'Me process allows agents to discover ontology conflicts and then, though incremental interpretation, clarification, and explanation, establish a common basis for communicating with each other. The need for ontology negotiation stems from the proliferation of information sources and of agents with widely varying specialty expertise. The unmanageability of massive amounts of web-based information is already becoming apparent. It is starting to have an impact on professions that rely on distributed archived information. If the expansion continues at its present rate without an ontology negotiation process being introduced, there will soon be no way to ensure the accuracy and completeness of information that scientists obtain from sources other than their own experiments. Ontology negotiation is becoming increasingly recognized as a crucial element of scalable agent technology. This is because agents, by their very nature, are supposed to operate with a fair amount of autonomy and independence from their end-users. Part of this independence is the ability to enlist other agents for help in performing a task (such as locating information on the web). The agents enlisted for help may be "owned" by a different end-user or organization (such as a document archive), and there is no guarantee that they will use the same terminology or understand the same concepts (objects, operators, theorems, rules) as the recruiting agent. For NASA, the need for ontology negotiation arises at the boundaries between scientific disciplines. For example: modeling the effects of global warming might involve knowledge about imaging, climate analysis, ecology, demographics, industrial economics, and biology. The need for ontology negotiation also arises at the boundaries between scientific programs. For example, a Principal Investigator may want to use information from a previous mission to complement downloads from the instruments currently deployed.

Bailin, Sidney C.↗
NASA NTRS2002

Smart Aerospace eCommerce: Using Intelligent Agents in a NASA Mission Services Ordering Application

This paper describes how intelligent agent technology was successfully prototyped and then deployed in a smart eCommerce application for NASA. An intelligent software agent called the Intelligent Service Validation Agent (ISVA) was added to an existing web-based ordering application to validate complex orders for spacecraft mission services. This integration of intelligent agent technology with conventional web technology satisfies an immediate NASA need to reduce manual order processing costs. The ISVA agent checks orders for completeness, consistency, and correctness, and notifies users of detected problems. ISVA uses NASA business rules and a knowledge base of NASA services, and is implemented using the Java Expert System Shell (Jess), a fast rule-based inference engine. The paper discusses the design of the agent and knowledge base, and the prototyping and deployment approach. It also discusses future directions and other applications, and discusses lessons-learned that may help other projects make their aerospace eCommerce applications smarter.

Moleski, Walt↗
DOE OSTI2025

Autonomous alloy composition optimization using molecular dynamics guided by a large language model

Here, we present an autonomous materials discovery framework that couples a large language model (LLM) with molecular dynamics (MD) simulations to optimize Fe–Cr–Mn alloy compositions for tensile strength. Starting from six distinct compositions, the LLM operated as an intelligent agent, iteratively proposing changes based on prior simulation results and constraints. Over 50 iterations per case, the LLM adaptively explored the composition space, identifying high-strength regions, not easily accessible by conventional methods. The highest strength, 18.7 GPa, was achieved with Fe 71 Cr 25 Mn 4 composition, identified from a Fe 75 Cr 20 Mn 5 starting point. The LLM autonomously adjusted its strategy in real time, demonstrating closed-loop decision-making using commodity hardware. This approach showcases the potential of LLMs as scientific co-pilots, capable of accelerating materials discovery and generalizable to other domains like biology and drug design.

Autonomy↗
DOE OSTI2023

Analysis of Building Model Forecasts using Autonomous HVAC Optimization System for Residential Neighborhood

Heating, ventilation, and air conditioning (HVAC) systems account for the highest share of home energy consumption in the United States. Optimized HVAC control can provide thermal improved comfort to the occupants, improve energy efficiency, reduce energy cost, and support grid services. In this paper, we discuss a multi-agent and cloud-based software framework that has been deployed in occupied residential neighborhood. This system enables automatic data collection, learning, optimization, and dispatches signals to neighborhood devices. HVAC optimization is based on model predictive control (MPC). Since the operational performance of MPC depends on model forecasting accuracy, it is crucial to evaluate the model continuously and modify or retrain it as necessary. In this research, we developed an automated workflow to evaluate the performance of temperature and power forecasts based on measured data in the real world. This will provide researchers with a deeper understanding of the model and how it can be improved.

Lebakula, Viswadeep↗
DOE OSTI2023

Near-Optimal Distributed Linear-Quadratic Regulator for Networked Systems

This paper studies the trade-off between the degree of decentralization and the performance of a distributed controller in a linear-quadratic control setting. We study a system of interconnected agents over a graph and a distributed controller, called k-distributed control, which lets the agents make control decisions based on the state information within distance k on the underlying graph. This controller can tune its degree of decentralization using the parameter k and thus allows a characterization of the relationship between decentralization and performance. We show that under mild assumptions, including stabilizability, detectability, and a subexponentially growing graph condition, the performance difference between k-distributed control and centralized optimal control becomes exponentially small in k. Finally, this result reveals that distributed control can achieve near-optimal performance with a moderate degree of decentralization, and thus it is an effective controller architecture for large-scale networked systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Deep Reinforcement Learning for Autonomous Water Heater Control

Electric water heaters represent 14% of the electricity consumption in residential buildings. An average household in the United States (U.S.) spends about USD 400–600 (0.45 ¢/L–0.68 ¢/L) on water heating every year. In this context, water heaters are often considered as a valuable asset for Demand Response (DR) and building energy management system (BEMS) applications. To this end, this study proposes a model-free deep reinforcement learning (RL) approach that aims to minimize the electricity cost of a water heater under a time-of-use (TOU) electricity pricing policy by only using standard DR commands. In this approach, a set of RL agents, with different look ahead periods, were trained using the deep Q-networks (DQN) algorithm and their performance was tested on an unseen pair of price and hot water usage profiles. The testing results showed that the RL agents can help save electricity cost in the range of 19% to 35% compared to the baseline operation without causing any discomfort to end users. Additionally, the RL agents outperformed rule-based and model predictive control (MPC)-based controllers and achieved comparable performance to optimization-based control.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
NASA NTRS1992

The achievement of spacecraft autonomy through the thematic application of multiple cooperating intelligent agents

A description is given of UNICORN, a prototype system developed for the purpose of investigating artificial intelligence (AI) concepts supporting spacecraft autonomy. UNICORN employs thematic reasoning, of the type first described by Rodger Schank of Northwestern University, to allow the context-sensitive control of multiple intelligent agents within a blackboard based environment. In its domain of application, UNICORN demonstrates the ability to reason teleologically with focused knowledge. Also presented are some of the lessons learned as a result of this effort. These lessons apply to any effort wherein system level autonomy is the objective.

Rossomando, Philip J.↗
NASA NTRS1996

Fuzzy Q-Learning for Generalization of Reinforcement Learning

Fuzzy Q-Learning, introduced earlier by the author, is an extension of Q-Learning into fuzzy environments. GARIC is a methodology for fuzzy reinforcement learning. In this paper, we introduce GARIC-Q, a new method for doing incremental Dynamic Programming using a society of intelligent agents which are controlled at the top level by Fuzzy Q-Learning and at the local level, each agent learns and operates based on GARIC. GARIC-Q improves the speed and applicability of Fuzzy Q-Learning through generalization of input space by using fuzzy rules and bridges the gap between Q-Learning and rule based intelligent systems.

Berenji, Hamid R.↗
NASA NTRS2014

Potential of Pest and Host Phenological Data in the Attribution of Regional Forest Disturbance Detection Maps According to Causal Agent

Near real time forest disturbance detection maps from MODIS NDVI phenology data have been produced since 2010 for the conterminous U.S., as part of the on-line ForWarn national forest threat early warning system. The latter has been used by the forest health community to identify and track many regional forest disturbances caused by multiple biotic and abiotic damage agents. Attribution of causal agents for detected disturbances has been a goal since project initiation in 2006. Combined with detailed cover type maps, geospatial pest phenology data offer a potential means for narrowing the candidate causal agents responsible for a given biotic disturbance. U.S. Aerial Detection Surveys (ADS) employ such phenology data. Historic ADS products provide general locational data on recent insect-induced forest type specific disturbances that may help in determining candidate causal agents for MODIS-based disturbance maps, especially when combined with other historic geospatial disturbance data (e.g., wildfire burn scars and drought maps). Historic ADS disturbance detection polygons can show severe and extensive regional forest disturbances, though they also can show polygons with sparsely scattered or infrequent disturbances. Examples will be discussed that use various historic disturbance data to help determine potential causes of MODIS-detected regional forest disturbance anomalies.

Spruce, Joseph↗
NASA NTRS2015

Thermochemistry of Rare Earth Silicates for Environmental Barrier Coatings

Rare earth silicates are promising candidates as environmental protective coatings (EBCs) for silica-forming ceramics and composites in combustion environments since they are predicted to have lower reactivity with the water vapor combustion products. The reactivity of rare earth silicates is assessed by the thermodynamic activity of the silica component which is best measured by Knudsen effusion mass spectrometry (KEMS). Here, we discuss a novel method based on a reducing agent to increase the partial pressure of SiO(g) which is then used to calculate thermodynamic activity of silica in Y2O3-SiO2 and Yb2O3-SiO2 systems. After the KEMS measurements, samples were probed by X-ray diffraction and their phase content was calculated from Rietveld refinement.

Rare Earth Silicates↗
NASA NTRS2018

Design and Development of a Laboratory-Scale Ice Adhesion Testing Device

When an aircraft traverses through clouds containing supercooled water droplets, in-flight icing can occur that negatively affects vehicle performance by increasing weight and drag leading to loss of lift. Super-cooled water droplets present in clouds that impact vehicle surfaces can lead to inflight icing any time during the year.1 Most events occur at temperatures ranging from 0 to -20degC. Ice generated on the aircraft can vary between clear/glaze, rime, and mixed (Fig. 1) depending on air temperature (-5 to -20degC), liquid water content (0.3-0.6 g/m3), and droplet size (median volumetric diameter of 15-40 μm). Current strategies to remove ice are based on active technologies such as pneumatic boots, heated surfaces, and deicing agents (i.e., ethylene- and propylene-based glycols). The latter have potential environmental concerns. A passive approach to mitigate accreting ice that is actively being investigated are protective coatings. An ice mitigating coating could potentially be used as a stand-alone material, but more likely in combination with an active approach. In the latter scenario, potential reduction in power consumption by the active approach may be realized. To determine the ice adhesion strength of impact ice that is representative of the aircraft environment is not a trivial matter. Test methods utilizing slowly formed ice (i.e., freezer ice) do not accurately simulate this environment. Likewise, some testing methodologies involve sample relocation from the icing environment to the test chamber that can result in thermal shock to the sample, thus affecting the results. The Adverse Environment Rotor Test Stand (AERTS) located at Pennsylvania State University (PSU) has been demonstrated to simulate impact icing conditions within the icing envelope for the determination of ice adhesion shear strength (IASS) without removal/relocation of the sample.2 Due to the confidence in results obtained from AERTS, this instrument is in high demand and requires a significant amount of lead time and capital investment to obtain IASS results. As a solution for quickly and economically screening coatings in a controlled manner under impact icing conditions, a laboratory-scale ice adhesion test and dead blades were then removed from the rotor/blade assembly to obtain the final mass. The IASS of the live blade was determined from the difference in mass (before and after testing) of the live and dead blades, the ice shed area, and the rpm of the shed event. The same live blade sample was tested in triplicate at all three test temperatures. Surface roughness was determined using a Bruker Dektak XT Stylus Profilometer. Measurements were conducted using a 12.5 μm tip at a vertical range of 65.5 μm with an applied force of 3 mg. Data were collected over a 1.0 mm length at a resolution of 0.056 μm/point. Five single line scans at different locations were collected and processed using a two-point leveling subtraction. The resultant Ra (arithmetic roughness) and Rq (root mean square roughness) average values were calculated.

Smith, Joseph G., Jr.↗
NASA NTRSDate not supplied

A Framework for Sense and Follow Convoys for Collective Autonomous Mobility

Convoys are collections of vehicles that share similar velocity profiles. In the sense-and follow convoy construct, a vehicle can follow a member of an existing convoy resulting in convoy chaining. We prove conditions under which this can occur such that the resulting convoy chain is bounded and the velocities of all members converge to the leader velocity through locally distributed control algorithms. To assess the approach, we utilize a six degree-of-freedom rigid body vehicle dynamics model for each agent. A dynamic inversion based control law is used to track the desired trajectory generated by the convoy algorithms. To simulate the system, we utilize Unity, a cross-platform game engine, where 3-dimensional terrain, building, and vehicle data can be visualized. Numerous simulations are presented to illustrate the concept.

convoys↗
NASA NTRSDate not supplied

A Framework for Sense and Follow Convoys for Collective Autonomous Mobility

Convoys are collections of vehicles that share similar velocity profiles. In the sense-and follow convoy construct, a vehicle can follow a member of an existing convoy resulting in convoy chaining. We prove conditions under which this can occur such that the resulting convoy chain is bounded and the velocities of all members converge to the leader velocity through locally distributed control algorithms. To assess the approach, we utilize a six degree-of-freedom rigid body vehicle dynamics model for each agent. A dynamic inversion based control law is used to track the desired trajectory generated by the convoy algorithms. To simulate the system, we utilize Unity, a cross-platform game engine, where 3-dimensional terrain, building, and vehicle data can be visualized. Numerous simulations are presented to illustrate the concept. Link to video file below:

convoys↗
DOE OSTI2020

Halogen-free electrolytes for magnesium batteries

An electrochemical cell includes a high voltage cathode configured to operate at 1.5 volts or greater, an anode including Mg0, and an electrolyte including an at least one organic solvent, at least one magnesium salt, and at least one additive agent including a Lewis base, wherein the electrolyte is halogen-free.

25 ENERGY STORAGE↗
DOE OSTI2020

Development and Validation of a Simulation Testbed for the Intelligent Building Agents Laboratory (IBAL) Using TRNSYS

This paper documents the development and validation of a dynamic primary cooling and thermal storage system simulation testbed. The system simulation testbed, sIBAL, is based on the Intelligent Building Agents Laboratory (IBAL) at the National Institute of Standards and Technology (NIST), which is a research infrastructure and testbed for the development, evaluation, and demonstration of intelligent control algorithms. The sIBAL testbed developed in this project will serve as a virtual twin of the real facility for future control algorithm development. The details of the methodologies used to develop and validate the simulation testbed, which replicates the dynamic behaviors of the primary cooling and ice storage system in the IBAL facility, are presented. The simulation testbed was developed in TRNSYS using built-in component models and MATLAB functions to replicate the two water-cooled chillers, a thermal storage tank, pumps, valves and other components for four different operation modes. Experiments on IBAL components were designed and executed to generate experimental data for model development and verification of the simulation platform. The validation of the simulation results was carried out in two phases: 1) independent component simulations for the chillers and thermal storage tank, and 2) a combined testbed simulation of the entire hydronic system. Comparison of simulation results to the experimental data obtained from the IBAL facility showed errors within 1 °C for the temperatures outputs of both the chiller and the thermal storage model. The error is within an acceptable range for further intelligent control algorithms development. The findings from the study are summarized and presented along with areas where additional research is needed. In addition, data filtering procedures and model refinement measures utilized to improve the accuracy and accelerate the computation time of the simulation are presented.

cooling systems↗
DOE OSTI2024

Electrodeposition of Tungsten using Hydrotropic Agents

The current work sought to electrodeposit tungsten from water-based solutions. The work’s initial hypothesis was that methoxide reducing agents could be used to generate urea anions that could enable tungsten electrodeposition. Unfortunately, this hypothesis was found to be incorrect. However, the work led to the understanding that chemical reducing agents not only enable the electrodeposition of refractory metals like rhenium from water-based solutions, but that the key to plating tungsten in the future involves chemical reduction followed by stabilization with proper ligands. The work resulted in a manuscript under review at Inorganic Chemistry Communications on the discovered of L-histidine as a suitable reducing agent from rhenium electrodeposition. Rhenium-tungsten alloys with 4% tungsten were deposited. A technical advance was filed for the rhenium chemistry and parts were delivered to an internal Sandia customer that used the chemistry.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗