Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “interacting agent systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Mitigation of Silver Ion Loss from Solution by Polymer Coating of Metal Surfaces, Part IV

“Spacecraft potable water systems require a biocidal agent that effectively provides both immediate and residual disinfection over long periods of time. Ionic silver (Ag+) is a leading candidate for this application, but suffers from rapid concentration loss due to interactions with the metallic storage containers and tubing. In order to maintain biocidal efficacy in systems with long periods of dormancy and to reduce the required rate of Ag+ injection, it is necessary to develop alternative materials and coatings for certified metal alloys that significantly reduce the Ag+ loss.” In previous reports, we have described our investigations addressing Ag+ loss mitigation and adhesion performance of parylene barrier coatings on coupons of several metal alloys and 316L tubing under static immersion. In such conditions, parylene-C and AF4 coatings have shown excellent Ag+ loss mitigation performance, and mixed long-term adhesion performance, depending on parylene species and substrate surface chemistry/structure. In Part IV of this series, we begin to address the performance of parylene-C barrier coatings under more challenging and realistic conditions, in order to evaluate potential suitability in flight systems. Using two testbeds, we characterized coating performance under dynamic mechanical operation. In the Flow/Pressure Testbed System, Ag+ solution is pumped through internally coated 316L tubing, with optional pressure cycling. In the Bellows Tank Testbed System, an internally coated edge-welded 316L bellows containing Ag+ solution is cyclically extended and compressed, analogous to the operation of bellows tanks used for potable water storage and delivery on the International Space Station. Periodic determinations of Ag+ loss with testbed cycling/time and visual observation of the parylene-C coatings were conducted. In addition, we characterized parylene-C coating resilience and Ag+ loss with 316L tubing and multiple fitting types under long-term immersion and repeated fitting dis/reassembly.

Lance Dean Delzeit↗
NASA NTRS2015

Collaborating with Autonomous Agents

With the anticipated increase of small unmanned aircraft systems (sUAS) entering into the National Airspace System, it is highly likely that vehicle operators will be teaming with fleets of small autonomous vehicles. The small vehicles may consist of sUAS, which are 55 pounds or less that typically will y at altitudes 400 feet and below, and small ground vehicles typically operating in buildings or defined small campuses. Typically, the vehicle operators are not concerned with manual control of the vehicle; instead they are concerned with the overall mission. In order for this vision of high-level mission operators working with fleets of vehicles to come to fruition, many human factors related challenges must be investigated and solved. First, the interface between the human operator and the autonomous agent must be at a level that the operator needs and the agents can understand. This paper details the natural language human factors e orts that NASA Langley's Autonomy Incubator is focusing on. In particular these e orts focus on allowing the operator to interact with the system using speech and gestures rather than a mouse and keyboard. With this ability of the system to understand both speech and gestures, operators not familiar with the vehicle dynamics will be able to easily plan, initiate, and change missions using a language familiar to them rather than having to learn and converse in the vehicle's language. This will foster better teaming between the operator and the autonomous agent which will help lower workload, increase situation awareness, and improve performance of the system as a whole.

Trujillo, Anna C.↗
DOE OSTI2024

The Transactive Energy Network Template Metamodel

While transactive energy, which is defined as an allocation of electricity based on dynamically discovered values or prices, has been extensively studied, its uptake and use has been slow. This report describes a tool, the transactive network template, which should hasten the creation and uptake of transactive energy networks. Some basic principles of transactive energy are familiar from existing wholesale electricity markets. Locational prices are calculated today for zones within bulk electric transmission systems. Locational prices differ while accounting for the locational costs of electricity generation and the losses and constraints incurred when electricity is transmitted from generators and distributed to consumers. A transactive energy network might include these transmission zones. However, current research strives to apply transactive energy also in electricity distribution circuits, buildings, and even for individual generating and consuming devices. At the same time, researchers explore how to apply transactive energy in real time during increasingly shorter time intervals. Automated computational agents become necessary as transactive energy becomes applied to smaller circuit zones and at faster dynamic timescales. A transactive energy network is an example of a multi-agent system. Each zone in the network is represented by its transactive agent, which makes decisions for and acts on behalf of a business entity that is responsible for and manages one of the circuit regions. A transactive energy network is also an example of a decentralized, distributed control system. Control decisions and responsibilities are distributed among the network’s transactive agents. The transactive agents are independent; that is, there typically is no centralized authority or oversight function. Instead, transactive agents exchange transactive signals and thereby negotiate the prices and quantities of electricity that they will exchange. Initially, the circuit regions and responsibilities of transactive agents appear to be very dissimilar. Each circuit region may comprise transmission, distribution, or building-level circuits. Each has a unique position and electrical connectivity within the transactive energy network. Each possesses unique assets that either generate or consume electricity, and these (e.g., renewable energy generator, diesel generator, aggregate utility load, building load, space conditioning, refrigerator, etc.) may further differ in their price flexibility and in their strategies for responding to dynamic electricity prices. Given such diversity, an implementer’s first inclination might be to start from scratch to define all these devices and to engineer their seemingly unique interactions. Given that each implementer’s perspective may be narrow within a transactive energy network, it is unlikely that uniquely engineered systems would interact well. This is where the transactive network template is applicable. The transactive network template is a metamodel that has been developed to guide implementers as they configure their own transactive agent within a network of such agents. The object-oriented design of the transactive network template provides basic code object types that may be used and extended by implementers to represent each of the assets in their circuit region. These objects further facilitate the transactive agent’s necessary computations, which are divided among responsibilities to schedule power usage, balance electric supply and demand, and coordinate the exchange of electricity with the other transactive agents. This report addresses the conceptual transactive network template design. Implementers are directed to more formal design documents and reference implementations. A Python™-based1 reference implementation of the transactive network template has been coded, and three implementations have been configured to represent a national laboratory and two university campuses. Version 2 of the transactive node template generalizes the market class and its methods to facilitate multiple, and more diverse market coordination mechanisms than were facilitated by and demonstrated using Version 1. Version 3 includes new Appendix B, which addresses the designs of methods that would make dynamic prices track approved electricity rates. In the future, the author wishes to make the transactive network template more generally applicable to networks that require more accurate power flow. Development of the transactive network template is jointly funded by the U.S. Department of Energy (DOE) Energy Efficiency and Renewable Energy and the DOE Office of Electricity. In late 2015, one of the first projects to be funded by the DOE Grid Laboratory Modernization Laboratory Consortium was the Clean Energy and Transactive Campus project, led by Pacific Northwest National Laboratory. DOE funds were matched by an investment by the Washington Department of Commerce through its Clean Energy Fund. The transactive network template was developed to guide the implementation of transactive energy networks within this project’s scope.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS2006

Model-Unified Planning and Execution for Distributed Autonomous System Control

The Intelligent Distributed Execution Architecture (IDEA) is a real-time architecture that exploits artificial intelligence planning as the core reasoning engine for interacting autonomous agents. Rather than enforcing separate deliberation and execution layers, IDEA unifies them under a single planning technology. Deliberative and reactive planners reason about and act according to a single representation of the past, present and future domain state. The domain state behaves the rules dictated by a declarative model of the subsystem to be controlled, internal processes of the IDEA controller, and interactions with other agents. We present IDEA concepts - modeling, the IDEA core architecture, the unification of deliberation and reaction under planning - and illustrate its use in a simple example. Finally, we present several real-world applications of IDEA, and compare IDEA to other high-level control approaches.

Aschwanden, Pascal↗
DOE OSTI2025

Reinforcement Learning Control for Buildings Co-Optimizing Energy, Comfort, and Indoor Air Quality: An Annual Assessment

Efficient control of Heating, Ventilation, and Air Conditioning (HVAC) systems is crucial for optimizing energy use and maintaining indoor comfort in buildings. Traditional control methods, such as PID control, cannot handle energy use trade-offs among multiple components in the building energy system at a supervisory level. Reinforcement learning (RL) presents a promising solution, offering adaptive and data-driven control strategies that optimize performance over time. However, RL also faces several challenges, including the conflicts encountered in co-optimizing energy savings, occupant comfort, and indoor air quality, and the requirement for extensive interactions with the environment in training. We proposed a flexible simulation platform that integrates a hybrid model for RL training and designed an RL agent to control the entire central HVAC system, focusing on co-optimizing energy consumption, thermal comfort, and indoor air quality ($\text{CO}_{2}$ and PM2.5 concentrations). Finally, we evaluated the RL agent's performance over an annual cycle. Our findings indicate that the RL agent can effectively manage the HVAC system with 14.7 % energy savings annually and balance multiple objectives, which demonstrates significant potential for improving HVAC system control and sustainability in buildings.

Guo, Fangzhou↗
NASA NTRS2004

Activity-Centric Approach to Distributed Programming

The first phase of an effort to develop a NASA version of the Cybele software system has been completed. To give meaning to even a highly abbreviated summary of the modifications to be embodied in the NASA version, it is necessary to present the following background information on Cybele: Cybele is a proprietary software infrastructure for use by programmers in developing agent-based application programs [complex application programs that contain autonomous, interacting components (agents)]. Cybele provides support for event handling from multiple sources, multithreading, concurrency control, migration, and load balancing. A Cybele agent follows a programming paradigm, called activity-centric programming, that enables an abstraction over system-level thread mechanisms. Activity centric programming relieves application programmers of the complex tasks of thread management, concurrency control, and event management. In order to provide such functionality, activity-centric programming demands support of other layers of software. This concludes the background information. In the first phase of the present development, a new architecture for Cybele was defined. In this architecture, Cybele follows a modular service-based approach to coupling of the programming and service layers of software architecture. In a service-based approach, the functionalities supported by activity-centric programming are apportioned, according to their characteristics, among several groups called services. A well-defined interface among all such services serves as a path that facilitates the maintenance and enhancement of such services without adverse effect on the whole software framework. The activity-centric application-program interface (API) is part of a kernel. The kernel API calls the services by use of their published interface. This approach makes it possible for any application code written exclusively under the API to be portable for any configuration of Cybele.

Levy, Renato↗
DOE OSTI2024

Uncertainty characterization in a coupled human-natural system: Modeling agricultural adaptation in the Great Lakes Region

The Great Lakes Region's water quality and ecological health are threatened by the export of nutrients from agricultural lands, which causes eutrophication, hypoxia, and destructive algal blooms. The intensification of hydrologic cycles brought about by climate change is expected to exacerbate nutrient loading in the region, and, at the same time, agricultural adaptation to changing conditions is also expected to affect loading through shifting amounts and timing of fertilization. Quantifying these future effects and their interactions necessitates modeling both the human and natural processes as a coupled system, by pairing land use and agricultural management with hydrologic modeling. At the same time, compounding uncertainties arising from the complex interactions in both systems significantly limit our predictive understanding of the region's impacts. This study utilizes the Soil and Water Assessment Tool (SWAT), developed for simulating the impact of various farmer decisions on watershed functions in Western Lake Erie watersheds, and an under-development agent-based model (ABM) for agricultural management decisions. The aim of this study is to use global sensitivity analysis on the coupled ABM and SWAT models to quantify how uncertainty in both models interactively affects nutrient loading. To do so, we will conduct Sobol sensitivity analysis experiments at different levels of coupling assumptions to quantify how various uncertain factors (e.g., soil moisture and crop choice) and their interactions affect our estimates of nutrient loading. The results of this analysis will allow us to quantify how complex interactions and dependencies between both systems amplify the effect of uncertainties. Insights gained from this study will have broader implications for modeling the adaptive co-evolution of human and natural systems under climate change and can inform effective management of nutrient loading in the Great Lakes Region.

Climate Change↗
DOE OSTI2021

A framework for integrated dispatching and charging management of an autonomous electric vehicle ride-hailing fleet

The convergence of electrification and automated driving will introduce opportunities to improve the operation and energy-efficiency of transportation systems. This paper discusses the challenges of dispatching autonomous electric vehicles (AEVs) in a ride-hailing fleet and their interactions with charging infrastructure. An integrated decision-making framework for dispatching and charging has been proposed using system optimization approaches. An agent-based platform has been developed for simulating and testing the proposed methods. A case study using New York City taxi data has been performed with different fleet sizes, dispatching strategies, and charging networks. Advantages of optimization-based approaches for AEV fleet management have been studied and demonstrated, for example, for a fleet of 1,750 AEVs to meet 100,000 daily requests, optimization-based centralized fleet management would result in 14% more ride requests satisfied and 43% fewer zero-occupancy miles traveled than if AEVs make independent decisions based on heuristic strategy. Benefits on reducing fleet size and charging downtime from optimization approaches are also comprehensively illustrated.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
NASA NTRS2023

Multiscale Hybrid Modeling of the Impact Response of the Earth's Magnetotail to Ionospheric O+ Outflow

Ionospheric outflow plays an important role in coupling the ionosphere with the solar wind-magnetosphere system. Previous multi-fluid MHD studies explored the global influence of oxygen ions of ionospheric origin (O+) on magnetospheric dynamics. A detailed exploration of the interaction of ionospheric ions with the magnetotail requires kinetic treatment for ions. We perform a self-consistent investigation of these processes with a three-dimensional space-time adaptive hybrid code, HYPERS, powered by an intelligent Event-driven Multi-Agent Planning System (EMAPS). By comparing simulations with and without outflow we conclude that oxygen ions, flowing from the ionosphere through the lobes into the tail or directly entering the inner magnetosphere, are able to significantly modify the magnetotail configuration and induce X-points and current sheet structures at locations where magnetic reconnection does not occur in a simulation without outflow, potentially very close to the Earth. This finding may have implications for interpreting substorms and magnetotail reconnection events observed for southward magnetic field simultaneously with significant contents of oxygen ions of ionospheric origin.

multiscale↗
DOE OSTI2021

Hybrid Imitation Learning for Real-Time Service Restoration in Resilient Distribution Systems

Self-healing capability is a critical factor for a resilient distribution system, which requires intelligent agents to automatically perform service restoration online, including network reconfiguration and reactive power dispatch. Here, the article proposes the imitation learning framework for training such an agent, where the agent will interact with an expert built based on the mixed-integer program to learn its optimal policy, and therefore significantly improve the training efficiency compared with exploration-dominant reinforcement learning (RL) methods. This significantly improved training efficiency makes the training problem under N-k scenarios tractable. A hybrid policy network is proposed to handle tie-line operations and reactive power dispatch simultaneously to further improve the restoration performance. The 33-bus and 119-bus systems with N-k disturbances are employed to conduct the training. The results indicate that the proposed method outperforms traditional RL algorithms such as the deep-Q network.

42 ENGINEERING↗
NASA NTRS2019

Extratropical Large-Scale Traveling Weather Systems in the Southern Hemisphere on Mars

From late-autumn through early-spring, the middle- and high-latitudes of both hemispheres of Mars and its predominantly carbon-dioxide atmosphere support mean equator-to-pole thermal contrasts, and then, support a strong mean westerly polar vortex. Observations from orbiting spacecraft indicate that this intense mean baroclinicity-barotropicity supports large-scale eastward traveling weather systems (i.e., transient, traveling synoptic-period waves, on the order of the Rossby deformation scale). On Earth, extratropical weather disturbances arise from wind-shear instabilities, and these are critical components of the terrestrial global circulation. So it is the case for Mars. Large-scale traveling weather systems on Mars serve as agents in the transport of heat, momentum and scalar and tracer quantities (e.g., atmospheric dust, watervapor, ice clouds, chemical species, etc). Such weather systems interact with other large-scale atmospheric circulation components, namely, quasi-stationary (i.e., forced Rossby) modes; global thermal tidal modes; and then, upon large-/continental- geographical scales, upslope/ down-slope flows amongst high relief, low relief, impact basins, and volcanic rises, and more. The character of Mars' traveling extratropical weather disturbances in its southern hemisphere during late winter through early spring is investigated using a high-resolution Mars global climate model (i.e., Mars GCM), and one from the Agency's Mars Climate Modeling Center (MCMC) based at the NASA Ames Research Center. The climate model includes several complex atmospheric physical packages. With such physics modules, our global climate simulations present comparatively well with observations of the planet's current water cycle (Haberle et al.,2019). The climate model is "forced" with an annual dust cycle (i.e., nudged based on MGS/TES observations). Compared to the northern-hemisphere counterparts, the southern synoptic-period weather disturbances and accompanying frontal waves have smaller meridional and zonal scales, and are less intense. Influences of the zonally asymmetric (i.e., east-west varying) topography on southern large-scale weather are investigated, in addition to large-scale up-slope/down-slope flows and the diurnal cycle. A southern storm zone in late winter and early spring presents in the western hemisphere via orographic influences from the Tharsis highlands, and the Argyre and Hellas impact basins. Geographically localized transient-wave activity diagnostics are constructed that illuminate dynamical differences amongst the simulations and these are presented.

Hollingsworth, Jeffery L.↗
NASA NTRS2017

Concepts for the Design of Human-Autonomy Systems

Over the last two years a number of workshops or similar meetings have been held under the auspice of NASA Ames Research Center that, although dealing with different primary foci, considered at some level the cross-cutting topic of humans-autonomous systems and the partnership between them. This publication presents findings from the reports of these meetings as they inform the process of designing autonomous systems to work in conjunction with humans. Some workshops were highly relevant to this question, others less so. Drawing from conclusions in these reports, this publication presents, at a high level, a summary of issues that could usefully be considered in the design process of automated systems working with human agents. Although differing in emphases, reports from the several workshops reflect many similar beliefs regarding human-autonomy teaming (HAT). Conclusions can be viewed as generally applicable to various aviation venues—air, ground, and air-ground interactions. The objective of the workshops was primarily to identify issues, concerns, and research needs associated with evolving human-autonomy systems—not in providing solutions. The analysis herewithin is generally limited to the findings in the workshop reports. And, since there was often commonality in findings among the several reports, no attempt is made to ascribe particular findings or observations to particular reports.

autonomy↗
DOE OSTI2024

Distribution Grid Incentive Design with Unknown Agent Behavior

Motivation: During extreme events, traditional grid regulation methods (e.g., energy prices, net power injection limits) may be insufficient. While system operators typically lack control over end-user grid interactions, (e.g., energy demand), incentives can influence behavior - for example, a user that receives a grid-driven incentive may adjust their consumption or expose relevant control variables in response. Problem: Optimize for the best incentive subject to system stability constraints. However, user behavior is unknown to the SO - i.e., for a given incentive, the amount of curtailed load or control variables exposed is unknown.

feedback based control↗
NASA NTRS2024

Enhancing Metal Additive Manufacturing Training with the Advanced Vision Language Model: A Pathway to Immersive Augmented Reality Training for Non-Experts

This paper introduces an innovative training system for the Renishaw AM400 metal printer, leveraging the synergy of the advanced Vision Language Model (VLM) with Augmented Reality (AR) within the Digital Twins (DT) framework. Aimed at overcoming the limitations of conventional training methods in metal additive manufacturing (AM), our system integrates AR to provide an immersive learning environment, enhancing the real-world experience with interactive digital overlays. The core of the system lies in its use of VLM, which, pre-trained on diverse datasets, excels in processing multi-modal data, thereby offering nuanced and contextually relevant guidance for trainees. Key experiments demonstrate the system’s effectiveness, particularly highlighting the usage of VLM as an Artificial Intelligence (AI) agent to integrate external tools like YOLO-v7 for valve state classification and CRAFT for control panel text recognition. This approach significantly improves recognition accuracy, operational understanding, and human–machine interaction, especially for non-expert users, making complex metal AM operations more accessible. The research not only showcases the potential of AR and VLM in industrial training but also sets a new standard for smart manufacturing practices, indicating broader applications in various industrial domains.

Metal additive manufacturing↗
DOE OSTI2022

Variational multiscale reinforcement learning for discovering reduced order closure models of nonlinear spatiotemporal transport systems

Abstract A central challenge in the computational modeling and simulation of a multitude of science applications is to achieve robust and accurate closures for their coarse-grained representations due to underlying highly nonlinear multiscale interactions. These closure models are common in many nonlinear spatiotemporal systems to account for losses due to reduced order representations, including many transport phenomena in fluids. Previous data-driven closure modeling efforts have mostly focused on supervised learning approaches using high fidelity simulation data. On the other hand, reinforcement learning (RL) is a powerful yet relatively uncharted method in spatiotemporally extended systems. In this study, we put forth a modular dynamic closure modeling and discovery framework to stabilize the Galerkin projection based reduced order models that may arise in many nonlinear spatiotemporal dynamical systems with quadratic nonlinearity. However, a key element in creating a robust RL agent is to introduce a feasible reward function, which can be constituted of any difference metrics between the RL model and high fidelity simulation data. First, we introduce a multi-modal RL to discover mode-dependant closure policies that utilize the high fidelity data in rewarding our RL agent. We then formulate a variational multiscale RL (VMRL) approach to discover closure models without requiring access to the high fidelity data in designing the reward function. Specifically, our chief innovation is to leverage variational multiscale formalism to quantify the difference between modal interactions in Galerkin systems. Our results in simulating the viscous Burgers equation indicate that the proposed VMRL method leads to robust and accurate closure parameterizations, and it may potentially be used to discover scale-aware closure models for complex dynamical systems.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2013

Unified Simulation and Analysis Framework for Deep Space Navigation Design

As the technology that enables advanced deep space autonomous navigation continues to develop and the requirements for such capability continues to grow, there is a clear need for a modular expandable simulation framework. This tool's purpose is to address multiple measurement and information sources in order to capture system capability. This is needed to analyze the capability of competing navigation systems as well as to develop system requirements, in order to determine its effect on the sizing of the integrated vehicle. The development for such a framework is built upon Model-Based Systems Engineering techniques to capture the architecture of the navigation system and possible state measurements and observations to feed into the simulation implementation structure. These models also allow a common environment for the capture of an increasingly complex operational architecture, involving multiple spacecraft, ground stations, and communication networks. In order to address these architectural developments, a framework of agent-based modules is implemented to capture the independent operations of individual spacecraft as well as the network interactions amongst spacecraft. This paper describes the development of this framework, and the modeling processes used to capture a deep space navigation system. Additionally, a sample implementation describing a concept of network-based navigation utilizing digitally transmitted data packets is described in detail. This developed package shows the capability of the modeling framework, including its modularity, analysis capabilities, and its unification back to the overall system requirements and definition.

Anzalone, Evan↗
NASA NTRS1994

VAS: A Vision Advisor System combining agents and object-oriented databases

A model-based approach to identifying and finding the orientation of non-overlapping parts on a tray has been developed. The part models contain both exact and fuzzy descriptions of part features, and are stored in an object-oriented database. Full identification of the parts involves several interacting tasks each of which is handled by a distinct agent. Using fuzzy information stored in the model allowed part features that were essentially at the noise level to be extracted and used for identification. This was done by focusing attention on the portion of the part where the feature must be found if the current hypothesis of the part ID is correct. In going from one set of parts to another the only thing that needs to be changed is the database of part models. This work is part of an effort in developing a Vision Advisor System (VAS) that combines agents and objected-oriented databases.

Eilbert, James L.↗
DOE OSTI2024

Langmuir adsorption model to assess the impact of silane coupling on nano-dispersion of silica in SBR

Surface active agents are often used to improve dispersion of nanoparticles. Quantitative correlation between these surface-active molecules and nanoscale dispersion is absent from the literature partly because a quantitative measure of nanoscale dispersion does not exist. Recently, we have developed the Virial-van der Waals method to quantify dispersion in nanocomposites using virial coefficients. In this paper, the Langmuir adsorption model is used to quantify the influence of surface-active agents on nano-scale dispersion in terms of the effective second virial coefficient B 2 *. The impact of silane coupling agent on the nano-dispersion and silica aggregate structure in precipitated silica/SBR nanocomposites is demonstrated. It is shown that the higher viscosity SBR matrix led to a greater silica aggregate structural breakup, while lower viscosity matrix improved surface silanization. The isomeric content of the SBR, which impacts the dielectric behavior, impacted whether the system could be modeled through a mean-field or specific interactions. We earlier showed that larger aggregates improve dispersion, and this is reaffirmed in these results. After account is made for aggregate size, nano-scale dispersion improves with the addition of silane coupling agent. The behavior is well modeled using Langmuir monolayer adsorption.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗