SEARCH · Engineering Papers

Results for “agent based simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24

All sources NASA NTRS DOE OSTI

NASA NTRS2012

Evaluation of the Absolute Regional Temperature Potential

The Absolute Regional Temperature Potential (ARTP) is one of the few climate metrics that provides estimates of impacts at a sub-global scale. The ARTP presented here gives the time-dependent temperature response in four latitude bands (90-28degS, 28degS-28degN, 28-60degN and 60-90degN) as a function of emissions based on the forcing in those bands caused by the emissions. It is based on a large set of simulations performed with a single atmosphere-ocean climate model to derive regional forcing/response relationships. Here I evaluate the robustness of those relationships using the forcing/response portion of the ARTP to estimate regional temperature responses to the historic aerosol forcing in three independent climate models. These ARTP results are in good accord with the actual responses in those models. Nearly all ARTP estimates fall within +/-20%of the actual responses, though there are some exceptions for 90-28degS and the Arctic, and in the latter the ARTP may vary with forcing agent. However, for the tropics and the Northern Hemisphere mid-latitudes in particular, the +/-20% range appears to be roughly consistent with the 95% confidence interval. Land areas within these two bands respond 39-45% and 9-39% more than the latitude band as a whole. The ARTP, presented here in a slightly revised form, thus appears to provide a relatively robust estimate for the responses of large-scale latitude bands and land areas within those bands to inhomogeneous radiative forcing and thus potentially to emissions as well. Hence this metric could allow rapid evaluation of the effects of emissions policies at a finer scale than global metrics without requiring use of a full climate model.

Shindell, D. T.↗

NASA NTRS1998

A Cognitive-System Model for En Route Air Traffic Management

NASA Ames Research Center has been engaged in the development of advanced air traffic management technologies whose basic form is cognitive aiding systems for air traffic controller and flight deck operations. In the design and evaluation of such systems the dynamic interaction between the airborne aiding system and the ground-based aiding systems forms a critical coupling for control. The human operator is an integral control element in the system and the optimal integration of human decision and performance parameters with those of the automation aiding systems offers a significant challenge to cognitive engineering. This paper presents a study in full mission simulation and the development of a predictive computational model of human performance. We have found that this combination of methodologies provide a powerful design-aiding process. We have extended the computational model Man Machine Integrated Design and Analysis System (N13DAS) to include representation of multiple cognitive agents (both human operators and intelligent aiding systems), operating aircraft airline operations centers and air traffic control centers in the evolving airspace. The demands of this application require the representation of many intelligent agents sharing world-models, and coordinating action/intention with cooperative scheduling of goals and actions in a potentially unpredictable world of operations. The operator's activity structures have been developed to include prioritization and interruption of multiple parallel activities among multiple operators, to provide for anticipation (knowledge of the intention and action of remote operators), and to respond to failures of the system and other operators in the system in situation-specific paradigms. We have exercised this model in a multi-air traffic sector scenario with potential conflict among aircraft at and across sector boundaries. We have modeled the control situation as a multiple closed loop system. The inner and outer loop alerting structure of air traffic management has many implications that need to be investigated to assure adequate design. First, there are control and stability factors implicit in the design. As the inner loop response time approaches that of the outer loop, system stability may be compromised in that controllers may be solving a problem the nature of which has already been changed by pilot action. Second, information exchange and information presentation for both air and ground must be designed to complement as opposed to compete with each other. Third, the level of individual and shared awareness in trajectory modification and flight conformance needs to be defined. Fourth, the level of required awareness and performance impact of mixed fleet operations and failed-mode recovery must be explored.

Corker, Kevin M.↗

NASA NTRS2004

Distributed network scheduling

Distributed Network Scheduling is the scheduling of future communications of a network by nodes in the network. This report details software for doing this onboard spacecraft in a remote network. While prior work on distributed scheduling has been applied to remote spacecraft networks, the software reported here focuses on modeling communication activities in greater detail and including quality of service constraints. Our main results are based on a Mars network of spacecraft and include identifying a maximum opportunity of improving traverse exploration rate a factor of three; a simulation showing reduction in one-way delivery times from a rover to Earth from as much as 5 to 1.5 hours; simulated response to unexpected events averaging under an hour onboard; and ground schedule generation ranging from seconds to 50 minutes for 15 to 100 communication goals.

planning↗

NASA NTRS2004

Applications of Intelligent Tutoring Systems to Human-Robotic Exploration of Mars

Space missions with small crews extending over several years with time-delay preventing normal conversations with people on earth will raise many challenges for training. Of special interest are possible three-year missions to Mars, requiring refresher instruction and learning new skills based on unexpected problems with machines and environmental conditions. For example, the crew will be required to monitor and repair more complex life support systems for air and water recycling than we even know how to build today. Highly educated astronauts, often with several doctorate degrees, require a very different mode of interaction than we have developed for school children or even typical college students. Explanation methods may need to differ-using analogies and techniques from different domains-depending on whether the astronaut is an astrophysicist, a pilot, or a geologist.Virtual reality (e.g., for Hubble repair missions) and "integrated" simulations (involving role-playing and emphasizing failure scenarios) are the most common advanced forms of instruction used in space flight today. The emphasis is on collaborative, embodied interaction with the same workstations and tools used in practice (e.g., a cockpit simulator). Otherwise, computerized instructional technology used by NASA is not model-based or tutorial in nature. This discussion will review some of the key instructional methods used at NASA over the past two decades and consider why ITS methods have not been exploited. Some of the problems and opportunities for training for Mars missions are examined, including how using robots in exploration activities will help but raise new training problems. These ideas will be illustrated with examples from the BrahmsVE system in which a browser- based virtual reality display with avatars allows interacting with a distributed multiagent system, in which agents can be people, robots, or software programs. Using BrahmsVE may provide a way for astronauts to interact with proxies of people who serve as instructional coaches on Mars.

Clancey, William J.↗

DOE OSTI2023

Stability study of aqueous foams under high-temperature and high-pressure conditions relevant to Enhanced Geothermal Systems (EGS)

In Enhanced Geothermal System (EGS) hydraulic fracturing is carried out by injecting cold water into deep Hot Dry Rocks (HDR) under carefully controlled conditions to create new or reopen existing fractures. Water-based fracturing fluids demonstrate some challenges including immense quantity of water usage, water sensitivity of the formations, water blocking, and lack of proppant carrying capacity and transportation. Thus, an alternative is to use foam-based fracturing fluid which offers potential advantage over conventional water-based fracturing fluid such as minimum water usage, reduced wellbore damage, high proppant carrying capacity, and less environmental damage. However, foams are complex mixture of gaseous phase and liquid phase which are thermodynamically unstable at downhole conditions, and their stability can decrease over time due to liquid drainage, bubble coarsening, and coalescence. This paper shows laboratory experiments executed to study foam stability at high temperature (200°C) and high pressure (6.9MPa) conditions which simulates the geothermal environment. Foam stability was characterized by half-life of foam, which is defined as the time taken by the foam to decreases by 50% of its original height due to drainage. In this paper, two types of gaseous phases, nitrogen (N 2 ) and carbon dioxide (CO 2 ) were investigated. Also, based on successful practice of foam-based fracturing fluid in oil and gas industries, four surfactants, including Alpha olefin sulfonate (AOS), Sodium dodecyl sulfonate (SDS), Tergitol™ (NP – 40), and Cetyltrimethylammonium chloride (CTAC) at optimum concentration of 1wt.% were tested for best stability performance. In addition, different stabilizing agents including guar gum, bentonite clay, crosslinker, silicon dioxide nanoparticles (SiO 2 ), graphene oxide (GO) were also studied. Experimental results showed that N 2 foams were more stable than CO 2 foams. It was observed that foam half-life decreased with the increase in temperature. Among all the surfactants, AOS foams showed the most promising thermal stability at high temperatures. Moreover, with the addition of stabilizing agents, foam's half-life was enhanced. Stabilizing agents such as crosslinker and GO dispersion showed the most stable foams with half-life recorded at 20min and 17min, respectively, at 200°C and 6.9MPa. Finally, pressure also showed a positive effect on foam stability; with increased pressure, foam half-life was increased. Based on the experimental data, analytical models for the effect of temperature and pressure were developed, considering foam degradation is a first-order kinetic reaction that linearly depends on the foam drainage mechanism. The effect of temperature on foam half-life was studied as an exponential decay model. In this model, foam half-life is a function of drainage rate constant (D A ) and activation energy (E a ) of the foam system. The effect of pressure on foam half-life was found to obey a power-law model where an increase in pressure showed an increase in foam half-life. Furthermore, a linear relation was studied for the effect of pressure on foam activation energy and drainage rate. Then the combined effects of temperature and pressure were studied, which yielded an analytical model to predict the foam stabilities in terms of half-life for different foam compositions. In conclusion, this research indicates that with an appropriate selection of surfactants and stabilizing agents, it is possible to obtain stable foams, which could replace conventional water fracturing fluid under EGS conditions.

15 GEOTHERMAL ENERGY↗

NASA NTRS2018

Design and Development of a Laboratory-Scale Ice Adhesion Testing Device

When an aircraft traverses through clouds containing supercooled water droplets, in-flight icing can occur that negatively affects vehicle performance by increasing weight and drag leading to loss of lift. Super-cooled water droplets present in clouds that impact vehicle surfaces can lead to inflight icing any time during the year.1 Most events occur at temperatures ranging from 0 to -20degC. Ice generated on the aircraft can vary between clear/glaze, rime, and mixed (Fig. 1) depending on air temperature (-5 to -20degC), liquid water content (0.3-0.6 g/m3), and droplet size (median volumetric diameter of 15-40 μm). Current strategies to remove ice are based on active technologies such as pneumatic boots, heated surfaces, and deicing agents (i.e., ethylene- and propylene-based glycols). The latter have potential environmental concerns. A passive approach to mitigate accreting ice that is actively being investigated are protective coatings. An ice mitigating coating could potentially be used as a stand-alone material, but more likely in combination with an active approach. In the latter scenario, potential reduction in power consumption by the active approach may be realized. To determine the ice adhesion strength of impact ice that is representative of the aircraft environment is not a trivial matter. Test methods utilizing slowly formed ice (i.e., freezer ice) do not accurately simulate this environment. Likewise, some testing methodologies involve sample relocation from the icing environment to the test chamber that can result in thermal shock to the sample, thus affecting the results. The Adverse Environment Rotor Test Stand (AERTS) located at Pennsylvania State University (PSU) has been demonstrated to simulate impact icing conditions within the icing envelope for the determination of ice adhesion shear strength (IASS) without removal/relocation of the sample.2 Due to the confidence in results obtained from AERTS, this instrument is in high demand and requires a significant amount of lead time and capital investment to obtain IASS results. As a solution for quickly and economically screening coatings in a controlled manner under impact icing conditions, a laboratory-scale ice adhesion test and dead blades were then removed from the rotor/blade assembly to obtain the final mass. The IASS of the live blade was determined from the difference in mass (before and after testing) of the live and dead blades, the ice shed area, and the rpm of the shed event. The same live blade sample was tested in triplicate at all three test temperatures. Surface roughness was determined using a Bruker Dektak XT Stylus Profilometer. Measurements were conducted using a 12.5 μm tip at a vertical range of 65.5 μm with an applied force of 3 mg. Data were collected over a 1.0 mm length at a resolution of 0.056 μm/point. Five single line scans at different locations were collected and processed using a two-point leveling subtraction. The resultant Ra (arithmetic roughness) and Rq (root mean square roughness) average values were calculated.

Smith, Joseph G., Jr.↗

DOE OSTI2025

Deep reinforcement learning control for co-optimizing energy consumption, thermal comfort, and indoor air quality in an office building

With the recent demand for decarbonization and energy efficiency, advanced HVAC control using Deep Reinforcement Learning (DRL) becomes a promising solution. Due to its flexible structures, DRL has been successful in energy reduction for many HVAC systems. However, only a few researches applied DRL agents to manage the entire central HVAC system and control multiple components in both the water loop and the air loop, owing to its complex system structures. Moreover, those researches have not extended their applications by incorporating the indoor air quality, especially both CO2 and PM2.5concentrations, on top of energy saving and thermal comfort, as achieving those objectives simultaneously can cause multiple control conflicts. What's more, DRL agents are usually trained on the simulation environment before deployment, so another challenge is to develop an accurate but relatively simple simulator. Therefore, we propose a DRL algorithm for a central HVAC system to co-optimize energy consumption, thermal comfort, indoor CO2 level, and indoor PM2.5 level in an office building. To train the controller, we also developed a hybrid simulator that decoupled the complex system into multiple simulation models, which are calibrated separately using laboratory test data. The hybrid simulator combined the dynamics of the HVAC system, the building envelope, as well as moisture, CO2, and particulate matter transfer. Three control algorithms (rule-based, MPC, and DRL) are developed, and their performances are evaluated on the hybrid simulator environment with a realistic scenario (i.e., with stochastic noises). The test results showed that, the DRL controller can save 21.4 % of energy compared to a rule-based controller, and has improved thermal comfort, reduced indoor CO2 concentration. The MPC controller showed an 18.6 % energy saving compared to the DRL controller, mainly due to savings from comfort and indoor air quality boundary violations caused by unmeasured disturbances, and it also highlights computational challenges in real-time control due to non-linear optimization. Finally, we provide the practical considerations for designing and implementing the DRL and MPC controllers based on their respective pros and cons.

Guo, Fangzhou↗

DOE OSTI2023

Modeling and simulation to investigate the electrification potential of medium- and heavy-duty vehicle fleets

This project involves developing and integrating new modeling tools to simulate the dynamics of electric medium- and heavy-duty fleet vehicle adoption. A technical and economic modeling tool, combining a data-driven hardware cost model with a cost-optimal charging strategy microsimulation, enables tailored analysis of the costs and benefits of electrifying individual fleets. Next, a novel text synthesis process, applied to a curated corpus of literature, quantifies trade-offs between technical, economic, and other factors in the fleet vehicle procurement decision. The outcomes of these tasks combine with knowledge from recent literature on fleet decision processes to specify the vehicle procurement model used by fleets in an agent-based model of the medium- and heavy-duty electric vehicle market. This model embodies an especially disaggregated approach to adoption modeling, internalizing factors and dynamics that conventional adoption models externalize. In particular, explicitly modeling the formation and diffusion of opinions among agents enables experiments that conventional models cannot support. Demonstrations show, for example, that increasing the extent of interactions between populations with different proclivities to electric vehicles has an asymmetrical outcome. High-proclivity electric vehicle adoption is generally unaffected as interactions increase, but low-proclivity adoption is accelerated. By representing individual fleets' requirements and costs at a high level of detail, incorporating an adoption decision model informed by a wide body of empirical research, and broadening the array of variables and dynamics available for experimentation, this integrated model offers a new way to understand the urgent challenge of eliminating emissions from the most emissions-intensive transportation sectors.

Trinko, David A.↗

NASA NTRSDate not supplied

Modeling Distributed Situation Awareness in Resilience-based Design of Complex Systems

Human operators play a major role in the resilience of complex systems–while human error is one of the biggest contributors to hazardous events, operators additionally play a critical role in mitigating hazardous events. A key factor underlying this operator resilience is situation awareness–the ability of operators to understand their environment and each other to achieve desired system functions. In contrast to situation awareness-related accident models in the literature, which are largely conceptual in nature, this work proposes the use of a dynamic simulation framework to concretely model both the effects of situation awareness-related human errors and situation awareness-related hazard-mitigating properties using the distributed situation awareness theory. This work then presents specialized model constructs to enable agents’ individual perceptions of the system state and transactions with other agents (and thus distributed situation awareness) to be represented in simulation. To demonstrate this framework, it is then adapted to an aircraft taxiway case study, where it is used to model aircraft conflicts due to lack of vision and poor communications from the air traffic controller. This demonstration shows the potential of using simulation models to rigorously understand situation awareness-related human errors and thus inform the design of resilience.

Resilience Modeling↗

NASA NTRS1990

Dual redundant arm system operational quality measures and their applications - Dynamic measures

Dual-arm dynamic operation quality measures are presented which quantify the efficiency and capability of generating Cartesian accelerations by two cooperative arms based on the analysis of dual-arm dynamic interactions. Dual-arm dynamic manipulability is defined as the efficiency of generating Cartesian accelerations under the dynamic and kinematic interactions between individual arms and an object under manipulation. The analysis of dual-arm dynamic interactions is based on the so-called Cartesian space agent model of an arm, which represents an individual arm as a force source acting upon a point mass with the effective Cartesian space arm dynamics and an environment or an object under manipulation. The Cartesian space agent model of an arm makes it possible to derive the dynamic and kinematic constraints involved in the transport, assembly and grasping modes of dual-arm cooperation. A task-oriented operational quality measure, (TOQd) is defined by evaluating dual-arm dynamic manipulability in terms of given task requirements. TOQd is used in dual-arm joint configuration optimization. Simulation results are shown. A complete set of forward dynamic equations for a dual-arm system is derived, and dual-arm dynamic operational quality measures for various modes of dual-arm cooperation allowing sliding contacts are established.

Lee, Sukhan↗

NASA NTRS2020

Optimal Multi-Agent Search and Rescue Using Potential Field Theory

This paper presents an algorithm for efficient search and rescue using a multi-agent system of vehicles. The algorithm uses an artificial potential field combined with a time-varying reward function for visiting various points within the search area. The reward function is used to weight the attractiveness of these points in the potential field, and collision avoidance terms are used to repel vehicles from each other, which has the additional effect of reducing duplication of searching efforts. The algorithm generates velocity commands in real-time based on communication with the other vehicles. This framework allows vehicles to react in a dynamic environment, which is a significant advantage to simply following a-priori defined trajectories. Simulation results are presented to demonstrate the ability of the algorithm to cover the search area effectively. The algorithm is also compared to an exhaustive lawn-mower search pattern. This comparison is done via a Monte Carlo simulation with randomized target initial conditions and trajectories. The time to find the target improved by 16 and 30% in the mean and median, respectively. Additionally, this paper presents a method for analyzing the upper bound for time to find a target under the potential field guidance algorithm assuming a radially expanding search area.

John R Cooper↗

NASA NTRSDate not supplied

Modeling Distributed Situation Awareness in Resilience-Based Design of Complex Engineered Systems

Resilience Modeling↗

DOE OSTI2021

Polyphenols Weaken Pea Protein Gel by Formation of Large Aggregates with Diminished Noncovalent Interactions

Polyphenols are well-known native cross-linkers and gel strengthening agents for many animal proteins. However, their role in modifying plant protein gels remains unclear. In this study, multiple techniques were applied to unravel the influence of green tea polyphenols (GTP) on pea protein gels and the underlying mechanisms. We found that the elasticity and viscosity of pea protein gels decreased with increased GTP. The protein backbone became less rigid when GTP was present based on shortened T 1ρ H in relaxation solid-state NMR measurements. Electron microscopy and small-angle X-ray scattering showed that gels weakened by GTP possessed disrupted networks with the presence of large protein aggregates. Solvent extraction and molecular dynamic simulation revealed a reduction in hydrophobic interactions and hydrogen bonds among proteins in gels containing GTP. The current findings may be applicable to other plant proteins for greater control of gel structures in the presence of polyphenols, expanding their utilization in food and biomedical applications.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2021

Distributional Deep Reinforcement Learning-Based Emergency Frequency Control

Emergency frequency control is one of the most critical approaches to maintain power system stability after major disturbances. With the increasing number of grid-connected renewable energy sources, existing model-based methods of frequency control are facing up with challenges of computational speed and scalability for large-scale systems. In this paper, the emergency frequency control problem is formulated as a Markov Decision Process (MDP) and solved through a novel Distributional Deep Reinforcement Learning (DDRL) method, namely the distributional soft actor critic (DSAC) method. Compared with other RL methods that only estimate the mean value, the proposed DSAC model estimates the distribution of value function over returns. This advancement can lead to more insights and knowledge for the agent, with the benefit of a much faster and more stable learning process, and the improved frequency control performance. Here, the simulation results on IEEE 39-bus and IEEE 118-bus systems demonstrate the effectiveness and robustness of proposed models, as well as the advantage compared to other state-of-the-art DRL algorithms.

24 POWER TRANSMISSION AND DISTRIBUTION↗

NASA NTRS2000

Adaptivity in Agent-Based Routing for Data Networks

Adaptivity, both of the individual agents and of the interaction structure among the agents, seems indispensable for scaling up multi-agent systems (MAS s) in noisy environments. One important consideration in designing adaptive agents is choosing their action spaces to be as amenable as possible to machine learning techniques, especially to reinforcement learning (RL) techniques. One important way to have the interaction structure connecting agents itself be adaptive is to have the intentions and/or actions of the agents be in the input spaces of the other agents, much as in Stackelberg games. We consider both kinds of adaptivity in the design of a MAS to control network packet routing. We demonstrate on the OPNET event-driven network simulator the perhaps surprising fact that simply changing the action space of the agents to be better suited to RL can result in very large improvements in their potential performance: at their best settings, our learning-amenable router agents achieve throughputs up to three and one half times better than that of the standard Bellman-Ford routing algorithm, even when the Bellman-Ford protocol traffic is maintained. We then demonstrate that much of that potential improvement can be realized by having the agents learn their settings when the agent interaction structure is itself adaptive.

Wolpert, David H.↗

DOE OSTI2021

Agent-based Disease Surveillance and Transmission Model

The SARS-CoV-2 pandemic has driven a need for models that can predict transmission among populations and test the effectiveness of proposed interventions to control it such as testing, quarantining, vaccinations, and nonpharmaceutical interventions. Some questions of interest include:1. How rapidly will the virus spread if no action is taken? 2. How frequently should people be tested and quarantined if necessary? 3. Should unvaccinated persons be tested more frequently than the vaccinated? 4. If test results are delayed, how will that affect the spread? 5. How do test false negative rates affect the overall efficacy of testing programs? 6. How do constraints on testing resources impact the overall efficacy of testing programs? 7. How does the patient’s failure to recognize COVID symptoms and quarantine affect the spread? 8. What level of vaccination coverage is needed to suppress the epidemic? 9. What is the risk of a large outbreak (probability exceeding x infections)? 10. What is the cost effectiveness of interventions (dollars per avoided infection)? This report describes the structure of a discrete event simulation model that provides actionable information to address these questions. Parameter inputs and results of analyses have been reported in briefings provided to LLNL management and are not discussed here.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2023

Resilient Design of Continuous-time Distributed Optimization Algorithm in the Presence of Cyber-attacks

This paper presents a continuous-time resilient distributed optimization algorithm based on competitive interaction design method on connected graphs in the presence of adversaries. Here, the competitive interaction method allows us to design a network that protects the multi-agent systems from adversaries without requiring high network connectivity. In addition, the proposed algorithm does not require the global information about the number of adversaries. First, we show that the proposed distributed algorithm solves the resilient distributed optimization problem with no attack on the communication links. Second, we show that the proposed continuous-time distributed optimization algorithm on connected graphs converges to the small neighborhood of the optimal solution in the presence of cyber-attacks onto the communication channel. Simulations are presented to illustrate our theoretical results.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Understanding and Manipulating Helical Nanofilaments in Binary Systems with Achiral Dopants

Here, in this paper, we report the relationship between helical pitch of the helical nanofilament (HNF) phase formed by bent-core molecule NOBOW and the concentration of achiral dopants 5CB and octane, using linearly polarized resonant soft X-ray scattering (RSoXS). Utilizing theory-based simulation, which fits well with the experiments, the molecular helices in the filament were probed and the superstructure of helical 5CB directed by groove of HNFs was observed. Quantitative pitch determination with RSoXS reveals that helical pitch variation is related to 5CB concentration with no temperature dependence. Doping rodlike immiscible 5CB led to a pitch shortening of up to 30%, which was attributed to a change in interfacial tension. By shedding light not only on phase behavior of binary systems but also enabling control over pitch length, our work may benefit various applications of HNF-containing binary systems, including optical rotation devices, circularly polarized light emitters, and chirality transfer agents.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗