Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “GAMES”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

Optimal Reward Functions in Distributed Reinforcement Learning

We consider the design of multi-agent systems so as to optimize an overall world utility function when (1) those systems lack centralized communication and control, and (2) each agents runs a distinct Reinforcement Learning (RL) algorithm. A crucial issue in such design problems is to initialize/update each agent's private utility function, so as to induce best possible world utility. Traditional 'team game' solutions to this problem sidestep this issue and simply assign to each agent the world utility as its private utility function. In previous work we used the 'Collective Intelligence' framework to derive a better choice of private utility functions, one that results in world utility performance up to orders of magnitude superior to that ensuing from use of the team game utility. In this paper we extend these results. We derive the general class of private utility functions that both are easy for the individual agents to learn and that, if learned well, result in high world utility. We demonstrate experimentally that using these new utility functions can result in significantly improved performance over that of our previously proposed utility, over and above that previous utility's superiority to the conventional team game utility.

Wolpert, David H.↗

Finding Bounded Rational Equilibria: Iterative Focusing - Part 1

A long-running difficulty with conventional game theory has been how to modify it to accommodate the bounded rationality characterizing all real-world players. A recurring issue in statistical physics is how best to approximate joint probability distributions with decoupled (and therefore far more tractable) distributions. It has recently been shown that the same information theoretic mathematical structure, known as Probability Collectives (PC) underlies both issues. This relationship between statistical physics and game theory allows techniques and insights from the one field to be applied to the other. In particular, PC provides a formal model-independent definition of the degree of rationality of a player and of bounded rationality equilibria. This pair of papers extends previous work on PC by introducing new computational approaches to effectively find bounded rationality equilibria of common-interest (team) games.

Wolpert, David H.↗

Finding Bounded Rational Equilibria: Alternative Lagrangians and Uncountable Move Spaces - Part 2

A long-running difficulty with conventional game theory has been how to modify it to accommodate the bounded rationality characterizing all real-world players. A recurring issue in statistical physics is how best to approximate joint probability distributions with decoupled (and therefore far more tractable) distributions. It has recently been shown that the same information theoretic mathematical structure, known as Probability Collectives (PC) underlies both issues. This relationship between statistical physics and game theory allows techniques and insights &om the one field to be applied to the other. In particular, PC provides a formal model-independent definition of the degree of rationality of a player and of bounded rationality equilibria. This pair of papers extends previous work on PC by introducing new computational approaches to effectively find bounded rationality equilibria of common-interest (team) games.

Wolpert, David H.↗

Presence Personalization and Persistence: A New Approach to Building Archives to Support Collaborative Research

We discuss approaches to building archives that support the way most science is done. Today research is done in formal teams and informal groups. However our on-line services are designed to work with a single user. We have begun prototyping a new approach to building archives in which support for collaborative research is built in from the start. We organize the discussion along three elements that we believe to be necessary for effective support: We must enable user presence in the archive environment; users must be able to interact. Users must be able to personalize the environment, adding data and capabilities useful to themselves and their team. These changes must be persistent: subsequent sessions must be able to build upon previous sessions. In building the archive we see the large multi-player interactive games as a paradigm of how this approach can work. These three 'P's are essential in gaming as well and we shall use insights from the gaming world and virtual reality systems like Second Life in our prototype.

McGlynn, Thomas A.↗

The Application of Modeling and Simulation to the Behavioral Deficit of Autism

This abstract describes a research effort to apply technological advances in virtual reality simulation and computer-based games to create behavioral modification programs for individuals with Autism Spectrum Disorder (ASD). The research investigates virtual social skills training within a 3D game environment to diminish the impact of ASD social impairments and to increase learning capacity for optimal intellectual capability. Individuals with autism will encounter prototypical social contexts via computer interface and will interact with 3D avatars with predefined roles within a game-like environment. Incremental learning objectives will combine to form a collaborative social environment. A secondary goal of the effort is to begin the research and development of virtual reality exercises aimed at triggering the release of neurotransmitters to promote critical aspects of synaptic maturation at an early age to change the course of the disease.

Anton, John J.↗

Zero-Fidelity Simulation: Engaging Team Coordination without Physical, Functional, or Psychological Re-Creation

Team coordination is essential across domains, enabling efficiency and safety. As technology improves, our temptation is to simulate with ever-higher fidelity, by making simulators re-create reality through their physical interfaces, functionality, and by making participants believe they are undertaking the simulated task. However, high-fidelity simulations often miss salient human-human work practices. We introduce the concept of zero-fidelity simulation (ZFS), a move away from literal high-fidelity mimesis of the concrete environment. ZFS alternatively models cooperation and communication as the basis of simulation. The ZFS Team Coordination Game (TeC) is developed from observation of fire emergency response work practice. We identify ways in which team members are mutually dependent on one another for information, and use these as the basis for the ZFS game design. The design creates a need for cooperation by restricting individual activity and requiring communication. The present research analyzes the design of interdependence in the validated ZFS TeC game. We successfully simulate interdependence between roles in emergency response without simulating the concrete environment.

Toups, Zachary O.↗

Life Cycle Analysis of Dedicated Nano-Launch Technologies

Recent technology advancements have enabled the development of small cheap satellites that can perform useful functions in the space environment. Currently, the only low cost option for getting these payloads into orbit is through ride share programs - small satellites awaiting the launch of a larger satellite, and then riding along on the same launcher. As a result, these small satellite customers await primary payload launches and a backlog exists. An alternative option would be dedicated nano-launch systems built and operated to provide more flexible launch services, higher availability, and affordable prices. The potential customer base that would drive requirements or support a business case includes commercial, academia, civil government and defense. Further, NASA technology investments could enable these alternative game changing options. With this context, in 2013 the Game Changing Development (GCD) program funded a NASA team to investigate the feasibility of dedicated nano-satellite launch systems with a recurring cost of less than $2 million per launch for a 5 kg payload to low Earth orbit. The team products would include potential concepts, technologies and factors for enabling the ambitious cost goal, exploring the nature of the goal itself, and informing the GCD program technology investment decision making process. This paper provides an overview of the life cycle analysis effort that was conducted in 2013 by an inter-center NASA team. This effort included the development of reference nano-launch system concepts, developing analysis processes and models, establishing a basis for cost estimates (development, manufacturing and launch) suitable to the scale of the systems, and especially, understanding the relationship of potential game changing technologies to life cycle costs, as well as other factors, such as flights per year.

nanolaunch↗

Life Cycle Analysis of Dedicated Nano-Launch Technologies

Recent technology advancements have enabled the development of small cheap satellites that can perform useful functions in the space environment. Currently, the only low cost option for getting these payloads into orbit is through ride share programs. As a result, these launch opportunities await primary payload launches and a backlog exists. An alternative option would be dedicated nano-launch systems built and operated to provide more flexible launch services, higher availability, and affordable prices. The potential customer base that would drive requirements or support a business case includes commercial, academia, civil government and defense. Further, NASA technology investments could enable these alternative game changing options.With this context, in 2013 the Game Changing Development (GCD) program funded a NASA team to investigate the feasibility of dedicated nano-satellite launch systems with a recurring cost of less than $2 million per launch for a 5 kg payload to low Earth orbit. The team products would include potential concepts, technologies and factors for enabling the ambitious cost goal, exploring the nature of the goal itself, and informing the GCD program technology investment decision making process. This paper provides an overview of the life cycle analysis effort that was conducted in 2013 by an inter-center NASA team. This effort included the development of reference nano-launch system concepts, developing analysis processes and models, establishing a basis for cost estimates (development, manufacturing and launch) suitable to the scale of the systems, and especially, understanding the relationship of potential game changing technologies to life cycle costs, as well as other factors, such as flights per year.

modeling↗

Interactive Mars: A Direct-Experience Mission

As NASA prepares to explore Mars, we describe an innovative architecture that could be based on public-private partnerships to offset the costs of such a mission, while demonstrating many of the key technologies—propulsion, communications, autonomy, and landing systems—that will be needed for future human exploration. We propose that NASA could use this capability to deliver dozens of small rovers to several sites on Mars to enable the creation of interactive games that would be operated commercially and sponsored privately. NASA would get a reduced cost to demonstrate a portion of the infrastructure needed for human exploration, and the private sector would get access to a new market and sponsorship opportunities for a broadly popular activity. In addition, our proposed architecture could enable a new, intuitive means for scientists to interpret data and conduct ground operations. This proposal is to broadly develop the overall concept, while focusing on the design of the novel communications system, developing requirements for the software architecture needed to control the rovers and implement gaming, and developing gaming concepts.

Carolyn R. Mercer↗

Gamification and Visualization of Sensor Data Analysis in Research Buildings

The use of video game elements in non-gaming systems, or gamification , has potential value in transforming data analysis. Our study focused on creating a web-based videogame that models two physical test buildings, each of which contains hundreds of sensors. After the application renders the models, the player can walk through the environments and interact with the virtual representations of the sensors inside. Rather than trudging through a database with textual commands and screens full of data, the user can (virtually) walk up to a sensor and view its data graphically. But these features only scratch the surface of what is possible using our new gamification approach. We anticipate being able to show that recent progress in game design techniques and capacities can contribute to the field of analysis through gamification. The net result could be more stimulating, intuitive, user-friendly interfaces, as well as potentially more informative and insightful applications.

Stone, Jackson A↗

The Handicap Principle, Strategic Information Warfare and the Paradox of Asymmetry

The term asymmetric threat (or warfare) often refers to tactics utilized by countries, terrorist groups, or individuals to carry out attacks on a superior opponent while trying to avoid direct confrontation. Information warfare is sometimes also referred to as a type of asymmetric warfare perhaps due to its asymmetry in terms of cost and efficacy. Obviously, there are differences and commonalities between two types of asymmetric warfare. One major difference lies in the goal to avoid confrontation and one commonality is the asymmetry. Regardless, the unique properties surrounding asymmetric warfare warrant a strategic-level study. Despite enormous studies conducted in the last decade, a consensus on the strategy a nation state should take to deal with asymmetric threat seems still intriguing. In this article, we try to shed some light on the issue from the handicap principle in the context of information warfare. The Handicap principle was first proposed by Zahavi (1975) to explain the honesty or reliability of animal communication signals. He argued that in a signaling system such as one used in mate selection, a superior male is able to signal with a highly developed "handicap" to demonstrate its quality, and the handicap serves "as a kind of (quality) test imposed on the individual" (Zahavi 1975, Searcy and Nowicki 2005). The underlying thread that inspires us for the attempt to establish a connection between the two apparently unrelated areas is the observation that competition, communication and cooperation (3C), which are three fundamental processes in nature and against which natural selection optimize living things, may also make sense in human society. Furthermore, any communication networks, whether it is biological networks (such as animal communication networks) or computer networks (such as the Internet) must be reasonably reliable (honest in the case of animal signaling) to fulfill its missions for transmitting and receiving messages. The strategic goal of information warfare is then to destroy or defend the reliability (honesty) of communication networks. The handicap principle that governs the reliability (honesty) of animal communication networks can be considered as the nature s version of information warfare strategy because it is a product of natural selection. What is particularly interesting is to transfer the evolutionary game theory models [e.g., Sir Philip Sydney (SPS) game] for the handicap principle to the study of information warfare. In a broad perspective, we realize that the handicap principle may actually contradict the principle of asymmetry in asymmetric warfare. Anyway, not every species of animals has evolved expensive signaling equipments like male peacocks (whose exaggerated train is an example of handicap). Furthermore, the handicap principle is not only about communication, and it also embodies the spirits of cooperation and competition. In human societies, communication modulates cooperation and competition; so does in animal communication networks. Therefore, to evolve or maintain a sustainable communication network, the proper strategy should be to balance (modulate) the cooperation and competition with communication tools (information warfare tools), which is perhaps in contradiction with the asymmetric strategy. There might be a paradox in the strategy of asymmetric warfare, and whether or not information warfare can be used as an asymmetric tool is still an open question.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Constrained Turret Defense with Fixed Final Time

In this paper, we extend existing turret defense differential game formulations involving a turn-constrained turret and mobile agent to include specified final time and a constraint. For the purposes of this analysis, the specified final time may represent some exogenous input, perhaps representing the time at which some other event will take place. As for the constraint, it represents a no-fly zone for the mobile agent. The scenario is formulated as a two-player, zero-sum differential game and solved via the method of characteristics (i.e., back-propagation of equilibrium trajectories). Three different trajectory types make up the solution: trajectories that end with the turret aligned with the mobile agent, trajectories that end with the mobile agent on the constraint boundary, and regular trajectories.

differential game, game theory↗

Approximating Nash Equilibrium in Day-ahead Electricity Market Bidding with Multi-agent Deep Reinforcement Learning

In this paper, a day-ahead electricity market bidding problem with multiple strategic generation company (GEN-CO) bidders is studied. The problem is formulated as a Markov game model, where GENCO bidders interact with each other todevelop their optimal day-ahead bidding strategies. Considering unobservable information in the problem, a model-free and data-driven approach, known as multi-agent deep deterministic policy gradient (MADDPG), is applied for approximating the Nash equilibrium (NE) in the above Markov game. The MADDPG algorithm has the advantage of generalization due to the automatic feature extraction ability of the deep neural networks. The algorithm is tested on an IEEE 30-bus system with three competitive GENCO bidders in both an uncongested caseand a congested case. Comparisons with a truthful bidding strategy and state-of-the-art deep reinforcement learning methods including deep Q network and deep deterministic policy gradient (DDPG) demonstrate that the applied MADDPG algorithm can find a superior bidding strategy for all the market participants with increased profit gains. In addition, the comparison with a conventional model-based method shows that the MADDPG algorithm has higher computational efficiency, which is feasible for real-world applications.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Minimax theorems in fuzzy metric spaces

A minimax theorem is a theorem providing conditions which guarantee that the max–min inequality is also an equality. The first theorem in this sense is von Neumann’s minimax theorem, which was considered the starting point of game theory. Since then, several alternative generalizations of von Neumann’s original theorem have appeared in the literature. Variational inequality and minimax problems are of fundamental importance in modern non-linear analysis. They are widely applied in mechanics, differential equations, control theory, mathematical economics, game theory, and optimization. The purpose of this paper is first to establish a minimax theorem for mixed lower–upper semi-continuous functions in fuzzy metric spaces which extends the minimax theorems of many von Neumann types. As applications, we utilize this result to study the existence problems of solutions for abstract variational inequalities and quasi-variational inequalities in fuzzy metric spaces and to study the coincidence problems and saddle problems in fuzzy metric spaces.

97 MATHEMATICS AND COMPUTING↗

How social impact assessment can contribute to conflict management

The potential for conflict is omnipresent in all projects, and even in all human interactions, and conflict itself leads to many second-order social impacts. This article examines the contribution of the methodological approach used in social impact assessment (SIA) to conflict management. We view conflict as a process that has its own dynamic, and is to be expected in all situations. By using game theory (prisoner's dilemma), we describe and conceptualize this process and highlight the importance of communication in managing conflict. We demonstrate the potential use of SIA in preventing, managing and resolving conflict. Emphasis is placed on the participatory character of SIA and the role of public media. In contrast to existing literature, our focus is not restricted to the typical fields of study of SIA (e.g. environmental conflicts), but understands conflict itself as a field of application. In this sense, conflict-sensitive SIA can be understood both as an extension to the SIA tool kit and a broadening of the scope of SIA application. -- Highlights: • Conflict is omnipresent and creates both positive and negative social impacts. • Conflict itself represents a possible field of application for SIA. • Conflict escalation is a process that can be modeled in a game-theoretic framework. • There needs to be concerted effort to prevent escalation to avoid harmful outcomes. • Conflict-sensitive SIA can support conflict management and sustainable resolution.

54 ENVIRONMENTAL SCIENCES↗

An Analysis of Post Attack Impacts and Effects of Learning Parameters on Vulnerability Assessment of Power Grid

Due to the increasing number of heterogeneous devices connected to electric power grid, the attack surface increases the threat actors. Game theory and machine learning are being used to study the power system failures caused by external manipulation. Most of existing works in the literature focus on one-shot process of attacks and fail to show the dynamic evolution of the defense strategy. In this paper, we focus on an adversarial multistage sequential game between the adversaries of the smart electric power transmission and distribution system. We study the impact of exploration rate and convergence of the attack strategies (sequences of action that creates large scale blackout based on the system capacity) based on the reinforcement learning approach. We also illustrate how the learned attack actions disrupt the normal operation of the grid by creating transmission line outages, bus voltage violations, and generation loss. This simulation studies are conducted on IEEE 9 and 39 bus systems. The results show the improvement of the defense strategy through the learning process. The results also prove the feasibility of the learned attack actions by replicating the disturbances created in simulated power system.

attack impacts↗

Propagating Mixed Uncertainties in Cyber Attacker Payoffs: Exploration of Two-Phase Monte Carlo Sampling and Probability Bounds Analysis

Securing cyber-systems on a continual basis against a multitude of adverse events is a challenging undertaking. Game-theoretic approaches, that model actions of strategic decision-makers, are increasingly being applied to address cybersecurity resource allocation challenges. Such game-based models account for multiple player actions and represent cyber attacker payoffs mostly as point utility estimates. Since a cyber-attacker’s payoff generation mechanism is largely unknown, appropriate representation and propagation of uncertainty is a critical task. In this paper we expand on prior work and focus on operationalizing the probabilistic uncertainty quantification framework, for a notional cyber system, through: 1) representation of uncertain attacker and system-related modeling variables as probability distributions and mathematical intervals, and 2) exploration of uncertainty propagation techniques including two-phase Monte Carlo sampling and probability bounds analysis.

cyber security↗

Signal-Anticipation in Local Voltage Control in Distribution Systems

We consider the signal-anticipating behavior in local Volt/Var control for distribution systems. Such a behavior makes interaction among the nodes a game. We characterize Nash equilibrium of the game as the optimum of a global optimization problem and establish its asymptotic global stability. We also show that the signal-anticipating voltage control has less restrictive convergence condition than the signal-taking control. We then introduce the notion of price of signal-anticipation (PoSA) to characterize the impact of signal-anticipating control, and use the gap in cost between network equilibrium in the signal-taking control and Nash equilibrium in the signal-anticipating control as the metric for PoSA. We characterize how the PoSA scales with the size, topology, and heterogeneity of the distribution network for a few network settings. Our results show that the PoSA is upper bounded by a constant and the average PoSA per node will go to zero as the size of the network increases. This is desirable as it means that the PoSA will not be arbitrarily large, no matter what the size of the network is, and no mechanism is needed to mitigate the signal-anticipating behavior. We further carry out numerical experiments with a real-world distribution circuit to complement the theoretical analysis.

24 POWER TRANSMISSION AND DISTRIBUTION↗