• Title/Summary/Keyword: nash equilibrium

Search Result 196, Processing Time 0.021 seconds

Opportunistic Spectrum Access with Discrete Feedback in Unknown and Dynamic Environment:A Multi-agent Learning Approach

  • Gao, Zhan;Chen, Junhong;Xu, Yuhua
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.9 no.10
    • /
    • pp.3867-3886
    • /
    • 2015
  • This article investigates the problem of opportunistic spectrum access in dynamic environment, in which the signal-to-noise ratio (SNR) is time-varying. Different from existing work on continuous feedback, we consider more practical scenarios in which the transmitter receives an Acknowledgment (ACK) if the received SNR is larger than the required threshold, and otherwise a Non-Acknowledgment (NACK). That is, the feedback is discrete. Several applications with different threshold values are also considered in this work. The channel selection problem is formulated as a non-cooperative game, and subsequently it is proved to be a potential game, which has at least one pure strategy Nash equilibrium. Following this, a multi-agent Q-learning algorithm is proposed to converge to Nash equilibria of the game. Furthermore, opportunistic spectrum access with multiple discrete feedbacks is also investigated. Finally, the simulation results verify that the proposed multi-agent Q-learning algorithm is applicable to both situations with binary feedback and multiple discrete feedbacks.

Game Theoretic Analysis for RFID Reader Collision (RFID 리더 주파수 간섭에 대한 게임 이론 관점에서의 해석)

  • Lee, Dong-Yul;Lee, Chae-Woo
    • Journal of the Institute of Electronics Engineers of Korea TC
    • /
    • v.46 no.5
    • /
    • pp.36-47
    • /
    • 2009
  • There exists RFID reader-to reader frequency which can not recognize tag in dense reader nude because the interference causes low SIR. To solve this frequency, the many algorithms based on TDM have been proposed. But the most of existing algorithms not obtain the optimal time allocation but propose heuristic scheduling algorithm. In this paper, we apply game theory which deals with interest between players of game to RFID reader-to reader interference and analyze the time allocation problem of reader based on TDM in terms of cooperative game which the players bind agreements using Nash Bargaining Solution(NBS) and non-cooperative game which the players do not bind agreements using Nash Equilibrium(NE). The applied results show that in dense reader mode, NBS of cooperative game is superior to NE of non-cooperative game and present optimal time allocation in dense reader mode.

A Study on the International R&D Competition and Optimal Tariff (국제 R&D 경쟁과 최적관세)

  • Li, Dong-Sheng;Lee, Jong-Min
    • Korea Trade Review
    • /
    • v.41 no.2
    • /
    • pp.29-60
    • /
    • 2016
  • Research and Development(R&D) investment is an issue of central importance in any economy. In this paper we analyze the relationship between R&D spillovers and trade-related variables, using a two-stage model where duopolists simultaneously decide on R&D in the first stage and engage in Cournot competition in the second stage. We characterized and compared the free-trade and trade-restriction R&D equilibrium in a two-stage game of R&D investment followed by Cournot market competition. We also assessed the impact of varying the R&D spillover on the equilibrium outcomes and tariff. We showed for both free trade and protection cases that there exists a unique symmetric solution(subgame perfect Nash equilibrium). As the solution, while analytical, cannot be stated in closed form, we resorted to numerical experiments to investigate the equilibrium results. Our estimates indicate for both free trade and protection cases that the level of R&D investment and the rate of R&D expenditure decrease as the degree of R&D spillovers increases, and that there is an inverse relation between the degree of R&D spillovers and level of protection. The latter implies that the larger the degree of R&D spillovers, the lesser the level of protection.

  • PDF

Optimal Bidding Strategy of Competitive Generators Under Price Based Pool (PBP(Price Based Pool) 발전경쟁시장에서의 최적입찰전략수립)

  • Kang, Dong-Joo;Hur, Jin;Moon, Young-Hwan;Chung, Koo-Hyung;Kim, Bal-Ho
    • The Transactions of the Korean Institute of Electrical Engineers A
    • /
    • v.51 no.12
    • /
    • pp.597-602
    • /
    • 2002
  • The restructuring of power industry is still going on all over the world for last several decades. Many kinds of restructuring model have been studied, proposed, and applied. Among those models, power pool is more popular than other. This paper assumes the power pool market structure having competitive generation sector, and a new method is presented to build a bidding strategy in that market. The utilities participating in the market have the perfect information of their cost and price functions, but they don't know which strategy to be chosen by others. To define one's strategy as a vector, we make utility's cost/price functions into discrete step functions. An utility knows only his own strategy, so he estimates the other's cost/price functions into discrete step functions. An utility knows only his own strategy, so he estimates the other's strategy using Nash equilibrium or stochastic methods. And he also has to forecast the system demand. According to this forecasting result, his payoffs can be changed. Considering these all conditions, we formulate a bidding game problem and apply noncooperative game theory to that problem for the optimal strategy or solution. Some restrictive assumption are added for simplification of solving process. A numerical example is given in Case Study to show essential features and concrete results of this approach.

The Relationship Between Monetary and Macroprudential Policies

  • KANG, JONG KU
    • KDI Journal of Economic Policy
    • /
    • v.39 no.1
    • /
    • pp.19-40
    • /
    • 2017
  • This paper analyzes the interaction between monetary and macroprudential policies mainly in the context of the non-cooperation among policy authorities. Each policy authority's optimal response is to tighten its policy measures when other authorities' policy measures are loosened. This indicates that the two policies are substitutes for each other. This result still holds when an additional financial stability mandate is assigned to the central bank. The condition for the response functions to converge to a Nash equilibrium state is analyzed along with the speed of convergence, showing that they depend on the authorities' preferences and the number of mandates assigned to policy authorities. If the financial supervisory authority (FSA) assigns greater importance to the output gap or a stronger financial stability mandate is assigned to the central bank (CB), the probability of non-convergence increases and the speed of convergence declines even when the condition of convergence is satisfied. Meanwhile, if the CB considers output stability as an important task, the probability of convergence and the speed of converging to a state of equilibrium are high. Finally, when a single mandate or small number of mandates is/are assigned to each authority, stability is more quickly restored as compared to when many mandates are assigned.

Benefits of Using Imperfect Information in Controlling an M/M/1 Queueing System

  • Nam, Ick-Hyun
    • Management Science and Financial Engineering
    • /
    • v.1 no.1
    • /
    • pp.1-19
    • /
    • 1995
  • In this paper, we analyze an M / M / 1 queueing system where there are incentive conflicts among customers. Self-interested customers' decisions whether to join the system or not may not necessarily induce a socially optimal congestion level. As a way to alleviate the over-congestion, toll imposition was used in Naor's paper [3]. Instead of using a toll mechanism, we study the usefulness of imperfect information on system state (queue size, for example) as a way to reduce the over-congestion by self-interested customers. The main conclusion of this paper is that by purposefully giving fuzzy or imperfect information on the current queue size we can improve the congestion in the system. This result might look contradictory to rough intuition since perfect information should give better performance than imperfect information. We show how this idea is verified. In deriving this result, we use the concept of Nash equilibrium (pure and mixed strategy) as introduced in game theory. In some real situations, using imperfect information is easier to apply than imposing a toll, and thus the result of this paper has practical implications.

  • PDF

A Study on the Model of Competitive Electricity Market Considering Emission Trading (온실가스 배출권 거래제도를 고려한 경쟁적 전력시장 모형 연구)

  • Kim, Sang-Hoon;Lee, Kwang-Ho;Kim, Wook
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.58 no.8
    • /
    • pp.1496-1503
    • /
    • 2009
  • The United Nations Framework Convention on Climate Change (UNFCCC) is an international environmental treaty to stabilize greenhouse gas concentrations in the atmosphere. In order to fulfil the commitments of the countries in an economically efficient way, the UNFCCC adapted the emission trading scheme in the Kyoto Protocol. If the UNFCCC's scheme is enforced in the country, considerable changes in electric power industry are expected due to the imposed greenhouse gas emission reduction. This paper proposes a game theoretic model of the case when generation companies participate in both competitive electricity market and emission market simultaneously. The model is designed such that generation companies select strategically between power quantity and greenhouse gas reduction to maximize their profits in both markets. Demand function and Environmental Welfare of emission trading market is proposed in this model. From the simulation results using the proposed model the impact of the emission trading on generation companies seems very severe in case that the emission prices are significantly high.

Load Balancing Algorithm of Ultra-Dense Networks: a Stochastic Differential Game based Scheme

  • Xu, Haitao;He, Zhen;Zhou, Xianwei
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.9 no.7
    • /
    • pp.2454-2467
    • /
    • 2015
  • Increasing traffic and bandwidth requirements bring challenges to the next generation wireless networks (5G). As one of the main technology in 5G networks, Ultra-Dense Network (UDN) can be used to improve network coverage. In this paper, a radio over fiber based model is proposed to solve the load balancing problem in ultra-dense network. Stochastic differential game is introduced for the load balancing algorithm, and optimal load allocated to each access point (RAP) are formulated as Nash Equilibrium. It is proved that the optimal load can be achieved and the stochastic differential game based scheme is applicable and acceptable. Numerical results are given to prove the effectiveness of the optimal algorithm.

The Effects of Decision-Making Situation In Ultimatum Game (최후통첩게임에서 의사결정 상황의 영향)

  • Park, Sang-June;Cheon, Do-Jeong
    • Korean Management Science Review
    • /
    • v.25 no.2
    • /
    • pp.1-12
    • /
    • 2008
  • In the ultimatum game two players have to divide a certain amount of money between them. One player is the allocator and proposes a division of the money. The other is the recipient and can either accept or reject the proposed division. If the recipient accepts, the money is divided as proposed. If the recipient rejects, however, both players receive nothing. Purchase decisions could be classified on two basic factors (or dimensions) : involvement and think/feel in the FCB grid model. In this study we studied the influences of the two factors in purchase decisions on the choice of strategy (or propensity to fairness) in the ultimatum game. The empirical study showed that a decision maker chooses rational strategy more frequently when he (or she) is thinkful (or cognitive) in high involvement level.

An Integrated Game Theoretical Approach for Primary and Secondary Users Spectrum Sharing in Cognitive Radio Networks

  • Kim, Jong-Gyu;Nguyen, Khanh-Huy;Lee, Jung-Tae;Hwang, Won-Joo
    • Journal of Korea Multimedia Society
    • /
    • v.14 no.12
    • /
    • pp.1549-1558
    • /
    • 2011
  • In this paper, we address the problem of bandwidth sharing among multiple primary users and multiple secondary users in a cognitive radio network. In cognitive radio networks, effective spectrum assignment for primary and secondary users is a challenge due to the available broad range of radio frequency spectrum as well as the requisition of harmonious coexistence of both users. To handle this problem, firstly, Bertrand game model is used to analyze a spectrum pricing in which multiple primary users emulate with each other to acquire maximal profit. After that, we employ Cournot game to model the spectrum sharing of secondary users to obtain optimal profit for each user also. Simulation results show that our scheme obtains optimal solution at Nash equilibrium.