“进化稳定策略”的版本间的差异

来自集智百科 - 复杂系统|人工智能|复杂科学|复杂网络|自组织
跳到导航 跳到搜索
Jie讨论 | 贡献
第63行: 第63行:
 
An evolutionarily stable strategy (ESS) is a strategy (or set of strategies) which, if adopted by a population in a given environment, is impenetrable, meaning that it cannot be invaded by any alternative strategy (or strategies) that are initially rare. It is relevant in game theory, behavioural ecology, and evolutionary psychology. An ESS is an equilibrium refinement of the Nash equilibrium. It is a Nash equilibrium that is "evolutionarily" stable: once it is fixed in a population, natural selection alone is sufficient to prevent alternative (mutant) strategies from invading successfully. The theory is not intended to deal with the possibility of gross external changes to the environment that bring new selective forces to bear.
 
An evolutionarily stable strategy (ESS) is a strategy (or set of strategies) which, if adopted by a population in a given environment, is impenetrable, meaning that it cannot be invaded by any alternative strategy (or strategies) that are initially rare. It is relevant in game theory, behavioural ecology, and evolutionary psychology. An ESS is an equilibrium refinement of the Nash equilibrium. It is a Nash equilibrium that is "evolutionarily" stable: once it is fixed in a population, natural selection alone is sufficient to prevent alternative (mutant) strategies from invading successfully. The theory is not intended to deal with the possibility of gross external changes to the environment that bring new selective forces to bear.
  
'''<font color="#ff8000"> 进化均衡策略Evolutionarily Stable Strategy(ESS)</font>'''是指一个种群在特定环境下采用的策略或策略组,它具有不可渗透性,即该群体不可能被初期占比小的其他策略或策略组所入侵。它与'''<font color="#ff8000"> 博弈论Game Theory</font>''','''<font color="#ff8000"> 行为生态学Behavioural Ecology</font>'''和'''<font color="#ff8000"> 进化心理学Evolutionary Psychology</font>'''有关。进化均衡策略是'''<font color="#ff8000"> 纳什均衡Nash equilibrium</font>'''的细化,相当于是稳定进化的纳什均衡:一旦该种群采取了此策略,仅自然选择过程就足以防止其他(变异)的策略成功入侵。该理论并非通过有目的性地处理外部总体环境可能发生的变化,来引入新的种群进化选择力。
+
'''<font color="#ff8000"> 进化均衡策略Evolutionarily Stable Strategy(ESS)</font>'''是指一个种群在特定环境下采用的策略或策略组,它具有不可渗透性,即该群体不可能被初期占比小的其他策略或策略组所入侵。它与'''<font color="#ff8000"> 博弈论Game Theory</font>''','''<font color="#ff8000"> 行为生态学Behavioural Ecology</font>'''和'''<font color="#ff8000"> 进化心理学Evolutionary Psychology</font>'''有关。进化均衡策略是'''<font color="#ff8000"> 纳什均衡Nash equilibrium</font>'''的细化,相当于是稳定进化的纳什均衡:一旦该种群采取了此策略,仅自然选择过程就足以防止其他(变异)的策略成功入侵。'''<font color="#32CD32">该理论并非通过有目的性地处理外部环境可能发生的变化,来引入新的种群进化选择力。</font>'''
  
  

2020年8月13日 (四) 09:37的版本

此词条由Jie初步翻译。

{{Infobox equilibrium

{{Infobox equilibrium

模板:Infobox equilibrium

}}

}}


An evolutionarily stable strategy (ESS) is a strategy (or set of strategies) which, if adopted by a population in a given environment, is impenetrable, meaning that it cannot be invaded by any alternative strategy (or strategies) that are initially rare. It is relevant in game theory, behavioural ecology, and evolutionary psychology. An ESS is an equilibrium refinement of the Nash equilibrium. It is a Nash equilibrium that is "evolutionarily" stable: once it is fixed in a population, natural selection alone is sufficient to prevent alternative (mutant) strategies from invading successfully. The theory is not intended to deal with the possibility of gross external changes to the environment that bring new selective forces to bear.

An evolutionarily stable strategy (ESS) is a strategy (or set of strategies) which, if adopted by a population in a given environment, is impenetrable, meaning that it cannot be invaded by any alternative strategy (or strategies) that are initially rare. It is relevant in game theory, behavioural ecology, and evolutionary psychology. An ESS is an equilibrium refinement of the Nash equilibrium. It is a Nash equilibrium that is "evolutionarily" stable: once it is fixed in a population, natural selection alone is sufficient to prevent alternative (mutant) strategies from invading successfully. The theory is not intended to deal with the possibility of gross external changes to the environment that bring new selective forces to bear.

进化均衡策略Evolutionarily Stable Strategy(ESS)是指一个种群在特定环境下采用的策略或策略组,它具有不可渗透性,即该群体不可能被初期占比小的其他策略或策略组所入侵。它与 博弈论Game Theory 行为生态学Behavioural Ecology 进化心理学Evolutionary Psychology有关。进化均衡策略是 纳什均衡Nash equilibrium的细化,相当于是稳定进化的纳什均衡:一旦该种群采取了此策略,仅自然选择过程就足以防止其他(变异)的策略成功入侵。该理论并非通过有目的性地处理外部环境可能发生的变化,来引入新的种群进化选择力。


First published as a specific term in the 1972 book by John Maynard Smith,[1] the ESS is widely used in behavioural ecology and economics, and has been used in anthropology, evolutionary psychology, philosophy, and political science.

First published as a specific term in the 1972 book by John Maynard Smith, the ESS is widely used in behavioural ecology and economics, and has been used in anthropology, evolutionary psychology, philosophy, and political science.

在1972年由约翰·梅纳德·史密斯John Maynard Smith出版的书中,进化均衡策略首次作为一个特定的术语出现,它广泛应用于行为生态学和经济学,同时在人类学、进化心理学、哲学和政治科学中均已被使用。


History 历史

Evolutionarily stable strategies were defined and introduced by John Maynard Smith and George R. Price in a 1973 Nature paper.[2] Such was the time taken in peer-reviewing the paper for Nature that this was preceded by a 1972 essay by Maynard Smith in a book of essays titled On Evolution.[1] The 1972 essay is sometimes cited instead of the 1973 paper, but university libraries are much more likely to have copies of Nature. Papers in Nature are usually short; in 1974, Maynard Smith published a longer paper in the Journal of Theoretical Biology.[3] Maynard Smith explains further in his 1982 book Evolution and the Theory of Games.[4] Sometimes these are cited instead. In fact, the ESS has become so central to game theory that often no citation is given, as the reader is assumed to be familiar with it.

Evolutionarily stable strategies were defined and introduced by John Maynard Smith and George R. Price in a 1973 Nature paper. Such was the time taken in peer-reviewing the paper for Nature that this was preceded by a 1972 essay by Maynard Smith in a book of essays titled On Evolution. (wiki后期添加的内容The 1972 essay is sometimes cited instead of the 1973 paper, but university libraries are much more likely to have copies of Nature. Papers in Nature are usually short; in 1974, Maynard Smith published a longer paper in the Journal of Theoretical Biology.[3] )Maynard Smith explains further in his 1982 book Evolution and the Theory of Games. Sometimes these are cited instead. In fact, the ESS has become so central to game theory that often no citation is given, as the reader is assumed to be familiar with it.

进化均衡策略是由约翰·梅纳德·史密斯John Maynard Smith和 乔治·普赖斯George R. Price 在1973年的《自然》杂志上定义和提出的。但是由于同行评审《自然》的论文花费了大量时间,以至于在此之前,梅纳德 史密斯就在1972年的一本论文集《论进化论》中发表了另一篇论文。有时候学者们会选择引用1972年在《论进化论》上发表的论文而非1973年《自然》杂志上的,但大学图书馆可能收藏有《自然》的副本。通常《自然》杂志上的论文很短;随后1974年,梅纳德·史密斯在《理论生物学》杂志上又发表了一篇更长的论文。在1982年梅纳德·史密斯的新著作《演化与博弈论》中,他又进一步解释了这个概念。之后该版本的解释时常被引用。实际上,进化均衡策略已经成为了博弈论的核心,往往没有引证给出,因为假定了读者是熟悉它的。


Maynard Smith mathematically formalised a verbal argument made by Price, which he read while peer-reviewing Price's paper. When Maynard Smith realized that the somewhat disorganised Price was not ready to revise his article for publication, he offered to add Price as co-author.

Maynard Smith mathematically formalised a verbal argument made by Price, which he read while peer-reviewing Price's paper. When Maynard Smith realized that the somewhat disorganised Price was not ready to revise his article for publication, he offered to add Price as co-author.

当梅纳德·史密斯在同行评审普莱斯论文的时候读到了这个论点,随后他将这个口头论点数学形式化。之后史密斯意识到杂乱无章的普莱斯应该是还没有准备好修改他自己的文章去发表,于是就提出了加上普莱斯名字作为合著者。


The concept was derived from R. H. MacArthur[5] and W. D. Hamilton's[6] work on sex ratios, derived from Fisher's principle, especially Hamilton's (1967) concept of an unbeatable strategy. Maynard Smith was jointly awarded the 1999 Crafoord Prize for his development of the concept of evolutionarily stable strategies and the application of game theory to the evolution of behaviour.[7]

The concept was derived from R. H. MacArthur and W. D. Hamilton's work on sex ratios, derived from Fisher's principle, especially Hamilton's (1967) concept of an unbeatable strategy. Maynard Smith was jointly awarded the 1999 Crafoord Prize for his development of the concept of evolutionarily stable strategies and the application of game theory to the evolution of behaviour.

这个概念源自于麦克阿瑟R. H. MacArthur和汉密尔顿W. D. Hamilton关于性别比例的研究,以及费雪原理Fisher's principle,另外尤其是汉密尔顿(1967)提出的“无敌战略Unbeatable Strategy“的概念。随后1999年,梅纳德·史密斯因其对“进化均衡策略”概念的发展,以及“行为进化博弈论“的应用研究做出了杰出贡献,与以上学者共同获得了著名的Crafoord奖。


Uses of ESS: Uses of ESS: 进化均衡策略的应用

• 进化均衡策略是理查德·道金斯Richard Dawkins1976年最畅销的著作《自私的基因The Selfish Gene》中用来分析进化的主要元素。

• 由罗伯特·阿克塞尔罗德Robert Axelrod在1984年创作出版的《合作的进化The Evolution of Cooperation》一书中首次将进化均衡策略用于社会科学领域。从那时起,它就被广泛用于社会科学,包括人类学,经济学,哲学和政治学。

  • In the social sciences, the primary interest is not in an ESS as the end of biological evolution, but as an end point in cultural evolution or individual learning.[8]

• 在社会科学中,最主要的兴趣不是将进化均衡策略作为生物进化的终点,而是将其作为文化进化或个体学习的终点。

• 在进化心理学中,进化均衡策略主要用作人类生物学进化的模型。


Motivation 策略的假设与动机

The Nash equilibrium is the traditional solution concept in game theory. It depends on the cognitive abilities of the players. It is assumed that players are aware of the structure of the game and consciously try to predict the moves of their opponents and to maximize their own payoffs. In addition, it is presumed that all the players know this (see common knowledge). These assumptions are then used to explain why players choose Nash equilibrium strategies.

The Nash equilibrium is the traditional solution concept in game theory. It depends on the cognitive abilities of the players. It is assumed that players are aware of the structure of the game and consciously try to predict the moves of their opponents and to maximize their own payoffs. In addition, it is presumed that all the players know this (see common knowledge). These assumptions are then used to explain why players choose Nash equilibrium strategies.

在博弈论中,纳什均衡相当于一种传统的解决方案概念,而这取决于玩家的认知能力。假定玩家知道游戏的结构,有意识地尝试预测对手的行动,并最大程度地提高自己的收益。另外,纳什均衡也假定所有玩家都知道这一点(请参阅常识性知识common knowledge)。后来这些假设又被用于解释为什么玩家会选择纳什均衡策略。


Evolutionarily stable strategies are motivated entirely differently. Here, it is presumed that the players' strategies are biologically encoded and heritable. Individuals have no control over their strategy and need not be aware of the game. They reproduce and are subject to the forces of natural selection, with the payoffs of the game representing reproductive success (biological fitness). It is imagined that alternative strategies of the game occasionally occur, via a process like mutation. To be an ESS, a strategy must be resistant to these alternatives.

Evolutionarily stable strategies are motivated entirely differently. Here, it is presumed that the players' strategies are biologically encoded and heritable. Individuals have no control over their strategy and need not be aware of the game. They reproduce and are subject to the forces of natural selection, with the payoffs of the game representing reproductive success (biological fitness). It is imagined that alternative strategies of the game occasionally occur, via a process like mutation. To be an ESS, a strategy must be resistant to these alternatives.

进化均衡策略的动机则完全不同。该策略被假定为具有生物编码性而且可遗传至下一代。玩家个人并不能控制自己的策略,也无需了解游戏规则。他们繁殖并服从自然选择,而游戏的收益则代表着繁殖成功(生物适应性)。同时可以想象,在繁殖过程中,游戏策略偶尔会通过类似基因突变而无计划地发生变异,产生其方案策略。之后他们会通过互相抵制直到出现最优势的策略,即进化均衡策略。


Given the radically different motivating assumptions, it may come as a surprise that ESSes and Nash equilibria often coincide. In fact, every ESS corresponds to a Nash equilibrium, but some Nash equilibria are not ESSes.

Given the radically different motivating assumptions, it may come as a surprise that ESSes and Nash equilibria often coincide. In fact, every ESS corresponds to a Nash equilibrium, but some Nash equilibria are not ESSes.

考虑到本质上全然不同的动机假设,进化均衡策略和纳什均衡偶尔的一致性可能令人港澳惊讶。实际上,每个进化均衡策略都有对应的纳什均衡,但是某些纳什均衡却不同于进化均衡策略。


Nash equilibrium

-->

-->


An ESS is a refined or modified form of a Nash equilibrium. (See the next section for examples which contrast the two.) In a Nash equilibrium, if all players adopt their respective parts, no player can benefit by switching to any alternative strategy. In a two player game, it is a strategy pair. Let E(S,T) represent the payoff for playing strategy S against strategy T. The strategy pair (S, S) is a Nash equilibrium in a two player game if and only if this is true for both players and for all TS:

E(S,S) ≥ E(T,S)

An ESS is a refined or modified form of a Nash equilibrium. (See the next section for examples which contrast the two.) In a Nash equilibrium, if all players adopt their respective parts, no player can benefit by switching to any alternative strategy. In a two player game, it is a strategy pair. Let E(S,T) represent the payoff for playing strategy S against strategy T. The strategy pair (S, S) is a Nash equilibrium in a two player game if and only if this is true for both players and for all T≠S:

E(S,S) ≥ E(T,S)

进化均衡策略是纳什均衡的改进式(关于两者的对比,见下一章节)。在纳什均衡中,如果所有参与者都采用各自的策略方案,且都无法通过改用任何其他策略而从中获益。那么在该两人游戏中,我们将此看作一个策略对。令E(S,T)表示策略S对策略T的收益。当且仅当双方都成立且所有T≠S时,策略对(S,S)为该两人游戏中的纳什均衡: E(S,S) ≥ E(T,S)


In this definition, strategy T can be a neutral alternative to S (scoring equally well, but not better).

In this definition, strategy T can be a neutral alternative to S (scoring equally well, but not better).

在这个定义中,策略T可以成为S的中性替代(即最后得分相同,但并不更好)。


A Nash equilibrium is presumed to be stable even if T scores equally, on the assumption that there is no long-term incentive for players to adopt T instead of S. This fact represents the point of departure of the ESS.

A Nash equilibrium is presumed to be stable even if T scores equally, on the assumption that there is no long-term incentive for players to adopt T instead of S. This fact represents the point of departure of the ESS.

即使采用T后其得分相等,纳什均衡也被认为是稳定的,当然前提是假设不存在长期动机去鼓励玩家采用T而不是S。


Maynard Smith and Price[2] specify two conditions for a strategy S to be an ESS. For all TS, either 1. E(S,S) > E(T,S), or 2. E(S,S) = E(T,S) and E(S,T) > E(T,T)

Maynard Smith and Price specify two conditions for a strategy S to be an ESS. For all T≠S, either 1. E(S,S) > E(T,S), or 2. E(S,S) = E(T,S) and E(S,T) > E(T,T)

梅纳德·史密斯和普莱斯为策略S指定了两个条件,使其成为进化均衡策略,对于所有的T≠S,两个选其一: 1. E(S,S) > E(T,S), 或者 2. E(S,S) = E(T,S) and E(S,T) > E(T,T)


The first condition is sometimes called a strict Nash equilibrium.[9] The second is sometimes called "Maynard Smith's second condition". The second condition means that although strategy T is neutral with respect to the payoff against strategy S, the population of players who continue to play strategy S has an advantage when playing against T.

The first condition is sometimes called a strict Nash equilibrium. The second is sometimes called "Maynard Smith's second condition". The second condition means that although strategy T is neutral with respect to the payoff against strategy S, the population of players who continue to play strategy S has an advantage when playing against T.

第一个条件有时称为严格的纳什均衡。而第二个有时称为“梅纳德·史密斯的第二个条件”,它意味着,尽管策略T在对抗策略S时收益不变,但继续使用策略S的玩家在对抗策略T时收益具有明显优势。


There is also an alternative, stronger definition of ESS, due to Thomas.[10] This places a different emphasis on the role of the Nash equilibrium concept in the ESS concept. Following the terminology given in the first definition above, this definition requires that for all TS 1. E(S,S) ≥ E(T,S),and 2. E(S,T) > E(T,T),

There is also an alternative, stronger definition of ESS, due to Thomas. This places a different emphasis on the role of the Nash equilibrium concept in the ESS concept. Following the terminology given in the first definition above, this definition requires that for all T≠S 1. E(S,S) ≥ E(T,S),and 2. E(S,T) > E(T,T),

后来伯恩哈德·托马斯Bernhard Thomas在他的论文《On evolutionarily stable sets》中提出了更大胆的定义。它不同于纳什均衡概念在进化均衡策略中的作用。根据上面第一个定义中给出的术语,此处要求对所有T≠S: 1. E(S,S) ≥ E(T,S),并且 2. E(S,T) > E(T,T),


In this formulation, the first condition specifies that the strategy is a Nash equilibrium, and the second specifies that Maynard Smith's second condition is met. Note that the two definitions are not precisely equivalent: for example, each pure strategy in the coordination game below is an ESS by the first definition but not the second.

In this formulation, the first condition specifies that the strategy is a Nash equilibrium, and the second specifies that Maynard Smith's second condition is met. Note that the two definitions are not precisely equivalent: for example, each pure strategy in the coordination game below is an ESS by the first definition but not the second.

在这两个公式中,第一个指定了该策略采取纳什均衡,而第二则是指定满足梅纳德·史密斯的第二个条件。请注意,这两个定义并不完全相等:例如,在接下来的协调游戏中的每个独立策略都是第一个定义的进化均衡策略,而非第二个。


In words, this definition looks like this: The payoff of the first player when both players play strategy S is higher than (or equal to) the payoff of the first player when he changes to another strategy T and the second player keeps his strategy S and the payoff of the first player when only his opponent changes his strategy to T is higher than his payoff in case that both of players change their strategies to T.

In words, this definition looks like this: The payoff of the first player when both players play strategy S is higher than (or equal to) the payoff of the first player when he changes to another strategy T and the second player keeps his strategy S and the payoff of the first player when only his opponent changes his strategy to T is higher than his payoff in case that both of players change their strategies to T.

换句话说,此定义还可以这么理解,当两个玩家都玩策略S时:1. 第一个玩家的收益要高于(或等于)当第一个玩家更改为策略T而第二个玩家保持策略S时的收益。2. 当第一个玩家的对手将策略更改为T时,第一个玩家自身的收益要大于他们两者都更改为策略T。


This formulation more clearly highlights the role of the Nash equilibrium condition in the ESS. It also allows for a natural definition of related concepts such as a weak ESS or an evolutionarily stable set.[10]

This formulation more clearly highlights the role of the Nash equilibrium condition in the ESS. It also allows for a natural definition of related concepts such as a weak ESS or an evolutionarily stable set.

这种表述更清楚地强调了纳什均衡条件在进化均衡策略中的作用。同时还考虑到对相关概念进行自然定义,例如弱进化均衡策略Weak evolutionarily stable strategy或进化均衡集合Evolutionarily stable set。


Examples of differences between Nash equilibria and ESSes 纳什均衡与进化均衡策略之间差异的示例

囚徒困境prisoner's dilemma
合作Cooperate 叛变Defect
合作Cooperate 3, 3 1, 4
叛变Defect 4, 1 2, 2
以邻为壑Harm thy neighbor
A B
A 2,2 1,2
B 2,1 2,2


In most simple games, the ESSes and Nash equilibria coincide perfectly. For instance, in the prisoner's dilemma there is only one Nash equilibrium, and its strategy (Defect) is also an ESS.

In most simple games, the ESSes and Nash equilibria coincide perfectly. For instance, in the prisoner's dilemma there is only one Nash equilibrium, and its strategy (Defect) is also an ESS.

在大多数简单的游戏中,进化均衡策略和纳什均衡完全重合。例如,在游戏《囚徒困境Prisoner's Dilemma》中,只有一个纳什均衡,其策略(叛变)也是一种进化均衡策略。


Some games may have Nash equilibria that are not ESSes. For example, in harm thy neighbor (whose payoff matrix is shown here) both (A, A) and (B, B) are Nash equilibria, since players cannot do better by switching away from either. However, only B is an ESS (and a strong Nash). A is not an ESS, so B can neutrally invade a population of A strategists and predominate, because B scores higher against B than A does against B. This dynamic is captured by Maynard Smith's second condition, since E(A, A) = E(B, A), but it is not the case that E(A,B) > E(B,B).

Some games may have Nash equilibria that are not ESSes. For example, in harm thy neighbor (whose payoff matrix is shown here) both (A, A) and (B, B) are Nash equilibria, since players cannot do better by switching away from either. However, only B is an ESS (and a strong Nash). A is not an ESS, so B can neutrally invade a population of A strategists and predominate, because B scores higher against B than A does against B. This dynamic is captured by Maynard Smith's second condition, since E(A, A) = E(B, A), but it is not the case that E(A,B) > E(B,B).

还有一些游戏可能具有非进化均衡策略的纳什均衡。例如,在游戏《以邻为壑Harm thy neighbor》中(此处显示为回报矩阵),(A,A)和(B,B)都是纳什均衡,因为玩家无法通过选择放弃任一个来做得更好。但是,只有B是进化均衡策略(也是强纳什)。A不是进化均衡策略,因此B可以中立地入侵A策略的群体并占据优势地位,因为B对B的得分要比A对B的得分高。由于E(A,A)= E(B,A),因此可以通过梅纳德·史密斯的第二个条件来捕获此动态,但是E(A,B)> E(B,B)并非如此。


伤害大家Harm everyone
C D
C 2,2 1,2
D 2,1 0,0
小鸡博弈The Game of Chicken
转身离开Swerve 留下Stay
转身离开Swerve 0,0 -1,+1
留下Stay +1,-1 -20,-20


Nash equilibria with equally scoring alternatives can be ESSes. For example, in the game Harm everyone, C is an ESS because it satisfies Maynard Smith's second condition. D strategists may temporarily invade a population of C strategists by scoring equally well against C, but they pay a price when they begin to play against each other; C scores better against D than does D. So here although E(C, C) = E(D, C), it is also the case that E(C,D) > E(D,D). As a result, C is an ESS.

Nash equilibria with equally scoring alternatives can be ESSes. For example, in the game Harm everyone, C is an ESS because it satisfies Maynard Smith's second condition. D strategists may temporarily invade a population of C strategists by scoring equally well against C, but they pay a price when they begin to play against each other; C scores better against D than does D. So here although E(C, C) = E(D, C), it is also the case that E(C,D) > E(D,D). As a result, C is an ESS.

纳什均衡以及同等评分的策略都可以是进化均衡策略。例如,在游戏《伤害大家Harm everyone》中,C是进化均衡策略,因为它满足了梅纳德·史密斯的第二条件。D策略可以暂时入侵C策略群体,因为D策略可以获得和C策略一样的评分。但是当他们开始互相对抗时,他们会付出一定的代价;C对D的得分比D对D的得分高。因此,尽管E(C,C)=E(D,C),但E(C,D)> E(D,D)。因此,最后C是最终进化均衡策略。


Even if a game has pure strategy Nash equilibria, it might be that none of those pure strategies are ESS. Consider the Game of chicken. There are two pure strategy Nash equilibria in this game (Swerve, Stay) and (Stay, Swerve). However, in the absence of an uncorrelated asymmetry, neither Swerve nor Stay are ESSes. There is a third Nash equilibrium, a mixed strategy which is an ESS for this game (see Hawk-dove game and Best response for explanation).

Even if a game has pure strategy Nash equilibria, it might be that none of those pure strategies are ESS. Consider the Game of chicken. There are two pure strategy Nash equilibria in this game (Swerve, Stay) and (Stay, Swerve). However, in the absence of an uncorrelated asymmetry, neither Swerve nor Stay are ESSes. There is a third Nash equilibrium, a mixed strategy which is an ESS for this game (see Hawk-dove game and Best response for explanation).

还有一些游戏即使具有纯粹的纳什均衡策略,但可能它们都不是进化均衡策略。比如游戏《小鸡博弈The Game of Chicken》,该游戏中有两种纯粹的纳什均衡策略(转身离开Swerve,留下Stay)和(留下Stay,转身离开Swerve)。但是,在无关联不对称Uncorrelated Asymmetry缺失的情况下,Swerve和Stay都不是进化均衡策略。此时存在第三种纳什均衡,它属于混合策略并且是该游戏的进化均衡策略(详情请参见《鹰鸽博弈Hawk-dove》游戏和《最佳响应Best Response》以获得解释)。


This last example points to an important difference between Nash equilibria and ESS. Nash equilibria are defined on strategy sets (a specification of a strategy for each player), while ESS are defined in terms of strategies themselves. The equilibria defined by ESS must always be symmetric, and thus have fewer equilibrium points.

This last example points to an important difference between Nash equilibria and ESS. Nash equilibria are defined on strategy sets (a specification of a strategy for each player), while ESS are defined in terms of strategies themselves. The equilibria defined by ESS must always be symmetric, and thus have fewer equilibrium points.

最后一个示例指出了纳什均衡与进化均衡策略之间的重要区别。纳什均衡是在策略集(每个参与者的策略规范)上定义的,而进化均衡策略是根据策略本身定义的。进化均衡策略定义的平衡必须始终是对称的,因此其平衡点更少。


Vs. evolutionarily stable state 与进化稳定状态的比较

In population biology, the two concepts of an evolutionarily stable strategy (ESS) and an evolutionarily stable state are closely linked but describe different situations.

In population biology, the two concepts of an evolutionarily stable strategy (ESS) and an evolutionarily stable state are closely linked but describe different situations.

在种群生物学中,进化均衡策略(ESS)和进化稳定状态Evolutionarily Stable State这两个概念密切相关,但却描述了不同的情况。


In an evolutionarily stable strategy, if all the members of a population adopt it, no mutant strategy can invade.[4] Once virtually all members of the population use this strategy, there is no 'rational' alternative. ESS is part of classical game theory.

In an evolutionarily stable strategy, if all the members of a population adopt it, no mutant strategy can invade. Once virtually all members of the population use this strategy, there is no 'rational' alternative. ESS is part of classical game theory.

在进化均衡策略中,如果所有种群的成员都采用它,那么任何突变策略都无法入侵。无形中只要所有成员都使用了这种策略,就不再有“理性”的选择。进化均衡策略是经典博弈论的一部分。


In an evolutionarily stable state, a population's genetic composition is restored by selection after a disturbance, if the disturbance is not too large. An evolutionarily stable state is a dynamic property of a population that returns to using a strategy, or mix of strategies, if it is perturbed from that initial state. It is part of population genetics, dynamical system, or evolutionary game theory. This is now called convergent stability.[11]

In an evolutionarily stable state, a population's genetic composition is restored by selection after a disturbance, if the disturbance is not too large. An evolutionarily stable state is a dynamic property of a population that returns to using a strategy, or mix of strategies, if it is perturbed from that initial state. It is part of population genetics, dynamical system, or evolutionary game theory. This is now called convergent stability.

在稳定的进化状态下,如果干扰不太大的话,即使受到冲击,种群的基因组成通过策略选择同样能够进行恢复。而进化稳定状态是种群的动态特性,即使受到初始状态的干扰,该状态会通过使用策略或混合策略组进行恢复。它是群体遗传学,动力学系统或进化博弈论的一部分。现在称为收敛稳定性。


B. Thomas (1984) applies the term ESS to an individual strategy which may be mixed, and evolutionarily stable population state to a population mixture of pure strategies which may be formally equivalent to the mixed ESS.[12]

B. Thomas (1984) applies the term ESS to an individual strategy which may be mixed, and evolutionarily stable population state to a population mixture of pure strategies which may be formally equivalent to the mixed ESS.

托马斯B. Thomas(1984)将“进化均衡策略”这一术语应用于可混合的独立策略,并将“进化稳定种群状态”应用于采取纯策略的混合种群,该应用在形式上可能等同于混合的“进化均衡策略”。


Whether a population is evolutionarily stable does not relate to its genetic diversity: it can be genetically monomorphic or polymorphic.[4]

Whether a population is evolutionarily stable does not relate to its genetic diversity: it can be genetically monomorphic or polymorphic.

种群是否在进化过程中处于稳定状态与它的基因多样性无关:它可以是遗传上的单态或多态的。


Stochastic ESS 随机的进化均衡策略

In the classic definition of an ESS, no mutant strategy can invade. In finite populations, any mutant could in principle invade, albeit at low probability, implying that no ESS can exist. In an infinite population, an ESS can instead be defined as a strategy which, should it become invaded by a new mutant strategy with probability p, would be able to counterinvade from a single starting individual with probability >p, as illustrated by the evolution of bet-hedging.[13]

In the classic definition of an ESS, no mutant strategy can invade. In finite populations, any mutant could in principle invade, albeit at low probability, implying that no ESS can exist. In an infinite population, an ESS can instead be defined as a strategy which, should it become invaded by a new mutant strategy with probability p, would be able to counterinvade from a single starting individual with probability >p, as illustrated by the evolution of bet-hedging.

在进化均衡策略的经典定义中,没有任何突变策略可以入侵。然而在有限种群中,任何突变体原则上是可以入侵的,尽管可能性很小,这就意味着在这个种群中绝对没有进化均衡策略的存在。如果在无限种群中,存在一个概率为P的新突变策略入侵,此时,进化均衡策略就被认为是具有概率大于p的策略方案且开始反击最初入侵的新突变策略个体,就像对冲交易的进化过程描述那样。


Prisoner's dilemma 囚徒困境

{{Payoff matrix | Name = Prisoner's Dilemma

模板:Payoff matrix

1 d = 缺陷 | DL = 4,1 | DR = 2,2}


A common model of altruism and social cooperation is the Prisoner's dilemma. Here a group of players would collectively be better off if they could play Cooperate, but since Defect fares better each individual player has an incentive to play Defect. One solution to this problem is to introduce the possibility of retaliation by having individuals play the game repeatedly against the same player. In the so-called iterated Prisoner's dilemma, the same two individuals play the prisoner's dilemma over and over. While the Prisoner's dilemma has only two strategies (Cooperate and Defect), the iterated Prisoner's dilemma has a huge number of possible strategies. Since an individual can have different contingency plan for each history and the game may be repeated an indefinite number of times, there may in fact be an infinite number of such contingency plans.

A common model of altruism and social cooperation is the Prisoner's dilemma. Here a group of players would collectively be better off if they could play Cooperate, but since Defect fares better each individual player has an incentive to play Defect. One solution to this problem is to introduce the possibility of retaliation by having individuals play the game repeatedly against the same player. In the so-called iterated Prisoner's dilemma, the same two individuals play the prisoner's dilemma over and over. While the Prisoner's dilemma has only two strategies (Cooperate and Defect), the iterated Prisoner's dilemma has a huge number of possible strategies. Since an individual can have different contingency plan for each history and the game may be repeated an indefinite number of times, there may in fact be an infinite number of such contingency plans.

利他主义和社会合作的普遍模式就是囚徒的困境。在这里,如果一群玩家选择“合作”,那么他们这个集体就会生活的更好,但是由于“背叛”带来的利益更大,因此每个玩家都有动机去选择“背叛”。解决该问题的其中一个方案是通过让个体反复与同一玩家来对战,以此引入报复机制的可能性。在所谓的囚徒困境迭代过程中,相同的两个人一遍又一遍地扮演着她们的角色。尽管囚犯的困境只有两种策略(合作和背叛),但迭代的囚徒困境游戏却具有大量可能的策略。由于个体对于每个历史可以具有不同的应急计划,并且游戏可以无限次重复,因此实际上可能有无限个此类应急计划。


Three simple contingency plans which have received substantial attention are Always Defect, Always Cooperate, and Tit for Tat. The first two strategies do the same thing regardless of the other player's actions, while the latter responds on the next round by doing what was done to it on the previous round—it responds to Cooperate with Cooperate and Defect with Defect.

Three simple contingency plans which have received substantial attention are Always Defect, Always Cooperate, and Tit for Tat. The first two strategies do the same thing regardless of the other player's actions, while the latter responds on the next round by doing what was done to it on the previous round—it responds to Cooperate with Cooperate and Defect with Defect.

其备受关注的三个简单的应急计划是:“始终背叛”,“始终合作”和“针锋相对”。前两种策略会始终执行相同的操作,而不受另一方行为的影响,而后一种策略则是通过上一轮中执行的操作来对下一轮中的对象做出响应-其响应为“合作对合作”和“背叛对背叛”。


If the entire population plays Tit-for-Tat and a mutant arises who plays Always Defect, Tit-for-Tat will outperform Always Defect. If the population of the mutant becomes too large — the percentage of the mutant will be kept small. Tit for Tat is therefore an ESS, with respect to only these two strategies. On the other hand, an island of Always Defect players will be stable against the invasion of a few Tit-for-Tat players, but not against a large number of them.[14] If we introduce Always Cooperate, a population of Tit-for-Tat is no longer an ESS. Since a population of Tit-for-Tat players always cooperates, the strategy Always Cooperate behaves identically in this population. As a result, a mutant who plays Always Cooperate will not be eliminated. However, even though a population of Always Cooperate and Tit-for-Tat can coexist, if there is a small percentage of the population that is Always Defect, the selective pressure is against Always Cooperate, and in favour of Tit-for-Tat. This is due to the lower payoffs of cooperating than those of defecting in case the opponent defects.

If the entire population plays Tit-for-Tat and a mutant arises who plays Always Defect, Tit-for-Tat will outperform Always Defect. If the population of the mutant becomes too large — the percentage of the mutant will be kept small. Tit for Tat is therefore an ESS, with respect to only these two strategies. On the other hand, an island of Always Defect players will be stable against the invasion of a few Tit-for-Tat players, but not against a large number of them. If we introduce Always Cooperate, a population of Tit-for-Tat is no longer an ESS. Since a population of Tit-for-Tat players always cooperates, the strategy Always Cooperate behaves identically in this population. As a result, a mutant who plays Always Cooperate will not be eliminated. However, even though a population of Always Cooperate and Tit-for-Tat can coexist, if there is a small percentage of the population that is Always Defect, the selective pressure is against Always Cooperate, and in favour of Tit-for-Tat. This is due to the lower payoffs of cooperating than those of defecting in case the opponent defects.

如果整个种群都选择“针锋相对”,并且出现了一个变异者选择了“始终背叛”,那么“针锋相对”将战胜“始终背叛”。如果该变异者的种群太大,则它所占的百分比将保持很小。因此,就这两种策略而言,“针锋相对”就是一种进化均衡策略。另一方面,“始终背叛”的玩家群体可以稳定地抵御少数“针锋相对”玩家的入侵,但不能抵御大量的入侵。 如果我们引入“始终合作”,那么“针锋相对”就不再是进化均衡策略了。由于大量的“针锋相对”玩家转向选择保持合作,因此“始终合作”策略在这一群体中的表现相同。最终,“始终合作”的变异者将不会被淘汰。当然,即使“始终合作”和“针锋相对”的人群可以共存,但是如果“始终背叛”的玩家总量只占一小部分时,那么策略选择压力会对“始终合作”不利,而倾向于支持“针锋相对”。这是由于合作带来的利益要比背叛来的低。


This demonstrates the difficulties in applying the formal definition of an ESS to games with large strategy spaces, and has motivated some to consider alternatives.

This demonstrates the difficulties in applying the formal definition of an ESS to games with large strategy spaces, and has motivated some to consider alternatives.

这证明了要想将进化均衡策略的正式定义应用于具有较大策略空间的游戏中,是非常困难的。因此促使了一些人去考虑替代方案。


Human behavior 人类行为

The fields of sociobiology and evolutionary psychology attempt to explain animal and human behavior and social structures, largely in terms of evolutionarily stable strategies. Sociopathy (chronic antisocial or criminal behavior) may be a result of a combination of two such strategies.[15]

The fields of sociobiology and evolutionary psychology attempt to explain animal and human behavior and social structures, largely in terms of evolutionarily stable strategies. Sociopathy (chronic antisocial or criminal behavior) may be a result of a combination of two such strategies.

社会生物学和进化心理学领域试图通过进化均衡策略,来解释动物和人类的行为以及社会的结构。反社会人格(长期的反社会或犯罪行为)被认为可能是两种此类策略结合的后果。


Evolutionarily stable strategies were originally considered for biological evolution, but they can apply to other contexts. In fact, there are stable states for a large class of adaptive dynamics. As a result, they can be used to explain human behaviours that lack any genetic influences.

Evolutionarily stable strategies were originally considered for biological evolution, but they can apply to other contexts. In fact, there are stable states for a large class of adaptive dynamics. As a result, they can be used to explain human behaviours that lack any genetic influences.

进化均衡策略最初被认为是解释生物进化论的,但是它们也可以应用于其他场景。实际上,一大类自适应动力学都具有稳定状态。因此,它们可以用来解释缺乏不受任何基因影响的人类行为。


See also 其他相关


References

  1. 1.0 1.1 Maynard Smith, J. (1972). "Game Theory and The Evolution of Fighting". On Evolution. Edinburgh University Press. ISBN 0-85224-223-9. https://archive.org/details/onevolution0000mayn. 
  2. 2.0 2.1 Maynard Smith, J.; Price, G.R. (1973). "The logic of animal conflict". Nature. 246 (5427): 15–8. Bibcode:1973Natur.246...15S. doi:10.1038/246015a0.
  3. Maynard Smith, J. (1974). "The Theory of Games and the Evolution of Animal Conflicts" (PDF). Journal of Theoretical Biology. 47 (1): 209–21. doi:10.1016/0022-5193(74)90110-6. PMID 4459582.
  4. 4.0 4.1 4.2 Maynard Smith, John (1982). Evolution and the Theory of Games. ISBN 0-521-28884-3. 
  5. MacArthur, R. H. (1965). Waterman T.. ed. Theoretical and mathematical biology. New York: Blaisdell. 
  6. Hamilton, W.D. (1967). "Extraordinary sex ratios". Science. 156 (3774): 477–88. Bibcode:1967Sci...156..477H. doi:10.1126/science.156.3774.477. JSTOR 1721222. PMID 6021675.
  7. Press release for the 1999 Crafoord Prize
  8. Alexander, Jason McKenzie (23 May 2003). "Evolutionary Game Theory". Stanford Encyclopedia of Philosophy. Retrieved 31 August 2007.
  9. Harsanyi, J (1973). "Oddness of the number of equilibrium points: a new proof". Int. J. Game Theory. 2 (1): 235–50. doi:10.1007/BF01737572.
  10. 10.0 10.1 Thomas, B. (1985). "On evolutionarily stable sets". J. Math. Biology. 22: 105–115. doi:10.1007/bf00276549.
  11. Apaloo, J.; Brown, J. S.; Vincent, T. L. (2009). "Evolutionary game theory: ESS, convergence stability, and NIS". Evolutionary Ecology Research. 11: 489–515. Archived from the original on 2017-08-09. Retrieved 2018-01-10.
  12. Thomas, B. (1984). "Evolutionary stability: states and strategies". Theor. Popul. Biol. 26 (1): 49–67. doi:10.1016/0040-5809(84)90023-6.
  13. King, Oliver D.; Masel, Joanna (1 December 2007). "The evolution of bet-hedging adaptations to rare scenarios". Theoretical Population Biology. 72 (4): 560–575. doi:10.1016/j.tpb.2007.08.006. PMC 2118055. PMID 17915273.
  14. Axelrod, Robert (1984). The Evolution of Cooperation. ISBN 0-465-02121-2. 
  15. Mealey, L. (1995). "The sociobiology of sociopathy: An integrated evolutionary model". Behavioral and Brain Sciences. 18 (3): 523–99. doi:10.1017/S0140525X00039595.


Further reading

  • Parker, G. A. (1984) Evolutionary stable strategies. In Behavioural Ecology: an Evolutionary Approach (2nd ed) Krebs, J. R. & Davies N.B., eds. pp 30–61. Blackwell, Oxford.