### Lecture 8,9 and 10: Mathematical and Theoretical Insights in Animal Behaviour

APS209 Animal Behaviour

Mathematical and theoretical insights in animal behaviour
Aims

## 1. To introduce the use of simple mathematics in the study of animal behaviour.

2. To show how to combine mathematics with biology.

## Objectives

1. Understand the use of figures and equations to express mathematical ideas in biology.
2. Understand how to combine mathematics with biology.
3. Lose fear of a mathematical approach in biology by being able to follow some simple models.

This lecture on mathematical and theoretical insights will introduce you to the use of maths in biology in the context of important questions in animal behaviour. No mathematical background beyond GCSE is necessary. The material will cover two topics. 1. Inclusive fitness theory; 2. Game theory.

To maximize the number of copies of genes in the next generation, an individual can:
1)    Produce as many offspring itself
2)    Help to raise siblings/ offspring of siblings

1. Inclusive fitness theory
The slides provide the information to understand this section. We first consider Hamilton’s rule (Inclusive Fitness Theory) in the context of cannibalism by tiger salamanders, following up on the research by David Pfennig (see Alcock pp 95-96) showing that salamanders are less likely to be cannibalistic when in a tank with siblings versus unrelated individuals. We can consider cannibalism to be a social action (i.e., directed at members of the same species in your environment) and determine how variation in relatedness between individuals, and the cost and benefit of the action to actor and recipient influence whether natural selection will favour carrying out that action or not.
Hamilton’s Rule states that a social action is favoured by natural selection if c < b.r, where c is the cost to the actor (reduced fitness) and b the benefit to the recipient (increased fitness), and r is their genetic relatedness. For example, giving food to another animal will have a survival cost to the actor and so will only be favoured by natural selection if the receiving individual is kin (r positive). Note however, that costs and benefits can be negative. Stealing food is also a social action. Who should actors steal from? In this case the “cost” is negative, and the “benefit” is also negative. Hamilton’s rule is more likely to be satisfied (i.e., stealing is favoured by natural selection) if actors steal from non-kin (r = 0).

2. Game Theory: Introduction and sex ratio

Human sports come in two main kinds. In one type, it is you against the clock or some physical challenge. For example, climbing a mountain or running 100m in the shortest possible time. In the other type, you are playing directly against an opponent. For example, in tennis the best place to put the ball is where your opponent isn’t. In tennis you have to adjust your game according to the opponent’s behaviour. Similar things happen with animals. Many of the challenges facing animals do not depend upon what other animals are doing: a bird migrating alone across the sea, for example. But many of the challenges faced by animals are more like a game of tennis. The best place for a male to find a female may be where there are few other competing males. The best place to find food may be where there are few other foragers. Thus, the fitness benefits of behaviours often depend upon what others are doing.
Game theory was originally developed in the 1940s by John von Neumann as a tool to understand economic and military (“war games”) behaviour. In the 1970’s John Maynard-Smith and George Price started to apply game theory to animal behaviour. At more of less the same time other biologists, particularly William Hamilton, also used game theory ideas to investigate optimal sex ratios and group formation. Price died soon after, but Maynard-Smith went on to develop the theory within a biological context. For those of you who are interested in learning more, his book (Maynard Smith, J. 1982. Evolution and the theory of games. Cambridge University Press) is well worth looking at, or see the references to some of his shorter articles (Maynard Smith 1998, 2002).
On receiving the Kyoto Prize for evolutionary biology in 2001, Maynard Smith commented “I have devoted most of my life to trying to apply mathematical reasoning, for example, Game theory, to biology. Trivial as it may seem, mathematics is of great use in biological studies. This is because verbal models can be interpreted in different ways, depending on who the reader is. Any theory to explain the complicated activities of organisms must always be simple. I felt the greatest happiness in finding that my theory, which I had elaborated after the most tenacious thinking, proved to be correct as some animal turned out to be doing something odd that the theory predicted.” [www.inamori-f.or.jp]. Using game theory in biology can be very mathematical. But it can also have zero or very little mathematics. In these lectures on game theory we will stick to the latter. As Maynard Smith (2002) notes, any theory investigating something as complex as animal behaviour must be simple.

## Sex ratio

It is perhaps surprising to think of a sex ratio as a behavioural strategy. But consider a female who can choose the sex of her offspring. Should she choose males or females or both? If most parents are producing daughters then it is best to produce sons, because on average a son will produce more sets of grand-offspring for his mother. If most parents are producing sons, then it is better to have daughters. But when half of the offspring in the population are sons and half are daughters, then offspring of either sex give a mother the same number of grand-offspring. In other words an equal sex ratio is an ESS (evolutionary stable strategy). It cannot be “invaded” by a better strategy. An equal sex ratio is a “Nash equilibrium” (after the Princeton scientist who devised it in his PhD research and for which he was awarded the Nobel prize for Economics many years later. In a Nash equilibrium, the optimum strategy is its own best reply.) That is, the best reply in a population where every female is producing equal numbers of sons and daughters is to do the same yourself.
A little simple maths will make things clear (see also the slides). Assume that every female has n surviving offspring. Each daughter, therefore, results in n grand-offspring. How many grand-offspring will a son provide? If there are equal numbers of males and females in the population, then each son, on average, will have one mate. So each son will also provide n grand-offspring. But imagine that there are twice as many females as males in the population. Each son will now mate with two females, on average. So each son provides 2n grand-offspring. This shows that if the sex ratio in the population is female biased, then a female having sons will have greater fitness (grand-offspring) that a female having daughters. Likewise, if the sex ratio is male biased, a female having daughters will have higher fitness than a female having sons. In this way, selection tends to cause an even sex ratio.
Many animals, including humans, have a genetic mechanism for determining sex (e.g., XY chromosomes) that can easily give an even sex ratio. This is the proximate cause of an even sex ratio but it is not the ultimate cause. Animals with chromosomal sex determination can adjust offspring sex ratio. Seychelles warblers have chromosomal sex determination (WZ; in birds the female is the heterogametic sex). Females adjust the sex ratio of their brood according to territory quality. This shows that, when there is an advantage for adjusting sex ratio, even animals with chromosomal sex determination can do it. There are other forms of sex determination some of which may make sex ratio adjustment a lot easier for the mother. In Hymenoptera (sawflies, wasps, ants, bees) males are haploid and females diploid. A female can control the sex of her offspring by choosing whether or not to release sperm from the sperm storage organ as the egg is laid. The sperm storage organ is connected to the oviduct via a duct controlled by nerves and muscles.  In honeybees there is conflict between the mother queen and her daughter workers over the sex ratio of young queens and males reared.  The workers may be able to cause a female-biased sex-allocation ratio by selectively killing male larvae and the queen may be able to resist this by laying few female eggs.

3. Game Theory: Hawk-Dove and Hawk-Dove-Bourgeois games and cyclical dynamics.
In the sex ratio game, the contestants (mothers choosing sex of offspring) were all playing each other, which is known as playing the field, as matings take place panmictically. However, many contests may take place between paired opponents, (pairwise contests). For example, if two individuals are contesting ownership of a resource, which forms the next series of examples.
Animals often fight over resources such as food or females. But not all do. Often, one animal quickly backs off. For example, in the speckled wood butterfly, a resident male always wins an encounter with a non-resident over the possession of a sun patch, a location where mating can occur. Traditionally, it was considered that such non-aggressive contests were for the good of the species. But game theory analyses have shown that non-aggressive contests can be explained via their benefits to the individual. Sometimes it is selfishly better to be less aggressive.
Consider a resource with a fitness value of v to whoever controls it. The resource might be a feeding or mating location. We will consider that animals compete for discrete resources in pairs and can have just two behavioural strategies: Hawk and Dove.

Focal
individual

# What happens in a pairwise contest over the resource

Opponent
Fitness payoff to focal individual
Hawk
Always fights. Always wins if opponent is Dove, and without paying the fighting cost. Wins half the time if opponent is Hawk but pays fighting cost half the time if it loses.
Dove
Hawk
v
(v - c)/2    on average
Dove
Never fights. Shares resource if opponent is Dove, but always loses resource if opponent is Hawk. Never pays the fighting cost.
Dove
Hawk
v/2
0

Hawk always wins when paired to a Dove. So it would seem that the Dove strategy should be replaced by the Hawk strategy if both occur in the population. But Hawk pays a fighting cost, c, when it pairs up with another Hawk. Dove does not pay this cost because it never fights. Could this make Dove a winning strategy?
Consider a population of Doves with a lone Hawk. (We say that the rare strategy is “invading”.) The Hawk can only pair with a Dove so the rare Hawk’s payoff is always v. The payoff of most Doves, who pair with other Doves, is v/2. This shows that Hawk can invade Dove because the rare Hawk has a higher payoff than do Doves.
Now consider a population of Hawks with a lone Dove. The Dove can only pair with a Hawk so the rare Dove’s payoff is 0. The payoff of most Hawks is (v-c)/2. This is < 0 when c > v. So Dove can invade Hawk if c > v. That is, when there is a high fighting cost (greater than half the value of the resource being fought over). In essence, the resource is not worth the fight because there can only be one winner (hence the benefit is v/2 not v).
In general, there are two conditions of cost and benefit that determine the best strategy to use.
c > v      Dove can invade Hawk. We already know that Hawk can invade Dove (because we assume that v > 0, that is the resource has some positive value for survival or reproduction), so this means that each strategy can invade a pure population of the other. What we end up with is a “mixed ESS” (Evolutionarily Stable Strategy) in which both strategies are present in the population. The exact proportions depend on the values of c and v. At the mixed ESS the fitness of individuals playing each strategy will be equal. Hawks pass on as many copies of their genes as Doves.
c < v      Dove cannot invade Hawk. As we know that Hawk can invade Dove this means that Hawk forms a “pure ESS”. The Dove strategy cannot persist. If it occurs in a population, and a rare mutant Hawk occurs, then Hawk will replace it (referred to as go to fixation).
The Hawk–Dove game is not meant to be a realistic model of any real animal population. But it gives some important insights. It shows that a non-fighting strategy can persist even when fighters occur, and that a population can have animals playing two different strategies, each having equal fitness. The two strategies do not have to be genetically determined, and in a mixed ESS each individual could play both strategies. For example, if the mixed ESS was 40% Doves, then this could come about by 40% always being Doves and 60% Hawks, or via each individual playing both strategies at different times such that, across all contests, 40% of the plays were Dove.
The payoffs to the different strategies are often put into a payoff matrix. In the matrix below (don’t be put off by the word matrix—it just means a table), the payoffs relevant to a population with a rare Dove are in column 1 (i.e., Dove can only pair with Hawk). The payoffs relevant to a population with a rare Hawk are in column 2 (i.e., Hawk can only pair with Dove). For example, cover up column 2 with your finger. This means that the only possible opponent is a Hawk (i.e., everyone is a Hawk except for one Dove, who cannot have itself as an opponent). The payoff to the rare Dove is 0 and to the Hawks is (v-c)/2. This shows the condition under which Dove can invade is 0 > v-c, which is the same as c > v (i.e., cost is greater than victory) Now cover up column 1. This means that the only possible opponent is a Dove (i.e., everyone is a Dove except for one Hawk, who cannot have itself as an opponent). The payoff to the rare Hawk is v and to the Doves is v/2. As v > 0 (i.e., the resource is worth something) this shows that the Hawk can invade a population of Doves.

Payoff Matrix for the Hawk-Dove Game. The payoff is the change in fitness of a focal individual who is playing either Hawk or Dove when paired to an opponent who is playing either Hawk or Dove.

Focal Individual’s Strategy                  Opponent’s Strategy
Hawk (col. 1)  Dove (col. 2)

Hawk                                       (v-c)/2             v
Dove                                       0                      v/2

Further strategies
Are Hawk and Dove the only possible strategies? No, they are not. Maynard Smith (2002) discusses some additional strategies, such as ‘Retaliator’ (plays Dove initially but fights back if opponent fights), ‘Prober-Retaliator’ (occasionally fights but backs down if opponent fights), ‘Bully’ (always start by fighting but back down if opponent fights) and ‘Bourgeois’ (see below).

### Hawk-Dove-Bourgeois and the speckled wood butterfly (Alcock pages 278-279).       Note: For the exam, you do not have to understand the maths behind the H-D-B game but you do have to understand the maths behind the H-D game.

Maynard-Smith considered various other strategies and the one that seemed the most successful in many situations of pairwise contests is Bourgeois, which is better than both Hawk and Dove and can form a pure ESS. That is, everyone plays Bourgeois. Bourgeois also seems to be quite common in nature. A good example of theory leading the way.
In some animal contests, the strategy of an animal depends upon whether it is a resident or not. Thus, male speckled wood butterflies can be either Hawks or Doves. They play Hawk when they are the resident/owner of a sun patch, but play Dove if they are the non-resident/intruder. Normally, when an intruder enters the patch of another male butterfly, the resident flies up and chases him away. The resident always wins after a short spiral flight. The intruder does not contest. However, it is possible to have two residents. For example, by experimentally moving one resident to the sun patch of another resident so that both think that they are the resident. When they see each other, they both play Hawk and this results in an “escalated” contest—a long spiral chase into the tree tops. (The speckled wood is a common butterfly and it is easy to see these behaviours.) So it seems that a butterfly plays Hawk when resident and Dove when non-resident. This particular strategy has been called Bourgeois, in reference to property owning people and their determination to hang on to their house. It would perhaps have been more immediately obvious if the strategy name Owner had been used instead of Bourgeois. How can we build upon our analysis of the Hawk-Dove game to include Bourgeois? First, the basics…

Focal
individual

# What happens in a pairwise contest over the resource

Opponent
Fitness payoff to focal individual
Hawk
Always fights. Always wins if opponent is Dove, and without paying the fighting cost. Wins half the time if opponent is Hawk but pays fighting cost
Dove
Hawk
Bourgeois
v               (as above)
(v-c)/2      (as above)
(3/4)vc/4  (note 5)
Dove
Never fights. Shares resource if opponent is Dove, but always loses resource if opponent is Hawk. Never pays the fighting cost.
Dove
Hawk
Bourgeois
v//2           (as above)
0               (as above)
v/4            (note 4)
Bourgeois
Plays Hawk when resident and Dove when non-resident
Dove
Hawk
Bourgeois
(3/4)v       (note 3)
(v-c)/4      (note 2)
v/2            (note 1)

Note 1 Assume that when two Bourgeois meet, one is the resident and one the non-resident so there is no fighting. On average, individuals are resident half of the time so the average payoff is (v + 0)/2 = v/2.
Note 2 When Bourgeois is resident it plays Hawk to an intruding Hawk and gets a payoff of (v-c)/2. When Bourgeois is non-resident it plays Dove when intruding on a Hawk and gets a payoff of 0. On average individuals are resident half of the time so the average payoff is ((v-c)/2 + 0)/2 = (v-c)/4.
Note 3 When Bourgeois is resident it plays Hawk to an intruding Dove and gets a payoff of v. When Bourgeois is non-resident it plays Dove when intruding on a Dove and gets a payoff of v/2. On average individuals are resident half of the time so the average payoff is (v + v/2)/2 = (3/4)v.
Note 4 When Dove plays Bourgeois it gets a payoff of v/2 when it is resident and Bourgeois is intruder, because both play Dove.   When Dove is non-resident it has a payoff of 0 when intruding on Bourgeois, who plays Hawk. On average, Dove individuals are resident half of the time so the average payoff is (0 + v/2)/2 = v/4.
Note 5 When Hawk plays Bourgeois it gets a payoff of v when resident and Bourgeois is intruder, because Bourgeois plays Dove. When Hawk is non-resident it has a payoff of (v-c)/2 when intruding on Bourgeois, who plays Hawk. On average, Bourgeois individuals are resident half of the time so the average payoff is (v + (v-c)/2)/2 = (3/4)vc/4.

Payoff Matrix for the Hawk-Dove-Bourgeois Game. The Payoff is the change in fitness of a focal individual who is playing either Hawk, Dove or Bourgeois when paired to an opponent who is playing either Hawk, Dove or Bourgeois.

Focal Individual’s Strategy                                          Opponent’s Strategy
Hawk (col 1)   Dove (col 2)    Bourgeois (col 3)

Hawk                                       (v-c)/2             v                      (3/4)v c/4
Dove                                       0                      v/2                   v/4
Bourgeois                                (v-c)/4             (3/4)v               v/2

From the matrix above we can determine whether the Bourgeois strategy is an ESS, that is whether it gives a higher payoff than playing either Hawk or Dove. The first question is, can Bourgeois invade a population of Doves? From Column 2 we can see that the payoff to Bourgeois from playing against Dove, (3/4)v, is greater than the payoff to Dove when playing Dove, v/2. Thus Bourgeois can invade Dove. The second question is, can Bourgeois invade a population of Hawks? From Column 1 we can see that the payoff to Bourgeois from playing against Hawk is (v-c)/4 whereas the payoff to Hawk from playing against Hawk is (v-c)/2. The payoff to Bourgeois is greater than that to Hawk if v < c. Thus, Bourgeois can invade Hawk if v < c. Finally, if everyone plays Bourgeois, can this be invaded by Hawk or Dove? Column 3 shows that the payoff to Hawk, Dove and Bourgeois when playing Bourgeois are (3/4)v – c/2, v/4, v/2, respectively. Clearly, Dove is always worse off than Bourgeois, as v > 0, and Hawk is worse off than Bourgeois if v < c. The final condition is also the same as the condition that allowed Bourgeois to invade Hawk. In summary, Bourgeois can always invade Dove and is resistant to invasion by Dove, and can invade Hawk and is resistant to invasion by Hawk if v < c.
This “Resident wins” situation is called a conventional settlement. In other words, who wins is decided by convention. It is logically possible to have the opposite convention, non-resident wins, being the ESS. There are a few examples of this. It is also possible that who wins is decided by some asymmetry in resource holding power, such as “Bigger wins”. In the case of the speckled wood it seems that there is also some asymmetry in resource holding power as the resident, who has been sunning himself, may have higher body temperature.

### Further insights from game theory

The above examples will provide you with a start to understanding the use of mathematics in the study of animal behaviour. Game theory has also made numerous other insights. For example, some games may have cyclical dynamics, with one strategy invading another, then being invaded by a third strategy which in turn is invaded by the first strategy. This is similar to the children’s game Rock, Scissors, Paper. Rock beats scissors, paper beats rock, and scissors beats paper. Amazingly enough, cyclical dynamics has been found in the reproductive behaviour of lizards, Uta stansburiana (Sinervo, B. Lively, C. M. 1996. Lizards play rock-scissors-paper. Nature 380: 240-243). Maynard Smith (1998 p. 130-131) describes the situation in the following way. “Male...lizards have one of three mating strategies. Orange-throated males establish large territories, within which live several females. A population of such males can be invaded by males with yellow throats: these “sneakers” do not defend a territory, but steal copulations. The orange throats cannot defend all their females. However, a population of yellow-striped males can be invaded by blue-throated males, which maintain territories large enough to hold one female, which they can defend against sneakers. Once sneakers become rare, it pays to defend a large territory with several females. Orange males invade, and we are back where we started. In the field, the frequencies of the three colour morphs cycled with a period of about 6 years.”

Synopsis of the behaviours seen among male morphs
The following descriptions are taken from Barry Sinervo’s website. If you go to this website you can see video clips of the behaviours of different male types on encountering each other.
http://bio.research.ucsc.edu/~barrylab/classes/animal_behavior/video_only.html

Yellow-Throated Sneaker Male Behaviour
Yellow males are "sneakers" in that they mimic the throat colour of receptive females, and yellows also mimic female behaviour. When a yellow male meets a dominant male, he pretends he is a female -- a female that is not interested in the act. The head bobs ("vibrations") involved in actual female rejection behaviours are of very high frequency compared to the low frequency aggressive challenge displays shown by aggressive males. In many cases, females will nip at the male and drive him off. By co-opting the female rejection display, yellow males use a dishonest signal to fool some territory holding males. The ruse of yellows works only on orange-throated males.

Blue-Throated Male Behaviour
Blue males are not fooled by yellows. Blue males root out yellow males that enter the territory of the blue male. Blue males are a little more circumspect when they engage another blue male during territory contests. Blue males spend a lot of time challenging and displaying, presumably allowing males to assess one another. Attack may or may not follow as blue males very often back down against other blue males. Indeed, neighbouring males use a series of bobs to communicate their identity, and the neighbours usually part without battle.

Orange-Throated Male Behaviour
Orange males are ultra-dominant and very aggressive owing to high levels of testosterone, and attack intruding blue males that typically have more modest levels of testosterone. Attacks by orange males on blue males do not involve the ritualized head bobs that are seen when blue males engage blue males, orange males just attack with little advanced warning. When an orange male encounters a more equally matched orange male, they are both a little more circumspect, and they will not necessarily attack one another (as is seen when blue meets blue).

Summary

Thus, each strategy has a strength and a weakness and there are strong asymmetries in contests between morphs. Trespassing yellows, with their female mimicry, can fool oranges. However, trespassing yellows are hunted down by blue males and attacked. While oranges with their high testosterone and high stamina can defeat blues, they are susceptible to the charms of yellows. In contrast, contests between like morphs (e.g., blue vs blue, orange vs orange or yellow vs yellow) are usually more symmetrical.