In probability theory, an expected value is the theoretical mean value of a numerical experiment over many repetitions of the experiment. Expected value is a measure of central tendency; a value for which the results will tend to. When a probability distribution is normal, a plurality of the outcomes will be close to the expected value.
Any given random variable contains a wealth of information. It can have many (or infinite) possible outcomes, and each outcome could have different likelihood. The expected value is a way to summarize all this information in a single numerical value.
If the sample space of a probability experiment contains only numerical outcomes, then a random variable is the variable that represents these outcomes. For example, the result of rolling a fair six-sided die is a random variable that takes each of the values from 1 to 6 with probability This is an example of a discrete random variable.
For a discrete random variable, the expected value can be calculated by multiplying each numerical outcome by the probability of that outcome, and then summing those products together. The expected value of a fair six-sided die is calculated as follows:
Let be a discrete random variable. Then the expected value of , denoted as or , is
A stack of cards contains one card labeled with , two cards labeled with , three cards labeled with , and four cards labeled with . If the stack is shuffled and a card is drawn, what is the expected value of the card drawn?
Let be the random variable that represents the value of the card drawn. Then
The expected value of the card drawn is
From a measure theoretic perspective, let () be a measure space. To compute the expectation or integral of general random variables, we must proceed in the following manner: Note: Please visit Axioms of Probability for the definition of a -algebra.
Step 1: Expectation, of simple random variables
A random variable, is called a simple, if it can be written as , such that form a partition of , that is, and , with each .Now we can define the expectation of a simple random variable as:
, where is a probability measure and each , is a -algebra of subsets of . is equivalently written as or
Since the partitioning of has many different representations, we must show that, given any choice of representation, we still wind up with a well-defined notion of expectation.
The definition of for simple random variables is well defined.
Let and be two simple random variables such that where and . Note that we can write each and each . Thus, we can rewrite our simple function representation for as . Since all and are disjoint, each form a disjoint union of , thus, . We do the same for simple random variable, . Thus, we let on all then we see that . Now take the expectation of and and we have so the definition of expectation on simple random variables is well defined.
The below two theorems show how translating or scaling the random variable by a constant changes the expected value. An explanation follows.
For random variable and any constant ,
For random variable and any constant
By the definition of expectation
The first theorem shows that translating all variables by a constant also translates the expected value by the same constant. This makes intuitive sense since if all variables are translated by a constant, the central or mean value should also be translated by the constant. The second theorem shows that scaling the values of a random variable by a constant also scales the expected value by .
A fair six-sided die is labeled on each face with the numbers 5 through 10. What is the expected value of the die roll?
From before, we know the expected value of a regular six-sided die is . This problem is asking for .
Therefore, the expected value of the die roll is .
A fair six-sided die is labeled on each face with the first six positive multiples of 5. What is the expected value of the die roll?
From before, the expected value of a regular six-sided die roll is . This problem is asking for .
Therefore, the expected value of the die roll is .
We now show how to calculate the expected value for a sum of random variables.
Let and be random variables. Then
Two fair six-sided dice are rolled. What is the expected value of the sum of their rolls?
From before, it is known that the expected value of a single fair six-sided die is . This problem is asking for .
Therefore, the expected value of the sum of the die rolls is .
Main Article: Linearity of Expectation.
The above theorems can be combined to prove the following:
For any random variables and constants we have
This is known as linearity of expectation, and holds even when the random variables are not independent events.
A fair six-sided die is rolled repeatedly until three sixes are rolled consecutively. What is the expected number of rolls?
Let be the random variable that represents the number of rolls required to get consecutive sixes.
In order to get consecutive sixes, there must first be consecutive sixes. Then, the consecutive six will occur on the next roll with probability, or the process will start over on the next roll with probability:
By linearity of expectation,
Solving for yields
It can be found that , so , and .
The expected number of rolls until three consecutive sixes is rolled is .
There are two types of random variables, discrete and continuous. The die-roll example from above is an example of a discrete random variable since the variable can take on a finite number of discrete values. Choosing a random real number from the interval would be an example of a continuous random variable.
Given a continuous random variable and probability density function , the expected value of is defined by
Given the probability density function defined on the interval , what is
By the above definition,
Let and be discrete random variables. Then the expected value of given the event , denoted as , is
What is the expected number of "heads" flips in 5 flips of a fair coin given that the number of "heads" flips is greater than 2?
In this example, is the number of "heads" flips in 5 flips of the coin, and is the event representing .
Recall the formula for conditional probability:
Thus the desired sum is
These probabilities can be calculated using the binomial distribution:
Substituting these values,
The expected number of heads flips given that there are more than 2 heads flips is
Let be a continuous random variable, and let be its density function. Let be an event, and let be the range of given . Then the expected value of given the event , denoted as , is
Let be a continuous random variable with density function .
In this example, the condition is applied on the random variable . Subject to this condition, the range of is .
The probability can be calculated with the same bounds:
Then the expected value of given is calculated using the formula above.
The expected value of given is
There are 2 bags, and balls numbered 1 through 5 are placed in each bag. From each bag, 1 ball is removed. What is the expected value of the total of the two balls?
Consider the following table, which lists the possible values of the first ball in the first row, and the possible values of the second ball in the first column. Each entry in the table is obtained by finding the sum of these two values:
Let be the random variable denoting the sum of these values. Then, we can see that the probability distribution of is given by the following table:
As such, this allows us to calculate
Note: How can we use the linearity of expectation to arrive at the result quickly?
six-sided dice are rolled. What is the expected number of times is rolled?
To determine the expected number of times 5 is rolled, we can define to be the random variable for the number of times a is rolled, and to be the random variable for die rolling a . It is easy to see that We have , so by the linearity of expectation, . Therefore, .
Note: We can also answer this question by noting that since the probability of getting each number is equal, the expected number of times we get each number is the same, and the sum of these expectations is , so for each number the expectation is .
Mathematically speaking, let be the random variable for the number of times is rolled out of throws. By symmetry, we know that is a constant. Since there are a total of results, . This gives us
Consider the Bernoulli process of a sequence of independent coin flips for a coin with probability of heads . Let be a random variable with if the flip is heads and if the flip is tails. Let be a random variable indicating the number of trials until the first flip of heads in the sequence of coin flips. What is the expected value of
The possible values for the number of coin flips until the first head are so these are the possible values for random variable . For , the probability that is the probability that the first trails are tails and trial is heads. This gives the distribution which is a geometrically distributed random variable. Then
Now for , we have
and differentiating this gives
Expected Value of a Dice Throw Experiment
A Dice throw experiment can have one outcome from the set . Hence the random variable can have values as follows:
For a fair dice, implying
Note: Observe that the expected value of a variable need not be one of the value taken by as illustrated by this example.
Expected Value of numbers of times to throw a Fair Coin till you get a Heads
Then we have
Dividing both sides by gives
Taking we have
say there is a 50% chance that he will get , and a 50% chance that he will get . They felt that since the expected value of every game is 0, they should not be making or losing money in the long run.The Las Vegas casino Magnicifecto was having difficulties attracting its hotel guests down to the casino floor. The empty casino prompted management to take drastic measures, and they decided to forgo the house cut. They decided to offer an “even value” game--whatever bet size the player places
Scrooge, who was on vacation, decided to exploit this even value game. He has an infinite bankroll (money) and decides to play the first round (entire series) in the following manner:
- He first makes a bet of .
- If he wins, he keeps his earnings and leaves.
- Each time that he loses, he doubles the size of his previous bet and plays again.
Now, what is the expected value of Scrooge’s (total) winnings from this first round (which ends when he leaves)?
A "round" refers to the entire series of games played above. This question refers to the entire round. There are 4 rounds in the set of problems.
This problem is part of Go Big Or Go Home, which explores the linearity of expected value.
Image credit: Wikipedia Flipchip
A bug starts on one vertex of a dodecahedron. Call it A. Define a second vertex adjacent to the one he starts on, and call it B.
Every second he randomly walks along one edge to another vertex. What is the expected value of the number of seconds it will take for him to reach the vertex B?
Clarification: Every second he chooses randomly among the three edges available to him, including the one he might have just walked along. On his first move, he has a probability of reaching B.
See my other Expected Value quizzes.
Image credit: math.wikia.com
As shown above, the left box contains 1 red ball and 2 blue balls while the right box contains 2 blue balls and 3 red balls.
In a lucky draw game, you have to randomly and simultaneously pick up one ball from each box using both hands.
If you get a blue ball from the left box, you'll be rewarded 4 dollars, but you'll lose 5 dollars for the red draw. On the other hand, a red ball drawn from the right box will cost you 7 dollars while a blue draw will earn you 8 dollars.
What is the expected value of the bet earned from this game?
You flip a fair coin several times.
Find the expected value for the number of flips you'll need to make in order to see the pattern TXT, where T is tails, and X is either heads or tails.
If the expectation value can be expressed as , where and are coprime positive integers, find .
Clarification: You are looking for the pattern TTT or THT. That is, you will keep flipping until you see one of these two patterns, and then count the number of flips you made.
Other Expected Value Quizzes
Image credit: www.cointalk.com
A bug starts on one vertex of an icosahedron. Every second he randomly walks along one edge to another vertex. What is the expected value of the number of seconds it will take for him to reach the vertex opposite to the original vertex he was on?
Clarification: Every second he chooses randomly between the five edges available to him, including the one he might have just walked along.
Other Expected Value Quizzes
Image credit: www.kjmaclean.com.
Call the vertices of a tetrahedron, A, B, C, and D.
A bug starts on vertex A. Every second he randomly walks along one edge to another vertex. What is the expected value of the number of seconds it will take for him to reach the vertex D?
Clarification: Every second he chooses randomly among the three edges available to him, including the one he might have just walked along.
Other Expected Value Quizzes
Image credit: http://loki3.com/