• C++ Programming for Financial Engineering
    Highly recommended by thousands of MFE students. Covers essential C++ topics with applications to financial engineering. Learn more Join!
    Python for Finance with Intro to Data Science
    Gain practical understanding of Python to read, understand, and write professional Python code for your first day on the job. Learn more Join!
    An Intuition-Based Options Primer for FE
    Ideal for entry level positions interviews and graduate studies, specializing in options trading arbitrage and options valuation models. Learn more Join!

Rolling a die

  • Thread starter Thread starter tuanl
  • Start date Start date
Joined
4/14/12
Messages
90
Points
18
We have a fair die and have up to 4 die rolls at our disposal. The objective of the game is to maximize the expected value of the *last* roll. For example, we roll once and get a 6; this cannot be improved upon, so we should stop, i.e., it is not optimal to roll again. Conversely, if the first roll gives us 1, then naively we should roll again.
1. What is the optimal strategy?
A. Stop if first roll gives 4 or 2, or second roll gives 3 or 6, or third roll gives 2 or higher.
B. Stop if first roll gives 3 or 6, or second roll gives 3 or 6, or third roll gives 2 or higher.
C. Stop if first roll gives 5 or 6, or second roll gives 5 or 6, or third roll gives 4 or higher.
D. Stop if first roll gives 1 or 5, or second roll gives 1 or 4, or third roll gives 3 or higher.
E. Stop if first roll gives 4 or 6, or second roll gives 4 or 5, or third roll gives 4 or higher.

2. What is the expected value of a game played using the optimal strategy?
A. Expected value of game played optimally is 3.9
B. Expected value of game played optimally is 4.9
C. Expected value of game played optimally is 5.5
D. Expected value of game played optimally is 3.5
E. Expected value of game played optimally is 4.5


My solution: We calculate the expected value of each of the 5 given optimal strategy as follows:
For choice A, Expected value(=6*1/6+9*1/6*2/3+(2+3+4+5+6)*1/6*2/3*2/3=67/27)
choice B, Expected value(=9*1/6+9*1/6*2/3+(2+3+4+5+6)*1/6*2/3*2/3=3.9 )(approximately)
choice C, Expected value(=11*1/6+11*1/6*2/3+(4+5+6)*1/6*2/3*2/3=4.16)
choice D, Expected value(=1+5/9+(3+4+5+6)*1/6*2/3*2/3=2.89)
choice E, Expected value(=10/6+9*1/6*2/3+(4+5+6)*1/6*2/3*2/3=3.77)
Based on these results, C should be the correct answer. However, the expected value of a game using this strategy based on my calculation doesn't match any of the 5 given answer choices of problem 2. I think my argument is wrong, but I can't figure out where. Can someone help me with this problem?

 
It should be like this:

choice C, Expected value=11∗1/6+11∗1/6∗2/3+(4+5+6)∗1/6∗2/3∗2/3 + 3.5 ∗2/3∗2/3 ∗1/2 = 4.9
 
It should be like this:

choice C, Expected value=11∗1/6+11∗1/6∗2/3+(4+5+6)∗1/6∗2/3∗2/3 + 3.5 ∗2/3∗2/3 ∗1/2 = 4.9

I can see that 3.5*2/3*2/3*1/2 is the expected value of the 4th roll, which my calculation above omitted in every choices. Is my understanding correct?
 
You can save yourself a lot of time by just looking at the answers you can choose from for question 1. An optimal strategy will be of the form:

"Stop if first roll is higher than x, otherwise roll again ...." where x is the expected value of the game when you have 3 rolls.
Since only C is of this form, it must be the right answer.

They could've made it a lot harder by including different answers of this form, for example
"Stop if first roll is 6, otherwise ..." or "Stop if first roll is 4, 5 or 6, otherwise ..."
 
I'd work backwards here. We know that the expected value of the last roll is 3.5. Which means the expected value of the third roll is 3.5+3.5+3.5+4+5+6=25.5/6=4.25, which means the expected value of the 2nd roll is 4.5+4.5+4.5+4.5+5+6=29/6=4.83, and the expected value of the first roll is 4.83+4.83+4.83+4.83+5+6=30.33333/6~=>5

So, yeah, if you roll 6 immediately, stop. If you roll a 5, roll again. And so forth.
 
Back
Top