You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
<li>Reading: <ahref="https://docs.google.com/document/d/1GiQUL71Iv2iGEe5hRy5yxTNQijA-fpWV9qcJucbwPVc/edit?usp=sharing" target="_blank">Decision-theory and Probability</a></li>
<p>Each day in class we'll practice some skill. You'll get <ahref="#grading">0.5 points</a> if you engage in and complete the activity. How to get credit for the activity will depend on the activity; sometimes being present will be enough, sometimes being to class on time will be enough, and sometimes you'll have to turn something in.</p>
594
594
595
595
<h2id="reading">Reading</h2>
596
-
596
+
597
+
<p>To access the readings, you will do the following:</p>
598
+
599
+
<ol>
600
+
<li>Click on the reading (a link to a Google doc) on the <ahref="#schedule">course schedule</a></li>
601
+
<li>Copy the google doc to your personal INFO 370 folder (which we shared with you at the beginning of the course). <ahref="https://support.google.com/docs/answer/49114" target="_blank">Instructions on making a copy of a file in Google Drive.</a></li>
602
+
<li>Read through the google doc/reading. Highlight and <ahref="https://support.google.com/docs/answer/65129" target="_blank">comment</a> any parts which are confusing.</li>
603
+
<li>Complete the questions marked "TODO".</li>
604
+
</ol>
605
+
597
606
<p>
598
-
You should complete your readings and reflection survey<i>before</i> at the beginning of each lecture (twice a week).
607
+
You should complete your readings and reflection <i>before</i> at the beginning of each lecture (twice a week).
599
608
Each time, you'll come prepared to discuss the assigned reading.
<li>We discuss the correct answers as a class.</li>
611
620
</ul>
612
621
613
-
<p>Your answer is correct, you'll receive <ahref="#grading">1 point</a>. We will give partial credit for partially correct answers, at our discretion.</p>
622
+
<p>
623
+
You will receive <ahref="#grading">0.5 points</a> for completing the reading and reflection before class (on the Google Doc).
624
+
You will receive up to another 0.5 points for getting the in-class reading quiz correct.
625
+
We will give partial credit for partially correct answers on the reading quiz, at our discretion.
626
+
In total, you can receive up to 1 point per reading.
Copy file name to clipboardExpand all lines: readings/decision-making-and-probability.html
+202-1
Original file line number
Diff line number
Diff line change
@@ -33,7 +33,7 @@ <h2>Decision are Choices, Outcomes, and Values of Outcomes</h2>
33
33
Making decisions is about choosing the options that leads to the outcome with the highest total value.
34
34
In business scenarios one might predict a dollar amount for the value for each possible outcome.
35
35
In a personal or other scenario one might imagine how much something is worth in dollars and use that as a value (or otherwise use numbers to express how much one wants an outcome);
36
-
note that this is potentially error-prone / inappropriate, but let’s (potentially dangerously) assume someone takes the time to carefully consider how much that outcome is worth to them and gives it a dollar amount.
36
+
note that this is potentially error-prone / inappropriate, but let's (potentially dangerously) assume someone takes the time to carefully consider how much that outcome is worth to them and gives it a dollar amount.
37
37
</p>
38
38
39
39
<h3>When each choice has a certain outcome</h3>
@@ -42,6 +42,207 @@ <h3>When each choice has a certain outcome</h3>
42
42
For example, on my way to class I walk by someone selling chocolate. I might consider this decision quickly as:
43
43
</p>
44
44
45
+
<tableclass="table table-striped text-left">
46
+
<tr>Table 1: Value given choice</tr>
47
+
<tr>
48
+
<td><b>Choice</b></td>
49
+
<td><b>Outcome</b></td>
50
+
<td><b>Value</b></td>
51
+
</tr>
52
+
<tr>
53
+
<td>Buy chocolate</td>
54
+
<td>I eat chocolate</td>
55
+
<td>"+$10" in happiness</td>
56
+
</tr>
57
+
<tr>
58
+
<td>Do not buy chocolate</td>
59
+
<td>I do not eat chocolate</td>
60
+
<td>$0</td>
61
+
</tr>
62
+
</table>
63
+
64
+
<p>
65
+
With this way of describing the choice, choosing to buy chocolate will lead to a higher-value outcome - a benefit "equivalent" to $10 from eating chocolate. Why $10? Well I just really like chocolate and I think I will be about as happy as if I had found $10 on the ground. Thus, choosing buy chocolate would optimize my potential value from the decision (gain $10 in value vs. gain $0).
66
+
</p>
67
+
68
+
<h3>When each choice also has a cost</h3>
69
+
70
+
<p>
71
+
As I go to buy the chocolate, I realize the chocolate costs money - $5. I reconsider my values for each outcome, subtracting the costs of making that choice.
72
+
</p>
73
+
74
+
<tableclass="table table-striped text-left">
75
+
<tr>Table 2: Value given choice and costs</tr>
76
+
<tr>
77
+
<td><b>Choice</b></td>
78
+
<td><b>Outcome</b></td>
79
+
<td><b>Value</b></td>
80
+
</tr>
81
+
<tr>
82
+
<td>Buy chocolate</td>
83
+
<td>I eat chocolate</td>
84
+
<td>+$10 (in happiness) - $5 (cost) = +$5 net benefit</td>
85
+
</tr>
86
+
<tr>
87
+
<td>Do not buy chocolate</td>
88
+
<td>I do not eat chocolate</td>
89
+
<td>$0</td>
90
+
</tr>
91
+
</table>
92
+
93
+
<p>
94
+
Buy chocolate still has the highest valued outcome at $5, so I reach for my wallet. However, I suddenly realize I'm not so sure there's only one possible outcome from that choice.
95
+
96
+
When there are many possible outcomes that are unknown / uncertain
97
+
Really, most decisions in life do not have a guaranteed outcome. Each choice can have multiple possible outcomes. In our example we'll add another possible outcome.
98
+
99
+
Looking over the person selling chocolate, I realize I don't know them, I haven't seen them before, and they are wearing a strange costume. I add a new outcome (I leave the value entry blank if that outcome cannot happen for that choice).
100
+
101
+
</p>
102
+
103
+
<tableclass="table table-striped text-left">
104
+
<tr>Table 3: Value given choices with uncertain outcomes</tr>
105
+
<tr>
106
+
<td></td>
107
+
<tdcolspan="3" class="text-center">Outcomes</td>
108
+
</tr>
109
+
<tr>
110
+
<td></td>
111
+
<td><b>Eat nothing</b></td>
112
+
<td><b>Eat chocolate</b></td>
113
+
<td><b>Eat poisoned chocolate, go to hospital</b></td>
Now that there are multiple outcomes, there are different rules I might use to decide. Here are two fairly extreme rules:
131
+
</p>
132
+
133
+
Decision Rules:
134
+
<ul>
135
+
<li><b>Minimize the worst possible outcome</b>: Take the worst outcome for each choice, then choose the choice with the best (of the worst) outcomes.</li>
136
+
<li><b>Maximize the best possible outcome</b>: Take the best outcome for each choice, then choose the choice with the best (of the best) outcomes.</li>
137
+
</ul>
138
+
139
+
<p>
140
+
For minimize the worst possible outcome, I'd choose to not buy chocolate.
141
+
To maximize the best possible outcome, I'd choose to buy the chocolate.
142
+
</p>
143
+
144
+
<h3>When you're biased and inadvertently change your analysis to get the choice you want</h3>
145
+
146
+
<p>
147
+
Now, the thought occurs to me, that maybe I'll eat half of the chocolate, meet someone that looks hungry on the way,
148
+
share my chocolate, start up a wonderful conversation, one thing leads to another, and - fast forward 10 years into the future
149
+
- we're a happy couple and life is awesome. I add a new outcome to my decision table.
150
+
</p>
151
+
152
+
<tableclass="table table-striped text-left">
153
+
<tr>Table 4: Value given choices with uncertain outcomes</tr>
154
+
<tr>
155
+
<td></td>
156
+
<tdcolspan="4" class="text-center">Outcomes</td>
157
+
</tr>
158
+
<tr>
159
+
<td></td>
160
+
<td><b>Eat nothing</b></td>
161
+
<td><b>Eat chocolate</b></td>
162
+
<td><b>Eat poisoned chocolate, go to hospital</b></td>
163
+
<td><b>Share chocolate with my future partner</b></td>
Now, the two decision rules from before seems really unsatisfactory.
183
+
If I try to, I can probably think about extreme outcomes (bad or good) for any choice I make,
184
+
which can heavily influence the choice I "should" make based on those rules.
185
+
</p>
186
+
187
+
<h2>Expressing belief with probability</h2>
188
+
<p>
189
+
Play this game to get a feel for subjectively expressing belief as a probability distribution
190
+
<ahref="http://cassandraxia.com/projs/advbiases/" target="_blank">Adventures in Cognitive Biases</a>
191
+
</p>
192
+
193
+
<h2>Decision theory</h2>
194
+
<p>
195
+
Decision theory combines the choices-outcomes-values model of a decision along with a probability distribution of the outcomes for each choice.
196
+
Practitioners of orthodox (prevalent / accepted) decision theory recommend one choose the choice that has the highest "expected" value, adjusted for the probability of that outcome. For example, for the decision below with the following probabilities:
197
+
</p>
198
+
199
+
<tableclass="table table-striped text-left">
200
+
<tr>Table 5: Probability table for chocolate outcomes</tr>
201
+
<tr>
202
+
<td><b>Choice</b></td>
203
+
<td><b>Outcome</b></td>
204
+
<td><b>Probability</b></td>
205
+
</tr>
206
+
<tr>
207
+
<td>Buy chocolate</td>
208
+
<td>Eat chocolate</td>
209
+
<td>0.99</td>
210
+
</tr>
211
+
<tr>
212
+
<td>Buy chocolate</td>
213
+
<td>Eat poisoned chocolate</td>
214
+
<td>0.009999</td>
215
+
</tr>
216
+
<tr>
217
+
<td>Buy chocolate</td>
218
+
<td>Share chocolate with future partner</td>
219
+
<td>0.000001</td>
220
+
</tr>
221
+
<tr>
222
+
<td>Buy chocolate</td>
223
+
</tr>
224
+
</table>
225
+
226
+
<p>
227
+
We can make our decision by first calculating our expected outcome, the product of the value of each outcome with the likelihood of it occuring.
228
+
<math>1+1</math>
229
+
</p>
230
+
231
+
<p>
232
+
Decision analysis without probability can change based on unlikely or extreme outcomes.
233
+
In general, it can be hard to define all the possible outcomes; decision analysis tends to just focus on some set of outcomes.
234
+
Some people in the decision analysis community try to come up with ways to deal with possible outcomes, this but limiting outcomes is a fundamental limitation of the method.
235
+
In the end, it's hard to tell if you have included all the possible choices and possible outcomes that matter in an analysis.
236
+
</p>
237
+
238
+
<h2>Further Reading</h2>
239
+
240
+
<p>
241
+
<i>Dutch book</i> arguments: If you don't use fair rules, someone can trick you into buying bets that you can't ever profit from.
242
+
243
+
</p>
244
+
<pid="cherubini">Cherubini, M., Venolia, G., DeLine, R., & Ko, A. J. (2007, April). <ahref="https://doi.org/10.1145/1240624.1240714">Let's go to the whiteboard: how and why software developers use drawings</a>. In Proceedings of the SIGCHI conference on Human factors in computing systems (pp. 557-566).</p>
0 commit comments