Skip to content

Commit

Permalink
Merge pull request #143 from Jieyixia/english
Browse files Browse the repository at this point in the history
高楼扔鸡蛋问题进阶
  • Loading branch information
labuladong authored Mar 4, 2020
2 parents 79baa00 + 79ed2d9 commit 3150914
Show file tree
Hide file tree
Showing 8 changed files with 263 additions and 268 deletions.
263 changes: 263 additions & 0 deletions dynamic_programming/SuperEggDrop(Advanced).md
Original file line number Diff line number Diff line change
@@ -0,0 +1,263 @@
# Super Egg Drop(Advanced)

**Translator: [Jieyixia](https://github.com/Jieyixia)**

**Author: [labuladong](https://github.com/labuladong)**

The Super Egg Drop problem (Leetcode 887) has been discussed in the last article using the classic dynamic programming method. If you are not very familiar with this problem and the classic method, please read「Super Egg Drop」, which is the basic of following contents.

In this article, we will optimize this problem with other two more efficient methods. One is adding binary search into the classic dynamic programming method, the other one is redefining state transition equation.

### Binary Search Optimization
We want to find the floor `F` for a building with `N` floors using **minimum** number of moves (Each move means dropping an egg from a certain floor). Any egg dropped at a floor higher than `F` will break, and any egg dropped at or below floor `F` will not break. First, let's review the classic dynamic programming method:

1、To know `F`, we should traverse the situations that we drop an egg from floor `i`, `1 <= i <= N` and find the situation that costs minimum number of moves;

2、Anytime we drop an egg, there are two possible outcomes: the egg is broken or not broken;

3、If the egg is broken, `F` <= `i`; else, `F` > `i`;

4. Whether the egg is broken or not depends on which outcome causes **more** moves, since the goal is to know with certainty what the value of `F` is, regardless of its initial value.

The code for state transition:

```python
# current state: K eggs, N floors
# return the optimal results under current state
def dp(K, N):
for 1 <= i <= N:
# the mininum moves
res = min(res,
max(
dp(K - 1, i - 1), # the egg is broken
dp(K, N - i) # the egg is not broken
) + 1 # drop an egg at floor i
)
return res
```

The above code reflects the following state transition equation:

$$ dp(K, N) = \min_{0 <= i <= N}\{\max\{dp(K - 1, i - 1), dp(K, N - i)\} + 1\}$$

If you can understand the state transition equation, it is not difficult to understand how to use binary search to optimize the process.

From the definition of `dp(K, N)` array (the minimum number of moves with `K` eggs and `N` floors), we know that when `K` is fixed, `dp(K, N)` will increase monotonically as `N` increases. In the above state transition equation, `dp(K - 1, i - 1)` will increase monotonically and `dp(K, N - i)` will decrease monotonically as `i` increases from 1 to `N`.

![](../pictures/SuperEggDrop/2.jpg)

We need to find the maximum between `dp(K - 1, i - 1)` and `dp(K, N - i)`, and then choose the minimum one among those maximum values. This means that we should get the intersection of the two straight lines (the lowest points of the red polyline).

In other article, we have mentioned that binary search is widely used in many cases, for example:

```java
for (int i = 0; i < n; i++) {
if (isOK(i))
return i;
}
```

In the above case, it is likely to use binary search to optimize the complexity of linear search. Review the two `dp` functions, the lowest point satisfies following condition:

```java
for (int i = 1; i <= N; i++) {
if (dp(K - 1, i - 1) == dp(K, N - i))
return dp(K, N - i);
}
```

If you are familiar with binary search, it is easy to know that what we need to search is the valley value. Let's look at the following code:

```python
def superEggDrop(self, K: int, N: int) -> int:

memo = dict()
def dp(K, N):
if K == 1: return N
if N == 0: return 0
if (K, N) in memo:
return memo[(K, N)]

# for 1 <= i <= N:
# res = min(res,
# max(
# dp(K - 1, i - 1),
# dp(K, N - i)
# ) + 1
# )

res = float('INF')
# use binary search to replace linear search
lo, hi = 1, N
while lo <= hi:
mid = (lo + hi) // 2
broken = dp(K - 1, mid - 1) # the egg is broken
not_broken = dp(K, N - mid) # the egg is not broken
# res = min(max(broken, not broken) + 1)
if broken > not_broken:
hi = mid - 1
res = min(res, broken + 1)
else:
lo = mid + 1
res = min(res, not_broken + 1)

memo[(K, N)] = res
return res

return dp(K, N)
```
The time complexity for dynamic programming problems is **the number of sub-problems × the complexity of function**.

Regardless of the recursive part, the complexity of `dp` function is O(logN), since binary search is used.

The number of sub-problems equals to the number of different states, which is O(KN).

Therefore, the time complexity of the improved method is O(K\*N\*logN), which is more efficient than O(KN^2) of the classic dynamic programming method. The space complexity is O(KN).


### Redefine State Transition Equation

It has been mentioned in other article that the state transition equation for the same problem is not unique, resulting in different methods with different complexity.

Review the definition of the `dp` function:

```python
def dp(k, n) -> int
# current state: k eggs, n floors
# return the optimal results under current state
```

Or the `dp` array:

```python
dp[k][n] = m
# current state: k eggs, n floors
# return the optimal results under current state
```

Based on this definition, the expected answer is `dp(K, N)`. The method of exhaustion is necessary, we have to compare the results under different situations `1<=i<=N` to find the minimum. Binary search helps to reduce the search space.

Now, we make some modifications to the definition of `dp` array, current states are `k` eggs and allowed maximum number of moves `m`. `dp[k][m] = n` represents that we can accurately determine a floor `F` for a building with at most `n` floors. More specifically:

```python
dp[k][m] = n
# current state: k eggs, at most m moves
# `F` can be determined for a building with at most n floors

# For example: dp[1][7] = 7 represents:;
# one egg is given and you can drop an egg at certain floor 7 times;
# you can determine floor `F` for a building with at most 7 floors;
# any egg dropped at a floor higher than `F` will break;
# any egg dropped at or below floor `F` will not break.
# (search linearly from the first floor)
```

This is actually a reverse version of our original definition. We want to know the number of moves at last. But under this new definition, it is one state of the `dp` array instead of the result. This is how we deal with this problem:

```java
int superEggDrop(int K, int N) {

int m = 0;
while (dp[K][m] < N) {
m++;
// state transition...
}
return m;
}
```

The `while` loop ends when `dp[K][m] == N`, which means that given `K` eggs and at most `m` moves, floor `F` can be accurately determined for a building with `N` floors. This is exactly the same as before.

Then how to find the state transition equation? Let's start from the initial idea:

![](../pictures/SuperEggDrop/1.jpg)

You have to traverse `1<=i<=N` to find the minimum. But these are not necessary under the new definition of `dp` array. This is based on the following two facts:

**1、There are only two possible outcomes when you drop an egg at any floor: the egg is broken or not broken. If the egg is broken, go downstairs. If the egg is not broken, go upstairs**

**2、No matter which outcome, total number of floors = the number of floors upstairs + the number of floors downstairs + 1(current floor)**

Base on the two facts, we can write the following state transition equation:

`dp[k][m] = dp[k][m - 1] + dp[k - 1][m - 1] + 1`

**`dp[k][m - 1]` is the number of floors upstairs**. `k` keeps unchanged since the egg is not broken, `m` minus one;

**`dp[k - 1][m - 1]` is the number of floors downstairs**. `k` minus one since the egg is broken, `m` minus one.

PS: why `m` minus one instead of plus one? According to the definition, `m` is the upper bound of the number of moves, instead of the number of moves。

![](../pictures/SuperEggDrop/3.jpg)

The code is

```java
int superEggDrop(int K, int N) {
// m will not exceed N (linear search)
int[][] dp = new int[K + 1][N + 1];
// base case:
// dp[0][..] = 0
// dp[..][0] = 0
// Java intializes the array to be all 0 by default
int m = 0;
while (dp[K][m] < N) {
m++;
for (int k = 1; k <= K; k++)
dp[k][m] = dp[k][m - 1] + dp[k - 1][m - 1] + 1;
}
return m;
}
```

which equals to:

```java
for (int m = 1; dp[K][m] < N; m++)
for (int k = 1; k <= K; k++)
dp[k][m] = dp[k][m - 1] + dp[k - 1][m - 1] + 1;
```

It seems more familiar. Since we need to get a certain index `m` of the `dp` array, `while` loop is used.

The time complexity of this algorithm is apparently O(KN), two nested `for` loop。
Moreover, `dp[m][k]` only relates to the left and left-top states, it is easy to simplify `dp` array to one dimension.
### More Optimization
In this section, we will introduce some mathematical methods without specific details.
Based on the `dp` definition in the previous section, **`dp(k, m)` increases monotonically when `m` increases. When `k` is fixed, a bigger `m` will cause a bigger `N`**

We can also use binary search to optimize the process, `dp[K][m] == N` is the stop criterion. Time complexity further decreases to O(KlogN), we can assume `g(k, m) =`……

All right, let's stop. I think it's enough to understand the binary search method with O(K\*N\*logN) time complexity.

It is certain that we should change the for loop to find `m`:

```java
// change the linear search to binary search
// for (int m = 1; dp[K][m] < N; m++)
int lo = 1, hi = N;
while (lo < hi) {
int mid = (lo + hi) / 2;
if (... < N) {
lo = ...
} else {
hi = ...
}

for (int k = 1; k <= K; k++)
// state transition equation
}
```
In conclusion, the first optimization using binary search is based on the monotonicity of the `dp` function; the second optimization modifies the state transition function. For most of us, it is easier to understand the idea of binary search instead of different forms of `dp` array.

If you have grasped the basic methods well, the methods in the last section are good challenges for you.






Loading

0 comments on commit 3150914

Please sign in to comment.