next up previous index CD Book Algorithms
Next: Lecture 14 - data Up: No Title Previous: Lecture 12 - introduction

Lecture 13 - dynamic programming applications

Listen To Part 13-1

16.3-5 Give an tex2html_wrap_inline15023 algorithm to find the longest montonically increasing sequence in a sequence of n numbers.   


Build an example first: (5, 2, 8, 7, 1, 6, 4)

Ask yourself what would you like to know about the first n-1 elements to tell you the answer for the entire sequence?

  1. The length of the longest sequence in tex2html_wrap_inline15027 . (seems obvious)
  2. The length of the longest sequence tex2html_wrap_inline15029 will extend! (not as obvious - this is the idea!)

Let tex2html_wrap_inline15031 be the length of the longest sequence ending with the ith character:

sequence 5 2 8 7 3 1 6 4
tex2html_wrap_inline15033 1 1 2 2 2 1 3 3

How do we compute i?

tex2html_wrap_inline15037

tex2html_wrap_inline15039

To find the longest sequence - we know it ends somewhere, so Length = tex2html_wrap_inline15041

Listen To Part 14-5

The Principle of Optimality

To use dynamic programming, the problem must observe the principle of optimality, that whatever the initial state is, remaining decisions must be optimal with regard the state following from the first decision.  

Combinatorial problems may have this property but may use too much memory/time to be efficient.

Example: The Traveling Salesman Problem

Let tex2html_wrap_inline15043 be the cost of the optimal tour for i to 1 that goes thru each of the other cities once  

displaymath15019

displaymath15020

Here there can be any subset of tex2html_wrap_inline15045 instead of any subinterval - hence exponential.

Still, with other ideas (some type of pruning or best-first search) it can be effective for combinatorial search.

Listen To Part 14-6

When can you use Dynamic Programming?

Dynamic programming computes recurrences efficiently by storing partial results. Thus dynamic programming can only be efficient when there are not too many partial results to compute!  

There are n! permutations of an n-element set - we cannot use dynamic programming to store the best solution for each subpermutation. There are tex2html_wrap_inline15049 subsets of an n-element set - we cannot use dynamic programming to store the best solution for each.

However, there are only n(n-1)/2 continguous substrings of a string, each described by a starting and ending point, so we can use it for string problems.

There are only n(n-1)/2 possible subtrees of a binary search tree, each described by a maximum and minimum key, so we can use it for optimizing binary search trees.

Dynamic programming works best on objects which are linearly ordered and cannot be rearranged - characters in a string, matrices in a chain, points around the boundary of a polygon, the left-to-right order of leaves in a search tree.

Whenever your objects are ordered in a left-to-right way, you should smell dynamic programming!

Listen To Part 14-7

Minimum Length Triangulation

A triangulation of a polygon is a set of non-intersecting diagonals which partitions the polygon into diagonals.  

tex2html_wrap15063
The length of a triangulation is the sum of the diagonal lengths.

We seek to find the minimum length triangulation. For a convex polygon, or part thereof:

tex2html_wrap15065
Once we identify the correct connecting vertex, the polygon is partitioned into two smaller pieces, both of which must be triangulated optimally!

eqnarray7624

Evaluation proceeds as in the matrix multiplication example - tex2html_wrap_inline15055 values of t, each of which takes O(j-i) time if we evaluate the sections in order of increasing size.

tex2html_wrap15067
What if there are points in the interior of the polygon?

Listen To Part 14-8

Dynamic Programming and High Density Bar Codes

Symbol Technology has developed a new design for bar codes, PDF-417 that has a capacity of several hundred bytes. What is the best way to encode text for this design?  

tex2html_wrap15069
They developed a complicated mode-switching data compression scheme.

tex2html_wrap15071
Latch commands permanently put you in a different mode. Shift commands temporarily put you in a different mode.

Listen To Part 14-9

Originally, Symbol used a greedy algorithm to encode a string, making local decisions only. We realized that for any prefix, you want an optimal encoding which might leave you in every possible mode.

tex2html_wrap15073
tex2html_wrap_inline15059 the cost of encoding the ith character and ending up in node j).

Our simple dynamic programming algorithm improved to capacity of PDF-417 by an average of tex2html_wrap_inline15061 !

Listen To Part 14-10

Dynamic Programming and Morphing

Morphing is the problem of creating a smooth series of intermediate images given a starting and ending image.   

The key problem is establishing a correspondence between features in the two images. You want to morph an eye to an eye, not an ear to an ear.

We can do this matching on a line-by-line basis:

tex2html_wrap15075
This should sound like string matching, but with a different set of operations:

This algorithm was incorported into a morphing system, with the following results:

tex2html_wrap15077

next up previous index CD Book Algorithms
Next: Lecture 14 - data Up: No Title Previous: Lecture 12 - introduction

Algorithms
Mon Jun 2 09:21:39 EDT 1997