Lecture 5:          Dictionaries         Steven SkienaDepartment of Computer Science State University of New York Stony Br...
Dictionary / Dynamic Set OperationsPerhaps the most important class of data structures maintaina set of items, indexed by ...
• Min(S), Max(S) – Returns the element of the totally   ordered set S which has the smallest (largest) key. • Next(S,x), P...
Problem of the DayWhat is the asymptotic worst-case running times for each ofthe seven fundamental dictionary operations w...
Solution Blank                      singly   singly doubly doubly                      unsorted sorted unsorted sorted  Se...
Solution                      singly     double     singly   doubly Dictionary operation unsorted   unsorted   sorted   so...
Binary Search TreesBinary search trees provide a data structure which efficientlysupports all six dictionary operations.A b...
Binary Search TreesA binary search tree labels each node x in a binary tree suchthat all nodes in the left subtree of x ha...
Implementing Binary Search Treestypedef struct tree {      item type item;      struct tree *parent;      struct tree *lef...
Searching in a Binary Tree: Implementationtree *search tree(tree *l, item type x){      if (l == NULL) return(NULL);      ...
Searching in a Binary Tree: How MuchThe algorithm works because both the left and right subtreesof a binary search tree ar...
Maximum and MinimumWhere are the maximum and minimum elements in a binarysearch tree?
Finding the Minimumtree *find minimum(tree *t){      tree *min; (* pointer to minimum *)      if (t == NULL) return(NULL);...
Where is the Predecessor: Internal Node                                   X                      PREDECESSOR(X)   SUCCESSO...
Where is the Successor: Leaf Node                             predecessor(x)                             XIf it does not h...
In-Order Traversalvoid traverse tree(tree *l){      if (l != NULL) {            traverse tree(l->left);            process...
Tree InsertionDo a binary search to find where it should be, then replace thetermination NIL pointer with the new item.    ...
insert tree(tree **l, item type x, tree *parent){      tree *p; (* temporary pointer *)      if (*l == NULL) {            ...
Tree DeletionDeletion is trickier than insertion, because the node to diemay not be a leaf, and thus effect other nodes.Th...
Cases of Deletion            2                             2                                  2                           ...
Binary Search Trees as DictionariesAll six of our dictionary operations, when implemented withbinary search trees, take O(...
Worst Case and Average Heightinsert(a)insert(b)insert(c)insert(d)                 A                     B                 ...
Tree Insertion AnalysisIn fact, binary search trees constructed with random insertionorders on average have Θ(lg n) height...
Perfectly Balanced TreesPerfectly balanced trees require a lot of work to maintain:                                       ...
Balanced Search TreesTherefore, when we talk about ”balanced” trees, we meantrees whose height is O(lg n), so all dictiona...
Upcoming SlideShare
Loading in...5
×

Skiena algorithm 2007 lecture05 dictionary data structure trees

494

Published on

Published in: Business, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
494
On Slideshare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
8
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Skiena algorithm 2007 lecture05 dictionary data structure trees

  1. 1. Lecture 5: Dictionaries Steven SkienaDepartment of Computer Science State University of New York Stony Brook, NY 11794–4400http://www.cs.sunysb.edu/∼skiena
  2. 2. Dictionary / Dynamic Set OperationsPerhaps the most important class of data structures maintaina set of items, indexed by keys. • Search(S,k) – A query that, given a set S and a key value k, returns a pointer x to an element in S such that key[x] = k, or nil if no such element belongs to S. • Insert(S,x) – A modifying operation that augments the set S with the element x. • Delete(S,x) – Given a pointer x to an element in the set S, remove x from S. Observe we are given a pointer to an element x, not a key value.
  3. 3. • Min(S), Max(S) – Returns the element of the totally ordered set S which has the smallest (largest) key. • Next(S,x), Previous(S,x) – Given an element x whose key is from a totally ordered set S, returns the next largest (smallest) element in S, or NIL if x is the maximum (minimum) element.There are a variety of implementations of these dictionaryoperations, each of which yield different time bounds forvarious operations.
  4. 4. Problem of the DayWhat is the asymptotic worst-case running times for each ofthe seven fundamental dictionary operations when the datastructure is implemented as • A singly-linked unsorted list, • A doubly-linked unsorted list, • A singly-linked sorted list, and finally • A doubly-linked sorted list.
  5. 5. Solution Blank singly singly doubly doubly unsorted sorted unsorted sorted Search(L, k) Insert(L, x) Delete(L, x) Successor(L, x) Predecessor(L, x) Minimum(L) Maximum(L)
  6. 6. Solution singly double singly doubly Dictionary operation unsorted unsorted sorted sorted Search(L, k) O(n) O(n) O(n) O(n) Insert(L, x) O(1) O(1) O(n) O(n) Delete(L, x) O(n)∗ O(1) O(n)∗ O(1) Successor(L, x) O(n) O(n) O(1) O(1) Predecessor(L, x) O(n) O(n) O(n)∗ O(1) Minimum(L) O(n) O(n) O(1) O(1) Maximum(L) O(n) O(n) O(1)∗ O(1)
  7. 7. Binary Search TreesBinary search trees provide a data structure which efficientlysupports all six dictionary operations.A binary tree is a rooted tree where each node contains atmost two children.Each child can be identified as either a left or right child. parent left right
  8. 8. Binary Search TreesA binary search tree labels each node x in a binary tree suchthat all nodes in the left subtree of x have keys < x and allnodes in the right subtree of x have key’s > x. 2 3 7 6 8 5The search tree labeling enables us to find where any key is.
  9. 9. Implementing Binary Search Treestypedef struct tree { item type item; struct tree *parent; struct tree *left; struct tree *right;} tree;The parent link is optional, since we can store the pointer ona stack when we encounter it.
  10. 10. Searching in a Binary Tree: Implementationtree *search tree(tree *l, item type x){ if (l == NULL) return(NULL); if (l->item == x) return(l); if (x < l->item) return( search tree(l->left, x) ); else return( search tree(l->right, x) );}
  11. 11. Searching in a Binary Tree: How MuchThe algorithm works because both the left and right subtreesof a binary search tree are binary search trees – recursivestructure, recursive algorithm.This takes time proportional to the height of the tree, O(h).
  12. 12. Maximum and MinimumWhere are the maximum and minimum elements in a binarysearch tree?
  13. 13. Finding the Minimumtree *find minimum(tree *t){ tree *min; (* pointer to minimum *) if (t == NULL) return(NULL); min = t; while (min->left != NULL) min = min->left; return(min);}Finding the max or min takes time proportional to the heightof the tree, O(h).
  14. 14. Where is the Predecessor: Internal Node X PREDECESSOR(X) SUCCESSOR(X)If X has two children, its predecessor is the maximum valuein its left subtree and its successor the minimum value in itsright subtree.
  15. 15. Where is the Successor: Leaf Node predecessor(x) XIf it does not have a left child, a node’s predecessor is its firstleft ancestor.The proof of correctness comes from looking at the in-ordertraversal of the tree.
  16. 16. In-Order Traversalvoid traverse tree(tree *l){ if (l != NULL) { traverse tree(l->left); process item(l->item); traverse tree(l->right); } } H A F B G D C E
  17. 17. Tree InsertionDo a binary search to find where it should be, then replace thetermination NIL pointer with the new item. 1 3 2 7 6 8 5Insertion takes time proportional to the height of the tree,O(h).
  18. 18. insert tree(tree **l, item type x, tree *parent){ tree *p; (* temporary pointer *) if (*l == NULL) { p = malloc(sizeof(tree)); (* allocate new node *) p->item = x; p->left = p->right = NULL; p->parent = parent; *l = p; (* link into parent’s record *) return; } if (x < (*l)->item) insert tree(&((*l)->left), x, *l); else insert tree(&((*l)->right), x, *l);}
  19. 19. Tree DeletionDeletion is trickier than insertion, because the node to diemay not be a leaf, and thus effect other nodes.There are three cases:Case (a), where the node is a leaf, is simple - just NIL out theparents child pointer.Case (b), where a node has one chld, the doomed node canjust be cut out.Case (c), relabel the node as its successor (which has at mostone child when z has two children!) and delete the successor!
  20. 20. Cases of Deletion 2 2 2 2 1 7 1 7 1 7 1 7 4 8 4 8 4 8 5 8 3 6 6 3 5 3 6 5 5 initial tree delete node with zero children (3) delete node with 1 child (6) delete node with 2 children (4)
  21. 21. Binary Search Trees as DictionariesAll six of our dictionary operations, when implemented withbinary search trees, take O(h), where h is the height of thetree.The best height we could hope to get is lg n, if the tree wasperfectly balanced, since lg n 2i ≈ n i=0But if we get unlucky with our order of insertion or deletion,we could get linear height!
  22. 22. Worst Case and Average Heightinsert(a)insert(b)insert(c)insert(d) A B C D
  23. 23. Tree Insertion AnalysisIn fact, binary search trees constructed with random insertionorders on average have Θ(lg n) height.The worst case is linear, however.Our analysis of Quicksort will later explain why the expectedheight is Θ(lg n).
  24. 24. Perfectly Balanced TreesPerfectly balanced trees require a lot of work to maintain: 9 5 13 3 7 11 15 2 4 6 8 10 12 14 1If we insert the key 1, we must move every single node in thetree to rebalance it, taking Θ(n) time.
  25. 25. Balanced Search TreesTherefore, when we talk about ”balanced” trees, we meantrees whose height is O(lg n), so all dictionary operations(insert, delete, search, min/max, successor/predecessor) takeO(lg n) time.Extra care must be taken on insertion and deletion toguarantee such performance, by rearranging things when theyget too lopsided.Red-Black trees, AVL trees, 2-3 trees, splay trees, and B-treesare examples of balanced search trees used in practice anddiscussed in most data structure texts.
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×