Lecture 5

Trees

Family Trees

Please draw from the board

Tree: Section 4.1 (Weiss)

Formal Definition

Tree is a sequence of nodes.

There is a starting node known as root node.

Every node other than the root has a parent node.

Nodes may have any number of children.

A has 3 children, B, C, D

A is parent of B

A

B C D

E

Path to a node p is a sequence of nodes root,n1, n2, …..p such that n1 is a child of root, n2 is a child of n1 ……

Path to E is ?

How many paths are there to one node?

Depth of a node is the length of the unique path from the root to the node (not counting the node).

Root is at depth 0

Depth of E is ?

Leaves are nodes without any children.

D and E are a leaf node.

Height of a nonleaf node is the length of the LONGEST path from the node to a leaf(not counting the leaf).

Height of a leaf is 0

Height of A is ?

Application

Organization of a file system.

Note down the example from the board

Every node has one or more elements:

Directory example: element of a node is the name of the corresponding directory

Implementation

Using pointers

A node has a pointer to all its children

Since a node may have many children, the child pointers have a linked list.

A has a pointer to B, C, D each.

B has pointers to E and its other child.

E does not have any pointers.

Addition of a child:

Create the new child node

Add a pointer to this child in the link list of its parent.

Deletion of a child B:

Children of B are first made children of the parent of B

Node B is deleted.

Deletion of the root:

One of the children becomes the new root:

Other children of old root become the children of the new root

Tree Traversal

Preorder

Postorder

Preorder:

First do the required operation with a node, then with its children

Postorder:

First do the required operation with the children, then return to the node.

Preorder Example

Need to find the depth of each node in the tree representing the unix file system.

Listdepth(node,depth)

{

print(node->name, depth)

for each child C of node

Listdepth(C,depth+1)

}

Postorder ExampleNeed to find the size of each directory in the unix file system

Dirsize(node)

{

size = 0

for each child C of node

size size + Dirsize( C );

print(node->name, size);

}

Binary Trees

Section 4.2, Weiss

A node can have at most 2 children, leftchild and rightchild

A complete binary tree is one where a node can have 0 or 2 children and all leaves are at the same depth.

A complete binary tree of N nodes has depth O(log N)

Proof

Prove by induction that number of nodes at depth d is 2d

Total number of nodes of a complete binary tree of depth d is 1 + 2 + 4 +…… 2d = 2d+1 - 1

Thus 2d+1 - 1 = N

d = log(N + 1) - 1

What is the largest depth of a binary tree of N nodes?

Inorder TravelFirst operate with the left subtree

Then operate with the node

Then operate with the right subtree

Printtree(node)

{

printtree(node->leftchild);

print(node->element);

printtree(node->rightchild);

}

Search Tree

A binary search tree is useful for searching, Section 4.3

All elements in the left subtree of a node are smaller than the element of the node, and all elements in the right subtree of a node are larger.

Example: Note down from the board

We assume that al elements are distinct

Searching an element in the Tree

Start from the root.

Each time we encounter a node, see if the key in the node equals the element. If yes stop.

If the element is less, go to the left subtree.

If it is more, go to the right subtree.

Conclude that the element is not in the list if we reach a leaf node and the key in the node does not equal the element.

Search(node, element)

{

If (node = NULL) conclude NOT FOUND;

Else If (node.key = element) conclude FOUND;

Else If (element < node.key) Search(node.leftchild, element);

Else If (element > node.key) Search(node.rightchild, element);

}

Complexity: O(d), d is the depth

Find Min

Node = root;

For (node = root; node=node.leftchild; node!=NULL)

prevnode = node;

Return(prevnode);

Complexity: O(d)

Insert an element

Try to find the element;

If the element exists, do nothing.

If it does not, insert it at the position of the returned null pointer;

Insert(node, element)

{

If (node.key = element) conclude FOUND and RETURN;

Else If (element < node.key)

{

if (node.leftchild =NULL)

insert the new node at node.leftchild; else Insert(node.leftchild, element);

}

Else If (element > node.key)

{

?????????? }

}

Complexity: O(d)

DELETION

When we delete a node, we need to consider how we take care of the children of the deleted nodes.

This has to be done such that the property of the search tree is maintained.

Any problem if the node has no child?

Any problem if the node has only one child?

Suppose, the node has two children.

Look at the right subtree of the node (subtree rooted at the right child of he node).

Find the Minimum there.

Replace the key of the node to be deleted by the minimum element.

Delete the minimum element.

Any problem deleting it?

For deletion convenience, always have a pointer from a node to its parent.

Pseudo CodeIf a node is childless, then

{

node->parent->ptr_to_node = NULL

free node;

}

If a node has one child

{

node->parent->child = node->child;

free node;

}

If a node has 2 children,

{

minnode = findmin(rightsubtree)->key;

node->key = minnode->key;

delete(minnode);

}

Complexity?

Lazy Deletion

Don’t physically delete the node, but mark it as ``junk.’’

Any problem?

Increases the depth of the tree.

However, if the number of deleted nodes is of the same order as the number of existing nodes, then lazy deletion does not alter the order of the depth significantly.

AVL Trees

We have seen that all operations depend on the depth of the tree.

We don’t want trees with large height

This can be attained if both subtrees of each node have roughly the same height.

AVL tree is a binary search tree where the height of the two subtrees of a node differs by at most one

Height of a null tree is -1

Section 4.4, Weiss

Suppose an AVL tree of height h contains contains at most S(h) nodes:

S(h) = L(h) + R(h) + 1

L(h) is the number of nodes in left subtree

R(h) is the number of nodes in right subtree

You have larger number of nodes if there is larger imbalance between the subtrees

This happens if one subtree has height h-1, another h-2

Thus, S(h) = S(h-1) + S(h-2) + 1

Using this you can show that h = O(log N)

Operations in AVL Tree

Searching, Complexity?

FindMin, Complexity?

Deletion?

Lazy Deletion, Complexity?

Insertion

Search for the element

If it is not there, insert it in its place.

Any problem?

Insertion may imbalance the tree. Heights of two children of a node may differ by 2 after an insertion.

Tree Rotations used to restore the balance.

If an insertion cause an imbalance, which nodes can be affected?

Nodes on the path of the inserted node.

Let U be the node nearest to the inserted one which has an imbalance.

insertion in the left subtree of the left child of U

insertion in the right subtree of the left child of U

insertion in the left subtree of the right child of U

insertion in the right subtree of the right child of U

Insertion in left child of left subtree

Single Rotation

U

V

X

Y

Z

V

U

XY Z

Before Rotation After Rotation

Example

Note down from board

Double Rotation

Suppose, imbalance is due to an insertion in the left subtree of right child

Single Rotation does not work!U

V

A

D

W

B C

W

V U

A DB C

Before Rotation After Rotation

Example

Note down from board

Pseudocode

Insert(X, T)

{

If (T = NULL)

insert X at T; T->height = 0;

If (XT.element)

{

Insert(X, T ->left)

If Height(T ->left) - Height(T ->right) = 2

PseudocodeSinglerotate routine in Fig 4.41 (Weiss)

Separate for left and right nodes

Doublerotate routine in Fig 4.43 (Weiss)

Separate for left and right nodes

{

If (X < T.leftchild.element) T =singleroratewithleft(T);

else T =doubleroratewithleft(T);

} }

Else If (X>T.element)

{

Insert(X, T ->right)

If Height(T ->right) - Height(T ->leftt) = 2

{

If (X > T.righchild.element) T =singleroratewithright(T);

else T =doubleroratewithright(T);

} }

T->height = max(height(T->left), height(T->right)) + 1;

Return(T);

EXTENDED EXAMPLE

Note down from board

Deletions can be done with similar rotations