8/8/2019 laod balancing in parallel computing

1/18

LOAD BALANCING

INPARALLEL COMPUTING

TEAM MEMBERS:-

HEMANT SHARMA

RAJNISH BISHNOI

1

8/8/2019 laod balancing in parallel computing

2/18

Introduction to Load BalancingIn terms computer networking the loadbalancing Is a technique todistribute workload evenly across twoor more computers, network links,CPUs, hard drives, or other resources, inorder to get optimal resource utilization& maximize throughput or minimizethe response time & avoid overload .

2

8/8/2019 laod balancing in parallel computing

3/18

3

Types of Parallel Computers

y The parallel computers are classified as

y shared memory

y distributed memory

y Both shared and distributed memory systems have:

1. processors

2. memory

3. network

8/8/2019 laod balancing in parallel computing

4/18

4

Interconnect Method

There is no single way to connect bunch of processors

y The manner in which the nodes are connected -Network & Topology(mesh,star).

8/8/2019 laod balancing in parallel computing

5/18

5

Block Diagrams

Memory

Interconnection Network

P1 P2 P3 P4 P5

A Shared Memory Parallel Computer

Processors

8/8/2019 laod balancing in parallel computing

6/18

6

Block Diagrams

Interconnection Network

P1 P2 P3 P4 P5

M1 M2 M3 M4 M5

A Distributed Memory Parallel Computer

8/8/2019 laod balancing in parallel computing

7/18

PROCESS IN SERIAL COMPUTING

7

8/8/2019 laod balancing in parallel computing

8/18

PROCESS IN PARALLEL COMPUTING

8

8/8/2019 laod balancing in parallel computing

9/18

9

Types of parallelism

y Control parallelism (Algorithmic parallelism):

y Data parallelism

8/8/2019 laod balancing in parallel computing

10/18

10

Parallel Programming Models

Different approaches are used in the development ofparallel programs

y Shared Variable Model:

y

Message Passing Model:

8/8/2019 laod balancing in parallel computing

11/18

11

Load Sharing and Queuing System

y Keep track of available nodes in the system

yAllot nodes to jobs

y Maintain job queues with job priority,reservations

8/8/2019 laod balancing in parallel computing

12/18

Distributed schedulingDistributed scheduling is composed of

two parts:

Local Scheduling

Global Scheduling

12

8/8/2019 laod balancing in parallel computing

13/18

Computer N/W

P1

Pk+1

P2 Pk

Pn-1 Pn

. . . . . . .

. . . . . . .

Network connectivity in Distributed System

13

8/8/2019 laod balancing in parallel computing

14/18

Different Approaches used in loadbalancing :-

Two different form have been taken by researchers intheir attempts to achieve load balance in distributedsystems are

Static

Dynamic

14

8/8/2019 laod balancing in parallel computing

15/18

Static Load balancing :-

The Static approach further divide into twocategories -

Deterministic - A deterministic strategy assignstasks to processors based on a fixed criterion.

Probabilistic - A probabilistic strategy uses

probability values when the assignment is made.

15

8/8/2019 laod balancing in parallel computing

16/18

Dynamic Load Balancing : -well known strategies are

Bidding

Drifting Threshold

Greedy

16

8/8/2019 laod balancing in parallel computing

17/18

Scope of Project

Load balancing in parallel computing has beenconsidered to be "the high end of computing", and has

been used to model difficult scientific and engineeringproblems found in the real world .

Few of them are

y Computer Science, Mathematics

17

8/8/2019 laod balancing in parallel computing

18/18

**THANKS TO ALL OF YOU**

18