SamPra - Social Networking Website - DBMS Project

7/23/2019 SamPra - Social Networking Website - DBMS Project

1/13

1

A Report OnSamPra Social Networking Website

(Distributed Database Approach)

Database Management And 4 GL


2/13

2

Table of Contents

TITLE

1 Introduction

2 Problem Statement

3 ER Diagram And Tables

4 Application

5 Snapshot of the application

6 Contribution of individual members of the group in the project

PAGE

NO.

3

5

6-

9

10

13


3/13

3

Introduction

Social networking is the grouping of individuals into specific groups, like small rural

communities or a neighborhood subdivision. Although social networking is possible in

person, especially in the workplace, universities, and high schools, it is most popular

online. This is because unlike most high schools, colleges, or workplaces, the internet isfilled with millions of individuals who are looking to meet other people, to gather and

share first-hand information and experiences about golfing, gardening, aesthetics and

cosmetic surgery, developing friendships or professional alliances, finding employment,

business-to-business marketing and even groups sharing information about the end of

the Mayan calendar and the Great Shift. The topics and interests are as varied and rich

as our society and the history of the human being. When it comes to online social

networking, websites are commonly used. These websites are known as social sites.

Social networking websites function like an online community of internet users.

Depending on the website in question, many of these online community members share

common interests in hobbies, religion, or politics. Once you are granted access to a

social networking website you can begin to socialize. This socialization may include

reading the profile pages of other members and possibly even contacting them.As we all

know that a coin has two sides, there are dangers associated with social networking

including data theft and viruses, which are on the rise. The most prevalent danger

though often involves online predators or individuals who claim to be someone that they

are not. Although danger does exist with networking online, it also exists with

networking out in the real world.

Our project is an online Social Networking Website which used a distributed database at

the back end. As data is stored in huge quantities in Social Networking using a Singleserver to host the database is not practical. Hence, we illustrated how distributed

database is maintained and data is fetched as per requirement from multiple servers.

The application of this Project is to any project which requires the maintenance

of a large database (like Social Networking, employees database, Citizens database at

government sites etc.)

Background

Hardware / Equipment used:

4 Pc Machines (1 Master and 3 Slaves, located in MSCLIS 1st year Lab)


4/13

4

Framework / Architecture used:

Apache Hadoop

Apache Hadoop is an open-source software framework that supports data-intensive

distributed applications. The Hadoop framework transparently provides both reliability

and data motion to applications. Hadoop implements a computational paradigm

named Mapreduce where the application is divided into many small fragments of work,

each of which may be executed or re-executed on any node in the cluster. In addition, it

provides a distributed file system that stores data on the compute nodes, providing very

high aggregate bandwidth across the cluster. Both map/reduce and the distributed file

system are designed so that node failures are automatically handled by the framework.

Each node in a Hadoop instance typically has a single namenode; a cluster of datanodesform the HDFS cluster. The file system uses the TCP/IP layer for communication.

Clients use Remote procedure call (RPC) to communicate between each other.

A small Hadoop cluster will include a single master and multiple worker nodes. The

master node consists of a JobTracker, TaskTracker, NameNode and DataNode. A slave

or worker node acts as both a DataNode and TaskTracker, though it is possible to have

data-only worker nodes, and compute-only worker nodes


5/13

5

Problem Statement

Data Intensive Application like Social Networking, government Databases etc come

under tremendous load and often fail to satisfy requests, eg IRCTC, MySpace etc. They

quickly run out Resources like space, memory, CPU cycles, when requests are made on

them on a global basis.

Our Approach during the Project: We wished to illustrate how distributed

database frameworks can be used to serve such data intensive needs. We used the

Hadoop Framework that is deployed by the likes of Facebook, Yahoo etc

Design of our Project: We already had the Hadoop Framework to work with. We

designed Database schemas to it and then designed a Web Interface for our SamPra

Networking Website. We configured the Master and Slaves to be used to serve data

requests and brought it all together.

Slave 1 Master Slave 2 Slave 3

Configure Hadoop Master / Slaves

Design Database Schema for SamPra

SamPra Website Front-end

Populate the Database in the HadoopStorage


6/13

6

Tables

Table Name: Profile

Column Family: IDttr ute ame ype ze escr pt on

rst_ ame arc ar 20 e rst ame oPerson

ast_ ame arc ar 20 e ast ame oPerson

ma arc ar 25 ma o erson

asswor arc ar 20 as es o assworSelected

one_ o nt 10 e o e um er

en er ar 2 e en er oPerson

rt ay ate - e erson sBirthday

ress arc ar 40 e erson sResidence

ou _ e arc ar 0 erson n s ownwords

nt n que o erson

Column Family: Workttr ute ype ze escr pt on

ota _ ompan es nt 3 ompan es nvo ve

ota _ xper ence nt 2 ears o xper ence

ame arc ar 20 ame o ompany

ress arc ar 0 A ress oCompany

es gnat on arc ar 40 es gnat on oPerson

or _ on s n 2 o. o or on s

Column Family: Educationttr ute ype ze escr pt on

c oo _ ame arc ar 20 ame o c ooAttended

ercentage_10 nt 2 ercentage n 10

o ege_ ame arc ar 20 ame o un orCollege Attended


7/13

7

ercen age_12 n 2 ercen age n 12

o ege_ ame arc ar 20 ame o t e o ege

ercentage_ ra nt 2 ercentage n ra

Table Name: Friends

Column Family: ID

Attribute Type Size Description

Friends_List Varchar 30 List of Friends

Sent_Request Int 3 No. of Requests

Pending_Requests Int 3 Requests Pending

Blocked_List Varchar 30 UID of BlockedPeople

Table Name: Updates

Column Family: Posts

Attribute Type Size DescriptionTotal_Status Int 2 Total Posts made

Status Int 2 Status of Post

From Varchar 20 Fname of Person

Likes Int 3 No. of Likes on Post


8/13

8

Column Family: Comments

Attribute Name Type Size Description

Comment_ID Int 6 Unique Id ofComment

From Int 6 Id of Sender

Receiver Int 6 Id of Receiver

Comment Varchar 100 The ActualComment

Date Date - The Date ofComment

Likes Int 3 The no. of Likes onComment

Column Family: Messages

Attribute Type Size Description

Total_Messages Int 3 The total count ofMessages

Message Varchar 100 The Actual Message

From Int 6 The UID of Sender

MStatus Int 1 Read or Not


9/13

9

Application Of SamPra Social Networking:

The Applications SamPra Website over Distributed Framework are many. Social

networking service is a platform to build social networks or social relations among

people who, for example, share interests, activities, backgrounds, or real-life

connections. A social network service consists of a representation of each user (often aprofile), his/her social links, and a variety of additional services. Most social network

services are web-based and provide means for users to interact over the Internet, such

as e-mail and instant messaging. Online community services are sometimes considered

as a social network service, though in a broader sense, social network service usually

means an individual-centered service whereas online community services are group-

centered. Social networking sites allow users to share ideas, pictures, posts, activities,

events, and interests with people in their network.

The distributed framework we illustrated through this projects can offer many

advantages in Databases which are huge and need to spread over different networks,these are:

Management of distributed data with different levels of transparency likenetwork transparency, fragmentation transparency, replication transparency, etc.

Increase reliability and availability. Easier expansion. Reflects organizational structure database fragments are located in the

departments they relate to.

Protection of valuable data if there were ever a catastrophic event such as afire, all of the data would not be in one place, but distributed in multiple

locations.

Improved performance data is located near the site of greatest demand, andthe database systems themselves are parallelized, allowing load on the databases

to be balanced among servers. (A high load on one module of the database won't

affect other modules of the database in a distributed database.)

Modularity systems can be modified, added and removed from the distributeddatabase without affecting other modules (systems).

Reliable transactions - Due to replication of database. Distributed query processing can improve performance. Distributed transaction management.


10/13

10

Snapshots of the Developed Application

The Login Page (You can Login here or follow link to Register)

The Register Page (where first time users make a new profile)


11/13

11

The Main Home Page


12/13

12

The Profile Wall Page


13/13

13

What Individual Members did in the Project

Member 1: Pranshu Bajpai

Role 1: Designed the Database Schema and Handled the Apache HBase Hadoop

Database of multiple PCs (1 Master + 3 Slaves)

Sample HBase Commands used:

- Create profile, username, email, pswd, phno, gender, bday, b_month,b_yr, relation_status, languages, about_you, address

- Create profile, id, work, education- Put profile, pranshu, id:fname, pranshu- Get profile, pranshu

Role 2: Populated the Database Tables with initial entries

Role 3: Designed the developed the website Front-end using HTML and CSS and JSP

Member 2: Sameer Patil

Distributed Computing Framework Deployment

Role 1: Configured the Apache Hadoop framework

The distributed computing framework Hadoop was deployed on 1 master and 3 slaves.

The master would have following services running:

HQuorumPeer

HMaster

NameNode

JobTracker

The slaves would have following services running:

Regionserver

Datanode

TaskTracker

Role 2: Coding Modules

SamPra - Social Networking Website - DBMS Project

Documents

Transcript of SamPra - Social Networking Website - DBMS Project