High Performance WMS with Virtualization - hnee.de · HIGH PERFORMANCE WMS WITH ... Monitoring...

23
Student Research Colloquium Forest Information Technology (M.Sc.) Majid Jalili [email protected] 24. Juni 2014 HIGH PERFORMANCE WMS WITH VIRTUALIZATION

Transcript of High Performance WMS with Virtualization - hnee.de · HIGH PERFORMANCE WMS WITH ... Monitoring...

Page 1: High Performance WMS with Virtualization - hnee.de · HIGH PERFORMANCE WMS WITH ... Monitoring Distributed Packet from DB ... • VMware® vCenter™ Single Sign-On Server Technical

Student Research Colloquium

Forest Information Technology (M.Sc.)

Majid Jalili

[email protected]

24. Juni 2014

HIGH PERFORMANCE WMS WITH

VIRTUALIZATION

Page 2: High Performance WMS with Virtualization - hnee.de · HIGH PERFORMANCE WMS WITH ... Monitoring Distributed Packet from DB ... • VMware® vCenter™ Single Sign-On Server Technical

OUTLINE

• Agenda

• Introduction

• Project Architecture

• Research Target

• Result

• Conclustion

• Outlook

HIGH PERFORMANCE WMS WITH VIRTUALIZATION 2

Page 3: High Performance WMS with Virtualization - hnee.de · HIGH PERFORMANCE WMS WITH ... Monitoring Distributed Packet from DB ... • VMware® vCenter™ Single Sign-On Server Technical

Agenda

• Advantages of Server Virtualization

• Introduce Virtualization Project

• Compare of Performance in Different Servers Platform

• Virtual Network operation in Virtual Machine

• Large Data Storage and response to Access Data from Server to

different Resource in to the SAN Storage

• Monitoring Virtual Network Performance between SAN storage and

Server and Create Load balancing for increase the Speed on the

Network I/O

• Monitoring of I/O Traffic in Virtual Network between Virtual Kernel

for each operating System in Local Machine and SAN Storage

High Performance WMS with Virtualization 3

Page 4: High Performance WMS with Virtualization - hnee.de · HIGH PERFORMANCE WMS WITH ... Monitoring Distributed Packet from DB ... • VMware® vCenter™ Single Sign-On Server Technical

Data virtualization vs Data integration

• Increase the Performance for access the resource between client request or

between Web Server and Database Server

• High Availability with lower bandwith transmission data to migrate Virtual

Machine between different Server.(Capacity ,Memory ,CPU)

• Improve and more flaxibile to Disaster recovery and Fault Tolerance

• Integrate all the resource from each Server and Make Centeralize

Distribution for Monitoring and Control the Traffic

• Dynamic Distribution resource scheduler to share the Memory ,CPU and

Storage between diffrent Virtual Host in Virtualization

High Performance WMS with Virtualization 4

Page 5: High Performance WMS with Virtualization - hnee.de · HIGH PERFORMANCE WMS WITH ... Monitoring Distributed Packet from DB ... • VMware® vCenter™ Single Sign-On Server Technical

Project Architecture

High Performance WMS with Virtualization 5

Page 6: High Performance WMS with Virtualization - hnee.de · HIGH PERFORMANCE WMS WITH ... Monitoring Distributed Packet from DB ... • VMware® vCenter™ Single Sign-On Server Technical

Open Source Server - Implementation

High Performance WMS with Virtualization 6

Page 7: High Performance WMS with Virtualization - hnee.de · HIGH PERFORMANCE WMS WITH ... Monitoring Distributed Packet from DB ... • VMware® vCenter™ Single Sign-On Server Technical

Microsoft Server-Implementation

High Performance WMS with Virtualization 7

Page 8: High Performance WMS with Virtualization - hnee.de · HIGH PERFORMANCE WMS WITH ... Monitoring Distributed Packet from DB ... • VMware® vCenter™ Single Sign-On Server Technical

Virtual SAN Storage Architecture (Create a file level Transfer)

High Performance WMS with Virtualization 8

Storage Area Network

Local Area Network

Fiber channel and iSCSI channel

Page 9: High Performance WMS with Virtualization - hnee.de · HIGH PERFORMANCE WMS WITH ... Monitoring Distributed Packet from DB ... • VMware® vCenter™ Single Sign-On Server Technical

LUN01

LUN-ADD for DB Server

High Performance WMS with Virtualization 9

Raw device mapping (RDM) Direct access of Virtual Machine Disk from Host to Storage Area Network

Page 10: High Performance WMS with Virtualization - hnee.de · HIGH PERFORMANCE WMS WITH ... Monitoring Distributed Packet from DB ... • VMware® vCenter™ Single Sign-On Server Technical

SAN Storage Architecture Store the DB Server .VMDK on SAN Storage with RDM

High Performance WMS with Virtualization 10

Store VMDK from DB Server to SAN Storage

Page 11: High Performance WMS with Virtualization - hnee.de · HIGH PERFORMANCE WMS WITH ... Monitoring Distributed Packet from DB ... • VMware® vCenter™ Single Sign-On Server Technical

Concept of Virtual Network (Between Virtual Machine and SAN Storage)

High Performance WMS with Virtualization 11

Virtual Host (ESXi Server)

Virtual SAN Storage

Virtual Machine File System

Setup the 2 Diffrent line Connection ,Fiber Channel with

8 Gbps data trasfering and iSCSI Channel with 2 Gbps data Trasnfering between Host and

Storage

Page 12: High Performance WMS with Virtualization - hnee.de · HIGH PERFORMANCE WMS WITH ... Monitoring Distributed Packet from DB ... • VMware® vCenter™ Single Sign-On Server Technical

Virtual Network Architecture

NIC Card

QLogic Fiber Channel

High Performance WMS with Virtualization 12

Page 13: High Performance WMS with Virtualization - hnee.de · HIGH PERFORMANCE WMS WITH ... Monitoring Distributed Packet from DB ... • VMware® vCenter™ Single Sign-On Server Technical

I/O Channel Performance (Setup the three channel between virtual host and Storage Area Network)

QLogic Fiber Channel FCOE

High Performance WMS with Virtualization 13

Fiber Channel over Ethernet (FCOE) ,10 Gbps Data Trasfer between LAMP Server and Storage are Network

Fiber Channel (FC) ,8 Gbps Data Trasfer between WEB Server and Storage are Network and iSCSI channel ,2 Gbps Data Trasfer between Database Server and SAN Storage

Page 14: High Performance WMS with Virtualization - hnee.de · HIGH PERFORMANCE WMS WITH ... Monitoring Distributed Packet from DB ... • VMware® vCenter™ Single Sign-On Server Technical

vSphere Standard Switch Between Host (ESXi-01 and VMDK in SAN Storage)

High Performance WMS with Virtualization 14

Page 15: High Performance WMS with Virtualization - hnee.de · HIGH PERFORMANCE WMS WITH ... Monitoring Distributed Packet from DB ... • VMware® vCenter™ Single Sign-On Server Technical

Monitoring Distributed Packet from DB Server to SAN Storage

Between VMKernel Port and Physical Adapter

High Performance WMS with Virtualization 15

Page 16: High Performance WMS with Virtualization - hnee.de · HIGH PERFORMANCE WMS WITH ... Monitoring Distributed Packet from DB ... • VMware® vCenter™ Single Sign-On Server Technical

High Performance WMS with Virtualization 16

Page 17: High Performance WMS with Virtualization - hnee.de · HIGH PERFORMANCE WMS WITH ... Monitoring Distributed Packet from DB ... • VMware® vCenter™ Single Sign-On Server Technical

High Performance WMS with Virtualization 17

Created stands for Network File System(nfs) in to the LUN and Volumes and Store the VMDK from DB server on Storage are Network

Page 18: High Performance WMS with Virtualization - hnee.de · HIGH PERFORMANCE WMS WITH ... Monitoring Distributed Packet from DB ... • VMware® vCenter™ Single Sign-On Server Technical

High Performance WMS with Virtualization 18

Result :

Check Network Performance Between VMNIC 0 / 1 -When Packet has been Send From DB Server to SAN

Storage Fixed I/O (VMware)

DB Server request to SAN Storage for load VMDK from SAN when we have fix Single line ,Result is Reduce the Performance

Page 19: High Performance WMS with Virtualization - hnee.de · HIGH PERFORMANCE WMS WITH ... Monitoring Distributed Packet from DB ... • VMware® vCenter™ Single Sign-On Server Technical

Result :

Check Network Performance Between VMNIC 0 / 1 -When Packet has been Send From DB Server to SAN

Storage after Round Robin I/O Activated.

High Performance WMS with Virtualization 19

DB Server request to SAN Storage for load VMDK from SAN when we have Dynamic I/O line,Result is increase the Performance

Page 20: High Performance WMS with Virtualization - hnee.de · HIGH PERFORMANCE WMS WITH ... Monitoring Distributed Packet from DB ... • VMware® vCenter™ Single Sign-On Server Technical

Conclusions

High Performance WMS with Virtualization 20

The technique for higher Performance of the Web Map Services to load

satellite imagery and get faster response front of many requests from clients

on the web is one of the key point of Geo Server Map loading. This Research

Monitoring and compare of different Data resource Storage and Network

infrastructure Design with web Server Technology to show the increase the

performance and optimize data loading, Also web Server Programming

technique to make High Availability and High Performance to load the data,

Mainly Part of this research I would like to focus on How Virtualization

technology make reduce of physical number server to help to Web Server for

make high Performance load the spatial Data on the web. Also How

Virtualization help between GeoServer, Database Server and Web Server.

Reduce the additional hardwares and Devices are also one of the key point

of Virtualization technique between many Servers.

Page 21: High Performance WMS with Virtualization - hnee.de · HIGH PERFORMANCE WMS WITH ... Monitoring Distributed Packet from DB ... • VMware® vCenter™ Single Sign-On Server Technical

FUTURE RESEARCH

HIGH PERFORMANCE WMS WITH VIRTUALIZATION 21

• Building an OCG web map service infrastructure

• Geospatial Data Infrastructure (Authentication and Design)

• Raster data storage ,compression and loaing from SAN Storage to Web Server

• NetIOC Controller QOS Traffice Performance

• Fault Tolerance Traffic

• Iscsi Traffic Vs Fiber Channel Packet Traffice Control .

• vSphare Replication

• vMotion Traffic Contoller

• Distribute Resorce Scheduler (DRS) for Network and Researce Pool in SAN Storage

Page 22: High Performance WMS with Virtualization - hnee.de · HIGH PERFORMANCE WMS WITH ... Monitoring Distributed Packet from DB ... • VMware® vCenter™ Single Sign-On Server Technical

THANK YOU

HIGH PERFORMANCE WMS WITH VIRTUALIZATION 22

Page 23: High Performance WMS with Virtualization - hnee.de · HIGH PERFORMANCE WMS WITH ... Monitoring Distributed Packet from DB ... • VMware® vCenter™ Single Sign-On Server Technical

REFERANCE

HIGH PERFORMANCE WMS WITH VIRTUALIZATION 23

• http://webhelp.esri.com/arcims/9.3/general/mergedProjects/wms_connect/wms_connector/get_capabilities.htm

• https://my.vmware.com/web/vmware/info/slug/datacenter_cloud_infrastructure/vmware_vsphere/5_5

• LIVE WEBCAST: Data Protection in Transition to the Cloud

• http://www.mindland.com/wp/integrating-ogc-getcapabilities-information-wordpress/

• Cloud Storage Clients

• vSphere Data Protection Administration Guide vSphere Data Protection 5.1

• https://www.vmware.com/support/pubs/vsphere-esxi-vcenter-server-pubs.html

• http://www.pearsonitcertification.com/store/vmware-vsphere-virtualization-fundamentals-livelessons-9780133442083

• VMware® vCenter™ Single Sign-On Server Technical White Paper technical marketing Documentation V1 . .0/AUGUS T 201 3/JUS T 201 3/JUS TI N K ING

• Developing and Deploying vSphere Solutions, vServices, and ESX Agents.

• What’s New in VMware vSphere® 5.1 – Performance VMware vSphere 5.1 technical marketing Documentation V 1 .0/OC TOB E R 201 2

• https://www.brighttalk.com/webcast/10911/116171 Converged Infrastructure for Cloud: Challenges, Innovations and Opportunities

• Top 7 Storage Performance Gotchas: Latency the silent killer

• Streamlining IT Operations To Preserve Business Revenue

• Virtual SAN: A Sneak Peek

• Solving the SAN Storage / VMware Performance Puzzle

• Cisco Prime Service Catalog and Red Hat OpenShift