淘寶技術這十年

心得分享

What is 淘寶 ?

雙十一 (光棍節)

營業額

2009 5000萬

2010 9.36億

2011 52億

2012 191億

2013 350億

網站交易數據

2012訂單高峰 1.3萬筆/秒全天訪問 UV 2.12億

2013 總成交筆數：1.71億筆

全天訪問 UV：4.02億

架構演進

2003/05 ~ 2004/01淘寶 v1.0

Application

Apache

mod_php4

pear_DB

MySQLMaster

MySQLSlave2

MySQLSlave1

READREAD / WRITE

READ

ReplicationReplication

Issue

Table

T1 T3 T5T4T2

Table-Level Locking

MasterSlave

Primary-Key Conflict

T1

T2

Replication

Replication

2004 /01 ~ 2004/05淘寶 v1.1

Application

Apache

mod_php4

pear_DB

OracleREAD / WRITE

SQL Relay

Connection Pool

DB

Application

C1 C2 C3

T1 T2 T3

Oracle Real Application Clusters (RAC)

Application

File System

Storage

Network

Network-Attached Storage(NAS)

Issue

T1 T3 T5T4T2

Connection Deadlock

Connection Pool

2004/02 ~ 2005/03淘寶 v2.0

Application

JBOSS

淘寶MVC

EJB

OracleREAD / WRITE

OR-Mapping

iSearch

Node 1 Node n

Dump

Search

View

Controller

Model

Manipulate

User Action

Notify

Update

Model-View-Controller

Java EE Application Server

Web Container

ServletJSP Page

EJB Container

EJB Bean EJB Bean

Client

Application

DBTable A

Table B

Table C

Object A

Object B

Object C

Object-Relational Mapping

Enterprise Java Bean

Storage

Application

File System

FC/Gbe

Storage Area Network(SAN)

2004/10 ~ 2007/01淘寶 v2.1

Application

JBOSS

淘寶MVC

Spring

OracleREAD / WRITE

OR-Mapping

iSearch

Node 1 Node n

Dump

Search

Oracle

Oracle Oracle

Cache

Item A Item B UserA

Application

Database Sharding

UserB

DB

Application Cache

Client

Update

Get

Update

Get / Update

Database Cache

2006/10 ~ 2007/12淘寶 v2.2

Application

JBOSS

淘寶MVC

Spring

Oracle

READ / WRITE

OR-Mapping

iSearch

Node 1 Node n

DumpSearch

Oracle

Oracle Oracle

TFS(分散式儲存)

Node 1 Node nTair

(Cache)

淘寶 Tair

淘寶 TFS

2008/01 ~ present淘寶 v3.0

業務系統

TM IM Detail SS

核心業務服務

TC IC SC

基礎業務服務

UIC Forest

HSF

HSF

Notify

DB / TFS / NAS

Application Layer

TBSession WebX Lvs Tengine

CDN

Service Layer

TDDL TFS Tair Search

HSF Notify Configuration

Content Delivery Network (CDN)Traditional Distribution

Service Provider

Config ServerClient

Service Provider

Register

Invoke

Register

Request

High-Speed Service Framework (HSF)

Notify Server

Config Server

Notify Client

RegisterRegister

淘寶 Notify

DB

Produce / Consume

心得感想

Big Data !!

羅馬不是一天造成的

Good Enough

參考資料

LAMP - http://en.wikipedia.org/wiki/LAMPPHPAuction - http://www.enuuk.com/homeSQL Relay - http://sqlrelay.sourceforge.net/Oracle RAC - http://en.wikipedia.org/wiki/Oracle_RACEJB - http://en.wikipedia.org/wiki/Enterprise_JavaBeans淘寶MVC - http://www.openwebx.org/JBoss AP7 - http://www.jboss.org/jbossasNAS - http://en.wikipedia.org/wiki/Network-attached_storageSAN - http://en.wikipedia.org/wiki/Storage_area_networkDB Sharding - http://en.wikipedia.org/wiki/Shard_(database_architecture)DB Cache - http://en.wikipedia.org/wiki/Database_caching淘寶HSF - http://ppt.cc/qYzHCDN - http://en.wikipedia.org/wiki/Content_delivery_network淘寶 Tair - http://code.taobao.org/p/tair/wiki/index/

Q & A