Consistent Data Replication: Is it feasible in WANs?

download Consistent Data Replication: Is it feasible in WANs?

of 16

  • date post

    13-Jan-2016
  • Category

    Documents

  • view

    31
  • download

    0

Embed Size (px)

description

Consistent Data Replication: Is it feasible in WANs?. Yi Lin Bettina Kemme Marta Patiño-Martínez Ricardo Jiménez-Peris Sep 2, 2005. Data Replication: What,Why,How?. Without Replication. With Replication. Toronto. Montreal. Ottawa. Toronto. Montreal. Ottawa. …. …. WAN. Montreal. - PowerPoint PPT Presentation

Transcript of Consistent Data Replication: Is it feasible in WANs?

  • Consistent Data Replication: Is it feasible in WANs?Yi LinBettina KemmeMarta Patio-Martnez Ricardo Jimnez-Peris

    Sep 2, 2005

  • Data Replication: What,Why,How?MontrealMontrealTorontoOttawaTorontoTorontoMontrealMontrealOttawaOttawaWithout ReplicationWith ReplicationBenefits: Fault Tolerance, Performance Challenge: keep data consistentWAN

  • Data Replication: challengeReplica control Keep data consistent

  • MotivationsMost replication protocols have been proved to perform well in LANs.Little work has been done in WANsGlobData [DMBS02], Tech Report [JHU02]Are these protocols also feasible in WANs?Protocols working well in LANs may not work well in WANs.Why? What are the bottlenecks?Any solutions?

  • Intro to Group Communication SystemsGCS provides multicast primitives to all members in the groupGroup maintenance (removal of failed members, etc.)OrderingUnorderedTotal order (messages delivered in all members in the same order)ReliabilityDifferent degrees of delivery guarantees in case of site failuresAnalyzed in paper;

  • Data Replication: Using Group Communication SystemsRead-Only requests:Executed in the local siteUpdate requests: Multicast in total order firstly.executed according to total order delivery.Num of msgs for an update1 total order

    w(x)w(x)Symmetric

  • Data Replication: Using Group Communication SystemsxxxxRead-Only requests:Executed in the local site Update requests: Request totally ordered firstly.executed only in the primary siteMulticast the changes in unordered msg.Apply change in other sitesNum of msgs for an update1 total order + 1 unorderedLocal write (w(x))1 total order within response timeRemote write (w(x))1 total order + 1 unordered within response timew(x)w(x)primaryPrimary Copy

  • Data Replication: Using Group Communication SystemsxxxxRead-Only requests:Executed in the local site Update requests: Request totally ordered firstly.executed locallyMulticast the changes in unordered msg.Apply change in other sitesNum of msgs for an update1 total order + 1 unorderedNo concurrent conflicting req1 total order within response timeHas concurrent conflicting req1 total order + 1 unordered within response timew(x)w(x)Local Copy

  • Num of messages summary

  • Experiment (I)LAN WAN(5 sites, 100% update)

    LAN

    20.83213

    20.43716.8

    22.834.216.6

    259164.8

    128.21534.2759.4

    PC

    Sym

    LC

    Load (txn/s)

    Resp Time (ms)

    LAN20_4_2

    This is experiment with version src20_4_2. Date: Sept 20, 2004

    This is in LAN, lab7-21, 22, 23, 25, 27

    writesetCCorder

    a)primary Copy1OPTSAFE

    b)primary Copy3OPTSAFE

    c)Symmetric1OPTSAFE

    d)Symmetric3OPTSAFE

    e)Local Copy1OPTSAFE

    f)Local Copy3OPTSAFE

    g)Tuple1OPTSAFE

    h)Tuple3OPTSAFE

    TPSa)b)c)d)e)f)g)h)

    Resp(ms)5020.830.832281330.429.623.8

    Opt(ms)3.423.201.62.443.4

    TO(ms)8.669.28.846.212.29.4

    Exe(ms)9818.69.47.27.2169.2

    # of Abort01931182631

    Resp - To -Exe3.216.84.29.81.8171.45.2

    TPS75

    Resp(ms)20.464.83728.216.823431.426.4

    Opt(ms)3.224.22.631.84.23.2

    TO(ms)5.26169.67.6613.67.4

    Exe(ms)7.68.418.89.27.6816.410.2

    # of Abort022234331836

    Resp - To -Exe7.650.42.29.41.62201.48.8

    TPS80

    Resp(ms)133.8

    Opt(ms)2

    TO(ms)6

    Exe(ms)8.6

    # of Abort0

    Resp - To -Exe

    TPS85

    Resp(ms)492.6

    Opt(ms)2.2

    TO(ms)6.2

    Exe(ms)9

    # of Abort2

    Resp - To -Exe

    TPS100

    Resp(ms)22.84698.834.265.616.628.644.4

    Opt(ms)3.62.44.4333.63

    TO(ms)10.46.7512.29.27.611.29.2

    Exe(ms)10918.89.49159.6

    # of Abort1.6081102414

    Resp - To -Exe2.44683.053.24702.425.6

    TPS110

    Resp(ms)911387446.23119.2

    Opt(ms)11.2382.67

    TO(ms)30.2718011

    Exe(ms)25.810.441.211.4

    # of Abort322940

    Resp - To -Exe351369.62253096.8

    TPS125

    Resp(ms)251534.23709.264.81763.5

    Opt(ms)43423.140269.75

    TO(ms)10.25767.88477.5

    Exe(ms)1019.210.611.239.25

    # of Abort233143

    Resp - To -Exe4.80939.003690.8045.601246.75

    TPS150

    Resp(ms)128.2759.4

    Opt(ms)5.84.2

    TO(ms)12.610.4

    Exe(ms)12.616.8

    # of Abort10

    103732.2

    LAN20_4_2

    000000

    000000

    00000

    00000

    00000

    PC, cc=1

    PC, cc=3

    Sym, cc=1

    Sym, cc=3

    LC, cc=1

    LC, cc=3

    TPS (txn/s)

    Resp Time (ms)

    Different Protocols in LAN, Optsafe, 5 sites, 100% update

    Fig4

    0000

    0000

    0000

    0000

    000

    Sym, cc=1

    Sym, cc=3

    Tuple, cc=1

    Tuple, cc=3

    TPS (txn/s)

    Resp Time (ms)

    Different Protocols in LAN, Optsafe, 5 sites, 100% update

    Fig5

    00000000

    00000000

    0000000

    0000000

    000000

    PC, cc=1

    PC, cc=3

    Sym, cc=1

    Sym, cc=3

    LC, cc=1

    LC, cc=3

    Tuple, cc=1

    Tuple, cc=3

    TPS (txn/s)

    Resp Time (ms)

    Different Protocols in LAN, Optsafe, 5 sites, 100% update

    Fig6

    319.4398469762.8

    344.6791.2980.21464.4

    584.26487.246475.212300.2

    987.44040

    1330.84545

    Sym

    PC-LW

    LC

    PC-RW

    Load (txn/s)

    Resp Time (ms)

    5 sites

    308.2101.2

    389.26.82

    536.68.8217.4

    435.410.423.2

    327.416.80.4

    774.212.24.8

    1077.412.2374.8

    822.410.4147.4

    Msg Delivery

    Exe Time

    Resp Tiime

    Time (ms)

    disturbance

    339.6348.4136.6331

    369.4387.4132.2339

    604645.6225561

    1085.61101364.2854.25

    1471.61543.8509.21348

    5050847.4

    60604806.6

    Optsafe

    Safe

    Agreed

    ESym

    Load (txn/s)

    Resp Time (ms)

    Fig7

    This is based on src20_4_3

    sitespc4adapt11piccarddemmittiks3

    txns:500*5

    symmetricTuplePrimary copyLocal copyLazy Primary

    100% updatecc=3cc=1cc=3cc=3cc=3cc=1cc=1, avgcc=1, LWcc=1, RWcc=1cc=3

    TPSOptsafeOptsafeSafeAgreedOptsafeOptsafeOptsafeOptsafeOptsafeOptsafeSym10FIFO

    10Resp339.6319.4348.4136.6331319.2686.2398762.8469PC-LW10TPSResp (ms)145

    Opt123121.6122.2121208.4158221.2206.4PC-RW1010Delivery(ms)66

    To311.6308.2313.2121.8310.2306.8506.6389.2536.6435.4LC10Exe (ms)7.4

    Exe1110119.81110.48.66.88.810.4Sym20

    Resp - To - Exe171.224.259.821712217.423.2PC-LW20

    PC-RW20

    20Resp369.4344.6387.4132.23393451315.2791.21464.4980.2LC20TPSResp (ms)169.6

    Opt120119.4119121.4358.4293.8375319.420Delivery(ms)72

    To329.6327.4329.6117.2327.6327.21011.6774.21077.4822.4Exe (ms)7.2

    Exe12.216.811.89.611.2171212.212.210.4

    Resp - To - Exe27.60.4465.40.20.8291.64.8374.8147.4

    30Resp604584.2645.6225561555.810986.86487.212300.246475.2TPSResp (ms)167.6

    Opt193.4203.2218.4199.65166.45090.25137.8837.430Delivery(ms)72.4

    To520.6532.6534191.8532.25247012.26418.47123.22072.2Exe (ms)8.2

    Exe12.632.211.21112.227.215.214.415.211

    Resp - To - Exe70.819.4100.422.216.64.63959.454.45161.844392

    40Resp1085.6987.41101364.2854.25878.6TPSResp (ms)143

    Opt340.6338.2309.7531840Delivery(ms)63.8

    To861.8855.6873.2324801.75817.2Exe (ms)7.6

    Exe12.242.411.81211.540

    Resp - To - Exe89.428.2

    45Resp1471.61330.81543.8509.213481321.6TPSResp (ms)173.4

    Opt449.8443.2489.6463.650Delivery(ms)77

    To1141.41128.41208.8451.21216.21161.2Exe (ms)7

    Exe12.64712.213.814.256.6

    Resp - To - Exe44.2

    50Resp847.4

    OptTPSResp (ms)187.4

    To756.660Delivery(ms)77.4

    Exe13Exe (ms)7.8

    Resp - To - Exe77.8

    60Resp4806.6

    Opt

    To4690.8

    Exe12.8

    Fig7

    00000

    00000

    00000

    00000

    00000

    Sym, cc=1

    Sym, cc=3

    Tuple, cc=1

    Tuple, cc=3

    TO-delivery

    TPS (txn/s)

    Resp Time (ms)

    Different Locking Granularity, OptSafe, 5 Sites, 100% update

    GCS

    0000

    0000

    0000

    0000

    0000

    00

    0

    OptSafe

    Safe

    Agreed

    Lazy Primary

    TPS (txn/s)

    Resp Time (ms)

    Different Delivery Guarantee, cc=3, Sym, 5 sites, 100% update

    Fig8a

    This is based on src20_4_3

    sitespc4adapt14piccarddemmittik2

    txns:500*5

    TPSPrimary CopyLocal CopySymmetric

    Avg 4 fastik2Avg 4 fastik2Avg 4 fastik2

    5Resp(ms)302.5308148.75320126.75261

    To(ms)144.25147113.5135112129

    Exe(ms)24307.751258.25105

    LW Resp125.5330

    LW To111.25158

    LW Exe8125

    RW Resp355.5302

    RW To155.25145

    RW Exe37.58

    10Resp(ms)296.5309171.5371124.7518389

    To(ms)145.5182126.75158111.5237

    Exe(ms)2510281318933

    LW Resp144.75310

    LW To116182

    LW Exe8102

    RW Resp343.5308

    RW To151.25148

    RW Exe32.257

    15Resp(ms)62587614983142148.558958

    To(ms)325.5417347.5436134721

    Exe(ms)39.755493488994

    LW Resp2791134

    LW To239.5405

    LW Exe8.25232

    RW Resp759.75807

    RW To321397

    RW Exe50.258

    20Resp(ms)1863270512858.2513478195.2579070

    To(ms)410689438884172.752545

    Exe(ms)52.25759.570711.25999

    LW Resp38716033

    LW To369.51075

    LW Exe9.25486

    RW Resp2640.751009

    RW To416497

    RW Exe739

    Fig8a

    000

    000

    000

    000

    Primary Copy

    Local Copy

    Symmetric

    TPS (txn/s)

    Fast Site Resp Time (ms)

    Disturbance, 4+1(slow) sites, cc=1, AGREED

    Fig8b

    334.4160.6297.8336

    335.4190.6240.2403.8

    336.8160250708

    335.8180.81183.411803

    338.2251.41772.860

    739.235897070

    SEQ

    RR

    LAMP

    TOKEN

    Load (txn/s)

    Resp Time (ms)

    new scalability

    This is to compare different group communication protocols in Ja