Riak / Riak-CS(Enterprise版) ベンチマークしました

Click here to load reader

  • date post

    12-Nov-2014
  • Category

    Technology

  • view

    2.335
  • download

    5

Embed Size (px)

description

Riak Source Code Reading #8 発表スライド riak, riak-cs(エンタープライズ版)を basho_bench でベンチマークした結果をまとめました。検証方法についてはいくつか課題はありますが、自分で測定した結果が概ね正しいかどうかの判断材料にはなると思いますので、是非ご活用ください。

Transcript of Riak / Riak-CS(Enterprise版) ベンチマークしました

  • 1. Riak / Riak-CS(Enterprise)Takashi [email protected] Initiative Japan., Inc.
  • 2. riak / riak-cs ? ? Ethernet GbE 10GbE ?
  • 3. riak riak-1.3.0 riak-cs-ee riak-cs-ee-1.3.0 riak-cs-1.3.0
  • 4. Fujitsu Primagy RX200 S6 32 + 2(basho_bench) Memory: 24GB CPU: Xeon(R) CPU L5630 @ 2.13GHz, 4 cores, 8HTs Ethernet: GbE L2SW HDD: 4TB megaraid_sas (raid5) Seagate ST91000640NS x 8 (2.5inch SATA, 1TB, 7200rpm,64MB cache) XFS
  • 5. basho_bench basho benchmark Cassandra, Hibari
  • 6. RIAK BASHO_BENCH
  • 7. Riak /etc/riak app.config, vm.config IP Kernelsudo sysctl -w net.ipv4.tcp_max_syn_backlog=40000sudo sysctl -w net.core.somaxconn=4000sudo sysctl -w net.ipv4.tcp_timestamps=0sudo sysctl -w net.ipv4.tcp_sack=1sudo sysctl -w net.ipv4.tcp_window_scaling=1sudo sysctl -w net.ipv4.tcp_fin_timeout=15sudo sysctl -w net.ipv4.tcp_keepalive_intvl=30sudo sysctl -w net.ipv4.tcp_tw_reuse=1sudo mount -o remount,noatime (device)echo deadline | sudo tee /sys/block/sda/queue/scheduler
  • 8. basho_bench duration 180sec concurrent 64 key_generator {int_to_bin, {uniform_int, 100000}} value_generator {fixed_bin, 10000}
  • 9. basho_bench Key binary 1 100000 GET preload : 10kB API: PB(Protocol Buffer) Backend DB: Bitcask Bitcask
  • 10. GET node=1
  • 11. GET node=3
  • 12. PUT n=1
  • 13. PUT n=3
  • 14. PUT n=4
  • 15. PUT n=8
  • 16. GET: 3PUT: 8 basho_benchGbEEthernet Riak10GbEEthernetbasho_bench
  • 17. RIAK-CS(ENTERPRISE)BASHO_BENCH
  • 18. Riak Storage Backend riak_cs_kv_multi_backend Bashoriak_kv_eleveldb_backend +riak_kv_bitcask_backend ) Riak
  • 19. Riak-CS / stanchion /etc/riak/app.config, vm.config IP Admin user credentials /etc/stanchion/app.config, vm.config IP
  • 20. basho_bench duration 60sec key_generator {int_to_str, {partitioned_sequential_int, 100000}} value_generator {function, basho_bench_driver_cs, bigfile_valgen,[[{file_size, 10000}
  • 21. GET node=1 (10kB)
  • 22. GET node=3(10kB)
  • 23. GET node=4(10kB)
  • 24. GET node=8(10kB)
  • 25. GET node=16(10kB)
  • 26. GET node=32(10kB)
  • 27. GET node=1(10MB)Throughput Mbytes/secMbytes/sec
  • 28. GET node=3(10MB)
  • 29. PUT node=1
  • 30. PUT node=3
  • 31. PUT node=4
  • 32. PUT node=8
  • 33. PUT node=16
  • 34. PUT node=32
  • 35. DELETE node=1
  • 36. DELETE node=3
  • 37. DELETE node=4
  • 38. DELETE node=8
  • 39. DELETE node=16
  • 40. DELETE node=32
  • 41. Riak-CS 10kB1 200 ops/sec(20Mbps) 10MB3 Ethernet