Hazelcast, In-memory Big Data
description
Transcript of Hazelcast, In-memory Big Data
![Page 1: Hazelcast, In-memory Big Data](https://reader034.fdocuments.net/reader034/viewer/2022050723/554f75dfb4c9058a148b55ce/html5/thumbnails/1.jpg)
In-Memory Big Data
Fuad Malikov
Thursday, June 13, 13
![Page 2: Hazelcast, In-memory Big Data](https://reader034.fdocuments.net/reader034/viewer/2022050723/554f75dfb4c9058a148b55ce/html5/thumbnails/2.jpg)
Big Data
90% of the data in the world has been created in the last two years alone.
Thursday, June 13, 13
![Page 3: Hazelcast, In-memory Big Data](https://reader034.fdocuments.net/reader034/viewer/2022050723/554f75dfb4c9058a148b55ce/html5/thumbnails/3.jpg)
Big Data Storage
Hadoop
Map/Reduce
NoSQL
Thursday, June 13, 13
![Page 4: Hazelcast, In-memory Big Data](https://reader034.fdocuments.net/reader034/viewer/2022050723/554f75dfb4c9058a148b55ce/html5/thumbnails/4.jpg)
Disk is the New Tape
Memory is the New Disk
Thursday, June 13, 13
![Page 5: Hazelcast, In-memory Big Data](https://reader034.fdocuments.net/reader034/viewer/2022050723/554f75dfb4c9058a148b55ce/html5/thumbnails/5.jpg)
Distributed System
We should be able to partition the data across many servers
Thursday, June 13, 13
![Page 6: Hazelcast, In-memory Big Data](https://reader034.fdocuments.net/reader034/viewer/2022050723/554f75dfb4c9058a148b55ce/html5/thumbnails/6.jpg)
Big Data In-Memory
Partitioned Scalable
RedundantDynamic
Thursday, June 13, 13
![Page 7: Hazelcast, In-memory Big Data](https://reader034.fdocuments.net/reader034/viewer/2022050723/554f75dfb4c9058a148b55ce/html5/thumbnails/7.jpg)
Used by
Every 1.5 sec one Hazelcast instance is starting around the globeHazelcast Elastic Memory on 100 node, storing 4 TB data in-memory and doing more than 1.3M distributed ops on AWS.
Thursday, June 13, 13
![Page 8: Hazelcast, In-memory Big Data](https://reader034.fdocuments.net/reader034/viewer/2022050723/554f75dfb4c9058a148b55ce/html5/thumbnails/8.jpg)
Keywords
In-Memory Data GridDistributed (Elastic) CacheNoSQL Key-Value StoreClustering, Scalability, Partitioning, Big DataCloud Computing
Thursday, June 13, 13
![Page 9: Hazelcast, In-memory Big Data](https://reader034.fdocuments.net/reader034/viewer/2022050723/554f75dfb4c9058a148b55ce/html5/thumbnails/9.jpg)
Map
import java.util.Map; import java.util.HashMap;
Map map = new HashMap();map.put(“1”, “value”); map.get(“1”);
Thursday, June 13, 13
![Page 10: Hazelcast, In-memory Big Data](https://reader034.fdocuments.net/reader034/viewer/2022050723/554f75dfb4c9058a148b55ce/html5/thumbnails/10.jpg)
Thread-safe Map
import java.util.Map; import java.util.concurrent.*;
Map map = new ConcurrentHashMap();map.put(“1”, “value”); map.get(“1”);
Thursday, June 13, 13
![Page 11: Hazelcast, In-memory Big Data](https://reader034.fdocuments.net/reader034/viewer/2022050723/554f75dfb4c9058a148b55ce/html5/thumbnails/11.jpg)
Distributed Map
import java.util.Map; import com.hazelcast.core.Hazelcast;
Map map = Hazelcast.getMap(“mymap”);map.put(“1”, “value”); map.get(“1”);
Thursday, June 13, 13
![Page 12: Hazelcast, In-memory Big Data](https://reader034.fdocuments.net/reader034/viewer/2022050723/554f75dfb4c9058a148b55ce/html5/thumbnails/12.jpg)
Demo
Thursday, June 13, 13
![Page 13: Hazelcast, In-memory Big Data](https://reader034.fdocuments.net/reader034/viewer/2022050723/554f75dfb4c9058a148b55ce/html5/thumbnails/13.jpg)
We Scale the Application Layer
Distributed Data Structures from JavaMap, Queue, List, Lock, Executor Service, Topic, Events and etc.
NoSQL
Thursday, June 13, 13
![Page 14: Hazelcast, In-memory Big Data](https://reader034.fdocuments.net/reader034/viewer/2022050723/554f75dfb4c9058a148b55ce/html5/thumbnails/14.jpg)
Use Cases
Big Data Sharing/CachingSession ReplicationHibernate 2nd Level CacheSpring CacheParallel ProcessingSend/Receive Messages
Ex: Mozilla uses Hazelcast + Hadoop to process Firefox Crash Reports.
Thursday, June 13, 13
![Page 15: Hazelcast, In-memory Big Data](https://reader034.fdocuments.net/reader034/viewer/2022050723/554f75dfb4c9058a148b55ce/html5/thumbnails/15.jpg)
Thank You!
www.hazelcast.comTwitter: @hazelcastSource: github.com/[email protected]
Bay Area Hazelcast Hackers Meetup Group
Thursday, June 13, 13