Big Data Europe Concept and Platform
-
Upload
bigdataeurope -
Category
Technology
-
view
209 -
download
0
Transcript of Big Data Europe Concept and Platform
BIG DATA EUROPEBIG DATA EUROPE:CONCEPT AND PLATFORMNCSR Demokritos20 December 2016
Big Data Europe (CSA: 2015-17) Show societal value of Big Data
o Across all societal challenges addressed by Horizon 2020
Lower barrier for using big data technologieso Effort and resources to convert tools and workflows
o Skills and expertise
H l bli h d l h i Help establish data value chainso Across languages, organizations and domains
31-janv.-17www.big-data-europe.eu
Consortium
NCSRDEMOKRITOS
Stakeholder Engagement
Stakeholder engagement workshops:g g p Present the action and its
showcase deployments Raise awareness about BDE results
and what they mean for stakeholders
Collect requirements to drive further development
31-janv.-17www.big-data-europe.eu
Societal Soc e aChallenges
31-janv.-17www.big-data-europe.eu
Architecture
Big Data Integrator (BDI):o The prototype developed by BDE
Main points of the architecture Main points of the architectureo Dockerization
Support layer including integrated UIo Support layer, including integrated UIo Semantification layer
31-janv.-17www.big-data-europe.eu
Docker containers
Docker offers lightweight virtualizationo Docker containers can be shared to be provisioned on different
Linux variations and versions
Identical base sys not required
All BDI components: Docker containers
31-janv.-17www.big-data-europe.eu
Docker containers
BDI components Processing and storage components
o Re-used existing docker containers where availableo Dockerized by BDE where noto Ensured all can be provisioned through Docker Swarm
Components by BDE:o Support Layero Semantic Layer
31-janv.-17www.big-data-europe.eu
BDE Docker Containers
D t i HDFS C d 4 t Data serving: HDFS, Cassandra, 4store, PostGIS, Strabon, Elastic Search, Hive, SemagrowSemagrow
Processing: Spark, Flink, Sansa Stream ingestion middleware: Flume,
Kafka
31-janv.-17www.big-data-europe.eu
Semantic layer tools
BDE tooling for Semantic Data Lake:go Swagger: Semantics of RESTful APIso Semantic Analytics Stack (SANSA): y ( )
Distributed data processing for large-scale RDF data
o Semagrow: SPARQL perspective over Big Data stores
31-janv.-17www.big-data-europe.eu
Questions? BigDataEurope Web site:
https://www.big-data-europe.eu
Thank you for your attention!
www.big-data-europe.eu