SC4 Hangout 1: BDE-Transport Webinar Simon Scerri
-
Upload
bigdataeurope -
Category
Data & Analytics
-
view
1.712 -
download
3
Transcript of SC4 Hangout 1: BDE-Transport Webinar Simon Scerri
Empowering Communities with Data TechnologiesFraunhofer IAIS - coordinatorSC Workshops
BIG DATA EUROPE
The Motivation – Big Data
Every day, we create 2.5 quintillion bytes of data — so much that 90% of the data in the world today has been created in the last two years alone.
This data comes from everywhere: sensors used to gather climate information, posts to social media sites, digital pictures and videos, purchase transaction records, and cell phone GPS signals to name a few.
This data is big data. Source: IBM
Big Data
2 mai 2023www.big-data-europe.eu
BIG DATA
Open DataLinked
DataLinked Open Data
Data Repositories
DatabasesData
LibrariesCatalogues
Social Media
Big Data: Dimensions
www.big-data-europe.eu
Volume
Velocity
Variety
10001010101010101010101001010010101010101001010010101001010010101001010010100101010010101010010101000101010101001010101010101010100101010101010100101010111000101010101010101010100101001010101010100101001010100101001010100101001010010101001010101001010100010101010100101010101
10001010101010101010101001010010101010101001010010
…….………….……………..……..……………
1 0
1000101010101010101010100101001010101010100101oo11
Veracity!
Big Data Dimensions
HealthClimateEnergy> TransportFoodSocietiesSecurity
Big Data in Europe: Challenges, Opportunities
www.big-data-europe.eu
Loremipsumdolors
KSDJOPSCKKSDKA
B
LKASJLLAWWD
S
wpweppepwpisio
we
10101001101010010101
0Data Sources
#1: Compile, Harmonise, Publish10101001101010010101
0
10101001101010010101
0
#2: Interlink, Centralise Access, Explore101010100101010101001011010001010101010010101010100001011010001010101010010101010100100101010100101010101001011010
001010
Town Squar
e#3: Analyse, Discover, Visualise
#4: Mashup, Cross-domain Exploitation
JournalistsCitizens Industry
Authorities
location
location
Traffic Sensors
Taxi MapSchedulesRoad Network
Big Data in Europe: Obstacles
2 mai 2023www.big-data-europe.eu
#1 Big Data “Variety“ problem Multiple Data Sources Required: Integration, Harmonisation
#2 Opening-up Data concerns Loss of control, lack of tracking Reservations about large corporations
#3 Limited Skills, Training, Technology
Lack of Data Scientists Lack of Generic Architectures, components
Data Value Chain Evolution
2 mai 2023www.big-data-europe.eu
Extraction, Curation Quality, Linking, Integration
Publication, Visualization, Analysis
Extraction, Curation, Quality, Linking, Integration, Publication,
Visualization, Analysis
HealthTransport
Security
Extraction Curation Quality Linking Integration Publication Visualization Analysis
Data Repositories Linked Open Data Cloud
Stage 1
Stage 2
Stage 3
Food SocietiesClimate Energy
BigDataEurope – The Project
2 mai 2023www.big-data-europe.eu
Rationale Show societal value of Big Data Lower barrrier for using big data
technologieso Required effort and resourceso Limited data science skills
Help establishing cross-lingual/organizational/domain Data Value Chains 2 mai 2023
BigDataEurope: Consortium
Stakeholder Engagement Cycle
Data Aggregator Platform: Blueprint
Batch Layer
Speed Layer
Data Storage
Real-time data &
Transactions …
Batch View
Real-time View
mes
sage
pas
sing
message passing
Applications & ShowcasesReal-time dashboardsDomain-specific BDE apps
Big Data AnalyticsIn-stream Mining
BDE Platform &
Intelligence
Input dataStreamSpatialSocialStatistical TemporalTransactionalImagery
+ Semantic Layer (Retaining Semantics using LD approach )
Lambda Architecture
Big Data & Transport Challenges
o We want to hear what you have to say!o Input for BD Aggregator Platform &
Components Opportunities
o We want to broaden your horizons!o We will provide free, useful, cutting-edge
BD tools. 2 mai 2023www.big-data-europe.eu