Drupal for Big Data - is it ready? (European Drupal Days 2015)
-
Upload
ibuildings-italia -
Category
Internet
-
view
210 -
download
2
Transcript of Drupal for Big Data - is it ready? (European Drupal Days 2015)
© Ibuildings 2014/2015 - All rights reserved
#DrupalDaysEU
Drupal for big data - is it ready?
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
Gold Sponsors
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
Media Sponsors
Silver Sponsors
© Ibuildings 2014/2015 - All rights reserved
Janis Janovskis
Drupal architect and entrepreneurworked > 100 frameworks, led > 55 guys
janis.janovskis@passivemanagement@PASSIVUS
CTO of Passive Management
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
passivemanagement.net
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
Big Data???
@Wikipedia
Big data is a broad term for data sets so large or complex that traditional data processing applications are inadequate. Challenges include analysis, capture, curation, search, sharing, storage, transfer, visualisation, and information privacy. The term often refers simply to the use of predictive analytics or other certain advanced methods to extract value from data, and seldom to a particular size of data set.
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
Volume
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
Velocity
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
Variety
© Ibuildings 2014/2015 - All rights reserved
Hang on…. What is Drupal?
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
DataBase
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
Web server
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
Structure
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
@Data Science for businesses
The fundamental concepts of data science are drawn form many fields that study data analytics …
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
Unstructured data
© Ibuildings 2014/2015 - All rights reserved
Can We parse unstructured data with Drupal???
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
function my_analysis_external_views_plugins() { $plugin = array();
$plugin['query']['my_analysis_master_plugin_query'] = array();
….. }
Views???
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
Views???
public function query($get_count = FALSE){
}
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
function execute(&$view){
$data = drupal_http_request(“what so ever”);
}
Views???
https://www.lullabot.com/blog/article/building-views-query-plugins-part-2
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
© Ibuildings 2014/2015 - All rights reserved
https://www.drupal.org/project/feeds_crawler
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
Pros
• Great community
• Support
• Reputation
• Myriad of vendors
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
Cons
• Too robust
• Slow
• No lazy loading
• Single threaded
• Heavy
• Structured
© Ibuildings 2014/2015 - All rights reserved
Case Studies
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
Only ~2000 nodes???
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
Used to track search results with nodes???
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
Visualizing Big Data In Drupal: Using Data Visualizations to Drive Knowledge Discovery
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
https://www.drupal.org/sandbox/cilefen/1858412
© Ibuildings 2014/2015 - All rights reserved
Drupal for big data - is it … ?
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
Acknowledgements
• Nicolas Roberts - [email protected]
• http://www.westridge.com/media/series/out-of-the-box
• Florian Loretan
• My Wife
• Drupal Community
• Organisers - Lenka especially
#DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
Grazie
@PassiveManage
passivemanagement.net/contact