Mind the gap! Reflections on the state of repository data harvesting
Data is a state of mind
-
Upload
lukas-toma -
Category
Data & Analytics
-
view
55 -
download
0
Transcript of Data is a state of mind
![Page 1: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/1.jpg)
DATA SCIENCE IS A STATE OF MIND
![Page 2: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/2.jpg)
MEBc in Applied Math (Masaryk University) / MSc Artificial Intelligence (Polytech Nantes)
Data Scientist at Kreditech / first Data Scientist at Ulmon (CityMaps2Go)
Co-Founder at Knoyd
![Page 4: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/4.jpg)
KNOYDFounded by two alumni of Masaryk University (Czech Republic), born and raised in
Slovakia
Customized data solutions for businesses of any size
Trying to fill the hiring gap in data-job market
![Page 5: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/5.jpg)
AGENDAEvolution of productivity
Data vs. non-data management
Areas of application
How to become a Data Scientist
![Page 6: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/6.jpg)
EVOLUTION OF PRODUCTIVITY
![Page 7: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/7.jpg)
MAN MAKES TOOLS
![Page 8: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/8.jpg)
MAN MAKES MORE TOOLS
![Page 9: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/9.jpg)
TOOLS MAKE TOOLS
![Page 10: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/10.jpg)
MACHINE MAKES TOOLS
![Page 11: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/11.jpg)
MAN MAKES MEN
![Page 12: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/12.jpg)
WHY SHOULD YOU CARE?
![Page 13: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/13.jpg)
SPEED OF DEVELOPMENT
![Page 15: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/15.jpg)
JOB MARKET“… the sexiest job of 21st century.”
Relative growth of # of Data Science jobs
![Page 16: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/16.jpg)
JOB MARKET
![Page 17: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/17.jpg)
DATA VS. NON-DATA MANAGMENT
![Page 18: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/18.jpg)
MANUAL VS. AUTOMATION
![Page 19: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/19.jpg)
INTUITION VS. VALIDATION
![Page 20: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/20.jpg)
REACTIVE VS. PROACTIVE
![Page 21: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/21.jpg)
EXPERT-ONLY VS. AUGMENTED
![Page 22: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/22.jpg)
AREAS OF APPLICATION
![Page 23: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/23.jpg)
Classification
![Page 24: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/24.jpg)
Regression
Source: http://www.datapine.com/blog/big-data-and-ski-resorts/
![Page 25: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/25.jpg)
Clustering
Source: https://2.bp.blogspot.com/-KS6-whrl9pM/Vr3fT6e51qI/AAAAAAAABfA/rVvPkY-N_14/s1600/neurokiff-tablettte.jpg
![Page 26: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/26.jpg)
Recommender Systems
Source: http://www.slideshare.net/Hadoop_Summit/shah-june27-425pmroom210av2
![Page 27: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/27.jpg)
Recommender Systems
Source: Nina Rabinowitz, Marijuana: Turn another leaf
![Page 28: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/28.jpg)
Social Network Analysis
Barack Obama campaign
![Page 29: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/29.jpg)
Text Analytics
Source: https://hsto.org/getpro/habr/post_images/8e4/768/568/8e47685686001174765c7b00bb4b8b44.png
![Page 30: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/30.jpg)
Text Analytics
different text analytics functions
reinventing human resources
![Page 32: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/32.jpg)
Data Visualization
How parents’ income predicts college chances of children
Aging of the US population
![Page 33: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/33.jpg)
KINDS OF DATA SCIENCE
![Page 34: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/34.jpg)
UNICORN DATA SCIENTIST
![Page 35: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/35.jpg)
TYPES OF DATA SCIENTIST
Source: http://www.marketingdistillery.com/wp-content/uploads/2014/11/mds_f.png
Research Scientist
Data Engineer
Visualization Expert
Data Manager
![Page 36: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/36.jpg)
WHERE TO GET THEM
![Page 37: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/37.jpg)
WHERE CAN YOU GET THEM
MOOCs: Coursera, EdX, Udacity
Bootcamps: DSR, Data Science Europe
Formal education
![Page 38: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/38.jpg)
THE HARDEST PARTS
![Page 39: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/39.jpg)
ASK THE RIGHT QUESTION: INTERESTING
“We run the company by questions, not by answers. So in the strategy process we've so far formulated 30 questions that we have to answer […] You ask it as a question, rather than a pithy answer, and that stimulates conversation. Out of the conversation comes innovation. Innovation is not something that I just wake up one day and say 'I want to innovate.' I think you get a better innovative culture if you ask it as a question.”
Eric Schmidt (Executive Chairman of Alphabet Inc. / Former CEO Google)
![Page 40: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/40.jpg)
ASK THE RIGHT QUESTION: SOLVABLE
What data do you have?
What other data can you get? How? Where? Privacy?
Resources available?
Development burden vs. added value?
![Page 41: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/41.jpg)
PITFALLS
Overfitting
Leakage
Class Imbalance
Missing Data / Outliers
!!! BIASES !!!
![Page 43: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/43.jpg)
FUTURE IS DATA!
+43 681 323 82
linkedin.com/company/knoydwww.knoyd.com
Web:
E-mail:
Phone:
facebook.com/knoyding
twitter.com/knoyd_com
![Page 44: Data is a state of mind](https://reader033.fdocuments.net/reader033/viewer/2022042619/587c97401a28abfa5e8b650f/html5/thumbnails/44.jpg)
ATTRIBUTIONS
Stefano Vetere, Ray Design, Sergey Patutin from the Noun Project
Nina Rabinowitz for “Marijuana: Turning the next leave”