Machine Learning - Stephan Robert€¦ · Lesson 1: Introduction to Machine Learning, Gradient...

14
8/20/18 1 Machine Learning Stephan Robert | HEIG-Vd | Summer University 2018 Few good books (Not necessary to buy them, just download them. Free access)

Transcript of Machine Learning - Stephan Robert€¦ · Lesson 1: Introduction to Machine Learning, Gradient...

Page 1: Machine Learning - Stephan Robert€¦ · Lesson 1: Introduction to Machine Learning, Gradient Descent (cost function, many variables) Lesson 2: Linear regression, logistic regression

8/20/18

1

Machine Learning

StephanRobert|HEIG-Vd|SummerUniversity2018

Few good books (Not necessary to buy them, just download them. Free access)

Page 2: Machine Learning - Stephan Robert€¦ · Lesson 1: Introduction to Machine Learning, Gradient Descent (cost function, many variables) Lesson 2: Linear regression, logistic regression

8/20/18

2

Few good books (Not necessary to buy them, just download them. Free access)

•  Machine Learning, Tom Mitchell•  Machine Learning, Kevin Murphy

Web page and links...   Lectureslidesandhandouts

  Documentation,links,softwareresources

  Announcementsandschedule

  Email(labs)

  Slidesathttp://www.stephan-robert.ch/teaching/machine-learning

Page 3: Machine Learning - Stephan Robert€¦ · Lesson 1: Introduction to Machine Learning, Gradient Descent (cost function, many variables) Lesson 2: Linear regression, logistic regression

8/20/18

3

… and links...

  Kaggle.com(competitions,jobs,…)

  Datascience.net

Python tutorials and books

  docs.python.org/3/tutorial/index.html

  wiki.python.org/moin/IntroductoryBooks

Page 4: Machine Learning - Stephan Robert€¦ · Lesson 1: Introduction to Machine Learning, Gradient Descent (cost function, many variables) Lesson 2: Linear regression, logistic regression

8/20/18

4

Python environment

  Pythonrelease3.6

  AnacondaNavigator(Jupyter,Ipython,Spyder,…)

Python libraries

  Numpy

  Pandas

  Matplotlib

  Scikit-learn

  Scipy

Page 5: Machine Learning - Stephan Robert€¦ · Lesson 1: Introduction to Machine Learning, Gradient Descent (cost function, many variables) Lesson 2: Linear regression, logistic regression

8/20/18

5

Syllabus

  Lesson1:IntroductiontoMachineLearning,GradientDescent(costfunction,manyvariables)

  Lesson2:Linearregression,logisticregression

  Lesson3:Supportvectormachines

  Lesson4:Unsupervisedlearning(PCA,k-means,K-nearestneighbor,classification)

Homeworks

  HW1:GradientDescent

  HW2:Linearandlogisticregression

  HW3:SupportVectorMachines

  HW4:Unsupervisedlearning

Page 6: Machine Learning - Stephan Robert€¦ · Lesson 1: Introduction to Machine Learning, Gradient Descent (cost function, many variables) Lesson 2: Linear regression, logistic regression

8/20/18

6

Eachgroupofstudents(1-2studentspergroup)mustwritetheirowncodefortheprogrammingpart.Pleasedon’tsearchforanswersontheweb,Google,previousyears’homeworks,etc.D0n’tpostthemeither!

  HW1,2,3:Groupoftwostudents(1fromSNU+1fromHEIG-Vd)

  HW4:Individual

Homeworks

Grading

•  4homeworks

Page 7: Machine Learning - Stephan Robert€¦ · Lesson 1: Introduction to Machine Learning, Gradient Descent (cost function, many variables) Lesson 2: Linear regression, logistic regression

8/20/18

7

Machine Learning is changing the world

© Emily Fox

Few videos...

•  NVIDIA Press Event at CES 2018https://www.youtube.com/watch?v=P3BjB5-Y4JM

Page 8: Machine Learning - Stephan Robert€¦ · Lesson 1: Introduction to Machine Learning, Gradient Descent (cost function, many variables) Lesson 2: Linear regression, logistic regression

8/20/18

8

What is Machine Learning?

•  Study of algorithms that improve their performances at some tasks with experience

Supervised learning

•  Knowledgeofoutput

Learningwiththepresenceofanexpert(e.g.SupportVectorMachines,DecisionTrees,NeuralNetworks,BayesianClassifiers,…)

Page 9: Machine Learning - Stephan Robert€¦ · Lesson 1: Introduction to Machine Learning, Gradient Descent (cost function, many variables) Lesson 2: Linear regression, logistic regression

8/20/18

9

ExampleofhousespricesinLausanne

House price prediction Supervised learning: regression

House price prediction Supervised learning

Page 10: Machine Learning - Stephan Robert€¦ · Lesson 1: Introduction to Machine Learning, Gradient Descent (cost function, many variables) Lesson 2: Linear regression, logistic regression

8/20/18

10

House price prediction Supervised learning

House price prediction Supervised learning

Page 11: Machine Learning - Stephan Robert€¦ · Lesson 1: Introduction to Machine Learning, Gradient Descent (cost function, many variables) Lesson 2: Linear regression, logistic regression

8/20/18

11

Spam filtering Supervised learning: classification

NotSpamTextofemail,IPSource,… Spam

input output

Other examples Supervised learning: classification

•  Sentimentanalysis•  Personalizedmedicaldiagnosis(multiple

outputs:flu,healthy,…)

Page 12: Machine Learning - Stephan Robert€¦ · Lesson 1: Introduction to Machine Learning, Gradient Descent (cost function, many variables) Lesson 2: Linear regression, logistic regression

8/20/18

12

Stock prediction Supervised learning

Depends on recent historyof stock market, newsevents,…

(Vodafone)

Unsupervised learning

•  NoKnowledgeofoutput

Learningwithoutthepresenceofanexpert(e.gk-means,clusteringapproaches,…)

Page 13: Machine Learning - Stephan Robert€¦ · Lesson 1: Introduction to Machine Learning, Gradient Descent (cost function, many variables) Lesson 2: Linear regression, logistic regression

8/20/18

13

Unsupervised learning

news.google.com

Unsupervised learning

Clusteringimages,groupas:

•  Clouds•  Mountains•  Roads

Page 14: Machine Learning - Stephan Robert€¦ · Lesson 1: Introduction to Machine Learning, Gradient Descent (cost function, many variables) Lesson 2: Linear regression, logistic regression

8/20/18

14

Unsupervised learning

Otherexamples

•  UsersonWebsites(groups,activities)•  Words(Firstnames,lastnames,location

words,…)


LESSON 10 & 11 SIMPLE LINEAR REGRESSION

LESSON 10 & 11 SIMPLE LINEAR REGRESSION

Principles of Machine Learning - GitHub of Machine Learning Lab 2 – Regression Overview In this lab, you will train and evaluate a regression model. Like classification, regression

Principles of Machine Learning - GitHub of Machine Learning Lab 2 – Regression Overview In this lab, you will train and evaluate a regression model. Like classification, regression

Correlation and regression lesson 1 Introduction.

Correlation and regression lesson 1 Introduction.

Jeff Howbert Introduction to Machine Learning Winter 2014 1 Regression Linear Regression Regression Trees.

Jeff Howbert Introduction to Machine Learning Winter 2014 1 Regression Linear Regression Regression Trees.

Machine Learning Lecture Regression basics...Machine Learning Regression basics linear regression, non-linear features (polynomial, RBFs, piece-wise), regularization, cross validation,

Machine Learning Lecture Regression basics...Machine Learning Regression basics linear regression, non-linear features (polynomial, RBFs, piece-wise), regularization, cross validation,

Gaussian Processes for Ordinal Regression - Machine Learning

Gaussian Processes for Ordinal Regression - Machine Learning

Regression With SPSS_ Lesson 2 - Regression Diagnostics

Regression With SPSS_ Lesson 2 - Regression Diagnostics

Machine Learning Basics Lecture 1: Linear Regression · Machine Learning Basics Lecture 1: Linear Regression ... Real data: Prostate Cancer ... Linear regression with bias •Given

Machine Learning Basics Lecture 1: Linear Regression · Machine Learning Basics Lecture 1: Linear Regression ... Real data: Prostate Cancer ... Linear regression with bias •Given

The Great Regression. Machine Learning, Econometrics, and ...

The Great Regression. Machine Learning, Econometrics, and ...

Machine Learning and Data Mining Linear regression

Machine Learning and Data Mining Linear regression

Evaluating Hospital Case Cost Prediction Models Using ... · regression machine learning models: linear regression, Bayesian linear regression, decision forest regression, boosted

Evaluating Hospital Case Cost Prediction Models Using ... · regression machine learning models: linear regression, Bayesian linear regression, decision forest regression, boosted

Regression Function Characterization of Synchronous Machine Magnetization … · 2017-04-25 · Regression Function Characterization of Synchronous Machine Magnetization and Its Impact

Regression Function Characterization of Synchronous Machine Magnetization … · 2017-04-25 · Regression Function Characterization of Synchronous Machine Magnetization and Its Impact

Advanced Machine Learning Lecture 6 - Computer Vision · g ’15 This Lecture: Advanced Machine Learning • Regression Approaches Linear Regression Regularization (Ridge, Lasso)

Advanced Machine Learning Lecture 6 - Computer Vision · g ’15 This Lecture: Advanced Machine Learning • Regression Approaches Linear Regression Regularization (Ridge, Lasso)

classification_methods-logistic regression Machine Learning

classification_methods-logistic regression Machine Learning

Machine Learning Regression - Uni Stuttgart...Machine Learning Regression Linear regression, non-linear features (polynomial, RBFs, piece-wise), regularization, cross validation, Ridge/Lasso,

Machine Learning Regression - Uni Stuttgart...Machine Learning Regression Linear regression, non-linear features (polynomial, RBFs, piece-wise), regularization, cross validation, Ridge/Lasso,

Lesson 8 Linear Correlation And Regression

Lesson 8 Linear Correlation And Regression

Regression for machine translation evaluation at the …ccc.inaoep.mx/~villasen/bib/Regression for machine...Regression for MT evaluation 3 inputs that are similar to its training

Regression for machine translation evaluation at the …ccc.inaoep.mx/~villasen/bib/Regression for machine...Regression for MT evaluation 3 inputs that are similar to its training

Regression With Stata: Lesson 1 - Simple and Multiple Regression

Regression With Stata: Lesson 1 - Simple and Multiple Regression

Regression - Machine Learning and Pattern Recognition · Regression Machine Learning and Pattern Recognition Chris Williams School of Informatics, University of Edinburgh ... (radial

Regression - Machine Learning and Pattern Recognition · Regression Machine Learning and Pattern Recognition Chris Williams School of Informatics, University of Edinburgh ... (radial

15-830 – Machine Learning 2: Nonlinear Regression

15-830 – Machine Learning 2: Nonlinear Regression