Python Data Processing with Pandasweb.cse.ohio-state.edu/~shen.94/5544/pandas.pdf · 2020. 9....

30
Python Data Processing with Pandas CSE 5542 Introduc:on to Data Visualiza:on

Transcript of Python Data Processing with Pandasweb.cse.ohio-state.edu/~shen.94/5544/pandas.pdf · 2020. 9....

Page 1: Python Data Processing with Pandasweb.cse.ohio-state.edu/~shen.94/5544/pandas.pdf · 2020. 9. 1. · Pandas • A very powerful package of Python for manipulang tables • Built on

PythonDataProcessingwithPandas

CSE5542Introduc:ontoDataVisualiza:on

Page 2: Python Data Processing with Pandasweb.cse.ohio-state.edu/~shen.94/5544/pandas.pdf · 2020. 9. 1. · Pandas • A very powerful package of Python for manipulang tables • Built on

Pandas

•  AverypowerfulpackageofPythonformanipula:ngtables

•  Builtontopofnumpy,soisefficient

•  Saveyoualotofeffortfromwri:nglowerpythoncodeformanipula:ng,extrac:ng,andderivingtablesrelatedinforma:on

•  Easyvisualiza:onwithMatplotlib

•  Maindatastructures–SeriesandDataFrame

Page 3: Python Data Processing with Pandasweb.cse.ohio-state.edu/~shen.94/5544/pandas.pdf · 2020. 9. 1. · Pandas • A very powerful package of Python for manipulang tables • Built on

•  Firstthingfirst

•  Series:anindexed1Darray

Page 4: Python Data Processing with Pandasweb.cse.ohio-state.edu/~shen.94/5544/pandas.pdf · 2020. 9. 1. · Pandas • A very powerful package of Python for manipulang tables • Built on

•  Explicitindex

•  Accessdata

Page 5: Python Data Processing with Pandasweb.cse.ohio-state.edu/~shen.94/5544/pandas.pdf · 2020. 9. 1. · Pandas • A very powerful package of Python for manipulang tables • Built on

•  Canworkasadic:onary

•  Accessandslicedata

Page 6: Python Data Processing with Pandasweb.cse.ohio-state.edu/~shen.94/5544/pandas.pdf · 2020. 9. 1. · Pandas • A very powerful package of Python for manipulang tables • Built on

DataFrameObject

•  Generalizedtwodimensionalarraywithflexiblerowandcolumnindices

Page 7: Python Data Processing with Pandasweb.cse.ohio-state.edu/~shen.94/5544/pandas.pdf · 2020. 9. 1. · Pandas • A very powerful package of Python for manipulang tables • Built on

DataFrameObject

•  Generalizedtwodimensionalarraywithflexiblerowandcolumnindices

Page 8: Python Data Processing with Pandasweb.cse.ohio-state.edu/~shen.94/5544/pandas.pdf · 2020. 9. 1. · Pandas • A very powerful package of Python for manipulang tables • Built on

DataFrameObject

•  FromPandasSeries

Page 9: Python Data Processing with Pandasweb.cse.ohio-state.edu/~shen.94/5544/pandas.pdf · 2020. 9. 1. · Pandas • A very powerful package of Python for manipulang tables • Built on

DataFrameObject

•  FromPandasSeries

Page 10: Python Data Processing with Pandasweb.cse.ohio-state.edu/~shen.94/5544/pandas.pdf · 2020. 9. 1. · Pandas • A very powerful package of Python for manipulang tables • Built on

DataFrameObject

•  Anotherexample

Page 11: Python Data Processing with Pandasweb.cse.ohio-state.edu/~shen.94/5544/pandas.pdf · 2020. 9. 1. · Pandas • A very powerful package of Python for manipulang tables • Built on

ViewingData

•  ViewthefirstorlastNrows

Page 12: Python Data Processing with Pandasweb.cse.ohio-state.edu/~shen.94/5544/pandas.pdf · 2020. 9. 1. · Pandas • A very powerful package of Python for manipulang tables • Built on

ViewingData

•  Displaytheindex,columns,anddata

Page 13: Python Data Processing with Pandasweb.cse.ohio-state.edu/~shen.94/5544/pandas.pdf · 2020. 9. 1. · Pandas • A very powerful package of Python for manipulang tables • Built on

ViewingData

•  Quicksta:s:cs(forcolumnsABCDinthiscase)

Page 14: Python Data Processing with Pandasweb.cse.ohio-state.edu/~shen.94/5544/pandas.pdf · 2020. 9. 1. · Pandas • A very powerful package of Python for manipulang tables • Built on

ViewingData

•  Sor:ng:sortbytheindex(i.e.,reordercolumnsorrows),notbythedatainthetable

column

Page 15: Python Data Processing with Pandasweb.cse.ohio-state.edu/~shen.94/5544/pandas.pdf · 2020. 9. 1. · Pandas • A very powerful package of Python for manipulang tables • Built on

ViewingData

•  Sor:ng:sortbythedatavalues

Page 16: Python Data Processing with Pandasweb.cse.ohio-state.edu/~shen.94/5544/pandas.pdf · 2020. 9. 1. · Pandas • A very powerful package of Python for manipulang tables • Built on

Selec:ngData

•  Selec:ngusingalabel

Page 17: Python Data Processing with Pandasweb.cse.ohio-state.edu/~shen.94/5544/pandas.pdf · 2020. 9. 1. · Pandas • A very powerful package of Python for manipulang tables • Built on

Selec:ngData

•  Mul:-axis,bylabel

Page 18: Python Data Processing with Pandasweb.cse.ohio-state.edu/~shen.94/5544/pandas.pdf · 2020. 9. 1. · Pandas • A very powerful package of Python for manipulang tables • Built on

Selec:ngData

•  Mul:-axis,bylabelSlicing:lastincluded

Page 19: Python Data Processing with Pandasweb.cse.ohio-state.edu/~shen.94/5544/pandas.pdf · 2020. 9. 1. · Pandas • A very powerful package of Python for manipulang tables • Built on

Selec:ngData

•  Selectbyposi:on

Page 20: Python Data Processing with Pandasweb.cse.ohio-state.edu/~shen.94/5544/pandas.pdf · 2020. 9. 1. · Pandas • A very powerful package of Python for manipulang tables • Built on

Selec:ngData

•  Booleanindexing

Page 21: Python Data Processing with Pandasweb.cse.ohio-state.edu/~shen.94/5544/pandas.pdf · 2020. 9. 1. · Pandas • A very powerful package of Python for manipulang tables • Built on

Selec:ngData

•  Booleanindexing

Page 22: Python Data Processing with Pandasweb.cse.ohio-state.edu/~shen.94/5544/pandas.pdf · 2020. 9. 1. · Pandas • A very powerful package of Python for manipulang tables • Built on

SeZngData

•  SeZnganewcolumnalignedbyindexes

Page 23: Python Data Processing with Pandasweb.cse.ohio-state.edu/~shen.94/5544/pandas.pdf · 2020. 9. 1. · Pandas • A very powerful package of Python for manipulang tables • Built on

SeZngData

Page 24: Python Data Processing with Pandasweb.cse.ohio-state.edu/~shen.94/5544/pandas.pdf · 2020. 9. 1. · Pandas • A very powerful package of Python for manipulang tables • Built on

Opera:ons

•  Descrip:vesta:s:cs– Acrossaxis0(rows),i.e.,columnmean

– Acrossaxis1(column),i.e.,rowmean

Page 25: Python Data Processing with Pandasweb.cse.ohio-state.edu/~shen.94/5544/pandas.pdf · 2020. 9. 1. · Pandas • A very powerful package of Python for manipulang tables • Built on

Opera:ons

•  Apply

•  Histogram

Page 26: Python Data Processing with Pandasweb.cse.ohio-state.edu/~shen.94/5544/pandas.pdf · 2020. 9. 1. · Pandas • A very powerful package of Python for manipulang tables • Built on

MergeTables

•  Join

Page 27: Python Data Processing with Pandasweb.cse.ohio-state.edu/~shen.94/5544/pandas.pdf · 2020. 9. 1. · Pandas • A very powerful package of Python for manipulang tables • Built on

MergeTables

•  Append

Page 28: Python Data Processing with Pandasweb.cse.ohio-state.edu/~shen.94/5544/pandas.pdf · 2020. 9. 1. · Pandas • A very powerful package of Python for manipulang tables • Built on

Grouping

Page 29: Python Data Processing with Pandasweb.cse.ohio-state.edu/~shen.94/5544/pandas.pdf · 2020. 9. 1. · Pandas • A very powerful package of Python for manipulang tables • Built on

FileI/O

•  CSV

Page 30: Python Data Processing with Pandasweb.cse.ohio-state.edu/~shen.94/5544/pandas.pdf · 2020. 9. 1. · Pandas • A very powerful package of Python for manipulang tables • Built on

FileI/O

•  Excel


Rearranging and manipulang data - Evolutionary Biologyevol.bio.lmu.de/_statgen/Rcourse/ws1617/slides/Day7_DataManipula… · Get an overview str() provides an overview of an object

Rearranging and manipulang data - Evolutionary Biologyevol.bio.lmu.de/_statgen/Rcourse/ws1617/slides/Day7_DataManipula… · Get an overview str() provides an overview of an object

Ambidextrous Python - Introduction Python Libraries

Ambidextrous Python - Introduction Python Libraries

Work Python, play Python~

Work Python, play Python~

Python Programming. Python Programming for Beginners, Python Programming for Intermediates

Python Programming. Python Programming for Beginners, Python Programming for Intermediates

A Crash Course in Python - Techomepage.cem.itesm.mx/.../SLIDES/Python/CrashCoursePythonPartI.pdfA Crash Course in Python 2 Agenda Why Python Python References Python Advantages Python

A Crash Course in Python - Techomepage.cem.itesm.mx/.../SLIDES/Python/CrashCoursePythonPartI.pdfA Crash Course in Python 2 Agenda Why Python Python References Python Advantages Python

Datenanalyse mit IPython und Pandas - Dirk Lossdirk-loss.de/ipython-pandas-2013-05/datenanalyse-ipython-pandas.pdf · python-sympy python-nose. Title: Datenanalyse mit IPython und

Datenanalyse mit IPython und Pandas - Dirk Lossdirk-loss.de/ipython-pandas-2013-05/datenanalyse-ipython-pandas.pdf · python-sympy python-nose. Title: Datenanalyse mit IPython und

python training | python course | python online training

python training | python course | python online training

Python. Лекция 2. Основные стандартные модули Python. · Python. Лекция 2. Основные стандартные модули Python. Одним

Python. Лекция 2. Основные стандартные модули Python. · Python. Лекция 2. Основные стандартные модули Python. Одним

Python 2 and Python 3 -

Python 2 and Python 3 -

SANJEEV SHARMA Informatics Practices(New) CLASS XII Code ...layak.in/Python_Programming/Python pandas.pdf · Pandas is an open source, BSD-licensed library providing high-performance,

SANJEEV SHARMA Informatics Practices(New) CLASS XII Code ...layak.in/Python_Programming/Python pandas.pdf · Pandas is an open source, BSD-licensed library providing high-performance,

UVOD U PYTHON NAUČITE PYTHON UVOD U PYTHON dosadnih ...

UVOD U PYTHON NAUČITE PYTHON UVOD U PYTHON dosadnih ...

Internet&of&Things&Workshop& - tamberg.org · h?p:// % Measuring%and%manipulang & Measuring%and%manipulang & IoT%hardware%has%an%interface&tothe&realworld %

Internet&of&Things&Workshop& - tamberg.org · h?p:// % Measuring%and%manipulang & Measuring%and%manipulang & IoT%hardware%has%an%interface&tothe&realworld %

Python 3: Byte of Python

Python 3: Byte of Python

Manipulating and analyzing data with pandasccomte/reading-groups/19-pandas.pdf · Addingtwoseries(withautomaticdataalignment) > u = pd.Series([230., 275.], index=['Mei Xiang', 'Tian

Manipulating and analyzing data with pandasccomte/reading-groups/19-pandas.pdf · Addingtwoseries(withautomaticdataalignment) > u = pd.Series([230., 275.], index=['Mei Xiang', 'Tian

pandas SQLitegerth/ipsa18/slides/pandas.pdf · Table: country name population area capital 'Denmark' 5748769 42931 'Copenhagen' 'Germany' 82800000 357168 'Berlin' 'USA' 325719178

pandas SQLitegerth/ipsa18/slides/pandas.pdf · Table: country name population area capital 'Denmark' 5748769 42931 'Copenhagen' 'Germany' 82800000 357168 'Berlin' 'USA' 325719178

Python Data Processing with Pandas - web.cse.ohio-state.eduweb.cse.ohio-state.edu/~shen.94/5544/Slides/pandas.pdf · Pandas • A very powerful package of Python for manipulang tables

Python Data Processing with Pandas - web.cse.ohio-state.eduweb.cse.ohio-state.edu/~shen.94/5544/Slides/pandas.pdf · Pandas • A very powerful package of Python for manipulang tables

Python Tkinter Introducción (Interface gráfica)mmc2.geofisica.unam.mx/cursos/edp/HPC/Lenguajes/Python/Python Tkinter... · Python Práctica con Botones . Python Posicionamientos

Python Tkinter Introducción (Interface gráfica)mmc2.geofisica.unam.mx/cursos/edp/HPC/Lenguajes/Python/Python Tkinter... · Python Práctica con Botones . Python Posicionamientos

Modern Keysigning · sudo apt-get install python avahi-daemon python-avahi python-gi gir1.2-glib-2.0 gir1.2-gtk-3.0 python-dbus python-requests monkeysign python-qrcode

Modern Keysigning · sudo apt-get install python avahi-daemon python-avahi python-gi gir1.2-glib-2.0 gir1.2-gtk-3.0 python-dbus python-requests monkeysign python-qrcode

Python: Interfaces Gráficas com Tk - orion.lcg.ufrj.brorion.lcg.ufrj.br/python/_14 - Programando em Python - Interfaces... · Interfaces Gráficas em Python n Python possui camadas

Python: Interfaces Gráficas com Tk - orion.lcg.ufrj.brorion.lcg.ufrj.br/python/_14 - Programando em Python - Interfaces... · Interfaces Gráficas em Python n Python possui camadas

Introdução a Python - Python Poli

Introdução a Python - Python Poli