Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... ·...
37
Data Streaming Algorithms Barna Saha
Transcript of Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... ·...
![Page 1: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/1.jpg)
DataStreamingAlgorithms
BarnaSaha
![Page 2: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/2.jpg)
![Page 3: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/3.jpg)
![Page 4: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/4.jpg)
![Page 5: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/5.jpg)
![Page 6: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/6.jpg)
![Page 7: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/7.jpg)
![Page 8: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/8.jpg)
![Page 9: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/9.jpg)
![Page 10: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/10.jpg)
![Page 11: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/11.jpg)
![Page 12: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/12.jpg)
![Page 13: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/13.jpg)
![Page 14: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/14.jpg)
DevelopingStreamingAlgorithms• Themainhurdleisthespace.
• Oftenitismuchmoreefficienttogetanapproximateanswerthananexactanswer.
• Oftenthealgorithmusesrandomizationlikehashingandsampling.
![Page 15: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/15.jpg)
![Page 16: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/16.jpg)
![Page 17: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/17.jpg)
![Page 18: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/18.jpg)
![Page 19: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/19.jpg)
![Page 20: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/20.jpg)
![Page 21: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/21.jpg)
![Page 22: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/22.jpg)
![Page 23: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/23.jpg)
![Page 24: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/24.jpg)
![Page 25: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/25.jpg)
![Page 26: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/26.jpg)
![Page 27: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/27.jpg)
![Page 28: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/28.jpg)
![Page 29: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/29.jpg)
![Page 30: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/30.jpg)
![Page 31: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/31.jpg)
![Page 32: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/32.jpg)
![Page 33: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/33.jpg)
![Page 34: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/34.jpg)
![Page 35: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/35.jpg)
![Page 36: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/36.jpg)
![Page 37: Data Streaming Algorithms - University of Massachusetts ... › cs590d › lectures › ... · Developing Streaming Algorithms •The main hurdle is the space. ... > Cloud infrastructure](https://reader033.fdocuments.net/reader033/viewer/2022042310/5ed887326714ca7f476817bf/html5/thumbnails/37.jpg)
MiniExercise[DueOct31st]
• ImplementCountMinSketchandplotthefrequencyofallelementsasreportedbytheCountMinsketchdatastructureaswellastheirtruefrequenciesusingε=0.01andnumberofhashfunctions=25.– Data:considerastreamofsize1000000whereeachelementinthestreamarrivesfrom[1,1000]chosenuniformlyatrandom.