"Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)
-
Upload
tech-in-asia-id -
Category
Technology
-
view
101 -
download
0
Transcript of "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)
![Page 1: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/1.jpg)
Build a Web Scraper with Angular 2 & GO17 Nov 2016 @ Balai Kartini
Sigit Prayoga
![Page 2: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/2.jpg)
Sigit Prayoga.Initiator of JLP
People Development Manager @ Obortech
Just about 6 years experience.Worked onsite with TiVo, Best Buy, JC
Penney & JPMC.
gh: @sigit-prayoga
![Page 3: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/3.jpg)
[DEMO]
![Page 4: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/4.jpg)
Simple, huh?
![Page 5: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/5.jpg)
1.Bootstrap Angular 2 App with angular-cli
![Page 6: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/6.jpg)
2. Create http request di Angular 2
![Page 7: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/7.jpg)
3. Create a RESTful API
![Page 8: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/8.jpg)
4. Web Scraping with GoQuery
![Page 9: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/9.jpg)
5. Build and run GO
![Page 10: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/10.jpg)
1.Bootstrap Angular 2 App with angular-cli
2.Create http request di Angular 23.Create a RESTful API4.Web Scraping with GoQuery5.Build and run GO
![Page 11: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/11.jpg)
In common practice what do we need?
![Page 12: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/12.jpg)
Database || Open API
![Page 13: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/13.jpg)
Database
![Page 14: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/14.jpg)
[{“name”:”iPhone 7 White 128 GB”,“description”:”lorem ipsum
lorem”,“categories”:[cat1, cat2, cat3,
cat4]},{
“Name”:”lemari baju”,“description”:”lorem ipsum
lorem”,“categories”:[cat1, cat2, cat3,
cat4]},{
“Name”:”sepatu lari”,“description”:”lorem ipsum
lorem”,“categories”:[cat1, cat2, cat3,
cat4]}]
![Page 15: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/15.jpg)
Frontend Backend Database
![Page 16: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/16.jpg)
So, let’s input all products then?
![Page 17: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/17.jpg)
![Page 18: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/18.jpg)
OPEN API
![Page 19: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/19.jpg)
![Page 20: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/20.jpg)
Application Program Interface
![Page 21: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/21.jpg)
Open for public usage?
![Page 22: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/22.jpg)
![Page 23: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/23.jpg)
No database, No open API?!
![Page 24: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/24.jpg)
No worries
![Page 25: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/25.jpg)
Let’s scrap this sh*t!
Note: Only for sharing purpose. More research required about the legality before you really want to do this.
![Page 26: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/26.jpg)
What is web scraping?
![Page 27: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/27.jpg)
![Page 28: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/28.jpg)
How about searching category?
![Page 29: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/29.jpg)
![Page 30: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/30.jpg)
![Page 31: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/31.jpg)
![Page 32: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/32.jpg)
![Page 33: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/33.jpg)
![Page 34: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/34.jpg)
![Page 35: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/35.jpg)
![Page 36: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/36.jpg)
![Page 37: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/37.jpg)
![Page 38: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/38.jpg)
![Page 39: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/39.jpg)
![Page 40: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/40.jpg)
![Page 41: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/41.jpg)
![Page 42: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/42.jpg)
![Page 43: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/43.jpg)
[..SEE THE CODE..]
![Page 44: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/44.jpg)
https://github.com/sigit-prayoga/web-scraper-angular2
![Page 45: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/45.jpg)
Questions?
![Page 46: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/46.jpg)
![Page 47: "Build A Web Scraper With GO & Angular2" by Sigit Prayoga (JLP Community)](https://reader031.fdocuments.net/reader031/viewer/2022021922/587756011a28ab84388b73f7/html5/thumbnails/47.jpg)