Welcome [tc18.tableau.com]...MATILLION ETL FOR BigQuery Snowflake How to Engage •Visit •Launch...
Transcript of Welcome [tc18.tableau.com]...MATILLION ETL FOR BigQuery Snowflake How to Engage •Visit •Launch...
Welcome
Give Your Data A Workout
Arawan GajajivaSolution Architect
Matillion
# T C 1 8
Want to hit the ground running with advanced data analytics?
No sweat!
ELT to the rescue!
“Wait, did he just say E-L-T?
Doesn’t he mean E-T-L?”
This might be a process you are familiar with... ...prepare to have your mind blown.
First, we connected to Strava APIs.
To fetch all Workout Activities.
In raw JSON format.
[{"resource_state":2,"athlete":{"id":16782953,"resource_state":1},"name":"EveningRun","distance":5261.8,"moving_time":1750,"elapsed_time":1868,"total_elevation_gain":43.8,"type":"Run","workout_type":0,"id":1738996722,"external_id":"1297e650882ee3c8e8329b41926905db","upload_id":1865841116,"start_date":"2018-07-31T00:15:49Z","start_date_local":"2018-07-30T18:15:49Z","timezone":"(GMT-07:00) America/Denver","utc_offset":-21600,"start_latlng":[39.63,-105.33],"end_latlng":[39.63,-105.32],"location_city":null,"location_state":null,"location_country":"","start_latitude":39.63,"start_longitude":-105.33,"achievement_count":0,"kudos_count":1,"comment_count":0,"athlete_count":1,"photo_count":0,"map":{"id":"a1738996722","summary_polyline":"amzpFpszaSoCsCiDt@_DkDmDfFdEfHuEaAy@vByCHgFp\\mEfBP{FmDoOgAoV|HmMb@sDmA}ChLvHaEfQp@nIdBv@iBdScCvH}DjA?gGcDiOMaO}@aBf@eEvHsLu@gG","resource_state":2},"trainer":false,"commute":false,"manual":false,"private":false,"flagged":false,"gear_id":"g3396464","from_accepted_tag":false,"average_speed":3.007,"max_speed":7.8,"has_heartrate":true,"average_heartrate":156.1,"max_heartrate":168,"elev_high":2202.5,"elev_low":2144.5,"pr_count":0,"total_photo_count":0,"has_kudoed":false,"suffer_score":50}]
We then connected to WorldWeatherOnline.com APIs.
To fetch Historical Hourly Weather data.
Also in JSON format.
{"data":{"request":[{"type":"LatLon","query":"Lat 39.63 and Lon -105.33"}],"weather":[{"date":"2018-07-01","astronomy":[{"sunrise":"05:38 AM","sunset":"08:33 PM","moonrise":"11:00 PM","moonset":"08:42 AM","moon_phase":"WaningGibbous","moon_illumination":"83"}],"maxtempC":"27","maxtempF":"81","mintempC":"12","mintempF":"54","totalSnow_cm":"0.0","sunHour":"14.5","uvIndex":"0","hourly":[{"time":"0","tempC":"13","tempF":"56","windspeedMiles":"4","windspeedKmph":"7","winddirDegree":"242","winddir16Point":"WSW","weatherCode":"176","weatherIconUrl":[{"value":"http://cdn.worldweatheronline.net/images/wsymbols01_png_64/wsymbol_0025_light_rain_showers_night.png"}],"weatherDesc":[{"value":"Patchy rain possible"}],"precipMM":"0.2","humidity":"62","visibility":"10","pressure":"1016","cloudcover":"76","HeatIndexC":"14","HeatIndexF":"57","DewPointC":"7","DewPointF":"45","WindChillC":"14","WindChillF":"57","WindGustMiles":"6","WindGustKmph":"9","FeelsLikeC":"14","FeelsLikeF":"57"},{"time":"300","tempC":"12","tempF":"54","windspeedMiles":"3","windspeedKmph":"5","winddirDegree":"285","winddir16Point":"WNW","weatherCode":"116","weatherIconUrl":[{"value":"http://cdn.worldweatheronline.net/images/wsymbols01_png_64/wsymbol_0004_black_low_cloud.png"}],"weatherDesc":[{"value":"Partlycloudy"}],"precipMM":"0.0","humidity":"57","visibility":"10","pressure":"1017","cloudcover":"4","HeatIndexC":"13","HeatIndexF":"55","DewPointC":"5","DewPointF":"41","WindChillC":"13","WindChillF":"55","WindGustMiles":"6","WindGustKmph":"10","FeelsLikeC":"13","FeelsLikeF":"55"}]}]}}
Data preparation was performed on both data sets to allow for them to be joined for deeper analysis.
Matillion and Snowflake made this task simple!
Matillion Demo
Tableau Analysis
Workout Map – Weather
Pace vs Elevation
Workout Weather Diagram
We make purpose-built, native solutions that leveragethe intersection of data and cloud computing
MATILLION ETL FOR
Amazon RedshiftMATILLION ETL FOR
BigQueryMATILLION ETL FOR
Snowflake
How to Engage
• Visit www.matillion.com
• Launch on the AWS Marketplace, GCP Marketplace or Azure Marketplace
• Free Trial or Test Drive
• Booth #715 in the Data Village
Please complete the
session survey from the
Session Details screen
in your TC18 app
Thank you!
#TC18
Visit us at Booth #715
Appendix