Insight wk4

download Insight wk4

If you can't read please download the document

Transcript of Insight wk4

Windpipe

Sophie Diehl
Insight Data Engineering Fellow

What is the wind speed
at turbine height

right now,
and in the past?

Dataset

Wind speed data: NOAA GFS 4

Global, every 0.5 degrees latitude and longitude

Forecasts for coming week in 3-hour intervals

Released daily at midnight

Queries

What is the forecast today?

Past averages: single days, months

HBase Storage

rowkey day1 day2 day3 day4 ...

lat-long2 3.48 3.29 3.11 4.54

lat-long1 3.56 2.63 2.56 3.91 ...

vs.

day1_lat-long2 3.48

day2_lat-long1 2.63

day2_lat-long2 3.29

Page load for continental USA: 25s vs. 11s

day1_lat-long1 3.56

rowkeyvalue

...

...

...

MIT B.S. 2014Electrical Engineering

Sophie Diehl