Hue HBase Browser
description
Transcript of Hue HBase Browser
![Page 1: Hue HBase Browser](https://reader033.fdocuments.net/reader033/viewer/2022061602/568161bc550346895dd19609/html5/thumbnails/1.jpg)
1
Hue HBase BrowserKevin Wang, Platform Intern, Cloudera@Kevinverse
![Page 2: Hue HBase Browser](https://reader033.fdocuments.net/reader033/viewer/2022061602/568161bc550346895dd19609/html5/thumbnails/2.jpg)
2
Cloudera Hue
• Web Interface for making Hadoop easier to use • Aggregation of apps for each Hadoop component
(e.g. Hive, Pig, Impala, Oozie, Solr, Sqoop, HBase...)
![Page 3: Hue HBase Browser](https://reader033.fdocuments.net/reader033/viewer/2022061602/568161bc550346895dd19609/html5/thumbnails/3.jpg)
3
• Industry Usage
• Widespread HBase Usage• Meetups, HBaseCon
• Community Need
Product Mission - HBase Usage Size
Organic ExampleCommunity Expresses Need for HBase UI
![Page 4: Hue HBase Browser](https://reader033.fdocuments.net/reader033/viewer/2022061602/568161bc550346895dd19609/html5/thumbnails/4.jpg)
4
Product Mission - Problem & Competition
Lack of Accessibility• Hard for beginnersLack of Familiarity• Unfamiliarity with Key-ValueUsability Challenges• Lack of any web UI• Lack of imaginative interface• Low-level• CDH - Command Line
HBase Manager’s Tabular View
Competing Application
![Page 5: Hue HBase Browser](https://reader033.fdocuments.net/reader033/viewer/2022061602/568161bc550346895dd19609/html5/thumbnails/5.jpg)
5
• Open HBase usage to non-technical people• Drive HBase adoption in startups/organizations• Solve a pain point with a good product
• Knockout/JS/jQuery• Django • Thrift Hbase
Project Purpose – Addressing this Need
![Page 6: Hue HBase Browser](https://reader033.fdocuments.net/reader033/viewer/2022061602/568161bc550346895dd19609/html5/thumbnails/6.jpg)
6
Demo
![Page 7: Hue HBase Browser](https://reader033.fdocuments.net/reader033/viewer/2022061602/568161bc550346895dd19609/html5/thumbnails/7.jpg)
7
Technical Challenges - Design
• Design Innovation• Problem: HBase is a key-value store, not a traditional RDB • Solution: Collapse Sparse Data across HBase Tables
Tabular View HBase Browser Smartview
![Page 8: Hue HBase Browser](https://reader033.fdocuments.net/reader033/viewer/2022061602/568161bc550346895dd19609/html5/thumbnails/8.jpg)
8
• Scale • Problem: Performance on Millions of Columns• Solution: Lazy loading & Truncation using Thrift FilterString
• Stream raw data cached MEM DOM elements dynamically generated• b64encode binary data to preserve during ASCII dump• Detect schema on preview reading byte headers• Capped, Lazy Loaded & Bound to DOM via MVVM Pattern
Technical Highlight - Scale
100MB Currently Streamed Thrift 5TB HBase Cluster
![Page 9: Hue HBase Browser](https://reader033.fdocuments.net/reader033/viewer/2022061602/568161bc550346895dd19609/html5/thumbnails/9.jpg)
9
Technical Highlight - Flexible Searchbar
• Flexible Searchbar• Problem: Need high-level tool for complex data fetching &
analysis• Solution: Simple custom query language
• Supports HBase filter language• Supports selection & Copy + Paste, Gracefully degrades in IE• Autocomplete Help Menu• Regenerate Rendered Position – Firefox Bug
Row Key
Scan Length
Prefix Scan
Column/Family Filters
Thrift Filterstring
Searchbar Syntax Breakdown
![Page 10: Hue HBase Browser](https://reader033.fdocuments.net/reader033/viewer/2022061602/568161bc550346895dd19609/html5/thumbnails/10.jpg)
10
Current• Ramp up for CDH 4.4 release• Tutorial Video & Blog Post• Tons of JIRAs
Roadmap, Timeline & Next Steps
Initial Release in Hue 2.5 Ship in CDH 4.4
![Page 11: Hue HBase Browser](https://reader033.fdocuments.net/reader033/viewer/2022061602/568161bc550346895dd19609/html5/thumbnails/11.jpg)
11
Any Questions?Kevin, Platform Intern, ClouderaFollow me: @Kevinversewww.gethue.com
Hue HBase Browser250+ commits20000+ lines of code∞ cups of coffee
Pageviews
![Page 12: Hue HBase Browser](https://reader033.fdocuments.net/reader033/viewer/2022061602/568161bc550346895dd19609/html5/thumbnails/12.jpg)
12
Icons (more to come)
![Page 13: Hue HBase Browser](https://reader033.fdocuments.net/reader033/viewer/2022061602/568161bc550346895dd19609/html5/thumbnails/13.jpg)
13
Arrows
Working Elements