Sqrrl Overview for Stac Research

9
Securely explore your data SQRRL OVERVIEW Ely Kahn VP Business Development [email protected]

description

Ely Kahn presents at Stac Research Fall 2013 NYC Summit.

Transcript of Sqrrl Overview for Stac Research

Page 1: Sqrrl Overview for Stac Research

Securely explore your data

SQRRL OVERVIEW

Ely Kahn VP Business Development [email protected]

Page 2: Sqrrl Overview for Stac Research

WHO WE ARE

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Sqrrl’s team has worked with the world’s largest and most sensitive datasets for the last decade

!   Over 20 years of combined Accumulo experience

!   Team includes former Technical Director of Accumulo at NSA and 6 committers/contributors

Google’s BigTable Paper

2006

NSA Builds Accumulo

2008 Sqrrl Founded

2012 1st Sqrrl Release and Customers

2013

NSA Open Sources

Accumulo 2011

Investors:

2

Page 3: Sqrrl Overview for Stac Research

THE PROBLEM

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Security is the number one hurdle for adopting Big Data solutions

3

Page 4: Sqrrl Overview for Stac Research

An Accumulo key is a 5-tuple, consisting of: !   Row: Controls Atomicity !   Column Family: Controls Locality !   Column Qualifier: Controls Uniqueness !   Visibility Label: Controls Access !   Timestamp: Controls Versioning

Row Col. Fam. Col. Qual. Visibility Timestamp Value

John Doe Notes PCP PCP_JD 20120912 Patient suffers from an acute …

John Doe Test Results Cholesterol JD|PCP_JD 20120912 183

John Doe Test Results Mental Health JD|PSYCH_JD 20120801 Pass

John Doe Test Results X-Ray JD|PHYS_JD 20120513 1010110110100…

Accumulo  Key/Value  Example  

ACCUMULO DATA FORMAT

4 © 2013 Sqrrl | All Rights Reserved

Page 5: Sqrrl Overview for Stac Research

INDEXES AND QFDS

Logs/Observations Input

Indexes

Question-Focused Datasets Transform

ation

•  Immutable •  Append-Only •  Simple Security Model

•  Real-Time •  Online •  Sorted •  Grouped •  Aggregated •  Complex Security

Model

5 © 2013 Sqrrl | All Rights Reserved

Page 6: Sqrrl Overview for Stac Research

SECURITY

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Sqrrl Enterprise has a powerful security model featuring Cell-Level Security™, encryption, & RBAC/ABAC

6

Page 7: Sqrrl Overview for Stac Research

USE CASE

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Many orgs are using Sqrrl Enterprise to enable a Secure Data Lake™ capability (i.e., multitenancy)

Real-Time Big Apps

7

Page 8: Sqrrl Overview for Stac Research

USE CASE

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Sqrrl Enterprise can integrate with Stream Processing Engines (SPEs)

Dashboards

Actions

Interactive Analysis Tools (Discovery + Forensics)

1.  SPE queries Sqrrl to enrich streaming data 2.  SPE persists results in Sqrrl for future query 3.  SPE takes action automatically 4.  SPE issues data-driven alerts

5.  Sqrrl provides context for dashboards 6.  Analysis tools query use Sqrrl to search and

manipulate historical data

DATA

SPE

8

Page 9: Sqrrl Overview for Stac Research

USE CASE

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Sqrrl Enterprise powers operational apps in the financial services industry

Real-Time Operational Apps BI-Reporting/Analytics

•  Complex/Multi-Structured Data •  Fine grain Security •  Multi Tenancy/High Concurrency •  Operational Data Store •  Continuous Data Ingest •  Indexed •  Full Text Search •  Dynamic Schema

Pull Relevant Data

•  MPP •  Ad Hoc Complex

Queries •  Structured

Analytics •  Medium to low

concurrency

Historical & Analytical Questions; Middle/Back Office

Intra-Day, Client Real Time Apps; Front Office

Signals & Alerting On Events

FX Messages

Equity Trades

Messages

Enterprise Data Bus

SPE

Analytical DB

9