Top Banner
Securely explore your data SQRRL OVERVIEW Ely Kahn VP Business Development [email protected]
9

Sqrrl Overview for Stac Research

Jan 27, 2015

Download

Technology

sqrrl

Ely Kahn presents at Stac Research Fall 2013 NYC Summit.
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Sqrrl Overview for Stac Research

Securely explore your data

SQRRL OVERVIEW

Ely Kahn VP Business Development [email protected]

Page 2: Sqrrl Overview for Stac Research

WHO WE ARE

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Sqrrl’s team has worked with the world’s largest and most sensitive datasets for the last decade

!   Over 20 years of combined Accumulo experience

!   Team includes former Technical Director of Accumulo at NSA and 6 committers/contributors

Google’s BigTable Paper

2006

NSA Builds Accumulo

2008 Sqrrl Founded

2012 1st Sqrrl Release and Customers

2013

NSA Open Sources

Accumulo 2011

Investors:

2

Page 3: Sqrrl Overview for Stac Research

THE PROBLEM

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Security is the number one hurdle for adopting Big Data solutions

3

Page 4: Sqrrl Overview for Stac Research

An Accumulo key is a 5-tuple, consisting of: !   Row: Controls Atomicity !   Column Family: Controls Locality !   Column Qualifier: Controls Uniqueness !   Visibility Label: Controls Access !   Timestamp: Controls Versioning

Row Col. Fam. Col. Qual. Visibility Timestamp Value

John Doe Notes PCP PCP_JD 20120912 Patient suffers from an acute …

John Doe Test Results Cholesterol JD|PCP_JD 20120912 183

John Doe Test Results Mental Health JD|PSYCH_JD 20120801 Pass

John Doe Test Results X-Ray JD|PHYS_JD 20120513 1010110110100…

Accumulo  Key/Value  Example  

ACCUMULO DATA FORMAT

4 © 2013 Sqrrl | All Rights Reserved

Page 5: Sqrrl Overview for Stac Research

INDEXES AND QFDS

Logs/Observations Input

Indexes

Question-Focused Datasets Transform

ation

•  Immutable •  Append-Only •  Simple Security Model

•  Real-Time •  Online •  Sorted •  Grouped •  Aggregated •  Complex Security

Model

5 © 2013 Sqrrl | All Rights Reserved

Page 6: Sqrrl Overview for Stac Research

SECURITY

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Sqrrl Enterprise has a powerful security model featuring Cell-Level Security™, encryption, & RBAC/ABAC

6

Page 7: Sqrrl Overview for Stac Research

USE CASE

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Many orgs are using Sqrrl Enterprise to enable a Secure Data Lake™ capability (i.e., multitenancy)

Real-Time Big Apps

7

Page 8: Sqrrl Overview for Stac Research

USE CASE

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Sqrrl Enterprise can integrate with Stream Processing Engines (SPEs)

Dashboards

Actions

Interactive Analysis Tools (Discovery + Forensics)

1.  SPE queries Sqrrl to enrich streaming data 2.  SPE persists results in Sqrrl for future query 3.  SPE takes action automatically 4.  SPE issues data-driven alerts

5.  Sqrrl provides context for dashboards 6.  Analysis tools query use Sqrrl to search and

manipulate historical data

DATA

SPE

8

Page 9: Sqrrl Overview for Stac Research

USE CASE

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Sqrrl Enterprise powers operational apps in the financial services industry

Real-Time Operational Apps BI-Reporting/Analytics

•  Complex/Multi-Structured Data •  Fine grain Security •  Multi Tenancy/High Concurrency •  Operational Data Store •  Continuous Data Ingest •  Indexed •  Full Text Search •  Dynamic Schema

Pull Relevant Data

•  MPP •  Ad Hoc Complex

Queries •  Structured

Analytics •  Medium to low

concurrency

Historical & Analytical Questions; Middle/Back Office

Intra-Day, Client Real Time Apps; Front Office

Signals & Alerting On Events

FX Messages

Equity Trades

Messages

Enterprise Data Bus

SPE

Analytical DB

9