Kx Meetup NY Dec 2014 - AquaQ Analytics presentation

AquaQ Analytics Limited

kdb+ KickStarter Presentation

kx Systems NY MeetupTuesday, 9th Dec 2014

Ronan Pairceir CEO

www.aquaq.co.uk

AquaQ Analytics

• Provider of specialist data management, data analytics and data mining services to clients:

• kdb+ Training Courses

• kdb+ Consultancy

• Free TorQ Framework for kdb+

• Clinical Trials Forecasting App

• Analytics Consultancy

• HQ in Belfast

www.aquaq.co.uk

Sectors of Interest

• Investment Banking

• Manufacturing (sensor data)

• Sports Tracking (wearable computing)

• Latency Monitoring

• Telematics (BB) Car Insurance

• Clinical Trial Cost Forecasting

• Medical Supply Chain tracking

• Tidal Energy

• Telecommunications

www.aquaq.co.uk

kdb+ KickStarter Tools

1. Online kdb+ Training Courses• Bootcamp

• Booster

2. AquaQ Blog Posts and

contributions to code.kx

3. Free TorQ Framework for kdb+• Allows users to focus

on the business logic

www.aquaq.co.uk

Online Training Courses

• designed by some of the most experienced kdb+ consultants globally

• series of instructional videos, downloadable slides, sample q code, and self-assessment questions

• learning at your own pace

www.aquaq.co.uk

training.aquaq.co.uk

Course Overview

Bootcamp

• Aimed at developers

• Equivalent to a 3-day introductory course

Booster

• Aimed at end-users and analysts

www.aquaq.co.uk

Suite 5, 9 - 15 Queen Street, Belfast, BT1 6EA 028 9031 2939 / 028 9031 5676

www.aquaq.co.uk

Slidess

Video Area

Links & Downloads

Progress & Test Scores

NotesQuestions

AquaQ Blog Posts and code.kx

• Series of q programming challenges and resources on kdb+• Self Similarity challenge

• Square-free sequences challenge

• Supporting kdb+ tick

• Garbage Collection in kdb+

• Hashing Algorithms in kdb+

• Websockets, HTML5 and kdb+

• Interfacing kdb+ to C

www.aquaq.co.uk

AquaQ TorQ Framework for kdb+

• AquaQ TorQ is a framework which forms the basis of a production kdb+ system

• Production in this sense, means TorQ possesses several core features found in many live kdb+ systems deployed today

• These core features are combined with a set of very useful utilities

www.aquaq.co.uk

TorQ Design Principles

The TorQ framework was designed with the following in mind:

• Ease of implementation and use

• To be highly extensible

• To have an emphasis on readability and performance

• To make use of code available on code.kx.com where it makes sense

www.aquaq.co.uk

Key Features

TorQ provides all the basic building blocks:

• Process management

• Code management

• Log management

• Centralised logging and Error-handling

• Housekeeping and Compression utilities

• Gateway, Discovery and Monitor processes

www.aquaq.co.uk

TorQ in Action

• A standard kdb+tick stack:

www.aquaq.co.uk

A TorQ kdb+ stack

www.aquaq.co.uk

Key Features

• The discovery process registers all processes known to it and can pass connection details to processes wishing to connect with one another

• The gateway provides load-balancing, querying over multiple databases and a single point of entry for users

• The monitor continually checks the health of the system via heartbeat queries and provides the central log message database

www.aquaq.co.uk

Additonal Features

• A browser based HTML5 GUI for the monitor, allowing even kdb+ novices to quickly spot and diagnose issues

• A file-alerter process with functionality to deal with damaged configuration or binary files

• Many more features and tools outlined in the documentation

www.aquaq.co.uk

Gateway Behaviour

www.aquaq.co.uk

HTML5 Monitor GUI

www.aquaq.co.uk

Why Choose TorQ?

• Powerful and comprehensive functionality out of the box on top of kdb+

• Spend developer time writing business critical code instead of system infrastructure

• Easily extendable and customizable

• A growing community of users – 12 organisations already using TorQ

www.aquaq.co.uk

Why Choose TorQ?

• The Framework is FREE and fully documented

• Windows and Linux platforms supported

• 32-bit and 64-bit kdb+ supported

• The TorQ framework will be continuously improved and updated

• Implementation, Full Support and Customisation is available for customers as a service from AquaQ

www.aquaq.co.uk

Coming Very Soon - TorQ 2.0

• WDB process based on w.q

• A configurable report process for querying data and publishing it to a specified format

• More robust monitoring – email notifications, polling checks for common issues

• Enhancements to the RDB and subscription code

• Addition of more data loading and writing utilities

• TorQ package ready to kick off with sample data

www.aquaq.co.uk

Thank You For Listening

• Follow TorQ updates here: http://www.aquaq.co.uk/news/

• Get started with the code here: http://www.aquaq.co.uk/products/

• Contact us with TorQ queries and suggestions [email protected]

• Public Webinars coming your way with the release of Torq 2.0 in Q1 2015

www.aquaq.co.uk