UnCon2016 - New Job Queue Framework

New Job Queue Framework

Alesia KhizhkoSr. Director of Engineering,SugarCRM

• My role/history at SugarCRM– Joined Sugar at 2010– Lead Global PS Development– Manage/built multiple teams/products:

• Plugins,Multiple core components, Performance, SNIP

• My technical background– Master in Computer Science– Hands on experience as: Software Engineer, Project/Product managed,

Business analyst, Solution Architect, Engagement Director

• Functional Overview• Key technical terms

– Messaging queue– AMQP– Adaptor, Handler, Worker

• Anything else?

• Scalability;• Multi-platform and multi-language API support;• Designed for high performance clustering, client-

server, peer based communication;• No single point of failure;• Asynchronous processing;

• Work can be carried out by small, self-contained programs;

• Multiple providers can post messages to a queue;• Multiple message consumers attached to a single

queue;• The queuing infrastructure ensures messages are

delivered exactly once;

• Messages can be successfully submitted to a queue even if the message consumer(s) for that queue are not running or are unreachable.

• Message priority support;• Monitoring capabilities (using perfmon counters:

number of message received per second…)

Entry point for the JQ Framework

Responsible for registering:- Adaptors- Handlers- Jobs

•–

•

Demo

Questions, Resources and Follow-up

• Concepts?• Techniques?• Applicability?• Context?

New Job Queue Framework