DEBS 2010 – 4 th ACM International Conference on Distributed Event-Based System Cambridge, United Kingdom HOLMES: An event-driven solution to monitor data centers through continuous queries and machine learning Pedro Henriques dos Santos Teixeira Ricardo Gomes Clemente Ronald Andreu Kaiser Denis Almeida Vieira Jr
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
DEBS 2010 – 4th ACM International Conference on Distributed Event-Based SystemCambridge, United Kingdom
HOLMES: An event-driven solution to monitor data centers through continuous queries and
machine learning
Pedro Henriques dos Santos TeixeiraRicardo Gomes Clemente
Ronald Andreu KaiserDenis Almeida Vieira Jr
DEBS 2010 – 4th ACM International Conference on Distributed Event-Based SystemCambridge, United Kingdom
Topics
• Motivation• Use Case• The Solution
• Overview• System architecture• CEP• Machine learning• CEP & Machine learning integration• Visualization and User Interface
• Conclusion
DEBS 2010 – 4th ACM International Conference on Distributed Event-Based SystemCambridge, United Kingdom
Motivation
DEBS 2010 – 4th ACM International Conference on Distributed Event-Based SystemCambridge, United Kingdom
Motivation
• Non-stop growing environment, dynamic• Understand our environment• Too many dependencies• Can't afford downtime
DEBS 2010 – 4th ACM International Conference on Distributed Event-Based SystemCambridge, United Kingdom
Motivation
• Monitoring can be tricky• Precede the inevitable and try to avoid chaos• 1.2K servers• 14K+ monitored items• Correlation
DEBS 2010 – 4th ACM International Conference on Distributed Event-Based SystemCambridge, United Kingdom
Use Case
DEBS 2010 – 4th ACM International Conference on Distributed Event-Based SystemCambridge, United Kingdom
Use Case
• Big Brother Brazil• New world record• 151 million votes in 2 days• Peaks of 13500 votes per minute (~220 v/s)• DDoS atack detected
DEBS 2010 – 4th ACM International Conference on Distributed Event-Based SystemCambridge, United Kingdom
Overview
DEBS 2010 – 4th ACM International Conference on Distributed Event-Based SystemCambridge, United Kingdom
DEBS 2010 – 4th ACM International Conference on Distributed Event-Based SystemCambridge, United Kingdom
The System Architecture
DEBS 2010 – 4th ACM International Conference on Distributed Event-Based SystemCambridge, United Kingdom
HOLMES
DEBS 2010 – 4th ACM International Conference on Distributed Event-Based SystemCambridge, United Kingdom