Top Banner
Copyright © 2015 Splunk Inc. Robert Goolsby Dir, OperaAons Enablement, Fiserv IT Service Intelligence At Fiserv
32

IT*Service*Intelligence* AtFiserv* - .conf19 | Splunk...Splunk*IT*Service*Intelligence* 10 ITSIis*a Splunk*premium*soluAon*thatenables*us*to*model*our*business*services*and*measure*them*

May 21, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: IT*Service*Intelligence* AtFiserv* - .conf19 | Splunk...Splunk*IT*Service*Intelligence* 10 ITSIis*a Splunk*premium*soluAon*thatenables*us*to*model*our*business*services*and*measure*them*

Copyright  ©  2015  Splunk  Inc.  

Robert  Goolsby  Dir,  OperaAons  Enablement,  Fiserv  

IT  Service  Intelligence  At  Fiserv  

Page 2: IT*Service*Intelligence* AtFiserv* - .conf19 | Splunk...Splunk*IT*Service*Intelligence* 10 ITSIis*a Splunk*premium*soluAon*thatenables*us*to*model*our*business*services*and*measure*them*

Disclaimer  

2  

During  the  course  of  this  presentaAon,  we  may  make  forward  looking  statements  regarding  future  events  or  the  expected  performance  of  the  company.  We  cauAon  you  that  such  statements  reflect  our  current  expectaAons  and  esAmates  based  on  factors  currently  known  to  us  and  that  actual  events  or  results  could  differ  materially.  For  important  factors  that  may  cause  actual  results  to  differ  from  those  contained  in  our  forward-­‐looking  statements,  please  review  our  filings  with  the  SEC.  The  forward-­‐looking  statements  made  in  the  this  presentaAon  are  being  made  as  of  the  Ame  and  date  of  its  live  presentaAon.  If  reviewed  aQer  its  live  presentaAon,  this  presentaAon  may  not  contain  current  or  

accurate  informaAon.  We  do  not  assume  any  obligaAon  to  update  any  forward  looking  statements  we  may  make.    

In  addiAon,  any  informaAon  about  our  roadmap  outlines  our  general  product  direcAon  and  is  subject  to  change  at  any  Ame  without  noAce.  It  is  for  informaAonal  purposes  only  and  shall  not,  be  incorporated  into  any  contract  or  other  commitment.  Splunk  undertakes  no  obligaAon  either  to  develop  the  features  

or  funcAonality  described  or  to  include  any  such  feature  or  funcAonality  in  a  future  release.  Referenced  customers  for  ITSI  product  parAcipated  in  a  limited  release  soQware  program  that  included  

items  at  no  charge.  

Page 3: IT*Service*Intelligence* AtFiserv* - .conf19 | Splunk...Splunk*IT*Service*Intelligence* 10 ITSIis*a Splunk*premium*soluAon*thatenables*us*to*model*our*business*services*and*measure*them*

Agenda  

Who  is  Fiserv?  

Fiserv’s  Monitoring  Opportunity  

What  is  IT  Service  Intelligence?  

IT  Service  Intelligence  OpportuniAes  

IT  Service  Intelligence  Challenges  

3  

Page 4: IT*Service*Intelligence* AtFiserv* - .conf19 | Splunk...Splunk*IT*Service*Intelligence* 10 ITSIis*a Splunk*premium*soluAon*thatenables*us*to*model*our*business*services*and*measure*them*

  Financial  Services  technology  provider:  –  Core  Account  Processing,  Electronic  Billing,  Card  Based  TransacAons,  Online  Banking,  Mobile  

Banking,  Check  Processing,  Lending  SoluAons,  Risk  Management  soluAons,  Person  to  Person  Payments,  etc…  

  More  than  1  in  3  U.S.  financial  insAtuAons  rely  on  Fiserv  for  core  processing  services      More  than  $1  trillion  moves  through  Fiserv  soluAons  annually      Fiserv  supports:    –  145  Million  deposit  accounts    –  21  Million  debit  accounts    –  75  Million  online  banking  end  users    –  14  Million  mobile  banking  end  users    –  Nearly  25  million  acAve  bill  payment  end  users    –  More  than  180  patents  issued  and  pending  for  innovaAve  financial  services  technology  soluAons    

  If  you're  a  mobile  banking  user  or  pay  your  bills  online  –  if  you  interact  with  a  financial  insAtuAon  at  all  –  chances  are  you're  more  familiar  with  Fiserv  than  you  realize.  

4  

Page 5: IT*Service*Intelligence* AtFiserv* - .conf19 | Splunk...Splunk*IT*Service*Intelligence* 10 ITSIis*a Splunk*premium*soluAon*thatenables*us*to*model*our*business*services*and*measure*them*

  Robert  Goolsby  –  Director,  OperaAons  Enablement  –  [email protected]  –  Responsible  for  overall  Enterprise  Monitoring  strategy    

  Abrar  Fakhri  –  Manager,  Splunk  Monitoring  –  [email protected]  –  Responsible  for  Splunk  vision,  roadmap,  planning  &  roll-­‐out  

5  

Page 6: IT*Service*Intelligence* AtFiserv* - .conf19 | Splunk...Splunk*IT*Service*Intelligence* 10 ITSIis*a Splunk*premium*soluAon*thatenables*us*to*model*our*business*services*and*measure*them*

Our  Opportunity  

Page 7: IT*Service*Intelligence* AtFiserv* - .conf19 | Splunk...Splunk*IT*Service*Intelligence* 10 ITSIis*a Splunk*premium*soluAon*thatenables*us*to*model*our*business*services*and*measure*them*

Monitoring  Improvement  IniAaAve    Inconsistent  monitoring  approach  for  a  parAcular  applicaAon  

  Many  different  log  files,  locaAons  and  logging  formats  across  many  different  servers  spanning  mulAple  Aers  of  infrastructure  

  Triage  required  specific  applicaAon  knowledge    

  Too  many  tools  –  trigger  event  or  condiAon  is  “visible”  but  support  teams  are  looking  in  the  wrong  place    SoluAon  –  deploy  Splunk  to  collect  and  process  data  that  can  feed  into  exisAng  incident  management  process.  

7  

Page 8: IT*Service*Intelligence* AtFiserv* - .conf19 | Splunk...Splunk*IT*Service*Intelligence* 10 ITSIis*a Splunk*premium*soluAon*thatenables*us*to*model*our*business*services*and*measure*them*

Splunk  Dashboarding  Challenges    The  trigger  event  is  in  the  logs  is  there  but  no  one  is  aware  unAl  a#er  client  is  impacted  

  How  can  we  quickly  react  to  changing  environment  condiAons  to  alert  and  prevent  reoccurring  events?  

  How  do  we  perform  conAnual  educaAon  across  business  units,  across  support  Aers  and  across  shiQs  on  the  latest  dashboards  that  looks  for  specific  client  impacAng  condiAons?  

  How  do  we  approach  creaAng  dashboards  for  a  variety  of  applicaAons,  infrastructure  teams  and  generate  FI  specific  views  and  not  suffer  from  analysis  paralysis?  

  …and  a  90  day  deliverable  date  from  incepAon  to  delivery.    

8  

Page 9: IT*Service*Intelligence* AtFiserv* - .conf19 | Splunk...Splunk*IT*Service*Intelligence* 10 ITSIis*a Splunk*premium*soluAon*thatenables*us*to*model*our*business*services*and*measure*them*

What  is  IT  Service  Intelligence?  

Page 10: IT*Service*Intelligence* AtFiserv* - .conf19 | Splunk...Splunk*IT*Service*Intelligence* 10 ITSIis*a Splunk*premium*soluAon*thatenables*us*to*model*our*business*services*and*measure*them*

Splunk  IT  Service  Intelligence  

10  

  ITSI  is  a  Splunk  premium  soluAon  that  enables  us  to  model  our  business  services  and  measure  them  against  defined  service  levels    

  Splunk  ITSI  monitors  service  health,  enable  alerAng,  assist  in  triage  and  ulAmately  root  cause  analysis  

   

SPLUNK  IT  SERVICE  INTELLIGENCE  

Planorm  for  Machine  Data  

Time-­‐series  Index   Schema-­‐on-­‐read   Data  Model   Common  InformaAon  Model  

AT-­‐A-­‐GLANCE  PROBLEM  ANALYSIS  

EARLY  WARNING  ON  DEVIATIONS  

DYNAMIC  SERVICE  MODELS  

SIMPLIFY    INCIDENT  

WORKFLOWS  

Page 11: IT*Service*Intelligence* AtFiserv* - .conf19 | Splunk...Splunk*IT*Service*Intelligence* 10 ITSIis*a Splunk*premium*soluAon*thatenables*us*to*model*our*business*services*and*measure*them*

Splunk  IT  Service  Intelligence  At  Fiserv  

11  

Server-­‐based  to  Services-­‐based  monitoring  

Top-­‐down  and  deep-­‐dive  service  insights  

200+  services  and  1500+  KPIs  monitored  

Flexible  creaAon  and  modificaAon  of  services  and  KPIs  

AlerKng  on  service  KPI’s  instead  of  

server  performance  

Real-­‐Ame,  holisAc  and  proacAve  “client”  view    

Page 12: IT*Service*Intelligence* AtFiserv* - .conf19 | Splunk...Splunk*IT*Service*Intelligence* 10 ITSIis*a Splunk*premium*soluAon*thatenables*us*to*model*our*business*services*and*measure*them*

ConfiguraAon  and  Planning  Tips  Prior to any technical work in Splunk or IT Service Intelligence

•  Understand expectations •  Plan your service hierarchy •  Standards - define services & KPIs •  Understand how your users plan on interacting with IT Service

Intelligence •  End User Training Plan

12  

Page 13: IT*Service*Intelligence* AtFiserv* - .conf19 | Splunk...Splunk*IT*Service*Intelligence* 10 ITSIis*a Splunk*premium*soluAon*thatenables*us*to*model*our*business*services*and*measure*them*

IT  Service  Intelligence  Key  Concepts  Service  –  a  component  of  the  system  that  key  to  business  success.  It  can  be:  

–  An  applicaAon  or  group  of  applicaAons;  –  An  infrastructure  Aer  (such  as  web,  database,  or  network  Aer);  –  A  business  service,  such  as  an  online  marketplace,  which  might  include  mulAple  

infrastructure  components  (web  servers,  databases,  business  applicaAons,  load  balancers,  and  so  on);  

–  A  single  process,  such  as  one  instance  of  an  applicaAon  running  on  a  host.  –  Really  anything  that  you  define  

A  Service  usually  contains  EnAAes  or  is  dependent  on  other  Sub-­‐Services  

13  

Page 14: IT*Service*Intelligence* AtFiserv* - .conf19 | Splunk...Splunk*IT*Service*Intelligence* 10 ITSIis*a Splunk*premium*soluAon*thatenables*us*to*model*our*business*services*and*measure*them*

IT  Service  Intelligence  Key  Concepts  EnAty  

–  EnAty  is  an  IT  component  that  requires  management  in  order  to  deliver  an  service  –  Each  enAty  has  specific  arributes  and  relaAonships  to  other  IT  processes  that  uniquely  

idenAfy  it  –  Examples:  

ê  Server  or  Host  ê  URI  ê  Processes  ê  SoQware  ApplicaAon  

KPI  –  KPI  (or  Key  Performance  Indicator)  is  a  metric  that  defines  the  expectable  behavior  of  a  

service  and  the  threshold  by  which  we  may  learn  of  problems  with  the  service  –  Splunk  assigns  a  Service  Health  Score  (scale  0  to  100)  to  each  Service  based  on  KPIs  

14  

Page 15: IT*Service*Intelligence* AtFiserv* - .conf19 | Splunk...Splunk*IT*Service*Intelligence* 10 ITSIis*a Splunk*premium*soluAon*thatenables*us*to*model*our*business*services*and*measure*them*

IT  Service  Intelligence  Process  Flow  

15  

Page 16: IT*Service*Intelligence* AtFiserv* - .conf19 | Splunk...Splunk*IT*Service*Intelligence* 10 ITSIis*a Splunk*premium*soluAon*thatenables*us*to*model*our*business*services*and*measure*them*

ITSI  Service  Hierarchy  

Client  Centric  (Sub  Service  1)  

CPU  

ApplicaAon  1    (Top  Level  Service)    

System  Centric  (Sub  Service  2)  

Disk   Memory  

ApplicaAon    Log  

SyntheAc    Monitor  Data  

Database    Query   Web  Tier  

(Sub  Service)  AppTier  

(Sub  Service)  DB  Tier  

(Sub  Service)  

16  

Page 17: IT*Service*Intelligence* AtFiserv* - .conf19 | Splunk...Splunk*IT*Service*Intelligence* 10 ITSIis*a Splunk*premium*soluAon*thatenables*us*to*model*our*business*services*and*measure*them*

Service  CreaAon  Services  can  be  created  •  Manually  •  CSV  File  •  Modular  input  

17  

Page 18: IT*Service*Intelligence* AtFiserv* - .conf19 | Splunk...Splunk*IT*Service*Intelligence* 10 ITSIis*a Splunk*premium*soluAon*thatenables*us*to*model*our*business*services*and*measure*them*

Service  Info  

18  

•  We  primarily  used  host  names  or  URLs  for  enAAes  

•  Plan  your  enAAes  ahead  of  Ame!    

•  AQer  saving  you  are  taken  to  KPIs  config…  

Page 19: IT*Service*Intelligence* AtFiserv* - .conf19 | Splunk...Splunk*IT*Service*Intelligence* 10 ITSIis*a Splunk*premium*soluAon*thatenables*us*to*model*our*business*services*and*measure*them*
Page 20: IT*Service*Intelligence* AtFiserv* - .conf19 | Splunk...Splunk*IT*Service*Intelligence* 10 ITSIis*a Splunk*premium*soluAon*thatenables*us*to*model*our*business*services*and*measure*them*
Page 21: IT*Service*Intelligence* AtFiserv* - .conf19 | Splunk...Splunk*IT*Service*Intelligence* 10 ITSIis*a Splunk*premium*soluAon*thatenables*us*to*model*our*business*services*and*measure*them*
Page 22: IT*Service*Intelligence* AtFiserv* - .conf19 | Splunk...Splunk*IT*Service*Intelligence* 10 ITSIis*a Splunk*premium*soluAon*thatenables*us*to*model*our*business*services*and*measure*them*
Page 23: IT*Service*Intelligence* AtFiserv* - .conf19 | Splunk...Splunk*IT*Service*Intelligence* 10 ITSIis*a Splunk*premium*soluAon*thatenables*us*to*model*our*business*services*and*measure*them*

Sevng  Thresholds  

23  

Page 24: IT*Service*Intelligence* AtFiserv* - .conf19 | Splunk...Splunk*IT*Service*Intelligence* 10 ITSIis*a Splunk*premium*soluAon*thatenables*us*to*model*our*business*services*and*measure*them*

WeighAng  

24  

Page 25: IT*Service*Intelligence* AtFiserv* - .conf19 | Splunk...Splunk*IT*Service*Intelligence* 10 ITSIis*a Splunk*premium*soluAon*thatenables*us*to*model*our*business*services*and*measure*them*

Service    Analyzer    

Page 26: IT*Service*Intelligence* AtFiserv* - .conf19 | Splunk...Splunk*IT*Service*Intelligence* 10 ITSIis*a Splunk*premium*soluAon*thatenables*us*to*model*our*business*services*and*measure*them*

26  

Page 27: IT*Service*Intelligence* AtFiserv* - .conf19 | Splunk...Splunk*IT*Service*Intelligence* 10 ITSIis*a Splunk*premium*soluAon*thatenables*us*to*model*our*business*services*and*measure*them*

Building a Glass Table

27  

Page 28: IT*Service*Intelligence* AtFiserv* - .conf19 | Splunk...Splunk*IT*Service*Intelligence* 10 ITSIis*a Splunk*premium*soluAon*thatenables*us*to*model*our*business*services*and*measure*them*

Drill Down

28  

Page 29: IT*Service*Intelligence* AtFiserv* - .conf19 | Splunk...Splunk*IT*Service*Intelligence* 10 ITSIis*a Splunk*premium*soluAon*thatenables*us*to*model*our*business*services*and*measure*them*

ITSI  OpportuniAes                      …and  challenges  

Page 30: IT*Service*Intelligence* AtFiserv* - .conf19 | Splunk...Splunk*IT*Service*Intelligence* 10 ITSIis*a Splunk*premium*soluAon*thatenables*us*to*model*our*business*services*and*measure*them*

ITSI  OpportuniAes  

Speed   we  were  able  to  deliver  service  based  monitoring  in  a  much  shorter  Ame  frame  

Empower  Users  

Able  to  empower  a  Aer  1  user  with  a  tool  kit  to  triage  and  act  as  a  higher  Aer  

Agility   Develop  model  out  of  a  problem  review  to  add  new  KPIs  to  roll  into  the  service  as  a  hole  

Triage   Ability  to  easily  correlate  issues  through  a  drill  down  and  determine  cause  vs  effect  and  then  dive  right  into  the  logs  

30  

Page 31: IT*Service*Intelligence* AtFiserv* - .conf19 | Splunk...Splunk*IT*Service*Intelligence* 10 ITSIis*a Splunk*premium*soluAon*thatenables*us*to*model*our*business*services*and*measure*them*

Challenges  

  Manual  effort  -­‐  100+  services  and  200+  KPIs  (and  growing!)      Standards  -­‐  Define  default  KPIs/Metrics  ahead  of  Ame  and  develop  standards…  if  not  rework  will  be  required  

  Search  Head  &  Indexer  Sizing  –  each  KPI  and  service  increases  the  load  on  the  system  

  Training  and  OperaAonal  AcAviAes  –  new  tool  requires  training  and  ongoing  educaAon  for  the  staff    

 

31  

Page 32: IT*Service*Intelligence* AtFiserv* - .conf19 | Splunk...Splunk*IT*Service*Intelligence* 10 ITSIis*a Splunk*premium*soluAon*thatenables*us*to*model*our*business*services*and*measure*them*

THANK  YOU