Bacula Open Source Project Bacula Systems (professional ... · Bacula Systems SA Page 3 Introduction – Project History • «Bacula» = Backup Dracula It comes by night and sucks

BaculaSystemsSA

Bacula Open Source Project Bacula Systems (professional support)

TheEnterpriseReadyOpenSourceNetworkBackupSolu<on

Kern Sibbald

Page2BaculaSystemsSA

Introduction – What is Bacula?

•  Anetworkbackupsolu<ondesignedfor*BSD,Linux,MacOSX,UnixandWindowssystems

•  Projectgoalsareto:  BackupanyclientfromaPalmtoamainframecomputer

  Provide«Enterprise»featuressimilartothelargestcommercialapplica<onsinanOpenSourcesolu<on

  Assuredatacompa<bilityfor30years(providingthatappropriatehardwareisavailable)

  UseaFreeandOpenSource(GPLv2)license

Page3BaculaSystemsSA

Introduction – Project History

•  «Bacula»=Backup+Dracula  Itcomesbynightandsucksthevitalessencefromyourcomputers.

•  Timeline  January2000–Projectstarted  14April2002–FirstreleasetoSourceForge(version1.16)  29June2006–Release1.38.11  January2007–Release2.0.0  August2007–Release2.2.0  June2008–Release2.4.0  July2009–Currentrelease3.0.2

•  Downloadstodate:(Sep2009)  1,027,109allversions

  6.9TB

Page4BaculaSystemsSA

Bacula Download History

Release 3.0.2

Page5BaculaSystemsSA

Why Backup?

•  HardwareFailureProtec<on

•  UnauthorizedIntrusion(Hackers)

•  VirusProtec<on

•  UserErrorProtec<on

•  ServiceLevelAgreements

•  Legaland/orRegulatoryRequirements

•  BusinessCostofTime/DataLoss

•  DisasterRecovery

Page6BaculaSystemsSA

What is «Backup»?

•  Dataprotec<on  Allfiles

  Databases(MySQL,PostgreSQL,MSSQL,Oracle,DB2,…)

  Applica<ons(E‐mail:MSExchange,Lotus,...)

  Groupwareapplica<ons(LotusNotes,etc.)

  EnterpriseResourcePlanning(ERP)

  CRMandsalesorderentrysystems

  Others…

Page7BaculaSystemsSA

What is «Backup»?

•  Off‐sitebackup  Storingcopiesoff‐site

•  Disasterrecoveryplan(DRP)  BareMetalrecovery

  Serverconfigura<on

  BaculaCatalogdatabase

  Baculabinariesandconfigura<onfiles

  Keypeopletobecontacted

  Loca<onofrecoverymedia

Page8BaculaSystemsSA

What is «Backup»?

•  Archiving  Compliancewithregulatory

requirements

  Businessrequirements

  Longreten<on(7‐30years)

  Guaranteesdataarenotchangedordeleted

  Auditrequirements

Module 1

Page9BaculaSystemsSA

Reflection – Key Questions

•  Doyoudobackups?  No  Yes,Ididonelastmonth  Yes,tarfileseveryweek  Some<mesIrsync...  Yes,CDseveryweek  Iusecustomscripts

•  Haveyouencounteredthetypicalproblems?  Retrievingandrestoring:

•  Howtofindthefilesyouneedtorestore?•  Howtorestoretoapointin<me?•  Whichfilesareonwhichmedium?

  Scalability:•  Couldthesolu<onhandle2000+machines?

  Compliance:•  Canthesolu<onassurethatallgovernmentregula<onsaremet?

Page10BaculaSystemsSA

Introduction – the Bacula Solution

•  OpenSource(GPLv2)

•  Centrallymanaged

•  Networkbackup/restore

•  Mul<‐plarormsupport(*BSD,Linux,MacOSX,UnixWin32,...)

•  Differentmedia(Tape,disk,USB,CD/DVD)

•  Reliable

•  Trackscomprehensivelywhatwasbackedupwhenandwhere

•  Allowsrestora<onofspecificfilesrequired(Catalog+GUI)

•  Restorestoapointin<me

•  Scalestohandle10,000machines

Page11BaculaSystemsSA

What is Bacula?

•  Enterprisebackupsolu<on  Networkbased  CentralizedAdministra<on  Automa<copera<on  Performsbookkeeping  Mul<‐plarorm  Manyhigh‐endfeatures

•  Robustdesignbuiltforhighperformance  Modular  Mul<pleBackupMedia  Customizable  Reliable  RapidRestores  AdvancedRepor<ng,No<fica<on,Monitoring

Page12BaculaSystemsSA

What is Bacula?

•  OpenSource  Zero‐costlicense

  Largecommunityofusersanddevelopers

  Abilitytocustomizetoyourspecificrequirements•  Extensiveconfigura<on

•  ContributetoBaculaProject

  Securityofsolu<onguaranteed•  Usershavethesourcecode

•  Nolicenseaudits

Module 1

Page13BaculaSystemsSA

Architecture – 5 Bacula Components Module 1

Page14BaculaSystemsSA

Architecture – 5 Bacula Components

•  Director(DIR)  Centralizedcontrolandadministra<onforallfunc<ons

  BasicunitisaJob(oneclient,onesetoffiles,...)

  Schedules,ini<atesandsupervisesallJobs

  Maintainsthecatalog(SQLdatabase)

•  Typicalinstalla<on  OneDirectorperBaculainstalla<on

  Excep<on–verylargeenvironmentsthat

requireaddi<onalcoordina<on

Page15BaculaSystemsSA

Architecture – 5 Bacula Components

•  FileDaemonorClient(FD)  Performsfilebackup,restoreandverifica<onrequestedbyDirector

  Installedoneachmachineasaservice(daemon)

  CommunicatesovernetworkwithDirectorandStoragedaemon

  Needsaccesstoallfilestobebackedup(root,SYSTEM)

•  Typicalinstalla<on  Mul<pleFiledaemonsperDirector

•  Oneforeachmachine

6.3

Page16BaculaSystemsSA

Architecture – 5 Bacula Components

•  Storagedaemon(SD)  Readsandwritesdatatothephysicalmedium

  Disk,Tape,CD/DVD,USB,...

  Acceptsordersandauthoriza<onfromtheDirector

  Acceptsandreturnsdatato/fromFiledaemons(FD)

  Sendsfilestorageloca<ontoDirector‐>Catalog

  Supportsmul<pledevicesperSD

•  Typicalinstalla<on  OneSDperDirector

Page17BaculaSystemsSA

Architecture – 5 Bacula Components

•  Console  AllowsuseroradministratortocontrolBacula  CommunicateswithDirectorvianetwork

  Startjobs,reviewJoboutput,query/modifycatalog

•  Consolesavailable  TTY(bconsole)  bataQt4(GUI)–mostcomprehensive

  wxWidgets(GUI)–Linux,Unix,Win32  Mul<plewebinterfaces

•  bweb=mostcomprehensive

  Restrictedconsoles•  Userscanrestoretheirownfiles

Page18BaculaSystemsSA

Architecture – 5 Bacula Components

•  Catalogdatabase  OnlycomponentnotwriuenbyBaculateam

  SQLdatabase(MySQL,PostgreSQL,orSQLite)–unique

  TracksJobsrun,Volumesused,Fileloca<ons,...

  Permitsrapidrestores

  Allowsinquiryofwhenandwherefileswerebackedup

  Olddataautoma<callyprunedbyDirector

  Supportsmul<pledatabasesforscaling

Page19BaculaSystemsSA

Bacula Release Files

•  bacula‐3.0.2.tar.gz  PrimaryBaculasourcecode

release

•  bacula‐docs‐3.0.2.tar.bz2  Prebuiltdocs:HTML

directory,singleHTMLfile,andPDFfile..

•  bacula‐gui‐3.0.2.tar.gz  Non‐coreGUIprograms  bweb  bacula‐web  Bimagemgr

•  programforburningCDROMimageswithBaculaVolumes

•  bacula‐rescue‐3.0.2.tar.gz  BareMetalRecovery  CD‐ROMdepreciated  ReplacedbyUSBkey

•  winbacula‐3.0.2.exe  32‐bitinstallerfor

Windows®client(FileDaemon)

•  win64bacula‐3.0.2.exe  64‐bitinstallerfor

Windows®client(FileDaemon)

Page20BaculaSystemsSA

Bacula Administration Tool (BAT)

•  GUIformofbconsole–withmanyaddi<onalfeatures

•  Keyfeatures  Graphicalrepresenta<onofJobsrunbyBacula

  Abilitytocreatereportsmoreeasilyandquickly

  Sor<ngofrun/failedJobsbyclickingonthecolumnheader

  Contextsensi<vemenuwithreadyaccesstokeyfeatures

Page21BaculaSystemsSA

The BAT Interface

Page22BaculaSystemsSA

The BAT Interface – Job List

Page23BaculaSystemsSA

The BAT Interface – Job Log

Page24BaculaSystemsSA

The BAT Interface – Volume Actions

Page25BaculaSystemsSA

The BAT Interface – Running a Job Module 4

Page26BaculaSystemsSA

The BAT Interface – Restoring Files Module 4

Page27BaculaSystemsSA

Bweb Management Interface

•  Webbasedmanagementtool

•  Keyfeatures  Graphicalrepresenta<onofJobsrunbyBacula

  Abilitydrillintoproblemareas

  Restartfailedjobs

  Pointandclickautochangercontrol

  Volumeloca<ontracking

  Jobgrouping

Page28BaculaSystemsSA

Main Bweb Window

Page29BaculaSystemsSA

Job Log for Failed Job

Page30BaculaSystemsSA

Job Log for Job with Warnings

Page31BaculaSystemsSA

Media View (in Catalog)

Page32BaculaSystemsSA

Autochanger View (in changer)

Page33BaculaSystemsSA

Bacula Reliability

•  Reliabilitydesignedinfromthebeginning

•  Lowlevelmemoryclobberandbufferlosschecking

•  Owncodeforvprinr–avoidsexploits

•  10–20%ofcodecleanedup(refactored)eachrelease

•  Extensiveregressiontes<ng

•  Userregressiontes<ngpostedondashboardnightlyfrommanymachines

Page34BaculaSystemsSA

Bacula Test Dashboard

Page35BaculaSystemsSA

Failed Job

Page36BaculaSystemsSA

Failed Job Details

Page37BaculaSystemsSA

Open Bugs Database

•  Bugsdatabaseopentoeveryone

•  Canfindfixestounusualproblems

•  hup://bugs.bacula.org

Page38BaculaSystemsSA

Bacula Bugs Database

Page39BaculaSystemsSA

Bacula Bugs Database

Page40BaculaSystemsSA

Development Roadmap

•  Version3.0.3bugfixtobereleasedbymid‐October

•  Version3.2.0tobereleasedaxer1January2010

•  New3.2.0features  MaximumConcurrentJobsforDevices

  EnhancementstoAccuratebackup

  Restorefrommul<pleStoragedaemons

  Filededuplica<onwithBaseJobs

  BaculavirtualcatalogfilesystemAPI

  Enhancedtapedrivetes<ngfunc<onality

Page41BaculaSystemsSA

Development Roadmap (cont)

•  New3.2.0features  Disableblockchecksums(performance)

  NewBatfunc<onality

  RestartfailedJobsrecoveringwhatwasalreadysave

  Filedaemondropsrootpermissionbutcanbackupallfiles

Page42BaculaSystemsSA

Future Projects

•  Deduplica<on  BaseJobdeduplica<on  “rsync”toservertree

  Rdiffusingprecomputedhashcodes  Laptopbackup(similartoBackupPC)

•  Archive  Jobskeptforever

  Par<<onedcatalog  Movecatalogdatatoanotherdatabase

•  ManagementConsole(perhapsbweb)  Controlofmul<pleDirectors

•  Writetomul<pleStoragedaemons

Page43BaculaSystemsSA

Resources – Email lists

•  bacula‐users  Generalforumtoaskorrespondtoques<onsaboutBaculafrom

otherusers.•  Allusersareencouragedtosubscribeandpar<cipate

  Signupat:hup://lists.sourceforge.net/lists/lis<nfo/bacula‐users

  Oncesubscribed,sendemailtotheBaculaUsersListat:•  bacula‐[email protected]

•  bacula‐devel  Forcommunica<ondirectlywithdevelopers

  Signupat:hup://lists.sourceforge.net/lists/lis<nfo/bacula‐devel

  Emailaddress:bacula‐[email protected]

Page44BaculaSystemsSA

Typical Open Source Resources

•  Bugsdatabase(hup://bugs.bacula.org)•  BaculaWiki(hup://wiki.bacula.org)•  BaculaEmailLists

  hup://www.bacula.org➯EmailLists

•  Recommended:bacula‐announce  Signupat:

hup://lists.sourceforge.net/lists/lis<nfo/bacula‐announce  Read‐onlylowvolumelistforuserswhowishtobeno<fiedof

importantevents(bugs,newreleases,...)

•  Foremailno<fica<onofnewpackagerelease  Signupat:hup://sourceforge.net/projects/bacula

•  ClickonDownload,thenMonitornexttodesiredpackage

Page45BaculaSystemsSA

Resources – Email lists

•  Recommended:bacula‐bugs(No<fica<onaboutnewbugs)  hup://bugs.bacula.org

  Signupat:hup://lists.sourceforge.net/lists/lis<nfo/bacula‐bugs

•  bacula‐beta(No<fica<onofnewbetareleases)  Signupat:hup://lists.sourceforge.net/lists/lis<nfo/bacula‐beta

•  Bacula‐commits(diffofeachcommittotheSVN)  Normallyusedonlybydevelopers

•  Signupat:hup://lists.sourceforge.net/lists/lis<nfo/bacula‐commits

•  Archives(AvailableonSourceForge,andGmane)  hup://news.gmane.org/search.php?match=bacula

Page46BaculaSystemsSA

Resources

•  Supportop<ons  Professionalsupport–fromBaculaSystemsorauthorizedpartners

  Otherprofessionalsupport

  Freesupport–fromtheBaculacommunity

•  BaculaSystemsSupport  Professionalsupportonafee‐paidbasis:

•  hup://www.baculasystems.com

•  BaculaCommunitySupport

•  Onanas‐availablebasis(users),byemail:  bacula‐[email protected]

Page47BaculaSystemsSA

Bacula Systems Support

•  IfthecodeisfreewhydoIneedasupportcontract?  Insurancepolicyincaseofproblems

  Ticketsystem

  Guaranteedresponsetoques<onsandproblems

  Prioritybugfixing

  Fundeddevelopment

  Configura<onverifica<on

  Advancedinforma<onondevelopmentprojects

  Inputtodevelopmentprojectpriori<es

  DirectcontactwiththeBaculadevelopers

  BaculaEnterpriseEdi<onbinaries

Page48BaculaSystemsSA

Thank You

Bacula Systems SA Rue Galilée 5

CH-1400 Yverdon-les-Bains

Switzerland T: +41 24 420 7890 F: +41 24 420 7891 E: [email protected] W: www.baculasystems.com

French Branch Office Bacula Systems S.A. 18 rue de l'Eglise FR-14440 Douvres La Délivrande France T: +33 (0) 231 97 33 78

German Branch Office Bacula Systems S.A. Sandstrasse 6 DE-49080 Osnabrück Germany T: +49 (0) 541 75 04 24 01