für Radioastronomie Max-Planck-Institut Bareos in Radio Astronomy - Scaling up using Virtual Full Backups Bareos in Radio Astronomy – Scaling up using Virtual Full Backups Jan Behrend Max Planck Institute for Radio Astronomy Open Source Backup Conference September 23 rd 2014
29
Embed
Bareos in Radio Astronomy Scaling up using Virtual Full ... · Bareos in Radio Astronomy - Scaling up using Virtual Full Backups ... Open Source Backup Conference ... Jan Behrend
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
für Radioastronomie
Max-Planck-Institut
Bareos in Radio Astronomy - Scaling up using Virtual Full Backups
Bareos in Radio Astronomy –Scaling up using Virtual Full Backups
Jan Behrend
Max Planck Institute for Radio Astronomy
Open Source Backup ConferenceSeptember 23rd 2014
für Radioastronomie
Max-Planck-Institut
Bareos in Radio Astronomy - Scaling up using Virtual Full Backups
OverviewAbout the InstituteBackup Goals and LimitationsThe ChallengeImplementationConfiguraton StrategyVirtual Full BackupsIntegration with DRBDIntegration with REARWishlist
Bareos in Radio Astronomy - Scaling up using Virtual Full Backups
Max Planck Institute for Radio Astronomy
– Founded in 1966– Main Building Bonn / 100m Radio Telescope Effelsberg– Apex Telescope in the Atacama Desert, Chile
– IT staff of 11 people– 204 servers (132 virtualized, 110 Bareos clients)– 64 node cluster– . . .
http://mpifr.de
für Radioastronomie
Max-Planck-Institut
Bareos in Radio Astronomy - Scaling up using Virtual Full Backups
Lofar Antenna Field
“Software” Telescope44 Stations
für Radioastronomie
Max-Planck-Institut
Bareos in Radio Astronomy - Scaling up using Virtual Full Backups
Bareos in Radio Astronomy - Scaling up using Virtual Full Backups
Hardware Infrastructure
FC SAN FC SAN
BACKUPSRV2cold standby
BACKUPSRV1
BACKUP LAN BACKUP LAN
INTRANET BONNINTRANET EFFELSBERG
TAPE LIBRARY 1TAPE LIBRARY 2
8GBit
1GBit
3x10GBit
10GBit 10GBit
SATABEAST (30 TiB)
40km
SATABEAST (30 TiB)
für Radioastronomie
Max-Planck-Institut
Bareos in Radio Astronomy - Scaling up using Virtual Full Backups
Configuration StrategyIncrementals to disk for better restore performanceFulls and Differentials to cheaper tape storagePer client config (DIR and SD) for easier configmanagement:
compression, quota, reservation, encryption ...easy templating for new backup clients
Focus on schedules / retentionDaily backup summary (3rd party tools)Dedicated DB partition· · ·
für Radioastronomie
Max-Planck-Institut
Bareos in Radio Astronomy - Scaling up using Virtual Full Backups
Virtual Full Backups
Reorganizes existing backups to create a new Full
Last Full (2 months ago)FullPool
Last Differential (1 week ago)DiffPool
Incrementals (x days ago)IncrementalPool
New Virtual Full (today)VirtualPool
Subsequent Migration
für Radioastronomie
Max-Planck-Institut
Bareos in Radio Astronomy - Scaling up using Virtual Full Backups
Virtual Full Backups
+++ No backup client interaction!(basically) no backup time limit
– Needs designated pool to avoid lockups– No “MaxFullInterval” config option
für Radioastronomie
Max-Planck-Institut
Bareos in Radio Astronomy - Scaling up using Virtual Full Backups
What is DRBD?
Taken from http://www.drbd.org/home/what-is-drbd
für Radioastronomie
Max-Planck-Institut
Bareos in Radio Astronomy - Scaling up using Virtual Full Backups
Integrating Bareos with HA / DRBD
DRBD volume backed up by HA controlled BAREOS instance
IMAP FailoverIP: 134.104.18.110BAREOS on /REAR enabled
IMAP FailoverIP: 134.104.18.111BAREOS on /REAR enabled
/var/mail on DRBDBAREOS on /var/mailIP: 134.104.18.77...
Bareos in Radio Astronomy - Scaling up using Virtual Full Backups
WishlistIntegration of virtualization solutions on hypervisor levelWrite to more than one destination at onceRolling Spool/DespoolAutomatic spooling when writing to tapeNo copy of jobs using a base job?”MaxFullInterval“ for Virtual Full Backups
für Radioastronomie
Max-Planck-Institut
Bareos in Radio Astronomy - Scaling up using Virtual Full Backups