Data on azure details

Believe it or not !! Database on cloud !!

Pini Krisher DBA TL at etoro (www.etoro.com)@krisherpi

[email protected]

Agenda:What is the Cloud Computing?DATA on the cloud - Pros and consWhat DATA can we put on the cloud?What forms of DATA Services Azure can offer?What DATA can we take from Azure?Other Cloud Solutions

I will work a lot on the portal during the presentation….

Cloud is not 1 huge machine

What is the Cloud Computing?

• Types• SAAS – Software as a service• PAAS – Platform as a service• IAAS – Infrastructure as a service

• Vendors• AWS-Amazon Web Services• Rackspace• Google• HP Cloud• VM Cloud• Microsoft Azure• בזק• Etc….

Azure DATA Centers

6 Data CentersNice movie at:http://www.youtube.com/watch?v=JJ44hEr5DFE

• DATA on the cloud - Pros and cons (in short)• PROS

• Unlimited resources (unlimited!!!!), Data is biggest storage /IO Consumer• Easy to manage• Pay as you go• Scale – UP/DOWN - OUT/IN• Backups• Auto Upgrades• Access from any where • SLA• No Bottlenecks at IT, Finance etc.

• CONS• Compliance• Performance – next slide

• Not pros, not cons :Security, Costs

From PASS Summit 2012 – Main Problems in DB on Cloud

What DATA can we put on the cloud?All data or storage you want!!!

DB’sFilesBI systems

Problems:Compliance Security – is the most important issue – but…Manage Costs – about costs we will show at the end…

• Security on Cloud-security is the primary concern • SSL• IP protection• Isolation of Customer Access• Multi-factor Authentication• Regular Authentication in DB• Internal VPN

FROM AWS Security manager“Security is not just one thing. It’s both an art and a science.” The art he refers to is being able to balance the needs of customers to access information to get business done…with the desire to make sure you protect that which is really important.”You Can Be More Secure In The Cloud Than You Can Be On Premise.

• What forms of DATA Services Azure can offer?

Windows Azure SQL DatabasesSQL Server on VM – RDS in AWSWindows Azure StorageReporting - misleadingHadoop on AzureRecovery

•DATABASES on AZURE

•Windows Azure SQL Databases – PAAS•SQL Server on VM – IAAS•Windows Azure Storage - NoSQL

• SO… When should we use DB’s on Cloud ?• Hybrid – some on private cloud and some on

public.• The high point after IPO• Elections• Shared Data/storage costs/IT costs• No MSFT agreements

SQL Azure (PAAS) :Windows Azure SQL DatabasesWASD

SQL Azure (PAAS)

What is PAAS in DB world?

You can not connect to the serverYou can not manage hardwareYou can not control hardwareNo clusters etc.…So… what DBA’s can do?

Nothing in infrastructure - there are 3 replicas…Applicative work: adding Indexes, short transaction etc.…Performance tuningHigh queries by CPU ,IO etc.…

SQL Azure (PAAS)

Some Usages with SQL AzureLogsRegular DB –has PCILots of small DB’sScale up – increase DB sizeScale out – federationDevops

SQL Azure (PAAS)

Logical structure of SQL Azure Subscription servers DataBasesThey can not talk with each other!!!!!!(Not Serverinstanses DataBases)

Creation of New DBSecurityConnect via SSMSSSMS differencesLimitations

SQL Azure (PAAS)

SO – we have DB what's next?Start working – build tables, insert data, create SP’sCopy DBModify sizeBACKUPS only to blobs!Migrate existing data – how?

WAMW – tool from MSFT – free toolScripts in SSMSDeploy from SSMSBCP’sBacpac – Data Tier Application – to storage and to azureTools like red gate etc.Sync

Queries from SSMS about tuning

MWSSMS

Portal

SQL Azure (PAAS)

Access to SQL Azure - Azure Portal

Create ServerCreate DB – 3 ways (from portal, ssms, vs2012)LocationSize – 1-150 GBSecurityBasic monitoring (monitoring in other tools like Quest)Connection strings from the portalBackups to BLOB Go to

Portal

SQL Azure (PAAS)

Access to SQL Azure - Web Portal

Connect – silver light – to 1 DB or to serverRun T-sqlBasic monitoringQuery plansAdd indexesSee DATAChange schema SQL

Portal

SQL Azure (PAAS)

Features that Supported/not Supported in SQL Azure

Supported:New syntaxAuto UpdatesCopy DBLinked server from local DB’s

Not Supported:Service brokerJobsprofilerCLRReplicationConnections between DB’s in server

SSMS

SQL Azure (PAAS)

• Monitoring – SQL AZURE• Tools• Portals

SQL Azure (PAAS)

DEMO

SQL Server on VM (IAAS)CreateAttach DiskConnect via RDP

Can control the serverCan monitor the server

MonitoringReduce costs

SQL Server on VM (IAAS)

SQL Server on VM (IAAS)

SQL Server on VM (IAAS)

• Monitoring in VM• Via portal

SQL Server on VM (IAAS)

• Inside machine in RDP

SQL Server on VM (IAAS)

DEMO

Azure Storage

Blob – can store any type of file:BackupsImagesVHDAny Files you want – can be secured

MonitoringGeo-Replication

Main portalAzure storage explorer

VS2012

Azure Storage

Q – messagingMonitoring

Main portalAzure storage explorer

VS2012

Azure Storage

Tables Nosql– tools and manage (Azure Storage explorer, VS2012)Store NON relational DATA – no Group by – no JOINSMonitoringGeo-Replication

Main portalAzure storage explorer

VS2012

DEMO

HDINSIGHT – Hadoop on Azure

Any files sitting on ClustersCan be query by PowerShell

Map ReduceHive

Main portal

HDINSIGHT – Hadoop on Azure

• Backup Vault• Hyper-V Recovery manager Vault

Recovery Services

Reduce costs

Price ???Start workingMigrate existing data

DEMO

MarketPlace DATAMarket

Getting a lot of raw dataGetting application to manage dataUse application to see dataHas a lot of API’s

https://datamarket.azure.com/

SOME ARE FREE!!!!

DEMO