Download to read offline
Uploaded byPini Krisher
Data on azure details
This document discusses putting databases and data on the cloud using Microsoft Azure services. It covers the pros and cons of storing data on the cloud, what types of data can be stored, and the different data services Azure offers like SQL databases, storage, and Hadoop. Specific topics covered include SQL databases on Azure, using SQL Server virtual machines on Azure, Azure storage options, HDInsight for Hadoop, and data recovery services. Demos are provided of the various Azure data services.
More Related Content
Similar to Data on azure details
Data on azure details
- 1. Believe it ornot !! Database on cloud !! Pini Krisher DBA TL at etoro (www.etoro.com) @krisherpi pinik@naya-tech.co.il
- 2. Agenda: What is theCloud Computing? DATA on the cloud - Pros and cons What DATA can we put on the cloud? What forms of DATA Services Azure can offer? What DATA can we take from Azure? Other Cloud Solutions I will work a lot on the portal during the presentation….
- 3. What is theCloud Computing? Cloud is not 1 huge machine
- 4. • Types • SAAS– Software as a service • PAAS – Platform as a service • IAAS – Infrastructure as a service
- 5. • Vendors • • • • • • • • AWS-Amazon WebServices Rackspace Google HP Cloud VM Cloud Microsoft Azure Etc….
- 6. Azure DATA Centers 6Data Centers Nice movie at: http://www.youtube.com/wa tch?v=JJ44hEr5DFE
- 7. • DATA onthe cloud - Pros and cons (in short) • PROS • • • • • • • • • • CONS • • • Unlimited resources (unlimited!!!!), Data is biggest storage /IO Consumer Easy to manage Pay as you go Scale – UP/DOWN - OUT/IN Backups Auto Upgrades Access from any where SLA No Bottlenecks at IT, Finance etc. Compliance Performance – next slide Not pros, not cons :Security, Costs
- 8. From PASS Summit2012 – Main Problems in DB on Cloud
- 9. What DATA canwe put on the cloud? All data or storage you want!!! DB’s Files BI systems Problems: Compliance Security – is the most important issue – but… Manage Costs – about costs we will show at the end…
- 10. • Security onCloud-security is the primary concern • • • • • • SSL IP protection Isolation of Customer Access Multi-factor Authentication Regular Authentication in DB Internal VPN FROM AWS Security manager “Security is not just one thing. It’s both an art and a science.” The art he refers to is being able to balance the needs of customers to access information to get business done…with the desire to make sure you protect that which is really important.” You Can Be More Secure In The Cloud Than You Can Be On Premise.
- 11. • What formsof DATA Services Azure can offer? Windows Azure SQL Databases SQL Server on VM – RDS in AWS Windows Azure Storage Reporting - misleading Hadoop on Azure Recovery
- 13. •DATABASES on AZURE •WindowsAzure SQL Databases – PAAS •SQL Server on VM – IAAS •Windows Azure Storage - NoSQL
- 14. • SO… Whenshould we use DB’s on Cloud ? • Hybrid – some on private cloud and some on public. • The high point after IPO • Elections • Shared Data/storage costs/IT costs • No MSFT agreements
- 15. SQL Azure (PAAS) SQLAzure (PAAS) : Windows Azure SQL Databases WASD
- 16. SQL Azure (PAAS) Whatis PAAS in DB world? You can not connect to the server You can not manage hardware You can not control hardware No clusters etc.… So… what DBA’s can do? Nothing in infrastructure - there are 3 replicas… Applicative work: adding Indexes, short transaction etc.… Performance tuning High queries by CPU ,IO etc.…
- 17. SQL Azure (PAAS) SomeUsages with SQL Azure Logs Regular DB –has PCI Lots of small DB’s Scale up – increase DB size Scale out – federation Devops
- 18. SQL Azure (PAAS) Logicalstructure of SQL Azure Subscription servers DataBases They can not talk with each other!!!!!! (Not Serverinstanses DataBases) Creation of New DB Security Connect via SSMS SSMS differences Limitations
- 19. SQL Azure (PAAS) SO– we have DB what's next? Start working – build tables, insert data, create SP’s Copy DB Modify size BACKUPS only to blobs! Migrate existing data – how? WAMW – tool from MSFT – free tool Scripts in SSMS Deploy from SSMS BCP’s MW Bacpac – Data Tier Application – to storage and to azure Tools like red gate etc. Sync Queries from SSMS about tuning SSMS Portal
- 20. SQL Azure (PAAS) Accessto SQL Azure - Azure Portal Create Server Create DB – 3 ways (from portal, ssms, vs2012) Location Size – 1-150 GB Security Basic monitoring (monitoring in other tools like Quest) Connection strings from the portal Backups to BLOB
- 21. SQL Azure (PAAS) Accessto SQL Azure - Web Portal Connect – silver light – to 1 DB or to server Run T-sql Basic monitoring Query plans Add indexes See DATA Change schema
- 22. SQL Azure (PAAS) Featuresthat Supported/not Supported in SQL Azure Supported: New syntax Auto Updates Copy DB Linked server from local DB’s Not Supported: Service broker Jobs profiler CLR Replication Connections between DB’s in server SSMS
- 23. SQL Azure (PAAS) •Monitoring – SQL AZURE • Tools • Portals
- 24.
- 25. SQL Server onVM (IAAS) SQL Server on VM (IAAS) Create Attach Disk Connect via RDP Can control the server Can monitor the server Monitoring Reduce costs
- 26. SQL Server onVM (IAAS)
- 27. SQL Server onVM (IAAS)
- 28. SQL Server onVM (IAAS) • Monitoring in VM • Via portal
- 29. SQL Server onVM (IAAS) • Inside machine in RDP
- 30.
- 31. Azure Storage Blob –can store any type of file: Backups Images VHD Any Files you want – can be secured Monitoring Geo-Replication Main portal Azure storage explorer VS2012
- 32. Azure Storage Q –messaging Monitoring Main portal Azure storage explorer VS2012
- 33. Azure Storage Tables Nosql–tools and manage (Azure Storage explorer, VS2012) Store NON relational DATA – no Group by – no JOINS Monitoring Geo-Replication Main portal Azure storage explorer VS2012
- 34.
- 35. HDINSIGHT – Hadoopon Azure Any files sitting on Clusters Can be query by PowerShell Map Reduce Hive Main portal
- 36. HDINSIGHT – Hadoopon Azure
- 37. Recovery Services • BackupVault • Hyper-V Recovery manager Vault
- 38.
- 39. Price ??? Start working Migrateexisting data
- 40.
- 41. MarketPlace DATAMarket Getting alot of raw data Getting application to manage data Use application to see data Has a lot of API’s https://datamarket.azure.com/ SOME ARE FREE!!!!
- 43.