This document provides an overview of scalable storage options in Microsoft Azure, including blobs, tables, and queues. It describes how each storage type can be used and some key features. Blobs provide scalable file-based storage for any type of data. Tables allow storing structured data in tables with entities and properties. Queues provide reliable messaging for communication between applications and distributed processes. Examples and code samples are given to illustrate how to perform common operations like uploading blobs, querying tables, and using queues for producer-consumer workflows.

1.  Brad Calder
Director/Architect
Microsoft Corporation
ES04

2. 


 Scalable Storage



3. 






4. 






 queues, locks, …
 blobs, blocks, …
 tables, caches, …



5. 




Account
Blob Table Queue

6.  Blobs
 Tables
 Queues

7. BlobContainerAccount
sally
pictures
IMG001.JPG
IMG002.JPG
movies MOV1.AVI

8. 









BlobContainerAccount
sally
pictures
IMG001.JPG
IMG002.JPG
movies MOV1.AVI

9. 
blob



 http://sally.blob.core.windows.net/music/rock/rush/xanadu.mp3
BlobContainerAccount
sally
pictures
IMG001.JPG
IMG002.JPG
movies MOV1.AVI

10. 

blob
 PutBlob

 GetBlob

 DeleteBlob






11. 


12. 
10 GB Movie
Windows Azure
Storage
BlockId1
BlockId2
BlockId3
BlockIdN
blobName = “TheBlob.wmv”;
PutBlock(blobName, blockId1, block1Bits);
PutBlock(blobName, blockId2, block2Bits);
…………
PutBlock(blobName, blockIdN, blockNBits);
PutBlockList(blobName,
blockId1,…,blockIdN);
TheBlob.wmvTheBlob.wmv
Benefit:
• Efficient continuation
and retry
• Parallel and out of order
upload of blocks

13. BlockId1
BlockId3
BlockId2
BlobName =
ExampleBlob.wmvBlockId4
BlockId2
BlockId3
BlockId4
BlockId4
Committed and readable version of blob
 Example Uploading
 Blocks Out of Order
 Same Block IDs
 Unused Blocks
 Sequence of Operations
 PutBlock BlockId1
 PutBlock BlockId3
 PutBlock BlockId4
 PutBlock BlockId2
 PutBlock BlockId4
 PutBlockList BlockId2,
BlockId3, BlockId4

14. BlockBlobContainerAccount
sally
pictures
IMG001.
JPG
IMG002.
JPG
movies MOV1.AVI
Block 1
Block 2
Block 3

15. 








16. 







17. PUT
http://dvd.blob.core.windows.net/movies/TheBlob.wmv
?comp=block &blockid=BlockId1 &timeout=60
HTTP/1.1 Content-Length: 4194304
Content-MD5: HUXZLQLMuI/KZ5KDcJPcOA==
Authorization: SharedKey dvd:
F5a+dUDvef+PfMb4T8Rc2jHcwfK58KecSZY+l2naIao=
x-ms-date: Mon, 27 Oct 2008 17:00:25 GMT
……… Block Data Contents ………
Account Container Blob Name

18. PUT
http://dvd.blob.core.windows.net/movies/TheBlob.wmv
?comp=blocklist &timeout=120
HTTP/1.1 Content-Length: 161213
Authorization: SharedKey dvd:
QrmowAF72IsFEs0GaNCtRU143JpkflIgRTcOdKZaYxw=
x-ms-date: Mon, 27 Oct 2008 17:00:25 GMT
<?xml version=“1.0” encoding=“utf-8”?>
<BlockList>
<Block>BlockId1</Block>
<Block>BlockId2</Block>
………………
</BlockList>
Account Container Blob Name

19. GET
http://dvd.blob.core.windows.net/movies/TheBlob.wmv
HTTP/1.1
Authorization: SharedKey dvd:
RGllHMtzKMi4y/nedSk5Vn74IU6/fRMwiPsL+uYSDjY=
X-ms-date: Mon, 27 Oct 2008 17:00:25 GMT
• Get whole blob
GET
http://dvd.blob.core.windows.net/movies/TheBlob.wmv
?timeout=60
HTTP/1.1
Range: bytes=1024000-2048000
• Get a range of the blob

20. 


Container “movies” has:
Action/Rocky.avi
Action/Rocky2.avi
Drama/Crime/GodFather.avi
Drama/Crime/GodFather2.avi
Drama/LordOfRings.avi
Thriller/TheBlob.wmv
List top level “directories”
REST Request:
GET http://dvd.blob.windows.net/movies
?comp=list
&delimiter=/
Results:
<BlobPrefix>Action</BlobPrefix>
<BlobPrefix>Drama</BlobPrefix>
<BlobPrefix>Horror</BlobPrefix>
Container “movies” has:
Action/Rocky1.wmv
Action/Rocky2.wmv
Action/Rocky3.wmv
Action/Rocky4.wmv
Action/Rocky5.wmv
Drama/Crime/GodFather1.wmv
Drama/Crime/GodFather2.wmv
Drama/Memento.wmv
Horror/TheBlob.wmv

21. 


Container “movies” has:
Action/Rocky1.avi
Action/Rocky2.avi
………
Action/Rocky5.avi
Drama/Crime/GodFather1.avi
Drama/Crime/GodFather2.avi
Drama/Gladiator.avi
Horror/TheBlob.wmv
List directory “Drama”:
REST Request:
GET http://dvd.blob.windows.net/movies
?comp=list &prefix=Drama/ &delimiter=/
Results:
<BlobPrefix>Drama/Crime</BlobPrefix>
<Blob>Drama/Memento.wmv</Blob>
Container “movies” has:
Action/Rocky1.wmv
Action/Rocky2.wmv
Action/Rocky3.wmv
Action/Rocky4.wmv
Action/Rocky5.wmv
Drama/Crime/GodFather1.wmv
Drama/Crime/GodFather2.wmv
Drama/Memento.wmv
Horror/TheBlob.wmv

22. Container “movies” has:
Action/Rocky1.wmv
Action/Rocky2.wmv
Action/Rocky3.wmv
Action/Rocky4.wmv
Action/Rocky5.wmv
Drama/Crime/GodFather1.wmv
Drama/Crime/GodFather2.wmv
Drama/Memento.wmv
Horror/TheBlob.wmv



Max Results and Next Marker
REST Request:
GET http://dvd.blob.windows.net/movies
?comp=list &prefix=Action &maxresults=3
Results:
<Blob>Action/Rocky1.wmv</Blob>
<Blob>Action/Rocky2.wmv</Blob>
<Blob>Action/Rocky3.wmv</Blob>
<NextMarker>OpaqueMarker1</NextMarker>

23. 


Using Continuation Marker
REST Request:
GET http://dvd.blob.windows.net/movies
?comp=list &prefix=Action &maxresults=3
&marker=OpaqueMarker1
Results:
<Blob>Action/Rocky4.wmv</Blob>
<Blob>Action/Rocky5.wmv</Blob>
<NextMarker></NextMarker>
Container “movies” has:
Action/Rocky1.wmv
Action/Rocky2.wmv
Action/Rocky3.wmv
Action/Rocky4.wmv
Action/Rocky5.wmv
Drama/Crime/GodFather1.wmv
Drama/Crime/GodFather2.wmv
Drama/Memento.wmv
Horror/TheBlob.wmv

24. 









25. 






26. 
 Tables – Provide structured storage.
A Table is a set of entities, which
contain a set of properties


27. 












28. 










29. 







30. Partition Key
Document
Name
Row Key
Version
Property 3
Modification
Time
….. Property N
Description
Examples Doc V1.0 8/2/2007 ….. Committed version
Examples Doc V2.0.1 9/28/2007 Alice’s working version
FAQ Doc V1.0 5/2/2007 Committed version
FAQ Doc V1.0.1 7/6/2007 Alice’s working version
FAQ Doc V1.0.2 8/1/2007 Sally’s working version
Partition
1
Partition
2



31. 








32. 


Partition Key
Document
Name
Row Key
Version
Property 3
Modification
Time
….. Property N
Description
Examples Doc V1.0 8/2/2007 ….. Committed version
Examples Doc V2.0.1 9/28/2007 Alice’s working version
FAQ Doc V1.0 5/2/2007 Committed version
FAQ Doc V1.0.1 7/6/2007 Alice’s working version
FAQ Doc V1.0.2 8/1/2007 Sally’s working version
Partition
1
Partition
2

33. 





34. Partition Key
Document
Name
Row Key
Version
Property 3
Modification
Time
….. Property N
Description
Examples Doc V1.0 8/2/2007 ….. Committed version
Examples Doc V2.0.1 9/28/2007 Alice’s working version
FAQ Doc V1.0 5/2/2007 Committed version
FAQ Doc V1.0.1 7/6/2007 Alice’s working version
FAQ Doc V1.0.2 8/1/2007 Sally’s working version




Partition
1
Partition
2

35. 









36. 




Partition Key
Document
Name
Row Key
Version
Property 3
Modification
Time
….. Property N
Description
Examples Doc V1.0 8/2/2007 ….. Committed version
Examples Doc V2.0.1 9/28/2007 Alice’s working version
FAQ Doc V1.0 5/2/2007 Committed version
FAQ Doc V1.0.1 7/6/2007 Alice’s working version
FAQ Doc V1.0.2 8/1/2007 Sally’s working version
Partition
1
Partition
2

37. 









38. 











39. 








40. 

[DataServiceKey("PartitionKey", "RowKey")]
public class Customer
{
// Partition key – Customer Last name
public string PartitionKey { get; set; }
// Row Key – Customer First name
public string RowKey { get; set; }
// User defined properties here
public DateTime CustomerSince { get; set; }
public double Rating { get; set; }
public string Occupation { get; set; }
}

41.  “Tables”

 “Tables”
[DataServiceKey("TableName")]
public class TableStorageTable
{
public string TableName { get; set; }
}
TableStorageTable table = new TableStorageTable("Customers");
context.AddObject("Tables", table);
DataServiceResponse response = context.SaveChanges();
// serviceUri is “http://<Account>.table.core.windows.net/”
DataServiceContext context = new DataServiceContext(serviceUri);

42. 
Customer cust = new Customer(
“Lee”, // Partition Key = Last Name
“Geddy”, // Row Key = First Name
DateTime.UtcNow, // Customer Since
2.0, // Rating
“Engineer” // Occupation);
context.AddObject(“Customers”, cust);
DataServiceResponse response = context.SaveChanges();
// Service Uri is “http://<Account>.table.core.windows.net/”
DataServiceContext context = new DataServiceContext(serviceUri);

43. 
DataServiceContext context = new
DataServiceContext(“http://myaccount.table.core.windows.net”);
var customers = from o in
context.CreateQuery<Customer>(“Customers”)
where o.PartitionKey == “Lee”
select o;
foreach (Customer customer in customers) { }
GET http://myaccount.table.core.windows.net/Customers?
$filter= PartitionKey eq ‘Lee’


44. context.DeleteObject(cust);
DataServiceResponse response = context.SaveChanges();
cust.Occupation = “Musician”;
context.UpdateObject(cust);
DataServiceResponse response = context.SaveChanges();
Customer cust = (
from c in context.CreateQuery<Customer> (“Customers”)
where c.PartitionKey == “Lee” // Partition Key = Last Name
&& c.RowKey == “Geddy” // Row Key = First Name
select c)
.FirstOrDefault();

45. 







46. 










47.  Blobs
 Tables
 Queues – Provide reliable storage and
delivery of messages for an application

48. Cloud Storage (blob, table, queue)
Web Role
LB
n
Worker Role
m

49. 





50. 




 queue




51. 









52. 2 1
C1
C2
1234
Producers Consumers
P2
P1
3
2. Dequeue(Q, 30 sec)  msg 2
1. Dequeue(Q, 30 sec)  msg 1
12

53. C1
C2
34
Producers Consumers
P2
P1
1
2
2. Dequeue(Q, 30 sec)  msg 2
3. C2 consumed msg 2
4. Delete(Q, msg 2)
7. Dequeue(Q, 30 sec)  msg 1
1. Dequeue(Q, 30 sec)  msg 1
5. C1 crashed
12 1 6. msg1 visible 30 seconds after Dequeue
Benefit:
• Insures that every
message can be
processed at
least once
3

54. 




56. 

 Future support for geo-distribution and geo-replication






57. 









58. 




 queues, locks, …
 blobs, blocks, …
 tables, caches, …

59. Account
Container Blobs
Table Entities
Queue Messages
http://<account>.blob.core.windows.net/<container>
http://<account>.table.core.windows.net/<table>
http://<account>.queue.core.windows.net/<queue>

60. 





 http://www.azure.com/windows

 http://blogs.msdn.com/astoriateam

61. www.microsoftpdc.com

63. © 2008 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market
conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation.
MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.