Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Big TV Means Big Infrastructure and Big Data (ENT304) | AWS re:Invent 2013


Published on

To support their advanced Xfinity X1 platform and provide services to millions of customers, Comcast maintains physical data centers, but the company is increasingly relying on AWS as well; it plans to maintain both going forward. AWS supplies Comcast with resources on demand so that capacity issues in its brick-and-mortar sites can be more readily managed as part of its high-availability strategy. Comcast also employs AWS as a flexible, cost-effective platform for development and prototyping. Finally, AWS also helps Comcast make effective tactical and strategic use of the huge data streams generated by its customers’ use of its services. In this talk, we trace how Comcast uses AWS to mitigate risk and to open up new technical capabilities.

Published in: Technology, Business

Big TV Means Big Infrastructure and Big Data (ENT304) | AWS re:Invent 2013

  1. 1. Big TV Means Big Infrastructure and Big Data Jacques Louvet, Charlie Hammell, Comcast November 13, 2013 © 2013, Inc. and its affiliates. All rights reserved. May not be copied, modified, or distributed in whole or in part without the express consent of, Inc.
  2. 2. The X1Platform from XFINITY 2
  3. 3. The X1Platform from XFINITY (Video) 3
  4. 4. Comcast Core Backbone 4
  5. 5. Comcast Private Clouds 5
  6. 6. X1 Leased CPE X1 Platform Set Top Box Ramp Target Jan 6 Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  7. 7. Big Data
  8. 8. Millions of STBs DC 1 Head End DC 2 Head End DC 3 Head End DC n
  9. 9. Millions of STBs Backbone Network Cloud Services
  10. 10. Log MB per 48 hrs. 2,500,000 2,500,000 MB per 48 hrs 2,000,000 1,500,000 1,000,000 9,500 500,000 0 April January
  11. 11. Millions of X1 Set Top Boxes File Servers BI Tools
  12. 12. Cost
  13. 13. STB Logging: No Constraints X1 Set Top Boxes S3 Hadoop (EMR) S3 Data Warehouse Oracle Node Oracle Node Oracle Node Oracle Node Node Amazon Redshift BI Tools
  14. 14. No Constraints: Ingest and Storage
  15. 15. No Constraints: Processing Hadoop Map/ Reduce Script S3 S3 Map Worker Node buckets buckets Reduce Worker Node buckets Job Controller Map Worker Node buckets Reduce Worker Node buckets buckets Map Worker Node buckets buckets
  16. 16. No Constraints: Querying AWS Comcast DCs ETL Data Warehouse Oracle S3 Oracle buckets Oracle buckets Oracle buckets Amazon Redshift buckets BI Tools
  17. 17. What Did We Learn?
  18. 18. 60% Savings
  19. 19. What about You?
  20. 20. Please give us your feedback on this presentation ENT304 As a thank you, we will select prize winners daily for completed surveys!