© 2012 IBM Corporation
sGE01
To Infinity and Beyond 2012
Big Data Internet Scale Update
John Sing
IBM STG Asia Pacific Tec...
© 2012 IBM Corporation
2
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
2
IBMTECHU...
© 2012 IBM Corporation
3
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
3
IBMTECHU...
© 2012 IBM Corporation
4
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
4
Evaluati...
© 2012 IBM Corporation
5
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
John Sing ...
© 2012 IBM Corporation
7
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Agenda
1. ...
© 2012 IBM Corporation
8
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Part 1: Ex...
© 2012 IBM Corporation
9
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
The nature...
© 2012 IBM Corporation
10
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Humans co...
© 2012 IBM Corporation
11
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Unmanned ...
© 2012 IBM Corporation
12
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
http://ww...
© 2012 IBM Corporation
13
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
We are bu...
© 2012 IBM Corporation
14
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
IBM Predi...
© 2012 IBM Corporation
15
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
IBM Predi...
© 2012 IBM Corporation
16
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
A new cla...
© 2012 IBM Corporation
17
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
McKinsey ...
© 2012 IBM Corporation
18
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Will Big ...
© 2012 IBM Corporation
19
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
GlobalDat...
© 2012 IBM Corporation
20
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Worldwide...
© 2012 IBM Corporation
21
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
End user ...
© 2012 IBM Corporation
22
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Growth of...
© 2012 IBM Corporation
23
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
How Big i...
© 2012 IBM Corporation
24
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Bandwidth...
© 2012 IBM Corporation
25
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Bandwidth...
© 2012 IBM Corporation
26
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
http://wi...
© 2012 IBM Corporation
27
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Large Dat...
© 2012 IBM Corporation
28
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Container...
© 2012 IBM Corporation
29
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
More data...
© 2012 IBM Corporation
30
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
2012: Oth...
© 2012 IBM Corporation
31
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Now….. wh...
© 2012 IBM Corporation
32
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Apple
Her...
© 2012 IBM Corporation
33
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Facebook
...
© 2012 IBM Corporation
34
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Amazon We...
© 2012 IBM Corporation
35
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
What is G...
© 2012 IBM Corporation
36
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Google
Da...
© 2012 IBM Corporation
37
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Google Da...
© 2012 IBM Corporation
38
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Google Da...
© 2012 IBM Corporation
39
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Tradition...
© 2012 IBM Corporation
40
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Part 2: D...
© 2012 IBM Corporation
41
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
With all ...
© 2012 IBM Corporation
42
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Observe: ...
© 2012 IBM Corporation
43
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Disruptiv...
© 2012 IBM Corporation
44
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Disruptiv...
© 2012 IBM Corporation
45
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Disruptiv...
© 2012 IBM Corporation
46
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Disruptiv...
© 2012 IBM Corporation
47
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Mobile wi...
© 2012 IBM Corporation
48
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Cloud-sca...
© 2012 IBM Corporation
49
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
By 2016, ...
© 2012 IBM Corporation
50
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Will Big ...
© 2012 IBM Corporation
51
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Disruptiv...
© 2012 IBM Corporation
52
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
It’s NOT ...
© 2012 IBM Corporation
53
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
It’s NOT ...
© 2012 IBM Corporation
54
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Today, cu...
© 2012 IBM Corporation
55
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Internet-...
© 2012 IBM Corporation
56
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
You want ...
© 2012 IBM Corporation
57
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Part 3: P...
© 2012 IBM Corporation
58
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Big Posit...
© 2012 IBM Corporation
59
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Big Posit...
© 2012 IBM Corporation
60
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Build new...
© 2012 IBM Corporation
61
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Key strat...
© 2012 IBM Corporation
62
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
To succes...
© 2012 IBM Corporation
63
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Apply les...
© 2012 IBM Corporation
64
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
How to ge...
© 2012 IBM Corporation
65
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Feel free...
© 2012 IBM Corporation
66
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Learning ...
© 2012 IBM Corporation
67
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Inter-dis...
© 2012 IBM Corporation
68
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Together,...
© 2012 IBM Corporation
69
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Recommend...
© 2012 IBM Corporation
70
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Applying ...
© 2012 IBM Corporation
71
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Today: tw...
© 2012 IBM Corporation
72
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Today’s t...
© 2012 IBM Corporation
73
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
How to bu...
© 2012 IBM Corporation
74
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
What You ...
© 2012 IBM Corporation
75
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Policy-ba...
© 2012 IBM Corporation
76
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Internet-...
© 2012 IBM Corporation
77
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Internet ...
© 2012 IBM Corporation
78
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Breakdown...
© 2012 IBM Corporation
79
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
construct...
© 2012 IBM Corporation
80
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Google cl...
© 2012 IBM Corporation
81
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Modular D...
© 2012 IBM Corporation
82
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
That’s wh...
© 2012 IBM Corporation
83
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
State of ...
© 2012 IBM Corporation
84
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
IBM inter...
© 2012 IBM Corporation
85
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Analytics...
© 2012 IBM Corporation
86
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
IBM Analy...
© 2012 IBM Corporation
87
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
IBM Big D...
© 2012 IBM Corporation
88
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Governanc...
© 2012 IBM Corporation
89
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Governanc...
© 2012 IBM Corporation
90
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Acknowled...
© 2012 IBM Corporation
91
IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012
sGE01
Light Det...
Upcoming SlideShare
Loading in …5
×

To_Infinity_and_Beyond_2012_Big_Data_Internet_Scale_Update_4Q12_John_Sing

741 views

Published on

This presentation was given at the Australia/New Zealand November 2012 IBM Symposium - it is a 4Q12 supplement to my other mid-2012 presentation "Internet Scale Workloads Data Center Design" which is also here on Slideshare.net. This presentation discusses how unprecedented growth of Big Data is affecting traditional IT industry. We discuss current trends In addressing, managing, and effectively using this massive volume of data for business value. Provides today's IT personnel an entertaining, fast-paced business and IT-oriented update tutorial on 2012 Internet Scale, Big Data - what it is, where it's going. You'll come away with answers to these questions: "What will happen with Big Data and Internet Scale in 2012 and beyond?" "What do I need to know about mobile technology, consumerization of IT, high performance analytics, and data center design?"
"What are innovative IT customers deploying today to provide competitive advantage?"
"What does this mean for my IT infrastructure and my IT staff job skills?" Immediately useful, you'll come away with an up to date Big Picture about modern IT technologies, workloads, innovation, and the job skills that
are already clearly demanded in 2013 and beyond. The messages are universal, and I provide PowerPoint source because of this need for universal dissemination / knowledge of these principles. All I ask is that proper credit is given to me as the original author / compiler / researcher of this information.

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
741
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
22
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Source: IDC's 2011 Enterprise Disk Storage Consumption Model
  • Chart in public domain: IEEE Massive File Storage presentation, author: Bill Kramer, NCSA: http://storageconference.org/2010/Presentations/MSST/1.Kramer.pdf
  • http://www.hawkeyeuav.com/ http://www.gatewing.com/ http://www.sensefly.com/ http://www.aeryon.com/products.html http://www.leptron.com/corporate/products/
  • http://www.geodigital.com/ http://www.profsurv.com/magazine/article.aspx?i=70599Mobile Mapping article http://www.gim-international.com/issues/articles/id1306-Mapping_with_Mobile_Lidar.html http://www.sparpointgroup.com/News/Vol09No37-New-feature-extraction-tool-for-lidar/ http://www.lidarnews.com/PDF/LiDARMagazine_Richardson-PreservingThePast_Vol2No5.pdf http://www.lidarnews.com/content/view/9228/198/ Coordinates and Building Info Mgmt article http://www.southernmapping.com/methodology.php http://www.lidarnews.com/PDF/LiDARMagazine_Amadori-UtilityVegetationManagement_Vol2No5.pdf
  • Chart in public domain: IEEE Massive File Storage presentation, author: Bill Kramer, NCSA: http://storageconference.org/2010/Presentations/MSST/1.Kramer.pdf:
  • Online URL for this video is: http://www.youtube.com/watch?v=_ZyU6po_E74 Blue CRUSH in Memphis, TN & Richmond, VA Blue CRUSH predictive analysis for officer deployment & risk management generated easy-to-read crime maps every four hours Richmond, VA: Violent crime decreased in the first year by 32%, another 40% thereafter, moving Richmond from #5 on the list of the most dangerous US cities to #99 Another great example of using predictive technology is in the City of Richmond. Richmond, Virginia had a significant problem with violent crime. In fact, in one year, they were listed as the 9 th most dangerous large city in the US. And this was not a one time problem. The following year, Richmond increased it’s rank to #5! The city had no interest in becoming the #1 most dangerous city and wanted to do something different… and do it quickly! IBM helped the City of Richmond to analyze its crime data and provide enhanced predictions on the times and locations with the highest probability of crimes. The City was able to align its resources to the areas that were most likely to experience crimes As a result, violent crime decreased in the first year by 32%. And this also wasn’t a 1-time decrease. The following year, violent crime fell another 40% moving Richmond from #5 on the list of the most dangerous US cities to #99. Most cities can’t afford to keep adding new resources. Our goal is to use our resources more effectively in fighting crime and keeping our cities safe. On our smarter planet, technology can help us do that.
  • There is a new class of data rich companies emerging where the company’s value is based on the amount of information it can store and exploit. We call these “hyperscale data companies.” Examples of the hyperscale data companies today are Google, Amazon, and Facebook. In order for these companies to grow revenue and profit, their business models require that be able to store vast amounts of data. As a result, storage becomes a core competence for these companies. We see that over time, companies in various industries will need to collect, store, and exploit very large amounts of data and will move towards becoming hyperscale data companies. Two examples: A large healthcare company currently has 3.5 petabytes of data and is installing new imaging scanners that generate 1 terabyte per session and over 2 ½ petabytes per year. In order to provide high quality healthcare to their patients and offer more services, they will need to store this data for years to come and have that data readily accessible. A large insurance company currently has 20 petabytes of data and grows by over 300 terabytes a month – every month. In addition to using this data to process claims, they want to be able to exploit this data to provide services to other claims processors and to provide services across the healthcare ecosystem.
  • http://www.mckinsey.com/mgi/publications/big_data/index.asp
  • http://www.mckinsey.com/Insights/MGI/Research/Technology_and_Innovation/Big_data_The_next_frontier_for_innovation Free download: Big data: The next frontier for innovation, competition, and productivity https://www.mckinseyquarterly.com/Are_you_ready_for_the_era_of_big_data_2864
  • http://gigaom.com/broadband/worldwide-broadband-demand-speeds-are-zooming/
  • http:// www.akamai.com/stateoftheinternet / http://www.de-c http://en.wikipedia.org/wiki/List_of_Internet_exchange_points_by_size http://www.de-cix.net/about/statistics / IXP statistics traffic – de-cix.net in Frankfurt, the current largest Internet Exchange Point in the world. Nearly 2Tb/sec (200 GB/sec)
  • Source: Independent Analyst Shipment Data, Cisco Analysis, at: http://www.datacenterknowledge.com/archives/2012/10/23/cisco-releases-2nd-annual-global-cloud-index/ http://www.cisco.com/en/US/solutions/collateral/ns341/ns525/ns537/ns705/ns1175/Cloud_Index_White_Paper.html
  • http://wikibon.org/blog/how-big-is-the-world-of-cloud-computing-infographic/
  • Bandwidth: http://www.cisco.com/en/US/solutions/collateral/ns341/ns525/ns537/ns705/ns827/VNI_Hyperconnectivity_WP.html http:// www.akamai.com/stateoftheinternet / Cisco global IP traffic study and forecast: http://www.akamai.com/stateoftheinternet
  • With their corresponding storage, networking, power distribution and cooling, software, and software developers to create all this this
  • http://wikibon.org/blog/wp-content/uploads/2011/10/5-top-data-centers.html
  • http://www.datacenterknowledge.com/special-report-the-worlds-largest-data-centers/largest-data-centers-supernap-microsoft-dft/#supernap http://www.datacenterknowledge.com/special-report-the-worlds-largest-data-centers/largest-data-centers-supernap-microsoft-dft/#quincy
  • http://www.datacenterknowledge.com/special-report-the-worlds-largest-data-centers/largest-data-centers-io-data-centers-microsoft/#phoenixone http://www.datacenterknowledge.com/special-report-the-worlds-largest-data-centers/largest-data-centers-io-data-centers-microsoft/#chicago http://www.datacenterknowledge.com/special-report-the-worlds-largest-data-centers/largest-data-centers-ngd-terremark-qts/#qts http://news.cnet.com/2300-10805_3-10001679.html = Inside Microsoft Container Data Center
  • #1 data center consumes 100 megawatts of power, 2nd-largest power customer for Commonwealth Edison, trailing only Chicago’s O’Hare Airport. http://www.datacenterknowledge.com/special-report-the-worlds-largest-data-centers/largest-data-centers-ngd-terremark-qts/#ngd http://www.datacenterknowledge.com/special-report-the-worlds-largest-data-centers/largest-data-centers-ngd-terremark-qts/#napota http://www.datacenterknowledge.com/special-report-the-worlds-largest-data-centers/worlds-largest-data-center-350-e-cermak/ 10. The SuperNAP, Las Vegas (Switch Communications) 9A and 9B. Microsoft Data Centers in Quincy Washington and San Antonio 8. CH1, Elk Grove Village, Ill. (DuPont Fabros) 7. Phoenix ONE, Phoenix (i/o Data Centers) 6. Microsoft Dublin (Microsoft) 5. Container Data Center, Chicago (Microsoft) 4. NGD Europe, Newport Wales (Next Generation Data) 3. The NAP of the Americas, Miami (Terremark) 2. Metro Technology Center, Atlanta (Quality Technology) 1. 350 East Cermak / Lakeside Technology Center (Digital Realty)
  • http://www-03.ibm.com/press/us/en/pressrelease/36693.wss http://www.datacenterknowledge.com/archives/2012/02/08/tulip-ibm-team-on-huge-data-center-in-india/ http:// www.youtube.com/watch?v =-h5RYflgBcM Amadeus: 1+ billion transactions / day .3 second response time Access to 95% of the worlds airline seats 5000+ servers Powers over 260 websites in 110 countries for over 100 airlines 10 PB of storage Tulip Telecom: Currently largest in AP and 3d largest in world (for now) Nearly 1 M sq feet Co-built with IBM http://www.amadeus.com/blog/16/03/did-you-know-amazing-facts-about-amadeus/ http://www.govtech.com/featured/China-to-Build-Worlds-Largest-Data-Center.html http://www.wired.com/threatlevel/2012/03/ff_nsadatacenter/all/1
  • http://www.fastcompany.com/magazine/160/tech-wars-2012-amazon-apple-google-facebook
  • http://gigaom.com/cloud/apple-launches-icloud-heres-what-powers-it/ http:// www.youtube.com/watch?v =IPNZAvX1yEs http://www.theregister.co.uk/2012/02/21/apple_new_data_center/ http://www.datacenterknowledge.com/archives/2011/05/18/apple-adding-data-center-in-silicon-valley/ http://www.datacenterknowledge.com/the-apple-data-center-faq / Apple purposes for these data centers: iCloud Support Apple’s WW install base of devices Futures: Move Content Delivery Network in-house? Futures: Streaming video? Other Apple data centers: Cork, Ireland Munich, Germany Newark, California Cupertion, Calif
  • http://www.datacenterknowledge.com/archives/2012/04/20/facebooks-north-carolina-data-center-goes-live/ http://www.wired.com/wiredenterprise/2011/12/facebook-data-center/all/1 https:// www.facebook.com/note.php?note_id =469716398919 http://www.datacenterknowledge.com/archives/2011/10/27/facebook-goes-global-with-data-center-in-sweden/ http://wikibon.org/blog/inside-ten-of-the-worlds-largest-data-centers/ http://www.datacenterknowledge.com/archives/2012/02/02/facebooks-1-billion-data-center-network/
  • http://aws.typepad.com/aws/2012/04/amazon-s3-905-billion-objects-and-650000-requestssecond.html http://gigaom.com/cloud/how-big-is-amazon-web-services-bigger-than-a-billion/ http://www.datacenterknowledge.com/archives/2011/06/09/a-look-inside-amazons-data-centers/ http://gigaom.com/cloud/just-how-big-is-the-amazon-cloud-anyway / http://www.economist.com/node/21548487 The focus of Jeff Bezos, CEO / founder of Amazon http:// mvdirona.com/jrh/work / James Hamilton, AWS Vice President and Distinguished Engineer on the Amazon Web Services team where he is focused on infrastructure efficiency, reliability, and scaling.  All his presentations are listed here at this URL.
  • http://www.google.com/about/datacenters/locations/ http://www.google.com/about/datacenters/locations/the-dalles http://www.datacenterknowledge.com/archives/2012/04/13/google-data-center-spending-recedes-to-607m/
  • http://royal.pingdom.com/2008/04/11/map-of-all-google-data-center-locations/ http://www.datacenterknowledge.com/archives/2012/04/13/google-data-center-spending-recedes-to-607m/ A capital expenditure is an investment in a long-term asset, typically physical assets such as buildings or machinery. Google says the majority of its capital investments are for IT infrastructure, including data enters, servers, and networking equipment. In the past the company’s CapEx spending has closely tracked its data center construction projects, each of which requires between $200 million and $600 million in investment.
  • As of Sept 11, 2012, IBM market capitalization is $232B
  • http://liesdamnedliesstatistics.com/2012/05/stats-that-show-why-you-need-a-mobile-first-approach-now.html http://www.digitalbuzzblog.com/2011-mobile-statistics-stats-facts-marketing-infographic By 2014: mobile will be main way of connecting to Internet.   Younger consumers are already doing so, various activities ranging from social media to online shopping are increasing on smartphones. Smartphones are becoming the primary camera for more and more people coinciding with Instagram reaching 50 million users while smartphone users are not only always connected but engage in content snacking as this US report says  In other words, what we consume may not be different but how we consume it, how long for, how they share it and how they view it will be.
  • http:// en.wikipedia.org/wiki/Disruptive_innovation
  • http:// en.wikipedia.org/wiki/Disruptive_innovation
  • http:// en.wikipedia.org/wiki/Disruptive_innovation
  • http:// en.wikipedia.org/wiki/Disruptive_innovation
  • http://www.digitalbuzzblog.com/2011-mobile-statistics-stats-facts-marketing-infographic By 2014: mobile will be main way of connecting to Internet.   Younger consumers are already doing so, various activities ranging from social media to online shopping are increasing on smartphones. Smartphones are becoming the primary camera for more and more people coinciding with Instagram reaching 50 million users while smartphone users are not only always connected but engage in content snacking as this US report says  In other words, what we consume may not be different but how we consume it, how long for, how they share it and how they view it will be.
  • http://mashable.com/2007/07/11/google-maps-mashups-2/ A mashup is a lightweight web application that combines data from more than one source into an integrated and new, useful experience. TaxiWiz Figure out how much a cab ride is likely to cost beforehand by plotting your route in six different cities including New York and San Francisco. From LAX airport to 930 Wilshire Blvd where this conference is taking place; Estimated cost: That cab ride would cost about $42.00. That's roughly $48 with a 15% tip. It is about 17.9 miles. There is a $42.00 flat fare for trips from LAX Airport to Los Angeles. HousingMaps This site is a mashup of Craigslist with Google Maps, providing a listing of housing for rent and for sale in most major cities. The site also includes filters so you can drill down to listings in a specific price range.
  • http://techcrunch.com/2012/02/14/the-number-of-mobile-devices-will-exceed-worlds-population-by-2012-other-shocking-figures/ http://www.cisco.com/en/US/solutions/collateral/ns341/ns525/ns537/ns705/ns827/white_paper_c11-520862.html
  • Online URL for this video is: http://www.youtube.com/watch?v=EdSd32nbtoA
  • http:// en.wikipedia.org/wiki/Disruptive_innovation
  • http://hbswk.hbs.edu/item/7007.html
  • http://www.tatango.com/blog/time-spent-on-mobile-devices-outpaces-newspapers-and-magazines/ Sept 2011
  • Illustrative Cloud examples only No endorsement is implied or expressed
  • Summary: When you break it down even further, IBM has constructed a portfolio of software and solutions with the breadth and depth to meet all of the needs of all organizations today, combined with unique synergies across this portfolio that enable organizations to start with their most pressing needs knowing that they will be able to leverage their skills and investment in future projects to reduce risk, lower costs and achieve faster time to value in meeting the needs of the business. There are multiple “entry-points”, driven by your most pressing needs, that help you start moving down the path for an information-led transformation. (Note: describe this slide from the bottom-up ) When you think about an information-led transformation, you need to ensure that your infrastructure and systems are optimized to handle the various workloads that are demanded of it. Especially today when you are faced with a glut of new information, you need to ensure that relevant information is available, that it is secure and that you are able to retrieve it in a timely manner not only for analytical, operational and transactional systems, but also for regulatory compliance. That is why IBM Software Group and our Systems & Technology Group are working together to provide optimized solutions focused on delivering greater business value to our customers, faster, for increased return on investment. From the new IBM Smart Analytics System, to the new DB2 PureScale for continuous availability, unlimited capacity and application transparency, to the deep integration of System z, IBM has unparalleled expertise in designing and implementing workload optimized systems and services. On top of that infrastructure, there is also the need to ensure that you can bring all of those sources of information together to create a single, trusted view of information from across your business – regardless of whether that information is structured or unstructured – and then manage it over time. From data warehousing, Master Data Management, information integration, and Agile ECM and integrated data management, IBM’s InfoSphere portfolio ensures that organizations will be able to leverage their information over time to drive innovation across their business. And armed with this single-view of your business, you can then look to optimize business processes and drive greater performance across your organization. Decision makers will have the right information, at the right time, in the right context to make better, more informed decisions, and even anticipate new opportunities or counter potential threats more effectively. The Business Analytics and Optimization Platform supports and information-led transformation in that it focuses on establishing well-constructed processes and empowering individuals throughout the organization with pervasive, predictive real-time analytics . From Cognos and the newly acquired SPSS portfolios, organizations can now be more pro-active and predictive in innovating their business.
  • Summary: When you break it down even further, IBM has constructed a portfolio of software and solutions with the breadth and depth to meet all of the needs of all organizations today, combined with unique synergies across this portfolio that enable organizations to start with their most pressing needs knowing that they will be able to leverage their skills and investment in future projects to reduce risk, lower costs and achieve faster time to value in meeting the needs of the business. There are multiple “entry-points”, driven by your most pressing needs, that help you start moving down the path for an information-led transformation. (Note: describe this slide from the bottom-up ) When you think about an information-led transformation, you need to ensure that your infrastructure and systems are optimized to handle the various workloads that are demanded of it. Especially today when you are faced with a glut of new information, you need to ensure that relevant information is available, that it is secure and that you are able to retrieve it in a timely manner not only for analytical, operational and transactional systems, but also for regulatory compliance. That is why IBM Software Group and our Systems & Technology Group are working together to provide optimized solutions focused on delivering greater business value to our customers, faster, for increased return on investment. From the new IBM Smart Analytics System, to the new DB2 PureScale for continuous availability, unlimited capacity and application transparency, to the deep integration of System z, IBM has unparalleled expertise in designing and implementing workload optimized systems and services. On top of that infrastructure, there is also the need to ensure that you can bring all of those sources of information together to create a single, trusted view of information from across your business – regardless of whether that information is structured or unstructured – and then manage it over time. From data warehousing, Master Data Management, information integration, and Agile ECM and integrated data management, IBM’s InfoSphere portfolio ensures that organizations will be able to leverage their information over time to drive innovation across their business. And armed with this single-view of your business, you can then look to optimize business processes and drive greater performance across your organization. Decision makers will have the right information, at the right time, in the right context to make better, more informed decisions, and even anticipate new opportunities or counter potential threats more effectively. The Business Analytics and Optimization Platform supports and information-led transformation in that it focuses on establishing well-constructed processes and empowering individuals throughout the organization with pervasive, predictive real-time analytics . From Cognos and the newly acquired SPSS portfolios, organizations can now be more pro-active and predictive in innovating their business.
  • My presentation on Internet Scale architectures: http://www.slideshare.net/johnsing1/s-bd03-infinitybeyond2internetscaleworkloadsdatacenterdesignv6speaker
  • Understand your company’s and your industry’s Big Data / Modern Analytics initiatives, components, and vision within your environment: To be viewed as a powerful partner and enabler of these workloads Architect how you wish to your platform, people, and infrastructure to grow along these lines Take the daily challenge to be on top of them My presentation on Internet Scale architectures: http://www.slideshare.net/johnsing1/s-bd03-infinitybeyond2internetscaleworkloadsdatacenterdesignv6speaker
  • Think larger than technology Watch the business models, learn and apply Use tools like Lotus Communities, Dropbox, Delicious…. Step by step, intentionally form your own digital worldwide footprint and network of leveraged friends sharing research – Be the change you want your world, company, and career to be The sharing process is what develops your daily sources of research and collaboration I suggest iPhone or Android smart phone ecosystems (because the others don’t really have an equivalent cosystem)
  • Identify your Big Data / new gen workloads / competitors for that workload Many non-traditional competitors for workload Laying out plans to meld / meet / build readiness for: Awareness, platform readiness, accept/intermix connectors, skills, tactics, architectures Resources to help you on this journey
  • Link to enter your email address and then get free copy of this book downloaded: https://www14.software.ibm.com/webapp/iwm/web/signup.do?source=sw-infomgt&S_PKG=500016891&S_CPM=is_bdebook1_biginsightsfp Direct URL to load book (3.5 MB Acrobat Reader file): http://public.dhe.ibm.com/common/ssi/ecm/en/iml14297usen/IML14297USEN.PDF
  • Image courtesy DLB Associates: D. Dyer, “Current trends/challenges in datacenter thermal management—a facilities perspective,” presentation at ITHERM, San Diego, CA, June 1, 2006. “ The Data Center as a Computer: Introduction to Warehouse Scale Computing”, figure 4-1, p.40 Barroso, Holzle http://www.morganclaypool.com/doi/pdf/10.2200/S00193ED1V01Y200905CAC006
  • Image courtesy of ASHRAE http://www.ashrae.org American Society of Heating, Refrigerating and Air-Conditioning Engineers  “ The Data Center as a Computer: Introduction to Warehouse Scale Computing”, figure 5-2, p.49 Barroso, Holzle http://www.morganclaypool.com/doi/pdf/10.2200/S00193ED1V01Y200905CAC006
  • http://www.datacenterknowledge.com/archives/2012/04/20/facebooks-north-carolina-data-center-goes-live/ http://www.wired.com/wiredenterprise/2011/12/facebook-data-center/all/1 https:// www.facebook.com/note.php?note_id =469716398919 http://www.datacenterknowledge.com/archives/2011/10/27/facebook-goes-global-with-data-center-in-sweden/ http://wikibon.org/blog/inside-ten-of-the-worlds-largest-data-centers/ http://www.datacenterknowledge.com/archives/2012/02/02/facebooks-1-billion-data-center-network/
  • http://venturebeat.com/2012/03/26/google-data-centers-use-less-energy/ http://www.google.com/about/datacenters/inside/efficiency/power-usage.html http://www.datacenterknowledge.com/archives/2011/05/10/uptime-institute-the-average-pue-is-1-8/
  • http://www.youtube.com/watch?v=zRwPSFpLX8I
  • http://www.datacenterknowledge.com/special-report-the-worlds-largest-data-centers/largest-data-centers-io-data-centers-microsoft/#phoenixone http://www.datacenterknowledge.com/special-report-the-worlds-largest-data-centers/largest-data-centers-io-data-centers-microsoft/#chicago http://www.datacenterknowledge.com/special-report-the-worlds-largest-data-centers/largest-data-centers-ngd-terremark-qts/#qts http://news.cnet.com/2300-10805_3-10001679.html = Inside Microsoft Container Data Center
  • http://www.datacenterknowledge.com/archives/2012/05/17/cyrusone-going-massively-modular-in-phoenix/ http://www.datacenterknowledge.com/archives/2012/02/06/the-state-of-the-modular-data-center/ http://www.datacenterknowledge.com/archives/2012/01/30/inside-ios-modular-data-center-assembly-line/ IO  has 35 customers using its IO Anywhere modules, who have deployed about 50 modules in the company’s immense data centers in Phoenix and New Jersey. IO customers using modules include Photobucket, Allianz, Avnet, Logicalis and Suntron. Cloud computing provider  Red Cloud , will install 4.5 megawatts of modular capacity at three sites across Australia, demonstrating the remote deployment capability. HP  recently cited momentum for its modular offering, the Portable Optimized Datacenter (POD). Customers who have recently used PODs to expand their IT operations include UCLA, Skoda Power, the Australian government and the city of El Paso, Texas. Modules from  Dell’s Data Center Solutions Group  (DCS) are powering  Bing Maps , the  Janus Supercomputer  at the University of Colorado and a  Tier 5 facility  in Australia, and will populate Dell’s own cloud data center in  Quincy, Washington . Colt  has supplied its factory-built modules to  Verne Global  in Iceland, where they will house servers for managed hosting provider Datapipe, as well as a substantial deployment for systems integrator  Phoenix IT  in London. Modules from  AST Global  have populated a 21-unit  data center park  for a financial customer in Denmark, as well as servers for Opera within the  Thor Data Center  in Iceland. eBay  has used a new modular design for a new data center in  Phoenix , and will also use modules to power the second phase of its major data center near  Salt Lake City . Cloud computing pioneer  Amazon Web Services  is using a modular design known as Perdix to deploy data center capacity at several sites in  central Oregon . Microsoft  has been among the most aggressive in adopting the modular form factor, using it as the building block for major data centers in  Chicago , Washington state ,  Virginia  and  Iowa . Google  was perhaps the first company to use container in a large-scale deployment, using them in a data center  it built in 2005 .
  • Summary: When you break it down even further, IBM has constructed a portfolio of software and solutions with the breadth and depth to meet all of the needs of all organizations today, combined with unique synergies across this portfolio that enable organizations to start with their most pressing needs knowing that they will be able to leverage their skills and investment in future projects to reduce risk, lower costs and achieve faster time to value in meeting the needs of the business. There are multiple “entry-points”, driven by your most pressing needs, that help you start moving down the path for an information-led transformation. (Note: describe this slide from the bottom-up ) When you think about an information-led transformation, you need to ensure that your infrastructure and systems are optimized to handle the various workloads that are demanded of it. Especially today when you are faced with a glut of new information, you need to ensure that relevant information is available, that it is secure and that you are able to retrieve it in a timely manner not only for analytical, operational and transactional systems, but also for regulatory compliance. That is why IBM Software Group and our Systems & Technology Group are working together to provide optimized solutions focused on delivering greater business value to our customers, faster, for increased return on investment. From the new IBM Smart Analytics System, to the new DB2 PureScale for continuous availability, unlimited capacity and application transparency, to the deep integration of System z, IBM has unparalleled expertise in designing and implementing workload optimized systems and services. On top of that infrastructure, there is also the need to ensure that you can bring all of those sources of information together to create a single, trusted view of information from across your business – regardless of whether that information is structured or unstructured – and then manage it over time. From data warehousing, Master Data Management, information integration, and Agile ECM and integrated data management, IBM’s InfoSphere portfolio ensures that organizations will be able to leverage their information over time to drive innovation across their business. And armed with this single-view of your business, you can then look to optimize business processes and drive greater performance across your organization. Decision makers will have the right information, at the right time, in the right context to make better, more informed decisions, and even anticipate new opportunities or counter potential threats more effectively. The Business Analytics and Optimization Platform supports and information-led transformation in that it focuses on establishing well-constructed processes and empowering individuals throughout the organization with pervasive, predictive real-time analytics . From Cognos and the newly acquired SPSS portfolios, organizations can now be more pro-active and predictive in innovating their business.
  • Top layer = consumer , middle = creator of the new programs and the value/insights inside the big data Summary: When you break it down even further, IBM has constructed a portfolio of software and solutions with the breadth and depth to meet all of the needs of all organizations today, combined with unique synergies across this portfolio that enable organizations to start with their most pressing needs knowing that they will be able to leverage their skills and investment in future projects to reduce risk, lower costs and achieve faster time to value in meeting the needs of the business. There are multiple “entry-points”, driven by your most pressing needs, that help you start moving down the path for an information-led transformation. (Note: describe this slide from the bottom-up ) When you think about an information-led transformation, you need to ensure that your infrastructure and systems are optimized to handle the various workloads that are demanded of it. Especially today when you are faced with a glut of new information, you need to ensure that relevant information is available, that it is secure and that you are able to retrieve it in a timely manner not only for analytical, operational and transactional systems, but also for regulatory compliance. That is why IBM Software Group and our Systems & Technology Group are working together to provide optimized solutions focused on delivering greater business value to our customers, faster, for increased return on investment. From the new IBM Smart Analytics System, to the new DB2 PureScale for continuous availability, unlimited capacity and application transparency, to the deep integration of System z, IBM has unparalleled expertise in designing and implementing workload optimized systems and services. On top of that infrastructure, there is also the need to ensure that you can bring all of those sources of information together to create a single, trusted view of information from across your business – regardless of whether that information is structured or unstructured – and then manage it over time. From data warehousing, Master Data Management, information integration, and Agile ECM and integrated data management, IBM’s InfoSphere portfolio ensures that organizations will be able to leverage their information over time to drive innovation across their business. And armed with this single-view of your business, you can then look to optimize business processes and drive greater performance across your organization. Decision makers will have the right information, at the right time, in the right context to make better, more informed decisions, and even anticipate new opportunities or counter potential threats more effectively. The Business Analytics and Optimization Platform supports and information-led transformation in that it focuses on establishing well-constructed processes and empowering individuals throughout the organization with pervasive, predictive real-time analytics . From Cognos and the newly acquired SPSS portfolios, organizations can now be more pro-active and predictive in innovating their business.
  • Top layer = consumer , middle = creator of the new programs and the value/insights inside the big data Summary: When you break it down even further, IBM has constructed a portfolio of software and solutions with the breadth and depth to meet all of the needs of all organizations today, combined with unique synergies across this portfolio that enable organizations to start with their most pressing needs knowing that they will be able to leverage their skills and investment in future projects to reduce risk, lower costs and achieve faster time to value in meeting the needs of the business. There are multiple “entry-points”, driven by your most pressing needs, that help you start moving down the path for an information-led transformation. (Note: describe this slide from the bottom-up ) When you think about an information-led transformation, you need to ensure that your infrastructure and systems are optimized to handle the various workloads that are demanded of it. Especially today when you are faced with a glut of new information, you need to ensure that relevant information is available, that it is secure and that you are able to retrieve it in a timely manner not only for analytical, operational and transactional systems, but also for regulatory compliance. That is why IBM Software Group and our Systems & Technology Group are working together to provide optimized solutions focused on delivering greater business value to our customers, faster, for increased return on investment. From the new IBM Smart Analytics System, to the new DB2 PureScale for continuous availability, unlimited capacity and application transparency, to the deep integration of System z, IBM has unparalleled expertise in designing and implementing workload optimized systems and services. On top of that infrastructure, there is also the need to ensure that you can bring all of those sources of information together to create a single, trusted view of information from across your business – regardless of whether that information is structured or unstructured – and then manage it over time. From data warehousing, Master Data Management, information integration, and Agile ECM and integrated data management, IBM’s InfoSphere portfolio ensures that organizations will be able to leverage their information over time to drive innovation across their business. And armed with this single-view of your business, you can then look to optimize business processes and drive greater performance across your organization. Decision makers will have the right information, at the right time, in the right context to make better, more informed decisions, and even anticipate new opportunities or counter potential threats more effectively. The Business Analytics and Optimization Platform supports and information-led transformation in that it focuses on establishing well-constructed processes and empowering individuals throughout the organization with pervasive, predictive real-time analytics . From Cognos and the newly acquired SPSS portfolios, organizations can now be more pro-active and predictive in innovating their business.
  • http://www.geodigital.com/ http://www.profsurv.com/magazine/article.aspx?i=70599 Mobile Mapping article http://www.gim-international.com/issues/articles/id1306-Mapping_with_Mobile_Lidar.html http://www.lidarnews.com/PDF/LiDARMagazine_Richardson-PreservingThePast_Vol2No5.pdf http://www.lidarnews.com/content/view/9228/198/ Coordinates and Building Info Mgmt article
  • To_Infinity_and_Beyond_2012_Big_Data_Internet_Scale_Update_4Q12_John_Sing

    1. 1. © 2012 IBM Corporation sGE01 To Infinity and Beyond 2012 Big Data Internet Scale Update John Sing IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 Opening video: http://www.youtube.com/watch?v=CxQHwmhJXX4 Opening video
    2. 2. © 2012 IBM Corporation 2 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 2 IBMTECHU.COMIBMTECHU.COM  IBM STG Technical Universities & Conferences web portal  Direct link: ibmtechu.com/nz  KEY FEATURES... – Create a personal agenda using the agenda planner – View the agenda and agenda changes – Use the agenda search to find the sessions and/or – Download presentations – Submit Session and Conference Evaluations
    3. 3. © 2012 IBM Corporation 3 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 3 IBMTECHU.COMIBMTECHU.COM
    4. 4. © 2012 IBM Corporation 4 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 4 Evaluations are Online!Evaluations are Online! IBMTECHU.COM/NZIBMTECHU.COM/NZ sGE01
    5. 5. © 2012 IBM Corporation 5 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 John Sing  31 years of experience with IBM in high end servers, storage, and software – 2009 - Present: IBM Executive Strategy Consultant: IT Strategy and Planning, Enterprise Large Scale Storage, Internet Scale Workloads and Data Center Design, Big Data Analytics, HA/DR/BC – 2002-2008: IBM IT Data Center Strategy, Large Scale Systems, Business Continuity, HA/DR/BC, IBM Storage – 1998-2001: IBM Storage Subsystems Group - Enterprise Storage Server Marketing Manager, Planner for ESS Copy Services (FlashCopy, PPRC, XRC, Metro Mirror, Global Mirror) – 1994-1998: IBM Hong Kong, IBM China Marketing Specialist for High-End Storage – 1989-1994: IBM USA Systems Center Specialist for High-End S/390 processors – 1982-1989: IBM USA Marketing Specialist for S/370, S/390 customers (including VSE and VSE/ESA)  singj@us.ibm.com  IBM colleagues may access my intranet webpage: – http://snjgsa.ibm.com/~singj/  You may follow my daily IT research blog – http://www.delicious.com/atsf_arizona  You may follow me on Slideshare.net: – http://www.slideshare.net/johnsing1  My LinkedIn: – http://www.linkedin.com/in/johnsing
    6. 6. © 2012 IBM Corporation 7 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Agenda 1. Exploiting the Big Opportunity: Data, Data, Data!  Real-time Data Factories  Bandwidth created “The Cloud”  Internet Scale Data Center architectures house internet scale data 2. Disruptive Innovation in Today’s IT World  The Non-Traditional Competitor  The mobile Web 3.0 3. Principles, collaboration for a successful IT Future Inter-disciplinary Inter- Disciplinary
    7. 7. © 2012 IBM Corporation 8 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Part 1: Exploiting the Opportunity: Data! Data! Data! 1. Exploiting the Big Opportunity: Data, Data, Data!  Real-time Data Factories  Bandwidth created “The Cloud”  Internet Scale Data Center Architectures house internet scale data
    8. 8. © 2012 IBM Corporation 9 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 The nature of workloads is rapidly shifting…. Rapid unstructured data growth Unstructured data workloads = Traditional OLTP, database
    9. 9. © 2012 IBM Corporation 10 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Humans collecting useful data on massive scale Chart in public domain: IEEE Massive File Storage presentation, author: Bill Kramer, NCSA: http://storageconference.org/2010/Presentations/MSST/1.Kramer.pdf
    10. 10. © 2012 IBM Corporation 11 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Unmanned Aerial Surveillance (UAS) http://www.hawkeyeuav.com/ , http://www.gatewing.com/ , http://www.sensefly.com/ http://www.aeryon.com/products.html http://www.leptron.com/corporate/products/
    11. 11. © 2012 IBM Corporation 12 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 http://www.gim-international.com/issues/articles/id1306-Mapping_with_Mobile_Lidar.html http://www.sparpointgroup.com/News/Vol09No37-New-feature-extraction-tool-for-lidar/ http://www.lidarnews.com/PDF/LiDARMagazine_Amadori-UtilityVegetationManagement_Vol2No5.pdf Light Detection and Ranging (LiDAR) http://www.southernmapping.com/methodology.php http://www.profsurv.com/magazine/article.aspx?i=70599
    12. 12. © 2012 IBM Corporation 13 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 We are building real-time, integrated stream computing on massive scale n d Inter- Disciplinary Chart in public domain: IEEE Massive File Storage presentation, author: Bill Kramer, NCSA: http://storageconference.org/2010/Presentations/MSST/1.Kramer.pdf
    13. 13. © 2012 IBM Corporation 14 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 IBM Predictive Analytics: Movement in a City •10 minute-ahead volume forecast (blue) vs. actual value (black) •10 minute-ahead speed forecast (blue) vs. actual value (black). Blue line: IBM analytics prediction 10 minutes in advance Black line: actual result
    14. 14. © 2012 IBM Corporation 15 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 IBM Predictive Analytics Ensuring Public Safety: Let’s play video 1st Memphis Blue CRUSH MapMemphis Blue CRUSH Map http://www.youtube.com/watch?v=_ZyU6po_E74  Blue CRUSH predictive analysis for officer deployment & risk management generated easy-to-read crime maps every four hours  Richmond, VA: Violent crime decreased in the first year by 32%, another 40% thereafter, moving Richmond from #5 on the list of the most dangerous US cities to #99
    15. 15. © 2012 IBM Corporation 16 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 A new class of data-rich industries is emerging Today’s Hyperscale Data Companies New business models: company’s value based on amount of information stored, exploited Tomorrow’s Hyperscale Data Companies Aerospace Banking Energy Government Healthcare Insurance Manufacturing Media and Entertainment Retail 3.5 PB in 2010 1 TB CT scanner → 2.5 PB/Year/Scanner 20 PB in 2011 Grow 300 TB per month, every month ExamplesIndustries Healthcare Provider Claims Processor
    16. 16. © 2012 IBM Corporation 17 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 McKinsey Global Report on Big Data – May 2011 Number of Big Data scientists and mgrs needed in USA http://www.mckinsey.com/mgi/publications/big_data/index.asp
    17. 17. © 2012 IBM Corporation 18 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Will Big Data Change the Way We Compete? Already Has! Finance Information Healthcare Ease of capture Value http://www.mckinsey.com/Insights/MGI/Research/Technology_and_Innovation/Big_data_The_next_frontier_for_innovation
    18. 18. © 2012 IBM Corporation 19 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 GlobalDataVolumeinExabytes Sensors (InternetofThings) Multiple sources: IDC,Cisco 100 90 80 70 60 50 40 30 20 10 AggregateUncertainty% VoIP 9000 8000 7000 6000 5000 4000 3000 2000 1000 0 2005 2010 2015 The Big Data opportunity is huge Enterprise Data 2015: # networked devices 2x global population Social Media (video, audio and text) Total # social media accounts > global population.
    19. 19. © 2012 IBM Corporation 20 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Worldwide, Broadband Internet Speeds are Zooming Inter- Disciplinary http://gigaom.com/broadband/worldwide-broadband-demand-speeds-are-zooming/
    20. 20. © 2012 IBM Corporation 21 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 End user average connection speed State of worldwide Internet: average Internet user connection speed End user average connection speed http://www.akamai.com/stateoftheinternet/
    21. 21. © 2012 IBM Corporation 22 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Growth of The Cloud by 2016  Mobile  Geo-locational  Real-time data  Shift to cloud mega-data centers http://www.datacenterknowledge.com/archives/2012/10/23/cisco-releases-2nd-annual-global-cloud-index/ Source:
    22. 22. © 2012 IBM Corporation 23 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 How Big is the World? - 1 http://wikibon.org/blog/how-big-is-the-world-of-cloud-computing-infographic/ This is significant Cheaper 7.1x 5.7x 7.3x Network Storage Admins
    23. 23. © 2012 IBM Corporation 24 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Bandwidth Availability created “The Cloud”…………  Worldwide bandwidth  Pervasive web services delivery model –(i.e. “The Cloud”)  Data centers with massive amounts: –Processors –Storage –Network
    24. 24. © 2012 IBM Corporation 25 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Bandwidth and the Cloud…..  Internet-scale centers…..  Data: –10s / 100s petabytes  Servers: –100,000s ….  Workloads: –Require server clusters of 100s, 1000s, 10,000, more …..
    25. 25. © 2012 IBM Corporation 26 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 http://wikibon.org/blog/wp-content/uploads/2011/10/5-top-data-centers.html
    26. 26. © 2012 IBM Corporation 27 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Large Data Centers in past 2 years 10. SUPERNAP, LAS VEGAS, 407,000 SF 9A and 9B. MICROSOFT QUINCY AND SAN ANTONIO DATA CENTERS, 470,000 S http://www.datacenterknowledge.com/special-report-the-worlds-largest-data-centers/largest-data-centers-supernap-microsoft-dft/#supernap http://www.datacenterknowledge.com/special-report-the-worlds-largest-data-centers/largest-data-centers-supernap-microsoft-dft/#quincy
    27. 27. © 2012 IBM Corporation 28 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Container Data Center Architecture 7. PHOENIX ONE, PHOENIX, ARIZ. 538,000 SF 5. MICROSOFT CHICAGO DATA CENTER, Chicago 700,000 SF 2. QTS METRO DATA CENTER, ATLANTA, 990,000 SF Microsoft’s Chicago Container Data Center http://www.datacenterknowledge.com/special-report-the-worlds-largest-data-centers/largest-data-centers-io-data-centers-microsoft/#phoenixone http://www.datacenterknowledge.com/special-report-the-worlds-largest-data-centers/largest-data-centers-io-data-centers-microsoft/#chicago http://www.datacenterknowledge.com/special-report-the-worlds-largest-data-centers/largest-data-centers-ngd-terremark-qts/#qts
    28. 28. © 2012 IBM Corporation 29 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 More data centers…. 4. NEXT GENERATION DATA EU 3. NAP OF THE AMERICAS, MIAMI, 750,000 SF 1. 350 EAST CERMAK, CHICAGO,
    29. 29. © 2012 IBM Corporation 30 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 2012: Other large world data centers Tulip Telecom, India, Bangalore China to build 6.2 M sq feet data center by 2016 Amadeus, Erding, Germany Utah Data Center, US Govt, 1M sq feet http://www.datacenterknowledge.com/archives/2012/02/08/tulip-ibm-team-on-huge-data-center-in-india/ http://www.youtube.com/watch?v=-h5RYflgBcM
    30. 30. © 2012 IBM Corporation 31 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Now….. what about the web giants?  i.e. Apple, Facebook, Google, Amazon, etc? That’s Big! http://www.fastcompany.com/magazine/160/tech-wars-2012-amazon-apple-google-facebook
    31. 31. © 2012 IBM Corporation 32 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Apple Here’s what powers iCloud, see Jobs at WWDC 2011 iCloud announce (YouTube) Rendering of Apple's new North Carolina Data Center. Credit: Apple Apple Data Center FAQ Maiden, North Carolina 500K sq ft USD $1Billion Apple Data Center Newark, California Under construction: Prineville, Oregon iCloud http://gigaom.com/cloud/apple-launches-icloud-heres-what-powers-it/ http://www.youtube.com/watch?v=IPNZAvX1yEs http://www.theregister.co.uk/2012/02/21/apple_new_data_center/ http://www.datacenterknowledge.com/archives/2011/05/18/apple-adding-data-center-in-silicon-valley/
    32. 32. © 2012 IBM Corporation 33 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Facebook Lulea, Sweden - 290K sq ft (27K sq me http://www.datacenterknowledge.com/archives/2012/04/20/facebooks-north-carolina-data-center-goes-live/ http://www.wired.com/wiredenterprise/2011/12/facebook-data-center/all/1 https://www.facebook.com/note.php?note_id=469716398919
    33. 33. © 2012 IBM Corporation 34 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Amazon Web Services Amazon Web Services 1Q12: 450,000 servers Amazon Perdix Modular Datacenter EC2 17K core, 240 teraflop cluster 42 nd fastest supercomputer in world 450,000 servers 905 billion objects 650K req/sec http://aws.typepad.com/aws/2012/04/amazon-s3-905-billion-objects-and-650000-requestssecond.html http://gigaom.com/cloud/how-big-is-amazon-web-services-bigger-than-a-billion/
    34. 34. © 2012 IBM Corporation 35 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 What is Google? Google is not a search engine Google is a real-time “Data Factory” ecosystem – Defacto organizer of all human internet data – Worldwide Patterns of Life data – Android ingest / output devices • Motorola Wireless acquired $12B – Supporting businesses and ecosystem roles: • Google+, Play, Shop, Books, Gmail, Docs • Voice recognition The history of search engine http://www.wordstream.com/articles/internet-search-engines-history Inter- Disciplinary
    35. 35. © 2012 IBM Corporation 36 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Google Data Centers in 2008:
    36. 36. © 2012 IBM Corporation 37 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Google Data Center Photo Gallery http://www.google.com/about/datacenters/gallery/#/
    37. 37. © 2012 IBM Corporation 38 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Google Data Center CAPEX worldwide  Capital expenditures on datacenters: – 1Q12: USD$ 607M – 2011: USD$ 3.4B – 2010: USD$ 4.0B – 2009: USD$ 809M Each data center between $200M and $600M The Dalles, Oregon http://www.datacenterknowledge.com/archives/2012/04/13/google-data-center-spending-recedes-to-607m/
    38. 38. © 2012 IBM Corporation 39 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Traditional IT vs. Internet Scale Workload Data Center Source: Egan Ford, IBM Distinguished Engineer, Budapest xCL01 OpenStack presentation: http://xmission.com/~egan/cloud/ Source: http://it20.info/2012/02/the-cloud-magic-rectangle-tm/
    39. 39. © 2012 IBM Corporation 40 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Part 2: Disruptive Innovation 2. Disruptive Innovation in Today’s IT World  The Non-Traditional Competitor  Big Data, mobile Web 3.0
    40. 40. © 2012 IBM Corporation 41 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 With all this opportunity……. Why is this Disruptive Change flat-lining traditional consumer PC / desktop manufacturers?  PC / laptop stalwarts  Unsuccessful in shift  To mobile http://gigaom.com/2012/09/01/hp-dell-and-the-paradox-of-the-disrupted/ PC/laptop market value big decreases Cloud / mobile market value *bigger increases* MarketCapitalization
    41. 41. © 2012 IBM Corporation 42 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Observe: how fast mobile internet grows by 2014  By 2014:  Mobile will be main way  Of connecting to Internet Inter- Disciplinary http://www.digitalbuzzblog.com/2011-mobile-statistics-stats-facts-marketing-infographic
    42. 42. © 2012 IBM Corporation 43 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Disruptive Innovation Definition:  Create new market and value  Eventually disrupts existing  Displaces earlier technology Clayton Christensen Harvard Business School http://en.wikipedia.org/wiki/Disruptive_innovation
    43. 43. © 2012 IBM Corporation 44 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Disruptive Innovation  Not “advanced technologies”  Inferior yet “good enough”  Novel combinations  Starts low end  Grows up-market –“low end disruption” Clayton Christensen Harvard Business School http://en.wikipedia.org/wiki/Disruptive_innovation
    44. 44. © 2012 IBM Corporation 45 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Disruptive Innovation  Learn lessons  Watch today’s world Illustrative examples only
    45. 45. © 2012 IBM Corporation 46 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Disruptive Innovation  “Consumerization”  Not just technology  Delivery models (cloud)  Business models  Ecosystems Clayton Christensen Harvard Business School http://en.wikipedia.org/wiki/Disruptive_innovation
    46. 46. © 2012 IBM Corporation 47 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Mobile will affect all business models… Mobile = Geo-locational superfood Real-time analytics http://www.digitalbuzzblog.com/2011-mobile-statistics-stats-facts-marketing-infographic
    47. 47. © 2012 IBM Corporation 48 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Cloud-scale Data Centers required for: Data Supertransformagicability TaxiWiz HousingMaps Source: http://mashable.com/2007/07/11/google-maps-mashups-2/ Weatherbug
    48. 48. © 2012 IBM Corporation 49 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 By 2016, how much mobile data? What kind?  2012: –Mobile-connected devices > # people  2016: –10 billion mobile devices –(world population: 7.3 B) http://www.cisco.com/en/US/solutions/collateral/ns341/ns525/ns537/ns705/ns827/white_paper_c11-520862.html Smartphones 48% Web data, video 70%
    49. 49. © 2012 IBM Corporation 50 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Will Big Data, Internet Cloud data centers, mobile-centric business models affect the way we compete? Implement IT? Yes, it will! Let’s see one more video http://www.youtube.com/watch?v=EdSd32nbtoA
    50. 50. © 2012 IBM Corporation 51 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Disruptive Innovation  Big Data / Cloud on disruptive path  Traditional IT still around but….  Newer technologies disrupt all platforms Clayton Christensen Harvard Business School What will the effect be on your business model? Inter- Disciplinary
    51. 51. © 2012 IBM Corporation 52 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 It’s NOT your Traditional competitors you need worry about Blockbuster 2002: “Online video not viable” “Niche market” 2011: 24 million Netflix customers 2010: Blockbuster files for bankruptcy http://hbswk.hbs.edu/item/7007.html
    52. 52. © 2012 IBM Corporation 53 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 It’s NOT your Traditional competitors you need worry about Illustrative examples only http://www.tatango.com/blog/time-spent-on-mobile-devices-outpaces-newspapers-and-magazines/
    53. 53. © 2012 IBM Corporation 54 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Today, customers have many non-traditional alternatives Traditional alternatives:  Other platforms  Other vendors  Non-traditional alternatives: – The Cloud, the Developing World What will the effect be on your business model?
    54. 54. © 2012 IBM Corporation 55 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Internet-scale application stack summary User Interface Layer Reports, Dashboards, Mashups, Search, Ad hoc reporting, Spreadsheets Analytic Process Layer Real-time computing and analysis, stream computing, entity analytics, data mining, data proximity, content management, text analytics, etc. Infrastructure layer Virtualization, central end to end management, control, deployment on software, server, storage in a geographically dispersed environment Users Security authorization OS software Location of competitive advantage applications. Does all workload balance, redundancy Cloud infrastructure Servers, storage Unstructured data is the growth workload Compute power = visualization layer Data, I/O = analytic layer
    55. 55. © 2012 IBM Corporation 56 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 You want a partner like IBM that covers the entire modern inter-discipline IT stack User Interface Layer Reports, Dashboards, Mashups, Search, Ad hoc reporting, Spreadsheets Analytic Process Layer Real-time computing and analysis, stream computing, entity analytics, data mining, data proximity, content management, text analytics, etc. Infrastructure layer Virtualization, central end to end management, control, deployment on software, server, storage in a geographically dispersed environment Users Security authorization STG Virtualization IBM Software Group Big Insights InfoStreams IBM Cloud infrastructureSTG Servers, Storage IBM Analytics IBM SWG, Services IBM SWG, Services
    56. 56. © 2012 IBM Corporation 57 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Part 3: Principles for a successful IT Future Plans Meld / meet / build readiness Use, exploit, thrive
    57. 57. © 2012 IBM Corporation 58 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Big Positioning picture Traditional IT Storagereq’d:GB,TB,PB $/server,storage Data Warehouse Big Data, Internet scale Traditional IT Data Warehouse Big Data, Internet scale
    58. 58. © 2012 IBM Corporation 59 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Big Positioning picture Traditional IT Storagereq’d:GB,TB,PB $/server.stroage Data Warehouse Traditional IT Data Warehouse Current IT architectures Growth areas Mobile, Cloud Growth areas Mobile, Cloud Big Data Internet scale Big Data Internet scale Current IT architectures
    59. 59. © 2012 IBM Corporation 60 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Build new, different skill sets Traditional IT Storagereq’d:GB,TB,PB $/server,storage Data Warehouse Big Data Internet scale Traditional IT Data Warehouse Big Data Internet scale Current IT architectures Traditional IT workload Highly parallelized internet scale architecture Integrated E2E software centric Current IT architectures
    60. 60. © 2012 IBM Corporation 61 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Key strategy $/server,storage Traditional IT Data Warehouse Big Data Internet scale Current IT architectures Traditional IT architectures Internet scale architectures  Continue modernize current traditional IT … Architect new-gen connectors, skills Architect future expandability  Connect with – New generation mobile-enabled workloads http://www.slideshare.net/johnsing1/s-bd03-infinitybeyond2internetscaleworkloadsdatacenterdesignv6speaker
    61. 61. © 2012 IBM Corporation 62 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 To successfully co-exist / thrive with new generation workloads  Understand Big Data / new gen workload environment  Successfully innovate new capabilities  Expand your understanding  Be the change you want your company to be $/server Traditional IT Data Warehouse Big Data Internet scale Views new gen as powerful partner Traditional IT architectures Internet scale architectures Views traditional IT as powerful enabler http://www.slideshare.net/johnsing1/s-bd03-infinitybeyond2internetscaleworkloadsdatacenterdesignv6speaker
    62. 62. © 2012 IBM Corporation 63 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Apply lessons from today to Traditional IT as best possible Source: Egan Ford, IBM Distinguished Engineer, OpenStack presentation: http://xmission.com/~egan/cloud/ Source: http://it20.info/2012/02/the-cloud-magic-rectangle-tm/
    63. 63. © 2012 IBM Corporation 64 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 How to get ahead and thrive in this new world?  2012: devote 1st hour of day to keeping current –No longer optional  Establish power-knowledge digital footprint, intelligently sharing what you find –Don’t email what you find (too much email already) –Use social networking, social bookmarking, blogs, etc  Become a power user of your smartphone’s ecosystem Inter- Disciplinary
    64. 64. © 2012 IBM Corporation 65 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Feel free to use me as a resource John Sing’s bookmarks   My external sources, daily IT research: – http://delicious.com/atsf_arizona – http://www.linkedin.com/in/johnsing – http://www.slideshare.net/johnsing1  IBM colleagues may also see my IBM Intranet webpage: – http://snjgsa.ibm.com/~singj/ – http://snjgsa.ibm.com/~singj/public/sonas_index.html  singj@us.ibm.com
    65. 65. © 2012 IBM Corporation 66 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Learning Points 1. Exploitation of the opportunity: Data, Data, Data!  Is being done in real-time Data Factories on internet scale today  Bandwidth will continue to create “The Cloud”  Understand and study how Internet Scale Data Center architectures house internet scale data 2. Hyper-pace of Disruptive Innovation in Today’s IT World  Beware the Non-Traditional Competitor  The Mobile Web 3.0 is already impacting all business models 3. Invest your 1st hour of every day in being a part of the future  Be the change you want your company to be Inter-disciplinary Inter- Disciplinary
    66. 66. © 2012 IBM Corporation 67 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Inter-disciplinary Disruptive Innovation: Greatest opportunity to thrive we have yet seen $/server Traditional IT Data Warehouse Big Data Internet scale Current IT Traditional IT Internet scale workloads New gen workloads Identify inter-disciplinary new generation big data workloads, business models Know non-traditional competitors well Develop / implement to meld, meet, use, exploit, thrive with new reality Inter- disciplinary Exascale datacenters  Massive parallelism  E2E automation Mobile Big Data Applications Cloud Business Models Inter- Disciplinary
    67. 67. © 2012 IBM Corporation 68 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Together, let’s build a Smarter Planet
    68. 68. © 2012 IBM Corporation 69 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Recommend you download, read, this very informative IBM book  “Understanding Big Data” – Published April 2012 – Free download – Well worth reading to understand components of Big Data, and how to exploit  Part 1: The Big Deal about Big Data – Chapter 1 – What is Big Data? Hint: You’re a Part of it Every Day – Chapter 2 – Why Big Data is Important – Chapter 3 – Why IBM for Big Data  Part II: Big Data: From the Technology Perspective – Chapter 4 - All About Hadoop: The Big Data Lingo Chapter – Chapter 5 – IBM InfoSphere Big Insights – Analytics for “At Rest” Big Data – Chapter 6 – IBM InfoSphere Streams – Analytics for “In Motion” Big Data http://public.dhe.ibm.com/common/ssi/ecm/en/iml14297usen/IML14297USEN.PDF Download your free copy here
    69. 69. © 2012 IBM Corporation 70 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Applying the lessons from Internet-scale Cloud Computing to the Traditional data center
    70. 70. © 2012 IBM Corporation 71 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Today: two different types of IT Source: http://it20.info/2012/02/the-cloud-magic-rectangle-tm/ Internet scale wkloadsTransactional IT
    71. 71. © 2012 IBM Corporation 72 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Today’s two major IT workload types Source: http://it20.info/2012/02/the-cloud-magic-rectangle-tm/ Transactional IT Internet scale wkloads
    72. 72. © 2012 IBM Corporation 73 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 How to build these two different clouds Source: http://it20.info/2012/02/the-cloud-magic-rectangle-tm/ Transactional IT Internet scale wkloads
    73. 73. © 2012 IBM Corporation 74 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 What You (Consumer) Get with These Clouds: Source: http://it20.info/2012/02/the-cloud-magic-rectangle-tm/
    74. 74. © 2012 IBM Corporation 75 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Policy-based Traditional IT Clouds and Design-for-fail Internet Clouds are purpose optimized Infrastructure Management solutions  Policy-based Clouds • Purpose optimized for longer-lived virtual machines managed by Server Administrator • Centralizes enterprise server virtualization administration tasks • High degree of flexibility designed to accommodate virtualization all workloads • Significant focus on managing availability and QoS for long-lived workloads with level of isolation • Characteristics derived from exploiting enterprise class hardware • Legacy applications  Design-for-fail Clouds • Purpose optimized for shorter-term virtual machines managed via end-user or automated process • Decentralized control, embraces eventual consistency, focus on making “good enough” decisions • High degree of standardization • Significant focus on ensuring availability of control plane • Characteristics driven by software • New applications
    75. 75. © 2012 IBM Corporation 76 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Internet-scale warehouse-level cloud data center What’s biggest cost-savings element?
    76. 76. © 2012 IBM Corporation 77 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Internet Scale data center power components… Image courtesy of DLB Associates: D. Dyer, “Current trends/challenges in datacenter thermal management—a facilities perspective,”presentation at ITHERM, San Diego, CA, June 1, 2006. “The Data Center as a Computer: Introduction to Warehouse Scale Computing”, figure 4-1, p.40 Barroso, Holzle http://www.morganclaypool.com/doi/pdf/10.2200/S00193ED1V01Y200905CAC006
    77. 77. © 2012 IBM Corporation 78 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Breakdown of data center energy overheads Image courtesy of ASHRAE “The Data Center as a Computer: Introduction to Warehouse Scale Computing”, figure 5-2, p.49 Barroso, Holzle http://www.morganclaypool.com/doi/pdf/10.2200/S00193ED1V01Y200905CAC006 Chiller alone is 33% of the cost UPS alone is 18% of construction cost Physical cooling, UPS dominates the electrical power cost
    78. 78. © 2012 IBM Corporation 79 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 construction cost of Internet Scale Data Center is Power / Cooling Facebook’s North Carolina Data Center Goes Live Facebook: Lulea, Sweden - 29 Facebook – Prinville , Oregon Has spent $1B on it’s data centers Open Compute Project ? Reducing power profile reduces construction cost
    79. 79. © 2012 IBM Corporation 80 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Google claims its data centers use 50% less energy than competitors  Power Usage Effectiveness – PUE=1.14 means power overhead is only 14% – Industry average is around 1.8 http://venturebeat.com/2012/03/26/google-data-centers-use-less-energy/ Industry average PUE is about 1.8 http://www.datacenterknowledge.com/archives/2011/05/10/uptime-institute-the-average-pue-is-1-8/
    80. 80. © 2012 IBM Corporation 81 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Modular Data Center Value isn’t just time to delivery / flexibility It’s also Higher Power density = lower construction cost http://www.youtube.com/watch?v=zRwPSFpLX8I
    81. 81. © 2012 IBM Corporation 82 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 That’s why you see such a big modern push on Container Data Centers: 7. PHOENIX ONE, PHOENIX, ARIZ. 538,000 SF 5. MICROSOFT CHICAGO DATA CENTER, Chicago 700,000 SF 2. QTS METRO DATA CENTER, ATLANTA, 990,000 SF Microsoft’s Chicago Container Data Center
    82. 82. © 2012 IBM Corporation 83 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 State of the Modular Data Center Cyrus One 1 million sq ft “Massively Modular” data center under construction in Phoenix, Arizona I/O Modular Data Center Assembly line http://www.datacenterknowledge.com/archives/2012/05/17/cyrusone-going-massively-modular-in-phoenix/ http://www.datacenterknowledge.com/archives/2012/02/06/the-state-of-the-modular-data-center/ http://www.datacenterknowledge.com/archives/2012/01/30/inside-ios-modular-data-center-assembly-line/ Mismatch between rapid workload churn vs. 10+ year data center lifespan = modular data center characteristics strategic possibilities for new build data centers
    83. 83. © 2012 IBM Corporation 84 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 IBM internet-scale modern application stack: User Interface Layer Reports, Dashboards, Mashups, Search, Ad hoc reporting, Spreadsheets Analytic Process Layer Real-time computing and analysis, stream computing, entity analytics, data mining, data proximity, content management, text analytics, etc. Infrastructure layer Virtualization, central end to end management, control, deployment on software, server, storage in a geographically dispersed environment Users Security authorization User interface
    84. 84. © 2012 IBM Corporation 85 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Analytics layer User Interface Layer Reports, Dashboards, Mashups, Search, Ad hoc reporting, Spreadsheets Analytic Process Layer Real-time computing and analysis, stream computing, entity analytics, data mining, data proximity, content management, text analytics, etc. Infrastructure layer Virtualization, central end to end management, control, deployment on software, server, storage in a geographically dispersed environment Users Security authorization Analytics
    85. 85. © 2012 IBM Corporation 86 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 IBM Analytics layer User Interface Layer Reports, Dashboards, Mashups, Search, Ad hoc reporting, Spreadsheets Analytic Process Layer Real-time computing and analysis, stream computing, entity analytics, data mining, data proximity, content management, text analytics, etc. Infrastructure layer Virtualization, central end to end management, control, deployment on software, server, storage in a geographically dispersed environment Users Security authorization Big Data Accelerators Open Source Foundation Components Big Data Enterprise Engines Productivity Tools and Optimization InfoSphere BigInsightsInfoSphere Streams Applications Text Image/Video Financial Times Series Statistics Mining Geospatial Mathematical Workload Management and Optimization Consumability and Management Tools IBM Analytics
    86. 86. © 2012 IBM Corporation 87 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 IBM Big Data Reference Architecture 87 Big Data Accelerators Eclipse Oozie Hadoop HBase Pig Lucene Jaql Open Source Foundation Components Big Data Enterprise Engines Productivity Tools and Optimization InfoSphere BigInsightsInfoSphere Streams Connectors Applications Blueprints Text Image/Video Financial Times Series Statistics Mining Geospatial Mathematical Acoustic Workload Management and Optimization Client and Partner Solutions IBM Big Data Solutions Consumability and Management Tools Data Growth Management InfoSphere Optim Database DB2 Data Warehouse InfoSphere Warehouse Master Data Management InfoSphere MDM Warehouse Appliance IBM Netezza Marketing IBM Unica Content Analytics ECM Business Analytics Cognos & SPSS InforSphereInformationServer
    87. 87. © 2012 IBM Corporation 88 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Governance Security, Resiliency & Performance Cloud Service Provider Common Cloud Management Platform (CCMP) Operational Support Services (OSS) Operational Support Services (OSS) Cloud Services Infrastructure-as-a-ServiceInfrastructure-as-a-Service Platform-as-a-ServicePlatform-as-a-Service Software-as-a-ServiceSoftware-as-a-Service Business-Process- as-a-Service Business-Process- as-a-Service Partner CapabilitiesPartner Capabilities Business Support Services (BSS) Business Support Services (BSS) Cloud Service Integration Tools Consumer In-house IT Cloud Service Integration Tools Cloud Service Integration Tools Consumer In-house IT Consumer In-house IT Service Creation Tools Service Creation Tools InfrastructureInfrastructure Getting Cloud Right -- IBM Reference Architecture Whitepaper Open Group Document IBM’s Cloud Service Reference Architecture
    88. 88. © 2012 IBM Corporation 89 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Governance Security, Resiliency, Performance & Consumability Cloud Service Creator Cloud Service ProviderCloud Service Consumer Cloud Services IaaS PaaS SaaS BPaaS Common Cloud Management Platform Cloud Service Integration Tools Consumer In- house IT Infrastructure Middleware Applications Business Processes OSS – OperationalSupport Services BSS – Business Support Services Subscription Management Pricing Entitlement Management Metering Rating Billing Clearing & Settlement Accounts Payable Accounts Receivable Customer Account Management Service Offering Catalog Service Offering Management Contracts & Agreement Management Service Request Management Order Management Transition Manager Deployment Architect Operations Manager Service Provider Portal & API Consumer Administrator Consumer Business Manager Consumer End user Service Creation Tools Service Management Development Tools Service Runtime Development Tools Software Development Tools Image Creation Tools Service Component Developer Infrastructure Security & Risk Manager Customer Care Service Manager Business Manager Service Composer Offering Manager Service Integrator ServiceManagement ServiceConsumerPortal&API ServiceDevelopmentPortal&API API API API API Existing & 3rd party services, Partner Ecosystems Provisioning Incident & Problem Management IT Service Level Management Service Automation Management Service Delivery Catalog Service Request Management Change & Configuration Management Image Lifecycle Management Monitoring & Event Management IT Asset & License Management Capacity & Performance Management Platform & Virtualization Management Infrastructure MgmtInterfaces PlatformMgmt Interfaces SoftwareMgmt InterfacesBPMgmtInterfaces Management Architecture
    89. 89. © 2012 IBM Corporation 90 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Acknowledgements, disclaimers and trademarks Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries. IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency which is now part of the Office of Government Commerce. Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries. Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both. ITIL is a registered trademark, and a registered community trademark of the Office of Government Commerce, and is registered in the U.S. Patent and Trademark Office. UNIX is a registered trademark of The Open Group in the United States and other countries. Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates. Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc. in the United States, other countries, or both and is used under license therefrom. Linear Tape-Open, LTO, the LTO Logo, Ultrium, and the Ultrium logo are trademarks of HP, IBM Corp. and Quantum in the U.S. and other countries. Other product and service names might be trademarks of IBM or other companies. Information is provided "AS IS" without warranty of any kind. The customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer. Information concerning non-IBM products was obtained from a supplier of these products, published announcement material, or other publicly available sources and does not constitute an endorsement of such products by IBM. Sources for non-IBM list prices and performance numbers are taken from publicly available information, including vendor announcements and vendor worldwide homepages. IBM has not tested these products and cannot confirm the accuracy of performance, capability, or any other claims related to non-IBM products. Questions on the capability of non-IBM products should be addressed to the supplier of those products. All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only. Some information addresses anticipated future capabilities. Such information is not intended as a definitive statement of a commitment to specific levels of performance, function or delivery schedules with respect to any future products. Such commitments are only made in IBM product announcements. The information is presented here to communicate IBM's current investment and development activities as a good faith effort to help with our customers' future planning. Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve throughput or performance improvements equivalent to the ratios stated here. Prices are suggested U.S. list prices and are subject to change without notice. Starting price may not include a hard drive, operating system or other features. Contact your IBM representative or Business Partner for the most current pricing in your geography. Photographs shown may be engineering prototypes. Changes may be incorporated in production models. © IBM Corporation 2012. All rights reserved. References in this document to IBM products or services do not imply that IBM intends to make them available in every country. Trademarks of International Business Machines Corporation in the United States, other countries, or both can be found on the World Wide Web at http://www.ibm.com/legal/copytrade.shtml.
    90. 90. © 2012 IBM Corporation 91 IBM STG Asia Pacific Technical Symposia – Auckland | New Zealand | November 2012 sGE01 Light Detection and Ranging (LiDAR)

    ×