ANALYZING BIG DATA                          IS PROGRAMMING                           FOR THE CLOUD                        ...
Data, lots of itDonnerstag, 24. Mai 12
Even in simple datasets, common statistics                    fails - (avg, min, max, distribution)Donnerstag, 24. Mai 12
79 times more CPU power than used                   in Apollo missions on one iPhoneDonnerstag, 24. Mai 12
Why you need big data                         You Are Here !                    Yield                          2010 s   Sy...
Finding clusters, evaluating outliers                        and interpreting white noiseDonnerstag, 24. Mai 12
You are not looking for patterns,                          you are looking for anomaliesDonnerstag, 24. Mai 12
Cloud Computing 1.0                           Is              When the IT guys are finally              able to explain to ...
=Donnerstag, 24. Mai 12
Computation on                            demand                                +                          Pay as you goDo...
Cloud Computing 2.0                         Is             When the IT guys realize              that using this scalable ...
=Donnerstag, 24. Mai 12
go beyond IaaS                             and start                         thinking parallelDonnerstag, 24. Mai 12
andDonnerstag, 24. Mai 12
BASE                         (Basically Available, Soft State, Eventual consistency)                                      ...
How to scale                                 (AWS Example)                     • Do not allocate instances manually       ...
Human Software                     •   Click Workers and Mechanical Turks are not just                         cheap labou...
Old Style (Imperative)                             Programming                     •   Step by step explanation   1       ...
One New Stly (Functional)                     Programming I                     •   Combine results to       1            ...
Functional                                 Programming II                         F ( G ( H ( A,B) , C), D)               ...
Check out my tool list:                         http://www.hcboos.net/100-links/Donnerstag, 24. Mai 12
2 ExamplesDonnerstag, 24. Mai 12
The AMP3 Platform at Senzari.com                         Adaptable Music Parallel Processing PlatformDonnerstag, 24. Mai 12
MARS-o-Matic at arago.de                         Big data based IT modelling and pricing appDonnerstag, 24. Mai 12
Thank You for                          Your TimeDonnerstag, 24. Mai 12
Credits                     • „Big Data Just Beginning to Explode“ by                         CSC http://www.csc.com/insig...
Upcoming SlideShare
Loading in …5
×

Chris Boos, arago AG: Big Data means new programs

644
-1

Published on

Lightning Talk anlässlich des zweiten CloudCamp Frankfurt am 24.5.2012 in der Brotfabrik in Hausen.

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
644
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
4
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Chris Boos, arago AG: Big Data means new programs

  1. 1. ANALYZING BIG DATA IS PROGRAMMING FOR THE CLOUD Chris Boos (@boosc) boos@arago.de CloudCamp Frankfurt 24.5.2012Donnerstag, 24. Mai 12
  2. 2. Data, lots of itDonnerstag, 24. Mai 12
  3. 3. Even in simple datasets, common statistics fails - (avg, min, max, distribution)Donnerstag, 24. Mai 12
  4. 4. 79 times more CPU power than used in Apollo missions on one iPhoneDonnerstag, 24. Mai 12
  5. 5. Why you need big data You Are Here ! Yield 2010 s Systems Thinking Wisdom 2000 s Knowledge Ecology Intelligence 1990 s Knowledge Management Knowledge 1980 s Information Mangement Information 1970 s 1960 s 1950 s Data Processing DataDonnerstag, 24. Mai 12
  6. 6. Finding clusters, evaluating outliers and interpreting white noiseDonnerstag, 24. Mai 12
  7. 7. You are not looking for patterns, you are looking for anomaliesDonnerstag, 24. Mai 12
  8. 8. Cloud Computing 1.0 Is When the IT guys are finally able to explain to business people what they were talking about 20 years ago!Donnerstag, 24. Mai 12
  9. 9. =Donnerstag, 24. Mai 12
  10. 10. Computation on demand + Pay as you goDonnerstag, 24. Mai 12
  11. 11. Cloud Computing 2.0 Is When the IT guys realize that using this scalable ressource also calles for new ways of programmingDonnerstag, 24. Mai 12
  12. 12. =Donnerstag, 24. Mai 12
  13. 13. go beyond IaaS and start thinking parallelDonnerstag, 24. Mai 12
  14. 14. andDonnerstag, 24. Mai 12
  15. 15. BASE (Basically Available, Soft State, Eventual consistency) not ACID (Atomicity, Consistency, Isolation, Durability)Donnerstag, 24. Mai 12
  16. 16. How to scale (AWS Example) • Do not allocate instances manually • Each component needs to be independent • Plan for failure • Actively provoke failureDonnerstag, 24. Mai 12
  17. 17. Human Software • Click Workers and Mechanical Turks are not just cheap labour • They allow programmers to hand tasks to humans they are not able to handle algorithmically • Make use of it to • Do things too complicated for machine learning • Pre populate machine learning spacesDonnerstag, 24. Mai 12
  18. 18. Old Style (Imperative) Programming • Step by step explanation 1 what to do • Explaining WHAT to do rather than RESULTS you want 2 • Always necessary for basic algorithms 3Donnerstag, 24. Mai 12
  19. 19. One New Stly (Functional) Programming I • Combine results to 1 become a program 2 • Allows dynamic 3 distribution • Map-Reduce is only one way of doing it!Donnerstag, 24. Mai 12
  20. 20. Functional Programming II F ( G ( H ( A,B) , C), D) getMusicLikes(getFriends(facebookID) Instead of for i in getFriends(facebookID) getMusicLikes(i)Donnerstag, 24. Mai 12
  21. 21. Check out my tool list: http://www.hcboos.net/100-links/Donnerstag, 24. Mai 12
  22. 22. 2 ExamplesDonnerstag, 24. Mai 12
  23. 23. The AMP3 Platform at Senzari.com Adaptable Music Parallel Processing PlatformDonnerstag, 24. Mai 12
  24. 24. MARS-o-Matic at arago.de Big data based IT modelling and pricing appDonnerstag, 24. Mai 12
  25. 25. Thank You for Your TimeDonnerstag, 24. Mai 12
  26. 26. Credits • „Big Data Just Beginning to Explode“ by CSC http://www.csc.com/insights/flxwd/ 78931-big_data_just_beginning_to_explode • „Social media network connections among twitter users“ by Marc Smith http:// www.flickr.com/photos/marc_smith/ • Asteroid Datasets by Bruce Gary http:// brucegary.net/POVENMIRE/x.htmDonnerstag, 24. Mai 12
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×