Per aspera ad grid To the grid computing through difficulties

707 views
651 views

Published on

my last grid talk from 2009 at Lund Univ.

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
707
On SlideShare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Per aspera ad grid To the grid computing through difficulties

  1. 1. Per aspera ad grid To the grid computing through difficulties Ferenc Szalai [email_address]
  2. 2. I am physicist
  3. 3. 16 (1995)
  4. 4. fuzzy thermal manikin chaotic fuzzy controllers granular material N-Body simulation bioconvetion (3D navier-stokes) plasmas evolution virtual screening (drog research)
  5. 6. I need more computation power!
  6. 7. motivation
  7. 8. 1998
  8. 9. Welcome to Geekland!
  9. 10. Large Linux clusters
  10. 11. PVM (parallel virtual machine) MPI (message passing interface)
  11. 12. 20%
  12. 13. 2000
  13. 15. What is grid computing?
  14. 16. Developing middleware which schedule computational intensive tasks on heterogeneous resources
  15. 17. grid middleware Resource Resource Resource
  16. 19. No modification required
  17. 20. No central component
  18. 21. Globus (the Windows ™ of grid computing) Globus Globus
  19. 22. Problems
  20. 23. user authentication missing libraries not running scripts resource discovery hard to deploy and maintain obscure protocols description of job/resource scheduling
  21. 24. Me vs Globus
  22. 25. 2002
  23. 26. “Everybody have own grid”
  24. 27. TeraGrid EuroGrid Nordugrid LHC Grid -> EGEE Hungarian Cluster Grid ...
  25. 28. and a money come
  26. 29. “Everybody have own grid middleware”
  27. 30. Babel of protocols
  28. 31. Standardization
  29. 32. GGF -> OGF (global/open grid forum)
  30. 33. Web services
  31. 34. SOAP
  32. 35. POST /InStock HTTP/1.1 Host: www.example.org Content-Type: application/soap+xml; charset=utf-8 Content-Length: nnn <?xml version=&quot;1.0&quot;?> <soap:Envelope xmlns:soap=&quot;http://www.w3.org/2001/12/soap-envelope&quot; soap:encodingStyle=&quot;http://www.w3.org/2001/12/soap-encoding&quot;> <soap:Body xmlns:m=&quot;http://www.example.org/stock&quot;> <m:GetStockPrice> <m:StockName> IBM </m:StockName> </m:GetStockPrice> </soap:Body> </soap:Envelope>
  33. 36. Its about syntax
  34. 37. 2004
  35. 38. EGEE -> glite
  36. 39. too many overlapping components running only on old linuxes slow, unrealible hard to deploy and maintain hard to use
  37. 40. ARC
  38. 41. Standard Based Modular Secure Simple Elegant
  39. 42. (bicycle repairman )
  40. 43. 2006
  41. 44. Boinc (“desktop grid”)
  42. 45. Master - Slave
  43. 46. It is not a grid!
  44. 47. Pilot job is evil!
  45. 48. Developing middleware which schedule computational intensive tasks on heterogeneous resources
  46. 49. “ Houston we have a problem”
  47. 50. 1, 2, 3, 5, 8, 13
  48. 51. What about DATA?
  49. 52. store access index find transfer convert ...
  50. 53. latency
  51. 54. There is no working distributed large scale storage system
  52. 56. Data cache Storage system
  53. 57. 2007-2009
  54. 58. Job should go to the DATA
  55. 59. MapReduce
  56. 61. virtualization
  57. 62. Cloud computing
  58. 63. Resource as a Service
  59. 64. Cloud Virtual Resource
  60. 65. grid middleware Resource Resource Resource
  61. 66. Cloud Virtual Resource Virtual Resource Grid middleware
  62. 67. Take away
  63. 69. Grid is here
  64. 70. But not good for everything

×