Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Final presentasi gnome asia

559 views

Published on

Presentation in GNOME Asia 2015 which focus in the topic of "In Memory Computing" with the tittle An Overview, Maximize the Ability of The GNU/LINUX Operating System using In Memory Computation for Academic, Business and Government.
This paper are mainly focus in moving the root file system from storage device into memory (RAM) device, minimizing bottleneck and maximizing performance, benchmarking and a little snippet script how to do that.

  • Be the first to comment

  • Be the first to like this

Final presentasi gnome asia

  1. 1. An Overview, Maximize The Ability of The GNU/Linux Operating System Using "In Memory Computation" for Academic, Business and Government Anton Siswo Raharjo Ansori
  2. 2. A little of Myself Member of KLAS (Komunitas Linux Arek Suroboyo) 2008 - Now Lecturer at Telkom University March, 2015 Born : May, 11th 1987 Live in Bandung, Come from Pasuruan Mobile Number : +6282233932728 Email : raharjo@telkomuniversity.ac.id masgandhul@gmail.com
  3. 3. Who had done it Using application which whole processing is in memory Using General OS More and More Company Image from http://www.welltech.in.ua/images/Linux_Family.jpg
  4. 4. Who had done it
  5. 5. Who had done it
  6. 6. Who had done it
  7. 7. Who had done it
  8. 8. Example
  9. 9. Let's talk about In Memory Computing What is it? Why we need it? Where it can be applied? Cost reduction and calculation Computer Component Network Topology with and Without HDD How we build it What next research Technical Specs Benchmarking Live and Video Demo
  10. 10. What is In Memory Computing
  11. 11. What is In Memory Computing Whole OS in Memory
  12. 12. What is In Memory Computing All OS Processes
  13. 13. What is In Memory Computing Critical Process Only
  14. 14. What is In Memory Computing Become Storage as HDD
  15. 15. What is In Memory Computing Whole OS in Memory All OS Processes Critical Process Only Become Storage as HDD OR
  16. 16. What is In Memory Computing Put simply, in-memory computing primarily relies on keeping data in a server's RAM as a means of processing at faster speeds. In-memory computing especially applies to processing problems that require extensive access to data–analytics, reporting or data warehousing, and big data applications. -- IBM --
  17. 17. Put it Simply
  18. 18. Put it Simply Whole OS in Memory
  19. 19. Put it Simply Whole OS in Memory
  20. 20. Put it Simply Intention? Whole OS in Memory
  21. 21. Put it Simply Get the maximum performance with the minimum bottleneck Intention? Whole OS in Memory
  22. 22. CONS of In Memory Computing (1) At this moment: ● Not yet implemented Data Sync between “HOST” and “In Memory” computer ● Temporary file system – data loss at electricity failure –
  23. 23. CONS of In Memory Computing (2) ● Limited Disk at max memory capacity in 16GB for single Notebook ● Mounting local disk manually
  24. 24. Why we need it ● Better, faster, decision making. This includes the ability to reduce cost, identify competitive opportunities, grow revenue, become more efficient and reduce risk. -- IBM -- ● General and Specific Purposes ● System for Realtime processing
  25. 25. Why we need it Green Technology Easier Maintenance Less Electricity, Less temperature Minimum Drive and OS Error
  26. 26. Areas which need the most Bottleneck of Storage, Memory and Processor in : – Computing – Intensive tasks – Databases
  27. 27. Where it can be applied Academic
  28. 28. Where it can be applied Business
  29. 29. Where it can be applied Government
  30. 30. Where it can be applied Software Developer
  31. 31. Where it can be applied Academic Business Government Software Developer Business
  32. 32. More specific purposes ● In daily activity ● In research for HPC areas ● Lower cost and greener Labs ● In Public computer at campus
  33. 33. More specific purposes ● For business which need realtime processing ● For handling big data processing ● Using in memory computing to minimize hardware maintenance and cost reduction
  34. 34. More specific purposes ● Faster compiling ● Testing system ● Developing ● Benchmarking
  35. 35. Common Computer Component
  36. 36. Common Computer Network Topology with HDD Computer Computer Computer Computer
  37. 37. Common Computer Network Topology with HDD Computer switch Computer Computer Computer
  38. 38. Common Computer Network Topology with HDD switch Server Server Server
  39. 39. Common Computer Network Topology with HDD Computer switch Server Computer Computer Computer Server Server
  40. 40. Proposed Computer Network Topology For Non Storage Drive
  41. 41. Computer Computer Computer Computer
  42. 42. Computer Computer Computer Computer switch
  43. 43. Computer Server For Non-Storage Client Computer Computer Computer switch
  44. 44. Computer switch Server For Non-Storage Client Computer Computer Computer switch
  45. 45. Computer switch Server For Non-Storage Client Computer Computer Computer Server Web Server Datacenter switch
  46. 46. What next is Benchmarking
  47. 47. Phoronix Benchmarking Disk Suite Processor Suite Memory Suite
  48. 48. Benchmarking MemoryHDD
  49. 49. Benchmarking SQLite Fail HDD PHORONIX-TEST-SUITE.COMMB/s, More Is Better AIO-Stress v0.21 Random Write disk-51 700 1400 2100 2800 3500 SE +/- 84.95 3076.56 Phoronix Test Suite 5.6.0 1. (CC) gcc options: -pthread -laio PHORONIX-TEST-SUITE.COMSeconds, Less Is Better SQLite v3.7.3 12,500 INSERTs disk-51 300 600 900 1200 1500 SE +/- 51.27 1420.52 Phoronix Test Suite 5.6.0 1. (CC) gcc options: -O2 -ldl -lpthread PHORONIX-TEST-SUITE.COMMB/s, More Is Better AIO-Stress v0.21 Test: Random Write aio-stress-mem 1200 2400 3600 4800 6000 SE +/- 50.86 5450.16 Phoronix Test Suite 5.6.0 1. (CC) gcc options: -pthread -laio Memory
  50. 50. PHORONIX-TEST-SUITE.COMFiles/s, More Is Better FS-Mark v3.3 1000 Files, 1MB Size disk-51 6 12 18 24 30 SE +/- 0.43 23.23 Phoronix Test Suite 5.6.0 1. (CC) gcc options: -static Benchmarking MemoryHDD PHORONIX-TEST-SUITE.COMFiles/s, More Is Better FS-Mark v3.3 Test: 4000 Files, 32 Sub Dirs, 1MB Size fs-mark-mem 1000 2000 3000 4000 5000 SE +/- 20.48 4871.33 Phoronix Test Suite 5.6.0 1. (CC) gcc options: -static
  51. 51. PHORONIX-TEST-SUITE.COMMB/s, More Is Better Dbench v4.0 48 Clients disk-51 20 40 60 80 100 SE +/- 1.15 82.23 Phoronix Test Suite 5.6.0 1. (CC) gcc options: -lpopt -O2 PHORONIX-TEST-SUITE.COMMB/s, More Is Better Dbench v4.0 128 Clients disk-51 20 40 60 80 100 SE +/- 1.27 97.14 Phoronix Test Suite 5.6.0 1. (CC) gcc options: -lpopt -O2 PHORONIX-TEST-SUITE.COMMB/s, More Is Better Dbench v4.0 Client Count: 256 dbench-mem 1500 3000 4500 6000 7500 SE +/- 38.13 7176.82 Phoronix Test Suite 5.6.0 1. (CC) gcc options: -lpopt -O2 PHORONIX-TEST-SUITE.COMMB/s, More Is Better Dbench v4.0 12 Clients disk-51 11 22 33 44 55 SE +/- 0.13 48.62 Phoronix Test Suite 5.6.0 1. (CC) gcc options: -lpopt -O2
  52. 52. PHORONIX-TEST-SUITE.COMMB/s, More Is Better IOzone v3.405 8GB Read Performance disk-51 2000 4000 6000 8000 10000 SE +/- 88.67 8136.12 Phoronix Test Suite 5.6.0 1. (CC) gcc options: -O3 PHORONIX-TEST-SUITE.COMMB/s, More Is Better IOzone v3.405 8GB Write Performance disk-51 20 40 60 80 100 SE +/- 0.29 82.65 Phoronix Test Suite 5.6.0 1. (CC) gcc options: -O3 PHORONIX-TEST-SUITE.COMMB/s, More Is Better IOzone v3.405 Record Size: 1MB - File Size: 8GB - Disk Test: Read Performance iozone-mem 2000 4000 6000 8000 10000 SE +/- 18.54 8598.22 Phoronix Test Suite 5.6.0 1. (CC) gcc options: -O3 PHORONIX-TEST-SUITE.COMMB/s, More Is Better IOzone v3.405 Record Size: 1MB - File Size: 8GB - Disk Test: Write Performance iozone-mem 1100 2200 3300 4400 5500 SE +/- 44.10 5299.84 Phoronix Test Suite 5.6.0 1. (CC) gcc options: -O3
  53. 53. PHORONIX-TEST-SUITE.COMMB/s, More Is Better Threaded I/O Tester v0.3.3 64MB Random Read - 32 Threads disk-51 3000 6000 9000 12000 15000 SE +/- 86.29 15038.89 Phoronix Test Suite 5.6.0 PHORONIX-TEST-SUITE.COMMB/s, More Is Better Threaded I/O Tester v0.3.3 64MB Random Write - 32 Threads disk-51 0.1215 0.243 0.3645 0.486 0.6075 SE +/- 0.00 0.54 Phoronix Test Suite 5.6.0 PHORONIX-TEST-SUITE.COMMB/s, More Is Better Threaded I/O Tester v0.3.3 Test: Random Read - Size Per Thread: 256MB - Thread Count: 32 thread-io-test-mem 3000 6000 9000 12000 15000 SE +/- 213.59 13907.61 Phoronix Test Suite 5.6.0
  54. 54. PHORONIX-TEST-SUITE.COMMB/s, More Is Better Compile Bench v0.6 Test: Initial Create disk-51 70 140 210 280 350 SE +/- 7.65 303.04 Phoronix Test Suite 5.6.0 PHORONIX-TEST-SUITE.COMMB/s, More Is Better Compile Bench v0.6 Test: Read Compiled Tree disk-51 200 400 600 800 1000 SE +/- 0.15 955.16 Phoronix Test Suite 5.6.0 PHORONIX-TEST-SUITE.COMMB/s, More Is Better Compile Bench v0.6 Test: Compile disk-51 130 260 390 520 650 SE +/- 1.05 584.58 Phoronix Test Suite 5.6.0 In Memory side - Failure
  55. 55. PHORONIX-TEST-SUITE.COMSeconds, Less Is Better Unpacking The Linux Kernel linux-2.6.32.tar.bz2 disk-51 3 6 9 12 15 SE +/- 0.12 9.07 Phoronix Test Suite 5.6.0 PHORONIX-TEST-SUITE.COMTPS, More Is Better PostMark v1.51 Disk Transaction Performance disk-51 1200 2400 3600 4800 6000 SE +/- 38.33 5396 Phoronix Test Suite 5.6.0 1. (CC) gcc options: -O3 PHORONIX-TEST-SUITE.COMSeconds, Less Is Better Unpacking The Linux Kernel linux-2.6.32.tar.bz2 unpack-kernel-mem 2 4 6 8 10 SE +/- 0.02 8.90 Phoronix Test Suite 5.6.0 PHORONIX-TEST-SUITE.COMTPS, More Is Better PostMark v1.51 Disk Transaction Performance postmark-mem 2000 4000 6000 8000 10000 SE +/- 95.67 8429 Phoronix Test Suite 5.6.0 1. (CC) gcc options: -O3
  56. 56. Benchmarking HDD PHORONIX-TEST-SUITE.COMSeconds, Less Is Better Gzip Compression 2GB File Compression disk-51 3 6 9 12 15 SE +/- 0.64 13.57 Phoronix Test Suite 5.6.0 PHORONIX-TEST-SUITE.COMRequests Per Second, More Is Better Apache Benchmark v2.4.7 Static Web Page Serving disk-51 8000 16000 24000 32000 40000 SE +/- 632.92 39242.25 Phoronix Test Suite 5.6.0 1. (CC) gcc options: -shared -fPIC -O2 -pthread PHORONIX-TEST-SUITE.COMSeconds, Less Is Better Gzip Compression 2GB File Compression gzip-mem 3 6 9 12 15 SE +/- 0.01 12.95 Phoronix Test Suite 5.6.0 PHORONIX-TEST-SUITE.COMRequests Per Second, More Is Better Apache Benchmark v2.4.7 Static Web Page Serving apache-mem 9000 18000 27000 36000 45000 SE +/- 66.56 41255.76 Phoronix Test Suite 5.6.0 1. (CC) gcc options: -shared -fPIC -O2 -pthread
  57. 57. Benchmarking Memory Suite in HDD and Memory Suite in Memory
  58. 58. PHORONIX-TEST-SUITE.COMMB/s, More Is Better RAMspeed SMP v3.5.0 Integer Add mem-suite-test 3000 6000 9000 12000 15000 SE +/- 0.00 13818.12 Phoronix Test Suite 5.6.0 PHORONIX-TEST-SUITE.COMMB/s, More Is Better RAMspeed SMP v3.5.0 Integer Copy mem-suite-test 3000 6000 9000 12000 15000 SE +/- 0.00 14320.51 Phoronix Test Suite 5.6.0 PHORONIX-TEST-SUITE.COMMB/s, More Is Better RAMspeed SMP v3.5.0 Integer Add mem-suite-mem 3000 6000 9000 12000 15000 SE +/- 0.00 13813.87 Phoronix Test Suite 5.6.0 PHORONIX-TEST-SUITE.COMMB/s, More Is Better RAMspeed SMP v3.5.0 Integer Copy mem-suite-mem 3000 6000 9000 12000 15000 SE +/- 0.00 14221.83 Phoronix Test Suite 5.6.0
  59. 59. PHORONIX-TEST-SUITE.COMMB/s, More Is Better RAMspeed SMP v3.5.0 Integer Scale mem-suite-test 3000 6000 9000 12000 15000 SE +/- 0.00 14288.12 Phoronix Test Suite 5.6.0 PHORONIX-TEST-SUITE.COMMB/s, More Is Better RAMspeed SMP v3.5.0 Floating-Point Add mem-suite-test 3000 6000 9000 12000 15000 SE +/- 0.00 15690.93 Phoronix Test Suite 5.6.0 PHORONIX-TEST-SUITE.COMMB/s, More Is Better RAMspeed SMP v3.5.0 Integer Scale mem-suite-mem 3000 6000 9000 12000 15000 SE +/- 0.00 14202.47 Phoronix Test Suite 5.6.0 PHORONIX-TEST-SUITE.COMMB/s, More Is Better RAMspeed SMP v3.5.0 Floating-Point Add mem-suite-mem 3000 6000 9000 12000 15000 SE +/- 0.00 15538.87 Phoronix Test Suite 5.6.0
  60. 60. PHORONIX-TEST-SUITE.COMMB/s, More Is Better Stream v2013-01-17 Add mem-suite-test 3000 6000 9000 12000 15000 SE +/- 7.76 16334.69 Phoronix Test Suite 5.6.0 1. (CC) gcc options: -O3 -march=native -fopenmp PHORONIX-TEST-SUITE.COMMB/s, More Is Better Stream v2013-01-17 Copy mem-suite-test 3000 6000 9000 12000 15000 SE +/- 9.10 14579.18 Phoronix Test Suite 5.6.0 1. (CC) gcc options: -O3 -march=native -fopenmp PHORONIX-TEST-SUITE.COMMB/s, More Is Better Stream v2013-01-17 Add mem-suite-mem 3000 6000 9000 12000 15000 SE +/- 17.77 16215.08 Phoronix Test Suite 5.6.0 1. (CC) gcc options: -O3 -march=native -fopenmp PHORONIX-TEST-SUITE.COMMB/s, More Is Better Stream v2013-01-17 Copy mem-suite-mem 3000 6000 9000 12000 15000 SE +/- 11.72 14462.49 Phoronix Test Suite 5.6.0 1. (CC) gcc options: -O3 -march=native -fopenmp
  61. 61. PHORONIX-TEST-SUITE.COMMB/s, More Is Better Stream v2013-01-17 Scale mem-suite-test 3000 6000 9000 12000 15000 SE +/- 6.20 14485.59 Phoronix Test Suite 5.6.0 1. (CC) gcc options: -O3 -march=native -fopenmp PHORONIX-TEST-SUITE.COMMB/s, More Is Better CacheBench Read Cache mem-suite-test 600 1200 1800 2400 3000 SE +/- 3.99 2785.24 Phoronix Test Suite 5.6.0 1. (CC) gcc options: -lrt PHORONIX-TEST-SUITE.COMMB/s, More Is Better Stream v2013-01-17 Scale mem-suite-mem 3000 6000 9000 12000 15000 SE +/- 13.77 14357.91 Phoronix Test Suite 5.6.0 1. (CC) gcc options: -O3 -march=native -fopenmp PHORONIX-TEST-SUITE.COMMB/s, More Is Better CacheBench Read Cache mem-suite-mem 600 1200 1800 2400 3000 SE +/- 0.14 2791.91 Phoronix Test Suite 5.6.0 1. (CC) gcc options: -lrt
  62. 62. PHORONIX-TEST-SUITE.COMMB/s, More Is Better CacheBench Write Cache mem-suite-test 3000 6000 9000 12000 15000 SE +/- 11.08 14896.86 Phoronix Test Suite 5.6.0 1. (CC) gcc options: -lrt PHORONIX-TEST-SUITE.COMMB/s, More Is Better CacheBench Write Cache mem-suite-mem 3000 6000 9000 12000 15000 SE +/- 7.20 14910.62 Phoronix Test Suite 5.6.0 1. (CC) gcc options: -lrt
  63. 63. Benchmarking MemoryHDD mem-suite RAMspeed SMP RAMspeed SMP RAMspeed SMP RAMspeed SMP Stream Stream Stream CacheBench CacheBench mem-suite-test 13818.12 14320.51 14288.12 15690.93 16334.69 14579.18 14485.59 2785.24 14896.86 PHORONIX-TEST-SUITE.COM mem-suite-mem RAMspeed SMP RAMspeed SMP RAMspeed SMP RAMspeed SMP Stream Stream Stream CacheBench CacheBench mem-suite-mem 13813.87 14221.83 14202.47 15538.87 16215.08 14462.49 14357.91 2791.91 14910.62 PHORONIX-TEST-SUITE.COM
  64. 64. Processor Benchmarking Memory HDD PHORONIX-TEST-SUITE.COMSeconds, Less Is Better Smallpt v1.0 Global Illumination Renderer; 100 Samples smalpt 20 40 60 80 100 SE +/- 1.15 104 Phoronix Test Suite 5.6.0 1. (CXX) g++ options: -fopenmp PHORONIX-TEST-SUITE.COMSeconds, Less Is Better Smallpt v1.0 Global Illumination Renderer; 100 Samples smalpt-mem 20 40 60 80 100 SE +/- 0.88 104 Phoronix Test Suite 5.6.0 1. (CXX) g++ options: -fopenmp
  65. 65. How we build it Linux In Memory Computing
  66. 66. How we build it LOCK Install
  67. 67. How we build it LOCK Load Linux to Memory at Start Up
  68. 68. How we build it When Finish, Your Linux at Your RAM
  69. 69. How we build it LOCK
  70. 70. Let's demo It Building in GNU/Linux OS
  71. 71. Let's demo It Transfer session at boot up cost up to 10 minutes for 5.3 GB
  72. 72. Let's demo It Proof of “In Memory Computing”
  73. 73. We are Searching for Partnership Research Project and Collaboration
  74. 74. Tribute to: ● KLAS (Komunitas Linux Arek Suroboyo) – klas.or.id ● Tel-U (Telkom University) – telkomuniversity.ac.id ● Free and Open Source Licence image ● Gnome Asia Summit 2015 ● Everyone who cannot be written their name in here
  75. 75. Sayonara.... Thank You.... Terima Kasih.... Question Answer and Improvement Sections

×