Kartik Kumar Perisetlakartik.peri@gmail.com
Grid Computing▪ Grid computing is the combination of several computing resources from  several administrative domains or o...
Grid Computing Principle                                                     3                     Node1) Task Request.   ...
Grid Computing Architecture         Model                OSI Model                                   Application          ...
DRMS (Distriuted Resource Management System)• Batch processing• User interface and a single point control for defining and...
Types of GridParticipating Nodes    Nature of Nodes• Cluster Grid        • Compute Grid• Departmental Grid   • Data Grid• ...
Pebble Grid Framework• Grid Computing middleware that provides daemons, tools and shared  libraries to implement and exten...
Components: Daemons    Pebble Grid Manager (PGM)     Pebble Grid Client (PGC)Administation & Submission Host   Execution H...
Pebble Grid Manager (PGM): Host ConfigurationAdding a Host : At PGM• GUI Host configuration• Dynamic cluster-grid nodes• C...
Pebble Grid Manager (PGM): Job ManagementSubmitting a Job• GUI Job Management• Job Submission• Jobs : C, C++, Fortran, Pas...
Pebble Grid Manager (PGM): Job ManagementMonitoring a Job• GUI Job Management• Job MonitoringQueues• TaskQ• StatQ• FinQ   ...
PGM-Scheduling & MonitoringMaster-Slave Architecture                                PGC-Execution Host-Cluster Grid       ...
PGM-Scheduling &Tree Architecture                                PGM                   Monitoring                         ...
Peer-to-Peer(PGM) Architecture                              PGM-Scheduling & Monitoring                                   ...
pebshd: Scheduler Daemon Dynamic Scheduling • Priority Scheduling • FIFO Scheduling                                       ...
libPebble*• Shared Library Functionality includes:• Job class• Job scheduler + Rescheduling policy• Execution Host• Suppor...
Pebble Divide & Conquer Framework                           100,000                                                       ...
Sy         st e             m Property Architecture    Hierarchical, Peer     Centralised       Hierarchical, PeerImplemen...
ReferencesRedHat           https://www.redhatrenewals.com/.../selinuxFedora           docs.fedoraproject.org/selinux-faq-f...
Thank You !              20
Upcoming SlideShare
Loading in …5
×

Pebble Grid Computing Framework

735 views
609 views

Published on

a GUI based grid computing framework that provides tools, daemons and libraries that facilitate users to submit jobs, monitor jobs, Dynamic participation of grid nodes, resource discovery. Best suited for high speed web crawling, Image processing and any job with sufficient degree of parallelism; Developed in C,C++

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
735
On SlideShare
0
From Embeds
0
Number of Embeds
15
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Pebble Grid Computing Framework

  1. 1. Kartik Kumar Perisetlakartik.peri@gmail.com
  2. 2. Grid Computing▪ Grid computing is the combination of several computing resources from several administrative domains or organizations applied to a common task, usually scientific research areas.▪ Grid computing is distributed, large scale clustered computing as well as network distributed parallel processing.▪ The main strategy of grid computing is using software to divide a job into pieces and assign to different computing resources.▪ Grid computing facilitate virtual organizations to access remote computing resources to achieve common goal.▪ Virtual organization refers to set of individuals defined around the resource sharing policies, protocols. 2
  3. 3. Grid Computing Principle 3 Node1) Task Request. 22) Task splitting into jobs (or sub tasks) and job Task submission Control 23) Sub-results collection Node Server4) Final result aggregation 3 Result 2 3 Node Node: Grid node with 2 : Sub task 3 : Sub results Computing resources 3
  4. 4. Grid Computing Architecture Model OSI Model Application Transport Network Link 4
  5. 5. DRMS (Distriuted Resource Management System)• Batch processing• User interface and a single point control for defining and monitoring• In current scenario there are two popular DRMS available : Load Sharing Facility (LSF) by Platform Computing Inc. and Sun Grid Engine (SGE) by Sun Microsystems• Our Aim- UI for SGE & LSF or Develop a new DRMS ? 5
  6. 6. Types of GridParticipating Nodes Nature of Nodes• Cluster Grid • Compute Grid• Departmental Grid • Data Grid• Global Grid • Utility Grid 6
  7. 7. Pebble Grid Framework• Grid Computing middleware that provides daemons, tools and shared libraries to implement and extend the grid computing functionalityFeatures• GUI• Grid computing framework for Linux OS written in C/C++• Daemon based implementation• Job submission• Job monitoring• Dynamic load balancing & Rescheduling• Dynamic participating nodes• Highly scalable• Middleware• Framework: Shared Libraries*• Implement Desktop Grid, Cluster Grid, Department Grid & Global Grid + Data, Utility Grid *framework is in progress 7
  8. 8. Components: Daemons Pebble Grid Manager (PGM) Pebble Grid Client (PGC)Administation & Submission Host Execution Host• Job submission • Execution of Jobs• Dynamic load balancing • Cluster-Dept.-Global grid & Rescheduling • Participation in several grids• Job Monitoring• Cluster-Dept.-Global grid 8
  9. 9. Pebble Grid Manager (PGM): Host ConfigurationAdding a Host : At PGM• GUI Host configuration• Dynamic cluster-grid nodes• Cluster-Grid host configurationAuto-Register : By PGC• Memory available• Imports list of installed packages 9
  10. 10. Pebble Grid Manager (PGM): Job ManagementSubmitting a Job• GUI Job Management• Job Submission• Jobs : C, C++, Fortran, Pascal Python scriptsNature of Job• Independent batch• Divide & Conquer 10
  11. 11. Pebble Grid Manager (PGM): Job ManagementMonitoring a Job• GUI Job Management• Job MonitoringQueues• TaskQ• StatQ• FinQ 11
  12. 12. PGM-Scheduling & MonitoringMaster-Slave Architecture PGC-Execution Host-Cluster Grid Job PGM Result PGM-PGC connection Execution PGC PGC PGC PGC PGC **New jobs are allocated as per the rate of execution of execution hosts 12
  13. 13. PGM-Scheduling &Tree Architecture PGM Monitoring PGC-Execution Host-Department Grid Job-Global Grid Result PGM-PGC connection PGM-PGM connection -PGM acting as slave PGM -Not a execution host -Receive Jobs Execution PGC PGC PGC**New jobs are allocated as per the rate of execution of execution hosts PGC PGC PGC 13
  14. 14. Peer-to-Peer(PGM) Architecture PGM-Scheduling & Monitoring PGC-Execution Host-Department Grid Job-Global Grid Result PGM-PGC connection PGM PGM PGM-PGM connection -PGM acting as peer -Not a execution host -Send & Receive Jobs Execution PGC PGC PGC PGC PGC **New jobs are allocated as per the rate of execution of execution hosts 14
  15. 15. pebshd: Scheduler Daemon Dynamic Scheduling • Priority Scheduling • FIFO Scheduling pebshd Load Balancing • Real time load • Status Queues • TaskQ- Idle jobs • StatQ- Running jobs • FinQ- Finished jobs Rescheduling TaskQ StatQ FinQ • Timeout for each job Resource Reservation* • Scheduling as per nature of job * Work in progress 15
  16. 16. libPebble*• Shared Library Functionality includes:• Job class• Job scheduler + Rescheduling policy• Execution Host• Support for Divide & Conquer jobs• API for developer to extend the frameworkResources used • CentOS 5.3 • C,C++,GCC • Glib/GTK+ * Work in progress 16
  17. 17. Pebble Divide & Conquer Framework 100,000 numbers• Framework to support distributed computing on large data sets on clusters• Inspired by Google’s MapReduce framework• Basis: Divide & Conquer To PGC Divider 20,000• GUI / API in libPebble numbers 20,000Applications numbers• Quick sorting of 100,000 no. 20,000 20,000• Crawling the WWW numbers 20,000 numbers• Image Processing numbers & many more Combiner Final Output 17
  18. 18. Sy st e m Property Architecture Hierarchical, Peer Centralised Hierarchical, PeerImplementation C, C++, POSIX C++, Win32, POSIX C#, WebTechnology services,.NET FrameworkExtendable Yes No YesGUI Yes Yes YesCLI Yes Yes NoProjects CSIRO Land & Soon… SETI@home, Water , Einstein@home,etc FMI Biomedical Research Inst, etcUser/Developer Soon… Massive GoodCommunity 18
  19. 19. ReferencesRedHat https://www.redhatrenewals.com/.../selinuxFedora docs.fedoraproject.org/selinux-faq-fc5Wikipedia en.wikipedia.org/wiki/Grid_computingGrid Computing www.gridcomputing.comIBM www.ibm.com/grid/Oracle www.oracle.com/us/technologies/grid/index.htmGoogle Books books.google.co.in/books?isbn=1558609334selinux docs.fedoraproject.org/selinux-faq-fc5Gridcomputing en.wikipedia.org/wiki/Grid_computingGridcomputing www.gridcomputing.comGridcomputing www.ibm.com/grid/Grid www.oracle.com/us/technologies/grid/index.htmiptables iptables-tutorial.frozentux.net/iptables-tutorial.html 19
  20. 20. Thank You ! 20

×