The document discusses intelligent cloud computing. It describes cloud computing concepts like SaaS, PaaS, and IaaS. It then discusses using intelligent agents and predictive techniques for load balancing in cloud platforms and datacenters. This includes predicting resource usage and migrating virtual machines between servers to balance workloads and avoid congestion. The goal is to develop intelligent techniques to control data flows and scheduling in cloud systems.

1. Intelligent
Cloud Computing
Julie Kim
(kjulee114@gmail.com)
1

2. Cloud Computing
• The use of computing resources
(hardware and software) that are delivered
as a service over a network
http://upload.wikimedia.org/wikipedia/commons/thumb/b/b5/Cloud_computing.svg/400px-Cloud_computing.svg.png 2

3. “X” As A Service
• SaaS
– Software A Service
– Common delivery model for business
• PaaS
– Platform As A Service
– Providing computing platform and solution stack
• IaaS
– Infrastructure As A Service
– Providing physical or virtual related resources
3

4. Platform As A Service
• Elastic Computing
– Scale up/down
• Parallel control
• Resource
management
• Load balancing
• Failover
• ON DEMAND…
http://upload.wikimedia.org/wikipedia/commons/3/3c/Cloud_computing_layers.png 4

5. Elastic computing
Scale up or out Which node is busy?
Which network is
congestion?
How to detect
HOW TO congestion?
Traffic Congestion Problem
5

6. Traffic Congestion
• A condition on road network that occurs as
use increases
– Slower speeds
– Longer trip times
– Increased vehicular queuing
Longer waiting time Response Delay
System Overload Decrease QoS
6

7. Intelligent Transport System
• Applied various area
• Wireless communication
• Computational technologies
– Hardware memory management
– Process control
• How about apply it to Cloud system..?
7

8. Keyword: Intelligent
• Grid Load Balancing Using Intelligent
Agents
• Prediction-based Virtual Instance
Migration for Balanced Workload in the
Cloud Datacenters
8

9. ACM Future Generation Computer Systems 2005 Pages 135 - 149
GRID LOAD BALANCING
USING INTELLIGENT AGENTS
9

10. Agent
• Managing processor of local resource
• Scheduling incoming tasks
• Hierarchy of homogeneous agents
• Communication Layer
• Heterogeneous networks interface
• Coordination Layer
• How act on the request
according to its own knowledge
• Local Management Layer
• Performs functions
for local grid load balancing
10

11. Performance Prediction
• A KEY
– Resource scheduling
– Load balancing
• PACE
– A toolset for the performance prediction of
parallel and distributes systems
• Local/Global load balancing
– Resource scheduling
11

12. Load Balancing
• Local
– First-come-first-served algorithm
– Genetic algorithm
• Reorder tasks for optimal execution time
• Global
– Agent Capability Tables
• This ACT/Local ACT/Global ACT
– Data-pull/Data-push
12

13. RIT
PREDICTION-BASED VIRTUAL INSTANCE
MIGRATION FOR BALANCED WORKLOAD
IN THE CLOUD DATACENTERS
13

14. Load Balancer
• Xen Hypervisor based
– Monitoring the loads of the servers
– Detecting indications of overloading
– Migrating virtual instances
• Modeled as..
– A multidimensional
knapsack optimization
– Bin packing
http://www.websters-online-dictionary.org/images/wiki/wikipedia/commons/thumb/f/fd/Knapsack.svg/250px-
Knapsack.svg.png 14
http://www.astrokettle.com/b_y3r1x.gif

15. Reactive-Predictive Load Balancer
Polling
# of virtual
instances
CPU
Memory
I.O
Network
utilization
1) Which virtual machines
on the overloaded server
to migrate
2) The new destination server
1 to migrate to
2 15

16. Conclusion
• Key problem
– How to be Intelligent?
– How to control data congestion?
– Traditional approach
• Prediction performance of each virtual node
• Task migration
– Future work
• Allocate request before congestion
• Data flow monitoring and request scheduling
16

17. Q&A
17

18. THANKS
18

19. References
• http://en.wikipedia.org/wiki/Infrastructure_as_a_service
• http://en.wikipedia.org/wiki/Platform_as_a_service
• http://en.wikipedia.org/wiki/Intelligent_transportation_system
• Junwei Cao, Daniel P. Spooner, Stephen A. Jarvis, Grahan R. Nudd,
Grid load balancing using intelligent agents, ACM Future Generation
Computer Systems, 2005, Page 135-149
• Shibu Daniel, Minseok Kwon, Prediction-based Virtual Instance
Migration for Balanced Workload in the Cloud Datacenters, RIT,
2011
• Fei-Yue Wang, Parallel Control and Management for Intelligent
Transportation Systems: Concepts, Architectures, and Applications,
IEEE Intelligent Transportation Systems, 2010, Page 630-638
19