CloudCamp Milan 2009: Telecom Italia

Where P2P ? … over the clouds … into the clouds … aside the clouds?

R. Minerva, A. Manzalini, C. Moiso

P2P Technology (a simple view)

P2P Pros ...

P2P system resources are often "free", coming from individuals which volunteer their machines' CPUs, storage, and bandwidth

... and Cons

P2P systems lack a centralized administrative entity that owns and controls the peer resources. This makes it hard to ensure high levels of availability and performance.

Decentralized control also limits trust. Users can inspect the memory and storage of a running application, meaning that applications cannot safely store confidential information unencrypted on peers. Nor can the application developer count on any particular quantity of resources being dedicated on a machine, or on any particular reliability of storage. These obstacles have made it difficult to monetize p2p services. It should come as no surprise that, so far, the most successful p2p applications have been free, with Skype being a notable exception.

The freeriding phenomenon (and the tragedy of commons)

Excerpts from http://berkeleyclouds.blogspot.com/

P2P as a complementary technology for Cloud Computing ?

P2P “techniques are often useful in building datacenter-scale applications, including datacenter-scale applications that are hosted in the cloud”

Actually the Key-Value Store techniques are often exploited by big data centers

Amazon Dynamo (see http://www.allthingsdistributed.com/2007/10/amazons_dynamo.html)

Google

Pando, Abacast, ...

Excerpts from http://berkeleyclouds.blogspot.com/ App 1 App 2 … Appl m DISTRIBUTED APPLICATIONS Node 1 Node 2 … Node n DISTRIBUTED HASH TABLE put (H(key), value); get (H(key), data); H(Key) is a hashing function of the Key

Or as an Alternative ? P2P Range of Applicability … Distributed Computing File Sharing Collaboration Platforms Communication DataStorage Search Engine Dark nets

Freenet

F2F

GNUnet

…

[email_address]

…

Gnutella

Kazaa

Bit Torrent

…

Jabber

…

Skype

…

OceanStore

BitVault

Peeriodata

…

JXTA

Peers Toolkit

…

YACY

…

P2P Systems

Are Operators out of the emerging trend of the (Data) Service/Platform/Infrastructure as a Service ?

The Prevalent Paradigm For Services Is Client - Server

Client Server paradigm is used in Web Interactions

New Services are taking advantage of this consolidated technology

Rich Internet Application

Cloud Computing

And others...

But ... Can the Data Centers grow forever?

Google maintains over 450,000 servers (estimates)

http://www.tnl.net/blog/2004/04/30/ how-many-google-machines /

Google Data Centers: $3,000 A Square Foot?

http://www.datacenterknowledge.com/archives/2007/11/12/google-data-centers-3000-a-square-foot/

Estimates of the power required for over 450,000 servers range upwards of 20 megawatts , which cost on the order of US$2 million per month in electricity charges

Web Client (Browser) Web Client (Browser) Web Client (Browser) Internet Web Server http http http http

P2P Computing as a competitor of Client Server? Capacity (HD System) =  (b i , s i , f i , p i ) Where: b i = bandwidth of node i s i = storage of node i f i = files of node i p i = processing of node i Capacity (Centralized System) = {b S , s S , f S , p S } Where: b S = bandwidth of the Server System s S = storage of the Server System f S = files stored in the Sever System p S = processing in the Server System Optimization is a problem Optimization is a function of a business model

www.gapinvoid.com A Few Issues

Example of Projects trying to overcome P2P Cons ... The nanodatacenter (http://www.nanodatacenters.eu/)

Autonomic Computing

What is it? (from wikipedia)

IBM has defined the following four functional areas:

Self-Configuration

Self-Healing

Self-Optimization

Self-Protection

Autonomic Networking follows the concept of Autonomic Computing . Its ultimate aim is to apply autonomic concepts to Networks.

Functions of an Autonomic Network:

Autognostic, Configuration management, Policy management, Autodefense, Security

Connection Fabric (i.e., The connection fabric supports the interaction with all the elements and sub-systems of the autonomic system)

Principles of Autonomic Networking

Compartmentalization (how to implement the operational rules and administrative policies for a given communication context)

Function re-composition

Atomization

Closed control loop

http://www-03.ibm.com/servers/eserver/zseries/zos/sm/autonomic.html Why? Millions of pervasive nodes!! There is the need of a new approach Users should be “bothered” by such a cumbersome task!

Example Of Waste Of Resources

Actually a p2p Overlay Network is considered “infrastructure-less”, but ...

In reality it is using the network infrastructure ...

Without optimization

E.g., two nodes seen as adjacent by the p2p network can be very far each other. T-Lab suggests mechanisms to improve the situation

There is the need to manage the network resources in order to give a fair service to ALL the users.

There is the need to cooperate

Needs for interoperability: means definition of common protocols and functions

Overlay Net See for instance http://www.cambridge-mit.org/project/home/default.aspx?objid=2313 P4P and IETF ALTO are trying to solve these problems

Application of Gossiping Algorithm to FCAPS areas (courtesy of CASCADAS)

fault detection and recovery

for each contract of type T there is a “back-up” contract, to be used if B fails;

the nodes in achieving(T) updates the back-up contract in case B’ fails;

the nodes in contracting(T) help A in case B and B’ fails;

load balancing

when B’ is under-loaded, B’ informs all its neighbors in achieving(T);

if B, one of the neighbors of B’, is overloaded, it answers to B’ by accepting the offer;

when A, with an active contract with B, sends a new request, B informs A to redirect its contract to B’;

Usable as the “stand-by” algorithm for power saving

Simulation snapshots (from Cascadas) State of Nodes with distributed LB Legenda: Nodes available to get traffic Nodes in “normal load” Nodes in “overload” State of Nodes without LB Thanks to A. Manzalini, C. Moiso

Cross Layer Design: The End Of The OSI Model?? http://www.uni-marburg.de/fb12/verteilte_systeme/forschung/adhoc_routing_emul

Wireless Networks are pushing for a closer cooperation of functions in order to better respond to a fast changing communication environment:

Reflective middleware (able to adapt)

Cross Layer Design (ability to get the relevant information from any OSI layer)

No Network Transparency

Protocol dependence of the middleware

Cognitive Layer (it can perceive current network conditions, and then plan, decide and act on those conditions)

A glimpse to the future ...

DirecNet: A group of industry players is proposing an open-standard directional networking system designed to provide 1-gigabit-per-second data communication with anyone in a network on the ground, in the air or at sea, within hundreds of miles . The planned mobile mesh network , known as DirecNet, will use a network-friendly data link waveform to provide secure Internet Protocol communications up to 1 gbps for all types of air and surface platforms. DirecNet would use fast-steered directional antennas to substantially boost link power and operating range, and to permit reuse of radio frequency (RF) spectrum . Any DirecNet node can serve as a relay . This will multiply connectivity and extend the range to beyond line of sight.”( http://www.military-information-technology.com/print_article.cfm?DocID =1539 )

The DirecNet™ Task Force anticipates the completion of the specification within 2 years ( https://www.opengroup.org/conference-live/uploads/40/11007/Forum_Reports.pdf#search=%22goals%20direcnet%20military%22 )

Leveraging the TELCO infrastructure www.gapinvoid.com

Incipit

Positive Dilemmas : Network Operators should investigate disruptive scenarios for Future Communications and Services in order to be aware of how to transform their biz models and exploit network and service infrastructures;

One of the most challenging scenario is characterized by:

High pervasiveness (computing systems distributed and connected everywhere);

Connectivity as a commodity;

Structure as Network of Networks (adaptive networks);

Intelligence at the edges (terminals and end points);

This scenario is highly disruptive as it implies moving intelligence at the edge of the network reinforcing the end-to-end argument and an open environment for services;

There is a need of understanding:

The potential evolution of this scenario (in terms of architectures, technologies and services);

Which is the role of the Network Operator (biz model, architectures, technologies, …);

Next: Open Questions

Which mix of networking and computing paradigms and technologies will enable the scenario (characterized by high pervasivity, with connectivity as a commodity and Network of Networks) ?

How to optimize allocation, sharing and management of pervasive resources, to guarantee the best Users’ experience whilst reducing the systems and Operators’ costs ?