Building Cloud-Aware Applications

Building Applications On Cloud Architecture Chris Haddad @cobiacomm chris@wso2.comRead more about Cloud Architecture and Cloud-aware Apps at http://blog.cobia.net/cobiacomm

Skating towards the puck

Cloud Characteristics and Architecture • Stateless servicesMeasured service • Rapid provisioning or pay per use • Flexible topology Rapid • High Quality of Service Elasticity• Fine-grained metering• Billing On-• Reporting demand self-service• Flexible workload assignment Resource pooling• Standard service offerings• Quick startup and automation • Multi-tenancy • Resource utilization • Shared, virtual infrastructure • Interoperability

Cloud Dimensions• Sharing – Private / Public / Community• Responsibility – Internal / External• Location – On-premise / outsourced

Platform as a Service Adoption Drivers

Defining Cloud Platform Boundaries• Distributed Topology – Latency – Stateless, autonomous services – Instrumented, redundant, and expecting failure• Efficient resource pooling – Consumption aware and multi-tenant – Automated, continuous• Scale – Asynchronous, event driven callbacks – Parallelizable, workload decomposition, and idempotent• On-demand self service – Personalization extensibility points – Fine grained, modular – Template driven

Platform as a Service Capabilities Automated Dev Ops Tooling Governance Consumption Service Level based Funding Management

Platform as a Service Capabilities• Self service configuration • Service catalogue• Automated provisioning • Service tiers• Policy configuration • Demand and capacity• Process automation management • Lifecycle management • Cloud Management Dev Ops Automated integration Tooling Governance Consumption Service Level based Funding Management• Metering • Resource monitoring• Reporting • Resource management• Billing • Performance management • Traffic orchestration

PaaS Abstraction Levels Component • Users, workspaces, transactions Services • Services, channels, API • Application session, frameworks Application • Application instance, .war files Platform • Installing application • Command line interface, bash shell Hardware • Machine size, JVM configurationInfrastructure • Installing infrastructure

WSO2 Architecture Advantage Availability Scalability Management Load monitor Tenant partitioning Cloud controller Private jet modeBalancing and failover across Ghost deployment BigData Logging infrastructure hybrid cloudsState replication and session BAM 2.0 architecture Artifact Distribution Controller replication and Deployment synchronizationMultiple load balancers with Auto-scaling P2 Repository keepalived or DNS RR Native multi-tenancy Elastic Load Balancer Consistent management and infrastructure services across entire platform Dynamic Clustering Multi-tenant shared Management console container 10

PaaS Reference Architecture

Building Apps on Cloud Architecture•Why cloud aware applications rise above Web applications•Where to make applications cloud aware•What open source projects deliver cloud awareness

Rise Above: Cloud Scale and Distributed Providers Business Functional Proces Presentation and Business Mashups Role Process Presentation Functional Business Role Role Process Business Presentation and Functional Role Process and Mashups Functional Business Rules Presentation and Mashups codeClient Tier Resource Integration Services Tier Resource Services Resource Services Integration Services Public Cloud Services Private Applications

Rise Above: Application Resiliency and Composition Composite Mobile Infrastructure as a Application Application Service (IaaS)SaaS Application Cloud API Web Endpoint application Endpoint Integration Services Business Service Portfolio Application Portfolio Hybrid Presentation Services Platform Business Process and Functional Services Services Rules Services Resources Services Integration Services

Rise Above: Deliver Cross-Partner Digital Business PlatformVertical Application 1 Vertical Application 2 Vertical Application 3 App Data App Data App Data Summit VerticalApp Source Code App Source Code App Source Code App App App Configuration Configuration Configuration Vertical API Domain Services Domain Services Domain Artifacts Domain Artifacts Managed Programming Languages by PaaS Frameworks Containers OS/Hypervisor Hardware

Where to make applications Cloud Aware• Deliver application to massive consumer base• Infrastructure cost optimization strategy• Application resiliency improvement strategy• Create an ecosystem platform supporting cross-partner digital business

Cloud Aware Architecture• Maximize utilization and optimize cost – Requires deterministic performance – Load balance based on tenant, service, and workload, context – Increase tenant density• Increase reliability, availability, scalability – Shared nothing architecture – Stateless server-side elements – Consensus protocols – Services distributed across multiple providers and zones• Ecosystem platform – Monetize assets based on business value – Tenant/Consumer personalization and isolation – Sharing domain specific business capabilities

Architectural Difference Between Web Application and Cloud Application Web Application Cloud Application• Synchronous request-reply • Asynchronous interaction interaction • Queues and workers• Centralized state (i.e. single • Scale out across datacenters database) and session and providers management • Distributed state and session• Clustered server instances management• Silo architecture • Autonomous service instances • Tenant context personalization • Shared JVM / Shared Schema • Shared nothing architecture

Cloud Application Patterns and Anti-Patterns 18 Separation of concerns Failure Resilient Leaky interfaces Tightly coupledSingle threaded, modulesserial execution Embarrassingly Parallel / Minimal Shared Nothing Architecture Deterministic Consumption performance Resource locks Monolithic footprint Single tenancy model Deploy and execute on optimum topology

Cloud Architecture Best PracticesTransitioning to a New normal – Traditional practices maynot apply• Distributed and federated interactions – Event based, heterogeneous systems, network latency• Configurable containers and engines – Declarative data, rules, and process definitions• De-normalized and simplified data models – Hadoop/BigTable, Hypertext media, simple NoSQL entities• Expect failure – Systems span transactional control• Applications decomposed into distinct services – Federated environment drives autonomy, statelessness, and composition

Application Architecture Crossroads Innovation Familiarity

Cloud-awarenessPlatform support for Cloud-aware applications• Cloud Architecture• Cloud Aware Design Patterns• Programming Model

PaaS Reference Architecture

Cloud aware architecture model shiftNew interaction model• Actor Model – Dispatching and scheduling instead of direct invocation – Queues and asynchronous interactions• RESTful interactions – Message passing instead of function calls or shared memory• Eventual consistency instead of ACID – Distributed cache instead of application cluster – Cache access instead of direct resource access • Traditional O/R mapping (e.g. Hibernate) doesn’t work 24

Cloud-aware Design PatternsCloud-aware Application Parallelizable, Shared nothing Multi-tenant Application Platform Services Asynchronous, stateless services Fine grained, ESB modular design Tenant Application Server PaaS Framework personalization Business Process Registry Asset Efficient resource Load Metering and Controller Deployer and Repositories consumption Identity Management balancer Billing Synchronizer Deterministic Storage performance

Simplification Through PatternsRelevant pattern categories• Computational fit analysis• Parallelism and workload decomposition• Concurrency• State• Structural• Scale26

Apply Computational Patterns Evaluate 13 Dwarfs 1. Dense linear algebra – matrix calculations 2. Sparse linear algebra – sparse matrix calculations and storage 3. Spectral methods – operational engineering 4. N-body methods – particle force calculations 5. Structured grids – mechanical and fluid engineering, meteorology 6. Unstructured grids – mechanical and fluid engineering 7. Mapreduce – Monte Carlo simulations, data processing 8. Combinational logic – data transformation 9. Graph traversal – social networking 10. Dynamic programming – DNA pattern matching, web search, shipping 11. back-track / branch & bound - travel route mapping 12. graphical model reference – speech and image recognition 13. finite state machines – workflow optimization27

Cloud-awarenessProgramming Model• Actor model (i.e. message passing instead of function invocation• RESTful interactions• Dynamic recoverability• Consensus protocols• Asynchronous rather than synchronous interactions• Shared nothing architecture• Data partitioning and sharding• Federated data queries• Service orchestration• Functional programming• MapReduce

Open Source Projects• Cloud aware Infrastructure – WSO2 Stratos – Cloud Foundry – Red Hat OpenShift• Frameworks – Parallel Process Execution and Coordination – Distributed Map-Reduce – Distributed Storage for Large Scale Structured Data (aka Big Table / Big Data) – Grid Frameworks – Distributed Object and Tuple Spaced Data Cache – REST Frameworks – Actor model• Languages – Functional, Parallel, Actor Model

Cloud-optimized FrameworksScaffolding to structure Cloud aware app development• Parallel Process Execution and Coordination• Distributed Map-Reduce • Apache Hadoop, Apache MapReduce, StarFish MapReduce• Distributed Storage for Large Scale Structured Data (aka Big Table / Big Data) • Apache Cassandra, Apache Hbase, Neptune, Hypertable• Grid Frameworks• Distributed Object and Tuple Spaced Data Cache – memcache• REST Frameworks• Actor model30

Cloud-optimized FrameworksScaffolding to structure Cloud application development• Parallel Process Execution and Coordination – .NET 4 Task Parallel Library, Apache Zookeeper• Distributed Map-Reduce – Apache Hadoop, Apache MapReduce, StarFish MapReduce• Distributed Storage for Large Scale Structured Data (aka Big Table / Big Data) – Apache Cassandra, Apache Hbase, Neptune, Hypertable• Grid Frameworks – Globus, Condor, DataSynapse• Distributed Object and Tuple Spaced Data Cache – Oracle Coherence, Terracotta Ehcache, Spring GemStone, memcache, GigaSpaces XAP• REST Frameworks – Restlet, .NET WCF, DJango• Actor model – Akka, Jetlang, Actors Guild, Actor Foundry, 31

Programming LanguagesCloud-ready languages are emerging and maturing• Functional Languages – Haskell – Occam – F# – Clojure• Actor Model Alignment – Erlang – Scala• Parallel Computation and Data Processing – Skywrite – Pig – BOOM 32

Building Cloud-awarenessFocus on adopting Cloud-friendly Architecture• Tenancy, dynamic discovery, and distributed cache• Fine-grained metering, billing, and reporting of business entities, activities, and interactions• Scale discrete application service instances instead of scaling monolithic application instances• Shared nothing architecture, Thirteen Dwarf Patterns, parallel processing, resource coordination• Cloud service provisioning and load balancer

Resources• Try StratosLive right now: – https://stratoslive.wso2.com/• Read about Stratos: – http://wso2.com/cloud/stratos/ – Source Download available• White Paper – Selecting Platform as a Service – Platform as a Service TCO: multi-tenant shared container• Blog Articles – What is Platform as a Service? – PaaS Evaluation Framework for CIOs and Architects – How to simplify Platform as a Service Complexity – Searching for Cloud Reference Architecture• Contact us: – bizdev@wso2.com

Follow us: http://twitter.com/#!/wso2 Follow us:Contact us: http://twitter.com/#!/wso2http://wso2.com/contact/ http://twitter.com/#!/cobiacomm

lean . enterprise . middleware

Building Cloud-Aware Applications

by Chris Haddad on Aug 30, 2012

Accessibility

Categories

Upload Details

Usage Rights

1 Embed 1

Statistics

Building Cloud-Aware Applications Presentation Transcript