Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Partner Webcast – Building event driven microservices with Oracle Event Hub CS

242 views

Published on

If we are about to pick one word which would characterize the microservice approach, it would probably be the word freedom. It is all about freedom to change, freedom to deploy at any time, finally freedom to replace with a completely new technology stack when needed. The latter ability is actually the key driving architectural principle for microservices, which can be summarized as built to be replaced

[Read More @ https://blogs.oracle.com/imc/partner-webcast-building-event-driven-microservices-with-oracle-event-hub-cs]

Presenter: Łukasz Romaszewski

Published in: Technology
  • Be the first to comment

Partner Webcast – Building event driven microservices with Oracle Event Hub CS

  1. 1. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Building event driven microservices with Oracle Event Hub CS Łukasz Romaszewski Cloud IMC Consultant Oracle Partner Hub Innovation & Modernization Center Poland Partner Webcast
  2. 2. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Introduction to Apache Kafka and asynchronous patterns in the microservice architecture
  3. 3. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Problem of monolith application Microservice architecture Data Application Logic Web
  4. 4. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Splitting functionality into independent microservices Microservice architecture Data Application Logic Web Data Application Logic Data Application Logic Data Application Logic
  5. 5. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Introducing asynchronous communication Microservice architecture Data Application Logic Data Application Logic Data Application Logic Data Application Logic Kafka partition Kafka partition Kafka partition Kafka partition Kafka partition
  6. 6. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |Copyright © 2017, Oracle and/or its affiliates. All rights reserved. What is Kafka?
  7. 7. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Kafka essentials https://kafka.apache.org/intro
  8. 8. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Kafka essentials https://kafka.apache.org/intro
  9. 9. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Kafka essentials https://kafka.apache.org/intro
  10. 10. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | What problems does Kafka solve? • Real time streaming – REST/web sockets doe not provide needed reliability – Traditional messaging systems (e.g. RabbitMQ) are difficult to manage and scale • Data integration between various data stores and applications – Different requirements in terms of throughput, latency, message formats etc. – Need for lousily coupled connections • In terms of time (downtime of one component does not impact others) • In terms of location (components can be re-located/scaled without updating metadata of others) • In terms of contract (message can be versioned)
  11. 11. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | of enterprises use Kafka as the message broker for their Fast Data ecosystem – Source: OpsClarity Survey: 2016 State of Fast Data and Streaming Applications 86%
  12. 12. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Introduction to Oracle Event Hub Cloud Service
  13. 13. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | • Oracle Event Hub Cloud Service is fully managed streaming data platform that leverages the World’s Most Popular Message Broker (Apache Kafka) The Most Popular Platform for Fast Data on Oracle Cloud Oracle Event Hub CS: Overview
  14. 14. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | • Flexibility – Available in Autonomous/Fully Managed and Dedicated Cluster deployments options – Available on Oracle Public Cloud as well as On-Prem via Oracle Cloud Machine – Elastic – Horizontally, Vertically • Accessibility – Access via both Kafka Native and REST API – Access to Streams API, Connectors API, Schema Registry – SSH Access to Kafka Cluster (Dedicated) for extensibility and customization • Ecosystem – Plug and play with Marketplace Connectors – Access to Open Source Kafka Community developed toolsets – Integrated with Oracle IAAS/PAAS ecosystem Oracle Event Hub CS: Key Capabilities
  15. 15. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | • Topics (Autonomous PAAS) • Dedicated Flexible deployment options Oracle Event Hub CS: Deployment
  16. 16. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | • Fully managed deployment option that handles – Cluster Management – Broker Configuration – Broker/Zookeeper Scaling – Patching – Lifecycle Management • Just create topics and partitions and start streaming • Built in HA with pre-configured replication • Autonomous PAAS Topics Oracle Event Hub CS: Deployment
  17. 17. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | • A Dedicated Kafka Cluster – Create and build your own cluster – Choose number of brokers, REST servers and Zookeeper servers – Manage scaling out as needed – Compute Shape, Storage, Brokers, Zookeepers – SSH access to the cluster – Managed Patching Dedicated Oracle Event Hub CS: Deployment
  18. 18. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | • Configuration (no code) based Source and Sink connectivity to Databases, Storage, Hadoop, ElasticSearch and more • Support for Publicly Available Kafka Connectors Oracle Event Hub CS: Connectors API
  19. 19. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Oracle IoT CS Oracle Application Container CS Oracle Big Data CS Oracle Integration CS Oracle Database CS Oracle Java CS Oracle Analytics CS Oracle Storage CS Oracle Event Hub CS: IAAS/PAAS Integration
  20. 20. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Oracle Event Hub CS: Performance • Ingress: 1 MB/sec via REST per partition • Egress: 2 MB/sec via REST per partition • Native access (Dedicated Cluster)
  21. 21. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | • Data in Motion – SSL/TLS for REST Access – SSL/TLS for Native Access • Data at Rest – Disk encryption (Roadmap item) • Authentication and Authorization – OAuth 2.0 (IDCS) • Access Control – ACLs Oracle Event Hub CS: Security
  22. 22. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |Copyright © 2017, Oracle and/or its affiliates. All rights reserved. DEMO Building and deploying event producer and consumer microservices in the Oracle Cloud Oracle Application Container CS Oracle Event Hub CS
  23. 23. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | • Data Pipeline – OEHCS can be used as a single sink where all data can be stored and distributed to a data lake or data warehouse • Log Aggregation – Kafka as a central hub gathering logs from all machines/applications in the datacenter • IoT – OEHCS integrated with IoTCS provides an example on how Kafka can be used as a main data hose in the IoT world Oracle Event Hub CS: Other use cases
  24. 24. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | • Database Change Capture – OEHCS can be easily connected to cloud or on- premise installations of Oracle Golden Gate – Golden Gate can capture and propagate to Kafka changes in relational databases – Kafka in turn can distribute the data across systems and cloud/on-prem installations – This setup works very well in the CQRS scenarios where different databases are used to change and to read the data • Click Stream Analytics Oracle Event Hub CS: Other use cases cont.
  25. 25. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | • Open Source Apache Kafka based manager service • Available in Autonomous/Fully Managed and a Dedicated mode where customers can build out and control their own private cluster • Integrated with Oracle IAAS/PAAS ecosystem (OCI and OCI-Classic) • Oracle Public Cloud and On-Premise Oracle Event Hub CS: Key Takeaways
  26. 26. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Oracle EMEA Innovation & Modernization Center 28 OracleIMC blog: http://blogs.oracle.com/imc OracleIMC email: partner.imc@beehiveonline.oracle.com
  27. 27. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | EMEA Innovation & Modernization Center Partner.IMC@beehiveonline.oracle.com twitter.com/OracleIMC facebook.com/OracleIMC plus.google.com/+OracleIMC youtube.com/user/OracleIMCTeam linkedin.com/groups/4535240 blogs.oracle.com/imc
  28. 28. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 31

×