This document summarizes a presentation given at the 2004 JavaOne conference about Jini network technology. It discusses how Orbitz uses Jini to power its travel booking websites in a scalable and reliable way. Some key benefits of Jini mentioned include its self-healing capabilities, automatic load balancing, and horizontal scalability. Some challenges with distributed computing like random load balancing and event storming are also covered. The presentation outlines Orbitz's architecture which uses Jini services as a "big switch" to connect to various airline and hotel booking systems. It also previews potential next steps like upgrading to Jini 2.x for improved security and disabling distributed garbage collection.
This document summarizes Netflix's journey to building a globally ubiquitous and failure-resilient architecture. It describes how Netflix evolved from a single data center architecture to a multi-region active-active design using microservices, Cassandra for data storage, EVCache for caching, and virtual DNS regions for traffic management. The architecture is designed to reliably serve customers from any region by replicating data and traffic across regions and implementing failover mechanisms.
Modern DevOps across Technologies on premises and clouds with Oracle Manageme...Lucas Jellema
DevOps team are responsible for well performing applications in every aspect, through the entire life cycle and across the stack, including platform and infrastructure, on premises and all cloud environments. Keeping watch on current and predicted behavior of all running components is not an easy challenge.
The challenge is growing with multi tier architectures and IT landscapes distributed across technology stacks, locations and clouds. Oracle Management Cloud provides advanced capabilities to do application, platform and infrastructure monitoring and root cause log analysis. This session introduces OMC and tells about real live experiences with OMC for managing demanding non functional requirements in very hybrid environments. The objective discussed is to quickly spot problems – ideally before they occur – find the cause and a solution and apply the latter. The session demonstrates what OMC can do for Oracle Fusion Middleware and Database, both on premises and in the public cloud.
This document provides tips for building an Oracle Fusion Middleware implementation on an Oracle Exalogic Elastic Cloud. It discusses starting the implementation by provisioning the Exalogic hardware and software, creating virtual servers, networking, and storage. It also covers optimizing technologies like WebLogic, clustering, and Oracle Traffic Director to take advantage of the Exalogic platform. Automation, provisioning, and disaster recovery strategies are recommended areas for future work.
Ten Real-World Customer Configurations on Oracle Database Appliance Simon Haslam
Oracle Database Appliance is a powerful machine, yet its name hides its versatility. Certainly, it provides a great place to run Oracle databases but given that it runs virtualization, it also offers much more for the Oracle-centric platform builder. This session presents 10 different real-world customer implementations from various database configurations, to middleware infrastructures such as Oracle WebLogic and Oracle SOA Suite, through to application deployments like Oracle’s E-Business Suite. For each example in this session the approach chosen is discussed—as well as lessons learned—to provide the audience with a clear path for moving forward with Oracle Database Appliance.
Some highlights of topics from the OpenStack Summit, as presented to the OpenStack St. Louis Meetup in November 2015. Most slides sourced from the summit videos (https://www.openstack.org/summit/tokyo-2015/videos/)
Slide deck from my "OpenStack and MySQL" presentation at Oracle OpenWorld 2015:
"This session details exactly how MySQL fits in throughout OpenStack, takes a deeper look at the database-as-a-service (DBaaS) offering with OpenStack Trove with MySQL, and discusses how Oracle supports this thriving ecosystem."
The document discusses Oracle Service Bus (OSB) features including transports, bindings, business services, proxy services, message flows, transformations, logging, error handling, security, service level agreements, and management. It provides an agenda and demos the use of OSB in a sample PR application to search for blacklisted applicants and submit applications using various OSB components.
The document discusses Network Functions Virtualization (NFV) and how CloudStack can be enhanced to better support NFV use cases. It provides an overview of NFV, comparing the NFV reference architecture to CloudStack's virtual router. While CloudStack's virtual router functions similarly to a virtualized network function, CloudStack currently lacks features like layer 2 networking and enterprise topologies that are important for NFV. The document proposes enhancements to CloudStack such as new topology and network types that would improve its capabilities for NFV.
This document summarizes Netflix's journey to building a globally ubiquitous and failure-resilient architecture. It describes how Netflix evolved from a single data center architecture to a multi-region active-active design using microservices, Cassandra for data storage, EVCache for caching, and virtual DNS regions for traffic management. The architecture is designed to reliably serve customers from any region by replicating data and traffic across regions and implementing failover mechanisms.
Modern DevOps across Technologies on premises and clouds with Oracle Manageme...Lucas Jellema
DevOps team are responsible for well performing applications in every aspect, through the entire life cycle and across the stack, including platform and infrastructure, on premises and all cloud environments. Keeping watch on current and predicted behavior of all running components is not an easy challenge.
The challenge is growing with multi tier architectures and IT landscapes distributed across technology stacks, locations and clouds. Oracle Management Cloud provides advanced capabilities to do application, platform and infrastructure monitoring and root cause log analysis. This session introduces OMC and tells about real live experiences with OMC for managing demanding non functional requirements in very hybrid environments. The objective discussed is to quickly spot problems – ideally before they occur – find the cause and a solution and apply the latter. The session demonstrates what OMC can do for Oracle Fusion Middleware and Database, both on premises and in the public cloud.
This document provides tips for building an Oracle Fusion Middleware implementation on an Oracle Exalogic Elastic Cloud. It discusses starting the implementation by provisioning the Exalogic hardware and software, creating virtual servers, networking, and storage. It also covers optimizing technologies like WebLogic, clustering, and Oracle Traffic Director to take advantage of the Exalogic platform. Automation, provisioning, and disaster recovery strategies are recommended areas for future work.
Ten Real-World Customer Configurations on Oracle Database Appliance Simon Haslam
Oracle Database Appliance is a powerful machine, yet its name hides its versatility. Certainly, it provides a great place to run Oracle databases but given that it runs virtualization, it also offers much more for the Oracle-centric platform builder. This session presents 10 different real-world customer implementations from various database configurations, to middleware infrastructures such as Oracle WebLogic and Oracle SOA Suite, through to application deployments like Oracle’s E-Business Suite. For each example in this session the approach chosen is discussed—as well as lessons learned—to provide the audience with a clear path for moving forward with Oracle Database Appliance.
Some highlights of topics from the OpenStack Summit, as presented to the OpenStack St. Louis Meetup in November 2015. Most slides sourced from the summit videos (https://www.openstack.org/summit/tokyo-2015/videos/)
Slide deck from my "OpenStack and MySQL" presentation at Oracle OpenWorld 2015:
"This session details exactly how MySQL fits in throughout OpenStack, takes a deeper look at the database-as-a-service (DBaaS) offering with OpenStack Trove with MySQL, and discusses how Oracle supports this thriving ecosystem."
The document discusses Oracle Service Bus (OSB) features including transports, bindings, business services, proxy services, message flows, transformations, logging, error handling, security, service level agreements, and management. It provides an agenda and demos the use of OSB in a sample PR application to search for blacklisted applicants and submit applications using various OSB components.
The document discusses Network Functions Virtualization (NFV) and how CloudStack can be enhanced to better support NFV use cases. It provides an overview of NFV, comparing the NFV reference architecture to CloudStack's virtual router. While CloudStack's virtual router functions similarly to a virtualized network function, CloudStack currently lacks features like layer 2 networking and enterprise topologies that are important for NFV. The document proposes enhancements to CloudStack such as new topology and network types that would improve its capabilities for NFV.
SWIM MasterClass - Building SWIM B2B web services using Open StandardsDebbie Wilson
The document discusses building SWIM B2B web services using open standards to enable the interoperable exchange of ATM data. It describes creating a prototype that reduces the costs of creating and consuming SWIM services by implementing them using OGC web services and providing flexible, open APIs. The prototype connects to existing EAUP services and publishes the data through WFS, RESTful APIs, and a SOAP wrapper to demonstrate how standards-based services can encourage sharing of ATM data.
An application server is software that hosts web applications and provides additional services for them. Oracle uses WebLogic Server as its application server for Oracle Fusion Middleware. The document discusses deploying WebLogic Server on Oracle Database Appliance (ODA) hardware, which provides an integrated and automated setup of WebLogic Server and Oracle Real Application Clusters.
Read to learn what Mule Runtime Fabric (RTF) and Anypoint RTF are, how you can leverage these integration engines, the best adoption strategies, and the right way to conduct the risk-cost-benefit analysis for your business.
V mware v realize orchestrator 6.0 knowledge transfer kitsolarisyougood
This document provides an overview of VMware vRealize Orchestrator 6.0 and VMware vRealize Automation. It outlines the key features of vRealize Orchestrator such as workflow development capabilities and integration with vRealize Automation. It also summarizes the main components and functions of vRealize Automation including self-service provisioning, policy-based governance, and integration with vRealize Orchestrator to enable custom services.
Acceleration Technology: Taking Media File Transfers From Days to MinutesFileCatalyst
Delivering and receiving digital content can be challenging - FTP is slow and unreliable, attachment size limits often prevent sending via email and shipping on physical storage solutions is costly and can take days to deliver. Factor in the growing size of today’s media files and the above mentioned methods of file transfer become an inefficient and disruptive processes to media workflows, especially over large geographical distances.
To ensure the effective and fast transfers of digital content, a strategy must be put in place for the swift reliable and secure delivery of files. Adopting a solution that prevents the file transfer bottlenecks commonly experienced when transferring large format media files is crucially important to media and broadcast organizations looking to make timely transfers when sharing files.
This presentation, originally presented at Broadcast India 2013, provides an understanding of the challenges and solutions associated with the agile and reliable delivery of digital content in today’s media and entertainment landscape, as well as an overview file transfer technologies optimizing user networks for cost-efficient IT processes. Also included in this presentation is a look at the technology behind accelerated file transfer, its benefits over other methods of file transfer, and an in depth look at why accelerated and managed file transfer should be considered in transferring today’s ever-growing digital media files.
Also see a video recording of this presentation from Broadcast India 2013 at the end of the presentation slides.
IT could resolve storage issues much faster with better visibility into the storage area network. VMware’s vCenter Operations improves storage operations by offering an extensible, flexible architecture.
Learn more about how VMware works with leading storage solutions to create single-pane-of-glass management. VMware’s storage partners include:
- EMC
- Hitachi
- NetApp
- HP
- Fujitsu
- IBM
- Dell
vCloud Automation Center 6.0 -My Notes on Architecturetechstarts
vCAC provides a single portal for self-service provisioning, management of cloud services, authoring and administration. It comes pre-configured on a virtual appliance with an embedded PostgreSQL database. For high availability, multiple vCAC instances can be load balanced and the database installed on separate servers in a clustered configuration.
Other key IaaS components include the IaaS website, manager service, DEM orchestrator/workers, agents and databases. The IaaS website, manager service and DEM orchestrator/workers are made highly available through load balancing and clustering. Agents integrate vCAC with external systems like vSphere and are installed separately.
The document provides hardware recommendations and design decisions for deploying vCAC in a
Diameter progress, popular use cases, roadmap - Mobicents Summit 2011telestax
This document summarizes progress on the Mobicents Diameter project, including use cases, architecture, roadmap reviews, and future plans. It discusses improvements in stability, performance and support for additional Diameter applications from 2010-2011. It also reviews successes and shortcomings against previous roadmap goals and previews the 2011-2012 roadmap.
Programmability and Automation in Data Center Networks: A talk on Hot Air Bal...Joel W. King
The document discusses a talk given on programmability and automation in data center networks. It covers topics like using Ansible, Jinja templates, and Excel spreadsheets to configure and automate Cisco Nexus and ACI networks. Specific points include using Ansible to deploy ACI fabrics using XML/JSON playbooks, understanding REST APIs and markup languages, and thinking like a programmer to improve network automation. The talk emphasizes that automation tools allow network engineers to focus on applications rather than infrastructure and help adopt a DevOps mindset for networking.
One tool, two fabrics: Ansible and Nexus 9000Joel W. King
Ansible can be used to automate configuration of Cisco Nexus 9000 series switches running either NX-OS or Application Centric Infrastructure (ACI). It allows using YAML files, Jinja templates, and Python modules to provision and manage network infrastructure without relying on CLI commands. The presentation demonstrated using Ansible roles to configure NTP servers and backup settings for an ACI fabric by specifying variables in a CSV file and generating XML configuration files from templates.
Oracle WebLogic Server 12.2.1 Do More with LessEd Burns
Oracle WebLogic Server 12.2.1 (WLS) is the most significant release of WLS since Oracle added WLS to its product portfolio with the acquisition of BEA in 2008. This session by WebLogic developer and JCP Specification Lead Ed Burns goes behind the buzzwords and explains the enterprise value-add brought by WLS 12.2.1 in plain English. Ed infuses his decades long experience in web technologies throughout the presentation, addressing such topics as why app servers are still useful, what role standards play in transitioning to the cloud, and what is the difference between "full stack" and "monolith".
See an interview about this topic at <https: />.
Ed introduces the new version of WLS by taking a tour of two big ticket new features: multitenancy and Java EE 7. Other features such as continuous availability, REST management, and Docker/devops features will also be included.
The multitenancy features in WebLogic Server offer extreme efficiency, full isolation, application portability, and full automation, all in an easy to adopt format.
Java EE 7 is the latest version of the Java standard full stack of loosely coupled, highly cohesive technologies for building enterprise software. EE 7 features new versions of popular standards such as JAX-RS (REST), CDI, Servlet, JSF, JSON, WebSocket, JMS, and more.
WLS 12.2.1 delivers these and other new features, while continuing the promise of stability and scale developers expect.
V mware virtualization design and deploy servicesolarisyougood
Here are the key points about the networking design:
- Software-defined networking with NSX provides network virtualization and automation.
- Logical "valves" segment and secure each network feed/connection point.
- Leaf-spine topology with distributed routing scales the network backbone.
- Edge cluster hosts gateways that securely route north-south traffic between corporate network, DMZ, and internet.
- Payload clusters focus on east-west workloads with isolated tenant networks.
- Management cluster provides centralized management and control plane.
The design logically segments and secures all network traffic flows while maintaining flexibility, performance, and scalability. Let me know if any part needs more explanation!
V mware v center orchestrator 5.5 knowledge transfer kitsolarisyougood
VMware vCenter Orchestrator 5.5 is a workflow automation tool that enables integration and automation of VMware solutions. It provides a graphical workflow development environment to easily create workflows using drag-and-drop actions. Workflows can automate VMware tasks, integrate VMware and third party systems, and orchestrate IT services and processes. The tool includes hundreds of pre-built actions and plugins to facilitate workflow development.
This document discusses TOSCA (Topology and Orchestration Specification for Cloud Applications), a standard for describing application deployment workflows in a portable way across multiple cloud platforms. It describes the key components of TOSCA including node types, node templates, relationship types, topology templates, policies, and workflows. TOSCA aims to automate and standardize the orchestration of installing, configuring, and deploying applications across different cloud environments and tools.
This document discusses challenges and potential solutions for automating inter-domain traffic engineering using BGP. It describes how BGP is used to exchange routing information between networks but has historically been difficult to use for traffic engineering. The document outlines the workflow of collecting data, simulating changes, optimizing traffic flows, and deploying changes. It discusses challenges with each step and how segment routing could help address some issues by allowing more granular control over internal and external paths. The document also covers differences between engineering egress versus ingress traffic and potential approaches for attracting more ingress traffic.
The document discusses different approaches for migrating from an older SeeBeyond eGate 4.5.X system to the newer Java CAPS platform. It describes using the Schema Run-time Environment (SRE) which allows running existing 4.X components without conversion. It also outlines the process of fully converting components to the new Java CAPS platform, including rewriting collaborations and business processes. The benefits and disadvantages of each approach are provided.
Enabling Microservices @Orbitz - DevOpsDays Chicago 2015Steve Hoffman
In this talk we discuss how we enabled decomposition of one of our 500+ system components into a continuously deployed microservice cluster using automated pipelines in jenkins with docker, mesos, & marathon
Enabling Microservice @ Orbitz - GOTO Chicago 2016Steve Hoffman
In this talk we will discuss how we enabled decomposition of one of our 500+ system components into a continuously deployed microservice cluster. Our platform is comprised of Apache Mesos/Marathon, Docker, and a number of local services including Consul for service discovery, Logstash for diskless logging, and a custom metrics forwarder to Graphite. Building on this, we'll detail our CI pipeline using Jenkins workflows to build and publish microservices as Docker images, test and deploy via Marathon/Mesos, and automated change tickets. Finally, we'll discuss lessons learned from building our own enterprise PaaS and scaling it out to a large organization.
SWIM MasterClass - Building SWIM B2B web services using Open StandardsDebbie Wilson
The document discusses building SWIM B2B web services using open standards to enable the interoperable exchange of ATM data. It describes creating a prototype that reduces the costs of creating and consuming SWIM services by implementing them using OGC web services and providing flexible, open APIs. The prototype connects to existing EAUP services and publishes the data through WFS, RESTful APIs, and a SOAP wrapper to demonstrate how standards-based services can encourage sharing of ATM data.
An application server is software that hosts web applications and provides additional services for them. Oracle uses WebLogic Server as its application server for Oracle Fusion Middleware. The document discusses deploying WebLogic Server on Oracle Database Appliance (ODA) hardware, which provides an integrated and automated setup of WebLogic Server and Oracle Real Application Clusters.
Read to learn what Mule Runtime Fabric (RTF) and Anypoint RTF are, how you can leverage these integration engines, the best adoption strategies, and the right way to conduct the risk-cost-benefit analysis for your business.
V mware v realize orchestrator 6.0 knowledge transfer kitsolarisyougood
This document provides an overview of VMware vRealize Orchestrator 6.0 and VMware vRealize Automation. It outlines the key features of vRealize Orchestrator such as workflow development capabilities and integration with vRealize Automation. It also summarizes the main components and functions of vRealize Automation including self-service provisioning, policy-based governance, and integration with vRealize Orchestrator to enable custom services.
Acceleration Technology: Taking Media File Transfers From Days to MinutesFileCatalyst
Delivering and receiving digital content can be challenging - FTP is slow and unreliable, attachment size limits often prevent sending via email and shipping on physical storage solutions is costly and can take days to deliver. Factor in the growing size of today’s media files and the above mentioned methods of file transfer become an inefficient and disruptive processes to media workflows, especially over large geographical distances.
To ensure the effective and fast transfers of digital content, a strategy must be put in place for the swift reliable and secure delivery of files. Adopting a solution that prevents the file transfer bottlenecks commonly experienced when transferring large format media files is crucially important to media and broadcast organizations looking to make timely transfers when sharing files.
This presentation, originally presented at Broadcast India 2013, provides an understanding of the challenges and solutions associated with the agile and reliable delivery of digital content in today’s media and entertainment landscape, as well as an overview file transfer technologies optimizing user networks for cost-efficient IT processes. Also included in this presentation is a look at the technology behind accelerated file transfer, its benefits over other methods of file transfer, and an in depth look at why accelerated and managed file transfer should be considered in transferring today’s ever-growing digital media files.
Also see a video recording of this presentation from Broadcast India 2013 at the end of the presentation slides.
IT could resolve storage issues much faster with better visibility into the storage area network. VMware’s vCenter Operations improves storage operations by offering an extensible, flexible architecture.
Learn more about how VMware works with leading storage solutions to create single-pane-of-glass management. VMware’s storage partners include:
- EMC
- Hitachi
- NetApp
- HP
- Fujitsu
- IBM
- Dell
vCloud Automation Center 6.0 -My Notes on Architecturetechstarts
vCAC provides a single portal for self-service provisioning, management of cloud services, authoring and administration. It comes pre-configured on a virtual appliance with an embedded PostgreSQL database. For high availability, multiple vCAC instances can be load balanced and the database installed on separate servers in a clustered configuration.
Other key IaaS components include the IaaS website, manager service, DEM orchestrator/workers, agents and databases. The IaaS website, manager service and DEM orchestrator/workers are made highly available through load balancing and clustering. Agents integrate vCAC with external systems like vSphere and are installed separately.
The document provides hardware recommendations and design decisions for deploying vCAC in a
Diameter progress, popular use cases, roadmap - Mobicents Summit 2011telestax
This document summarizes progress on the Mobicents Diameter project, including use cases, architecture, roadmap reviews, and future plans. It discusses improvements in stability, performance and support for additional Diameter applications from 2010-2011. It also reviews successes and shortcomings against previous roadmap goals and previews the 2011-2012 roadmap.
Programmability and Automation in Data Center Networks: A talk on Hot Air Bal...Joel W. King
The document discusses a talk given on programmability and automation in data center networks. It covers topics like using Ansible, Jinja templates, and Excel spreadsheets to configure and automate Cisco Nexus and ACI networks. Specific points include using Ansible to deploy ACI fabrics using XML/JSON playbooks, understanding REST APIs and markup languages, and thinking like a programmer to improve network automation. The talk emphasizes that automation tools allow network engineers to focus on applications rather than infrastructure and help adopt a DevOps mindset for networking.
One tool, two fabrics: Ansible and Nexus 9000Joel W. King
Ansible can be used to automate configuration of Cisco Nexus 9000 series switches running either NX-OS or Application Centric Infrastructure (ACI). It allows using YAML files, Jinja templates, and Python modules to provision and manage network infrastructure without relying on CLI commands. The presentation demonstrated using Ansible roles to configure NTP servers and backup settings for an ACI fabric by specifying variables in a CSV file and generating XML configuration files from templates.
Oracle WebLogic Server 12.2.1 Do More with LessEd Burns
Oracle WebLogic Server 12.2.1 (WLS) is the most significant release of WLS since Oracle added WLS to its product portfolio with the acquisition of BEA in 2008. This session by WebLogic developer and JCP Specification Lead Ed Burns goes behind the buzzwords and explains the enterprise value-add brought by WLS 12.2.1 in plain English. Ed infuses his decades long experience in web technologies throughout the presentation, addressing such topics as why app servers are still useful, what role standards play in transitioning to the cloud, and what is the difference between "full stack" and "monolith".
See an interview about this topic at <https: />.
Ed introduces the new version of WLS by taking a tour of two big ticket new features: multitenancy and Java EE 7. Other features such as continuous availability, REST management, and Docker/devops features will also be included.
The multitenancy features in WebLogic Server offer extreme efficiency, full isolation, application portability, and full automation, all in an easy to adopt format.
Java EE 7 is the latest version of the Java standard full stack of loosely coupled, highly cohesive technologies for building enterprise software. EE 7 features new versions of popular standards such as JAX-RS (REST), CDI, Servlet, JSF, JSON, WebSocket, JMS, and more.
WLS 12.2.1 delivers these and other new features, while continuing the promise of stability and scale developers expect.
V mware virtualization design and deploy servicesolarisyougood
Here are the key points about the networking design:
- Software-defined networking with NSX provides network virtualization and automation.
- Logical "valves" segment and secure each network feed/connection point.
- Leaf-spine topology with distributed routing scales the network backbone.
- Edge cluster hosts gateways that securely route north-south traffic between corporate network, DMZ, and internet.
- Payload clusters focus on east-west workloads with isolated tenant networks.
- Management cluster provides centralized management and control plane.
The design logically segments and secures all network traffic flows while maintaining flexibility, performance, and scalability. Let me know if any part needs more explanation!
V mware v center orchestrator 5.5 knowledge transfer kitsolarisyougood
VMware vCenter Orchestrator 5.5 is a workflow automation tool that enables integration and automation of VMware solutions. It provides a graphical workflow development environment to easily create workflows using drag-and-drop actions. Workflows can automate VMware tasks, integrate VMware and third party systems, and orchestrate IT services and processes. The tool includes hundreds of pre-built actions and plugins to facilitate workflow development.
This document discusses TOSCA (Topology and Orchestration Specification for Cloud Applications), a standard for describing application deployment workflows in a portable way across multiple cloud platforms. It describes the key components of TOSCA including node types, node templates, relationship types, topology templates, policies, and workflows. TOSCA aims to automate and standardize the orchestration of installing, configuring, and deploying applications across different cloud environments and tools.
This document discusses challenges and potential solutions for automating inter-domain traffic engineering using BGP. It describes how BGP is used to exchange routing information between networks but has historically been difficult to use for traffic engineering. The document outlines the workflow of collecting data, simulating changes, optimizing traffic flows, and deploying changes. It discusses challenges with each step and how segment routing could help address some issues by allowing more granular control over internal and external paths. The document also covers differences between engineering egress versus ingress traffic and potential approaches for attracting more ingress traffic.
The document discusses different approaches for migrating from an older SeeBeyond eGate 4.5.X system to the newer Java CAPS platform. It describes using the Schema Run-time Environment (SRE) which allows running existing 4.X components without conversion. It also outlines the process of fully converting components to the new Java CAPS platform, including rewriting collaborations and business processes. The benefits and disadvantages of each approach are provided.
Enabling Microservices @Orbitz - DevOpsDays Chicago 2015Steve Hoffman
In this talk we discuss how we enabled decomposition of one of our 500+ system components into a continuously deployed microservice cluster using automated pipelines in jenkins with docker, mesos, & marathon
Enabling Microservice @ Orbitz - GOTO Chicago 2016Steve Hoffman
In this talk we will discuss how we enabled decomposition of one of our 500+ system components into a continuously deployed microservice cluster. Our platform is comprised of Apache Mesos/Marathon, Docker, and a number of local services including Consul for service discovery, Logstash for diskless logging, and a custom metrics forwarder to Graphite. Building on this, we'll detail our CI pipeline using Jenkins workflows to build and publish microservices as Docker images, test and deploy via Marathon/Mesos, and automated change tickets. Finally, we'll discuss lessons learned from building our own enterprise PaaS and scaling it out to a large organization.
Slides from Orbitz's use case for microservices on docker & mesos at Velocity Santa Clara 2015 conference.
Details: http://velocityconf.com/web-mobile-business-conf-2015/public/schedule/detail/40700
Chicago Hadoop User Group (CHUG) Presentation on Apache Flume - April 9, 2014Steve Hoffman
Apache Flume is a distributed system for efficiently collecting, aggregating, and moving large amounts of log data from many different sources to a centralized data store such as Hadoop Distributed File System (HDFS). It consists of agents that collect data from sources and deliver it to sinks using channels. Common sources include log files, Kafka streams, and Avro clients. Common sinks include HDFS, HBase, Elasticsearch, and Kafka. Flume provides reliable and available service for efficiently collecting and moving large amounts of log data.
OSGi and Spring Data for simple (Web) Application DevelopmentChristian Baranowski
This document discusses using OSGi and Spring Data to develop simple web applications. It describes using Bndtools for OSGi application development and the enRoute project for getting started with OSGi. It provides an overview of using JPA and Spring Data with OSGi for the persistence layer. It also covers integrating Handlebars templates, Jersey MVC, and helpers for the web layer. Testing strategies using Spock are also summarized. Key technologies discussed include AngularJS, Jetty, OSGi, Spring Data JPA, and Spock.
Enabling Hybrid Workflows with Docker/Mesos @OrbitzSteve Hoffman
This document discusses using Mesos and Docker together at Orbitz to enable hybrid workflows. It describes three main use cases: 1) Using Mesos and Docker to run a microservices platform with multiple environments and datacenters, 2) Using Mesos and Docker slaves to build a Jenkins build farm, and 3) Using specialized Docker slaves to deploy apps from Jenkins to Marathon and other platforms. It provides examples of Dockerfiles used to create specialized slaves for building, deploying to AWS, and other tasks.
Similar to TS-2614 - Jini™ Network Technology-Enabled Service-Oriented Architecture, A Low-Cost Alternative to Enterprise JavaBeans™ (EJB™) Architecture
Developers must consider how stateful or stateless their web services are when deploying in a clustered environment like a server farm. Stateless services are easier to scale by adding nodes and have higher performance as they don't require preserving state between requests. If services are stateful, the service or middleware must handle failover and reconstructing state when requests are routed to different nodes.
Accelerating the Deployment of Practical, Programmable Transport NetworksDeborah Porchivina
The OIF and Carrier SDN: Accelerating the Deployment of Practical, Programmable Transport Networks
Speaker: Dave Brown, Alcatel-Lucent, OIF VP of Marketing
Service Fabric – building tomorrows applications todayBizTalk360
This session walks through incorporating Microsoft Service Fabric into your next application for zero downtime and upgradability. Microsoft have released the very same Azure Fabric smarts that look after for e.g. Azure VM management, into the Application space. Meaning your Apps can be based on the Actor model, highly distributed, scalable and in place upgrades with zero down time is now possible. Tapping into scale is key in this world of Cloud First, Device First world - can your apps handle the load? Bring the management of Azure to your application layer.
This document discusses designing microservices architectures. It begins by defining microservices as small, autonomous services that work together. The benefits of microservices include continuous innovation, independent deployments, and fault isolation. Challenges include complexity, testing, and service discovery. Key principles in designing microservices are modeling them around business domains, making each independently deployable, and decentralizing all components. Additional topics covered include service boundaries, communication patterns, data management, and monitoring microservices applications. The document provides examples and recommendations for implementing microservices on Azure.
This session will discuss MEF's Lifecycle Service Orchestration (LSO) requirements from ordering through service activation, including supporting APIs. We will also discuss how MEF is working with open source communities including OPNFV and Open Daylight to make LSO a reality.
TechWiseTV Workshop
(Original Webinar May 11, 2016, replay: http://cs.co/9005BoG6c
Cisco recently introduced Enterprise Network Functions Virtualization (NFV) as part of the digital network architecture: an architecture that allows you to transform your business to innovate more quickly, simplify operations, and reduce risk.
In this 60-minute workshop, we will deep dive into the technology behind Cisco Enterprise NFV. You’ll learn about the four components—orchestration and management, virtual network functions, virtualization layer, and the underlying hardware—and how all the components work together to provide a custom-fit solution for the enterprise. You will also see a demo of Enterprise Service Automation (ESA), the software-defined networking application that makes NFV all the easier for you to adopt.
Cisco Enterprise NFV will transform the way you think about the network and its services.
Watch the Workshop Replay: http://cs.co/9005BoG6c
Animation: 'Fundamentals of Enterprise NFV': http://bit.ly/ENFV_FUN
Watch the TechWiseTV DNA Episode, Part 1: https://youtu.be/TzGpNEfvMC8
Part 2: https://youtu.be/314-NyizsCA
PLNOG15 :Assuring Performance, Scalability and Reliability in NFV Deployments...PROIDEA
This document discusses testing methodologies for Network Function Virtualization (NFV) deployments. It begins with an agenda that includes testing NFV, existing test tools, and new NFV test methodologies. It then discusses challenges in NFV testing like portability, performance trade-offs, and network stability. New PASS testing methodologies are proposed to evaluate performance, availability, security, and scale of NFV deployments. Both hardware-based and virtual machine-based testing approaches are described, along with their advantages and limitations. Specific NFV testing use cases are outlined, such as convergence testing, migration impact testing, and auto-scaling testing.
PLNOG15 :Assuring Performance, Scalability and Reliability in NFV Deployments...Marta Pacyga
This document discusses testing methodologies for Network Function Virtualization (NFV) deployments. It begins with an agenda that includes testing NFV, existing test tools, and new NFV test methodologies. It then discusses challenges in NFV testing like portability, performance trade-offs, and network stability. New PASS methodologies are proposed to test performance, availability, security, and scale of NFV. Finally, the document compares hardware-based and virtual machine-based testing approaches and some sample NFV test methodologies.
Overview session of Microsoft's Azure Service Fabric Overview (v1.5.175), delivered at AzurePT community event in Lisbon, held March 26. The session describes all the main components of the platform, with a focus on its architecture.
1. The document discusses running NetflixOSS microservices on Docker locally and in the cloud. It demonstrates Docker local setup with Eureka for service discovery and Microscaler for auto scaling and recovery.
2. Key lessons from running SkyDNS and Eureka together for service discovery in Docker include that both work well but Eureka provides more application awareness while SkyDNS has looser coupling.
3. Microscaler is an open source auto scaling system developed to handle auto scaling, recovery, and version rolling for Docker local deployments, providing functionality similar to Amazon Auto Scaling and RightScale for Docker environments.
1. The document describes a Docker implementation of NetflixOSS microservices on IBM SoftLayer.
2. Key aspects discussed include networking Docker containers across multiple SoftLayer datacenters, managing the Docker API across multiple hosts, and integrating Docker images with SoftLayer image management.
3. Lessons learned include the need for a proxy for the Docker remote API across multiple hosts, and approaches for keeping Docker advantages like image portability when integrating with an IaaS platform.
Container Orchestration with Traefk on Docker SwarmJakub Hajek
The presentation contains details of how to set up a fully-fledged environment based on Docker Swarm and Traefk. You will see a multi-tier application stack consisting of Edge router running in the first layer, then the frontend application and NodeJS backend. This is a quite common setup used in a microservices architecture. If you are building a high available environment without a single point of failure, it can be interesting for you.
The source code used in the presentation: https://github.com/jakubhajek/traefik-consul-swarm
Oif at iir_next_genopticalnetworking_nice_22june15_jmcdonoughDeborah Porchivina
This document summarizes the OIF's work on software-defined networking (SDN) for transport networks. It discusses why transport networks need SDN to simplify management and enable rapid service provisioning. It also outlines challenges to SDN deployment and the OIF's efforts to address these challenges through a reference architecture, requirements documentation, demonstrations, and implementation agreements. The overall goal is to accelerate SDN adoption through multi-vendor interoperability testing and guidance for applying SDN concepts across multiple network domains.
Introducing ONAP for OpenStack St Louis Meetupdjzook
An introduction to the Open Networking Automation Platform (ONAP) a new Linux Foundation Project for SDN/NFV, as presented to the OpenStack St Louis Meetup on June 20, 2017
My @TriangleDevops talk from 2013-10-17. I covered the work that led us to @NetflixOSS (Acme Air), the work we did on the cloud prize (NetflixOSS on IBM SoftLayer/RightScale) and the @NetflixOSS platform (Karyon, Archaius, Eureka, Ribbon, Asgard, Hystrix, Turbine, Zuul, Servo, Edda, Ice, Denominator, Aminator, Janitor/Conformity/Chaos Monkeys of the Simian Army).
This document discusses microservices and Azure Service Fabric. It provides an overview of architectural evolutions from monolithic to service-oriented to microservices. Azure Service Fabric is presented as a platform for developing microservices that provides high availability, scalability and reliability. Key concepts are defined including nodes, clusters, stateful and stateless services. The presentation concludes with a demonstration of creating an Azure Service Fabric cluster and deploying an application.
Pace of Innovation at AWS - London Summit Enteprise Track RePlayAmazon Web Services
In this session we will present some of the stories around innovation in the Amazon Web Services Datacenter including how it partners with other vendors in the hardware space.
Stay productive while slicing up the monolithMarkus Eisele
The document discusses strategies for evolving monolithic applications into microservice architectures. It notes that modern software needs to meet increasing demands around release frequency, developer velocity, and infrastructure costs. While classical architectures based on monoliths and service-oriented architectures were effective, they no longer address today's challenges. The document then introduces microservices as an alternative, describing characteristics like independent deployability, language/data agnosticism, and process isolation. It acknowledges that while building individual microservices is straightforward, the difficult part is designing the overall system architecture and operational capabilities required to manage many interconnected microservices. Lagom is presented as one framework that can help implement reactive microservices on the JVM.
Andrew Spyker presented on Netflix's cloud platform and open source projects. Some key points included:
- Netflix has migrated from monolithic architectures to microservices and continuous delivery enabled by their open source libraries and services.
- Their platform focuses on elasticity, high availability through automation, and operational visibility.
- Netflix uses technologies like Eureka, Ribbon, Hystrix, and Servo to enable scalability, resilience, and monitoring across their distributed systems.
- They contribute over 50 open source projects to help others adopt their cloud-native approaches and are working on data and UI related projects.
Similar to TS-2614 - Jini™ Network Technology-Enabled Service-Oriented Architecture, A Low-Cost Alternative to Enterprise JavaBeans™ (EJB™) Architecture (20)
Slides for Jan 29, 2020 Chicago Rust Meetup talk where I discuss using Rust based Lambdas in AWS. I don't believe the talk is being recorded so might not make 100% sense, but left links on most pages for more info. Hope this is useful to folks.
Nerd Out with Hadoop: A Not-So-Basic Introduction to the PlatformSteve Hoffman
This document provides an introduction to the Hadoop platform and its components. It discusses HDFS for distributed file storage, MapReduce for parallel processing, Hive for SQL-like queries, HBase for column-oriented storage, and Dremel/Impala/Drill for fast SQL queries. It also provides examples of using Hadoop with open UFO sightings data, including importing the data, analyzing it with Hive, and visualizing locations on a map. The document is aimed at providing a practical introduction to Hadoop concepts and hands-on experience with an interesting real-world dataset.
Combating DNS Exfiltration in AWS - AWS Midwest Community Day 2018Steve Hoffman
Slides from AWS Midwest Community Day presentation on DNS Exfiltration in Amazon Web Services and some things you can do to protect yourself - June 7, 2018
Combating DNS Exfiltration in AWS - BSidesChicago 2018Steve Hoffman
Slides from BSidesChicago (https://bsideschicago.org/) presentation on DNS Exfiltration in Amazon Web Services and some things you can do to protect yourself - May 12, 2018
How Open Source is Transforming the Internet. Again.Steve Hoffman
The document discusses how open source software is transforming the internet and addressing challenges of complexity, scale, and continuous delivery in large internet applications. It outlines the history of computing and the internet, challenges of devops at large companies, and how open source approaches are needed to meet these challenges through rapid innovation and adaptation. The document also discusses how large enterprises can help sustain the open source software ecosystem through contributions of code, bug reports, hiring consultants, and participating in communities.
flAWS Walkthrough - AWS Chicago Meetup 8/8/2017Steve Hoffman
Slides from a walkthrough of the https://flaws.cloud/ puzzle. I highly recommend you try the puzzle and read the hints and assoicated links before looking at the answers!
Have fun!
A Comprehensive Guide to DeFi Development Services in 2024Intelisync
DeFi represents a paradigm shift in the financial industry. Instead of relying on traditional, centralized institutions like banks, DeFi leverages blockchain technology to create a decentralized network of financial services. This means that financial transactions can occur directly between parties, without intermediaries, using smart contracts on platforms like Ethereum.
In 2024, we are witnessing an explosion of new DeFi projects and protocols, each pushing the boundaries of what’s possible in finance.
In summary, DeFi in 2024 is not just a trend; it’s a revolution that democratizes finance, enhances security and transparency, and fosters continuous innovation. As we proceed through this presentation, we'll explore the various components and services of DeFi in detail, shedding light on how they are transforming the financial landscape.
At Intelisync, we specialize in providing comprehensive DeFi development services tailored to meet the unique needs of our clients. From smart contract development to dApp creation and security audits, we ensure that your DeFi project is built with innovation, security, and scalability in mind. Trust Intelisync to guide you through the intricate landscape of decentralized finance and unlock the full potential of blockchain technology.
Ready to take your DeFi project to the next level? Partner with Intelisync for expert DeFi development services today!
Best 20 SEO Techniques To Improve Website Visibility In SERPPixlogix Infotech
Boost your website's visibility with proven SEO techniques! Our latest blog dives into essential strategies to enhance your online presence, increase traffic, and rank higher on search engines. From keyword optimization to quality content creation, learn how to make your site stand out in the crowded digital landscape. Discover actionable tips and expert insights to elevate your SEO game.
HCL Notes and Domino License Cost Reduction in the World of DLAUpanagenda
Webinar Recording: https://www.panagenda.com/webinars/hcl-notes-and-domino-license-cost-reduction-in-the-world-of-dlau/
The introduction of DLAU and the CCB & CCX licensing model caused quite a stir in the HCL community. As a Notes and Domino customer, you may have faced challenges with unexpected user counts and license costs. You probably have questions on how this new licensing approach works and how to benefit from it. Most importantly, you likely have budget constraints and want to save money where possible. Don’t worry, we can help with all of this!
We’ll show you how to fix common misconfigurations that cause higher-than-expected user counts, and how to identify accounts which you can deactivate to save money. There are also frequent patterns that can cause unnecessary cost, like using a person document instead of a mail-in for shared mailboxes. We’ll provide examples and solutions for those as well. And naturally we’ll explain the new licensing model.
Join HCL Ambassador Marc Thomas in this webinar with a special guest appearance from Franz Walder. It will give you the tools and know-how to stay on top of what is going on with Domino licensing. You will be able lower your cost through an optimized configuration and keep it low going forward.
These topics will be covered
- Reducing license cost by finding and fixing misconfigurations and superfluous accounts
- How do CCB and CCX licenses really work?
- Understanding the DLAU tool and how to best utilize it
- Tips for common problem areas, like team mailboxes, functional/test users, etc
- Practical examples and best practices to implement right away
GraphRAG for Life Science to increase LLM accuracyTomaz Bratanic
GraphRAG for life science domain, where you retriever information from biomedical knowledge graphs using LLMs to increase the accuracy and performance of generated answers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providersakankshawande
Simplify your search for a reliable Python development partner! This list presents the top 10 trusted US providers offering comprehensive Python development services, ensuring your project's success from conception to completion.
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc
How does your privacy program stack up against your peers? What challenges are privacy teams tackling and prioritizing in 2024?
In the fifth annual Global Privacy Benchmarks Survey, we asked over 1,800 global privacy professionals and business executives to share their perspectives on the current state of privacy inside and outside of their organizations. This year’s report focused on emerging areas of importance for privacy and compliance professionals, including considerations and implications of Artificial Intelligence (AI) technologies, building brand trust, and different approaches for achieving higher privacy competence scores.
See how organizational priorities and strategic approaches to data security and privacy are evolving around the globe.
This webinar will review:
- The top 10 privacy insights from the fifth annual Global Privacy Benchmarks Survey
- The top challenges for privacy leaders, practitioners, and organizations in 2024
- Key themes to consider in developing and maintaining your privacy program
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUpanagenda
Webinar Recording: https://www.panagenda.com/webinars/hcl-notes-und-domino-lizenzkostenreduzierung-in-der-welt-von-dlau/
DLAU und die Lizenzen nach dem CCB- und CCX-Modell sind für viele in der HCL-Community seit letztem Jahr ein heißes Thema. Als Notes- oder Domino-Kunde haben Sie vielleicht mit unerwartet hohen Benutzerzahlen und Lizenzgebühren zu kämpfen. Sie fragen sich vielleicht, wie diese neue Art der Lizenzierung funktioniert und welchen Nutzen sie Ihnen bringt. Vor allem wollen Sie sicherlich Ihr Budget einhalten und Kosten sparen, wo immer möglich. Das verstehen wir und wir möchten Ihnen dabei helfen!
Wir erklären Ihnen, wie Sie häufige Konfigurationsprobleme lösen können, die dazu führen können, dass mehr Benutzer gezählt werden als nötig, und wie Sie überflüssige oder ungenutzte Konten identifizieren und entfernen können, um Geld zu sparen. Es gibt auch einige Ansätze, die zu unnötigen Ausgaben führen können, z. B. wenn ein Personendokument anstelle eines Mail-Ins für geteilte Mailboxen verwendet wird. Wir zeigen Ihnen solche Fälle und deren Lösungen. Und natürlich erklären wir Ihnen das neue Lizenzmodell.
Nehmen Sie an diesem Webinar teil, bei dem HCL-Ambassador Marc Thomas und Gastredner Franz Walder Ihnen diese neue Welt näherbringen. Es vermittelt Ihnen die Tools und das Know-how, um den Überblick zu bewahren. Sie werden in der Lage sein, Ihre Kosten durch eine optimierte Domino-Konfiguration zu reduzieren und auch in Zukunft gering zu halten.
Diese Themen werden behandelt
- Reduzierung der Lizenzkosten durch Auffinden und Beheben von Fehlkonfigurationen und überflüssigen Konten
- Wie funktionieren CCB- und CCX-Lizenzen wirklich?
- Verstehen des DLAU-Tools und wie man es am besten nutzt
- Tipps für häufige Problembereiche, wie z. B. Team-Postfächer, Funktions-/Testbenutzer usw.
- Praxisbeispiele und Best Practices zum sofortigen Umsetzen
This presentation provides valuable insights into effective cost-saving techniques on AWS. Learn how to optimize your AWS resources by rightsizing, increasing elasticity, picking the right storage class, and choosing the best pricing model. Additionally, discover essential governance mechanisms to ensure continuous cost efficiency. Whether you are new to AWS or an experienced user, this presentation provides clear and practical tips to help you reduce your cloud costs and get the most out of your budget.
Monitoring and Managing Anomaly Detection on OpenShift.pdfTosin Akinosho
Monitoring and Managing Anomaly Detection on OpenShift
Overview
Dive into the world of anomaly detection on edge devices with our comprehensive hands-on tutorial. This SlideShare presentation will guide you through the entire process, from data collection and model training to edge deployment and real-time monitoring. Perfect for those looking to implement robust anomaly detection systems on resource-constrained IoT/edge devices.
Key Topics Covered
1. Introduction to Anomaly Detection
- Understand the fundamentals of anomaly detection and its importance in identifying unusual behavior or failures in systems.
2. Understanding Edge (IoT)
- Learn about edge computing and IoT, and how they enable real-time data processing and decision-making at the source.
3. What is ArgoCD?
- Discover ArgoCD, a declarative, GitOps continuous delivery tool for Kubernetes, and its role in deploying applications on edge devices.
4. Deployment Using ArgoCD for Edge Devices
- Step-by-step guide on deploying anomaly detection models on edge devices using ArgoCD.
5. Introduction to Apache Kafka and S3
- Explore Apache Kafka for real-time data streaming and Amazon S3 for scalable storage solutions.
6. Viewing Kafka Messages in the Data Lake
- Learn how to view and analyze Kafka messages stored in a data lake for better insights.
7. What is Prometheus?
- Get to know Prometheus, an open-source monitoring and alerting toolkit, and its application in monitoring edge devices.
8. Monitoring Application Metrics with Prometheus
- Detailed instructions on setting up Prometheus to monitor the performance and health of your anomaly detection system.
9. What is Camel K?
- Introduction to Camel K, a lightweight integration framework built on Apache Camel, designed for Kubernetes.
10. Configuring Camel K Integrations for Data Pipelines
- Learn how to configure Camel K for seamless data pipeline integrations in your anomaly detection workflow.
11. What is a Jupyter Notebook?
- Overview of Jupyter Notebooks, an open-source web application for creating and sharing documents with live code, equations, visualizations, and narrative text.
12. Jupyter Notebooks with Code Examples
- Hands-on examples and code snippets in Jupyter Notebooks to help you implement and test anomaly detection models.
Building Production Ready Search Pipelines with Spark and MilvusZilliz
Spark is the widely used ETL tool for processing, indexing and ingesting data to serving stack for search. Milvus is the production-ready open-source vector database. In this talk we will show how to use Spark to process unstructured data to extract vector representations, and push the vectors to Milvus vector database for search serving.
Programming Foundation Models with DSPy - Meetup SlidesZilliz
Prompting language models is hard, while programming language models is easy. In this talk, I will discuss the state-of-the-art framework DSPy for programming foundation models with its powerful optimizers and runtime constraint system.
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfChart Kalyan
A Mix Chart displays historical data of numbers in a graphical or tabular form. The Kalyan Rajdhani Mix Chart specifically shows the results of a sequence of numbers over different periods.
Taking AI to the Next Level in Manufacturing.pdfssuserfac0301
Read Taking AI to the Next Level in Manufacturing to gain insights on AI adoption in the manufacturing industry, such as:
1. How quickly AI is being implemented in manufacturing.
2. Which barriers stand in the way of AI adoption.
3. How data quality and governance form the backbone of AI.
4. Organizational processes and structures that may inhibit effective AI adoption.
6. Ideas and approaches to help build your organization's AI strategy.
TS-2614 - Jini™ Network Technology-Enabled Service-Oriented Architecture, A Low-Cost Alternative to Enterprise JavaBeans™ (EJB™) Architecture
1. java.sun.com/javaone/sf
| 2004 JavaOneSM
Conference | Session TS-26141
Jini™ Network
Technology-Enabled
Service-Oriented
Architecture
Leon Chism/Steve Hoffman
Chief Internet Architect/Engineering Fellow
Orbitz
www.orbitz.com
A Low-Cost Alternative to
Enterprise JavaBeans™ (EJB™)
Architecture
2. | 2004 JavaOneSM
Conference | Session TS-26142
Goal
Increase your understanding of Jini™
network technology distributed computing
architectures, how they can facilitate
competitive advantage, and how they can
be used to replace/augment more
expensive alternatives.
3. | 2004 JavaOneSM
Conference | Session TS-26143
Orbitz’s Commitment to
Jini™ Network Technology
Or why am I listening to you?
• Orbitz runs over 1300 Jini™ services used by
over 300 client VMs
• Orbitz’ Jini™ network technology-based
architecture powers Orbitz.com, AA.com and
NWA.com, making it one of the highest-volume
processors of airline tickets
• Jini™ services have achieved 99+% uptime
(best uptime of all sub-systems at Orbitz)
6. | 2004 JavaOneSM
Conference | Session TS-26146
Orbitz Overview
• Founded in 2000 by 5 leading airlines
• Site launched in 2001
• Top 3 brand travel site in just over two years
• 22 MM registered users and strong
monthly traffic
• Poised to extend
strength in air to
other products
• Positive cash flow
from operations
since Q4 2002
• Public offering
on 12/17/03
7. | 2004 JavaOneSM
Conference | Session TS-26147
2001
Orbitz
8%
Expe
dia
31%
Other
28%
Travel
ocity
33%
Rapidly Approaching #2 Position
Based on gross travel bookings
Source: PhoCusWright
Jan 1–Jun 30 2003
Orbitz
17%
Expe
dia
40%
Other
23%
Travel
ocity
20%
8. | 2004 JavaOneSM
Conference | Session TS-26148
Architectural Drivers
• Low-cost distributor
• Speed to market is critical
• Flexibility of the application
• Robustness
─Availability
─Reliability
11. | 2004 JavaOneSM
Conference | Session TS-261411
Orbitz Architecture
Mile-high view
Presentation /
State / Persistence
Webapp
Web Services
IVR / Messaging
Apache
Weblogic
Oracle
Generic
Services
Air Services
Hotel Services
Car Services
Supplier—
Specific Services
GDS X Service
Airline X Service
Airline Y Service
GDS Y Service
Hotel Switch X Service
Hotel Switch Y Service
Jini wrappers
around legacy
systems and
internally hosted
J2EE systems
13. | 2004 JavaOneSM
Conference | Session TS-261413
SLONEGOrbitz.com
WebLogic
App Server
ONEG
Server
Logging
Service
Wspan
AA
CO
NW
HP
US
Pegs
TWeb
Discover Publish Publish
Log Log Log
Discover
ONeG—The Big Switch
Putting it all together
LUS
LUS
LUS
Logging
Service
LUS
LUS
LUS
LUS
Logging
Service
Logging
Service
Logging
Service
Logging
Service
Log
WebLogic
App Server
WebLogic
App Server
WebLogic
App Server
WebLogic
App Server
WebLogic
App Server
Hotel-
Oneg
Server
Other
Services
Other
Services
Other
Services
ONEG
Server
ONEG
Server
ONEG
Server
14. | 2004 JavaOneSM
Conference | Session TS-261414
ONeG—Design Decisions
• Client could have contacted host specific
services directly
• Was decided to put failure/retry logic in
the booking engine, not push on the client
due to hot reconfiguration requirements
• Business event logging at ONeG layer
• Use network layer security to restrict
access to supplier specific layer
Switch or router?
15. | 2004 JavaOneSM
Conference | Session TS-261415
High-Level Architecture Diagram
Novo System
(incl. orbitz.com
AA
Hosting
System
(connects only to
Sabre AA)
aa.com
Orbitz
Supplier
Link
System
nw a.com
JiniSLServicesi/f
JiniSLServicesi/f
NW
Hosting
System
(connects only to
WorldSpan)
JiniSLServicesi/f
ONeG / Hotel
(Rate request,
content,
search)
JiniSLServicesi/f
Kinetics
Shares
CO
HP
1P
World
Span
(NW)
Bookings DB
Site
DB
Orbitz
Merchant
Hotels
(OMH)
Pegasus
(external)
JiniSLServicesi/f
Sabre
AA
US
Notification
Jinii/f
Kinetics
Servleti/f
SMTP
Service
Notshown
Reporting
Monitoring/mgt/admin
Customer Care
Other agent desktop usage
Gatew ay
Partners
Advertising
Represents request/response where the
request is made in the indicated direction
ITA
Clear
Commerce
RPS
ONeG
(Air, Car,
Hotel
Bookings)
IVR
Service
"Public"HTTPi/f
Fulf illment
Serv leti/f
Hotel
Reference
Hotel DB
(Rate Cache)
Internet
Smart
Proxy
Jinisurrogate
Notif ica
-tion
Serv er
Web-siteFront-ends SupplierSystem "Third-parties"
OAG
Flifo
Servleti/f
Flif o
Serv er
Flif o
Jinii/f
J2EE
Jini
16. | 2004 JavaOneSM
Conference | Session TS-261416
The General Idea
Combine common set of objects, service
interfaces and JiniSM
services to create
blocks of reusable functionality.
17. | 2004 JavaOneSM
Conference | Session TS-261417
The General Idea (Cont.)
• Common objects
─AIRPORT
─CARRIER
• Service interfaces
─LowFareSearchRequest
─AirPurchaseRequest
• Mask framework details with simple Factory
─ServiceImpl =
OrbitzFactory.get(serviceInterface);
• Simple configuration (at least for client)
─VersionAttribute String
─List of lookup servers OR list of multicast groups
18. | 2004 JavaOneSM
Conference | Session TS-261418
The General Idea (Cont.)
• Response (and objects contained) are
core objects or interfaces are immutable
• Underlying implementations typically have
much more information than is exposed
to client
• Services are all transient and non-activatable
hence completely interchangeable
• No transactions
Things to note:
20. | 2004 JavaOneSM
Conference | Session TS-261420
Say What? Show Me a Picture….
req = OrbitzFactory.get(FooRequest);
req.setXXX(xxx);
ObjectFactory
Jini Service
http codebase
server
FooRequestImpl
resp = req.execute();
resp.getYYY();
remote = OrbitzFactory.get(FooRemote);
return remote.execute(req);
FooRemote
Jini Service
FooResponseImpl
21. | 2004 JavaOneSM
Conference | Session TS-261421
Let’s See More Code!
• Startup
ServerStarter.start();
SampleService ss = new SampleServiceImpl();
// SampleServiceImpl extends UnicastRemoteObject
// Need to run rmic to generate _Stub class
DiscoveryManagment ldm =
ServerStarter.getDiscoveryManager();
// Most likely LookupDiscoveryManager
JoinManager jm = new JoinManager(ss, attributes,
null, ldm, null);
// attributes is an Entry[] which includes
// things like VersionAttribute
Publishing a Service (Jini 1.X)
22. | 2004 JavaOneSM
Conference | Session TS-261422
Let’s See More Code!
• Shutdown
UnicastRemoteObject.unexport(ss, false);
jm.terminate();
ServerStarter.stop();
Publishing a Service (Jini 1.X) (cont.)
24. | 2004 JavaOneSM
Conference | Session TS-261424
Jini™ Technology Benefits
• Designed to expect network failure
(not ignore that it happens)
• Multicast discovery mechanism of
Lookup Server ensures <1 minute
discovery (heartbeat)
• Services come and go. Have many
places to go to get serviced
Self-healing
25. | 2004 JavaOneSM
Conference | Session TS-261425
Jini™ Technology Benefits
• LookupCache and
ServiceDiscoveryManager use random
selection when single service is requested
and there are multiple matches
• Over time this results in an even load
distribution of load on identical services
Automatic load balancing
26. | 2004 JavaOneSM
Conference | Session TS-261426
Jini™ Technology Benefits
• Capacity is directly related to the number of
places a client can go to fulfil a service request
• If you need more capacity of a particular
service, just start more instances
• Each LookupCache gets notified of new
service and load is redistributed across
new set
Horizontal scalability
27. | 2004 JavaOneSM
Conference | Session TS-261427
Jini™ Technology Benefits
• Easy to publish a service
• Easy to find a service
• Catch RemoteException and discard
proxy when something goes wrong
Lightweight
29. | 2004 JavaOneSM
Conference | Session TS-261429
Distributed Computing Pitfalls
• We don’t use remote objects
• No way to turn it off in JRMP
implementation of RMI (Jini versions 1.X)
• Default 1 minute DGC interval kills any
heap optimizations
• Accounts for anywhere between 50-75%
of the threads in our system
RMI Distributed Garbage Collection
30. | 2004 JavaOneSM
Conference | Session TS-261430
Distributed Computing Pitfalls
• Make DGC interval longer or disable
explicit GC (we saw a 1.5% improvement
in VM throughput when using
-XX:+DisableExplicitGC—
time spent running code vs doing GC)
• Upgrade to Jini 2.X and use JERI so
we can disable DGC
RMI DGC—possible remedies
31. | 2004 JavaOneSM
Conference | Session TS-261431
Distributed Computing Pitfalls
• Contributed implementation designed to wait
until things aren’t changing before answering
• Implemented with big reader’s/writer lock
• Not common, but annoying when
LookupCache/ServiceDiscoveryManager drops
all discovered services when lease
to lookup server cannot be renewed
Reggie lockouts
32. | 2004 JavaOneSM
Conference | Session TS-261432
Distributed Computing Pitfalls
• Longer lease times
• Custom implementation of lookup server that
doesn’t have reader’s/writer lock. Won’t get
best picture of state of services, but isn’t
necessary in our system
Reggie lockouts—possible remedies
33. | 2004 JavaOneSM
Conference | Session TS-261433
Distributed Computing Pitfalls
• If a machine gets slow, random selection will
eventually put all requests on the slow machine
• Also a problem in heterogeneous environments
Randomized load balancing
34. | 2004 JavaOneSM
Conference | Session TS-261434
Distributed Computing Pitfalls
• Switch from sync. calls to async so a
push to a service becomes a pull.
Use a JavaSpaces™ or JMS™ queue
• Publish Attribute with notion of relative
capacity in conjunction with
ServiceItemFilter on client side to
adjust spread of service calls more in-line
with machine’s relative abilities
Randomized load balancing—possible remedies
35. | 2004 JavaOneSM
Conference | Session TS-261435
Distributed Computing Pitfalls
• LookupCache uses event notification to
keep local VM cache up to date
• If large number of clients/lookup
servers/services, the math gets big—e.g.:
─100 app servers (service clients) * 2 lookup servers
* 30 services/VM * 20 VMs = 120,000 messages
• Contributed implementation of Lookup Server
does in-order delivery of notifications which
involves a linear scan of a single list of
messages to send out
Event storming using the LookupCache
36. | 2004 JavaOneSM
Conference | Session TS-261436
Distributed Computing Pitfalls
• Custom LookupCache that doesn’t use
event notifications:
─Every client probably doesn’t need more than 3-4
places to go for a particular service type at any time
─Auto-expire entries based on time or number of
calls to get same randomization
─Backfill with more services as current ones
become invalid
• Custom Lookup Server with event module
optimized for throughput of in-order event
notification
Event storming—remedies
37. | 2004 JavaOneSM
Conference | Session TS-261437
Distributed Computing Pitfalls
• Coarser grained services
─Group services living in single VM
(usually due to resource sharing i.e. DB pool)
into single (or fewer) Jini™ service(s).
Fewer event notifications to be sent
• Partitioning of service registrations
─Group service registrations to reduce the
number of messages sent by a single
instance of the Lookup Server
Event storming—remedies (cont.)
38. | 2004 JavaOneSM
Conference | Session TS-261438
Jini™ and J2EE™
• Have Jini environment, but want to
introduce some J2EE™ servers
(or vice-versa). What do you do?
• Deploy webapp that publishes Jini™
service interface similar to EJB™ interface,
but service impl makes EJB local call
• Jini service lookups take the place of
JNDI lookups
─Multiple copies give same result as
clustered directory service
─Can live side-by-side with other APIs:
XML/SOAP, JNDI EJB lookup, etc.
Two great tastes that go great together
40. | 2004 JavaOneSM
Conference | Session TS-261440
What’s Next?
• JERI
─Disable distributed garbage collection
─Plugable transports (UDP, SSL)
• Security (per service)
─Authorization
─Authentication
─Replace 2 layers of Jini services with 1
now that we can isolate/restrict access
to services individually
Jini 2.X upgrade
41. | 2004 JavaOneSM
Conference | Session TS-261441
Let’s See More Code!
• Startup
ServerStarter.start();
SampleService ss = new SampleServiceImpl();
// SampleServiceImpl implements Remote
Exporter e = new BasicJeriExporter(
TCPServerEndpoint.getInstance(0),
new BasicILFactory());
Remote stub = e.export(ss);
DiscoveryManagment ldm =
ServerStarter.getDiscoveryManager();
JoinManager jm = new JoinManager(stub, attributes,
null, ldm, null);
Publishing a Service (Jini 2.X)
42. | 2004 JavaOneSM
Conference | Session TS-261442
Let’s See More Code! (Cont.)
• Shutdown
e.unexport(stub);
jm.terminate();
ServerStarter.stop();
Publishing a Service (Jini 2.X)
43. | 2004 JavaOneSM
Conference | Session TS-261443
What’s Next? (Cont.)
• If Jini services use downloaded code,
why can’t all the code be downloadable?
• Introduce standard deployment platform
utilizing benefits of transportable byte-code
─Reconfigure capacity as needed
─Ease deployment across many machines
• Interesting work along these lines:
─Rio—http://rio.jini.org/
─Jini Service Container—http://chiron.jini.org/
Dynamic redeployment
44. | 2004 JavaOneSM
Conference | Session TS-261444
What’s Next? (Cont.)
• Perhaps change from sync-client-push
to async-server-pull model
─Using JavaSpaces™
─Using JMS™ queue
• Would keep servers from getting
overloaded since they wouldn’t pull
more work than they could handle
• Could have a more heterogeneous
environment of hardware while
maximizing utilization
• Downside is introducing a single point
of failure if the space/queue isn’t really
fault-tolerant
Asynchronous messaging
46. | 2004 JavaOneSM
Conference | Session TS-261446
Summary
• Try Jini™ services its:
─A great way for distributed applications to
discover and communicate with each other
─Lightweight, flexible, adaptable, self-healing
─Production ready
─The best kept secret in the Java™ community
program
• J2EE™ platform is not the solution for
every problem
47. | 2004 JavaOneSM
Conference | Session TS-261447
For More Information
• http://www.orbitz.com/
• http://www.jini.org/
─Strong and helpful community group. Presentations
from 7th community meeting are online for free
─Mailing list/archives
─Download Jini 2.0
• http://research.sun.com/techrep/1994/abstract-
29.html (A Note On Distributed Computing)
• Core Jini, W. Keith Edwards
─ISBN: 0130894087 (Jini 1.X)
• Hard Landing, Thomas Petzinger Jr.
─ISBN: 0812928350 (Airline lore)