More Related Content
Similar to WHISHWORKS-MuleSoft Hyderabad Meetup -April 2019 (20)
More from Coforge (Erstwhile WHISHWORKS) (14)
WHISHWORKS-MuleSoft Hyderabad Meetup -April 2019
- 1. From Docker to Big Data,
it's all about the Mule!
#MuleSoftMeetup
Hyderabad, 27 April 2019
- 2. All contents © MuleSoft Inc.
Agenda
2
• Introductions
• Mule 4 implementation case study
• Anypoint Runtime Fabric
• Big Data in the MuleSoft world
• Q&A Session
• What’s next
- 3. All contents © MuleSoft Inc.
Speakers
3
• Shashidhar Gurumurthy :: Technical Enablement Director (MULESOFT)
• Sudarsana Raju :: AVP, Delivery (WHISHWORKS)
• Mahesh Raja :: Technical Architect (WHISHWORKS)
• Rupesh Sinha :: Technical Architect (WHISHWORKS)
• Sanjeet Pandey :: Technical Architect (WHISHWORKS)
• Raveendar Bandaru :: Technical Success Manager (WHISHWORKS)
- 5. All contents © MuleSoft Inc.
Community Meetups
5
• 103+ Groups across the globe
• 120+ MuleSoft Community Meetups were held
across 30+ countries in 2018
• 5000+ attendees participated
• Already hits the ground sprinting with 27+
events scheduled so far in 2019
• A separate Community Meetup Booth in the
MuleSoft Connect
• Interested in speaking at a Meetup or being
involved in the organization?
meetups@mulesoft.com
- 7. All contents © MuleSoft Inc.
Introduction
7
Meetup Organizer and sponsor:
– WHISHWORKS
• A MuleSoft integration and Big Data specialist, helps businesses succeed in
their digital transformation journeys and monetise their data
• Best Service Delivery partner (EMEA)
• 5x MuleSoft partner award winner 2015-2018
• 300+ MuleSoft Certifications
• 100+ Successful MuleSoft Implementations
• 5000+ APIs
• 5 MuleSoft Certified Connectors
- 9. All contents © MuleSoft Inc.
• 30 years of operation
• 80 Stores across UK and Ireland
• 200 concessions
• Trade in 27 countries
• Multi-channel, multi-location strategy
9
Large fashion retailer
- 10. All contents © MuleSoft Inc. 10
• Rigid and difficult to support point-to-
point connections
• Siloed data and legacy systems impact
time-to-market capabilities
• Long concession partner onboarding
process (3-6 months)
• Increased manual work leading to
operational inefficiencies
The Challenge
- 12. All contents © MuleSoft Inc. 12
Discovery phase
• Study of the AS-IS landscape and
business requirements, including
existing problems and challenges.
• Creation of a TO-BE reference
architecture based on CloudHub.
• Single concession partner
onboarding solution to prove ROI
and gain the confidence of key
stakeholders.
Mule 4 implementation
• Connected legacy retail engine
with the concession partner
solution
• Loose-coupling and re-usability
enables the retailer to digitally
onboard new concession partners
fast and with minimal effort.
• Seamless exchange and processing
of data associated with orders,
product, sales and returns,
inventory and shipment.
The Solution
- 13. All contents © MuleSoft Inc. 13
Open up the transfer process, making it visible and accessible to the retailer
To-Be Landscape
- 14. All contents © MuleSoft Inc. 14
• Minimum viable product with focus on
onboarding concession partners quickly
and efficiently.
• Built a flexible and extensible framework
to support the retailer’s global market and
future enhancements
• Key use cases: transmission of Product,
Price, Stock, Sales transactions and Sales
Orders between the retailer’s supply chain
system and Concession Partners
Phase-1 Implementation
- 15. All contents © MuleSoft Inc. 15
• Reliable processing with no data loss
• Secure scalability with secure logging and monitoring
• Archiving of input and output external data for auditing
• Automated notifications and reprocessing strategies
• The 3-layered architecture supports horizontal and vertical scalability
• Ability to handle high volumes of transactions, through pagination and
streaming
Technology Enablers
- 17. All contents © MuleSoft Inc. 17
Phase-1 Technical Blueprint #2
Supply chain
system
- 18. All contents © MuleSoft Inc.
• Ability to digitally onboard new concession partners with ease and
speed.
• Transparency and control on data exchange
• Replaced manual operational steps through automated processing and
orchestration resulting in improved data quality and reduced man-
efforts.
• Near real-time alerting and monitoring of the status of messages
• Reduction of technical debt by replacing point to point connections with
API-led integration
18
Challenges Addressed
- 20. All contents © MuleSoft Inc.
Enterprise Cloud Strategy
Data
residency
Security
Cloud-first
initiatives
Compliance
Internal
regulations
- 22. All contents © MuleSoft Inc.
And we see this with MuleSoft customers as well
- 25. All contents © MuleSoft Inc.
Top priorities
MULTI &
HYBRID CLOUD
● Azure
● AWS
● Data centers
- 26. All contents © MuleSoft Inc.
• Container service to
orchestrate and automate
the deployment of
Mule runtimes into
your cloud or on-premises.
• Isolation between
applications by running a
separate Mule runtime per
application.
• Ability to run multiple
versions of Mule runtime
on the same set of
resources.
• Scaling applications across
multiple replicas.
• Automated application fail-
over.
• Application management
with Anypoint Runtime
Manager.
Anypoint Runtime Fabric
CUSTOMER’S NETWORK
Control
plane
Server Server Server
Mule
App
Mule
App
Mule
App
Mule
App
Mule
App
Mule
App
Mule
App
Mule
App
Mule
App
Runtime FabricDocker K8s
- 27. All contents © MuleSoft Inc.
Docket & Kubernetes
• No need to have
expertise on Docker or
Kubernetes
• Simply use templates &
scripts provided by
MuleSoft for setting up
Runtime Fabric on Cloud
of your choice.
- 28. All contents © MuleSoft Inc.
With Anypoint Runtime Fabric, you can
• Deploy consistently
across AWS, Azure
or data center
• Run multiple versions of
the runtime in a single
Runtime Fabric
• Reap the benefits of the
cloud, on-premises
• Manage it all in MuleSoft’s
control plane
- 30. All contents © MuleSoft Inc.
How is it different?
• CloudHub
• On-premise runtimes
• Runtime Fabric
Control
plane
Mule
App
Server
- 31. All contents © MuleSoft Inc.
How is it different?
CUSTOMER’S NETWORK
Mule
App App App
App App App
Mule
App App App
App App App
Mule
App App App
App App App
Control
plane
Server Server Server
• CloudHub
• On-premise runtimes
• Runtime Fabric
- 32. All contents © MuleSoft Inc.
How is it different?
• CloudHub
• On-premise runtimes
• Runtime Fabric
Control
plane
CUSTOMER’S NETWORK
Server Server Server
Mule
App
Mule
App
Mule
App
Runtime Fabric services
Mule
App
Mule
App
Mule
App
Mule
App
Mule
App
Mule
App
Docker & Kubernetes
AZ-a AZ-b AZ-c
Anypoint Runtime Fabric
- 35. All contents © MuleSoft Inc.
Minimum hardware (production)
3 servers, each with:
• 2 CPU cores
• 8 GiB memory
• 80 GiB dedicated disk for OS (/tmp, /logs &
/runtime-fabric)
• 60 GiB dedicated disk with 3000 provisioned IOPS
for etcd
• 250 GiB dedicated disk with 1000 provisioned
IOPS for Docker
• 1 Gbps network connection between servers
3 servers, each with:
• 2 CPU cores
• 15 GiB memory minimum
• 80 GiB dedicated disk for OSOS (/tmp, /logs &
/runtime-fabric)
• 250 GiB dedicated disk for log/metrics storage for
Docker
• 1 Gbps network connection between servers
Server Server Server
Mule
App
Mule
App
Server Server
Mule
App
Runtime Fabric services
Mule
App
Mule
App
Mule
App
Mule
App
Mule
App
Mule
App
Anypoint Runtime Fabric
Server
Docker & Kubernetes (workers)
Docker & Kubernetes (masters)
Runtime Fabric services
- 38. All contents © MuleSoft Inc.
Runtime Fabric Installer
38
• fabric.tf
– Terraform script that provisions the infrastructure on your AWS account.
• security_group.tf
– Terraform script containing the Security Groups used by the fabric.tf script.
• installer_env.sh
– Shell script of environment variables added to the controller VM acting as a
leader during the installation.
• controller_env.sh
– Shell script of environment variables added to the other controller VM(s).
• worker_env.sh
– Shell script of environment variables added to the worker VM(s).
- 39. All contents © MuleSoft Inc.
Steps
39
• Prepare AWS Account
– EC2 Keypair
– IAM Access Key and Secret Key
• Prepare RTF provisioning Scripts
– Download terraform Installable
– Initialize the terraform
– Download rtf scripts and unzip
– Configure fabric.tf script, add AWS region, credentials etc.
• Run the terraform script
• Wait for the RTF provisioning process to complete (30 mins.)
- 40. All contents © MuleSoft Inc.
Verify
40
• AWS
– Login into the Controller and Worker EC2 instances to see the progress of the
installation
– Confirm all the AWS components becoming green and active
• Anypoint Platform Management Center
– Login into the Anypoint Platform
– Access Runtime Manager and verify RTF configuration becoming active
– Once it becomes green, manage the rtf environment
– Associate the environments accordingly
- 42. All contents © MuleSoft Inc.
Installation Steps
42
• Pre-Configuration
– Download the provisioning scripts from MuleSoft
– Prepare The License key in Base64 encoding and export
– Prepare a Security Keypair
– And generate final-scripts for Azure deployment
• Anypoint Platform Management Center
– Login and configure RTF properties and note the RTF
activation data for Azure
• Azure Cloud Side
– Deploy the template generated in prior steps to trigger a
environment configuration using a resource group
configuration
– And provision the RTF platform
- 43. All contents © MuleSoft Inc.
Verification Steps
43
• Azure Cloud
– Monitor the provisioning process by logging into the Master/Controller VM
– Mark the completion by visiting the worker VM logs
• Anypoint Platform Management Center
– Check the running RTF configuration in the Runtime Manager
– Assign respective Environments to the RTF
– Deploy a sample project
– Access the end-point API URL and verify the results
- 44. All contents © MuleSoft Inc.
References
44
• System Requirements for Anypoint Runtime Fabric
– https://docs.mulesoft.com/runtime-fabric/1.2/install-sys-reqs
• Installation on AWS
– https://docs.mulesoft.com/runtime-fabric/1.2/install-aws
• Installation on Azure
– https://docs.mulesoft.com/runtime-fabric/1.2/install-azure
• Network Requirements
– https://docs.mulesoft.com/runtime-fabric/1.2/install-port-reqs
- 45. All contents © MuleSoft Inc.
Runtime Fabric Maintenance
45
• Resource Allocation
– VCore’s
– Memory
• Deployments
– Zero-downtime application re-deployments
• Security
– Anypoint Security – Edge
– Anypoint Security – Tokenization
• Ops Center
– Monitor dashboards, view logs, and download debugging information
– https://<any-node-ip>:32009/web
– Gravity CLI Tool
- 46. Big Data in the MuleSoft world
Sanjeet Panday :: Technical Architect (WHISHWORKS)
- 47. All contents © MuleSoft Inc.
The data & app conundrum
2.5 quintillion bytes
of data
1
Over 1000
applications during
enterprise lifespan
2
INTELLIGENCE
Competitor
Product
Customer
Price
Partners
Market
- 49. All contents © MuleSoft Inc.
? What are the latest trends in music per age group
? Which are the preferred channels to buy / listen music
? What streaming platforms are gaining momentum
? Which artists have brought the biggest ROI
? Which are your top selling channels per region
? Who are your biggest rivals
? Which radio producers are more influential
Most importantly… WHY? – What will really help make successful decision
Business questions
- 50. All contents © MuleSoft Inc.
The answers are there
real-time
historic
semi-structured
big data
external
unstructured
structured
small data
internal
archive
- 51. All contents © MuleSoft Inc.
How do you integrate these data?
How do you extract analytical insights?
How do you expose data to consuming applications?
How do you apply governance and secure your data?
How do you monetise your data?
IT challenges
real-time
unstructured
historic
structured
big data
small data
internal
archive
semi-structured
external
- 52. All contents © MuleSoft Inc.
Bringing Big Data into the MuleSoft world /1
Anypoint Platform
historic Transactional
(commercial info)
Artist Master licensing catalogue social feedanalytic
engine
- 53. All contents © MuleSoft Inc.
Mulesoft - Big Data Connectors
https://www.mulesoft.com/exchange :
MapR-DB Connector - Mule 3 (byWHISHWORKS)
MongoDB Connector - Mule 3
CassandraDB Connector - Mule 3 & Mule 4
Spark SQL Connector - Mule 3
Microsoft Azure Storage Connector - Mule 3 & Mule 4 (byWHISHWORKS)
Hadoop (HDFS) Connector - Mule 3 & Mule 4
And can create new custom connectors if needed.
- 54. All contents © MuleSoft Inc.
API MONETISATION
SUBSCRIPTION MODEL
API GOVERNANCE
SECURITY
Bringing Big Data into the MuleSoft world /2
Anypoint Platform
API
- 55. All contents © MuleSoft Inc.
Benefits - IT
Unified integration layerAPI MONETISATION
SUBSCRIPTION MODEL
API GOVERNANCE
SECURITY
Anypoint Platform
API
Less configuration & development effort
Faster deployment
No need for new skillsets
Scale up at reduced cost
Data monetisation
- 56. All contents © MuleSoft Inc.
Benefits - business
Unified view of the businessAPI MONETISATION
SUBSCRIPTION MODEL
API GOVERNANCE
SECURITY
Anypoint Platform
API
Faster time-to-insight
More informed decision making
More accurate results
More opportunities for growth
Decreased costs
- 57. All contents © MuleSoft Inc.
Final thoughts
! Start with the relevant business questions
! Mash up data that can support your business questions
! Start small, iterate and execute
! Go for ‘quick wins’ and prove value to the business soon
! Invest in people and develop alliances with specialised partners
! start innovating without the complexity that is usually associated with
big data
- 59. See you next time
Please send topic suggestions and any other comments
regarding this presentation to:
marketing@whishworks.com
www.whishworks.com
- 60. All contents © MuleSoft Inc.
Atlanta
May 14 - 15, 2019
San Francisco
June 25 - 26, 2019
Sydney
September 3 - 4, 2019
Chicago
September 11 - 12, 2019
New York
September 17 - 18, 2019
London
October 9 - 10, 2019
- 61. All contents © MuleSoft Inc.
Meet the MuleSoft Community at CONNECT
61
• Community Booth in the MuleSoft Campground
– Meet the team behind the community
– Learn and engage with other users
– Brainstorm together in the whiteboard area
• Community Meetup on Day 1
– Learn with use cases and demos
– Meet top community contributors
– Network with peers
• Register at connect.mulesoft.com
- 62. All contents © MuleSoft Inc.
Placard (in IPL) :: Want to become one !!
62