As a global publishing house, Scholastic Corporation has brought to market titles such as Clifford the Big Red Dog and series like Harry Potter and The Hunger Games. Scholastic is in the midst of a multi-year technology transformation, which will move it out of the data center business and all-in on AWS. This session will discuss Scholastic’s DevOps model, which has allowed it to quickly deploy traditional software systems to AWS. It will also discuss how Scholastic addressed enterprise integration challenges by developing “Integration as a Service” and building parallel feeds into Amazon Redshift and other AWS data warehouse and analytics platforms.
2. What to Expect from the Session
• Introduction to Scholastic
• Enterprise Integrations?
• Four Scenarios - Examples in Use
• Implementation and Technologies
• Lessons Learned and Next Steps
• Q&A
4. Who is Scholastic?
• Our mission: To encourage the intellectual and
personal growth of all children, beginning with
literacy.
• Started in 1920 with a single magazine
• The largest publisher and distributor of children’s books
in the world
• 165 countries, 45 languages
• A leading provider of educational materials in K-8
5. Who is Scholastic?
- Content – text, images, video, metadata
- Commerce – B2B, B2C
- Logistics and Distribution
- Physical – supply chain, printing, pop-up stores, shipping
- Digital – Content, Applications, Marketing, Mobile Games
6. Scholastic’s Technology Transformation
• Scholastic in transition
• Technology is not just a supporting function
• Three year goal to reform all technology
• Externalize commodity services
• More strategic, less routine operational
• Improve speed and quality of service
• Function as a coordinated system
9. What was Scholastic’s Enterprise Integration?
• Route
• Transform
• Transport
• Orchestrate
10. Why change at all?
Everything around us is changing:
• Endpoints
• Data
• Vendors, Partners, Platforms
• Integration Patterns and Expectations
• Rate of change
11. What would it have looked like?
• Route
• Transform
• Transport
• Orchestrate
13. How it is used
• Driven by consumer
• Usable at any time by anyone
• Integrated into SDLC
processes
• Testable, reconfigurable
Self-Service Integration Platform
What it is
• Published features
• Common patterns
• Highly instrumented and monitored
• Easy and fast to scale, in multiple
dimensions
• Capacity, Throughput, Isolation
Unblock the Enterprise
17. V1: Integration Platform
The core features of integration:
• Input, Output, Transform, Transport
•Unifies API, ESB, messaging
•Non-functionals for free
•Integration catalog
•Self-service
•SDLC support
18. V2: International ERP Transformation
International Division new ERP PoC
• Move at their own pace
• Participate in the Enterprise
• No scale-out concerns
• Freedom to innovate
19. V3: Fast Track Data and BI Transformation
Live migrate EDW to AWS data platforms
• Grab parallel feed from current bus
• Reuse transports, mappings
• Transform if needed
• Amazon Data Pipelines and Lambda
20. V4: Integration Forensics
Refactor 15 years of integrations
• Grab parallel feed from current bus
• Monitoring and Instrumentation
• ELK, SumoLogic, RedShift
• Cut-over at will
22. The Not As Good
• Mature commercial product
• Poor developer support
• Single Topic
• Single Topology
• Single Data Center
• Single Environment
• Single Team
Where we were
The Good
• Mature commercial product
• Business object dictionary
• Pub/Sub(ish)
23. How are we doing this?
• AWS IaaS + AWS platforms + 3rd Party SaaS
• Configuration Automation
• AMIs, CloudFront, Chef, (Consul)
• Open Source Integration Framework
• WSO2 API Manager and ESB
• Multiple Transports
• Kafka, RabbitMQ, Existing Bus
• APIs and Services – built and consumed
25. Where we are: Developer Flow
WSO2 API
Manager
Analytics
Platform Interfaces Platform Services
Transform
WSO2 ESB
Orchestrate
Jenkins CI
Swagger
API
30. The Not As Good
• Integration dev experience
• Platform automation
• Complexity
Where we are
The Good
• Good SDLC support
• Instrumentation
• Flexible topology
• Flexible transports
• Multiple environments
• Multiple data centers*
• Multiple instances*
Unblock the Enterprise
32. Next Steps
• Get rid of the ESB
Transform
WSO2 ESB
Orchestrate
Transform
Scala/Akka + Camel
Orchestrate
33. Credit and Thanks
• Scholastic Technology Services management
• Mark Bonano and the Integration Services Team
• Adam Japhet and the Cloud Transformation Engineers