A Mobile-First, Cloud-First Stack at Pearson


Published on

Published in: Technology, Education
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

A Mobile-First, Cloud-First Stack at Pearson

  1. 1. A Mobile-First, Cloud-First Stack at Pearson NoSQL and MongoDB Aref Matin
  2. 2. Contents 1. Introduction to Pearson – Global Future 2. Move to Open Source, NoSQL, and MongoDB – Pearson Technology Stack – Why MongoDB? 3. Pearson Use Cases – Identity and Access Management – Adaptive Learning and Analytics – Pearson Activity Framework 4. The Future of MongoDB at Pearson – Next Steps and Challenges
  3. 3. Introduction Efficacy
  4. 4. Open Source, NoSQL, and MongoDB Pearson Technology Stack Closed Source Open Source What Wherever possible, choose world-class, commodity technology as the foundation of our solutions. Why We must innovate in the areas that differentiate us as a learning company. We should not be re-inventing the wheel in areas where affordable and scalable solutions exist. How Think like a startup. Use open-source where available. Use vendor solutions where possible. Build proprietary solutions only when necessary and strategic When All new products and services built since January 2013 use this technology stack. Benefits ● Easier to find and hire talent ● World-class, proven technology stack ● Partner relationships with some of the world’s premiere technology providers ● We are helping to define Amazon’s backlog Client SDKs (iOS & Android) Nibiru Rest Express ThalassaNemesis Pearson Identity SubPub Eventing EC2 S3 Glacier RedshiftVPC Seer Activity Tracking JSON NOC Tools Push Notifications Mobile App Svcs Calabash/MAF Ziggy eSelenium REST Mobile Web Both
  5. 5. Open Source, NoSQL, and MongoDB Why MongoDB? • Open Source • Agility • Document-Oriented Data Model • Scalability • Fast Reads • Fast Ad-hoc Queries • Reduced Maintenance
  6. 6. MongoDB Usage Pearson Use Cases • Identity • Access Management • Learning Management System • Assignment Authoring • Social • Adaptivity and Analytics • Activity Framework • And more…
  7. 7. MongoDB Usage - Example 1a: Identity Access Management (Local) • 4 Shards - 3 replicas for each shard • Very Fast - (800 requests per sec.) • Highly Reliable - (15 min. total avg. down time per year) Elastic Load Balancer HA Proxy VMs Service VMs MongoDB Config Nodes
  8. 8. MongoDB Usage - Example 1b: Identity Access Management (Multi-Region) • Goals: - High Availability - High Scalability - Highly Persistent - Performance - Incident Mitigation - Manageable Cost
  9. 9. MongoDB Usage - Example 2: Adaptive Learning Analytics Learning App S3 S3 Oozie Job Scheduler Offline Learner Data Elastic MapReduce Analytics Data Services REST Endpoints Adaptivity, Recommendations, Dashboards, and Visualizations • Repository - Avro and JSON Schemas - Message Validation • Key component of Big Data ingestion pipeline
  10. 10. MongoDB Usage - Example 3: Activity Framework • Primary Data Store - 3 node replica cluster • Use Profile - High read - Low write • Leverages fast read powerful ad hoc query capability Authoring User Agent Learner User Agent Activity Hub Activity Authoring Activity Repository RDBMS Key / Value Learning Platforms Learning Services Scoring Engine
  11. 11. MongoDB Future at Pearson Next Steps and Challenges • Next Steps – Multi-Region – Extend Globally • Challenges – Need Easier Configurations – Enterprise Licensing Model – Developers Need to Embrace NoSQL Paradigms
  12. 12. Thank You