WSO2Con - Integrating Telecom Big Data: Challenges and Lessons Learned

1,007 views

Published on

WSO2Con 2013 - Case of project Coreo, a telecom platform that uses WSO2 ESB and BAM

Published in: Technology, Business
  • Be the first to comment

WSO2Con - Integrating Telecom Big Data: Challenges and Lessons Learned

  1. 1. Integrating Telecom Big Data: Challenges and Lessons Learned By Fabíola Pereira
  2. 2. Motivation
  3. 3. Motivation I want a service that, when given the cell phone number of my friend John, I receive a map of his current location.
  4. 4. Motivation How about an application that every day, at 8 am, makes me a call and plays my favorite song?
  5. 5. Motivation Weather Forecast Mother’s Day Sale Video Conference My playlist Call & vote Where is it? MMS Closest drugstore Blogging
  6. 6. Motivation Birthday Reminder Voice Mail Weather Forecast Mother’s Day Sale Video Conference Virtual Pabx My playlist Horoscope Call & vote Where is it? Any news? House Monitoring Warn my vendors! SMS MMS Closest drugstore Mail Random videos Blogging Daily feeds
  7. 7. Motivation
  8. 8. Velocity VolumeVariety Motivation
  9. 9. Outline Algar Telecom Coreo Platform Coreo Architecture Lessons Learned Challenges Conclusion
  10. 10. Algar Telecom 58 years in operation More than 1900 associates More than 800 thousand customers Publicly traded* * Via debentures
  11. 11. Business and Areas of Operation Concession - 87 communities in 4 states Authorization area - offices expanding into key states * In partnership with Algar Tecnologia Data and voice IT Services* Businesses Retail
  12. 12. Brazil Central Brazil Pioneering Cellular telephone Pre-paid telephone Digital telephone 1 Gb broadband Wireline broadband 3G deployment Commercial fibre optic Speech recognition Leader in broadband penetration Pioneer in NGN deployment – Next Generation Network Brazilian Interior Latin America
  13. 13. Outline Algar Telecom Coreo Platform Coreo Architecture Lessons Learned Challenges Conclusion
  14. 14. Coreo Platform Factsheet • Dynamic Platform for the Composition of Applications • ~1,5 years of development • 6 software developers • In homologation phase • Innovative project
  15. 15. Coreo Platform Components – the smallest units Send MMS Send SMS Translate Web Scrapper Web Service Send Mail RSS On Receive SMS On Receive MMS Math Make Call Get and PostDTMF Database Concat Announcement Telecom Internet Utils Media Storage
  16. 16. Coreo Platform Applications – make your own composition via a Service Creation Environment Location (LBS)
  17. 17. Coreo Platform Applications – make your own composition via a Service Creation Environment Web Scrapper Make Call Announcement
  18. 18. Coreo Platform
  19. 19. Coreo Platform
  20. 20. Coreo Platform
  21. 21. Outline Algar Telecom Coreo Platform Coreo Architecture Lessons Learned Challenges Conclusion
  22. 22. Coreo Architecture App Engine Event Handler Services MonitoringandStatistics LogsandSDRs Portal SCE Web ServicesGadgets CoreoIdentityServer 3rd Party and Web AppsUsers COREO Platform File Manager Scheduler WS Broker DB Manager Telecom Platforms SDP Controller Components
  23. 23. Coreo Architecture
  24. 24. Coreo Architecture – front-end
  25. 25. Coreo Architecture – front-end • Run apps via • Portal, • WS or • External gadgets.
  26. 26. Coreo Architecture – front-end • Run apps via • Portal, • WS or • External gadgets. • Coreo Accounts (IS) • Ldap user store; • Memcached session store; • Identity Server personalized.
  27. 27. Coreo Architecture – core
  28. 28. Coreo Architecture – core • Messaging passing, non-blocking calls
  29. 29. Coreo Architecture – core • Messaging passing, non-blocking calls • NoSQL for states storage: stateless architecture
  30. 30. Coreo Architecture – core • Messaging passing, non-blocking calls • NoSQL for states storage: stateless architecture • WSO2 ESB for services exposure and communication with Telecom Platforms
  31. 31. Coreo Architecture – back-end
  32. 32. Coreo Architecture – back-end • WSO2 BAM 1.3 for monitoring and statistics • most popular apps; • most used components; • endpoint errors.
  33. 33. Coreo Architecture – back-end • WSO2 BAM 1.3 for monitoring and statistics • most popular apps; • most used components; • endpoint errors. • Structured data into DB and unstructured data into HDFS via Scribe • Service Detail Records (SDRs – similar to Call Detail Records); • system logs.
  34. 34. Coreo Architecture – discussion WSO2 Tools
  35. 35. Outline Algar Telecom Coreo Platform Coreo Architecture Lessons Learned Challenges Conclusion
  36. 36. Lessons Learned 1.Be careful what you count when measuring data growth 2. Continuous improvement. It never ends! 3. CAP Theorem: what are your requirements? What do you really need? 4. Open source rocks!
  37. 37. 1. Become more data-driven Challenges 2. Move from reactive to proactive, turning data into actions 3. How to deal with legacy telecom platforms? How to adapt them? How to coexist? 4. Make Coreo happen!
  38. 38. Outline Algar Telecom Coreo Platform Coreo Architecture Lessons Learned Challenges Conclusion
  39. 39. Conclusion Built over WSO2 tools Distributed and scalable system – ready for Big Data Coreo Platform Telecom Innovation
  40. 40. Thank you! www.algartelecom.com.br Fabíola Pereira Cesar Alvarenga Emilio Dias {fabiolas,cesarw,emilio}@algartelecom.com.br

×