Successfully reported this slideshow.

Building the Next Analytic App Platform in the Cloud


Published on

Strata 2012 - Alteryx Presentation

George Mathew, President & COO of Alteryx explains how Alteryx built a scalable, fault-tolerant Analytic Plaform in the Cloud. This deck was presented at Strata Conference in Oct 2012 and George addresses JSON vs XML, elastic framework, IAAS, Automated deployment and many more issues that went into the development of

  • Be the first to comment

  • Be the first to like this

Building the Next Analytic App Platform in the Cloud

  1. 1. Building the Next Analytic App Platform in the Cloud George K. Mathew President & Chief Operating Officer, Alteryx© 2012 Alteryx, Inc. Confidential. 1
  2. 2. Conversation is shifting from Infrastructure to Outcomes…© 2012 Alteryx, Inc. Confidential. 2
  3. 3. …And For Good Reason: New Sources of Relevant Information Device Generated Data Cloud Applications Analytic Platform Social Media ClickStreams/ Log Files© 2012 Alteryx, Inc. Confidential. 3
  4. 4. More employees need Big Data Insight 77% agree more employees with big data insight = informed decisions 74% say more data shared = more effective decisions© 2012 Alteryx, Inc. Confidential. 4
  5. 5. © 2012 Alteryx, Inc. Confidential. 5
  6. 6. © 2012 Alteryx, Inc. Confidential. 6
  7. 7. Step 1: Data Integration & Analytic Workflow All Relevant Data Packaged Market & Customer Data Enrich App & Data Integrate Analyze Un-Structured Rapid design of Content Integrate any data predictive analytics source© 2012 Alteryx, Inc. Confidential. 7
  8. 8. Step 2: Create & Share Analytic Apps in Cloud Assemble App Publish Private or Public Cloud Run© 2012 Alteryx, Inc. Confidential. 8
  9. 9. Alteryx Strategic Analytics 8.0 First Cloud for Strategic Analytics© 2012 Alteryx, Inc. Confidential. 9
  10. 10. Attributes of Next-Gen Analytic Cloud Service 1. Relevant and Useful 2. Scalable and Elastic 3. Public/Private Deployment 4. Fault-Tolerant© 2012 Alteryx, Inc. Confidential. 10
  11. 11. Make it useful… Trends • JSON vs. XML (SOAP): JSON is the clear winner. • Web Tier: WCF • Focus on standards-based approach (i.e. HTTP for inter-process communication vs. proprietary communication protocols)© 2012 Alteryx, Inc. Confidential. 11
  12. 12. Yes, but how did we do it? JSON RESTful Service • A completely stateless web service tier built on WCF. • No need for session stickiness – initially. • Plan for security and versioning at the service operation level. • Have no other hosting dependencies (like IIS). Implication: Web service tier is completely elastic. A simple start with plenty of options moving forward – including more advanced traffic routing and versioned APIs.© 2012 Alteryx, Inc. Confidential. 12
  13. 13. Make it scalable… Don’t figure out the scaling alone. Great options are available: • Persistence • Out of the box maintenance, monitoring, replication • Strong developer support, multiple language drivers • Scalability/Elasticity Framework • Web-based • Automation API • Monitoring • Multiple IaaS provider support (private/hybrid options) • IaaS • Global, API-driven, Windows & Linux support© 2012 Alteryx, Inc. Confidential. 13
  14. 14. Yes, but how did we do it? Automate Deployment and Scalability • Use automation and configuration APIs of RightScale and AWS to fully instrument deployment of nodes in the web, persistence and analytic processing tiers. • Monitor and management tools for nodes via programmatic APIs. Implication: 1 FTE to the ProdOps for the Alteryx Gallery to monitor and manage our entire cloud deployment.© 2012 Alteryx, Inc. Confidential. 14
  15. 15. Make it deployable… Not all organizations want a public cloud service. • Designed the Gallery architecture to be a hybrid • Near seamless transition from public to private contexts • Mixed-context execution: Cloud execution environment with private data (DRO)© 2012 Alteryx, Inc. Confidential. 15
  16. 16. Yes, but how did you do it? Analytic Application Processing • Stateless controller/worker topology allowing for rapid expansion/contraction of analytic processing capacity. • Compressed and encrypted data streams over traditional HTTP. • Generic persistence interfaces to allow both relational and non-relational data stores (SQL vs. No-SQL) • Customizable throttles to limit app execution in a cloud environment. Implication: Analytic processing in the cloud can scale to meet the needs of 10’s to 1000’s of users in a secure and flexible way with the appropriate limits to protect both the user and the execution environment.© 2012 Alteryx, Inc. Confidential. 16
  17. 17. © 2012 Alteryx, Inc. Confidential. 17
  18. 18. Make it fault-tolerant… • Implemented a completely stateless architecture for analytic processing. • Use real-time compression and encryption to move data and analytic processes over HTTP. • Design for future Data Residency Options (DRO). • Create analytic processing arrays that are isolated processes and self-recoverable.© 2012 Alteryx, Inc. Confidential. 18
  19. 19. Plenty of room to grow… Initial testing indicates that even heavy-weight analytic processing (spatial, non- spatial, predictive and reporting) is uniformly distributed. • Web Tier • Analytic Workers • Node MongoDB replicated cluster ~= 50 OPS Implication: Performance is just a “scale-out” operation, as opposed to “scale-up” - with tremendous cost savings benefits.© 2012 Alteryx, Inc. Confidential. 19
  20. 20. Humanizing Big Data: Single Platform to Deliver Big Data Insight & Foresight Access and Integrate Big Data Enhance Data, Add Context Analytic Apps, Data Loading© 2012 Alteryx, Inc. Confidential. 20
  21. 21. Alteryx Strategic Analytics 8.0 First Cloud for Strategic Analytics© 2012 Alteryx, Inc. Confidential. 21
  22. 22. Key Terms • Alteryx • RESTful • Analytics Gallery • JSON services • Analytic Apps • Public/Private Deployment • Analytics in Cloud • Fault-Tolerant • Cloud Apps • JSON vs. XML (SOAP) • Big Data Analytics • Mongo DB • Strategic Analytics • Amazon Web Services • Predictive Analytics • IAAS • Unstructured data • RightScale • Humanizing Big Data • George Mathew, Alteryx • Analytics Platform • Strata 2012 • Data Analysts • OReilly Strata Conference • Data Scientist • Strata Conf, New York • Strata, Oct 2012© 2012 Alteryx, Inc. Confidential. 22