Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Intuit Analytics Cloud 101

558 views

Published on

Intuit Analytics Cloud 101

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Intuit Analytics Cloud 101

  1. 1. Intuit Confidential and Proprietary 1 Tilmann Bruckhaus Group Engineering Manager Intuit Data Engineering and Analytics (IDEA) Intuit Analytics Cloud 101
  2. 2. Intuit Confidential and Proprietary 2 Tilmann Bruckhaus Group Engineering Manager Intuit tilmann_bruckhaus@intuit.com Follow me on twitter: @tillirix
  3. 3. Intuit’s big vision for data Transform the lives of our customers by unleashing the power of data Customer Inspired
  4. 4. Era of Windows Era of Web Era of the CloudEra of DOS Spanning three decades of data Compliant data Mobile First 1980s 1990s 2000s • Employees: 150 • Customers: 1.3M customers • Revenue: $33M • Employees: 4,500 • Customers: 5.6M • Revenue: $1.04B • Employees: 7,700 • Customers: 37M • Revenue: $4.2B 20162010 Regulatory data Transactional data Batch data Real time data Complex, secure data
  5. 5. The Intuit Analytics Cloud (IAC) Data-Driven Users Data-Driven Products CG SBG Generic Data products derive value from IAC IntuitAnalyticsCloud Real Time Ingest Batch Ingest IAC = Data + Infrastructure + Foundational Services Business Lookup Unified Profile Personalization A/B Testing … Real Time Data Layer Intermediate Data Source Data Online Accountant
  6. 6. Use Case 1: Tax Personalization & Ease of Use
  7. 7. Key Practices for Planning, Deploying and Managing ❏ Data security ❏ Data governance ❏ Managed metadata ❏ Committed schemas ❏ Auto Deploy ❏ Monitored Operations
  8. 8. Key Practices for Planning, Deploying and Managing ❏ Data security ❏ Data governance ❏ Managed metadata ❏ Committed schemas ❏ Auto Deploy ❏ Monitored Operations
  9. 9. Key Practices for Planning, Deploying and Managing ❏ Data security ❏ Data governance ❏ Managed metadata ❏ Committed schemas ❏ Auto Deploy ❏ Monitored Operations
  10. 10. Key Practices for Planning, Deploying and Managing ❏ Data security ❏ Data governance ❏ Managed metadata ❏ Committed schemas ❏ Auto Deploy ❏ Monitored Operations
  11. 11. Key Practices for Planning, Deploying and Managing ❏ Data security ❏ Data governance ❏ Managed metadata ❏ Committed schemas ❏ Auto Deploy ❏ Monitored Operations
  12. 12. Key Practices for Planning, Deploying and Managing ❏ Data security ❏ Data governance ❏ Managed metadata ❏ Committed schemas ❏ Auto Deploy ❏ Monitored Operations
  13. 13. The Big Data Lake Journey at Intuit On Premise First Generation IAC Batch BatchCloud Lift & Shift
  14. 14. ˝ The Big Data Lake Journey at Intuit Real-Time IAC in the Cloud On Premise First Generation IAC Batch BatchCloud Lift & Shift Cloud Streaming
  15. 15. ˝ The Big Data Lake Journey at Intuit Real-Time IAC in the Cloud Cloud Challenges ❏ Service Security ❏ Whitelisting ❏ Restacking ❏ Auto Deploy ❏ Service Monitoring On Premise First Generation IAC Batch BatchCloud Lift & Shift Cloud Streaming
  16. 16. ˝ The Big Data Lake Journey at Intuit Real-Time IAC in the Cloud Cloud Challenges ❏ Service Security ❏ Whitelisting ❏ Restacking ❏ Auto Deploy ❏ Service Monitoring Streaming Challenges ❏ Stateful processes ❏ Performance ❏ Elastic scaling ❏ Replay ❏ Event ordering On Premise First Generation IAC Batch BatchCloud Lift & Shift Cloud Streaming
  17. 17. IAC Real-Time Ingest Architecture
  18. 18. IAC Architecture in the cloud
  19. 19. Event -Ingest Architecture
  20. 20. File -Ingest Architecture
  21. 21. Questions? Questions? We’re Hiring! data@intuit.com

×