Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

The Impact of SMACT on the Data Management Stack

4,147 views

Published on

This presentation introduces the concept of the "Integrator's Dilemma" and reviews some of the challenges faced by traditional data and application integration technologies when it comes to keeping up with the new enterprise data, application and API connectivity and management requirements. We review the landscape and share examples of the steps more and more IT organizations are taking to improve business alignment through faster access to trusted data.

To learn more, visit http://www.snaplogic.com/ipaas

Published in: Technology
  • Be the first to comment

The Impact of SMACT on the Data Management Stack

  1. 1. The Impact of SMACT on the Data Management Stack Darren Cunningham, SnapLogic
  2. 2. About Me • Responsible for Marketing @ SnapLogic o Co-founded by Gaurav Dhillon, co-founder and former CEO of Informatica o www.SnapLogic.com • Prior to SnapLogic: o 4 years at Informatica (Cloud Team) o 2 years at LucidEra (Cloud BI) o 1 year at Salesforce (Analytics / AppExchange) o 7 years at Business Objects
  3. 3. The New Enterprise Integration Challenges Big Data Access and Analytics Disconnected SaaS Silos API Proliferation The Internet of Things
  4. 4. We Recently Posted This Infographic…
  5. 5. of line of business employees admit to using non-approved SaaS applications in their jobs The global Hadoop Market is estimated to reach $50.2 billion by 2020. It was valued at $1.5 billion in 2012 and is expected to grow at a CAGR of 58.2% between 2013 to 2020
  6. 6. The Integrator’s Dilemma Old Approaches Not Built for the New Data Challenges Legacy EAI • Not built for the web • On-prem ESB (xml, soap) • Code-intensive Legacy ETL • Built for rows and columns • Batch-oriented • Struggles with real-time
  7. 7. The Integrator’s Dilemma is faced when legacy integration solutions are no longer effective in the new world of Social, Mobile, Analytics (Big Data), Cloud and the Internet of Things 2003 2014
  8. 8. So What’s Changed? 1 Speed
  9. 9. 2014 TechValidate Survey
  10. 10. So What’s Changed? 2 User (and Buyer) Expectations Citizen integrators are proliferating, in most cases outside of the control or visibility of whoever in the company is commissioned with fulfilling integration.
  11. 11. So What’s Changed? T3he Data (Volume, Velocity, Variety, right?) Top 5 Use Cases: 1) Customer Analytics 2) Operational Analytics: Understanding Machines, Devices and Human Interactions 3) Fraud and Compliance 4) Data-Driven Products & Services 5) EDW Optimization Source: Datameer
  12. 12. So What’s Changed? C4loudification and “Data Gravity” (iPaaS, elastic scale, opex) CRM HRMS ITSM SCM Analytics ERP?
  13. 13. The Cloud Analytics Wave Analytics
  14. 14. So What’s Changed? 5Standards, Protocols and Architectural Styles
  15. 15. Whitepaper on Cloud Integration • From XML to JSON • From SOAP to REST • From ESB to iPaaS Working on ETL Paper…stay tuned! Buses Don’t Fly in the Cloud Why the ESB Is the Wrong Approach For Cloud Integration
  16. 16. What’s the Same? It’s All About the Pipes!
  17. 17. Your Integration Strategy: Innovation On Ramp or Roadblock?
  18. 18. 2014 TechValidate Survey
  19. 19. Option • Determine if you’re suffering from the “Integrator’s Dilemma” o Multiple teams and tools for EAI, SOA, ESB / ETL, ELT; old tech used to solve new challenges • Review your ICC / COE practices o Command and control won’t fly in the age of the “Citizen Integrator” and need for speed • Do an audit of your cloud applications currently in use o Find out how/if they’re integrated and how it’s going (typically many SaaS silos) • Dig into Hadoop o The economics and scale will make it a key component of your data infrastructure • Investigate AWS Redshift other cloud DW / BI options
  20. 20. SnapLogic Elastic Integration Single Platform Connecting Data, Apps, APIs
  21. 21. SnapLogic: Connecting Data, Apps and APIs • Experienced Team: Leadership from Informatica, Salesforce, Microsoft • Investors: Andreessen Horowitz & Ignition • Advisory Board: AstraZeneca, HP, Symantec, Yahoo • Headquarters: San Mateo, CA • Customers: Adobe, Acxiom, Blackberry, Bloomin’ Brands, CapitalOne, Cisco, GE, iRobot, Netflix…
  22. 22. Why SnapLogic Elastic Integration? Fast Multi-Point Modern Easily Design Monitor, Manage Deploy in Days not Months • EAI, ETL, APIs, Hybrid Deployment • Modern Standards: REST, JSON • Scale Out Architecture REST SOAP WEB APIs
  23. 23. Hybrid Architecture • Streams: No data is stored/cached • Secure: 100% standards-based • Elastic: Scales out & handles data and app integration use cases Metadata Data
  24. 24. Software Defined Integration Integration Cloud Designer, Manager, Dashboards (Multi-tenant cloud service) Elastic Execution Snaplex Snaps (Buy or Build) “Cloudplex” “Hadooplex” “Groundplex”
  25. 25. SnapReduce and the Hadooplex Acquire, Prepare, Deliver Big Data YARN YARN MapReduce MapReduce MapReduce MapReduce MapReduce MapReduce MapReduce MapReduce Snaplex YARN Application MapReduce Generation Snaplogic iPaaS + Hadoop = Snaplex Container
  26. 26. Common SnapLogic Use Cases Cloud App Integration • Workday: HR On- Boarding • Salesforce: CRM Back Office • Eliminate SaaS Silos Digital Marketing • AWS Redshift • Tableau, Social, CRM • Cloud Analytics Big Data Analytics Enterprise Platform • Data Access • Data Preparation • Data Delivery • Self Service • Data, Apps, APIs • Integrator’s Solution
  27. 27. We looked at SnapLogic as an opportunity to think differently about integration. With a document-centric processing approach and schema-less platform, we’ve been able to eliminate some of the rigidity and time-consuming tasks related to traditional integration patterns. – Jim Teal, Information Architect, iRobot $555M revenue, 534 employees
  28. 28. Designs and builds robots that make a difference in people’s lives Challenges Faced: • Geographically distributed manufacturing • Wanted to improve data quality and eliminate FTP and VPN channels • Growing cloud app adoption Why SnapLogic? • Flexibility: Control plane in Boston, data planes in China, schema-less approach • Connectivity: Standards connectivity, eliminated VPNs, etc. • Productivity: 68 to 6 pipelines
  29. 29. Largest apparel brand ever built on the web in the United States. • 1 month vs. 6m-1yr • Reduction in headcount to administer and maintain • Lowers the barrier to entry for advanced analytics Speed Flexibility Scale Amazon Redshift Reporting Platform Analytics Platform Data Integration Platform Real-Time Dashboards
  30. 30. 50+ stores serving needs of Hispanic community in Southern CA and AZ Challenges Faced: How to integrate all of the company's applications and keep its 24/7 operations running smoothly. Why SnapLogic? Speed: Northgate was able to achieve a significant improvement in sales order throughput and accuracy. Productivity: In a matter of months, the company went from 30 pipelines to 64, all while adding 14 additional stores Connectivity: Modernized and connected the ERP and WMS systems in only 12 weeks
  31. 31. The Impact of SMACT on the Data Management Stack? • Presents an opportunity to re-think your approach to data and application integration • Means you need to accept / embrace self-service data access (citizen integrators) • Data, App, API integration converging quickly • Innovation is back in the DI market (so don’t settle for same old, same old – SO SO Integration)
  32. 32. Discussion @SnapLogic Facebook.com/SnapLogic Plus.google.com/+SnapLog ic

×