SlideShare a Scribd company logo
Backupify.com Board Meeting December 2010 Rob May (@robmay) CEO, Backupify  rob@backupify.com http://bit.ly/clouddataintegration  Confidential Agile Cloud Integration 1
What You Will Learn How to integrate at the speed of business How to avoid data chaos Best practices for cloud integration 2
About Backupify Backup, Search, Restore SaaS data Founded in 2008 165,000 customers 150TB of data Integrated with 18 services One of the largest users of Cassandra 3
CONFIDENTIAL 4 30% Data Loss is Due to User Error
5 “ Yes, I clicked the delete button. Yes, I regret it now. Yes, I belatedly realized why the Backupify service makes sense. ” Backup For Cloud AppsDavid F. Carr November 2010
What Do We Mean By Integration? 6
Back In The Day (On Premise) Few applications had good APIs but… Integration was relatively easy Full control of access, security & storage Independent access to all data in DBMSs & FS DBMS & FS triggers could kick off integration 7
Back In The Day (On Premise) Pros Many good integration products with mature application connectors Ability to govern software updates across systems You had more control Could always go straight at the data Cons Too many plumbing options (CORBA, DCOM, RMI, SOAP, MQ, …) Few apps had good APIs Version management problems 8
Moving To SaaS Means You have all the APIs you’ll ever need Everything is really simple 9
Benefits of Moving To SaaS Lower costs Information accessible anywhere Productive users Fewer maintenance headaches 10
Cons of Moving To SaaS Loss of access Service outages & data loss Data is isolated The API is what it is Loss of control Forced app/API upgrades Hacked accounts Privacy risk 11
The Problem With APIs Design issues Vendors design for the expected use cases Customers always push the boundaries Hard to build consistent copy of data model Implementation may not follow spec Access limitations API Throttling Query result set size limitations Historical query limitations 12
The Solution: Cloud Data Integration The best of both worlds Use SaaS as much as you want Use SaaS APIs whenever you can Have full control & independent access to your SaaS & on-premise data in the cloud Rules, triggers & integration logic run right next to the data in the cloud 13
The Problem With Cloud Integration Cloud integration == Connectors 2.0 14
This is Really Hard Massive infrastructure challenges Backupify has accidently become one of the foremost experts on Cassandra It is easy to screw up E.g., lock users out of their Gmail accounts Some things are impossible How do you Twitter in regulated industries? 15
The Hard Problems are Worth Solving Cloud Data Integration is agile integration Best of both worlds Best way to respond to new business needs Best way to protect against vendor change The SaaS vendors will help Front vs. backdoor SaaS APIs Cloud Data Intermediaries, e.g., GNIP 16
How To Think About Cloud Data Integration 17
The Hard Skills API knowledge & know-how Extreme & continuous testing automation Efficient cloud operations at huge scale Design for failure Avoid data chaos 18
The Soft Skills:  Be A Good Partner 19
Best Practices Implement, then generify Play nice with partners Expect to throttle Authenticate securely Plan for data model/access changes CONFIDENTIAL 20
Moving At The Speed of Business Generify you architecture as you incorporate more APIs Build for fault tolerance Use Oauth or similar authentication options when possible CONFIDENTIAL 21
Avoid Data Chaos Build throttling into your model – you will eventually need it. Plan for a time when the API data model will allow more or less access to data Play nice with partners, but be vocal – they don’t always get it right. CONFIDENTIAL 22
What Else Can You Do with Your Data? 23 Backup Search Migrate Restore Integrate Cloud Data Integration
Questions? Contact me: @robmay rob@backupify.com http://bit.ly/clouddataintegration  CONFIDENTIAL 24

More Related Content

What's hot

DevOps for IBM Commerce
DevOps for IBM CommerceDevOps for IBM Commerce
DevOps for IBM Commerce
Michael Elder
 
Elevate Your Continuous Delivery Strategy Above the Rolling Clouds - UrbanCod...
Elevate Your Continuous Delivery Strategy Above the Rolling Clouds - UrbanCod...Elevate Your Continuous Delivery Strategy Above the Rolling Clouds - UrbanCod...
Elevate Your Continuous Delivery Strategy Above the Rolling Clouds - UrbanCod...
Michael Elder
 
Agile Integration eBook from 2018
Agile Integration eBook from 2018Agile Integration eBook from 2018
Agile Integration eBook from 2018
Kim Clark
 
Cloud adoption patterns
Cloud adoption patternsCloud adoption patterns
Cloud adoption patterns
Kyle Brown
 
Continuously Design your Continuous Deployment
Continuously Design your Continuous DeploymentContinuously Design your Continuous Deployment
Continuously Design your Continuous Deployment
Michael Elder
 
The evolving story for Agile Integration Architecture in 2019
The evolving story for Agile Integration Architecture in 2019The evolving story for Agile Integration Architecture in 2019
The evolving story for Agile Integration Architecture in 2019
Kim Clark
 
Transforming to Microservices
Transforming to MicroservicesTransforming to Microservices
Transforming to Microservices
Kyle Brown
 
Implementing zero trust in IBM Cloud Pak for Integration
Implementing zero trust in IBM Cloud Pak for IntegrationImplementing zero trust in IBM Cloud Pak for Integration
Implementing zero trust in IBM Cloud Pak for Integration
Kim Clark
 
Elevating your Continuous Delivery Strategy Above the Rolling Clouds
Elevating your Continuous Delivery Strategy Above the Rolling CloudsElevating your Continuous Delivery Strategy Above the Rolling Clouds
Elevating your Continuous Delivery Strategy Above the Rolling Clouds
Michael Elder
 
Application Considerations for Cloud
Application Considerations for CloudApplication Considerations for Cloud
Application Considerations for Cloud
Kyle Brown
 
Turning up the HEAT with IBM MobileFirst for iOS Apps
Turning up the HEAT with IBM MobileFirst for iOS AppsTurning up the HEAT with IBM MobileFirst for iOS Apps
Turning up the HEAT with IBM MobileFirst for iOS Apps
Michael Elder
 
Hybrid Cloud: How to Get a Return from an Investment Made Three Decades Ago (...
Hybrid Cloud: How to Get a Return from an Investment Made Three Decades Ago (...Hybrid Cloud: How to Get a Return from an Investment Made Three Decades Ago (...
Hybrid Cloud: How to Get a Return from an Investment Made Three Decades Ago (...
Michael Elder
 
#8311: Transform the Enterprise with IBM Cloud Private
#8311: Transform the Enterprise with IBM Cloud Private#8311: Transform the Enterprise with IBM Cloud Private
#8311: Transform the Enterprise with IBM Cloud Private
Michael Elder
 
How to Adopt Docker Within Your Enterprise Using IBM UrbanCode Deploy (Interc...
How to Adopt Docker Within Your Enterprise Using IBM UrbanCode Deploy (Interc...How to Adopt Docker Within Your Enterprise Using IBM UrbanCode Deploy (Interc...
How to Adopt Docker Within Your Enterprise Using IBM UrbanCode Deploy (Interc...
Michael Elder
 
Improving Software Delivery with DevOps & Software Defined Environments
Improving Software Delivery with DevOps & Software Defined EnvironmentsImproving Software Delivery with DevOps & Software Defined Environments
Improving Software Delivery with DevOps & Software Defined Environments
Michael Elder
 
Deployment Automation for Hybrid Cloud and Multi-Platform Environments
Deployment Automation for Hybrid Cloud and Multi-Platform EnvironmentsDeployment Automation for Hybrid Cloud and Multi-Platform Environments
Deployment Automation for Hybrid Cloud and Multi-Platform Environments
IBM UrbanCode Products
 
IBM Bluemix hands on
IBM Bluemix hands onIBM Bluemix hands on
IBM Bluemix hands on
Felipe Freire
 
Cloud adoption patterns April 11 2016
Cloud adoption patterns April 11 2016Cloud adoption patterns April 11 2016
Cloud adoption patterns April 11 2016
Kyle Brown
 
How do you deliver your applications to the cloud?
How do you deliver your applications to the cloud?How do you deliver your applications to the cloud?
How do you deliver your applications to the cloud?
Michael Elder
 
IBM Cloud Integration Platform High Availability - Integration Tech Conference
IBM Cloud Integration Platform High Availability - Integration Tech ConferenceIBM Cloud Integration Platform High Availability - Integration Tech Conference
IBM Cloud Integration Platform High Availability - Integration Tech Conference
Robert Nicholson
 

What's hot (20)

DevOps for IBM Commerce
DevOps for IBM CommerceDevOps for IBM Commerce
DevOps for IBM Commerce
 
Elevate Your Continuous Delivery Strategy Above the Rolling Clouds - UrbanCod...
Elevate Your Continuous Delivery Strategy Above the Rolling Clouds - UrbanCod...Elevate Your Continuous Delivery Strategy Above the Rolling Clouds - UrbanCod...
Elevate Your Continuous Delivery Strategy Above the Rolling Clouds - UrbanCod...
 
Agile Integration eBook from 2018
Agile Integration eBook from 2018Agile Integration eBook from 2018
Agile Integration eBook from 2018
 
Cloud adoption patterns
Cloud adoption patternsCloud adoption patterns
Cloud adoption patterns
 
Continuously Design your Continuous Deployment
Continuously Design your Continuous DeploymentContinuously Design your Continuous Deployment
Continuously Design your Continuous Deployment
 
The evolving story for Agile Integration Architecture in 2019
The evolving story for Agile Integration Architecture in 2019The evolving story for Agile Integration Architecture in 2019
The evolving story for Agile Integration Architecture in 2019
 
Transforming to Microservices
Transforming to MicroservicesTransforming to Microservices
Transforming to Microservices
 
Implementing zero trust in IBM Cloud Pak for Integration
Implementing zero trust in IBM Cloud Pak for IntegrationImplementing zero trust in IBM Cloud Pak for Integration
Implementing zero trust in IBM Cloud Pak for Integration
 
Elevating your Continuous Delivery Strategy Above the Rolling Clouds
Elevating your Continuous Delivery Strategy Above the Rolling CloudsElevating your Continuous Delivery Strategy Above the Rolling Clouds
Elevating your Continuous Delivery Strategy Above the Rolling Clouds
 
Application Considerations for Cloud
Application Considerations for CloudApplication Considerations for Cloud
Application Considerations for Cloud
 
Turning up the HEAT with IBM MobileFirst for iOS Apps
Turning up the HEAT with IBM MobileFirst for iOS AppsTurning up the HEAT with IBM MobileFirst for iOS Apps
Turning up the HEAT with IBM MobileFirst for iOS Apps
 
Hybrid Cloud: How to Get a Return from an Investment Made Three Decades Ago (...
Hybrid Cloud: How to Get a Return from an Investment Made Three Decades Ago (...Hybrid Cloud: How to Get a Return from an Investment Made Three Decades Ago (...
Hybrid Cloud: How to Get a Return from an Investment Made Three Decades Ago (...
 
#8311: Transform the Enterprise with IBM Cloud Private
#8311: Transform the Enterprise with IBM Cloud Private#8311: Transform the Enterprise with IBM Cloud Private
#8311: Transform the Enterprise with IBM Cloud Private
 
How to Adopt Docker Within Your Enterprise Using IBM UrbanCode Deploy (Interc...
How to Adopt Docker Within Your Enterprise Using IBM UrbanCode Deploy (Interc...How to Adopt Docker Within Your Enterprise Using IBM UrbanCode Deploy (Interc...
How to Adopt Docker Within Your Enterprise Using IBM UrbanCode Deploy (Interc...
 
Improving Software Delivery with DevOps & Software Defined Environments
Improving Software Delivery with DevOps & Software Defined EnvironmentsImproving Software Delivery with DevOps & Software Defined Environments
Improving Software Delivery with DevOps & Software Defined Environments
 
Deployment Automation for Hybrid Cloud and Multi-Platform Environments
Deployment Automation for Hybrid Cloud and Multi-Platform EnvironmentsDeployment Automation for Hybrid Cloud and Multi-Platform Environments
Deployment Automation for Hybrid Cloud and Multi-Platform Environments
 
IBM Bluemix hands on
IBM Bluemix hands onIBM Bluemix hands on
IBM Bluemix hands on
 
Cloud adoption patterns April 11 2016
Cloud adoption patterns April 11 2016Cloud adoption patterns April 11 2016
Cloud adoption patterns April 11 2016
 
How do you deliver your applications to the cloud?
How do you deliver your applications to the cloud?How do you deliver your applications to the cloud?
How do you deliver your applications to the cloud?
 
IBM Cloud Integration Platform High Availability - Integration Tech Conference
IBM Cloud Integration Platform High Availability - Integration Tech ConferenceIBM Cloud Integration Platform High Availability - Integration Tech Conference
IBM Cloud Integration Platform High Availability - Integration Tech Conference
 

Viewers also liked

Internet for instruction 541
Internet for instruction 541Internet for instruction 541
Internet for instruction 541Janice Bezanson
 
The atlantic road norway’s construction of the century
The atlantic road norway’s construction of the centuryThe atlantic road norway’s construction of the century
The atlantic road norway’s construction of the centuryPACE Kiprovska
 
NIIT ISAS Q5 Report - Windows PowerShell
NIIT ISAS Q5 Report - Windows PowerShellNIIT ISAS Q5 Report - Windows PowerShell
NIIT ISAS Q5 Report - Windows PowerShell
Phan Hien
 
Beautiful fuchsia queen
Beautiful fuchsia queen Beautiful fuchsia queen
Beautiful fuchsia queen PACE Kiprovska
 
Are you ready for camp?
Are you ready for camp?Are you ready for camp?
Are you ready for camp?
Siu Fai Cheong
 
Instructional software 541
Instructional software 541Instructional software 541
Instructional software 541Janice Bezanson
 
ISOTECH ASC Wax
ISOTECH ASC WaxISOTECH ASC Wax
ISOTECH ASC Wax
Anh Tuan Ngo
 
Prelivene ruzicepuzici
Prelivene ruzicepuziciPrelivene ruzicepuzici
Prelivene ruzicepuziciPACE Kiprovska
 
Intervento del presidente
Intervento del presidenteIntervento del presidente
Intervento del presidentemattone84
 
Intervento del presidente
Intervento del presidenteIntervento del presidente
Intervento del presidentemattone84
 
да здравствует вежливость и доброта
да здравствует вежливость и добротада здравствует вежливость и доброта
да здравствует вежливость и добротаresnichka63
 
Internet for instruction 541
Internet for instruction 541Internet for instruction 541
Internet for instruction 541Janice Bezanson
 

Viewers also liked (20)

Internet for instruction 541
Internet for instruction 541Internet for instruction 541
Internet for instruction 541
 
Istina.o.raku.pluca
Istina.o.raku.plucaIstina.o.raku.pluca
Istina.o.raku.pluca
 
The atlantic road norway’s construction of the century
The atlantic road norway’s construction of the centuryThe atlantic road norway’s construction of the century
The atlantic road norway’s construction of the century
 
Community building 541
Community building 541Community building 541
Community building 541
 
NIIT ISAS Q5 Report - Windows PowerShell
NIIT ISAS Q5 Report - Windows PowerShellNIIT ISAS Q5 Report - Windows PowerShell
NIIT ISAS Q5 Report - Windows PowerShell
 
Beautiful fuchsia queen
Beautiful fuchsia queen Beautiful fuchsia queen
Beautiful fuchsia queen
 
Are you ready for camp?
Are you ready for camp?Are you ready for camp?
Are you ready for camp?
 
Instructional software 541
Instructional software 541Instructional software 541
Instructional software 541
 
Thebirds sex1
Thebirds sex1Thebirds sex1
Thebirds sex1
 
ISOTECH ASC Wax
ISOTECH ASC WaxISOTECH ASC Wax
ISOTECH ASC Wax
 
Maxi kuvar
Maxi kuvarMaxi kuvar
Maxi kuvar
 
Prelivene ruzicepuzici
Prelivene ruzicepuziciPrelivene ruzicepuzici
Prelivene ruzicepuzici
 
Intervento del presidente
Intervento del presidenteIntervento del presidente
Intervento del presidente
 
Intervento del presidente
Intervento del presidenteIntervento del presidente
Intervento del presidente
 
да здравствует вежливость и доброта
да здравствует вежливость и добротада здравствует вежливость и доброта
да здравствует вежливость и доброта
 
Conchas marinhas
Conchas marinhasConchas marinhas
Conchas marinhas
 
Kapky
KapkyKapky
Kapky
 
541networking
541networking541networking
541networking
 
541networking
541networking541networking
541networking
 
Internet for instruction 541
Internet for instruction 541Internet for instruction 541
Internet for instruction 541
 

Similar to Cloud Data Integration

Cloud Con 2015 - Integration & Web APIs
Cloud Con 2015 - Integration & Web APIsCloud Con 2015 - Integration & Web APIs
Cloud Con 2015 - Integration & Web APIs
SnapLogic
 
Informatica Cloud Overview
Informatica Cloud OverviewInformatica Cloud Overview
Informatica Cloud Overview
Darren Cunningham
 
Maximum Overdrive: How Cloud-Born Data Changes the Game
Maximum Overdrive: How Cloud-Born Data Changes the GameMaximum Overdrive: How Cloud-Born Data Changes the Game
Maximum Overdrive: How Cloud-Born Data Changes the Game
Inside Analysis
 
Where the Warehouse Ends: A New Age of Information Access
Where the Warehouse Ends: A New Age of Information AccessWhere the Warehouse Ends: A New Age of Information Access
Where the Warehouse Ends: A New Age of Information Access
Inside Analysis
 
Data Integration for Both Self-Service Analytics and IT Users
Data Integration for Both Self-Service Analytics and IT Users Data Integration for Both Self-Service Analytics and IT Users
Data Integration for Both Self-Service Analytics and IT Users
Senturus
 
What is cloud computing report
What is cloud computing reportWhat is cloud computing report
What is cloud computing report
Product Reviews
 
Top 5 Mistakes You Don’t Want to Make When Moving to the Cloud
Top 5 Mistakes You Don’t Want to Make When Moving to the CloudTop 5 Mistakes You Don’t Want to Make When Moving to the Cloud
Top 5 Mistakes You Don’t Want to Make When Moving to the Cloud
Internap
 
3 business technology trends in b2b
3 business technology trends in b2b3 business technology trends in b2b
3 business technology trends in b2b
Jean-François Caenen
 
IBM Relay 2015: Opening Keynote
IBM Relay 2015: Opening Keynote IBM Relay 2015: Opening Keynote
IBM Relay 2015: Opening Keynote
IBM
 
Client presentation ibm private modular cloud_082013
Client presentation ibm private modular cloud_082013Client presentation ibm private modular cloud_082013
Client presentation ibm private modular cloud_082013
jimmykibm
 
Informatica Cloud for Oracle
Informatica Cloud for OracleInformatica Cloud for Oracle
Informatica Cloud for Oracle
Darren Cunningham
 
IASA Atlanta September 2009
IASA Atlanta September 2009IASA Atlanta September 2009
IASA Atlanta September 2009
Christopher Curtin
 
How Cloud Providers are Playing with Traditional Data Centers
How Cloud Providers are Playing with Traditional Data CentersHow Cloud Providers are Playing with Traditional Data Centers
How Cloud Providers are Playing with Traditional Data Centers
Hostway|HOSTING
 
Cloud Data Integration Best Practices
Cloud Data Integration Best PracticesCloud Data Integration Best Practices
Cloud Data Integration Best Practices
Darren Cunningham
 
Cloud Ready Data: Speeding Your Journey to the Cloud
Cloud Ready Data: Speeding Your Journey to the CloudCloud Ready Data: Speeding Your Journey to the Cloud
Cloud Ready Data: Speeding Your Journey to the Cloud
DLT Solutions
 
Data Security Issues in Cloud Computing
Data Security Issues in Cloud ComputingData Security Issues in Cloud Computing
Data Security Issues in Cloud Computing
Asad Ali
 
Cloud Computing
Cloud ComputingCloud Computing
Cloud Computing
Madhusudan Partani
 
SendGrid Improves Email Delivery with Hybrid Data Warehousing
SendGrid Improves Email Delivery with Hybrid Data WarehousingSendGrid Improves Email Delivery with Hybrid Data Warehousing
SendGrid Improves Email Delivery with Hybrid Data Warehousing
Amazon Web Services
 
A Window into Salesforce Data Management
A Window into Salesforce Data ManagementA Window into Salesforce Data Management
A Window into Salesforce Data Management
Darren Cunningham
 
AI in Cloud Computing
AI in Cloud ComputingAI in Cloud Computing
AI in Cloud Computing
Zoe Gilbert
 

Similar to Cloud Data Integration (20)

Cloud Con 2015 - Integration & Web APIs
Cloud Con 2015 - Integration & Web APIsCloud Con 2015 - Integration & Web APIs
Cloud Con 2015 - Integration & Web APIs
 
Informatica Cloud Overview
Informatica Cloud OverviewInformatica Cloud Overview
Informatica Cloud Overview
 
Maximum Overdrive: How Cloud-Born Data Changes the Game
Maximum Overdrive: How Cloud-Born Data Changes the GameMaximum Overdrive: How Cloud-Born Data Changes the Game
Maximum Overdrive: How Cloud-Born Data Changes the Game
 
Where the Warehouse Ends: A New Age of Information Access
Where the Warehouse Ends: A New Age of Information AccessWhere the Warehouse Ends: A New Age of Information Access
Where the Warehouse Ends: A New Age of Information Access
 
Data Integration for Both Self-Service Analytics and IT Users
Data Integration for Both Self-Service Analytics and IT Users Data Integration for Both Self-Service Analytics and IT Users
Data Integration for Both Self-Service Analytics and IT Users
 
What is cloud computing report
What is cloud computing reportWhat is cloud computing report
What is cloud computing report
 
Top 5 Mistakes You Don’t Want to Make When Moving to the Cloud
Top 5 Mistakes You Don’t Want to Make When Moving to the CloudTop 5 Mistakes You Don’t Want to Make When Moving to the Cloud
Top 5 Mistakes You Don’t Want to Make When Moving to the Cloud
 
3 business technology trends in b2b
3 business technology trends in b2b3 business technology trends in b2b
3 business technology trends in b2b
 
IBM Relay 2015: Opening Keynote
IBM Relay 2015: Opening Keynote IBM Relay 2015: Opening Keynote
IBM Relay 2015: Opening Keynote
 
Client presentation ibm private modular cloud_082013
Client presentation ibm private modular cloud_082013Client presentation ibm private modular cloud_082013
Client presentation ibm private modular cloud_082013
 
Informatica Cloud for Oracle
Informatica Cloud for OracleInformatica Cloud for Oracle
Informatica Cloud for Oracle
 
IASA Atlanta September 2009
IASA Atlanta September 2009IASA Atlanta September 2009
IASA Atlanta September 2009
 
How Cloud Providers are Playing with Traditional Data Centers
How Cloud Providers are Playing with Traditional Data CentersHow Cloud Providers are Playing with Traditional Data Centers
How Cloud Providers are Playing with Traditional Data Centers
 
Cloud Data Integration Best Practices
Cloud Data Integration Best PracticesCloud Data Integration Best Practices
Cloud Data Integration Best Practices
 
Cloud Ready Data: Speeding Your Journey to the Cloud
Cloud Ready Data: Speeding Your Journey to the CloudCloud Ready Data: Speeding Your Journey to the Cloud
Cloud Ready Data: Speeding Your Journey to the Cloud
 
Data Security Issues in Cloud Computing
Data Security Issues in Cloud ComputingData Security Issues in Cloud Computing
Data Security Issues in Cloud Computing
 
Cloud Computing
Cloud ComputingCloud Computing
Cloud Computing
 
SendGrid Improves Email Delivery with Hybrid Data Warehousing
SendGrid Improves Email Delivery with Hybrid Data WarehousingSendGrid Improves Email Delivery with Hybrid Data Warehousing
SendGrid Improves Email Delivery with Hybrid Data Warehousing
 
A Window into Salesforce Data Management
A Window into Salesforce Data ManagementA Window into Salesforce Data Management
A Window into Salesforce Data Management
 
AI in Cloud Computing
AI in Cloud ComputingAI in Cloud Computing
AI in Cloud Computing
 

Recently uploaded

Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
ThousandEyes
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
Product School
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
Ana-Maria Mihalceanu
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
DianaGray10
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
Thijs Feryn
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
Product School
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Jeffrey Haguewood
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Product School
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
Paul Groth
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Product School
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
Elena Simperl
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
Product School
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
DanBrown980551
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Tobias Schneck
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Ramesh Iyer
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Thierry Lestable
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
BookNet Canada
 

Recently uploaded (20)

Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
 

Cloud Data Integration

  • 1. Backupify.com Board Meeting December 2010 Rob May (@robmay) CEO, Backupify rob@backupify.com http://bit.ly/clouddataintegration Confidential Agile Cloud Integration 1
  • 2. What You Will Learn How to integrate at the speed of business How to avoid data chaos Best practices for cloud integration 2
  • 3. About Backupify Backup, Search, Restore SaaS data Founded in 2008 165,000 customers 150TB of data Integrated with 18 services One of the largest users of Cassandra 3
  • 4. CONFIDENTIAL 4 30% Data Loss is Due to User Error
  • 5. 5 “ Yes, I clicked the delete button. Yes, I regret it now. Yes, I belatedly realized why the Backupify service makes sense. ” Backup For Cloud AppsDavid F. Carr November 2010
  • 6. What Do We Mean By Integration? 6
  • 7. Back In The Day (On Premise) Few applications had good APIs but… Integration was relatively easy Full control of access, security & storage Independent access to all data in DBMSs & FS DBMS & FS triggers could kick off integration 7
  • 8. Back In The Day (On Premise) Pros Many good integration products with mature application connectors Ability to govern software updates across systems You had more control Could always go straight at the data Cons Too many plumbing options (CORBA, DCOM, RMI, SOAP, MQ, …) Few apps had good APIs Version management problems 8
  • 9. Moving To SaaS Means You have all the APIs you’ll ever need Everything is really simple 9
  • 10. Benefits of Moving To SaaS Lower costs Information accessible anywhere Productive users Fewer maintenance headaches 10
  • 11. Cons of Moving To SaaS Loss of access Service outages & data loss Data is isolated The API is what it is Loss of control Forced app/API upgrades Hacked accounts Privacy risk 11
  • 12. The Problem With APIs Design issues Vendors design for the expected use cases Customers always push the boundaries Hard to build consistent copy of data model Implementation may not follow spec Access limitations API Throttling Query result set size limitations Historical query limitations 12
  • 13. The Solution: Cloud Data Integration The best of both worlds Use SaaS as much as you want Use SaaS APIs whenever you can Have full control & independent access to your SaaS & on-premise data in the cloud Rules, triggers & integration logic run right next to the data in the cloud 13
  • 14. The Problem With Cloud Integration Cloud integration == Connectors 2.0 14
  • 15. This is Really Hard Massive infrastructure challenges Backupify has accidently become one of the foremost experts on Cassandra It is easy to screw up E.g., lock users out of their Gmail accounts Some things are impossible How do you Twitter in regulated industries? 15
  • 16. The Hard Problems are Worth Solving Cloud Data Integration is agile integration Best of both worlds Best way to respond to new business needs Best way to protect against vendor change The SaaS vendors will help Front vs. backdoor SaaS APIs Cloud Data Intermediaries, e.g., GNIP 16
  • 17. How To Think About Cloud Data Integration 17
  • 18. The Hard Skills API knowledge & know-how Extreme & continuous testing automation Efficient cloud operations at huge scale Design for failure Avoid data chaos 18
  • 19. The Soft Skills: Be A Good Partner 19
  • 20. Best Practices Implement, then generify Play nice with partners Expect to throttle Authenticate securely Plan for data model/access changes CONFIDENTIAL 20
  • 21. Moving At The Speed of Business Generify you architecture as you incorporate more APIs Build for fault tolerance Use Oauth or similar authentication options when possible CONFIDENTIAL 21
  • 22. Avoid Data Chaos Build throttling into your model – you will eventually need it. Plan for a time when the API data model will allow more or less access to data Play nice with partners, but be vocal – they don’t always get it right. CONFIDENTIAL 22
  • 23. What Else Can You Do with Your Data? 23 Backup Search Migrate Restore Integrate Cloud Data Integration
  • 24. Questions? Contact me: @robmay rob@backupify.com http://bit.ly/clouddataintegration CONFIDENTIAL 24

Editor's Notes

  1. Could break this into: (1) it was hard and (2) it was easy
  2. Mention that you didn’t fail when AWS did. Talk about why.