1
Welcome to ServerlessToronto.org
2
Introduce Yourself:
- Where from? Why are you here?
- Looking for, or Offering work?
Fill the survey to win prises!
May 10, 2021: “Running (Business
Analytics for) a Serverless Insurance
Company” starts at 18:10pm…
Serverless Evolution (since FaaS started)
3
Serverless is New Agile & Mindset
#1 We started as Back-
end FaaS (Serverless)
Developers who enjoyed
“gluing” other people’s
APIs and Managed
Services)
#3 We're obsessed by
creating business value
(meaningful MVPs,
Products), focusing on
Outcomes – NOT
Outputs, and we mesh
well with Product
Managers
#2 We build bridges
between Serverless
Community (“Dev leg”),
and Front-end, Voice-First
& UX folks (“UX leg”)
#4 Achieve agility NOT
by “sprinting” faster
(like in Scrum), but
working smarter (by
using bigger building
blocks and less Ops)
Disconnect between IT & Business needs
4
How to help companies accelerate?
Technology is not the point => We are here to create Value
Adopting Serverless Mindset allowed us to shift the focus from “pimping
up our cars” (infrastructure/code), towards “driving” (the business) forward.
≠
Let’s bridge the Businesses & IT Gap by:
5
1. bringing more Business-focused
topics (like one today) to educate,
2. offering free Second Opinions on
Application/Data Architecture
modernization (to Businesses),
3. offering for-fee Consulting service
(regardless of how short they are),
4. start offering “matchmaking”
services… to connect Cloud experts
in the Community with Employers.
Fill the Survey to indicate your
needs / interests, and
to win Manning raffle today:
https://forms.gle/97fXbFxxtPzp4jsh8
Knowledge Sponsor
(on our path to enlightenment :)
1. Go to www.manning.com
2. Select *any* e-Book, Video course, or liveProject you want!
3. Add it to your shopping cart (no more than 1 item in the cart)
4. Raffle winners will send me the emails (used in Manning portal),
5. So the publisher can move it to your Dashboard – as if purchased.
Fill the survey to win!
Upcoming ServerlessToronto.org Meetups
7
1) Azure for Bioinformatics: Data
Lake Architecture for genomic-
scale data analysis – Lynn Langit
2) Smart Cities in Italy put Silicon
Valley to shame with innovative
IoT solutions – Antonio Puliafito
3) Building a Data Cloud to enable
Analytics and AI-Driven
Innovation – Lak Lakshmanan,
Head Data Analytics & AI @ GCP
4) Snowflake talk… and YOUR
“This is my Architecture” style
presentations are welcome!
Please rate us on Meetup &
Tell your peers we’re here to
Help YOU help others
8
Just an example how Joe influenced us
9
Presentation + Demo
Running Business Analytics for a
Serverless Insurance Company
@joeemison
I Have Made Mistakes: 22 years, 6 startups
Organizations Die on Common, Predictable, Unnecessary Hills
Undifferentiated Heavy Lifting Tech Blocks Everything
The Best Organizations Focus and Empower Leaders
Focus on the differentiated:
● Faster
● Cheaper
● Better
● Develop Internal Staff
Get out of the way:
● Leaders can execute in parallel
● Everyone is in technology
● No one can hide
Examples within Branch: Serverless Architecture
Examples within Branch: Software-as-a-Service
All about ETLs and Data Warehouses
Talend
Alteryx
y42
There’s Another Way: EL … T and Data Lakes
Fivetran at Branch
BigQuery at Branch
Looker at Branch
Enabling Every Decision
to be Data-Driven
Automated data integration that adapts to change for reliable data access.
Agenda
1. How Analytics Is
Changing
2. The Impact of
Automation
3. What is Fivetran?
4. UI Demo
High Rate of Resource Waste on Pipelines
The analytics landscape has shifted
● Constraining compute
(On-premises)
● Perpetual licensing
● ETL outside the database
● Separation of storage +
compute (on-premise)
● Subscription licensing
● Complex pipelines required
for large datasets
Single Node Databases Scalable Databases
● Auto scale cloud DBMS
● Usage based licensing
● Separation of storage and
compute allows for agile
data pipelines
Modern Cloud Databases
Pipeline architecture is being built on old assumptions
Business
Outcomes
Data-driven decisions at scale
require automation so you can...
Save Resources
Deliver insights more reliably with
less resources
Discover More Insights
Centralize more data to discover
hidden insights to optimize all
areas of your business
Free up Time
Without maintaining data
pipelines, use this time to _____
Data Reliability Fully Managed
Centralized Data
Pipeline can restart from a
point of failure, with minimal
costs, so that data integrity is
preserved in case of source
outage
Infrastructure is cloud-hosted
and fully managed to reduce
resource management for
servers and development
Raw source data should be
brought to a centralized
destination and delivered in a
schema that is optimized for
analytic workloads
The pipeline requirements...
A Powerful
Core Platform
Automated
Fivetran creates and maintains a perfect replica
of your data, with minimal user intervention
across 150+ connectors
Resilient
The core architecture of Fivetran enables
recovery from any point of failure with no user
intervention required
Cloud Native
Our engineers monitor and update our code as
the sources change
➔ Automatic Data
Updates (DML)
➔ Automatic Schema
Migrations (DDL)
➔ Automated Recovery
from Failure
(Idempotent)
➔ Micro-batched
architecture
➔ Extensible Cloud
Functions
What makes it different?
Serious about security
SOC 2 TYPE 2 certified,
GDPR compliant,
HIPAA BAA
Regularly audited
and certified for data
industry best practices.
End-to-end Encryption
Data is encrypted
end-to-end in transit
and at rest using
encrypted user keys.
No Data Retention
Data is deleted after
no more than 24 hours
from our system.
Fivetran Managed Workflow
1 2 3 4 5 6
Authenticate into
sources
Fivetran handles
scheduling and
batching queries
and API calls
Source sends
data to Fivetran
in form of JSON
or Queried Data
Automatic
Normalization of
Data
Fivetran creates
the appropriate
schemas and
tables in the
destination
Destination
Fivetran General Architecture
Automatic
Data Updates
Insert
Update
Delete
Source Destination
Automatic
Schema
Drift Handling
Add Column
Remove Column
Change Type
Source Destination
Add Object
Remove Object
We continually add new connectors!
Visit our directory page for an up to date list!
Sales Databases
Events
Files Functions
● Microsoft Dynamics 365
● Salesforce
● Shopify
● PrestaShop
● Pipedrive
● Spree Commerce
● OsCommerce
● PrestaShop
● Microsoft Dynamics NAV
● Oracle EBS
● WooCommerce
● Loaded Commerce
● DynamoDB
● MariaDB
● MongoDB
● MySQL
● Oracle
● PostgreSQL
● SQL Server
● Segment
● Snowplow
● Webhooks
● Airtable
● Amazon Cloudfront
● Amazon Kinesis
● Amazon S3
● Azure Blob Storage
● Box
● Browser Upload
● Dropbox
● Email
● FTP
● FTPS
● Google Cloud Storage
● Google Drive
● Google Sheets
● SFTP
● AWS Lambda
● Azure Functions
● Google Cloud Functions
Warehouses
● Azure Data Explorer
● Azure SQL
● BigQuery
● MySQL
● Panoly
● Periscope
● PostgreSQL
● Redshift
● Snowflake
→ fivetran.com/directory
Prebuilt connectors
Support
● Comm100
● Freshdesk
● Front
● Help Scout
● Intercom
● Kustomer
● UserVoice
● Zendesk
● Zendesk Chat
Marketing
● Adobe Analytics
● AdRoll
● Apple Search Ads
● Appsflyer
Finance
● Anaplan
● Braintree
● Coupa
● Lightspeed
● NetSuite SuiteAnalytics
● QuickBooks Online
● Recharge
● Recurly
● SAP ERP
● Square
● Stripe
● Xero
● Zuora
● Microsoft Dynamics Suite
● Sage Intacct
● SAP Concur
Human Resources
● Greenhouse
● Lever
● Workday
Productivity
● Asana
● Mavenlink
● ServiceNow
● Height
● CSV Uploader
● Airtable
● Bing Ads
● Braze
● Campaign Manager
● Criteo
● Facebook
● Google Ads
● Google Analytics
● Google Play
● Google Search Console
● HubSpot
● Iterable
● Itunes Connect
● Klaviyo
● LinkedIn Ads
● MailChimp
● Mandrill
● Marin Software
● Marketo
● Oracle Eloqua
● Outbrain
● Pardot
● Pinterest Ads
● Sailthru
● Salesforce Marketing Cloud
● SendGrid
● Snapchat Ads
● Taboola
● Twitter Ads
● Yahoo Gemini
● YouTube
Customers
Investors
Highlights
● 2,500+ customers
● 2.5 Trillion Rows Synced/Month
● 2019 Deloitte Fast 500 Award
Winner
● 2019 Y Combinator Top
Companies List
→ https://www.seagate.com/files/www-content/our-story/trends/files/idc-seagate-dataage-whitepaper.pdf
Top Rated
4.5 Rating
Denver, CO Munich, DE
Oakland, CA Bangalore, IN
Dublin, IR
Sydney, AU
Fivetran UI
Branch Case Study
(Fivetran, AWS)
Join www.ServerlessToronto.org
Home of “Less IT Mess”

Running Business Analytics for a Serverless Insurance Company - Joe Emison & Fivetran

  • 1.
  • 2.
    Welcome to ServerlessToronto.org 2 IntroduceYourself: - Where from? Why are you here? - Looking for, or Offering work? Fill the survey to win prises! May 10, 2021: “Running (Business Analytics for) a Serverless Insurance Company” starts at 18:10pm…
  • 3.
    Serverless Evolution (sinceFaaS started) 3 Serverless is New Agile & Mindset #1 We started as Back- end FaaS (Serverless) Developers who enjoyed “gluing” other people’s APIs and Managed Services) #3 We're obsessed by creating business value (meaningful MVPs, Products), focusing on Outcomes – NOT Outputs, and we mesh well with Product Managers #2 We build bridges between Serverless Community (“Dev leg”), and Front-end, Voice-First & UX folks (“UX leg”) #4 Achieve agility NOT by “sprinting” faster (like in Scrum), but working smarter (by using bigger building blocks and less Ops)
  • 4.
    Disconnect between IT& Business needs 4 How to help companies accelerate? Technology is not the point => We are here to create Value Adopting Serverless Mindset allowed us to shift the focus from “pimping up our cars” (infrastructure/code), towards “driving” (the business) forward. ≠
  • 5.
    Let’s bridge theBusinesses & IT Gap by: 5 1. bringing more Business-focused topics (like one today) to educate, 2. offering free Second Opinions on Application/Data Architecture modernization (to Businesses), 3. offering for-fee Consulting service (regardless of how short they are), 4. start offering “matchmaking” services… to connect Cloud experts in the Community with Employers. Fill the Survey to indicate your needs / interests, and to win Manning raffle today: https://forms.gle/97fXbFxxtPzp4jsh8
  • 6.
    Knowledge Sponsor (on ourpath to enlightenment :) 1. Go to www.manning.com 2. Select *any* e-Book, Video course, or liveProject you want! 3. Add it to your shopping cart (no more than 1 item in the cart) 4. Raffle winners will send me the emails (used in Manning portal), 5. So the publisher can move it to your Dashboard – as if purchased. Fill the survey to win!
  • 7.
    Upcoming ServerlessToronto.org Meetups 7 1)Azure for Bioinformatics: Data Lake Architecture for genomic- scale data analysis – Lynn Langit 2) Smart Cities in Italy put Silicon Valley to shame with innovative IoT solutions – Antonio Puliafito 3) Building a Data Cloud to enable Analytics and AI-Driven Innovation – Lak Lakshmanan, Head Data Analytics & AI @ GCP 4) Snowflake talk… and YOUR “This is my Architecture” style presentations are welcome! Please rate us on Meetup & Tell your peers we’re here to Help YOU help others
  • 8.
    8 Just an examplehow Joe influenced us
  • 9.
  • 10.
    Running Business Analyticsfor a Serverless Insurance Company @joeemison
  • 11.
    I Have MadeMistakes: 22 years, 6 startups
  • 12.
    Organizations Die onCommon, Predictable, Unnecessary Hills Undifferentiated Heavy Lifting Tech Blocks Everything
  • 13.
    The Best OrganizationsFocus and Empower Leaders Focus on the differentiated: ● Faster ● Cheaper ● Better ● Develop Internal Staff Get out of the way: ● Leaders can execute in parallel ● Everyone is in technology ● No one can hide
  • 14.
    Examples within Branch:Serverless Architecture
  • 15.
    Examples within Branch:Software-as-a-Service
  • 16.
    All about ETLsand Data Warehouses Talend Alteryx y42
  • 17.
    There’s Another Way:EL … T and Data Lakes
  • 18.
  • 19.
  • 20.
  • 21.
    Enabling Every Decision tobe Data-Driven Automated data integration that adapts to change for reliable data access.
  • 22.
    Agenda 1. How AnalyticsIs Changing 2. The Impact of Automation 3. What is Fivetran? 4. UI Demo
  • 23.
    High Rate ofResource Waste on Pipelines
  • 24.
    The analytics landscapehas shifted ● Constraining compute (On-premises) ● Perpetual licensing ● ETL outside the database ● Separation of storage + compute (on-premise) ● Subscription licensing ● Complex pipelines required for large datasets Single Node Databases Scalable Databases ● Auto scale cloud DBMS ● Usage based licensing ● Separation of storage and compute allows for agile data pipelines Modern Cloud Databases Pipeline architecture is being built on old assumptions
  • 25.
    Business Outcomes Data-driven decisions atscale require automation so you can... Save Resources Deliver insights more reliably with less resources Discover More Insights Centralize more data to discover hidden insights to optimize all areas of your business Free up Time Without maintaining data pipelines, use this time to _____
  • 26.
    Data Reliability FullyManaged Centralized Data Pipeline can restart from a point of failure, with minimal costs, so that data integrity is preserved in case of source outage Infrastructure is cloud-hosted and fully managed to reduce resource management for servers and development Raw source data should be brought to a centralized destination and delivered in a schema that is optimized for analytic workloads The pipeline requirements...
  • 27.
    A Powerful Core Platform Automated Fivetrancreates and maintains a perfect replica of your data, with minimal user intervention across 150+ connectors Resilient The core architecture of Fivetran enables recovery from any point of failure with no user intervention required Cloud Native Our engineers monitor and update our code as the sources change
  • 28.
    ➔ Automatic Data Updates(DML) ➔ Automatic Schema Migrations (DDL) ➔ Automated Recovery from Failure (Idempotent) ➔ Micro-batched architecture ➔ Extensible Cloud Functions What makes it different?
  • 29.
    Serious about security SOC2 TYPE 2 certified, GDPR compliant, HIPAA BAA Regularly audited and certified for data industry best practices. End-to-end Encryption Data is encrypted end-to-end in transit and at rest using encrypted user keys. No Data Retention Data is deleted after no more than 24 hours from our system.
  • 30.
    Fivetran Managed Workflow 12 3 4 5 6 Authenticate into sources Fivetran handles scheduling and batching queries and API calls Source sends data to Fivetran in form of JSON or Queried Data Automatic Normalization of Data Fivetran creates the appropriate schemas and tables in the destination Destination
  • 31.
  • 32.
  • 33.
    Automatic Schema Drift Handling Add Column RemoveColumn Change Type Source Destination Add Object Remove Object
  • 34.
    We continually addnew connectors! Visit our directory page for an up to date list! Sales Databases Events Files Functions ● Microsoft Dynamics 365 ● Salesforce ● Shopify ● PrestaShop ● Pipedrive ● Spree Commerce ● OsCommerce ● PrestaShop ● Microsoft Dynamics NAV ● Oracle EBS ● WooCommerce ● Loaded Commerce ● DynamoDB ● MariaDB ● MongoDB ● MySQL ● Oracle ● PostgreSQL ● SQL Server ● Segment ● Snowplow ● Webhooks ● Airtable ● Amazon Cloudfront ● Amazon Kinesis ● Amazon S3 ● Azure Blob Storage ● Box ● Browser Upload ● Dropbox ● Email ● FTP ● FTPS ● Google Cloud Storage ● Google Drive ● Google Sheets ● SFTP ● AWS Lambda ● Azure Functions ● Google Cloud Functions Warehouses ● Azure Data Explorer ● Azure SQL ● BigQuery ● MySQL ● Panoly ● Periscope ● PostgreSQL ● Redshift ● Snowflake → fivetran.com/directory Prebuilt connectors Support ● Comm100 ● Freshdesk ● Front ● Help Scout ● Intercom ● Kustomer ● UserVoice ● Zendesk ● Zendesk Chat Marketing ● Adobe Analytics ● AdRoll ● Apple Search Ads ● Appsflyer Finance ● Anaplan ● Braintree ● Coupa ● Lightspeed ● NetSuite SuiteAnalytics ● QuickBooks Online ● Recharge ● Recurly ● SAP ERP ● Square ● Stripe ● Xero ● Zuora ● Microsoft Dynamics Suite ● Sage Intacct ● SAP Concur Human Resources ● Greenhouse ● Lever ● Workday Productivity ● Asana ● Mavenlink ● ServiceNow ● Height ● CSV Uploader ● Airtable ● Bing Ads ● Braze ● Campaign Manager ● Criteo ● Facebook ● Google Ads ● Google Analytics ● Google Play ● Google Search Console ● HubSpot ● Iterable ● Itunes Connect ● Klaviyo ● LinkedIn Ads ● MailChimp ● Mandrill ● Marin Software ● Marketo ● Oracle Eloqua ● Outbrain ● Pardot ● Pinterest Ads ● Sailthru ● Salesforce Marketing Cloud ● SendGrid ● Snapchat Ads ● Taboola ● Twitter Ads ● Yahoo Gemini ● YouTube
  • 35.
    Customers Investors Highlights ● 2,500+ customers ●2.5 Trillion Rows Synced/Month ● 2019 Deloitte Fast 500 Award Winner ● 2019 Y Combinator Top Companies List → https://www.seagate.com/files/www-content/our-story/trends/files/idc-seagate-dataage-whitepaper.pdf Top Rated 4.5 Rating Denver, CO Munich, DE Oakland, CA Bangalore, IN Dublin, IR Sydney, AU
  • 36.
  • 37.
  • 38.