Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Upcoming SlideShare
What to Upload to SlideShare
Next
Download to read offline and view in fullscreen.

Share

Running Business Analytics for a Serverless Insurance Company - Joe Emison & Fivetran

Download to read offline

Take a peek into the future of IT - beyond Serverless Software Development, when Serverless becomes a way to run Internal IT.

When ServerlessToronto.org invited Joe Emison - AWS Serverless Hero, we expected to see how he "knocked down the wall" between AWS & Google Clouds (to query Amazon DynamoDB from Google BigQuery) using the Fivetran ELT tool, but we learned so much more... and you will too: https://youtu.be/GK5Ivm6EOlI

Related Books

Free with a 30 day trial from Scribd

See all

Related Audiobooks

Free with a 30 day trial from Scribd

See all
  • Be the first to like this

Running Business Analytics for a Serverless Insurance Company - Joe Emison & Fivetran

  1. 1. 1
  2. 2. Welcome to ServerlessToronto.org 2 Introduce Yourself: - Where from? Why are you here? - Looking for, or Offering work? Fill the survey to win prises! May 10, 2021: “Running (Business Analytics for) a Serverless Insurance Company” starts at 18:10pm…
  3. 3. Serverless Evolution (since FaaS started) 3 Serverless is New Agile & Mindset #1 We started as Back- end FaaS (Serverless) Developers who enjoyed “gluing” other people’s APIs and Managed Services) #3 We're obsessed by creating business value (meaningful MVPs, Products), focusing on Outcomes – NOT Outputs, and we mesh well with Product Managers #2 We build bridges between Serverless Community (“Dev leg”), and Front-end, Voice-First & UX folks (“UX leg”) #4 Achieve agility NOT by “sprinting” faster (like in Scrum), but working smarter (by using bigger building blocks and less Ops)
  4. 4. Disconnect between IT & Business needs 4 How to help companies accelerate? Technology is not the point => We are here to create Value Adopting Serverless Mindset allowed us to shift the focus from “pimping up our cars” (infrastructure/code), towards “driving” (the business) forward. ≠
  5. 5. Let’s bridge the Businesses & IT Gap by: 5 1. bringing more Business-focused topics (like one today) to educate, 2. offering free Second Opinions on Application/Data Architecture modernization (to Businesses), 3. offering for-fee Consulting service (regardless of how short they are), 4. start offering “matchmaking” services… to connect Cloud experts in the Community with Employers. Fill the Survey to indicate your needs / interests, and to win Manning raffle today: https://forms.gle/97fXbFxxtPzp4jsh8
  6. 6. Knowledge Sponsor (on our path to enlightenment :) 1. Go to www.manning.com 2. Select *any* e-Book, Video course, or liveProject you want! 3. Add it to your shopping cart (no more than 1 item in the cart) 4. Raffle winners will send me the emails (used in Manning portal), 5. So the publisher can move it to your Dashboard – as if purchased. Fill the survey to win!
  7. 7. Upcoming ServerlessToronto.org Meetups 7 1) Azure for Bioinformatics: Data Lake Architecture for genomic- scale data analysis – Lynn Langit 2) Smart Cities in Italy put Silicon Valley to shame with innovative IoT solutions – Antonio Puliafito 3) Building a Data Cloud to enable Analytics and AI-Driven Innovation – Lak Lakshmanan, Head Data Analytics & AI @ GCP 4) Snowflake talk… and YOUR “This is my Architecture” style presentations are welcome! Please rate us on Meetup & Tell your peers we’re here to Help YOU help others
  8. 8. 8 Just an example how Joe influenced us
  9. 9. 9 Presentation + Demo
  10. 10. Running Business Analytics for a Serverless Insurance Company @joeemison
  11. 11. I Have Made Mistakes: 22 years, 6 startups
  12. 12. Organizations Die on Common, Predictable, Unnecessary Hills Undifferentiated Heavy Lifting Tech Blocks Everything
  13. 13. The Best Organizations Focus and Empower Leaders Focus on the differentiated: ● Faster ● Cheaper ● Better ● Develop Internal Staff Get out of the way: ● Leaders can execute in parallel ● Everyone is in technology ● No one can hide
  14. 14. Examples within Branch: Serverless Architecture
  15. 15. Examples within Branch: Software-as-a-Service
  16. 16. All about ETLs and Data Warehouses Talend Alteryx y42
  17. 17. There’s Another Way: EL … T and Data Lakes
  18. 18. Fivetran at Branch
  19. 19. BigQuery at Branch
  20. 20. Looker at Branch
  21. 21. Enabling Every Decision to be Data-Driven Automated data integration that adapts to change for reliable data access.
  22. 22. Agenda 1. How Analytics Is Changing 2. The Impact of Automation 3. What is Fivetran? 4. UI Demo
  23. 23. High Rate of Resource Waste on Pipelines
  24. 24. The analytics landscape has shifted ● Constraining compute (On-premises) ● Perpetual licensing ● ETL outside the database ● Separation of storage + compute (on-premise) ● Subscription licensing ● Complex pipelines required for large datasets Single Node Databases Scalable Databases ● Auto scale cloud DBMS ● Usage based licensing ● Separation of storage and compute allows for agile data pipelines Modern Cloud Databases Pipeline architecture is being built on old assumptions
  25. 25. Business Outcomes Data-driven decisions at scale require automation so you can... Save Resources Deliver insights more reliably with less resources Discover More Insights Centralize more data to discover hidden insights to optimize all areas of your business Free up Time Without maintaining data pipelines, use this time to _____
  26. 26. Data Reliability Fully Managed Centralized Data Pipeline can restart from a point of failure, with minimal costs, so that data integrity is preserved in case of source outage Infrastructure is cloud-hosted and fully managed to reduce resource management for servers and development Raw source data should be brought to a centralized destination and delivered in a schema that is optimized for analytic workloads The pipeline requirements...
  27. 27. A Powerful Core Platform Automated Fivetran creates and maintains a perfect replica of your data, with minimal user intervention across 150+ connectors Resilient The core architecture of Fivetran enables recovery from any point of failure with no user intervention required Cloud Native Our engineers monitor and update our code as the sources change
  28. 28. ➔ Automatic Data Updates (DML) ➔ Automatic Schema Migrations (DDL) ➔ Automated Recovery from Failure (Idempotent) ➔ Micro-batched architecture ➔ Extensible Cloud Functions What makes it different?
  29. 29. Serious about security SOC 2 TYPE 2 certified, GDPR compliant, HIPAA BAA Regularly audited and certified for data industry best practices. End-to-end Encryption Data is encrypted end-to-end in transit and at rest using encrypted user keys. No Data Retention Data is deleted after no more than 24 hours from our system.
  30. 30. Fivetran Managed Workflow 1 2 3 4 5 6 Authenticate into sources Fivetran handles scheduling and batching queries and API calls Source sends data to Fivetran in form of JSON or Queried Data Automatic Normalization of Data Fivetran creates the appropriate schemas and tables in the destination Destination
  31. 31. Fivetran General Architecture
  32. 32. Automatic Data Updates Insert Update Delete Source Destination
  33. 33. Automatic Schema Drift Handling Add Column Remove Column Change Type Source Destination Add Object Remove Object
  34. 34. We continually add new connectors! Visit our directory page for an up to date list! Sales Databases Events Files Functions ● Microsoft Dynamics 365 ● Salesforce ● Shopify ● PrestaShop ● Pipedrive ● Spree Commerce ● OsCommerce ● PrestaShop ● Microsoft Dynamics NAV ● Oracle EBS ● WooCommerce ● Loaded Commerce ● DynamoDB ● MariaDB ● MongoDB ● MySQL ● Oracle ● PostgreSQL ● SQL Server ● Segment ● Snowplow ● Webhooks ● Airtable ● Amazon Cloudfront ● Amazon Kinesis ● Amazon S3 ● Azure Blob Storage ● Box ● Browser Upload ● Dropbox ● Email ● FTP ● FTPS ● Google Cloud Storage ● Google Drive ● Google Sheets ● SFTP ● AWS Lambda ● Azure Functions ● Google Cloud Functions Warehouses ● Azure Data Explorer ● Azure SQL ● BigQuery ● MySQL ● Panoly ● Periscope ● PostgreSQL ● Redshift ● Snowflake → fivetran.com/directory Prebuilt connectors Support ● Comm100 ● Freshdesk ● Front ● Help Scout ● Intercom ● Kustomer ● UserVoice ● Zendesk ● Zendesk Chat Marketing ● Adobe Analytics ● AdRoll ● Apple Search Ads ● Appsflyer Finance ● Anaplan ● Braintree ● Coupa ● Lightspeed ● NetSuite SuiteAnalytics ● QuickBooks Online ● Recharge ● Recurly ● SAP ERP ● Square ● Stripe ● Xero ● Zuora ● Microsoft Dynamics Suite ● Sage Intacct ● SAP Concur Human Resources ● Greenhouse ● Lever ● Workday Productivity ● Asana ● Mavenlink ● ServiceNow ● Height ● CSV Uploader ● Airtable ● Bing Ads ● Braze ● Campaign Manager ● Criteo ● Facebook ● Google Ads ● Google Analytics ● Google Play ● Google Search Console ● HubSpot ● Iterable ● Itunes Connect ● Klaviyo ● LinkedIn Ads ● MailChimp ● Mandrill ● Marin Software ● Marketo ● Oracle Eloqua ● Outbrain ● Pardot ● Pinterest Ads ● Sailthru ● Salesforce Marketing Cloud ● SendGrid ● Snapchat Ads ● Taboola ● Twitter Ads ● Yahoo Gemini ● YouTube
  35. 35. Customers Investors Highlights ● 2,500+ customers ● 2.5 Trillion Rows Synced/Month ● 2019 Deloitte Fast 500 Award Winner ● 2019 Y Combinator Top Companies List → https://www.seagate.com/files/www-content/our-story/trends/files/idc-seagate-dataage-whitepaper.pdf Top Rated 4.5 Rating Denver, CO Munich, DE Oakland, CA Bangalore, IN Dublin, IR Sydney, AU
  36. 36. Fivetran UI
  37. 37. Branch Case Study (Fivetran, AWS)
  38. 38. Join www.ServerlessToronto.org Home of “Less IT Mess”

Take a peek into the future of IT - beyond Serverless Software Development, when Serverless becomes a way to run Internal IT. When ServerlessToronto.org invited Joe Emison - AWS Serverless Hero, we expected to see how he "knocked down the wall" between AWS & Google Clouds (to query Amazon DynamoDB from Google BigQuery) using the Fivetran ELT tool, but we learned so much more... and you will too: https://youtu.be/GK5Ivm6EOlI

Views

Total views

174

On Slideshare

0

From embeds

0

Number of embeds

2

Actions

Downloads

5

Shares

0

Comments

0

Likes

0

×