New! Real-Time Data Replication to Snowflake

•Download as PPTX, PDF•

0 likes•147 views

Your business is adopting the Snowflake cloud data platform to rapidly deliver data insights and lower the costs of your data warehouse. But you have a problem – what happens when data changes on your mainframe and IBM i systems? How do you make sure Snowflake is always up-to-date and in sync with these systems of record? If you can’t integrate changes occurring on your mainframe and IBM i systems to Snowflake, your business will miss the critical data it needs to drive real-time insights and decision making. Join us to learn how the latest enhancements to Precisely Connect help your business meet its data-driven goals by sharing changes made on legacy, mainframe, and IBM systems to Snowflake in real time. During this webinar, you will learn more about: - How to easily support data replication from mainframe and IBM i to Snowflake - Connect’s enhanced data replication capabilities for cloud data platforms - How customers are using Connect to support their cloud data platform strategies

Technology

New! Real-Time
Data Replication
to Snowflake
Ashwin Ramachandran | Senior Product Manager

Agenda
• Market drivers
• New Feature: Precisely Connect
and Snowflake
• Customer Story
• Q&A
Precisely 2020: New! Real-Time Data Replication to Snowflake

Precisely 2020: New! Real-Time Data Replication to Snowflake
Why choose a cloud data platform approach?
Build scalable data
warehouses very quickly
Handle proliferating data
variety
Enable analytics and
insights at a faster rate
Lower hardware and
software costs

Cloud data platform nirvana:
All enterprise data accessible
Data from legacy systems in cloud
data platforms
Building data pipelines to cloud data
platforms in seamless, no rework
Changes to data reflected in real-time,
without the need for batch window
refreshes
Precisely 2020: New! Real-Time Data Replication to Snowflake

The reality
• Legacy data formats not readily
compatible with cloud data platforms
• Communicating changes is delayed
and business works off old data
• Reliably delivering data at scale is
easier said than done
Precisely 2020: New! Real-Time Data Replication to Snowflake

Precisely 2020: New! Real-Time Data Replication to Snowflake

Highlights
• Capture changes from legacy data
sources in real-time to Snowflake
• Convert mainframe, IBM i and data
from other sources to be shared
anywhere on Snowflake
• Deploy Precisely Connect on-prem, in
cloud or hybrid environments
Precisely 2020: New! Real-Time Data Replication to Snowflake

Mainframe
(Db2, VSAM)
IBM i RDBMS (Oracle, Db2
LUW, SQL Server)
BI and Analytics ToolsPrecisely 2020: New! Real-Time Data Replication to Snowflake

Customer story
Tracking shipments in real-time

Business goals and challenges
Precisely 2020: New! Real-Time Data Replication to Snowflake
Goals
1. Connect customer and
shipment information that
resides on multiple systems of
record
2. Improve data delivery
architecture to meet real-time
demand from customers and
LOB stakeholders
Challenges
• Legacy data formats (e.g.,
mainframe and IBM i) are not
readily readable and
consumable within cloud data
warehouses
• Making data movement
between on-premises and the
cloud data warehouse was
slow and delayed
• Complex integration
architectures, made it harder to
connect to the cloud data
warehouse

Precisely 2020: New! Real-Time Data Replication to Snowflake
Results
1
Integrate and replicate
hundreds of z/OS
tables to Snowflake
2
Power customer
dashboards for “near
real-time” reporting
3
Improve productivity
with hourly
dashboard updates
for employees
4
Provide shipment
information in a
way that no other
competitor can

Precisely 2020: New! Real-Time Data Replication to Snowflake
Deliver changes
data changes to
the business in
real-time
Build analytics
and business
applications in
Snowflake,
include all
enterprise sources
Ensure your
mainframe and IBM
i data is compatible
with Snowflake
What does it mean for you?

New! Real-Time Data Replication to Snowflake

Until recently, advancements in data warehousing and analytics were largely incremental. Small innovations in database design would herald a new data warehouse every 2-3 years, which would quickly become overwhelmed with rapidly increasing data volumes. Knowledge workers struggled to access those databases with development intensive BI tools designed for reporting, rather than exploration and sharing. Both databases and BI tools were strained in locally hosted environments that were inflexible to growth or change. Snowflake and Tableau represent a fundamentally different approach. Snowflake’s multi-cluster shared data architecture was designed for the cloud and to handle logarithmically larger data volumes at blazing speed. Tableau was made to foster an interactive approach to analytics, freeing knowledge workers to use the speed of Snowflake to their greatest advantage.

Zero to Snowflake Presentation

Brett VanderPlaats

This document outlines an agenda for a 90-minute workshop on Snowflake. The agenda includes introductions, an overview of Snowflake and data warehousing, demonstrations of how users utilize Snowflake, hands-on exercises loading sample data and running queries, and discussions of Snowflake architecture and capabilities. Real-world customer examples are also presented, such as a pharmacy building new applications on Snowflake and an education company using it to unify their data sources and achieve a 16x performance improvement.

Dataiku & Snowflake Meetup Berlin 2020

Harald Erb

From the Data Work Out event: Performant and scalable Data Science with Dataiku DSS and Snowflake Managing the whole process of setting up a machine learning environment from end-to-end becomes significantly easier when using cloud-based technologies. The ability to provision infrastructure on demand (IaaS) solves the problem of manually requesting virtual machines. It also provides immediate access to compute resources whenever they are needed. But that still leaves the administrative overhead of managing the ML software and the platform to store and manage the data. A fully managed end-to-end machine learning platform like Dataiku Data Science Studio (DSS) that enables data scientists, machine learning experts, and even business users to quickly build, train and host machine learning models at scale, needs to access data from many different sources and can also access data provided by Snowflake. Storing data in Snowflake has three significant advantages: a single source of truth, shorten the data preparation cycle, scale as you go.

Actionable Insights with AI - Snowflake for Data Science

Harald Erb

Talk @ ScaleUp 360° AI Infrastructures DACH, 2021: Data scientists spend 80% and more of their time searching for and preparing data. This talk explains Snowflake’s Platform capabilities like near-unlimited data storage and instant and near-infinite compute resources and how the platform can be used to seamlessly integrate and support the machine learning libraries and tools data scientists rely on.

Does it only have to be ML + AI?

Harald Erb

The document discusses machine learning and artificial intelligence applications inside and outside of Snowflake's cloud data warehouse. It provides an overview of Snowflake and its architecture. It then discusses how machine learning can be implemented directly in the database using SQL, user-defined functions, and stored procedures. However, it notes that pure coding is not suitable for all users and that automated machine learning outside the database may be preferable to enable more business analysts and power users. It provides an example of using Amazon Forecast for time series forecasting and integrating it with Snowflake.

Snowflake essentials

qureshihamid

Snowflake is a cloud data platform company that was founded in 2012. It has over 640 employees, 1500+ customers, and has raised $923 million in funding. Snowflake provides an elastic data warehouse that allows customers to instantly scale compute and storage resources. It offers a fully managed service with no infrastructure to manage and allows customers to consolidate siloed datasets and analyze data across multiple cloud regions and accounts.

AWS Summit Singapore 2019 | Snowflake: Your Data. No Limits

AWS Summits

This document discusses Snowflake, a cloud data platform. It describes Snowflake's mission to enable organizations to be data-driven. It outlines problems with traditional data architectures like complexity, limited scalability, inability to consolidate data, and rigid costs. Snowflake's solution is a cloud-native data warehouse delivered as a service that offers instant elasticity, end-to-end security, and the ability to query structured and semi-structured data using SQL. Key benefits of Snowflake include supporting any scale of data, users and workloads; paying only for resources used; and providing simplicity, scalability, flexibility and elasticity.

Snowflake on AWS Workshop

David Teszler

Launching a Data Platform on Snowflake

KETL Limited

This document discusses launching a data platform on Snowflake and the skills and technology required. It outlines that Snowflake provides a low barrier to entry with pay-per-use pricing and the ability to scale compute resources up and down as needed. Running a data platform requires data modeling skills and being able to work in an agile environment. The company's platform is a wrapper service built on Snowflake that extracts, loads, transforms data and provides a semantic layer for business users.

Introducing Direct Database Access with Snowflake + Intrinio

Intrinio

Google App Engine

Dave Nielsen

- Google App Engine is a platform for easily developing and hosting scalable web applications, with no need for complex server management. It automatically scales the applications and handles all the operational details. - App Engine applications run on Google's infrastructure and benefit from automatic scaling across multiple servers. It also provides security isolation and quotas to prevent applications from disrupting others. - The platform uses a stateless, request-based architecture and scales applications automatically as traffic increases by distributing requests across multiple servers. It also uses quotas to ensure fairness among applications.

Melbourne: Certus Data 2.0 Vault Meetup with Snowflake - Data Vault In The Cl...

Certus Solutions

Snowflake is a cloud data warehouse that provides elasticity, scalability, and simplicity. It allows organizations to consolidate their diverse data sources in one place and instantly scale up or down their compute capacity as needed. Aptus Health, a digital marketing company, used Snowflake to break down data silos, integrate disparate data sources, enable broad data sharing, and provide a scalable and cost-effective solution to meet their analytics needs. Snowflake addressed both business needs for timely access to centralized data and IT needs for flexibility, extensibility, and reducing ETL work.

Self-serve analytics journey at Celtra: Snowflake, Spark, and Databricks

Grega Kespret

Celtra provides a platform for streamlined ad creation and campaign management used by customers including Porsche, Taco Bell, and Fox to create, track, and analyze their digital display advertising. Celtra’s platform processes billions of ad events daily to give analysts fast and easy access to reports and ad hoc analytics. Celtra’s Grega Kešpret leads a technical dive into Celtra’s data-pipeline challenges and explains how it solved them by combining Snowflake’s cloud data warehouse with Spark to get the best of both. Topics include: - Why Celtra changed its pipeline, materializing session representations to eliminate the need to rerun its pipeline - How and why it decided to use Snowflake rather than an alternative data warehouse or a home-grown custom solution - How Snowflake complemented the existing Spark environment with the ability to store and analyze deeply nested data with full consistency - How Snowflake + Spark enables production and ad hoc analytics on a single repository of data

KSnow: Getting started with Snowflake

Knoldus Inc.

Snowflake Automated Deployments / CI/CD Pipelines

Drew Hansen

This document discusses using Azure DevOps and Snowflake to enable continuous integration and continuous deployment (CI/CD) of database changes. It covers setting up source control in a repository, implementing pull requests for code reviews, building deployment artifacts in a build pipeline, and deploying artifacts to development, test, and production environments through a release pipeline. The document also highlights key Snowflake features like zero-copy cloning that enable testing deployments before production.

Altis AWS Snowflake Practice

SamanthaSwain7

Master the Multi-Clustered Data Warehouse - Snowflake

Matillion

Snowflake is one of the most powerful, efficient data warehouses on the market today—and we joined forces with the Snowflake team to show you how it works! In this webinar: - Learn how to optimize Snowflake - Hear insider tips and tricks on how to improve performance - Get expert insights from Craig Collier, Technical Architect from Snowflake, and Kalyan Arangam, Solution Architect from Matillion - Find out how leading brands like Converse, Duo Security, and Pets at Home use Snowflake and Matillion ETL to make data-driven decisions - Discover how Matillion ETL and Snowflake work together to modernize your data world - Learn how to utilize the impressive scalability of Snowflake and Matillion

Snowflake Best Practices for Elastic Data Warehousing

Amazon Web Services

Data driven organizations can be challenged to deliver new and growing business intelligence requirements from existing data warehouse platforms, constrained by lack of scalability and performance. The solution for customers is a data warehouse that scales for real-time demands and uses resources in a more optimized and cost-effective manner. Join Snowflake, AWS and Ask.com to learn how Ask.com enhanced BI service levels and decreased expenses while meeting demand to collect, store and analyze over a terabyte of data per day. Snowflake Computing delivers a fast and flexible elastic data warehouse solution that reduces complexity and overhead, built on top of the elasticity, flexibility, and resiliency of AWS. Join us to learn: • Learn how Ask.com eliminates data redundancy, and simplifies and accelerates data load, unload, and administration • Learn how to support new and fluid data consumption patterns with consistently high performance • Best practices for scaling high data volume on Amazon EC2 and Amazon S3 Who should attend: CIOs, CTOs, CDOs, Directors of IT, IT Administrators, IT Architects, Data Warehouse Developers, Database Administrators, Business Analysts and Data Architects

Delivering Data Democratization in the Cloud with Snowflake

Kent Graziano

How Workato creates robust data pipelines and automations for you?

Jeraldine Phneah

A 30 day plan to start ending your data struggle with Snowflake

Snowflake Computing

This document outlines a 30-day plan to address common data struggles around loading, integrating, analyzing, and collaborating on data using Snowflake's data platform. It describes setting up a team, defining goals and scope, loading sample data, testing and deploying business logic transformations, creating warehouses for business intelligence tools, and connecting BI tools to the data. The goal is that after 30 days, teams will be collaborating more effectively, able to easily load and combine different data sources, have accurate business logic implemented, and gain more insights from their data.

Analyzing Semi-Structured Data At Volume In The Cloud

Robert Dempsey

Presentation from Snowflake Computing at the November 2015 Data Wranglers DC meetup. The Cloud, Mobile and Web Applications are producing semi-structured data at an unprecedented rate. IT professionals continue to struggle capturing, transforming, and analyzing these complex data structures mixed with traditional relational style datasets using conventional MPP and/or Hadoop infrastructures. Public cloud infrastructures such as Amazon and Azure provide almost unlimited resources and scalability to handle both structured and semi-structured data (XML, JSON, AVRO) at Petabyte scale. These new capabilities coupled with traditional data management access methods such as SQL allow organizations and businesses new opportunities to leverage analytics at an unprecedented scale while greatly simplifying data pipeline architectures and providing an alternative to the "data lake".

Get Mainframe and IBM i Data to Snowflake

New! Real-Time Data Replication to Snowflake

Recommended

Recommended

More Related Content

What's hot

What's hot (18)

Similar to New! Real-Time Data Replication to Snowflake

Similar to New! Real-Time Data Replication to Snowflake (20)

More from Precisely

More from Precisely (20)

Recently uploaded

Recently uploaded (20)

New! Real-Time Data Replication to Snowflake

Editor's Notes