An Introduction to Talend Integration Cloud
•Download as PPTX, PDF•
4 likes•4,445 views
Learn more about Talend Integration Cloud - http://www.talend.com/products/integration-cloud Talend Integration Cloud includes the powerful Talend Studio and new web-based designer tools to maximize your productivity. Speed cloud integration using robust graphical tools and wizards inside Talend Integration Cloud. More than 900 connectors and components simplify development of cloud-to-cloud and hybrid integration flows to deploy as governed integration services. Build simple or complex integration flows inside Talend Studio that connect, cleanse, and transform data. Simply push a button to publish and go live in seconds. Easily de-duplicate and standardize data to increase information accuracy and completeness.
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to An Introduction to Talend Integration Cloud
Similar to An Introduction to Talend Integration Cloud (20)
More from Talend
More from Talend (12)
Recently uploaded
Recently uploaded (20)
An Introduction to Talend Integration Cloud
- 1. 1 ©2015 Talend Inc Talend Update for BBBT
- 2. 2 2 Ready, Set, Tweet We encourage you to Tweet information from this portion of the presentation… · #BBBT · @Talend on Twitter (or @astirrup) · www.talend.com/blog
- 3. 3 Agenda • Company Update • Talend 6 • Introduction to Talend Integration Cloud • Use-cases and Demo • NDA section • Wrap-up
- 4. 4 ABOUT TALEND Key Facts • Founded in 2006 • Over 1,700 Customers • 500+ employees in 7 countries • Open Source Data Integration Leader 2007 2008 2209 2010 2011 2012 2013 2014 About Talend CLOUD INTEGRATION DATA INTEGRATION BIG DATA INTEGRATION MASTER DATA MANAGEMENT APPLICATION INTEGRATION Data Fabric DATA PREPARATION
- 5. 5 Connecting the Data-Driven Enterprise Data-Driven companies… · 23 times greater customer acquisition · 6 times greater customer retention · 19 times more profitability McKinsey’s DataMatics 2013 Survey - Using customer analytics to boost corporate performance
- 8. 8 APPLICATION INTEGRATION CLOUD INTEGRATION DATA INTEGRATION BIG DATA INTEGRATION MASTER DATA MANAGEMENT A Modern Data Platform for All Your Integration Needs INTEGRATE ANYTHING. OPERATE IN REAL-TIME. ACT WITH INSIGHT.
- 9. 9 $2B in savings in wind turbines alone Generate hundreds of millions in incremental revenue Sold 200,000 shoes online in a single day
- 10. 10 Investment Themes Big Data Hadoop becomes the dominant data processing platform Cloud Cloud overtakes on-premises investments Self-service Self-service will be a top IT priority for the next decade
- 11. 11 + DATABASE HARDWARE STORAGE COMMODITY HARDWARE WhatWeBelieve:Generational TechnologyShift
- 13. 13 5X FASTER 1/5 THE PRICE
- 14. 14 Benefits: Make decisions faster. Tremendous developer productivity. • Visually develop jobs that run 100% on Spark • 5X times faster using independent benchmarks • 10X developer productivity gained over hand- coding Spark • Over 100 new drag-n-drop Spark components • HDFS, RDBMS, NoSQL, Cloud Storage, Transformation, Messaging, In-memory analytics & machine learning recommendations, and much more • In-memory data caching & “windowed” computations • Click to enable Spark Streaming for real-time data processing Introducing Talend Real-time Big Data 1st Data Integration Platform on Spark
- 15. 15 Real-time Analytics Streaming Batch Query Transform Cleanse Govern Transform Cleanse Govern Recommendation Engine Spark Streaming/Kafka Spark NoSQL Historical ClickStream & Demographic Data Live ClickStream Live Recommendations WebUI Screnshot
- 16. 16 Benefit: Turn IoT data into real-time decisions using one product. z NoSQL Fast Messaging, High-scale Ingestion, Data Processing An End-to-End IoT Platform AMQP
- 17. 17 Easily Convert MapReduce to Spark with Talend! MapReduce Performance (runs on disk) One Click Spark Performance (runs in-memory & on disk) 5X Faster
- 18. 18 Future-Proof Too! One Click Spark Next Big Thing Next Big Thing Next Big Thing
- 19. 19 ©2015 Talend Inc Talend Integration Cloud
- 20. 20 “It takes too long to roll out new integration deployments” Talend Integration Cloud 5X reduction in costs of BI data warehousing with Talend and Amazon Go live in seconds with new data integration projects Empower the business with agile self- service integration tools
- 21. 21 How does Talend Integration Cloud work? Design on-premises, one-click-deploy to the cloud Talend Studio Web Interface DESIGN · MANAGE · MONITOR On-Premises Talend Remote Engine Talend Cloud Engine • Data Integration • Data Quality • Big Data Integration • 900+ Free Components • 100+ Free Templates
- 22. 22 Biggest problems today… I’m being asked to support an explosion in SaaS apps Every integration project takes too long to get up and running Supporting the day to day needs of the business takes way too much time Shadow IT projects are causing more problems than they are solving It takes way too long to get new leads to sales
- 23. 23 Use-cases Offload to the cloud Analytics in the cloud Redshift Self-Service Integration Connecting SaaS-SaaS, SaaS-Ground Internet of Things
- 24. 24 Integration Specialist Integration Specialist Capabilities • Productive graphical tooling • Create simple or complex flows • Enforce governance and security • Publish to the cloud Benefits • Faster time-to-market • Lower costs • Establish control
- 25. 25 Self-Service Integration – Business User Capabilities • Design anywhere • Extract, cleanse and load data • Reuse components published from Studio or Talend Exchange Benefits • Increase agility • Reduce error rates • Empower a new class of users • Ensure data governance and security Business User
- 26. 26 Leverage the power of Talend’s open source community Speed Project Delivery with Talend Exchange • Hundreds of pre-packaged integration actions • SaaS • Big data • Packaged apps • Technology connectors • Data quality • Flow templates • Easily add hundreds of additional components from Talend Studio Redshift
- 27. 27 Live in Seconds On-Premises Develop Deploy Admin Cost Support Staging Execution Load Balancing / Failover Disaster Recovery Manage (TAC) Monitor (AMC) Talend Integration Cloud Develop Cost Support Deploy Admin
- 28. 28 Integration Cloud Pricing SaaS Hybrid Elastic $1,000/month $2,000/month $4,500/month Cloud to Cloud Ground to Cloud to Ground Scale Out Big Data – – – Big Data Data Quality – Big Data Data Quality Exclusive Cloud Container Shared & Sandbox WorkspacesShared & Sandbox Workspaces
- 29. 29 ©2015 Talend Inc Talend Integration Cloud - Demo
- 30. 30 • Talend 6 Studio • Build and Deploy to the Cloud • Tour of the Talend Cloud • Build and Manage Jobs and Flows • Talend Data Warehouse • Self Service Cloud Integrations Demo
- 31. 31 How does Talend Integration Cloud work? Design on-premises, one-click-deploy to the cloud Talend Studio Web Interface DESIGN · MANAGE · MONITOR On-Premises Talend Remote Engine Talend Cloud Engine • Data Integration • Data Quality • Big Data Integration • 900+ Free Components • 100+ Free Templates
- 32. 32 Talend’s Customer Data Warehouse • Background • Lacking insight into sales and marketing programs • Goals • 360 customer view • Weekly pipeline snapshots • Full lead-to-deals win lifecycle Redshift License Manager
- 33. 33 Our Data Warehouse – By The Numbers
- 34. 34 Self-Service Integration – Business User Capabilities • Design anywhere • Extract, cleanse and load data • Reuse components published from Studio or Talend Exchange Benefits • Increase agility • Reduce error rates • Empower a new class of users • Ensure data governance and security Business User
- 35. 35 ©2015 Talend Inc Thank You Questions?
Editor's Notes
- Intro slide while registrants join webinar
- Before we get started, I wanted to encourage you to share information from my portion of today’s session. Everything I share during the session will be open and we’ll be responding and answering back during the session with the @Talend handle. Tweet questions to us, key info, or anything else you like! We will stop the presentation and make an announcement when the information is no longer public and shouldn’t be shared on social media. You can also follow my personal feed @astirrup
- Talend is the leading open source integration software provider focused on enabling organizations to become data-driven enterprises A recent report from McKinsey Global Institute highlights the impact of making decisions based on data-driven insights. In the end, companies that are data-driven, that can gather, process and analyze data as it flows through the enterprise, make better decisions This approach results in a 23 times greater likelihood of customer acquisition, a 6 times greater likelihood of customer retention and a 19 times greater likelihood of profitability. Talend 6 delivers new capabilities that make companies even more data-driven, able to turn all their data into decisions.
- Why companies want to be data-driven. Current state: Accidental Architecture with silos of data that must be harnessed and leveraged.
- Why companies want to be data-driven. Current state: Accidental Architecture with silos of data that must be harnessed and leveraged.
- And with the Talend Data Fabric, you can Integrate Anything. Operation in Real-Time, and Act with insight. --------- CIOs we tell this story to, get very excited.
- Business Benefit – Unique advantage Talend – Showing the way to be data driven It’s lot more complicated than ever before…more data, react faster, more applications Imperative for every company in the world to have a leadership in data
- The Big Data Architecture (Hadoop) What it is and why it’s great Implications Nearly unlimited scale disruptive cost – 40X cheaper In-memory now cost effective True real-time is increasingly possible
- When you look at legacy integration solutions that were built for enterprise data warehouses, you see that they sit in front of the EDW and do all the processing, data merging, transformation and cleansing before it goes into the data warehouse. And that made sense in yesterday’s world since EDW’s are so expensive. The issue however is as data volume grows, this approach does not scale – both architecturally and economically. The industry statistics are that using Hadoop vs EDW is 45X costs savings ($1,000/TB for Hadoop vs $45,000/TB for traditional EDW)
- In Today’s world you need a modern data integration platform that can take advantage of Hadoop. With Talend, we are doing all that processing and cleansing inside of Hadoop, so you are getting much more scalability at a much lower cost and taking advantage of the power, speed and elasticity of the Hadoop platform. So we can handle 10 times more data. With Talend’s approach and Spark, we are at a minimum 5X faster and sometimes 100x faster then legacy integration competitors and at 1/5 the price. So talk about a great value proposition
- So the first thing we will talk about is Talend Real-Time Big Data. This is a new offering and is the 1st data integration platform on Spark. It buiilds on Talend Big Data and MapReduce, providing native support for Spark, Spark Streaming, Talend Data Services and Enterprise Messaging. We ask each of the analysts we briefed, including Forrester, Gartner, and 451 Research if they have seen this level of support by other vendors for Spark They said no. They said Talend has a first mover advantage here as far as the depth and breadth of Spark support. Using the graphical Talend Studio you visually build integration jobs that generate native Spark code. That code can then be run inside a Hadoop platform like Cloudera, Hortonworks, MapR. It can be run standalone – in fact our new Real-Time Big Data Sandbox runs standalone. Or it can run in the Cloud, e.g. it runs in Amazon EMR. We will talk more about performance, but depending on what you are doing there is a 5 to 100 times performance gain in using Spark over MapReduce, and as a developer you are 10 times more productive using Talend model-driven tooling instead of handcoding. Talend 6 provides over 100 new drag-and-drop Spark components, so you can immediately connect to traditional data sources, Hadoop, NoSQL, Cloud storage. There are components for transformation, connecting to messaging systems like Apache Kafka and Amazone Kinesis, machine learning components and caching components as well. Another important capability that comes with Spark and Talend 6 is running processes in-memory and doing window-based computations. So for example if you are ingesting a stream of data, you can set a time period to analyze that data stream for any changes.
- And we have talked about the back-end data processing through Spark, but what about when I need to connect sensors, how does the data get captured. This is where Talend delivers an end-to-end Internet of Things Platform and Talend 6 adds support for Apache Kafka which connects right into Spark Streaming. For example, if you have hundreds of windmills with embedded sensors generating terabytes of data per hour, that data can be captured and delivered using Talend’s connectors to IoT protocols (MQTT) and high speed reliable messaing with AMQP, Kafka, Talend ESB, Apache Flume, or if in the cloud, Amazon Kinesis. This Fast data is then ingested and processed using Talend and Spark, and can then be stored in Hadoop, NoSQL or for the cloud something like Amazon RedShift. Talend provides all the connectors to these systems so you can turn IoT data into real-time decisions using one product. General Electric is a Talend customer for example, and they analyze turbine data to report daily on turbine efficiency, MTTF (Mean time to failure) averages, performance metrics etc. This data is used to capture when turbines break down or have specific parts failure. They have been able to not only reduce inventory investments (once they know which parts fail and how often can re-calibrate inventory management) they are able to be much more proactive with maintenance routines and fixing issues prior to them occurring. Improved customer satisfaction, improved productivity per turbine etc.
- SPEAKER: Thomas
- Talend Integration Cloud is a secure cloud integration platform that combines the power of Talend’s enterprise integration capabilities with the agility of the cloud. There are four key capabilities this solution provides: 1. Talend Integration Cloud makes it fast and easy to cleanse, enrich and share data from all your on-premises and cloud applications. 2. And we give you the flexibility to run those jobs anywhere, in the cloud or in your own data centers 3. And we support Cloud and on-premise big data platforms allowing customers to deliver next generation analytics at a fraction of the cost of traditional data warehouse solutions. 4. And finally, we’re enabling IT to empower business users with self-service integration tools, so they can move and access data faster than ever before.
- Lets drill down to what is Talend Integration Cloud. On the left, there are 2 ways to design jobs .. First is the powerful and productive Talend Studio and now there is a new Web Interface where you can design, manage and monitor integration flows in the cloud. Talend Integration Cloud comes with enterprise class integration capabilities, including data integration, data quality, big data and support for more than 800 Talend connectors and components. In Winter of 2015, we’ll be adding real-time capabilities and an API gateway. Finally, you can run these integration jobs in the cloud with our Cloud Engine, or in your data centers, on-premise, with our Remote Engine --------More------- First, it is a secure and hosted cloud integration platform. It is the Talend Platform running on Amazon Web Services. So it is inherently robust, scalable, and a secure architecture. All the products and features in the center can now be executed in the cloud. A complete data integration solution. You have the functionality of DI, DQ, BD, 800+ and this Winter we will be adding Real-Time Integration and an API Gateway. Finally, with a push of a button you can deploy to the cloud or on-premises. The service is managed by Talend meaning a Talend operations team manages the infrastructure for customers 24x7. Winter Release In winter 2015, Talend Integration Cloud becomes a single platform for batch and real-time integration. Connect, mediate, and orchestrate services in the cloud or on the ground to deliver data in real-time to take action immediately. An API Gateway makes it easy to create and extend policies to cloud, mobile, and partner applications, increasing productivity while enforcing data governance policies.
- Problems we heard from sales people.
- Here are five of the top use cases for Talend Integration: First, we have connecting apps whether they are in the cloud or on-premise. Next, is providing developers with the option to offload workloads to the cloud, either because they are one-time projects or because they need extra capacity to meet seasonal demands. Third, is a whole new style of integration that allows IT to partner with business users to meet integration needs. Fourth, is supporting the ingestion of data sensors. This is a real-time use case, which will be supported by the end of the year. Finally, we have Analytics in the cloud, leveraging tools like Redshift or Salesforce Wave. ----------------Additional------------------------------ Connecting cloud apps SaaS-to-SaaS, SaaS-to-Ground Make it easy to connect SaaS to SaaS without bringing data on-premises …benefit. Offload to the cloud Reducing time-to-market and setup costs. Internet of Things (IoT) Easily connect sensors in the cloud Self-service Integration .Supply Chain Inventory Marketing leads Reseller pipelines Analytics in the cloud (Cloud BI) Fast analytics requires fast access to accurate data. Talend Integration Cloud takes advantage of the massively parallel environment of Hadoop through native and optimized code generation. When integrating big data systems such as Amazon Redshift or Amazon EMR, Talend Integration Cloud enables users to run integration jobs when and where they need it for the best response time, lowest latency, and most cost-effective use of resources. There is no need to download data that is already stored in the cloud and native integration is included with cloud-based big data and analytics platforms. Talend Integration Cloud connects to all Hadoop and NoSQL sources and automatically generates native MapReduce, Spark or Storm code to run in cloud or on-premise Hadoop distributions.
- Another great thing about Talend Integration Cloud, is that you still have the full power and flexibility of Talend Studio. Now, you can build an integration flow in Talend Studio and then publish it to the cloud in seconds. This allows developers to build cloud actions with governance and security policies built in. So, anyone familiar with Talend Studio can start building integration flows for the cloud in minutes.
- Remember how I was saying that Gartner predicts that 65% of new integration flows will be developed outside of IT? Well, this is how IT can partner with the business, enable them to do more while still ensuring security and governance policies. For the first time, developers can focus on the complex parts of data integration, publish components to the cloud and empower less technical people to stich together integration flows from those components. This type of approach actually increases the productivity of IT and the business at the same time! ----More --- Give business users control to connect, enrich and share data in the cloud with self-service integration tools. Using a web-based designer and pre-built components from the Talend Exchange, anyone can quickly export, cleanse, and import data between popular applications and data sources including Salesforce, Marketo, NetSuite, Redshift, and SAP. Talend Studio for Cloud with over 800 connectors and components gives IT the power to develop cloud-based integration flows and deploy them as governed integration services to the designer. More business line autonomy means more time for IT to focus on strategic, revenue-generating projects. Talend Integration Cloud also offers capabilities for easily de-duplicating and standardizing data to increase information accuracy and completeness.
- To speed project delivery, we are also announcing today Talend Exchange, an online community with hundreds of ready-to-use packaged components where users can share cloud templates and best practices. The Exchange is prepopulated with actions (or components) that can be used by the web interface. Community members can share actions, and IT can publish their own actions from directly from Talend Studio. This is going to give your teams a real head start, allowing them to develop much faster than they otherwise could.
- One of the big benefits of integration cloud is how quickly you can go live. With a traditional Talend deployment, you’d need to install 5 or 6 servers for staging, load balancing, management and monitoring. <Click for build> With Talend Integration Cloud, all of those servers are in the cloud, dramatically reducing hardware, support and maintenance costs. ------More ------ So a quick comparison. Lets take a use case where you would integrate Salesforce, Marketo and a cloud data warehouse like Amazon Redshift. You could do this on-premise. You would need to buy the integration hardware, install and configure Talend. Then setup muliple test and deployment and management servers. Also, not shown, you would need to figure out security protocols to access these systems. In summary expensive and resource intensive. Now on the right, you can push all that deployment and administration into the cloud, all managed by Talend. Live in Seconds ..
- We’ve also made it easy to buy Talend Integration Cloud with a very simple pricing structure. If you’re just looking to connect applications in the cloud, pricing starts at $1,000 per month. If you want to add in on-premises connectivity, data quality, or collaboration features, that’s $2,000 per month and then if you need the highest levels of performance, our dedicated cloud containers for $4,500 per month.
- SPEAKER: Mark B
- New and Exciting Talend 6 DQ, Big Data, Spark Spark and Spark Streaming Build a Data Integration Job Build simple DI job – SFDC to S3 to Red Shift Switch over to real job Publish to Cloud Move to TIC Web UI (Stay in IT role) Quick Tour Come back to how that job I published is Run and Monitor Self Service – 002 - Contacts to Salesforce w/DQ
- Lets drill down to what is Talend Integration Cloud. On the left, there are 2 ways to design jobs .. First is the powerful and productive Talend Studio and now there is a new Web Interface where you can design, manage and monitor integration flows in the cloud. Talend Integration Cloud comes with enterprise class integration capabilities, including data integration, data quality, big data and support for more than 800 Talend connectors and components. In Winter of 2015, we’ll be adding real-time capabilities and an API gateway. Finally, you can run these integration jobs in the cloud with our Cloud Engine, or in your data centers, on-premise, with our Remote Engine --------More------- First, it is a secure and hosted cloud integration platform. It is the Talend Platform running on Amazon Web Services. So it is inherently robust, scalable, and a secure architecture. All the products and features in the center can now be executed in the cloud. A complete data integration solution. You have the functionality of DI, DQ, BD, 800+ and this Winter we will be adding Real-Time Integration and an API Gateway. Finally, with a push of a button you can deploy to the cloud or on-premises. The service is managed by Talend meaning a Talend operations team manages the infrastructure for customers 24x7. Winter Release In winter 2015, Talend Integration Cloud becomes a single platform for batch and real-time integration. Connect, mediate, and orchestrate services in the cloud or on the ground to deliver data in real-time to take action immediately. An API Gateway makes it easy to create and extend policies to cloud, mobile, and partner applications, increasing productivity while enforcing data governance policies.
- In this next use case, we’re going to show you how Talend lets you use Amazon Redshift and Tableau to build an enterprise class data warehouse in the cloud at a fraction of the cost of some data warehousing solutions. At Talend we use Salesforce.com for sales, Marketo for marketing and Netsuite for Finance. Using Talend, we’re able to pull all of this data together to help us run the business better and get new insights into how we can improve sales and marketing.
- Remember how I was saying that Gartner predicts that 65% of new integration flows will be developed outside of IT? Well, this is how IT can partner with the business, enable them to do more while still ensuring security and governance policies. For the first time, developers can focus on the complex parts of data integration, publish components to the cloud and empower less technical people to stich together integration flows from those components. This type of approach actually increases the productivity of IT and the business at the same time! ----More --- Give business users control to connect, enrich and share data in the cloud with self-service integration tools. Using a web-based designer and pre-built components from the Talend Exchange, anyone can quickly export, cleanse, and import data between popular applications and data sources including Salesforce, Marketo, NetSuite, Redshift, and SAP. Talend Studio for Cloud with over 800 connectors and components gives IT the power to develop cloud-based integration flows and deploy them as governed integration services to the designer. More business line autonomy means more time for IT to focus on strategic, revenue-generating projects. Talend Integration Cloud also offers capabilities for easily de-duplicating and standardizing data to increase information accuracy and completeness.
- SPEAKER: Mark B