Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Data Pipelines with Apache Airflow

301 views

Published on

A successful pipeline moves data efficiently, minimizing pauses and blockages between tasks, keeping every process along the way operational. Apache Airflow provides a single customizable environment for building and managing data pipelines, eliminating the need for a hodge-podge collection of tools, snowflake code, and homegrown processes. Using real-world scenarios and examples, Data Pipelines with Apache Airflow teaches you how to simplify and automate data pipelines, reduce operational overhead, and smoothly integrate all the technologies in your stack.

Check out the contents on our browser-based liveBook reader here: https://livebook.manning.com/book/data-pipelines-with-apache-airflow/

Published in: Software
  • Be the first to comment

  • Be the first to like this

Data Pipelines with Apache Airflow

  1. 1. Better Data Pipeline Management With Data Pipelines with Apache Airflow. Take 42% off the book by entering slharenslak into the discount code box at manning.com.
  2. 2. A successful pipeline moves data efficiently, minimizing pauses and blockages between tasks, keeping every process along the way operational. Apache Airflow provides a single customizable environment for building and managing data pipelines, eliminating the need for a hodge-podge collection of tools, snowflake code, and homegrown processes.
  3. 3. Using real-world scenarios and examples, Data Pipelines with Apache Airflow teaches you how to simplify and automate data pipelines, reduce operational overhead, and smoothly integrate all the technologies in your stack. Airflow lets you schedule, restart, and backfill pipelines, and its easy- to-use UI and workflows with Python scripting has users praising its incredible flexibility
  4. 4. Data Pipelines with Apache Airflow is your essential guide to working with the powerful Apache Airflow pipeline manager. In it, you’ll learn how to automate moving and transforming data, managing pipelines by backfilling historical tasks, developing custom components for your specific systems, and setting up Airflow in production environments.
  5. 5. What people are saying about the book: A great intro to what a DAG is and the basics behind its architecture. -Vlad Navitski A great introduction to Apache Airflow. It's well-written and well thought out. -Kent Spillner Easy to read and provides a range of tips to be productive with Airflow. -Eric Platon
  6. 6. About the authors: Bas Harenslak and Julian de Ruiter are data engineers with extensive experience using Airflow to develop pipelines for major companies including Heineken, Unilever, and Booking.com. Bas is a committer, and both Bas and Julian are active contributors to Apache Airflow.
  7. 7. With Data Pipelines with Apache Airflow. Take 42% off the book by entering slharenslak into the discount code box at manning.com. If you want to learn more about the book, you can check it out on our browser- based liveBook reader here.

×