This document discusses Scala Apache Beam API, an open source Scala API for Apache Beam created by Spotify. It highlights features of Scala like functional programming, immutability, and type safety that make it a natural fit for data processing. The API provides a concise syntax inspired by Spark and Scalding and allows interactive development using a Scala REPL. It also automatically generates coders to handle serialization and supports BigQuery types. A demo is provided to run a sample pipeline on Google Cloud Dataflow.

1. Scala Apache Beam API

2. Converteo Technology Expert and independent consulting

3. Why Scala ?
- Functional Programming : Natural fit for data
- Immutability
- Pure Functions
- Type Safe
- Macros

4. API Presentation
https://spotify.github.io
- Scala API for Apache Beam
- Spotify Open source project
Apache license 2.0

5. Concise syntax
Inspired from Spark and Scalding
https://spotify.github.io/scio/examples/

6. REPL Interactive mode with scio REPL

7. Cache

8. Coders
- Specify serialisation strategy on compile time
- Automatically generate Coder for classes

9. BigQuery SafeType
Type from Table
Type from Query
Type from Schema
Class to Table

10. BigQuery SafeType

11. Demo
sbt "runMain com.converteo.pipelines.dataflow.Demo --runner=DataflowRunner --region=europe-west1 --tempLocation=gs://testhai/scio/temp
--output=neon-opus-585:devhai.demo"

12. Demo

13. We are Hiring

14. Thank YOU !