The document introduces the challenges of data access in Python due to diverse data formats and storage systems, and presents Apache Arrow as a solution with features like cache-efficient columnar memory and zero-copy messaging. It highlights Dremio, a self-service data platform built on Arrow, which allows for interactive data queries and data curation without data duplication. The document also invites the community to engage via various platforms including GitHub and Twitter.

1. Sudheesh Katkam
Simplifying Data Access for Python

2. Introduction
• Data comes in all shapes, sizes and formats
• Data captured in multiple storage systems
• Data takes a complex path to (Python) applications
• How do we simplify access to data?

3. Demo

4. Traditional
Memory Buffer
Memory Layout
Table

5. Traditional
Memory Buffer
Arrow
Memory Buffer
Memory Layout
Table

6. Apache Arrow Goals
• Cache-efficient columnar memory
• Zero-copy messaging / IPC
• Language-agnostic metadata
• Complex/ nested schema support
• Main implementations in C++ and Java, with bindings for C, Python,
Ruby, JavaScript

7. Apache Arrow

8. Apache Arrow Adoption

9. About Dremio
• Launched in July 2017
• Self-Service Data Platform
• Apache License
• Built entirely on Apache Arrow, Calcite, Parquet
• Narwhal’s name is Gnarly (see me for stickers!)

10. SQL
Data Virtualization
RDBMS, MongoDB, Elasticsearch, Hadoop, S3,
NAS, Excel, JSON
Data Acceleration
OLAP and ad hoc queries at interactive speed,
without cubes or BI extracts
Data Curation
Wrangle, prepare, enrich any source without
making copies of your data
Data Catalog
Interactive Data Discovery, Enterprise and
Personal Data Assets
New Tier in Analytics: Self-Service Data

11. Demo

12. Join the Community!
• GitHub:
github.com/dremio/dremio-oss
github.com/apache/arrow
• Dremio Community: community.dremio.com
• Arrow Slack:apachearrowslackin.herokuapp.com
• Twitter: @ApacheArrow, @DremioHQ