01
DataScientists
M
L Engineers
City
Operations
Software
Engineers
Business
Intelligence
Apache Kafka
Schemaless
SOA
BI Apps NotebooksExperimentation ML Dashboards
Raw
Data
Raw
Tables
Hadoop
Apache
Hive
Presto
Apache
Spark
Modeled
Tables
Vertica
Vertica
Warehouse
AthenaX
Apollo
Streaming
Real-time
Metadata/Workflow Management
02
Cron
The Apache Ooozie and Apache Airflow logos are either a registered trademark or trademark of the Apache Software Foundation in the United States and/or other countries.
No endorsement by The Apache Software Foundation is implied by the use of these logos. The Jenkins logo is released under the Creative Commons Attribution-ShareAlike
3.0 unported license and is available at: https://jenkins.io/. The Clojure logo is in the public domain and was designed by Tom Hickey.
●
●
●
●
●
04
05
●
●
●
●
●
06
07
Pawan Dixit Alex Kira Ankit Mody Atasi Panda
Prakhar
Garg
Patrick
Cullen
Anthony Asta
Proprietary and confidential © 2019 Uber Technologies, Inc. All rights reserved. No part of this document may be reproduced or utilized
in any form or by any means, electronic or mechanical, including photocopying, recording, or by any information storage or retrieval
systems, without permission in writing from Uber. This document is intended only for the use of the individual or entity to whom it is
addressed and contains information that is privileged, confidential or otherwise exempt from disclosure under applicable law. All
recipients of this document are notified that the information contained herein includes proprietary and confidential information of Uber,
and recipient may not make use of, disseminate, or in any way disclose this document or any of the enclosed information to any person
other than employees of addressee to the extent necessary for consultations with authorized personnel of Uber.

SF Big Analytics 2019-06-12: Managing uber's data workflows at scale

  • 8.
  • 14.
  • 16.
    Apache Kafka Schemaless SOA BI AppsNotebooksExperimentation ML Dashboards Raw Data Raw Tables Hadoop Apache Hive Presto Apache Spark Modeled Tables Vertica Vertica Warehouse AthenaX Apollo Streaming Real-time Metadata/Workflow Management
  • 19.
  • 20.
    Cron The Apache Ooozieand Apache Airflow logos are either a registered trademark or trademark of the Apache Software Foundation in the United States and/or other countries. No endorsement by The Apache Software Foundation is implied by the use of these logos. The Jenkins logo is released under the Creative Commons Attribution-ShareAlike 3.0 unported license and is available at: https://jenkins.io/. The Clojure logo is in the public domain and was designed by Tom Hickey.
  • 40.
  • 44.
  • 52.
  • 54.
  • 63.
  • 82.
  • 87.
    Pawan Dixit AlexKira Ankit Mody Atasi Panda Prakhar Garg Patrick Cullen Anthony Asta
  • 89.
    Proprietary and confidential© 2019 Uber Technologies, Inc. All rights reserved. No part of this document may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying, recording, or by any information storage or retrieval systems, without permission in writing from Uber. This document is intended only for the use of the individual or entity to whom it is addressed and contains information that is privileged, confidential or otherwise exempt from disclosure under applicable law. All recipients of this document are notified that the information contained herein includes proprietary and confidential information of Uber, and recipient may not make use of, disseminate, or in any way disclose this document or any of the enclosed information to any person other than employees of addressee to the extent necessary for consultations with authorized personnel of Uber.