7. HISTORY
V1: OOZIE
• It works
• Code snippet
THE GOOD
• Submit through Oozie
• Shell ac:on
• Very Slow
• Batch
THE BAD
workflow.xml
snippet.py
stdout
8. HISTORY
V2: SPARK IGNITER
• It works beAer
THE GOOD
• Compiler Jar
• Batch only, no shell
• No Python, R
• Security
• Single point of failure
THE BAD Compile
Implement
Upload
json output
Batch
Scala
jar
Ooyala