Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

PyCon Korea 2018 - Luigi로 Data Pipeline System 구현하기

212 views

Published on

https://youtu.be/UOunv9V14cA

공매도 플랫폼 서비스인 trueshort.com 의 data pipeline 시스템을 luigi 기반으로 구현하면서 얻음 경험을 바탕으로 data pipeline 혹은 ETL 시스템 구현시 best practices 와 tip 공유

Published in: Software
  • Be the first to comment

PyCon Korea 2018 - Luigi로 Data Pipeline System 구현하기

  1. 1. 

  2. 2. 
 
 
 
 
 
 
 
 
 
 
 
 
 

  3. 3.
  4. 4. 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

  5. 5. 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

  6. 6. 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

  7. 7. ] ]
  8. 8.
  9. 9. 
 
 
 
 

  10. 10. 
 
 
 
 
 
 
 
 
 
 
 
 

  11. 11. 
 
 
 
 
 
 
 
 
 
 
 
 

  12. 12. 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

  13. 13. 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

  14. 14. 
 
 
 
 
 
 

  15. 15. 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

  16. 16. 
 
 
 
 
 
 
 
 

  17. 17. 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

  18. 18. 
 
 
 
 
 
 
 
 
 


×