Scratching your own itch

1,559 views

Published on

Sqoop Meetup in NYC 11/7/11 - process from finding a Sqoop bug, filing a
jira, coding a patch, submitting it for review, revising accordingly,
and finally to ship it '+1' approval

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Scratching your own itch

  1. 1. November 2011Scratching your own itchJoey Echeverria | Solutions Architectjoey@cloudera.com@fwiffo
  2. 2. About Joey •  Solutions Architect •  6 months •  3+ years2 ©2011 Cloudera, Inc. All Rights Reserved.
  3. 3. Why Apache Sqoop (incubating)? •  Data center integration •  Extensible –  Sources –  Destinations •  Company specific •  Open source –  Yay!3 ©2011 Cloudera, Inc. All Rights Reserved.
  4. 4. Getting the code •  Apache SVN –  https://svn.apache.org/repos/asf/incubator/ sqoop/ •  Apache GIT –  http://git.apache.org/sqoop.git •  GitHub –  https://github.com/apache/sqoop.git4 ©2011 Cloudera, Inc. All Rights Reserved.
  5. 5. Fork you5 ©2011 Cloudera, Inc. All Rights Reserved.
  6. 6. Building the code •  Requirements –  Ant 1.7.1 –  JDK 1.6 –  Maven •  SQOOP-306 •  Targets –  jar –  test –  checkstyle6 ©2011 Cloudera, Inc. All Rights Reserved.
  7. 7. Checkstyle7 ©2011 Cloudera, Inc. All Rights Reserved.
  8. 8. IDE8 ©2011 Cloudera, Inc. All Rights Reserved.
  9. 9. Testing •  JUnit •  By hand –  ant package –  cd build/sqoop-1.5-incubating-SNAPSHOT –  bin/sqoop9 ©2011 Cloudera, Inc. All Rights Reserved.
  10. 10. Contributing back: Why? •  Next release •  Lower long-term cost •  For the community! •  It’s easier than you think!10 ©2011 Cloudera, Inc. All Rights Reserved.
  11. 11. Fears •  People won’t want my patch –  Rare –  Small projects •  Only I need this feature –  That’s what everyone says… •  Too much process! –  A little time now, a massive headache later11 ©2011 Cloudera, Inc. All Rights Reserved.
  12. 12. Sqoop vs. HDFS •  Small project –  Less contentious –  Easier to grok the code –  Easy deployment •  Immediate feedback •  Great place to start12 ©2011 Cloudera, Inc. All Rights Reserved.
  13. 13. Contributing back: How? •  File a JIRA –  https://issues.apache.org/jira/browse/SQOOP •  Post your patch on the issue •  File a review request –  https://reviews.apache.org/groups/Sqoop/13 ©2011 Cloudera, Inc. All Rights Reserved.
  14. 14. Posting patches14 ©2011 Cloudera, Inc. All Rights Reserved.
  15. 15. The review process •  Upload your patch •  Describe your changes •  Describe your testing •  Wait for feedback •  Repeat15 ©2011 Cloudera, Inc. All Rights Reserved.
  16. 16. What else? •  Subscribe to the mailing list –  sqoop-dev@incubator.apache.org •  Look for open issues –  https://issues.apache.org/jira/browse/SQOOP •  Get hacking16 ©2011 Cloudera, Inc. All Rights Reserved.
  17. 17. Questions?17 ©2011 Cloudera, Inc. All Rights Reserved.

×