Scratching your own itch

Kathleen Ting
Kathleen TingAuthor, Committer, Technical Account Manager at Cloudera
November 2011

Scratching your own itch
Joey Echeverria | Solutions Architect
joey@cloudera.com
@fwiffo
About Joey

    •  Solutions Architect
    •  6 months
    •  3+ years




2
                      ©2011 Cloudera, Inc. All Rights Reserved.
Why Apache Sqoop (incubating)?

    •  Data center integration
    •  Extensible
      –  Sources
      –  Destinations
    •  Company specific
    •  Open source
      –  Yay!



3
                        ©2011 Cloudera, Inc. All Rights Reserved.
Getting the code

    •  Apache SVN
      –  https://svn.apache.org/repos/asf/incubator/
         sqoop/
    •  Apache GIT
      –  http://git.apache.org/sqoop.git
    •  GitHub
      –  https://github.com/apache/sqoop.git



4
                       ©2011 Cloudera, Inc. All Rights Reserved.
Fork you




5
               ©2011 Cloudera, Inc. All Rights Reserved.
Building the code

    •  Requirements
      –  Ant 1.7.1
      –  JDK 1.6
      –  Maven
         •  SQOOP-306
    •  Targets
      –  jar
      –  test
      –  checkstyle


6
                        ©2011 Cloudera, Inc. All Rights Reserved.
Checkstyle




7
                 ©2011 Cloudera, Inc. All Rights Reserved.
IDE




8
          ©2011 Cloudera, Inc. All Rights Reserved.
Testing

    •  JUnit
    •  By hand
      –  ant package
      –  cd build/sqoop-1.5-incubating-SNAPSHOT
      –  bin/sqoop




9
                     ©2011 Cloudera, Inc. All Rights Reserved.
Contributing back: Why?

 •    Next release
 •    Lower long-term cost
 •    For the community!
 •    It’s easier than you think!




10
                      ©2011 Cloudera, Inc. All Rights Reserved.
Fears

 •  People won’t want my patch
     –  Rare
     –  Small projects
 •  Only I need this feature
     –  That’s what everyone says…
 •  Too much process!
     –  A little time now, a massive headache later



11
                         ©2011 Cloudera, Inc. All Rights Reserved.
Sqoop vs. HDFS

 •  Small project
     –  Less contentious
     –  Easier to grok the code
     –  Easy deployment
 •  Immediate feedback
 •  Great place to start




12
                      ©2011 Cloudera, Inc. All Rights Reserved.
Contributing back: How?

 •  File a JIRA
     –  https://issues.apache.org/jira/browse/SQOOP
 •  Post your patch on the issue
 •  File a review request
     –  https://reviews.apache.org/groups/Sqoop/




13
                     ©2011 Cloudera, Inc. All Rights Reserved.
Posting patches




14
              ©2011 Cloudera, Inc. All Rights Reserved.
The review process

 •    Upload your patch
 •    Describe your changes
 •    Describe your testing
 •    Wait for feedback
 •    Repeat




15
                   ©2011 Cloudera, Inc. All Rights Reserved.
What else?

 •  Subscribe to the mailing list
     –  sqoop-dev@incubator.apache.org
 •  Look for open issues
     –  https://issues.apache.org/jira/browse/SQOOP
 •  Get hacking




16
                     ©2011 Cloudera, Inc. All Rights Reserved.
Questions?




17
              ©2011 Cloudera, Inc. All Rights Reserved.
1 of 17

Recommended

Solr consistency and recovery internals by
Solr consistency and recovery internalsSolr consistency and recovery internals
Solr consistency and recovery internalsCloudera, Inc.
2.1K views15 slides
Heroku cloud platform by
Heroku cloud platformHeroku cloud platform
Heroku cloud platformHasan Khatib
470 views6 slides
Scaling Jenkins Enterprise Wide by
Scaling Jenkins Enterprise WideScaling Jenkins Enterprise Wide
Scaling Jenkins Enterprise WideUdaypal Aarkoti
150.5K views12 slides
Accelerate Your Visual Studio Software Build Environment with ElectricAcceler... by
Accelerate Your Visual Studio Software Build Environment with ElectricAcceler...Accelerate Your Visual Studio Software Build Environment with ElectricAcceler...
Accelerate Your Visual Studio Software Build Environment with ElectricAcceler...David Rosen
732 views16 slides
Automated Performance Testing for Desktop Applications by Ciprian Balea by
Automated Performance Testing for Desktop Applications by Ciprian BaleaAutomated Performance Testing for Desktop Applications by Ciprian Balea
Automated Performance Testing for Desktop Applications by Ciprian Balea3Pillar Global
1.4K views24 slides
Cloud Provisioning: The SDKs Under the Hood by
Cloud Provisioning: The SDKs Under the HoodCloud Provisioning: The SDKs Under the Hood
Cloud Provisioning: The SDKs Under the HoodEverett Toews
1.5K views21 slides

More Related Content

What's hot

AP Setup Using Oxalis by
AP Setup Using OxalisAP Setup Using Oxalis
AP Setup Using OxalisNap Ramirez
594 views26 slides
Introduction to Infrastructure as Code & Automation / Introduction to Chef by
Introduction to Infrastructure as Code & Automation / Introduction to ChefIntroduction to Infrastructure as Code & Automation / Introduction to Chef
Introduction to Infrastructure as Code & Automation / Introduction to ChefNathen Harvey
911 views193 slides
Cloud Platforms for Java by
Cloud Platforms for JavaCloud Platforms for Java
Cloud Platforms for Java3Pillar Global
2.3K views33 slides
The Evolution of Glance API: On the Way From v1 to v3 by
The Evolution of Glance API: On the Way From v1 to v3The Evolution of Glance API: On the Way From v1 to v3
The Evolution of Glance API: On the Way From v1 to v3Brian Rosmaita
530 views52 slides
DevOp with Me! by
DevOp with Me!DevOp with Me!
DevOp with Me!Nathen Harvey
715 views15 slides
Spinnaker Microsrvices by
Spinnaker MicrosrvicesSpinnaker Microsrvices
Spinnaker MicrosrvicesAmbassador Labs
1.2K views21 slides

What's hot(20)

AP Setup Using Oxalis by Nap Ramirez
AP Setup Using OxalisAP Setup Using Oxalis
AP Setup Using Oxalis
Nap Ramirez594 views
Introduction to Infrastructure as Code & Automation / Introduction to Chef by Nathen Harvey
Introduction to Infrastructure as Code & Automation / Introduction to ChefIntroduction to Infrastructure as Code & Automation / Introduction to Chef
Introduction to Infrastructure as Code & Automation / Introduction to Chef
Nathen Harvey911 views
The Evolution of Glance API: On the Way From v1 to v3 by Brian Rosmaita
The Evolution of Glance API: On the Way From v1 to v3The Evolution of Glance API: On the Way From v1 to v3
The Evolution of Glance API: On the Way From v1 to v3
Brian Rosmaita530 views
Puppet Camp Melbourne Nov 2014 - A Build Engineering Team’s Journey of Infras... by Peter Leschev
Puppet Camp Melbourne Nov 2014 - A Build Engineering Team’s Journey of Infras...Puppet Camp Melbourne Nov 2014 - A Build Engineering Team’s Journey of Infras...
Puppet Camp Melbourne Nov 2014 - A Build Engineering Team’s Journey of Infras...
Peter Leschev12.8K views
Support Automation Central Build by Eoghan Shields
Support Automation Central BuildSupport Automation Central Build
Support Automation Central Build
Eoghan Shields421 views
Best practices deploying Sitecore to Microsoft Azure by Thom Puiman
Best practices deploying Sitecore to Microsoft AzureBest practices deploying Sitecore to Microsoft Azure
Best practices deploying Sitecore to Microsoft Azure
Thom Puiman1.5K views
OSGi Community Event 2010 - Eclipse Virgo Update by mfrancis
OSGi Community Event 2010 - Eclipse Virgo UpdateOSGi Community Event 2010 - Eclipse Virgo Update
OSGi Community Event 2010 - Eclipse Virgo Update
mfrancis642 views
Avoiding integration hell by aaronbassett
Avoiding integration hellAvoiding integration hell
Avoiding integration hell
aaronbassett1.2K views
Integrating Security into DevOps by CloudPassage
Integrating Security into DevOpsIntegrating Security into DevOps
Integrating Security into DevOps
CloudPassage2.6K views
Puppet Camp Charlotte 2015: Managing middleware with Puppet by Puppet
Puppet Camp Charlotte 2015: Managing middleware with PuppetPuppet Camp Charlotte 2015: Managing middleware with Puppet
Puppet Camp Charlotte 2015: Managing middleware with Puppet
Puppet912 views
Security as Code: DOES15 by Ed Bellis
Security as Code: DOES15Security as Code: DOES15
Security as Code: DOES15
Ed Bellis2.6K views
Webinar: OpenStack Best Practices for Production by Platform9
Webinar: OpenStack Best Practices for ProductionWebinar: OpenStack Best Practices for Production
Webinar: OpenStack Best Practices for Production
Platform9600 views
A Day in the Life of a Cross-platform, DevOps-enabled Team by Deborah Schalm
A Day in the Life of a Cross-platform, DevOps-enabled TeamA Day in the Life of a Cross-platform, DevOps-enabled Team
A Day in the Life of a Cross-platform, DevOps-enabled Team
Deborah Schalm513 views
Deliver on DevOps with Puppet Application Orchestration Webinar 11/19/15 by Puppet
Deliver on DevOps with Puppet Application Orchestration Webinar 11/19/15Deliver on DevOps with Puppet Application Orchestration Webinar 11/19/15
Deliver on DevOps with Puppet Application Orchestration Webinar 11/19/15
Puppet3.5K views

Viewers also liked

UnicastWS vol.1 by
UnicastWS vol.1UnicastWS vol.1
UnicastWS vol.1Unicast Inc.
711 views57 slides
рынок WP август 2012 by
рынок WP август 2012рынок WP август 2012
рынок WP август 2012SlyLamb
408 views11 slides
プレゼンテーション02(5分バージョン) by
プレゼンテーション02(5分バージョン)プレゼンテーション02(5分バージョン)
プレゼンテーション02(5分バージョン)Yuichi Masano
1.8K views17 slides
Sistema Operativo Slax Pendrive by
Sistema Operativo Slax PendriveSistema Operativo Slax Pendrive
Sistema Operativo Slax PendriveJFSG
775 views9 slides
Nagoya by
NagoyaNagoya
Nagoyac-mitsuba
562 views33 slides
SteamVRさわってみた by
SteamVRさわってみたSteamVRさわってみた
SteamVRさわってみたc-mitsuba
1.7K views28 slides

Viewers also liked(7)

рынок WP август 2012 by SlyLamb
рынок WP август 2012рынок WP август 2012
рынок WP август 2012
SlyLamb408 views
プレゼンテーション02(5分バージョン) by Yuichi Masano
プレゼンテーション02(5分バージョン)プレゼンテーション02(5分バージョン)
プレゼンテーション02(5分バージョン)
Yuichi Masano1.8K views
Sistema Operativo Slax Pendrive by JFSG
Sistema Operativo Slax PendriveSistema Operativo Slax Pendrive
Sistema Operativo Slax Pendrive
JFSG775 views
SteamVRさわってみた by c-mitsuba
SteamVRさわってみたSteamVRさわってみた
SteamVRさわってみた
c-mitsuba1.7K views
応用情報技術者第一回ゼミ by Yutaro Ikeda
応用情報技術者第一回ゼミ応用情報技術者第一回ゼミ
応用情報技術者第一回ゼミ
Yutaro Ikeda1.6K views

Similar to Scratching your own itch

Java / Opening Open Source the Jenkins Way - Nicolas de Loof, CloudBees by
Java / Opening Open Source the Jenkins Way - Nicolas de Loof, CloudBeesJava / Opening Open Source the Jenkins Way - Nicolas de Loof, CloudBees
Java / Opening Open Source the Jenkins Way - Nicolas de Loof, CloudBeesParis Open Source Summit
2.4K views59 slides
Continuous Integration Fundamentals: Build Automation - OFM Canberra October ... by
Continuous Integration Fundamentals: Build Automation - OFM Canberra October ...Continuous Integration Fundamentals: Build Automation - OFM Canberra October ...
Continuous Integration Fundamentals: Build Automation - OFM Canberra October ...Joelith
634 views13 slides
OpenStack Enabling DevOps by
OpenStack Enabling DevOpsOpenStack Enabling DevOps
OpenStack Enabling DevOpsCisco DevNet
595 views21 slides
Journée DevOps : De l'intégration continue au déploiement continu avec Jenkins by
Journée DevOps : De l'intégration continue au déploiement continu avec JenkinsJournée DevOps : De l'intégration continue au déploiement continu avec Jenkins
Journée DevOps : De l'intégration continue au déploiement continu avec JenkinsPublicis Sapient Engineering
2.6K views39 slides
Webinar: OpenStack Accelerates Software Development by
Webinar: OpenStack Accelerates Software DevelopmentWebinar: OpenStack Accelerates Software Development
Webinar: OpenStack Accelerates Software DevelopmentPlatform9
518 views18 slides
Java Community and Overview Track - March 2016 by
Java Community and Overview Track - March 2016Java Community and Overview Track - March 2016
Java Community and Overview Track - March 2016Yolande Poirier
119 views25 slides

Similar to Scratching your own itch(20)

Java / Opening Open Source the Jenkins Way - Nicolas de Loof, CloudBees by Paris Open Source Summit
Java / Opening Open Source the Jenkins Way - Nicolas de Loof, CloudBeesJava / Opening Open Source the Jenkins Way - Nicolas de Loof, CloudBees
Java / Opening Open Source the Jenkins Way - Nicolas de Loof, CloudBees
Continuous Integration Fundamentals: Build Automation - OFM Canberra October ... by Joelith
Continuous Integration Fundamentals: Build Automation - OFM Canberra October ...Continuous Integration Fundamentals: Build Automation - OFM Canberra October ...
Continuous Integration Fundamentals: Build Automation - OFM Canberra October ...
Joelith634 views
OpenStack Enabling DevOps by Cisco DevNet
OpenStack Enabling DevOpsOpenStack Enabling DevOps
OpenStack Enabling DevOps
Cisco DevNet595 views
Journée DevOps : De l'intégration continue au déploiement continu avec Jenkins by Publicis Sapient Engineering
Journée DevOps : De l'intégration continue au déploiement continu avec JenkinsJournée DevOps : De l'intégration continue au déploiement continu avec Jenkins
Journée DevOps : De l'intégration continue au déploiement continu avec Jenkins
Webinar: OpenStack Accelerates Software Development by Platform9
Webinar: OpenStack Accelerates Software DevelopmentWebinar: OpenStack Accelerates Software Development
Webinar: OpenStack Accelerates Software Development
Platform9518 views
Java Community and Overview Track - March 2016 by Yolande Poirier
Java Community and Overview Track - March 2016Java Community and Overview Track - March 2016
Java Community and Overview Track - March 2016
Yolande Poirier119 views
Java Community News - September 2015 by Yolande Poirier
Java Community News - September 2015Java Community News - September 2015
Java Community News - September 2015
Yolande Poirier107 views
Skipping OpenStack Releases: (You Don't) Gotta Catch 'Em All by Mark Voelker
Skipping OpenStack Releases: (You Don't) Gotta Catch 'Em AllSkipping OpenStack Releases: (You Don't) Gotta Catch 'Em All
Skipping OpenStack Releases: (You Don't) Gotta Catch 'Em All
Mark Voelker380 views
Mastering DevOps With Oracle by Kelly Goetsch
Mastering DevOps With OracleMastering DevOps With Oracle
Mastering DevOps With Oracle
Kelly Goetsch35K views
Bdd with Visual Studio 2010, Spec Flow and WatiN by Charles Nurse
Bdd with Visual Studio 2010, Spec Flow and WatiNBdd with Visual Studio 2010, Spec Flow and WatiN
Bdd with Visual Studio 2010, Spec Flow and WatiN
Charles Nurse1.6K views
Change Management for Oracle Database with SQLcl by Jeff Smith
Change Management for Oracle Database with SQLcl Change Management for Oracle Database with SQLcl
Change Management for Oracle Database with SQLcl
Jeff Smith5.1K views
August Webinar - Water Cooler Talks: A Look into a Developer's Workbench by Howard Greenberg
August Webinar - Water Cooler Talks: A Look into a Developer's WorkbenchAugust Webinar - Water Cooler Talks: A Look into a Developer's Workbench
August Webinar - Water Cooler Talks: A Look into a Developer's Workbench
Howard Greenberg220 views
Opening opensource : The Jenkins Way by Nicolas De Loof
Opening opensource : The Jenkins WayOpening opensource : The Jenkins Way
Opening opensource : The Jenkins Way
Nicolas De Loof3.3K views
Melhore o Desenvolvimento do Time com DevOps na Nuvem by Bruno Borges
Melhore o Desenvolvimento do Time com DevOps na NuvemMelhore o Desenvolvimento do Time com DevOps na Nuvem
Melhore o Desenvolvimento do Time com DevOps na Nuvem
Bruno Borges3.9K views
Mastering DevOps with Oracle by jeckels
Mastering DevOps with Oracle Mastering DevOps with Oracle
Mastering DevOps with Oracle
jeckels17.7K views

Recently uploaded

DRaaS using Snapshot copy and destination selection (DRaaS) - Alexandre Matti... by
DRaaS using Snapshot copy and destination selection (DRaaS) - Alexandre Matti...DRaaS using Snapshot copy and destination selection (DRaaS) - Alexandre Matti...
DRaaS using Snapshot copy and destination selection (DRaaS) - Alexandre Matti...ShapeBlue
139 views29 slides
"Surviving highload with Node.js", Andrii Shumada by
"Surviving highload with Node.js", Andrii Shumada "Surviving highload with Node.js", Andrii Shumada
"Surviving highload with Node.js", Andrii Shumada Fwdays
56 views29 slides
Digital Personal Data Protection (DPDP) Practical Approach For CISOs by
Digital Personal Data Protection (DPDP) Practical Approach For CISOsDigital Personal Data Protection (DPDP) Practical Approach For CISOs
Digital Personal Data Protection (DPDP) Practical Approach For CISOsPriyanka Aash
158 views59 slides
Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ... by
Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ...Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ...
Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ...ShapeBlue
186 views15 slides
State of the Union - Rohit Yadav - Apache CloudStack by
State of the Union - Rohit Yadav - Apache CloudStackState of the Union - Rohit Yadav - Apache CloudStack
State of the Union - Rohit Yadav - Apache CloudStackShapeBlue
297 views53 slides
Import Export Virtual Machine for KVM Hypervisor - Ayush Pandey - University ... by
Import Export Virtual Machine for KVM Hypervisor - Ayush Pandey - University ...Import Export Virtual Machine for KVM Hypervisor - Ayush Pandey - University ...
Import Export Virtual Machine for KVM Hypervisor - Ayush Pandey - University ...ShapeBlue
119 views17 slides

Recently uploaded(20)

DRaaS using Snapshot copy and destination selection (DRaaS) - Alexandre Matti... by ShapeBlue
DRaaS using Snapshot copy and destination selection (DRaaS) - Alexandre Matti...DRaaS using Snapshot copy and destination selection (DRaaS) - Alexandre Matti...
DRaaS using Snapshot copy and destination selection (DRaaS) - Alexandre Matti...
ShapeBlue139 views
"Surviving highload with Node.js", Andrii Shumada by Fwdays
"Surviving highload with Node.js", Andrii Shumada "Surviving highload with Node.js", Andrii Shumada
"Surviving highload with Node.js", Andrii Shumada
Fwdays56 views
Digital Personal Data Protection (DPDP) Practical Approach For CISOs by Priyanka Aash
Digital Personal Data Protection (DPDP) Practical Approach For CISOsDigital Personal Data Protection (DPDP) Practical Approach For CISOs
Digital Personal Data Protection (DPDP) Practical Approach For CISOs
Priyanka Aash158 views
Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ... by ShapeBlue
Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ...Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ...
Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ...
ShapeBlue186 views
State of the Union - Rohit Yadav - Apache CloudStack by ShapeBlue
State of the Union - Rohit Yadav - Apache CloudStackState of the Union - Rohit Yadav - Apache CloudStack
State of the Union - Rohit Yadav - Apache CloudStack
ShapeBlue297 views
Import Export Virtual Machine for KVM Hypervisor - Ayush Pandey - University ... by ShapeBlue
Import Export Virtual Machine for KVM Hypervisor - Ayush Pandey - University ...Import Export Virtual Machine for KVM Hypervisor - Ayush Pandey - University ...
Import Export Virtual Machine for KVM Hypervisor - Ayush Pandey - University ...
ShapeBlue119 views
Business Analyst Series 2023 - Week 4 Session 8 by DianaGray10
Business Analyst Series 2023 -  Week 4 Session 8Business Analyst Series 2023 -  Week 4 Session 8
Business Analyst Series 2023 - Week 4 Session 8
DianaGray10123 views
Centralized Logging Feature in CloudStack using ELK and Grafana - Kiran Chava... by ShapeBlue
Centralized Logging Feature in CloudStack using ELK and Grafana - Kiran Chava...Centralized Logging Feature in CloudStack using ELK and Grafana - Kiran Chava...
Centralized Logging Feature in CloudStack using ELK and Grafana - Kiran Chava...
ShapeBlue145 views
Confidence in CloudStack - Aron Wagner, Nathan Gleason - Americ by ShapeBlue
Confidence in CloudStack - Aron Wagner, Nathan Gleason - AmericConfidence in CloudStack - Aron Wagner, Nathan Gleason - Americ
Confidence in CloudStack - Aron Wagner, Nathan Gleason - Americ
ShapeBlue130 views
Future of AR - Facebook Presentation by Rob McCarty
Future of AR - Facebook PresentationFuture of AR - Facebook Presentation
Future of AR - Facebook Presentation
Rob McCarty64 views
Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda... by ShapeBlue
Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda...Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda...
Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda...
ShapeBlue161 views
CloudStack Object Storage - An Introduction - Vladimir Petrov - ShapeBlue by ShapeBlue
CloudStack Object Storage - An Introduction - Vladimir Petrov - ShapeBlueCloudStack Object Storage - An Introduction - Vladimir Petrov - ShapeBlue
CloudStack Object Storage - An Introduction - Vladimir Petrov - ShapeBlue
ShapeBlue138 views
Developments to CloudStack’s SDN ecosystem: Integration with VMWare NSX 4 - P... by ShapeBlue
Developments to CloudStack’s SDN ecosystem: Integration with VMWare NSX 4 - P...Developments to CloudStack’s SDN ecosystem: Integration with VMWare NSX 4 - P...
Developments to CloudStack’s SDN ecosystem: Integration with VMWare NSX 4 - P...
ShapeBlue194 views
Migrating VMware Infra to KVM Using CloudStack - Nicolas Vazquez - ShapeBlue by ShapeBlue
Migrating VMware Infra to KVM Using CloudStack - Nicolas Vazquez - ShapeBlueMigrating VMware Infra to KVM Using CloudStack - Nicolas Vazquez - ShapeBlue
Migrating VMware Infra to KVM Using CloudStack - Nicolas Vazquez - ShapeBlue
ShapeBlue218 views
Zero to Cloud Hero: Crafting a Private Cloud from Scratch with XCP-ng, Xen Or... by ShapeBlue
Zero to Cloud Hero: Crafting a Private Cloud from Scratch with XCP-ng, Xen Or...Zero to Cloud Hero: Crafting a Private Cloud from Scratch with XCP-ng, Xen Or...
Zero to Cloud Hero: Crafting a Private Cloud from Scratch with XCP-ng, Xen Or...
ShapeBlue198 views
CloudStack and GitOps at Enterprise Scale - Alex Dometrius, Rene Glover - AT&T by ShapeBlue
CloudStack and GitOps at Enterprise Scale - Alex Dometrius, Rene Glover - AT&TCloudStack and GitOps at Enterprise Scale - Alex Dometrius, Rene Glover - AT&T
CloudStack and GitOps at Enterprise Scale - Alex Dometrius, Rene Glover - AT&T
ShapeBlue152 views
2FA and OAuth2 in CloudStack - Andrija Panić - ShapeBlue by ShapeBlue
2FA and OAuth2 in CloudStack - Andrija Panić - ShapeBlue2FA and OAuth2 in CloudStack - Andrija Panić - ShapeBlue
2FA and OAuth2 in CloudStack - Andrija Panić - ShapeBlue
ShapeBlue147 views
Live Demo Showcase: Unveiling Dell PowerFlex’s IaaS Capabilities with Apache ... by ShapeBlue
Live Demo Showcase: Unveiling Dell PowerFlex’s IaaS Capabilities with Apache ...Live Demo Showcase: Unveiling Dell PowerFlex’s IaaS Capabilities with Apache ...
Live Demo Showcase: Unveiling Dell PowerFlex’s IaaS Capabilities with Apache ...
ShapeBlue126 views

Scratching your own itch

  • 1. November 2011 Scratching your own itch Joey Echeverria | Solutions Architect joey@cloudera.com @fwiffo
  • 2. About Joey •  Solutions Architect •  6 months •  3+ years 2 ©2011 Cloudera, Inc. All Rights Reserved.
  • 3. Why Apache Sqoop (incubating)? •  Data center integration •  Extensible –  Sources –  Destinations •  Company specific •  Open source –  Yay! 3 ©2011 Cloudera, Inc. All Rights Reserved.
  • 4. Getting the code •  Apache SVN –  https://svn.apache.org/repos/asf/incubator/ sqoop/ •  Apache GIT –  http://git.apache.org/sqoop.git •  GitHub –  https://github.com/apache/sqoop.git 4 ©2011 Cloudera, Inc. All Rights Reserved.
  • 5. Fork you 5 ©2011 Cloudera, Inc. All Rights Reserved.
  • 6. Building the code •  Requirements –  Ant 1.7.1 –  JDK 1.6 –  Maven •  SQOOP-306 •  Targets –  jar –  test –  checkstyle 6 ©2011 Cloudera, Inc. All Rights Reserved.
  • 7. Checkstyle 7 ©2011 Cloudera, Inc. All Rights Reserved.
  • 8. IDE 8 ©2011 Cloudera, Inc. All Rights Reserved.
  • 9. Testing •  JUnit •  By hand –  ant package –  cd build/sqoop-1.5-incubating-SNAPSHOT –  bin/sqoop 9 ©2011 Cloudera, Inc. All Rights Reserved.
  • 10. Contributing back: Why? •  Next release •  Lower long-term cost •  For the community! •  It’s easier than you think! 10 ©2011 Cloudera, Inc. All Rights Reserved.
  • 11. Fears •  People won’t want my patch –  Rare –  Small projects •  Only I need this feature –  That’s what everyone says… •  Too much process! –  A little time now, a massive headache later 11 ©2011 Cloudera, Inc. All Rights Reserved.
  • 12. Sqoop vs. HDFS •  Small project –  Less contentious –  Easier to grok the code –  Easy deployment •  Immediate feedback •  Great place to start 12 ©2011 Cloudera, Inc. All Rights Reserved.
  • 13. Contributing back: How? •  File a JIRA –  https://issues.apache.org/jira/browse/SQOOP •  Post your patch on the issue •  File a review request –  https://reviews.apache.org/groups/Sqoop/ 13 ©2011 Cloudera, Inc. All Rights Reserved.
  • 14. Posting patches 14 ©2011 Cloudera, Inc. All Rights Reserved.
  • 15. The review process •  Upload your patch •  Describe your changes •  Describe your testing •  Wait for feedback •  Repeat 15 ©2011 Cloudera, Inc. All Rights Reserved.
  • 16. What else? •  Subscribe to the mailing list –  sqoop-dev@incubator.apache.org •  Look for open issues –  https://issues.apache.org/jira/browse/SQOOP •  Get hacking 16 ©2011 Cloudera, Inc. All Rights Reserved.
  • 17. Questions? 17 ©2011 Cloudera, Inc. All Rights Reserved.