Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Data management, Analysis, and Sharing

647 views

Published on

Data management, Analysis, and Sharing

Published in: Environment
  • Be the first to comment

  • Be the first to like this

Data management, Analysis, and Sharing

  1. 1. Abhishek Rathore Senior Scientist (Biometrics) Email: a.rathore@cgiar.org Data Management, Analysis & Sharing (ICRISAT) CGIAR Research Program on DrylandSystems 29thSeptember, 2014, Dubai, UAE
  2. 2. DATA Experiments/ Research Station/ FPVS / FLD / LAB / Baseline Survey /Adoption Surveys and etc… AND Kept in IBP/FieldBooks, Agrobaseand etc. Data Processing: •Curation •Analysis •Interpretation •Publication After that? •Case 1: Archival / Storage of Data  •Case 2: Forgot, Lying in xlsfiles & Die with time  •Case 3: Case 1 () but no sharing () Data Sharing? Usual Project Dataflow
  3. 3. Most CommonRequests by email? –Maynotfindwhenrequested(After3- 4years)!!! –Verynarrowuserbasefordata –OnlyactiveGooglersmayfindyou(ThroughPublications?) –Highprobabilityofdataloss! We Share Data!
  4. 4. DATA Experiments/ Research Station/ FPVS / FLD / LAB / Baseline Survey /Adoption Surveys and etc… AND Kept in IBP/FieldBooks, Agrobaseand etc. Data Processing: •Curation •Analysis •Interpretation •Publication After that? •Case 1: Archival / Storage of Data  •Case 2: Forgot, Lying in xlsfiles & Die with time  •Case 3: Case 1 () but no sharing () Data Sharing? Data Sharing? Research Resources & Generated Data Not Used to Full Potential !
  5. 5. ICRISAT Data Management Strategy Data Curators Data Manager
  6. 6. Desired Way •MustHaves –Sharedinonlinerepositories –AccessibletoeverybodyasIPG –DataQualityEnsured –HighStandersofDataCuration –CompressedFiles/RawData –LinkstoPublications •Goodtohave –SummaryTables(variousperspectives) –DataQueryingTool –SaySuccessStory –PointtoLessonLearned –Showimpact We Share Data! 60-70% Time GIGO
  7. 7. Data Quality: Little Complicated –SupervisedAlgorithms/Scripts •SAS,R,GenStat –Leverage –Cook’sD –ResidualAnalysis –DiagnosticPlots –Rep/Season-Rep/Seasondifference –TextPatternSearch –OtherDatasepecific
  8. 8. Wish to have… •Auserfriendlybrowse-ableonlinesystem –Givesinformationinaglance –GraphicalrepresentationofStory –Completeinsightintodata •WithavailabilityofRaw/Meandata •Subsetselectionanddownload •Maintenancefree(PIsubmits&forget),Cloude? •Usercontroloverwhatisbeingshared? –Canshareonlyfewvarietiesforfewlocation •Andinwhatform(*.xls,jpeg,pdfetc? We Share Data!
  9. 9. Achieved !!!
  10. 10. Must Have CRP-DS Dataverse
  11. 11. ICRISAT DataverseNetwork -Open Source
  12. 12. ICRISAT DataverseNetwork -Open Source
  13. 13. ICRISAT DataverseNetwork -Open Source
  14. 14. Database @ ICRISAT Projects Tropical Legumes-II
  15. 15. 1 year more education Double the months on the farm per year The Simultaneous Triple-View of any data: Table, Map, Chart
  16. 16. Malawi Baseline Survey: Crop Utilization
  17. 17. Tanzania Baseline Survey: Crop Utilization
  18. 18. TL-II Trials (Station/FPVS)
  19. 19. India & Bangladesh Trials Comparing LOCAL variety performance summary.
  20. 20. Improved Varieties Summary of Improved Variety Performance
  21. 21. Create LOCAL and IMPROVED Summary Variables
  22. 22. Calculate Comparisons: Improved to Local Performance Ratio
  23. 23. Database @ ICRISAT Projects HOPE
  24. 24. Grain Yield Village wise local vsImproved varieties
  25. 25. Follow-up (Pooled over Districts) local vsImproved varieties
  26. 26. Follow-up (Year Wise) local vsImproved varieties Download selected Subset of data
  27. 27. Follow-up (Year Wise) local vsImproved varieties Precipitation Download selected Subset of data
  28. 28. Good & Wish to Have CRP-DS aWhere
  29. 29. Quantity of Fertilizer Used: http://apps.awhere.com/reader/Default.aspx?id=wSSIU7DkTE6L6O-enOxanQ Income Comparison: http://apps.awhere.com/reader/Default.aspx?id=KFCQG-O3e0i9lQsbbwerjA Economy: http://apps.awhere.com/reader/Default.aspx?id=VwkQAtCdAEmIRPOZiHN94w Land Size: http://apps.awhere.com/reader/Default.aspx?id=ThKD4aciLEGkYksBFDaszg Crop Input/OutputDistance: http://apps.awhere.com/reader/Default.aspx?id=7pxWd3P3N0GKdjseBnq31A
  30. 30. Thanks… For more details please contact: Dr. Abhishek Rathore a.rathore@cgiar.org

×