Download to read offline
Uploaded byitnig
Data Tools cosystem_for_non_programmers
This document provides an overview of tools for working with data that do not require programming skills. It discusses the data process, including acquisition, analysis, and visualization. Tools covered for acquisition include Google Forms, scraping tools, PDF extractors, and OpenRefine. Analysis tools include Excel, R, and natural language processing. Visualization tools include Timeline.js, Wordle, Plotly, Google Fusion Tables, Gephi, CartoDB, MapBox, and Tilemill. The document notes that developers may be needed for larger, real-time, or more advanced interactive projects. Resources for learning more are also listed.
More Related Content
Similar to Data Tools cosystem_for_non_programmers
Data Tools cosystem_for_non_programmers
- 1. Data Tools Ecosystem fornon-programmers Óscar Marín Miró @outliers_es www.outliers.es 1
- 2. Contents at aglance The Data Process ‣Why mess with Data? ‣A Data Pipeline Data Acquisition Tools ‣Data Sources ‣Google Forms & Google Docs ‣Scraping tools ‣Network acquisition tools ‣PDF tools ‣Open Refine Data Analysis ‣Excel capabilities ‣Beyond excel Data Visualization Tools ‣Timeline.js ‣Wordle ‣Plot.ly ‣Google Fusion Tables ‣Gephi ‣CartoDB ‣MapBox ‣Tilemill Developers needed ‣Size ‣Real-Time ‣Analysis beyond Basics ‣Interactivity* Resources 2
- 3.
- 4. Why mess withdata? Cognitive Complexity Wisdom •Non transferable •Ethic knowledge application Knowledge •Personal Absortion •Action: Information application •‘Insights’ Information •Structured Data •Semantics •Narrative •Spatialized Data Data •Register observations 4
- 5. A Data Pipeline Data Data Acquisition •API’s •Scraping •Files •DB’s •Providers Information Analysis •TextMining •Machine Learning •Network Metrics •Stats •Filtering Presentation •Visualization •Story 5
- 6.
- 7. Data Formats • JSON(Javascript Object Notation) - Dev • CSV, XLS - Tabular • XML - Old, but still used • Web data 7
- 8. Data Acq Techniques •Ask the user: Forms • Download from Data Repositories • Web data: Scrape • Ask the provider: API access 8
- 9.
- 10.
- 11.
- 12.
- 13.
- 14.
- 15.
- 16.
- 17.
- 18.
- 19.
- 20.
- 21.
- 22.
- 23.
- 24.
- 25.
- 26.
- 27.
- 28.
- 29.
- 30.
- 31.
- 32.
- 33.
- 34.
- 35.
- 36. Data Analysis Tools •Numeric analysis • Network analysis • Language analysis 36
- 37. Data Analysis w/MS Excel • • • • • • • Sort Basic Stats: Mean, Median, Sum... Filter Charts Pivot tables What-if Data Analysis Tool 37
- 38. Data Analysis:MS Excel ‘PivotTables’ 38
- 39.
- 40. Data Analysis: MSExcel Correlations, Covariance, Statistic Summary, Regression, Histogram, Factor Analysis, Fourier Analysis.... http://ire.org/media/uploads/car2013_tipsheets/excel_stats_nicar2013.pdf 40
- 41.
- 42.
- 43.
- 44.
- 45. Data Visualization Tools •Timelines • Words • Chart tools • Networks • Maps 45
- 46. Data Visualization Tools TimelineJS http://timeline.knightlab.com/ 46
- 47. Data Visualization Tools Timeliner(OKFN) http://timeliner.okfnlabs.org 47
- 48.
- 49.
- 50.
- 51.
- 52.
- 53.
- 54. Data Visualization Tools GoogleFusion Tables https://www.google.com/fusiontables/data?docid=1-941Px73b_XWWn3pmPHKp6WhbbSVNiEmKMadwe0#rows:id=1 https://www.google.com/fusiontables/ 54
- 55. Data Visualization Tools GoogleFusion Tables https://www.google.com/fusiontables/data?docid=1-941Px73b_XWWn3pmPHKp6WhbbSVNiEmKMadwe0#rows:id=1 https://www.google.com/fusiontables/ 55
- 56. Data Visualization Tools GoogleFusion Tables https://www.google.com/fusiontables/data?docid=1-941Px73b_XWWn3pmPHKp6WhbbSVNiEmKMadwe0#rows:id=1 https://www.google.com/fusiontables/ 56
- 57. Data Visualization Tools GoogleFusion Tables https://www.google.com/fusiontables/data?docid=1-941Px73b_XWWn3pmPHKp6WhbbSVNiEmKMadwe0#rows:id=1 https://www.google.com/fusiontables/ 57
- 58. Data Visualization Tools GoogleFusion Tables https://www.google.com/fusiontables/data?docid=1-941Px73b_XWWn3pmPHKp6WhbbSVNiEmKMadwe0#rows:id=1 https://www.google.com/fusiontables/ 58
- 59.
- 60.
- 61.
- 62.
- 63.
- 64.
- 65.
- 66.
- 67.
- 68.
- 69.
- 70.
- 71.
- 72.
- 73.
- 74. When you’ll needa developer ‣Size ‣Real-Time ‣Analysis beyond Basics ‣Interactivity ‣API access 74
- 75.
- 76.
- 77.
- 78.
- 79.
- 80.
- 81.
- 82.
- 83. Any questions? Thanks foryour attention! 83