Downloaded 69 times
Uploaded byOutliers Collective
Data tools ecosystem for non-programmers
The document presents a comprehensive overview of data tools and processes for non-programmers, detailing data acquisition, analysis, and visualization techniques. It discusses various tools such as Google Forms, OpenRefine, and visualization platforms like Plotly and Mapbox, while emphasizing the importance of data handling in informing decision-making. Additionally, it highlights the need for developers in specific scenarios such as real-time analysis and advanced interactivity.
More Related Content
Similar to Data tools ecosystem for non-programmers
Data tools ecosystem for non-programmers
- 1. Data Tools Ecosystem fornon-programmers Óscar Marín Miró @outliers_es www.outliers.es 1
- 2. Contents at aglance The Data Process ‣Why mess with Data? ‣A Data Pipeline Data Acquisition Tools ‣Data Sources ‣Google Forms & Google Docs ‣Scraping tools ‣Network acquisition tools ‣PDF tools ‣Open Refine Data Analysis ‣Excel capabilities ‣Beyond excel Data Visualization Tools ‣Timeline.js ‣Wordle ‣Plot.ly ‣Google Fusion Tables ‣Gephi ‣CartoDB ‣MapBox ‣Tilemill Developers needed ‣Size ‣Real-Time ‣Analysis beyond Basics ‣Interactivity* Resources 2
- 3.
- 4. Why mess withdata? Cognitive Complexity Wisdom •Non transferable •Ethic knowledge application Knowledge •Personal Absortion •Action: Information application •‘Insights’ Information •Structured Data •Semantics •Narrative •Spatialized Data Data •Register observations 4
- 5. A Data Pipeline Data Data Acquisition •API’s •Scraping •Files •DB’s •Providers Information Analysis •TextMining •Machine Learning •Network Metrics •Stats •Filtering Presentation •Visualization •Story 5
- 6.
- 7. Data Formats • JSON(Javascript Object Notation) - Dev • CSV, XLS - Tabular • XML - Old, but still used • Web data 7
- 8. Data Acq Techniques •Ask the user: Forms • Download from Data Repositories • Web data: Scrape • Ask the provider: API access 8
- 9.
- 10.
- 11.
- 12.
- 13.
- 14.
- 15.
- 16.
- 17.
- 18.
- 19.
- 20.
- 21.
- 22.
- 23.
- 24.
- 25.
- 26.
- 27.
- 28.
- 29.
- 30.
- 31.
- 32.
- 33.
- 34.
- 35.
- 36. Data Analysis Tools •Numeric analysis • Network analysis • Language analysis 36
- 37. Data Analysis w/MS Excel • • • • • • • Sort Basic Stats: Mean, Median, Sum... Filter Charts Pivot tables What-if Data Analysis Tool 37
- 38. Data Analysis:MS Excel ‘PivotTables’ 38
- 39.
- 40. Data Analysis: MSExcel Correlations, Covariance, Statistic Summary, Regression, Histogram, Factor Analysis, Fourier Analysis.... http://ire.org/media/uploads/car2013_tipsheets/excel_stats_nicar2013.pdf 40
- 41.
- 42.
- 43.
- 44.
- 45. Data Visualization Tools •Timelines • Words • Chart tools • Networks • Maps 45
- 46. Data Visualization Tools TimelineJS http://timeline.knightlab.com/ 46
- 47. Data Visualization Tools Timeliner(OKFN) http://timeliner.okfnlabs.org 47
- 48.
- 49.
- 50.
- 51.
- 52.
- 53.
- 54. Data Visualization Tools GoogleFusion Tables https://www.google.com/fusiontables/data?docid=1-941Px73b_XWWn3pmPHKp6WhbbSVNiEmKMadwe0#rows:id=1 https://www.google.com/fusiontables/ 54
- 55. Data Visualization Tools GoogleFusion Tables https://www.google.com/fusiontables/data?docid=1-941Px73b_XWWn3pmPHKp6WhbbSVNiEmKMadwe0#rows:id=1 https://www.google.com/fusiontables/ 55
- 56. Data Visualization Tools GoogleFusion Tables https://www.google.com/fusiontables/data?docid=1-941Px73b_XWWn3pmPHKp6WhbbSVNiEmKMadwe0#rows:id=1 https://www.google.com/fusiontables/ 56
- 57. Data Visualization Tools GoogleFusion Tables https://www.google.com/fusiontables/data?docid=1-941Px73b_XWWn3pmPHKp6WhbbSVNiEmKMadwe0#rows:id=1 https://www.google.com/fusiontables/ 57
- 58. Data Visualization Tools GoogleFusion Tables https://www.google.com/fusiontables/data?docid=1-941Px73b_XWWn3pmPHKp6WhbbSVNiEmKMadwe0#rows:id=1 https://www.google.com/fusiontables/ 58
- 59.
- 60.
- 61.
- 62.
- 63.
- 64.
- 65.
- 66.
- 67.
- 68.
- 69.
- 70.
- 71.
- 72.
- 73.
- 74. When you’ll needa developer ‣Size ‣Real-Time ‣Analysis beyond Basics ‣Interactivity ‣API access 74
- 75.
- 76.
- 77.
- 78.
- 79.
- 80.
- 81.
- 82.
- 83. Any questions? Thanks foryour attention! 83