PyDataVE #22 EDA Workshop https://www.meetup.com/pydata-venice/events/310339068/

1. Giovedì 28 Agosto 2025
@PyDataVenice #22 #Meetup #PyData
in presenza e in streaming
alle ore 19:00
Venice
Alessandra Bilardi
Data / Automation Specialist
@ Corley Cloud
Exploratory Data Analysis
on a Kaggle competition
#DataAnalysis
#Workshop

2. Promotori di PyData Venice #22

3. Agenda
Speech / Workshop
Iniziative
Prossimi incontri
Networking

4. Exploratory Data Analysis
@PyDataVenice #22 #Meetup #PyData
Alessandra Bilardi - Data / Automation Specialist @ Corley Cloud

5. Alessandra Bilardi
Data & Automation Specialist @ Corley Cloud
● AWS User Group Venezia leader
● Coderdojo mentor
● PyData Venice leader
● PyVenice cofounder
alessandra.bilardi@gmail.com
@abilardi
bilardi

6. Summary
The basics of EDA
Python libraries for EDA

7. The basics of EDA

8. Form: Networking post meetup ?
1. [online|presence]
2. [yes|no]

9. Form: First step to analyze a data file ?
1. [one word]

10. Form: Is a pie chart or a bar chart better ?
1. [pie|bar]

11. Time for Some Theory: human perception
http://euclid.psych.yorku.ca/www/psy6135/papers/ClevelandMcGill1984.pdf

12. Time for Some Theory: human perception
1. position, common scale
http://euclid.psych.yorku.ca/www/psy6135/papers/ClevelandMcGill1984.pdf
➢ scatter plot, point map

13. Time for Some Theory: human perception
1. position, common scale
2. position, non-aligned
http://euclid.psych.yorku.ca/www/psy6135/papers/ClevelandMcGill1984.pdf
➢ scatter plot, point map
➢ scatter plot matrix

14. Time for Some Theory: human perception
1. position, common scale
2. position, non-aligned
3. size, length
http://euclid.psych.yorku.ca/www/psy6135/papers/ClevelandMcGill1984.pdf
➢ scatter plot, point map
➢ scatter plot matrix
➢ bar chart, histogram

15. Time for Some Theory: human perception
1. position, common scale
2. position, non-aligned
3. size, length
4. orientation, angle
http://euclid.psych.yorku.ca/www/psy6135/papers/ClevelandMcGill1984.pdf
➢ scatter plot, point map
➢ scatter plot matrix
➢ bar chart, histogram
➢ pie chart, gradient lines

16. Time for Some Theory: human perception
1. position, common scale
2. position, non-aligned
3. size, length
4. orientation, angle
5. size, area
http://euclid.psych.yorku.ca/www/psy6135/papers/ClevelandMcGill1984.pdf
➢ scatter plot, point map
➢ scatter plot matrix
➢ bar chart, histogram
➢ pie chart, gradient lines
➢ tree map, bubble chart

17. Time for Some Theory: human perception
1. position, common scale
2. position, non-aligned
3. size, length
4. orientation, angle
5. size, area
6. size, volume & brightness
http://euclid.psych.yorku.ca/www/psy6135/papers/ClevelandMcGill1984.pdf
➢ scatter plot, point map
➢ scatter plot matrix
➢ bar chart, histogram
➢ pie chart, gradient lines
➢ tree map, bubble chart
➢ 3d, heat map

18. Time for Some Theory: human perception
1. position, common scale
2. position, non-aligned
3. size, length
4. orientation, angle
5. size, area
6. size, volume & brightness
7. color
http://euclid.psych.yorku.ca/www/psy6135/papers/ClevelandMcGill1984.pdf
➢ scatter plot, point map
➢ scatter plot matrix
➢ bar chart, histogram
➢ pie chart, gradient lines
➢ tree map, bubble chart
➢ 3d, heat map
➢ color hue scales

19. Time for Some Theory: human perception
1. position, common scale
2. position, non-aligned
3. size, length
4. orientation, angle
5. size, area
6. size, volume & brightness
7. color
http://euclid.psych.yorku.ca/www/psy6135/papers/ClevelandMcGill1984.pdf
➢ scatter plot, point map
➢ scatter plot matrix
➢ bar chart, histogram
➢ pie chart, gradient lines
➢ tree map, bubble chart
➢ 3d, heat map
➢ color hue scales

20. http://euclid.psych.yorku.ca/www/psy6135/papers/ClevelandMcGill1984.pdf

21. Time for Some Theory: human perception
1. position, common scale
2. position, non-aligned
3. size, length
4. orientation, angle
5. size, area
6. size, volume & brightness
7. color
http://euclid.psych.yorku.ca/www/psy6135/papers/ClevelandMcGill1984.pdf
➢ scatter plot, point map
➢ scatter plot matrix
➢ bar chart, histogram
➢ pie chart, gradient lines
➢ tree map, bubble chart
➢ 3d, heat map
➢ color hue scales

22. Time for Some Theory: human perception
1. position, common scale
2. position, non-aligned
3. size, length
4. orientation, angle
5. size, area
6. size, volume & brightness
7. color
http://euclid.psych.yorku.ca/www/psy6135/papers/ClevelandMcGill1984.pdf
➢ scatter plot, point map
➢ scatter plot matrix
➢ bar chart, histogram
➢ pie chart, gradient lines
➢ tree map, bubble chart
➢ 3d, heat map
➢ color hue scales

23. Python libraries for EDA

24. EDA tools
tool correlation distribution missing version contributors
YData profiling table & heatmap * histogram bar & heatmap 4.16.1 116
dabl scatter plot histogram --- 0.3.2 25
klib table & heatmap ** line / histo bar & heatmap 1.3.1 6
PyGWalker calculated field drag & drop calculated field 0.4.9.15 23

25. EDA tools
tool correlation distribution missing version contributors
YData profiling table & heatmap * histogram bar & heatmap 4.16.1 116
dabl scatter plot histogram --- 0.3.2 25
klib table & heatmap ** line / histo bar & heatmap 1.3.1 6
PyGWalker calculated field drag & drop calculated field 0.4.9.15 23
** also single feature heatmap
* also interactions

26. EDA tools
tool correlation distribution missing version contributors
YData profiling table & heatmap * histogram bar & heatmap 4.16.1 116
dabl scatter plot histogram --- 0.3.2 25
klib table & heatmap ** line / histo bar & heatmap 1.3.1 6
PyGWalker calculated field drag & drop calculated field 0.4.9.15 23
** also single feature heatmap
* also interactions

27. EDA tools
tool correlation distribution missing version contributors
YData profiling table & heatmap * histogram bar & heatmap 4.16.1 116
dabl scatter plot histogram --- 0.3.2 25
klib table & heatmap ** line / histo bar & heatmap 1.3.1 6
PyGWalker calculated field drag & drop calculated field 0.4.9.15 23
** also single feature heatmap
* also interactions

28. EDA tools
tool correlation distribution missing version contributors
YData profiling table & heatmap * histogram bar & heatmap 4.16.1 116
dabl scatter plot histogram --- 0.3.2 25
klib table & heatmap ** line / histo bar & heatmap 1.3.1 6
PyGWalker calculated field drag & drop calculated field 0.4.9.15 23
** also single feature heatmap
* also interactions

29. EDA tools
tool correlation distribution missing version contributors
YData profiling table & heatmap * histogram bar & heatmap 4.16.1 116
dabl scatter plot histogram --- 0.3.2 25
klib table & heatmap ** line / histo bar & heatmap 1.3.1 6
PyGWalker calculated field drag & drop calculated field 0.4.9.15 23
** also single feature heatmap
* also interactions

30. EDA tools
tool correlation distribution missing version contributors
YData profiling table & heatmap * histogram bar & heatmap 4.16.1 116
dabl scatter plot histogram --- 0.3.2 25
klib table & heatmap ** line / histo bar & heatmap 1.3.1 6
PyGWalker calculated field drag & drop calculated field 0.4.9.15 23
** also single feature heatmap
* also interactions

31. EDA tools
tool correlation distribution missing version contributors
YData profiling table & heatmap * histogram bar & heatmap 4.16.1 116
dabl scatter plot histogram --- 0.3.2 25
klib table & heatmap ** line / histo bar & heatmap 1.3.1 6
PyGWalker calculated field drag & drop calculated field 0.4.9.15 23
** also single feature heatmap
* also interactions

32. EDA tools
tool correlation distribution missing version contributors
YData profiling table & heatmap * histogram bar & heatmap 4.16.1 116
dabl scatter plot histogram --- 0.3.2 25
klib table & heatmap ** line / histo bar & heatmap 1.3.1 6
PyGWalker calculated field drag & drop calculated field 0.4.9.15 23
** also single feature heatmap
* also interactions

33. EDA tools
tool correlation distribution missing
YData profiling table & heatmap * histogram bar & heatmap
dabl scatter plot histogram ---
klib table & heatmap ** line / histo bar & heatmap
PyGWalker calculated field drag & drop calculated field
** also single feature heatmap
* also interactions

34. EDA tools
tool correlation distribution missing year of birth contributors
YData profiling table & heatmap * histogram bar & heatmap 2016 116
dabl scatter plot histogram --- 2019 25
klib table & heatmap ** line / histo bar & heatmap 2020 6
PyGWalker calculated field drag & drop calculated field 2023 23
** also single feature heatmap
* also interactions

35. EDA tools
** also single feature heatmap
* also interactions
tool correlation distribution missing version contributors
YData profiling table & heatmap * histogram bar & heatmap 4.16.1 116
dabl scatter plot histogram --- 0.3.2 25
klib table & heatmap ** line / histo bar & heatmap 1.3.1 6
PyGWalker calculated field drag & drop calculated field 0.4.9.15 23

36. EDA tools
tool correlation distribution missing year of birth contributors
YData profiling table & heatmap * histogram bar & heatmap 2016 116
dabl scatter plot histogram --- 2019 25
klib table & heatmap ** line / histo bar & heatmap 2020 6
PyGWalker calculated field drag & drop calculated field 2023 23
** also single feature heatmap
* also interactions

37. EDA tools
tool correlation distribution missing year of birth contributors
YData profiling table & heatmap * histogram bar & heatmap 2016 116
dabl scatter plot histogram --- 2019 25
klib table & heatmap ** line / histo bar & heatmap 2020 6
PyGWalker calculated field drag & drop calculated field 2023 23
** also single feature heatmap
* also interactions

38. EDA tools
tool correlation distribution missing year of birth contributors
YData profiling table & heatmap * histogram bar & heatmap 2016 116
dabl scatter plot histogram --- 2019 25
klib table & heatmap ** line / histo bar & heatmap 2020 6
PyGWalker calculated field drag & drop calculated field 2023 23
** also single feature heatmap
* also interactions

39. Questions ?
@PyDataVenice #22 #Meetup #PyData

40. Exploratory Data Analysis
on a Kaggle competition
@PyDataVenice #22 #Meetup #PyData
Alessandra Bilardi - Data / Automation Specialist @ Corley Cloud

41. Summary
Competition description
__init__ phase

42. Competition description

43. Form: What you need before you start doing EDA ?
1. [one word]

44. __init__ phase

45. Telegram: PyDataVe

46. Workshop material
● https://github.com/pydata-venice/PyDataVE

47. Questions ?
@PyDataVenice #22 #Meetup #PyData

48. Iniziative: workshop feedback

49. Iniziative: venice.pydata.org

50. Iniziative: pydata-venice.github.io

51. Prossimi incontri
● venerdì 5 settembre, PyVenice,
San Donà di Piave

52. Prossimi incontri
● venerdì 5 settembre, PyVenice, San Donà di Piave
● giovedì 30 ottobre, PyData Venice, Mestre

53. Prossimi incontri
● venerdì 5 settembre, PyVenice, San Donà di Piave
● giovedì 30 ottobre, PyData Venice, Mestre
● da martedì 9 a giovedì 11 dicembre, PyData Global, Online

54. Prossimi incontri
● venerdì 5 settembre, PyVenice, San Donà di Piave
● giovedì 30 ottobre, PyData Venice, Mestre
● da martedì 9 a giovedì 11 dicembre, PyData Global, Online
● giovedì 18 dicembre, PyData Venice, Mestre

55. Proposte

56. Thanks for listening.
@PyDataVenice #22 #Meetup #PyData