SlideShare a Scribd company logo
Anne-Marie Tousch
Senior Research Scientist
@amy8492
please don't ruin it!
Data is
beautiful
Mach 12th, 2019
2 reasons
to visualize
data
Photo by Yuri Loginov from Pexels
4 •
I keep seeing plain tables.
❑ Do they want me to read all this?
❑ Did they copy-paste their slides from their paper?
❑ Do they care about their audience?
❑ Do they care about giving this talk?
❑ Are they hiding something?
❑ Do they realize a dataviz would be much more
powerful?
Most respectful interpretation?
5 •
Efficient communication
A picture
tells a 1000
words.
Source: Business Insider, August 2016
6 •
Summary statistics
7 •
never trust summary
statistics alone;
always visualize your
data
Detecting patterns
http://www.thefunctionalart.com/2016/08/download-datasaurus-never-trust-summary.html
What is dataviz about?
9 •
Maxwell’s model of Saturn’s rings, 1858
Visualizing is always great, not only for data
10 •
Visualize algorithms http://playground.tensorflow.org
11 • Pictures credits : Wiki Commons / the_jetboy CC2.0 / Sandor Vamos / Wiki Commons / Acute3D / Walkerssk / Pixabay / Wiki Commons / Wiki Commons
Many ways to apprehend the world
7,000,000 visitors a year2,500,000 rivets
10,100 tons
12 •
Exploiting the human visual system
Ever heard of Gestalt
theory?
13 •
Count the 3s below
Ready?
14 •
Count the 3s below
756395068473
658663037576
860372658602
846589107830
Source: http://www.storytellingwithdata.com/book/downloads
15 •
How many 3s?
Source: http://www.storytellingwithdata.com/book/downloads
16 •
Count the 3s below
756395068473
658663037576
860372658602
846589107830
Source: http://www.storytellingwithdata.com/book/downloads
17 •
Much easier now, uh?
Source: http://www.storytellingwithdata.com/book/downloads
How?
Eugene Kim CC2.0
19 •
Define your
goal
Choose an
effective visual
Find the right
focus
Close the loop
Explore / Explain
Question?
Simple is better
Function first,
form next
Use color, size
Remove clutter
Do you answer your
question?
Do you have a
story?
Follow the process
20 •
Follow best practices
Think accessibility
Use rules of thumbs
Actively take control
Be truthful
21 •
When you want to focus the
attention on just a number or two
When you have a mixed
audience, for information lookup
To show the relationship between
two things
The best for continuous data over
time
Makes it very easy to compare
categories
To compare totals and also
subcomponents
Choose an effective, simple visual
Source: http://www.storytellingwithdata.com/book/downloads
22 •
Pie charts are evil
23 •
756395068473
658663037576
860372658602
846589107830
Remember
Source: http://www.storytellingwithdata.com/book/downloads
24 •
There are many preattentive attributes
Source: http://www.storytellingwithdata.com/book/downloads
25 •
But two are special
Colour is the most powerful tool you have.
Use it sparingly and resist the urge to use colour for the sake of being colourful.
Leverage colour selectively to highlight the important parts of your visual.
Size matters.
If you’re showing multiple things that are of roughly equal importance, size them similarly.
If there is one really important thing, leverage size to indicate that: make it BIG!
26 •
Maximise data-ink ratio,
within reason.
Edward Tufte, The Visual Display of Quantitative Information
27 •
Forgo chartjunk, including
moiré vibration, the grid, and the
duck.
Edward Tufte, The Visual Display of Quantitative Information
28 •
The moiré effect
29 •
Don’t let your design choices be happenstance.
They should be the result of explicit decisions.
30 •
Select good defaults
31 •
One Python trick:
32 •
Take the control
Take-aways
Wikimedia Commons
34 •
Know your data
35 •
You should care
It’s not only about nice
graphics
There’s a wealth of resources
Well-grounded best practices
Further tips
Highlight the important stuff
Eliminate distractions
Create a visual hierarchy of
information
Make it accessible
1
2
3
4
Only highlight 10% of the overall visual. Use preattentive attributes to do so, even together
for very important stuff
When detail isn’t needed, summarize. Ask yourself if eliminating this would change
anything. If not, take it out. Push less impacting items to the background with light grey
Organize information to guide the audience. Follow a Z-pattern from top left to bottom right.
You might be an engineer, but it shouldn’t take someone with an engineering degree to
understand your graph.
Use simple language5
Choose simple language over complex, choose fewer words over more words, define any
specialized language with which your audience may not be familiar, and spell out
acronyms.
Be mindful of aestethics6
Be smart with colors. Pay attention to alignment to give a sense of unity and cohesion.
Leverage white space, and don’t add stuff just to fill space
Always prefer simple over complex
37 •
The Visual Display of Quantitative Information. Edward Tufte. Graphics Press, 2d edition,
2001. The classic on beautiful, faithful displays.
Visualization Analysis and Design. Tamara Munzner. AK Peters / CRC Press, Oct 2014. A
comprehensive textbook.
Visualize this: the FlowingData guide to design, visualization, and statistics. Nathan Yau. John
Wiley & Sons, 2011. For practical examples and code.
The Wall Street Journal Guide to Information Graphics: The Dos and Don'ts of Presenting
Data, Facts, and Figures. Dona M. Wong. W. W. Norton & Company, 2013.
Storytelling with Data: A Data Visualization Guide for Business Professionals. Cole
Nussbaumer Knaflic. Wiley, 2015.
Books
38 •
Tukey, John W. "The future of data analysis." The annals of mathematical statistics 33.1 (1962): 1-67. pdf
Cleveland, William S., and Robert McGill. "Graphical perception: Theory, experimentation, and application to
the development of graphical methods." Journal of the American statistical association 79.387 (1984): 531-554.
pdf
Gelman, Andrew, Cristian Pasarica, and Rahul Dodhia. "Let's practice what we preach: turning tables into
graphs." The American Statistician 56.2 (2002): 121-130. pdf
Gelman, Andrew, and Antony Unwin. "Infovis and statistical graphics: different goals, different looks." Journal of
Computational and Graphical Statistics 22.1 (2013): 2-28. pdf
Gelman, Andrew, and Thomas Basbøll. "When do stories work? Evidence and illustration in the social
sciences." Sociological Methods & Research 43.4 (2014): 547-570. pdf
Maaten, Laurens van der, and Geoffrey Hinton. "Visualizing data using t-SNE." Journal of machine learning
research 9.Nov (2008): 2579-2605. pdf
Kim, Been, Rajiv Khanna, and Oluwasanmi O. Koyejo. "Examples are not enough, learn to criticize! criticism for
interpretability." Advances in Neural Information Processing Systems. 2016. pdf
Wongsuphasawat, Kanit, et al. "Visualizing Dataflow Graphs of Deep Learning Models in TensorFlow." IEEE
transactions on visualization and computer graphics 24.1 (2018): 1-12. pdf
Research papers
39 •
• Flowing Data
• Storytelling With Data
• The Functional Art
• Google Brain PAIR group
• colorbrewer2.org helps select colors
Blogs & other resources
Learn from good examples
• junkcharts
• vizwiz
• fivethirtyeight
• theguardian.com/data
But also from bad ones
• viz.wtf
Practice with makeovermonday
Interested? React on paris-wimlds.slack.com
Questions?
Thanks @Paolo Terzi
(Criteo) from whom I took a
bunch of slides
Colocho CC BY-SA 2.5
41 •
Rule of thumb: function first, form next

More Related Content

What's hot

Introduction to Data Visualization
Introduction to Data VisualizationIntroduction to Data Visualization
Introduction to Data Visualization
Stephen Tracy
 
Digital analytics: Dashboards, visualizations, and lying with data (Lectures ...
Digital analytics: Dashboards, visualizations, and lying with data (Lectures ...Digital analytics: Dashboards, visualizations, and lying with data (Lectures ...
Digital analytics: Dashboards, visualizations, and lying with data (Lectures ...
Joni Salminen
 
Data Analaytics.04. Data visualization
Data Analaytics.04. Data visualizationData Analaytics.04. Data visualization
Data Analaytics.04. Data visualization
Alex Rayón Jerez
 
Effective Strategies for Creating Scientific graphics
Effective Strategies for Creating Scientific graphicsEffective Strategies for Creating Scientific graphics
Effective Strategies for Creating Scientific graphicsJoel Kelly
 
Data visualization introduction
Data visualization introductionData visualization introduction
Data visualization introduction
ManokamnaKochar1
 
Data Visualization: Impact, Intrigue, Value Add for APLIC 2014
Data Visualization: Impact, Intrigue, Value Add for APLIC 2014Data Visualization: Impact, Intrigue, Value Add for APLIC 2014
Data Visualization: Impact, Intrigue, Value Add for APLIC 2014
Amanda Makulec
 
Intro to data visualization
Intro to data visualizationIntro to data visualization
Intro to data visualization
Jan Aerts
 
A Pixar Twist on Presenting Data
A Pixar Twist on Presenting DataA Pixar Twist on Presenting Data
A Pixar Twist on Presenting Data
Amanda Makulec
 
The Science of Powerful Data Visualizations
The Science of Powerful Data VisualizationsThe Science of Powerful Data Visualizations
The Science of Powerful Data Visualizations
Silvia Convento, PhD
 
Theory as foundation ieb presentation
Theory as foundation ieb presentationTheory as foundation ieb presentation
Theory as foundation ieb presentation
Sarel Van Greunen
 
Data visualization
Data visualizationData visualization
Data visualization
Subarna Natarajan
 
Class 5
Class 5Class 5
Class 5
Ana Jofre
 
Brief introduction to data visualization
Brief introduction to data visualizationBrief introduction to data visualization
Brief introduction to data visualization
Zach Gemignani
 
Data Visualization Tools
Data Visualization Tools Data Visualization Tools
Data Visualization in Data Science
Data Visualization in Data ScienceData Visualization in Data Science
Data Visualization in Data Science
Maloy Manna, PMP®
 
"Introduction to Data Visualization" Workshop for General Assembly by Hunter ...
"Introduction to Data Visualization" Workshop for General Assembly by Hunter ..."Introduction to Data Visualization" Workshop for General Assembly by Hunter ...
"Introduction to Data Visualization" Workshop for General Assembly by Hunter ...
Hunter Whitney
 
Data Visualization - A Brief Overview
Data Visualization - A Brief OverviewData Visualization - A Brief Overview
Data Visualization - A Brief Overview
Rotary Club of North Raleigh
 
Making Numbers Tell their Story
Making Numbers Tell their StoryMaking Numbers Tell their Story
Making Numbers Tell their Story
dwarlick
 
Every graph tells a story
Every graph tells a story Every graph tells a story
Every graph tells a story
dnalady1
 
Study guide in theoretical data mining
Study guide in theoretical data miningStudy guide in theoretical data mining
Study guide in theoretical data mining
akmaltk96
 

What's hot (20)

Introduction to Data Visualization
Introduction to Data VisualizationIntroduction to Data Visualization
Introduction to Data Visualization
 
Digital analytics: Dashboards, visualizations, and lying with data (Lectures ...
Digital analytics: Dashboards, visualizations, and lying with data (Lectures ...Digital analytics: Dashboards, visualizations, and lying with data (Lectures ...
Digital analytics: Dashboards, visualizations, and lying with data (Lectures ...
 
Data Analaytics.04. Data visualization
Data Analaytics.04. Data visualizationData Analaytics.04. Data visualization
Data Analaytics.04. Data visualization
 
Effective Strategies for Creating Scientific graphics
Effective Strategies for Creating Scientific graphicsEffective Strategies for Creating Scientific graphics
Effective Strategies for Creating Scientific graphics
 
Data visualization introduction
Data visualization introductionData visualization introduction
Data visualization introduction
 
Data Visualization: Impact, Intrigue, Value Add for APLIC 2014
Data Visualization: Impact, Intrigue, Value Add for APLIC 2014Data Visualization: Impact, Intrigue, Value Add for APLIC 2014
Data Visualization: Impact, Intrigue, Value Add for APLIC 2014
 
Intro to data visualization
Intro to data visualizationIntro to data visualization
Intro to data visualization
 
A Pixar Twist on Presenting Data
A Pixar Twist on Presenting DataA Pixar Twist on Presenting Data
A Pixar Twist on Presenting Data
 
The Science of Powerful Data Visualizations
The Science of Powerful Data VisualizationsThe Science of Powerful Data Visualizations
The Science of Powerful Data Visualizations
 
Theory as foundation ieb presentation
Theory as foundation ieb presentationTheory as foundation ieb presentation
Theory as foundation ieb presentation
 
Data visualization
Data visualizationData visualization
Data visualization
 
Class 5
Class 5Class 5
Class 5
 
Brief introduction to data visualization
Brief introduction to data visualizationBrief introduction to data visualization
Brief introduction to data visualization
 
Data Visualization Tools
Data Visualization Tools Data Visualization Tools
Data Visualization Tools
 
Data Visualization in Data Science
Data Visualization in Data ScienceData Visualization in Data Science
Data Visualization in Data Science
 
"Introduction to Data Visualization" Workshop for General Assembly by Hunter ...
"Introduction to Data Visualization" Workshop for General Assembly by Hunter ..."Introduction to Data Visualization" Workshop for General Assembly by Hunter ...
"Introduction to Data Visualization" Workshop for General Assembly by Hunter ...
 
Data Visualization - A Brief Overview
Data Visualization - A Brief OverviewData Visualization - A Brief Overview
Data Visualization - A Brief Overview
 
Making Numbers Tell their Story
Making Numbers Tell their StoryMaking Numbers Tell their Story
Making Numbers Tell their Story
 
Every graph tells a story
Every graph tells a story Every graph tells a story
Every graph tells a story
 
Study guide in theoretical data mining
Study guide in theoretical data miningStudy guide in theoretical data mining
Study guide in theoretical data mining
 

Similar to Dataviz 101: Data is beautiful, please don't ruin it by Anne-Marie Tousch, Senior Research Scientist @CriteoAILab

Introduction to data science
Introduction to data scienceIntroduction to data science
Introduction to data science
Tharushi Ruwandika
 
Painting a clearer picture
Painting a clearer picturePainting a clearer picture
Painting a clearer picture
Ana Figueiras
 
BigData Visualization and Usecase@TDGA-Stelligence-11july2019-share
BigData Visualization and Usecase@TDGA-Stelligence-11july2019-shareBigData Visualization and Usecase@TDGA-Stelligence-11july2019-share
BigData Visualization and Usecase@TDGA-Stelligence-11july2019-share
stelligence
 
Creating Functional Art in Excel
Creating Functional Art in ExcelCreating Functional Art in Excel
Creating Functional Art in Excel
Amanda Makulec
 
Data is love data viz best practices
Data is love   data viz best practicesData is love   data viz best practices
Data is love data viz best practices
Gregory Nelson
 
A data visualisation story - top tips from the Guardian Masterclass. Creative...
A data visualisation story - top tips from the Guardian Masterclass. Creative...A data visualisation story - top tips from the Guardian Masterclass. Creative...
A data visualisation story - top tips from the Guardian Masterclass. Creative...
CharityComms
 
Creating Compelling Infographics
Creating Compelling InfographicsCreating Compelling Infographics
Creating Compelling Infographics
Katja Reuter, PhD
 
Making data visual diy guide to getting started with data visualization
Making data visual diy guide to getting started with data visualizationMaking data visual diy guide to getting started with data visualization
Making data visual diy guide to getting started with data visualization
Visual Resources Association
 
Teaching visualization: effective communication in visual formats
Teaching visualization: effective communication in visual formatsTeaching visualization: effective communication in visual formats
Teaching visualization: effective communication in visual formats
Margot
 
diseñando datos
diseñando datosdiseñando datos
diseñando datos
darwin465743
 
Aftros
Aftros Aftros
Aftros
Sezzar
 
Designing with Data: Creating Visualizations to Tell Your Story
Designing with Data: Creating Visualizations to Tell Your StoryDesigning with Data: Creating Visualizations to Tell Your Story
Designing with Data: Creating Visualizations to Tell Your Story
Dominic Prestifilippo
 
Designing with data: Creating Visualizations to Tell Your Story
Designing with data: Creating Visualizations to Tell Your StoryDesigning with data: Creating Visualizations to Tell Your Story
Designing with data: Creating Visualizations to Tell Your Story
andCulture
 
Designing with Data: Creating Visualizations to Tell Your Story
Designing with Data: Creating Visualizations to Tell Your StoryDesigning with Data: Creating Visualizations to Tell Your Story
Designing with Data: Creating Visualizations to Tell Your Story
Dominic Prestifilippo
 
Data visualization & Story Telling with Data
Data visualization & Story Telling with DataData visualization & Story Telling with Data
Data visualization & Story Telling with Data
Dr Nisha Arora
 
Making Data Meaningful
Making Data MeaningfulMaking Data Meaningful
Making Data Meaningful
JSI
 
Making Data Meaningful
Making Data MeaningfulMaking Data Meaningful
Making Data Meaningful
Amanda Makulec
 
Measurecamp 7 Workshop: Data Visualisation
Measurecamp 7 Workshop: Data VisualisationMeasurecamp 7 Workshop: Data Visualisation
Measurecamp 7 Workshop: Data Visualisation
Sean Burton
 
Hands on Approaches to Data Storytelling
Hands on Approaches to Data StorytellingHands on Approaches to Data Storytelling
Hands on Approaches to Data Storytelling
rahulbot
 
Visual communication of qualitative data
Visual communication of qualitative dataVisual communication of qualitative data
Visual communication of qualitative data
Frieda Brioschi
 

Similar to Dataviz 101: Data is beautiful, please don't ruin it by Anne-Marie Tousch, Senior Research Scientist @CriteoAILab (20)

Introduction to data science
Introduction to data scienceIntroduction to data science
Introduction to data science
 
Painting a clearer picture
Painting a clearer picturePainting a clearer picture
Painting a clearer picture
 
BigData Visualization and Usecase@TDGA-Stelligence-11july2019-share
BigData Visualization and Usecase@TDGA-Stelligence-11july2019-shareBigData Visualization and Usecase@TDGA-Stelligence-11july2019-share
BigData Visualization and Usecase@TDGA-Stelligence-11july2019-share
 
Creating Functional Art in Excel
Creating Functional Art in ExcelCreating Functional Art in Excel
Creating Functional Art in Excel
 
Data is love data viz best practices
Data is love   data viz best practicesData is love   data viz best practices
Data is love data viz best practices
 
A data visualisation story - top tips from the Guardian Masterclass. Creative...
A data visualisation story - top tips from the Guardian Masterclass. Creative...A data visualisation story - top tips from the Guardian Masterclass. Creative...
A data visualisation story - top tips from the Guardian Masterclass. Creative...
 
Creating Compelling Infographics
Creating Compelling InfographicsCreating Compelling Infographics
Creating Compelling Infographics
 
Making data visual diy guide to getting started with data visualization
Making data visual diy guide to getting started with data visualizationMaking data visual diy guide to getting started with data visualization
Making data visual diy guide to getting started with data visualization
 
Teaching visualization: effective communication in visual formats
Teaching visualization: effective communication in visual formatsTeaching visualization: effective communication in visual formats
Teaching visualization: effective communication in visual formats
 
diseñando datos
diseñando datosdiseñando datos
diseñando datos
 
Aftros
Aftros Aftros
Aftros
 
Designing with Data: Creating Visualizations to Tell Your Story
Designing with Data: Creating Visualizations to Tell Your StoryDesigning with Data: Creating Visualizations to Tell Your Story
Designing with Data: Creating Visualizations to Tell Your Story
 
Designing with data: Creating Visualizations to Tell Your Story
Designing with data: Creating Visualizations to Tell Your StoryDesigning with data: Creating Visualizations to Tell Your Story
Designing with data: Creating Visualizations to Tell Your Story
 
Designing with Data: Creating Visualizations to Tell Your Story
Designing with Data: Creating Visualizations to Tell Your StoryDesigning with Data: Creating Visualizations to Tell Your Story
Designing with Data: Creating Visualizations to Tell Your Story
 
Data visualization & Story Telling with Data
Data visualization & Story Telling with DataData visualization & Story Telling with Data
Data visualization & Story Telling with Data
 
Making Data Meaningful
Making Data MeaningfulMaking Data Meaningful
Making Data Meaningful
 
Making Data Meaningful
Making Data MeaningfulMaking Data Meaningful
Making Data Meaningful
 
Measurecamp 7 Workshop: Data Visualisation
Measurecamp 7 Workshop: Data VisualisationMeasurecamp 7 Workshop: Data Visualisation
Measurecamp 7 Workshop: Data Visualisation
 
Hands on Approaches to Data Storytelling
Hands on Approaches to Data StorytellingHands on Approaches to Data Storytelling
Hands on Approaches to Data Storytelling
 
Visual communication of qualitative data
Visual communication of qualitative dataVisual communication of qualitative data
Visual communication of qualitative data
 

More from Paris Women in Machine Learning and Data Science

Sequential and reinforcement learning for demand side management by Margaux B...
Sequential and reinforcement learning for demand side management by Margaux B...Sequential and reinforcement learning for demand side management by Margaux B...
Sequential and reinforcement learning for demand side management by Margaux B...
Paris Women in Machine Learning and Data Science
 
How and why AI should fight cybersexism, by Chloe Daudier
How and why AI should fight cybersexism, by Chloe DaudierHow and why AI should fight cybersexism, by Chloe Daudier
How and why AI should fight cybersexism, by Chloe Daudier
Paris Women in Machine Learning and Data Science
 
Anomaly detection and data imputation within time series
Anomaly detection and data imputation within time seriesAnomaly detection and data imputation within time series
Anomaly detection and data imputation within time series
Paris Women in Machine Learning and Data Science
 
Managing international tech teams, by Natasha Dimban
Managing international tech teams, by Natasha DimbanManaging international tech teams, by Natasha Dimban
Managing international tech teams, by Natasha Dimban
Paris Women in Machine Learning and Data Science
 
Optimizing GenAI apps, by N. El Mawass and Maria Knorps
Optimizing GenAI apps, by N. El Mawass and Maria KnorpsOptimizing GenAI apps, by N. El Mawass and Maria Knorps
Optimizing GenAI apps, by N. El Mawass and Maria Knorps
Paris Women in Machine Learning and Data Science
 
Perspectives, by M. Pannegeon
Perspectives, by M. PannegeonPerspectives, by M. Pannegeon
Evaluation strategies for dealing with partially labelled or unlabelled data
Evaluation strategies for dealing with partially labelled or unlabelled dataEvaluation strategies for dealing with partially labelled or unlabelled data
Evaluation strategies for dealing with partially labelled or unlabelled data
Paris Women in Machine Learning and Data Science
 
Combinatorial Optimisation with Policy Adaptation using latent Space Search, ...
Combinatorial Optimisation with Policy Adaptation using latent Space Search, ...Combinatorial Optimisation with Policy Adaptation using latent Space Search, ...
Combinatorial Optimisation with Policy Adaptation using latent Space Search, ...
Paris Women in Machine Learning and Data Science
 
An age-old question, by Caroline Jean-Pierre
An age-old question, by Caroline Jean-PierreAn age-old question, by Caroline Jean-Pierre
An age-old question, by Caroline Jean-Pierre
Paris Women in Machine Learning and Data Science
 
Applying Churn Prediction Approaches to the Telecom Industry, by Joëlle Lautré
Applying Churn Prediction Approaches to the Telecom Industry, by Joëlle LautréApplying Churn Prediction Approaches to the Telecom Industry, by Joëlle Lautré
Applying Churn Prediction Approaches to the Telecom Industry, by Joëlle Lautré
Paris Women in Machine Learning and Data Science
 
How to supervise a thesis in NLP in the ChatGPT era? By Laure Soulier
How to supervise a thesis in NLP in the ChatGPT era? By Laure SoulierHow to supervise a thesis in NLP in the ChatGPT era? By Laure Soulier
How to supervise a thesis in NLP in the ChatGPT era? By Laure Soulier
Paris Women in Machine Learning and Data Science
 
Global Ambitions Local Realities, by Anna Abreu
Global Ambitions Local Realities, by Anna AbreuGlobal Ambitions Local Realities, by Anna Abreu
Global Ambitions Local Realities, by Anna Abreu
Paris Women in Machine Learning and Data Science
 
Plug-and-Play methods for inverse problems in imagine, by Julie Delon
Plug-and-Play methods for inverse problems in imagine, by Julie DelonPlug-and-Play methods for inverse problems in imagine, by Julie Delon
Plug-and-Play methods for inverse problems in imagine, by Julie Delon
Paris Women in Machine Learning and Data Science
 
Sales Forecasting as a Data Product by Francesca Iannuzzi
Sales Forecasting as a Data Product by Francesca IannuzziSales Forecasting as a Data Product by Francesca Iannuzzi
Sales Forecasting as a Data Product by Francesca Iannuzzi
Paris Women in Machine Learning and Data Science
 
Identifying and mitigating bias in machine learning, by Ruta Binkyte
Identifying and mitigating bias in machine learning, by Ruta BinkyteIdentifying and mitigating bias in machine learning, by Ruta Binkyte
Identifying and mitigating bias in machine learning, by Ruta Binkyte
Paris Women in Machine Learning and Data Science
 
“Turning your ML algorithms into full web apps in no time with Python" by Mar...
“Turning your ML algorithms into full web apps in no time with Python" by Mar...“Turning your ML algorithms into full web apps in no time with Python" by Mar...
“Turning your ML algorithms into full web apps in no time with Python" by Mar...
Paris Women in Machine Learning and Data Science
 
Nature Language Processing for proteins by Amélie Héliou, Software Engineer @...
Nature Language Processing for proteins by Amélie Héliou, Software Engineer @...Nature Language Processing for proteins by Amélie Héliou, Software Engineer @...
Nature Language Processing for proteins by Amélie Héliou, Software Engineer @...
Paris Women in Machine Learning and Data Science
 
Sandrine Henry presents the BechdelAI project
Sandrine Henry presents the BechdelAI projectSandrine Henry presents the BechdelAI project
Sandrine Henry presents the BechdelAI project
Paris Women in Machine Learning and Data Science
 
Anastasiia Tryputen_War in Ukraine or how extraordinary courage reshapes geop...
Anastasiia Tryputen_War in Ukraine or how extraordinary courage reshapes geop...Anastasiia Tryputen_War in Ukraine or how extraordinary courage reshapes geop...
Anastasiia Tryputen_War in Ukraine or how extraordinary courage reshapes geop...
Paris Women in Machine Learning and Data Science
 
Khrystyna Grynko WiMLDS - From marketing to Tech.pdf
Khrystyna Grynko WiMLDS - From marketing to Tech.pdfKhrystyna Grynko WiMLDS - From marketing to Tech.pdf
Khrystyna Grynko WiMLDS - From marketing to Tech.pdf
Paris Women in Machine Learning and Data Science
 

More from Paris Women in Machine Learning and Data Science (20)

Sequential and reinforcement learning for demand side management by Margaux B...
Sequential and reinforcement learning for demand side management by Margaux B...Sequential and reinforcement learning for demand side management by Margaux B...
Sequential and reinforcement learning for demand side management by Margaux B...
 
How and why AI should fight cybersexism, by Chloe Daudier
How and why AI should fight cybersexism, by Chloe DaudierHow and why AI should fight cybersexism, by Chloe Daudier
How and why AI should fight cybersexism, by Chloe Daudier
 
Anomaly detection and data imputation within time series
Anomaly detection and data imputation within time seriesAnomaly detection and data imputation within time series
Anomaly detection and data imputation within time series
 
Managing international tech teams, by Natasha Dimban
Managing international tech teams, by Natasha DimbanManaging international tech teams, by Natasha Dimban
Managing international tech teams, by Natasha Dimban
 
Optimizing GenAI apps, by N. El Mawass and Maria Knorps
Optimizing GenAI apps, by N. El Mawass and Maria KnorpsOptimizing GenAI apps, by N. El Mawass and Maria Knorps
Optimizing GenAI apps, by N. El Mawass and Maria Knorps
 
Perspectives, by M. Pannegeon
Perspectives, by M. PannegeonPerspectives, by M. Pannegeon
Perspectives, by M. Pannegeon
 
Evaluation strategies for dealing with partially labelled or unlabelled data
Evaluation strategies for dealing with partially labelled or unlabelled dataEvaluation strategies for dealing with partially labelled or unlabelled data
Evaluation strategies for dealing with partially labelled or unlabelled data
 
Combinatorial Optimisation with Policy Adaptation using latent Space Search, ...
Combinatorial Optimisation with Policy Adaptation using latent Space Search, ...Combinatorial Optimisation with Policy Adaptation using latent Space Search, ...
Combinatorial Optimisation with Policy Adaptation using latent Space Search, ...
 
An age-old question, by Caroline Jean-Pierre
An age-old question, by Caroline Jean-PierreAn age-old question, by Caroline Jean-Pierre
An age-old question, by Caroline Jean-Pierre
 
Applying Churn Prediction Approaches to the Telecom Industry, by Joëlle Lautré
Applying Churn Prediction Approaches to the Telecom Industry, by Joëlle LautréApplying Churn Prediction Approaches to the Telecom Industry, by Joëlle Lautré
Applying Churn Prediction Approaches to the Telecom Industry, by Joëlle Lautré
 
How to supervise a thesis in NLP in the ChatGPT era? By Laure Soulier
How to supervise a thesis in NLP in the ChatGPT era? By Laure SoulierHow to supervise a thesis in NLP in the ChatGPT era? By Laure Soulier
How to supervise a thesis in NLP in the ChatGPT era? By Laure Soulier
 
Global Ambitions Local Realities, by Anna Abreu
Global Ambitions Local Realities, by Anna AbreuGlobal Ambitions Local Realities, by Anna Abreu
Global Ambitions Local Realities, by Anna Abreu
 
Plug-and-Play methods for inverse problems in imagine, by Julie Delon
Plug-and-Play methods for inverse problems in imagine, by Julie DelonPlug-and-Play methods for inverse problems in imagine, by Julie Delon
Plug-and-Play methods for inverse problems in imagine, by Julie Delon
 
Sales Forecasting as a Data Product by Francesca Iannuzzi
Sales Forecasting as a Data Product by Francesca IannuzziSales Forecasting as a Data Product by Francesca Iannuzzi
Sales Forecasting as a Data Product by Francesca Iannuzzi
 
Identifying and mitigating bias in machine learning, by Ruta Binkyte
Identifying and mitigating bias in machine learning, by Ruta BinkyteIdentifying and mitigating bias in machine learning, by Ruta Binkyte
Identifying and mitigating bias in machine learning, by Ruta Binkyte
 
“Turning your ML algorithms into full web apps in no time with Python" by Mar...
“Turning your ML algorithms into full web apps in no time with Python" by Mar...“Turning your ML algorithms into full web apps in no time with Python" by Mar...
“Turning your ML algorithms into full web apps in no time with Python" by Mar...
 
Nature Language Processing for proteins by Amélie Héliou, Software Engineer @...
Nature Language Processing for proteins by Amélie Héliou, Software Engineer @...Nature Language Processing for proteins by Amélie Héliou, Software Engineer @...
Nature Language Processing for proteins by Amélie Héliou, Software Engineer @...
 
Sandrine Henry presents the BechdelAI project
Sandrine Henry presents the BechdelAI projectSandrine Henry presents the BechdelAI project
Sandrine Henry presents the BechdelAI project
 
Anastasiia Tryputen_War in Ukraine or how extraordinary courage reshapes geop...
Anastasiia Tryputen_War in Ukraine or how extraordinary courage reshapes geop...Anastasiia Tryputen_War in Ukraine or how extraordinary courage reshapes geop...
Anastasiia Tryputen_War in Ukraine or how extraordinary courage reshapes geop...
 
Khrystyna Grynko WiMLDS - From marketing to Tech.pdf
Khrystyna Grynko WiMLDS - From marketing to Tech.pdfKhrystyna Grynko WiMLDS - From marketing to Tech.pdf
Khrystyna Grynko WiMLDS - From marketing to Tech.pdf
 

Recently uploaded

Water Industry Process Automation and Control Monthly - May 2024.pdf
Water Industry Process Automation and Control Monthly - May 2024.pdfWater Industry Process Automation and Control Monthly - May 2024.pdf
Water Industry Process Automation and Control Monthly - May 2024.pdf
Water Industry Process Automation & Control
 
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
Amil Baba Dawood bangali
 
weather web application report.pdf
weather web application report.pdfweather web application report.pdf
weather web application report.pdf
Pratik Pawar
 
Final project report on grocery store management system..pdf
Final project report on grocery store management system..pdfFinal project report on grocery store management system..pdf
Final project report on grocery store management system..pdf
Kamal Acharya
 
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Dr.Costas Sachpazis
 
MCQ Soil mechanics questions (Soil shear strength).pdf
MCQ Soil mechanics questions (Soil shear strength).pdfMCQ Soil mechanics questions (Soil shear strength).pdf
MCQ Soil mechanics questions (Soil shear strength).pdf
Osamah Alsalih
 
Tutorial for 16S rRNA Gene Analysis with QIIME2.pdf
Tutorial for 16S rRNA Gene Analysis with QIIME2.pdfTutorial for 16S rRNA Gene Analysis with QIIME2.pdf
Tutorial for 16S rRNA Gene Analysis with QIIME2.pdf
aqil azizi
 
The Role of Electrical and Electronics Engineers in IOT Technology.pdf
The Role of Electrical and Electronics Engineers in IOT Technology.pdfThe Role of Electrical and Electronics Engineers in IOT Technology.pdf
The Role of Electrical and Electronics Engineers in IOT Technology.pdf
Nettur Technical Training Foundation
 
Water billing management system project report.pdf
Water billing management system project report.pdfWater billing management system project report.pdf
Water billing management system project report.pdf
Kamal Acharya
 
Fundamentals of Induction Motor Drives.pptx
Fundamentals of Induction Motor Drives.pptxFundamentals of Induction Motor Drives.pptx
Fundamentals of Induction Motor Drives.pptx
manasideore6
 
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
thanhdowork
 
CW RADAR, FMCW RADAR, FMCW ALTIMETER, AND THEIR PARAMETERS
CW RADAR, FMCW RADAR, FMCW ALTIMETER, AND THEIR PARAMETERSCW RADAR, FMCW RADAR, FMCW ALTIMETER, AND THEIR PARAMETERS
CW RADAR, FMCW RADAR, FMCW ALTIMETER, AND THEIR PARAMETERS
veerababupersonal22
 
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&BDesign and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Sreedhar Chowdam
 
一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理
一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理
一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理
bakpo1
 
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
MdTanvirMahtab2
 
Building Electrical System Design & Installation
Building Electrical System Design & InstallationBuilding Electrical System Design & Installation
Building Electrical System Design & Installation
symbo111
 
14 Template Contractual Notice - EOT Application
14 Template Contractual Notice - EOT Application14 Template Contractual Notice - EOT Application
14 Template Contractual Notice - EOT Application
SyedAbiiAzazi1
 
6th International Conference on Machine Learning & Applications (CMLA 2024)
6th International Conference on Machine Learning & Applications (CMLA 2024)6th International Conference on Machine Learning & Applications (CMLA 2024)
6th International Conference on Machine Learning & Applications (CMLA 2024)
ClaraZara1
 
DfMAy 2024 - key insights and contributions
DfMAy 2024 - key insights and contributionsDfMAy 2024 - key insights and contributions
DfMAy 2024 - key insights and contributions
gestioneergodomus
 
Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024
Massimo Talia
 

Recently uploaded (20)

Water Industry Process Automation and Control Monthly - May 2024.pdf
Water Industry Process Automation and Control Monthly - May 2024.pdfWater Industry Process Automation and Control Monthly - May 2024.pdf
Water Industry Process Automation and Control Monthly - May 2024.pdf
 
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
 
weather web application report.pdf
weather web application report.pdfweather web application report.pdf
weather web application report.pdf
 
Final project report on grocery store management system..pdf
Final project report on grocery store management system..pdfFinal project report on grocery store management system..pdf
Final project report on grocery store management system..pdf
 
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
 
MCQ Soil mechanics questions (Soil shear strength).pdf
MCQ Soil mechanics questions (Soil shear strength).pdfMCQ Soil mechanics questions (Soil shear strength).pdf
MCQ Soil mechanics questions (Soil shear strength).pdf
 
Tutorial for 16S rRNA Gene Analysis with QIIME2.pdf
Tutorial for 16S rRNA Gene Analysis with QIIME2.pdfTutorial for 16S rRNA Gene Analysis with QIIME2.pdf
Tutorial for 16S rRNA Gene Analysis with QIIME2.pdf
 
The Role of Electrical and Electronics Engineers in IOT Technology.pdf
The Role of Electrical and Electronics Engineers in IOT Technology.pdfThe Role of Electrical and Electronics Engineers in IOT Technology.pdf
The Role of Electrical and Electronics Engineers in IOT Technology.pdf
 
Water billing management system project report.pdf
Water billing management system project report.pdfWater billing management system project report.pdf
Water billing management system project report.pdf
 
Fundamentals of Induction Motor Drives.pptx
Fundamentals of Induction Motor Drives.pptxFundamentals of Induction Motor Drives.pptx
Fundamentals of Induction Motor Drives.pptx
 
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
 
CW RADAR, FMCW RADAR, FMCW ALTIMETER, AND THEIR PARAMETERS
CW RADAR, FMCW RADAR, FMCW ALTIMETER, AND THEIR PARAMETERSCW RADAR, FMCW RADAR, FMCW ALTIMETER, AND THEIR PARAMETERS
CW RADAR, FMCW RADAR, FMCW ALTIMETER, AND THEIR PARAMETERS
 
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&BDesign and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
 
一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理
一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理
一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理
 
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
 
Building Electrical System Design & Installation
Building Electrical System Design & InstallationBuilding Electrical System Design & Installation
Building Electrical System Design & Installation
 
14 Template Contractual Notice - EOT Application
14 Template Contractual Notice - EOT Application14 Template Contractual Notice - EOT Application
14 Template Contractual Notice - EOT Application
 
6th International Conference on Machine Learning & Applications (CMLA 2024)
6th International Conference on Machine Learning & Applications (CMLA 2024)6th International Conference on Machine Learning & Applications (CMLA 2024)
6th International Conference on Machine Learning & Applications (CMLA 2024)
 
DfMAy 2024 - key insights and contributions
DfMAy 2024 - key insights and contributionsDfMAy 2024 - key insights and contributions
DfMAy 2024 - key insights and contributions
 
Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024
 

Dataviz 101: Data is beautiful, please don't ruin it by Anne-Marie Tousch, Senior Research Scientist @CriteoAILab

  • 1. Anne-Marie Tousch Senior Research Scientist @amy8492 please don't ruin it! Data is beautiful Mach 12th, 2019
  • 2.
  • 3. 2 reasons to visualize data Photo by Yuri Loginov from Pexels
  • 4. 4 • I keep seeing plain tables. ❑ Do they want me to read all this? ❑ Did they copy-paste their slides from their paper? ❑ Do they care about their audience? ❑ Do they care about giving this talk? ❑ Are they hiding something? ❑ Do they realize a dataviz would be much more powerful? Most respectful interpretation?
  • 5. 5 • Efficient communication A picture tells a 1000 words. Source: Business Insider, August 2016
  • 7. 7 • never trust summary statistics alone; always visualize your data Detecting patterns http://www.thefunctionalart.com/2016/08/download-datasaurus-never-trust-summary.html
  • 9. 9 • Maxwell’s model of Saturn’s rings, 1858 Visualizing is always great, not only for data
  • 10. 10 • Visualize algorithms http://playground.tensorflow.org
  • 11. 11 • Pictures credits : Wiki Commons / the_jetboy CC2.0 / Sandor Vamos / Wiki Commons / Acute3D / Walkerssk / Pixabay / Wiki Commons / Wiki Commons Many ways to apprehend the world 7,000,000 visitors a year2,500,000 rivets 10,100 tons
  • 12. 12 • Exploiting the human visual system Ever heard of Gestalt theory?
  • 13. 13 • Count the 3s below Ready?
  • 14. 14 • Count the 3s below 756395068473 658663037576 860372658602 846589107830 Source: http://www.storytellingwithdata.com/book/downloads
  • 15. 15 • How many 3s? Source: http://www.storytellingwithdata.com/book/downloads
  • 16. 16 • Count the 3s below 756395068473 658663037576 860372658602 846589107830 Source: http://www.storytellingwithdata.com/book/downloads
  • 17. 17 • Much easier now, uh? Source: http://www.storytellingwithdata.com/book/downloads
  • 19. 19 • Define your goal Choose an effective visual Find the right focus Close the loop Explore / Explain Question? Simple is better Function first, form next Use color, size Remove clutter Do you answer your question? Do you have a story? Follow the process
  • 20. 20 • Follow best practices Think accessibility Use rules of thumbs Actively take control Be truthful
  • 21. 21 • When you want to focus the attention on just a number or two When you have a mixed audience, for information lookup To show the relationship between two things The best for continuous data over time Makes it very easy to compare categories To compare totals and also subcomponents Choose an effective, simple visual Source: http://www.storytellingwithdata.com/book/downloads
  • 22. 22 • Pie charts are evil
  • 24. 24 • There are many preattentive attributes Source: http://www.storytellingwithdata.com/book/downloads
  • 25. 25 • But two are special Colour is the most powerful tool you have. Use it sparingly and resist the urge to use colour for the sake of being colourful. Leverage colour selectively to highlight the important parts of your visual. Size matters. If you’re showing multiple things that are of roughly equal importance, size them similarly. If there is one really important thing, leverage size to indicate that: make it BIG!
  • 26. 26 • Maximise data-ink ratio, within reason. Edward Tufte, The Visual Display of Quantitative Information
  • 27. 27 • Forgo chartjunk, including moiré vibration, the grid, and the duck. Edward Tufte, The Visual Display of Quantitative Information
  • 29. 29 • Don’t let your design choices be happenstance. They should be the result of explicit decisions.
  • 30. 30 • Select good defaults
  • 32. 32 • Take the control
  • 35. 35 • You should care It’s not only about nice graphics There’s a wealth of resources Well-grounded best practices
  • 36. Further tips Highlight the important stuff Eliminate distractions Create a visual hierarchy of information Make it accessible 1 2 3 4 Only highlight 10% of the overall visual. Use preattentive attributes to do so, even together for very important stuff When detail isn’t needed, summarize. Ask yourself if eliminating this would change anything. If not, take it out. Push less impacting items to the background with light grey Organize information to guide the audience. Follow a Z-pattern from top left to bottom right. You might be an engineer, but it shouldn’t take someone with an engineering degree to understand your graph. Use simple language5 Choose simple language over complex, choose fewer words over more words, define any specialized language with which your audience may not be familiar, and spell out acronyms. Be mindful of aestethics6 Be smart with colors. Pay attention to alignment to give a sense of unity and cohesion. Leverage white space, and don’t add stuff just to fill space Always prefer simple over complex
  • 37. 37 • The Visual Display of Quantitative Information. Edward Tufte. Graphics Press, 2d edition, 2001. The classic on beautiful, faithful displays. Visualization Analysis and Design. Tamara Munzner. AK Peters / CRC Press, Oct 2014. A comprehensive textbook. Visualize this: the FlowingData guide to design, visualization, and statistics. Nathan Yau. John Wiley & Sons, 2011. For practical examples and code. The Wall Street Journal Guide to Information Graphics: The Dos and Don'ts of Presenting Data, Facts, and Figures. Dona M. Wong. W. W. Norton & Company, 2013. Storytelling with Data: A Data Visualization Guide for Business Professionals. Cole Nussbaumer Knaflic. Wiley, 2015. Books
  • 38. 38 • Tukey, John W. "The future of data analysis." The annals of mathematical statistics 33.1 (1962): 1-67. pdf Cleveland, William S., and Robert McGill. "Graphical perception: Theory, experimentation, and application to the development of graphical methods." Journal of the American statistical association 79.387 (1984): 531-554. pdf Gelman, Andrew, Cristian Pasarica, and Rahul Dodhia. "Let's practice what we preach: turning tables into graphs." The American Statistician 56.2 (2002): 121-130. pdf Gelman, Andrew, and Antony Unwin. "Infovis and statistical graphics: different goals, different looks." Journal of Computational and Graphical Statistics 22.1 (2013): 2-28. pdf Gelman, Andrew, and Thomas Basbøll. "When do stories work? Evidence and illustration in the social sciences." Sociological Methods & Research 43.4 (2014): 547-570. pdf Maaten, Laurens van der, and Geoffrey Hinton. "Visualizing data using t-SNE." Journal of machine learning research 9.Nov (2008): 2579-2605. pdf Kim, Been, Rajiv Khanna, and Oluwasanmi O. Koyejo. "Examples are not enough, learn to criticize! criticism for interpretability." Advances in Neural Information Processing Systems. 2016. pdf Wongsuphasawat, Kanit, et al. "Visualizing Dataflow Graphs of Deep Learning Models in TensorFlow." IEEE transactions on visualization and computer graphics 24.1 (2018): 1-12. pdf Research papers
  • 39. 39 • • Flowing Data • Storytelling With Data • The Functional Art • Google Brain PAIR group • colorbrewer2.org helps select colors Blogs & other resources Learn from good examples • junkcharts • vizwiz • fivethirtyeight • theguardian.com/data But also from bad ones • viz.wtf Practice with makeovermonday Interested? React on paris-wimlds.slack.com
  • 40. Questions? Thanks @Paolo Terzi (Criteo) from whom I took a bunch of slides Colocho CC BY-SA 2.5
  • 41. 41 • Rule of thumb: function first, form next