This document discusses how to transform raw data into compelling narratives through data storytelling and visualization. It begins with an introduction of the speaker and overview of topics to be covered, including why data needs design. Several examples are provided of how raw data on elections and financial inclusion can be analyzed at different levels and visualized into stories. The document emphasizes that data discovery, inclusion and building trust are important aims. It also discusses challenges in the Philippines related to scale and offers how data can help address issues of regionalism and bureaucracy.
Can you teach coding to kids in a mobile game app in local languages. Do you need to be good in English to learn coding in R or Python?
How young can we train people in coding-
something we worked on for six months but now we are giving up due to lack of funds is this idea.
Feel free to use it, it is licensed cc-by-sa
This document outlines the agenda for a two-day workshop on learning R and analytics. Day 1 will introduce R and cover data input, quality, and exploration. Day 2 will focus on data manipulation, visualization, regression models, and advanced topics. Sessions include lectures and demos in R. The goal is to help attendees learn R in 12 hours and gain an introduction to analytics skills for career opportunities.
This document provides an overview of key concepts in statistics for data science, including:
- Descriptive statistics like measures of central tendency (mean, median, mode) and variation (range, variance, standard deviation).
- Common distributions like the normal, binomial, and Poisson distributions.
- Statistical inference techniques like hypothesis testing, t-tests, and the chi-square test.
- Bayesian concepts like Bayes' theorem and how to apply it in R.
- How to use R and RCommander for exploring and visualizing data and performing statistical analyses.
Welcome to the Chief Analytics Officer Forum Europe
On 7th – 9th March 2016, over 80 Chief Analytics Officers and senior analytics leaders met in London for intimate, top-level discussions; dissecting the role of the CAO, exploring innovative case studies and addressing mutual cross-industry challenges. To learn more, visit http://www.caoforumeurope.com/
This event is organised by http://coriniumintelligence.com/
The Millennial generation will have a bigger impact on the future of media over the next five years than any other demographic group. But a new Economist Group study finds many misconceptions about this group when it comes to their attitudes, media habits and their understanding of the relationship between media and marketing.
Mapping Your Social DNA — SocialBakers Engage 2013, LondonPaul Papadimitriou
Information architecture is more than an effective website. It's the DNA of a company. A badly made website often mirrors a badly organized organization —one that doesn't often know who it is.
With introspection and by learning about your customers' behavior —what I call induced information architecture—, you can achieve true social information architecture, an holistic mapping of your organization's genome in its context.
This talk was partially inspired by Oliver Reichenstein @iA with whom I debated earlier this month in Tokyo.
Top SlideShare of the day, as featured on April 25 2013.
Can you teach coding to kids in a mobile game app in local languages. Do you need to be good in English to learn coding in R or Python?
How young can we train people in coding-
something we worked on for six months but now we are giving up due to lack of funds is this idea.
Feel free to use it, it is licensed cc-by-sa
This document outlines the agenda for a two-day workshop on learning R and analytics. Day 1 will introduce R and cover data input, quality, and exploration. Day 2 will focus on data manipulation, visualization, regression models, and advanced topics. Sessions include lectures and demos in R. The goal is to help attendees learn R in 12 hours and gain an introduction to analytics skills for career opportunities.
This document provides an overview of key concepts in statistics for data science, including:
- Descriptive statistics like measures of central tendency (mean, median, mode) and variation (range, variance, standard deviation).
- Common distributions like the normal, binomial, and Poisson distributions.
- Statistical inference techniques like hypothesis testing, t-tests, and the chi-square test.
- Bayesian concepts like Bayes' theorem and how to apply it in R.
- How to use R and RCommander for exploring and visualizing data and performing statistical analyses.
Welcome to the Chief Analytics Officer Forum Europe
On 7th – 9th March 2016, over 80 Chief Analytics Officers and senior analytics leaders met in London for intimate, top-level discussions; dissecting the role of the CAO, exploring innovative case studies and addressing mutual cross-industry challenges. To learn more, visit http://www.caoforumeurope.com/
This event is organised by http://coriniumintelligence.com/
The Millennial generation will have a bigger impact on the future of media over the next five years than any other demographic group. But a new Economist Group study finds many misconceptions about this group when it comes to their attitudes, media habits and their understanding of the relationship between media and marketing.
Mapping Your Social DNA — SocialBakers Engage 2013, LondonPaul Papadimitriou
Information architecture is more than an effective website. It's the DNA of a company. A badly made website often mirrors a badly organized organization —one that doesn't often know who it is.
With introspection and by learning about your customers' behavior —what I call induced information architecture—, you can achieve true social information architecture, an holistic mapping of your organization's genome in its context.
This talk was partially inspired by Oliver Reichenstein @iA with whom I debated earlier this month in Tokyo.
Top SlideShare of the day, as featured on April 25 2013.
Tell Your Library's Story with Infographics: Tips From an Accidental Graphic ...library_research_service
This document provides tips and guidelines for creating infographics to communicate library data and stories visually. It discusses choosing appropriate charts, simplifying designs, establishing a focal point, and putting numbers in context. Examples are provided of infographics created for libraries along with suggestions for design elements like format, fonts, and colors. Different software options for creating infographics like PowerPoint, Illustrator, Easelly and Piktochart are compared. The goal is to help libraries tell their story and impact through easy to understand visualizations.
Almost half of Christmas shoppers do some of their shopping online. Online shopping for Christmas is increasing, with 46% of shopping being done online on average in 2016. Smartphones are playing a bigger role, with over 70% of Australians owning a smartphone and 62% using their smartphone for Christmas shopping tasks like research. Retailers need to have an online and mobile-optimized presence to reach shoppers who are conducting more activities online and on their mobile devices during the holiday season.
Storyfying your Data: How to go from Data to Insights to StoriesGramener
Gramener's Director - Client success, Shravan Kumar A, delivered an online session to the students of Praxis Business School.
In his session he talked about how converting data into stories can benefit businesses and enable quick decision making. Furthermore, he shared approaches to create data stories along with some use cases and case studies we solved at Gramener to benefit our clients.
Check out our initiative to teach data storytelling to data scientists and analysts so that they can think out of the box and create wonderful data stories for their stakeholders: https://gramener.com/data-storytelling-workshop
Families, especially those with young children, really embrace the Christmas season. They start shopping and spending on gifts earlier than singles or couples. While families aim to stick to a budget, they often end up spending more than intended on presents each year. Families enjoy both in-store and online shopping for gifts and are likely to increase their online shopping for the upcoming Christmas. Retailers have an opportunity to capitalize on families' Christmas enthusiasm through targeted marketing and offers.
The Art of Storytelling Using Data ScienceGramener
Gramener's VP - Sales, APAC Region, Vijayam Sirikonda interacted with the students of IIM Raipur and talked about the importance of data storytelling for business users.
Keep it fresh - trends you can ride, ideas you should steal | Content strateg...CharityComms
Rob Mosley, creative partner and Sadia Siddiqui, client services director, Nonsense London
Visit the CharityComms website to view slides from past events, see what events we have coming up and to check out what else we do: www.charitycomms.org.uk
Your Turn: Sharing Tools and Resources for Effective Enrollment Outreach Pt. IIEnroll America
This document discusses how data is used to measure progress and inform outreach efforts for health insurance enrollment in Maryland. It analyzes geographic data on uninsured populations to identify areas with the largest numbers of remaining eligible uninsured residents. These areas are then prioritized for targeted outreach and media buys. Data on enrollments, carriers, and Google Analytics also inform outreach. The document argues that data tells a powerful story about the positive impact of the Affordable Care Act by showing enrollment increases across diverse populations and locations.
Help Sarah -Empowering people through the best possible careDigitasLBi Nordics
This document discusses how digital is disrupting industries and provides opportunities for companies. It emphasizes that while people embrace digital technologies, they still live in the real world. Effective digital strategies require using insights about people to tell relevant stories through content across multiple channels. Data and understanding people holistically across touchpoints are important to remain ready for the future.
This document discusses the data dividend deficit that retail banks face. It notes that while banks collect large amounts of customer data, they are not data-driven and fail to use data to understand customer experiences. In contrast, non-traditional competitors effectively use customer data to power their businesses. The document advocates that banks automate data collection, embrace different data types, partner with developers, and visualize insights to overcome their deficit and gain a data dividend.
This document discusses the idea of creating a company and app called PersonalHeroes that measures and tracks kindness. The app would allow people to tag and reward others for good deeds by rating them and giving virtual or real rewards. It aims to redefine heroism by showing that everyday people can be heroes through ordinary good acts and making these acts visible. The goal is to collect this kindness data to create a worldwide index and add a new layer of information to profiles, places, and organizations based on their measured levels of goodness.
Our 2016 Social Media Survival Guide provides the What, Why and How to succeed this year, with a look at the Three Core Pillars of Social Media – Data, Creative & Amplification.
A data visualisation story - top tips from the Guardian Masterclass. Creative...CharityComms
Horacio Herrera-Richmond, design manager, Anthony Nolan
Visit the CharityComms website to view slides from past events, see what events we have coming up and to check out what else we do: www.charitycomms.org.uk
Bridging the Curiosity Gap -- Lessons from the Atlantic - #SPARK15TrackMaven
This document provides lessons on building an audience in today's social media ecosystem. It discusses how audience attention is now fragmented across platforms and how content needs to be accessible, personalized, and useful. Brands must create "social things" like charts, lists, and facts that are visual and shareable. Headlines and content should be optimized to inspire sharing on social media. Once a piece gains attention, an organization should promote it widely across their owned channels and by tracking and fueling further discussion. Staking a claim on unique topic areas and transforming knowledge for digital are also discussed.
Can I Pay Someone To Write A Paper For Me Write My Paper For MeRenee Lewis
The passage discusses the New York Police Department's decision to dramatically reduce arrests for petty crimes like purse snatching in late 2014. This was in response to policy issues between the NYPD and Mayor de Blasio's office. As a result, incidents of minor crimes went unreported and unaided, as victims knew the police would not respond. While the mayor's actions warranted examination, the NYPD response had damaging consequences by failing to protect victims of petty crimes in New York City.
The document discusses the changing retail landscape and the challenges facing pureplay retailers. It finds that pureplay retailers must spend heavily on paid search to drive traffic since they lack brand awareness from physical stores. Pureplay retailers purchase more paid search keywords but pay higher costs per visitor than retailers with physical stores. While some pureplay retailers are growing rapidly in sales, many struggle with profitability due to high customer acquisition costs from their reliance on performance marketing. The document examines how retailers are adapting by adding physical storefronts or through acquisitions.
Beyond the headlines, there are several myths and realities about omnichannel retail. The myth that e-commerce is taking over physical stores is not entirely true, as over 90% of retail sales still occur in-store. While consumers love online shopping, they prefer omnichannel experiences like browsing online and purchasing in-store. Physical stores also remain profitable compared to e-commerce. Stores are not necessarily shrinking and disappearing either, as some brands expand store sizes and stores generate more profit per transaction than online. Finally, while some malls are struggling, higher-end "A" malls are doing well and the future of malls involves diversifying tenant mixes beyond traditional retailers.
This document contains details about Brian Housand's upcoming speaking tour for various gifted education associations in Fall 2020. It lists the dates and locations for his presentations, which will be either online or in-person. It also advertises his virtual conference presentations in November and December. The text promotes Brian's approach of engaging students through choice, creativity, complexity, and curiosity to increase engagement. It provides his email addresses and website for more information.
This document discusses innovations in philanthropy, including new tools and approaches that enable more effective giving and volunteering. It outlines corporate employee volunteering programs, online giving directly to beneficiaries, social fundraising platforms, and online tools for vetting and reviewing nonprofits. GreatNonprofits is highlighted as a leading platform that collects stories from those served by nonprofits to help inform donors and volunteers and promote nonprofit excellence through feedback and transparency. The organization has seen rapid growth since its founding and aims to better include those in need in conversations around humanitarian assistance.
Cashgate Scandal Malawi is our whomademyclothes campaign in April, which falls on the anniversary of the Rana Plaza factory collapse, which killed 1138 people and injured many more on 24th April 2013. That is the day Fashion Revolution was born. During this week, brands and producers are encouraged to respond with the hashtag imadeyourclothes and to demonstrate transparency in their supply chain.
Tell Your Library's Story with Infographics: Tips From an Accidental Graphic ...library_research_service
This document provides tips and guidelines for creating infographics to communicate library data and stories visually. It discusses choosing appropriate charts, simplifying designs, establishing a focal point, and putting numbers in context. Examples are provided of infographics created for libraries along with suggestions for design elements like format, fonts, and colors. Different software options for creating infographics like PowerPoint, Illustrator, Easelly and Piktochart are compared. The goal is to help libraries tell their story and impact through easy to understand visualizations.
Almost half of Christmas shoppers do some of their shopping online. Online shopping for Christmas is increasing, with 46% of shopping being done online on average in 2016. Smartphones are playing a bigger role, with over 70% of Australians owning a smartphone and 62% using their smartphone for Christmas shopping tasks like research. Retailers need to have an online and mobile-optimized presence to reach shoppers who are conducting more activities online and on their mobile devices during the holiday season.
Storyfying your Data: How to go from Data to Insights to StoriesGramener
Gramener's Director - Client success, Shravan Kumar A, delivered an online session to the students of Praxis Business School.
In his session he talked about how converting data into stories can benefit businesses and enable quick decision making. Furthermore, he shared approaches to create data stories along with some use cases and case studies we solved at Gramener to benefit our clients.
Check out our initiative to teach data storytelling to data scientists and analysts so that they can think out of the box and create wonderful data stories for their stakeholders: https://gramener.com/data-storytelling-workshop
Families, especially those with young children, really embrace the Christmas season. They start shopping and spending on gifts earlier than singles or couples. While families aim to stick to a budget, they often end up spending more than intended on presents each year. Families enjoy both in-store and online shopping for gifts and are likely to increase their online shopping for the upcoming Christmas. Retailers have an opportunity to capitalize on families' Christmas enthusiasm through targeted marketing and offers.
The Art of Storytelling Using Data ScienceGramener
Gramener's VP - Sales, APAC Region, Vijayam Sirikonda interacted with the students of IIM Raipur and talked about the importance of data storytelling for business users.
Keep it fresh - trends you can ride, ideas you should steal | Content strateg...CharityComms
Rob Mosley, creative partner and Sadia Siddiqui, client services director, Nonsense London
Visit the CharityComms website to view slides from past events, see what events we have coming up and to check out what else we do: www.charitycomms.org.uk
Your Turn: Sharing Tools and Resources for Effective Enrollment Outreach Pt. IIEnroll America
This document discusses how data is used to measure progress and inform outreach efforts for health insurance enrollment in Maryland. It analyzes geographic data on uninsured populations to identify areas with the largest numbers of remaining eligible uninsured residents. These areas are then prioritized for targeted outreach and media buys. Data on enrollments, carriers, and Google Analytics also inform outreach. The document argues that data tells a powerful story about the positive impact of the Affordable Care Act by showing enrollment increases across diverse populations and locations.
Help Sarah -Empowering people through the best possible careDigitasLBi Nordics
This document discusses how digital is disrupting industries and provides opportunities for companies. It emphasizes that while people embrace digital technologies, they still live in the real world. Effective digital strategies require using insights about people to tell relevant stories through content across multiple channels. Data and understanding people holistically across touchpoints are important to remain ready for the future.
This document discusses the data dividend deficit that retail banks face. It notes that while banks collect large amounts of customer data, they are not data-driven and fail to use data to understand customer experiences. In contrast, non-traditional competitors effectively use customer data to power their businesses. The document advocates that banks automate data collection, embrace different data types, partner with developers, and visualize insights to overcome their deficit and gain a data dividend.
This document discusses the idea of creating a company and app called PersonalHeroes that measures and tracks kindness. The app would allow people to tag and reward others for good deeds by rating them and giving virtual or real rewards. It aims to redefine heroism by showing that everyday people can be heroes through ordinary good acts and making these acts visible. The goal is to collect this kindness data to create a worldwide index and add a new layer of information to profiles, places, and organizations based on their measured levels of goodness.
Our 2016 Social Media Survival Guide provides the What, Why and How to succeed this year, with a look at the Three Core Pillars of Social Media – Data, Creative & Amplification.
A data visualisation story - top tips from the Guardian Masterclass. Creative...CharityComms
Horacio Herrera-Richmond, design manager, Anthony Nolan
Visit the CharityComms website to view slides from past events, see what events we have coming up and to check out what else we do: www.charitycomms.org.uk
Bridging the Curiosity Gap -- Lessons from the Atlantic - #SPARK15TrackMaven
This document provides lessons on building an audience in today's social media ecosystem. It discusses how audience attention is now fragmented across platforms and how content needs to be accessible, personalized, and useful. Brands must create "social things" like charts, lists, and facts that are visual and shareable. Headlines and content should be optimized to inspire sharing on social media. Once a piece gains attention, an organization should promote it widely across their owned channels and by tracking and fueling further discussion. Staking a claim on unique topic areas and transforming knowledge for digital are also discussed.
Can I Pay Someone To Write A Paper For Me Write My Paper For MeRenee Lewis
The passage discusses the New York Police Department's decision to dramatically reduce arrests for petty crimes like purse snatching in late 2014. This was in response to policy issues between the NYPD and Mayor de Blasio's office. As a result, incidents of minor crimes went unreported and unaided, as victims knew the police would not respond. While the mayor's actions warranted examination, the NYPD response had damaging consequences by failing to protect victims of petty crimes in New York City.
The document discusses the changing retail landscape and the challenges facing pureplay retailers. It finds that pureplay retailers must spend heavily on paid search to drive traffic since they lack brand awareness from physical stores. Pureplay retailers purchase more paid search keywords but pay higher costs per visitor than retailers with physical stores. While some pureplay retailers are growing rapidly in sales, many struggle with profitability due to high customer acquisition costs from their reliance on performance marketing. The document examines how retailers are adapting by adding physical storefronts or through acquisitions.
Beyond the headlines, there are several myths and realities about omnichannel retail. The myth that e-commerce is taking over physical stores is not entirely true, as over 90% of retail sales still occur in-store. While consumers love online shopping, they prefer omnichannel experiences like browsing online and purchasing in-store. Physical stores also remain profitable compared to e-commerce. Stores are not necessarily shrinking and disappearing either, as some brands expand store sizes and stores generate more profit per transaction than online. Finally, while some malls are struggling, higher-end "A" malls are doing well and the future of malls involves diversifying tenant mixes beyond traditional retailers.
This document contains details about Brian Housand's upcoming speaking tour for various gifted education associations in Fall 2020. It lists the dates and locations for his presentations, which will be either online or in-person. It also advertises his virtual conference presentations in November and December. The text promotes Brian's approach of engaging students through choice, creativity, complexity, and curiosity to increase engagement. It provides his email addresses and website for more information.
This document discusses innovations in philanthropy, including new tools and approaches that enable more effective giving and volunteering. It outlines corporate employee volunteering programs, online giving directly to beneficiaries, social fundraising platforms, and online tools for vetting and reviewing nonprofits. GreatNonprofits is highlighted as a leading platform that collects stories from those served by nonprofits to help inform donors and volunteers and promote nonprofit excellence through feedback and transparency. The organization has seen rapid growth since its founding and aims to better include those in need in conversations around humanitarian assistance.
Cashgate Scandal Malawi is our whomademyclothes campaign in April, which falls on the anniversary of the Rana Plaza factory collapse, which killed 1138 people and injured many more on 24th April 2013. That is the day Fashion Revolution was born. During this week, brands and producers are encouraged to respond with the hashtag imadeyourclothes and to demonstrate transparency in their supply chain.
Similar to WIAD 2016 Talk - A Thousand Stories (20)
Build applications with generative AI on Google CloudMárton Kodok
We will explore Vertex AI - Model Garden powered experiences, we are going to learn more about the integration of these generative AI APIs. We are going to see in action what the Gemini family of generative models are for developers to build and deploy AI-driven applications. Vertex AI includes a suite of foundation models, these are referred to as the PaLM and Gemini family of generative ai models, and they come in different versions. We are going to cover how to use via API to: - execute prompts in text and chat - cover multimodal use cases with image prompts. - finetune and distill to improve knowledge domains - run function calls with foundation models to optimize them for specific tasks. At the end of the session, developers will understand how to innovate with generative AI and develop apps using the generative ai industry trends.
The Ipsos - AI - Monitor 2024 Report.pdfSocial Samosa
According to Ipsos AI Monitor's 2024 report, 65% Indians said that products and services using AI have profoundly changed their daily life in the past 3-5 years.
End-to-end pipeline agility - Berlin Buzzwords 2024Lars Albertsson
We describe how we achieve high change agility in data engineering by eliminating the fear of breaking downstream data pipelines through end-to-end pipeline testing, and by using schema metaprogramming to safely eliminate boilerplate involved in changes that affect whole pipelines.
A quick poll on agility in changing pipelines from end to end indicated a huge span in capabilities. For the question "How long time does it take for all downstream pipelines to be adapted to an upstream change," the median response was 6 months, but some respondents could do it in less than a day. When quantitative data engineering differences between the best and worst are measured, the span is often 100x-1000x, sometimes even more.
A long time ago, we suffered at Spotify from fear of changing pipelines due to not knowing what the impact might be downstream. We made plans for a technical solution to test pipelines end-to-end to mitigate that fear, but the effort failed for cultural reasons. We eventually solved this challenge, but in a different context. In this presentation we will describe how we test full pipelines effectively by manipulating workflow orchestration, which enables us to make changes in pipelines without fear of breaking downstream.
Making schema changes that affect many jobs also involves a lot of toil and boilerplate. Using schema-on-read mitigates some of it, but has drawbacks since it makes it more difficult to detect errors early. We will describe how we have rejected this tradeoff by applying schema metaprogramming, eliminating boilerplate but keeping the protection of static typing, thereby further improving agility to quickly modify data pipelines without fear.
Codeless Generative AI Pipelines
(GenAI with Milvus)
https://ml.dssconf.pl/user.html#!/lecture/DSSML24-041a/rate
Discover the potential of real-time streaming in the context of GenAI as we delve into the intricacies of Apache NiFi and its capabilities. Learn how this tool can significantly simplify the data engineering workflow for GenAI applications, allowing you to focus on the creative aspects rather than the technical complexities. I will guide you through practical examples and use cases, showing the impact of automation on prompt building. From data ingestion to transformation and delivery, witness how Apache NiFi streamlines the entire pipeline, ensuring a smooth and hassle-free experience.
Timothy Spann
https://www.youtube.com/@FLaNK-Stack
https://medium.com/@tspann
https://www.datainmotion.dev/
milvus, unstructured data, vector database, zilliz, cloud, vectors, python, deep learning, generative ai, genai, nifi, kafka, flink, streaming, iot, edge
Open Source Contributions to Postgres: The Basics POSETTE 2024ElizabethGarrettChri
Postgres is the most advanced open-source database in the world and it's supported by a community, not a single company. So how does this work? How does code actually get into Postgres? I recently had a patch submitted and committed and I want to share what I learned in that process. I’ll give you an overview of Postgres versions and how the underlying project codebase functions. I’ll also show you the process for submitting a patch and getting that tested and committed.
We are pleased to share with you the latest VCOSA statistical report on the cotton and yarn industry for the month of March 2024.
Starting from January 2024, the full weekly and monthly reports will only be available for free to VCOSA members. To access the complete weekly report with figures, charts, and detailed analysis of the cotton fiber market in the past week, interested parties are kindly requested to contact VCOSA to subscribe to the newsletter.
Orchestrating the Future: Navigating Today's Data Workflow Challenges with Ai...Kaxil Naik
Navigating today's data landscape isn't just about managing workflows; it's about strategically propelling your business forward. Apache Airflow has stood out as the benchmark in this arena, driving data orchestration forward since its early days. As we dive into the complexities of our current data-rich environment, where the sheer volume of information and its timely, accurate processing are crucial for AI and ML applications, the role of Airflow has never been more critical.
In my journey as the Senior Engineering Director and a pivotal member of Apache Airflow's Project Management Committee (PMC), I've witnessed Airflow transform data handling, making agility and insight the norm in an ever-evolving digital space. At Astronomer, our collaboration with leading AI & ML teams worldwide has not only tested but also proven Airflow's mettle in delivering data reliably and efficiently—data that now powers not just insights but core business functions.
This session is a deep dive into the essence of Airflow's success. We'll trace its evolution from a budding project to the backbone of data orchestration it is today, constantly adapting to meet the next wave of data challenges, including those brought on by Generative AI. It's this forward-thinking adaptability that keeps Airflow at the forefront of innovation, ready for whatever comes next.
The ever-growing demands of AI and ML applications have ushered in an era where sophisticated data management isn't a luxury—it's a necessity. Airflow's innate flexibility and scalability are what makes it indispensable in managing the intricate workflows of today, especially those involving Large Language Models (LLMs).
This talk isn't just a rundown of Airflow's features; it's about harnessing these capabilities to turn your data workflows into a strategic asset. Together, we'll explore how Airflow remains at the cutting edge of data orchestration, ensuring your organization is not just keeping pace but setting the pace in a data-driven future.
Session in https://budapestdata.hu/2024/04/kaxil-naik-astronomer-io/ | https://dataml24.sessionize.com/session/667627
1. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
MANILA
2. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
A THOUSAND STORIES
HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
3. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
ABOUT ME
TROY JAMES PALANCA
Data Blogger Jumbo Dumbo Thoughts
City Operations Uber
Past:
4. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
WHAT THIS TALK WILL BE ABOUT
• Why data needs design and designers
• How data shapes policy and business goals differently
• Data storytelling and visualization
• Why the country needs you to “do” data
5. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
ON DATA
6. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
This was my undergraduate
thesis. I was very proud of it.
But then I realized, no one, even
one of my thesis advisers, was
reading it.
This was not their fault.
People are not obliged to read
your work - no matter how
“brilliant” you think it is.
WHY VISUALIZE?
7. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
ON DATA
It’s easy to think about
data as just numbers
on a spreadsheet.
8. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
ON DATA
“It’s not just a bucket of
numbers. There are
stories in that bucket.
There’s meaning, truth,
and beauty.”
Nathan Yau, Visualize This
9. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
ON DATA SCHOOLS DATASET
Each row is a
story
Each column defines
elements of that story
What is this school called?
How far do the students
have to travel to get to
school?
How many students have lost their
opportunities at education in the
last year?
10. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
ON DATA A single story on Culiat Elementary
School in Quezon City
ADD CONTEXT
How bad is Culiat in relation to its peers?
EXPAND THE SCOPE
How about the entire school system?
FIND (POSSIBLE) CAUSE
Why are Metro Manila schools so overcrowded?
11. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
ON DATA
A picture is
worth a
thousand
words
(literally)
12. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
ON DATA
A tweet can say a lot about how a business is run
13. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
ON DATA
But how about
thousands of
tweets?
14. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
WHY DATA
DISCOVERY INCLUSIVENESS TRUST
15. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
WHY DATA
DISCOVERY INCLUSIVENESS TRUST
Comparing votes for winning
candidate and voter turnout for
the 2004 elections results in a
surprising discovery
16. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
WHY DATA
DISCOVERY INCLUSIVENESS TRUST
While we worry about
capacity issues in the
capital, schools are
emptying out in
Mindanao
17. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
WHY DATA
DISCOVERY INCLUSIVENESS TRUST
Showing more data builds
trust in your arguments
18. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
SPEAKING WITH DATA
19. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
DATA
STORYTELLIN
G
1 Define the leading role (the row)
2 Define the elements of your story (the column)
3 Collect the data
4 Tell the story
5 Visualize the story
20. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
TELLING AND VISUALIZING THE STORYANALYSIS
DESCRIPTIVE
Information that is
processed in some way to
show a specific subset of
data
EXPLORATORY
Display or description of all
factual information available
INFERENTIAL / PREDICTIVE
Conclusions about a greater truth arrived at
through computation or analysis of the data
MEDIUM
Interactive visualizations
Dashboards
Charts, graphs, plots
Dashboards
Reports
Statistical models
Predictions
Journal articles
LESS CONTROL
HIGHER TRUST
MORE CONTROL
LESS TRUST
21. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
WHY VISUALIZE?
1. VISUALIZATION
BUILDS TRUST AS
VIEWERS SEE THE
LOGICAL
PROCESS
UNFOLD
22. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
WHY VISUALIZE?
2. VISUALIZATION KEEPS
THE ABSTRACTION TO A
MINIMUM
23. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
WHY VISUALIZE?
3. VISUALIZATION
FACILITATES
INFORMATION
INGESTION
24. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
THE GRAMMAR OF GRAPHICS
COORDINATE SYSTEMS GEOMETRIES AESTHETICS+ +
The canvas The paintbrushes The colors
Cartesian
Coordinates
Polar
Coordinates
Map
Coordinates
Points
Columns/
Bars
Lines/Arcs/
Paths
Color
Size
Width
Shape
Position on the
coordinates
25. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
THE GRAMMAR OF GRAPHICS
1 dimensional coordinate
plane
Arcs and Text Labels
Arc Width = Passenger Volume
Arc Color = Direction
Text Label = MRT Station
+
+
26. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
THE GRAMMAR OF GRAPHICS
Paired cartesian coordinate
planes
Bars, text labels, animation
Bar height = number of people
Bar position = age bracket
Bar color = gender
Movement = time
+
+
27. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
THE GRAMMAR OF GRAPHICS
1 Each aesthetic must map to a data value
(no hanging aesthetics, coloring for the heck of it)
2 Approximate reality as close as possible
(use a map for coordinate data, lines for walking paths, points for locations)
3
Information density <> Information volume
(Density is good because it builds trust in the data without adding complexity,
volume is bad because it doesn’t add value and just clutters informations)
28. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
SOME EXAMPLES
29. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
RAW DATA: ELECTIONS DATA
Rows: Each city/
municipality’s voting
relationship with a
particular candidate
Columns: What
municipality voted
for which candidate
for what position
and by how many
votes?
30. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
EXPLORATORY ANALYSIS
Story Visualization
Jejomar Binay won
179,375 votes in Makati
as Vice Presidential
Candidate in 2010.
31. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
DESCRIPTIVE ANALYSIS
Story
Visualization
It seems that Joseph Estrada was well liked in
parts of the country, but not at all popular in others,
causing a high variance in his vote percentage.
32. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
INFERENTIAL ANALYSIS
Story Visualization
Voters were most
divided between
Aquino, Estrada, Villar,
and Teodoro.
33. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
RAW DATA: WB FINANCIAL INCLUSION SURVEY
Rows: A household
Columns: What are
their demographics
and the financial
products they use?
34. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
EXPLORATORY ANALYSIS
Story
23.6% of Filipino
households have an
account at a financial
institution
35. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
DESCRIPTIVE ANALYSIS
Story
Having a formal bank
account is negatively
correlated with taking loans
from families and friends
INFERENTIAL ANALYSIS
Story
There is a strong divide
between the formal and
informal sectors
36. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
PREDICTIVE ANALYSIS
Story
Households with low
income and education
levels are most likely
to be Mattress Savers
or Community
Borrowers.
37. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
HARNESSING THE
COLLECTIVE WITH DATA
38. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
Filipinos have a problem with scale.
39. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
THE WINDOW
An alternative
explanation to ‘ningas
cogon’
Most organizations do very well
when they are small
Once organizations begin to
reach a ‘critical mass’ -
dysfunction starts to set in
Idea-generating intuition must
now take the backseat to
critical/analytical thought
Look at my dad’s rad bike.
40. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
Singapore
Malaysia
Indonesia
Thailand
Vietnam
Philippines
Little Kingdoms
Source: Annual Reports, Philippine Stock Exchange
Some of the largest ASEAN banks
41. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
Regionalism
Resistance
to change
Bureaucracy and
unnecessary
process
Patronage
politics
Corruption
“Little
kingdoms”
42. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
DATA
PROVIDES THE
CUSTOMS
VISUALIZATION
DASHBOARD
43. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
Information architecture, as applied to data, is
key to informing decision-making.
Designing the display of data is a distinct skill
from data analysis.
We need more people who know how to
communicate data than analyze it.
44. 01
WORLD IA DAY 2016 A THOUSAND STORES: HOW TO GET FROM RAW DATA TO A COMPELLING NARRATIVE
THANK YOU!
QUESTIONS?
PLEASE CONTACT:
TROY JAMES PALANCA
BLOGGER AT JUMBO DUMBO THOUGHTS, CITY OPS AT UBER
TJPALANCA@ME.COM | @TJPALANCA | TJPALANCA.COM