Creating Usable Data

•

0 likes•1,167 views

The Access Initiative

Technology Education

Creating Usable Data
Usable Data and “Actionable” Information
Jonathan Callahan
Mazama Science
MAZAMA SCIENCE
Data – Information – Knowledge

STRIPE Regional Meeting -- Apr 29 - May 01, 2013Mazama Science 2
From Data to Decision
Data
“Actionable” InformationKnowledge
Information

STRIPE Regional Meeting -- Apr 29 - May 01, 2013Mazama Science 3
Data – Information – Knowledge pathway
Graphic concept from nathan.com

STRIPE Regional Meeting -- Apr 29 - May 01, 2013Mazama Science 4Mazama Science 4
From Theory to Practice.

“Data – Information – Knowledge” is the theory.

Data files and software is the practice.

How do data managers start creating “Usable Data”?

How does this lead to “Actionable Information”?

STRIPE Regional Meeting -- Apr 29 - May 01, 2013Mazama Science 5Mazama Science 5
For Usable Data – Identify Your Users!

Do you want to support analysts?
(data only)

Do you want to support authors?
(data summaries and charts)

Do you want to engage local citizens?
(maps and local information)

Do you want to support decision makers?
(integrated stories)

STRIPE Regional Meeting -- Apr 29 - May 01, 2013Mazama Science 6
Support Analysts with Data.

Analysts want raw data.

They want easy access.

They know how to work with
data.

They have their own tools.

Give them big CSV files.

STRIPE Regional Meeting -- Apr 29 - May 01, 2013Mazama Science 7
Support Authors with Tables and Charts.

Authors want data summaries.

They want to tell stories.

They don't have great data
skills.

They will publish on the web.

Give them summary tables
and good data graphics.
(.png)

STRIPE Regional Meeting -- Apr 29 - May 01, 2013Mazama Science 8
Engage Citizens with Maps & Local Info.

Citizens want to know what is
going on near them.

They want maps.

They want simple explanations.

They will influence decision
makers.

Give them web pages with
text, maps and charts.

STRIPE Regional Meeting -- Apr 29 - May 01, 2013Mazama Science 9
Support Decision Makers with Stories.

Decision Makers want
“Actionable Information”.

They want integrated stories.

They don't have expert
knowledge.

They need well informed citizens
to back them up.

Give them compelling stories.

STRIPE Regional Meeting -- Apr 29 - May 01, 2013Mazama Science 10Mazama Science 10
Keep It Simple – Data and Charts

Data

ASCII CSV files on a web site

Text files (.txt, .pdf) with metadata describing the data

Data summaries and charts

Summarize important results in tables.

Study other sites for excellent chart examples.

Are your charts easy to understand?

Do they tell a story?

Are they beautiful?

Provide charts that can be copied. (.png)

Build a simple web presentation with html and javascript.

STRIPE Regional Meeting -- Apr 29 - May 01, 2013Mazama Science 11Mazama Science 11
Keep It Simple – Maps and Stories

Maps

Don't require the use of interactive maps.

Provide static versions of maps. (.png)

Provide KML files.

Integrated Stories

Tell compelling stories!

Who are the actors?

What is at stake?

What do we know?

Use web pages to integrate information.

Have “data consumers” write the stories.

STRIPE Regional Meeting -- Apr 29 - May 01, 2013Mazama Science 12
Examples of an 'engaged public'.

STRIPE Regional Meeting -- Apr 29 - May 01, 2013Mazama Science 13
End of Presentation

STRIPE Regional Meeting -- Apr 29 - May 01, 2013Mazama Science 14
Number Crunchers
Pattern Recognizers
& Story Tellers
The story behind this presentation.

Mazama Science 15STRIPE Regional Meeting -- Apr 29 - May 01, 2013
Number Crunchers

Fast

Accurate

Consistent

> 50 years of evolution
Very good at what they do!

Mazama Science 16STRIPE Regional Meeting -- Apr 29 - May 01, 2013
Pattern Recognizers

Fast!

Accurate ~

Creative!!

> 50K years of evolution
Awesome at what we do!

Mazama Science 17STRIPE Regional Meeting -- Apr 29 - May 01, 2013
Pattern Recognition
Humans are better than
computers are recognizing
patterns.

Mazama Science 18STRIPE Regional Meeting -- Apr 29 - May 01, 2013
Pattern Recognition
Sensors can generate and
computers can process
millions of measurements.
When presented visually,
humans recognize patterns
instantly.

Mazama Science 19STRIPE Regional Meeting -- Apr 29 - May 01, 2013
Pattern Recognition
• Humans communicate by telling stories.
• Familiar pictures help us tell those stories.

Mazama Science 20STRIPE Regional Meeting -- Apr 29 - May 01, 2013
Pattern Recognition
When we want to tell stories
with data we use graphics.
Including visualizations that
map onto the real world.
And charts that are
completely abstract.
Telling stories with data requires data visualization.

Similar to Creating Usable Data

D92-198gstindspdx

Data Science

Make Data Speak

Deck 92-146 (3)

The 4 th industrial revoulation data ver1.0

Prasanth Madom

Slides from the Pivotal Open Source Hub Meetup "Data Science as a Commodity: Use MADlib, R, & other OSS Tools for Data Science!" As the need for data science as a key differentiator grows in all industries, from large corporations to startups, the need to get to results quickly is enabled by sharing ideas and methods in the community. The data science team at Pivotal leverages and contributes to this community of publicly available and open source technologies as part of their practice. We will share the resources we use by highlighting specific toolkits for building models (e.g. MADlib, R) and visualization (e.g. Gephi and Circos) along with their benefits and limitations by sharing examples from Pivotal's data science engagements. At the end of this session we hope to have answered the questions: Where can I get started with Data Science? Which toolkit is most appropriate for building a model with my dataset? How can I visualize my results to have the greatest impact? Bio: Sarah Aerni is a member of the Pivotal Data Science team with a focus on healthcare and life science. She has a background in the field of Bioinformatics, developing tools to help biomedical researchers understand their data. She holds a B.S. In Biology with a specialization in Bioinformatics and minor in French Literature from UCSD, and an M.S. and Ph.D in Biomedical Informatics from Stanford University. During her time as a researcher she focused on the interface between machine learning and biology, building computational models enabling research for a broad range of fields in biomedicine. She also co-founded a start-up providing informatics services to researchers and small companies. At Pivotal she works with customers in life science and healthcare building models to derive insight and business value from their data.

Data Science as a Commodity: Use MADlib, R, & other OSS Tools for Data Scienc...

Sarah Aerni

Data Science Crash course

Mohamed Essam

Startds9.19.17sd

Thinkful

Data sci sd-11.6.17

Thinkful

Data fluency for the 21st century

MartinFrigaard

Designing Effective Search and Discovery Experiences for the Enterprise, Using the Language of Discovery The oncoming tidal wave of Big Data, with its rapidly evolving ecosystem of multi-channel information saturated environments and services, brings profound challenges and opportunities for the design of effective user experiences that UX practitioners are just beginning to engage with in a meaningful fashion. In this coming Age of Insight, 'discovery' is not only the purview of specialized Data Scientists who create exotic visualizations of massive data sets, it is a fundamental category of human activity that is essential to everyday interactions between people, resources, and environments. Search is the gateway to discovery, and thus is indispensable as a capability. To provide architects and designers with an effective starting point for creating satisfying search and discovery experiences this session presents a simple analytical and generative vocabulary for understanding how people conduct the broad range of discovery activities necessary in the information-permeated enterprise, and defining the search experiences they need. Specifically, this session will present: A simple, research-derived language for describing search and discovery needs and activities that spans domains, environments, media, and user types Observed and reusable patterns of discovery activities in individual and collaborative settings A practical model that defines actionable patterns of information engagement throughout the enterprise Examples of the architecture of successful discovery experiences at small and large scales A vocabulary and perspective for discovery as a critical individual and organizational capability Guidance on using this vocabulary to drive large scale IT portfolio management as well as the design of individual search solutions

Big Data Is Not the Insight: The Language Of Discovery:

Joe Lamantia

Getting started in ds (july 17) atlanta

Thinkful

Big data

Abhishek Palo

Big data

Abhishek Palo

Knowledge work adds value to raw data; how this activity is performed is critical for how reliably results can be reproduced and scrutinized. With a brief diversion into epistemology, the presentation will outline the challenges for practitioners and consumers of Big Data analysis, and demonstrate how these were tackled at Inforsense (life sciences workflow analytics platform) and Musicmetric (social media analytics for music). The talk covers the following issues with concrete examples: - Representations of provenance - Considerations to allow analysis computation to be recreated - Reliable collection of noisy data from the internet - Archiving of data and accommodating retrospective changes - Using linked data to direct Big Data analytics

Data Science Provenance: From Drug Discovery to Fake Fans

Jameel Syed

As the shortage of trained data scientists threatens to prevent firms from reaching their analytical potential, a new class of products and services is emerging that promises to relieve the stress on enterprise management. These new tools are making it easier for “citizen data scientists” to create and use models based on their understanding of the business logic and their data, rather than data science fundamentals. This webinar will present an overview of the new tool landscape and highlight features, benefits, and potential pitfalls for naive adopters. Will they eliminate the need for Data Scientists? Not yet, but they may be just what your firm needs now.

The Disappearing Data Scientist

DATAVERSITY

#ABUG14 intro

Maarten Cautreels

Thinkful - Intro to Data Science - Washington DC

TJ Stalcup

Odsc machine-learning-guide-v1

Harsh Khatke

IIPGH Webinar 1: Getting Started With Data Science

ds4good

Similar to Creating Usable Data (20)

D92-198gstindspdx

Data Science

Make Data Speak

Deck 92-146 (3)

The 4 th industrial revoulation data ver1.0

Data Science as a Commodity: Use MADlib, R, & other OSS Tools for Data Scienc...

Data Science Crash course

Startds9.19.17sd

Data sci sd-11.6.17

Data fluency for the 21st century

Big Data Is Not the Insight: The Language Of Discovery:

Getting started in ds (july 17) atlanta

Big data

Data Science Provenance: From Drug Discovery to Fake Fans

The Disappearing Data Scientist

#ABUG14 intro

Thinkful - Intro to Data Science - Washington DC

Odsc machine-learning-guide-v1

IIPGH Webinar 1: Getting Started With Data Science

Recently uploaded

Dubai, often portrayed as a shimmering oasis in the desert, faces its own set of challenges, including the occasional threat of flooding. Despite its reputation for opulence and modernity, the emirate is not immune to the forces of nature. In recent years, Dubai has experienced sporadic but significant floods, testing the resilience of its infrastructure and communities. Among the critical lifelines in this bustling metropolis is the Dubai International Airport, a bustling hub that connects the city to the world. This article explores the intersection of Dubai flood events and the resilience demonstrated by the Dubai International Airport in the face of such challenges.

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

Orbitshub

Key topics covered: - Understanding the basics of IAM and its significance in the modern enterprise. IAM in a platformless environment - Tackling real-world issues like prioritizing frictionless yet secure user access, securing high-value APIs, integrating to business, compliance, and adapting to cloud native environments with scalable solutions - Practical demonstrations of how WSO2 products can be instrumental in deploying efficient IAM solutions - Preparing for upcoming trends and innovations in identity management

Navigating Identity and Access Management in the Modern Enterprise

WSO2

Architecting Cloud Native Applications

WSO2

Understanding the FAA Part 107 License ..

Christopher Logan Kennedy

How to Check CNIC Information Online with Pakdata cf

danishmna97

The presentation was made in “Web3 Fusion: Embracing AI and Beyond” is more than a conference; it's a journey into the heart of digital transformation. The conference a provided a platform where the future of technology meets practical application. This three-day hybrid event, set in the heart of innovation, served as a gateway to the latest trends and transformative discussions in AI, Blockchain, IoT, AR/VR, and their collective impact on the information space.

AI in Action: Real World Use Cases by Anitaraj

AnitaRaj43

Corporate and higher education. Two industries that, in the past, have had a clear divide with very little crossover. The difference in goals, learning styles and objectives paved the way for differing learning technologies platforms to evolve. Now, those stark lines are blurring as both sides are discovering they have content that’s relevant to the other. Join Tammy Rutherford as she walks through the pros and cons of corporate and higher ed collaborating. And the challenges of these different technology platforms working together for a brighter future.

Corporate and higher education May webinar.pptx

Rustici Software

Explore the latest trends and insights on JavaScript usage with Pixlogix's informative blog. Discover key statistics and facts about JavaScript's role in web development, its popularity among developers, and its impact on modern websites. Stay updated with the evolving landscape of JavaScript frameworks and libraries, and learn how they're shaping the future of web development. Gain valuable insights to enhance your JavaScript skills and stay ahead in the digital realm.

JavaScript Usage Statistics 2024 - The Ultimate Guide

Pixlogix Infotech

Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows. We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases. This video focuses on the deployment of external web forms using Jotform for Bonterra Impact Management. This solution can be customized to your organization’s needs and deployed to support the common use cases below: - Intake and consent - Assessments - Surveys - Applications - Program registration Interested in deploying web form automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Jeffrey Haguewood

Elevate Developer Efficiency & build GenAI Application with Amazon Q

Bhuvaneswari Subramani

[BuildWithAI] Introduction to Gemini.pdf

Sandro Moreira

Six Myths about Ontologies: The Basics of Formal Ontology

johnbeverley2021

Dubai, known for its towering skyscrapers, luxurious lifestyle, and relentless pursuit of innovation, often finds itself in the global spotlight. However, amidst the glitz and glamour, the emirate faces its own set of challenges, including the occasional threat of flooding. In recent years, Dubai has experienced sporadic but significant floods, disrupting normalcy and posing unique challenges to its infrastructure. Among the critical nodes in this bustling metropolis is the Dubai International Airport, a vital hub connecting the world. This article delves into the intersection of Dubai flood events and the resilience demonstrated by the Dubai International Airport in the face of such challenges.

Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf

Orbitshub

Following the popularity of “Cloud Revolution: Exploring the New Wave of Serverless Spatial Data,” we’re thrilled to announce this much-anticipated encore webinar. In this sequel, we’ll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you’re building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Safe Software

AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)

Samir Dash

In the ever-evolving landscape of data management, Zero-ETL is an approach that is reshaping how businesses handle and integrate their data. This webinar explores Zero-ETL, a paradigm shift from the traditional Extract, Transform, Load (ETL) process, offering a more streamlined, efficient, and real-time data integration method. We will begin with an introduction to the concept of Zero-ETL, including how it allows direct access to data in its native environment and real-time data transformation, providing up-to-date information with significantly reduced data redundancy. Next, we'll take you through several demonstrations showing how Zero-ETL can deliver real-time data and enable the free movement of data between systems. We will also discuss the various tools that support all aspects of Zero-ETL, providing attendees with an understanding of how they can adopt this innovative approach in their organizations. Lastly, the session will conclude with an interactive Q&A segment, allowing participants to gain deeper insights into how Zero-ETL can be tailored to their specific business needs and how they can get started today. Join us to discover how Zero-ETL can elevate your organization's data strategy.

The Zero-ETL Approach: Enhancing Data Agility and Insight

Safe Software

CNIC Information System with Pakdata Cf In Pakistan

danishmna97

Exploring Multimodal Embeddings with Milvus

Zilliz

Design and Development of a Provenance Capture Platform for Data Science

Paolo Missier

Tracing the root cause of a performance issue requires a lot of patience, experience, and focus. It’s so hard that we sometimes attempt to guess by trying out tentative fixes, but that usually results in frustration, messy code, and a considerable waste of time and money. This talk explains how to correctly zoom in on a performance bottleneck using three levels of profiling: distributed tracing, metrics, and method profiling. After we learn to read the JVM profiler output as a flame graph, we explore a series of bottlenecks typical for backend systems, like connection/thread pool starvation, invisible aspects, blocking code, hot CPU methods, lock contention, and Virtual Thread pinning, and we learn to trace them even if they occur in library code you are not familiar with. Attend this talk and prepare for the performance issues that will eventually hit any successful system. About authorWith two decades of experience, Victor is a Java Champion working as a trainer for top companies in Europe. Five thousands developers in 120 companies attended his workshops, so he gets to debate every week the challenges that various projects struggle with. In return, Victor summarizes key points from these workshops in conference talks and online meetups for the European Software Crafters, the world’s largest developer community around architecture, refactoring, and testing. Discover how Victor can help you on victorrentea.ro : company training catalog, consultancy and YouTube playlists.

Finding Java's Hidden Performance Traps @ DevoxxUK 2024

Victor Rentea

Recently uploaded (20)

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

Navigating Identity and Access Management in the Modern Enterprise

Architecting Cloud Native Applications

Understanding the FAA Part 107 License ..

How to Check CNIC Information Online with Pakdata cf

AI in Action: Real World Use Cases by Anitaraj

Corporate and higher education May webinar.pptx

JavaScript Usage Statistics 2024 - The Ultimate Guide

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Elevate Developer Efficiency & build GenAI Application with Amazon Q

[BuildWithAI] Introduction to Gemini.pdf

Six Myths about Ontologies: The Basics of Formal Ontology

Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)

The Zero-ETL Approach: Enhancing Data Agility and Insight

CNIC Information System with Pakdata Cf In Pakistan

Exploring Multimodal Embeddings with Milvus

Design and Development of a Provenance Capture Platform for Data Science

Finding Java's Hidden Performance Traps @ DevoxxUK 2024

Creating Usable Data

1. Creating Usable Data Usable Data and “Actionable” Information Jonathan Callahan Mazama Science MAZAMA SCIENCE Data – Information – Knowledge

2. STRIPE Regional Meeting -- Apr 29 - May 01, 2013Mazama Science 2 From Data to Decision Data “Actionable” InformationKnowledge Information

3. STRIPE Regional Meeting -- Apr 29 - May 01, 2013Mazama Science 3 Data – Information – Knowledge pathway Graphic concept from nathan.com

4. STRIPE Regional Meeting -- Apr 29 - May 01, 2013Mazama Science 4Mazama Science 4 From Theory to Practice.  “Data – Information – Knowledge” is the theory.  Data files and software is the practice.  How do data managers start creating “Usable Data”?  How does this lead to “Actionable Information”?

5. STRIPE Regional Meeting -- Apr 29 - May 01, 2013Mazama Science 5Mazama Science 5 For Usable Data – Identify Your Users!  Do you want to support analysts? (data only)  Do you want to support authors? (data summaries and charts)  Do you want to engage local citizens? (maps and local information)  Do you want to support decision makers? (integrated stories)

6. STRIPE Regional Meeting -- Apr 29 - May 01, 2013Mazama Science 6 Support Analysts with Data.  Analysts want raw data.  They want easy access.  They know how to work with data.  They have their own tools.  Give them big CSV files.

7. STRIPE Regional Meeting -- Apr 29 - May 01, 2013Mazama Science 7 Support Authors with Tables and Charts.  Authors want data summaries.  They want to tell stories.  They don't have great data skills.  They will publish on the web.  Give them summary tables and good data graphics. (.png)

8. STRIPE Regional Meeting -- Apr 29 - May 01, 2013Mazama Science 8 Engage Citizens with Maps & Local Info.  Citizens want to know what is going on near them.  They want maps.  They want simple explanations.  They will influence decision makers.  Give them web pages with text, maps and charts.

9. STRIPE Regional Meeting -- Apr 29 - May 01, 2013Mazama Science 9 Support Decision Makers with Stories.  Decision Makers want “Actionable Information”.  They want integrated stories.  They don't have expert knowledge.  They need well informed citizens to back them up.  Give them compelling stories.

10. STRIPE Regional Meeting -- Apr 29 - May 01, 2013Mazama Science 10Mazama Science 10 Keep It Simple – Data and Charts  Data  ASCII CSV files on a web site  Text files (.txt, .pdf) with metadata describing the data  Data summaries and charts  Summarize important results in tables.  Study other sites for excellent chart examples.  Are your charts easy to understand?  Do they tell a story?  Are they beautiful?  Provide charts that can be copied. (.png)  Build a simple web presentation with html and javascript.

11. STRIPE Regional Meeting -- Apr 29 - May 01, 2013Mazama Science 11Mazama Science 11 Keep It Simple – Maps and Stories  Maps  Don't require the use of interactive maps.  Provide static versions of maps. (.png)  Provide KML files.  Integrated Stories  Tell compelling stories!  Who are the actors?  What is at stake?  What do we know?  Use web pages to integrate information.  Have “data consumers” write the stories.

12. STRIPE Regional Meeting -- Apr 29 - May 01, 2013Mazama Science 12 Examples of an 'engaged public'.

13. STRIPE Regional Meeting -- Apr 29 - May 01, 2013Mazama Science 13 End of Presentation

14. STRIPE Regional Meeting -- Apr 29 - May 01, 2013Mazama Science 14 Number Crunchers Pattern Recognizers & Story Tellers The story behind this presentation.

15. Mazama Science 15STRIPE Regional Meeting -- Apr 29 - May 01, 2013 Number Crunchers  Fast  Accurate  Consistent  > 50 years of evolution Very good at what they do!

16. Mazama Science 16STRIPE Regional Meeting -- Apr 29 - May 01, 2013 Pattern Recognizers  Fast!  Accurate ~  Creative!!  > 50K years of evolution Awesome at what we do!

17. Mazama Science 17STRIPE Regional Meeting -- Apr 29 - May 01, 2013 Pattern Recognition Humans are better than computers are recognizing patterns.

18. Mazama Science 18STRIPE Regional Meeting -- Apr 29 - May 01, 2013 Pattern Recognition Sensors can generate and computers can process millions of measurements. When presented visually, humans recognize patterns instantly.

19. Mazama Science 19STRIPE Regional Meeting -- Apr 29 - May 01, 2013 Pattern Recognition • Humans communicate by telling stories. • Familiar pictures help us tell those stories.

20. Mazama Science 20STRIPE Regional Meeting -- Apr 29 - May 01, 2013 Pattern Recognition When we want to tell stories with data we use graphics. Including visualizations that map onto the real world. And charts that are completely abstract. Telling stories with data requires data visualization.

Creating Usable Data

Recommended

Recommended

More Related Content

Similar to Creating Usable Data

Similar to Creating Usable Data (20)

More from The Access Initiative

More from The Access Initiative (20)

Recently uploaded

Recently uploaded (20)

Creating Usable Data