Usability Testing: analyzing data

•

0 likes•373 views

The document outlines the steps to take in analyzing user data from testing: 1) Compile the raw data, 2) Summarize the key metrics and measurements, 3) Analyze the data to identify problems and their severity. Some important metrics that should be summarized include task accuracy, task timings, and preference data. The analysis should prioritize problems by severity to identify the most serious issues.

Technology Design

• Compile
• Summarize data
• Analyze data
• Develop recommendations
• Produce the ﬁnal report

Wednesday, March 28, 12

Step 1: Compile

Wednesday, March 28, 12

Get it into a pile.

Wednesday, March 28, 12

Get your piles sorted.

Wednesday, March 28, 12

compile as you test.

Wednesday, March 28, 12

further test the test.

Wednesday, March 28, 12

keep the data legible.

Wednesday, March 28, 12

• Type handwritten notes
• Verify data captures
• Back up ﬁles

Wednesday, March 28, 12

Organize raw data.

Wednesday, March 28, 12

Do whatever it takes to
get it done.

Wednesday, March 28, 12

• lists
• tallies
• matrices
• stories
• structure models
• ﬂow diagrams

Wednesday, March 28, 12

Step 2: summarize

Wednesday, March 28, 12

1. task accuracy

Wednesday, March 28, 12

number of errors made
per task

Wednesday, March 28, 12

• categorize errors by type
• ommission
• commission

Wednesday, March 28, 12

# of participants who performed:

• successfully
• successfully but with some assistance
• assistance types, tasks, products

Wednesday, March 28, 12

Vital Statistics:

Wednesday, March 28, 12

% performing successfully, including those
who needed assistance

• regardless of time limits
• regardless of assistance needed

Wednesday, March 28, 12

If this percentage is
very low, you’ve got a
serious problem.

Wednesday, March 28, 12

% performing successfully

• including those who corrected errors

Wednesday, March 28, 12

% performing successfully within
benchmark

• indicative of efﬁciency

Wednesday, March 28, 12

2. task timings

Wednesday, March 28, 12

summarize
preference data

Wednesday, March 28, 12

Limited choice questions:
• Sum by choice
• Chart trends

Wednesday, March 28, 12

Free-form questions:
• Group into meaningful categories
• Ex: particular screen, doc section, etc.

Wednesday, March 28, 12

Summarize other measures

• Unnecessary returns to main navigation
• Number/type of hints and prompts
• Times site map was accessed
• Points of hesitation (and for how long)

Wednesday, March 28, 12

Summarize by Group/Version

Wednesday, March 28, 12

(see pages 255 - 259)

Wednesday, March 28, 12

3: analyze data

Wednesday, March 28, 12

What didn’t succeed?

Wednesday, March 28, 12

What were the
difﬁculties?

Wednesday, March 28, 12

What were the
error sources?

Wednesday, March 28, 12

Prioritize problems
by severity

Wednesday, March 28, 12

Severity descriptions &
deﬁnitions: p. 262

Wednesday, March 28, 12

This document discusses how lawyers can learn lessons from tennis to better serve their clients. It outlines 8 lessons lawyers can take from tennis: 1) master the basics of law, 2) know your legal opponents, 3) know your weaknesses, 4) call out issues when in doubt, 5) use percentage strategies, 6) keep focus on the key issues, 7) attention to legal footwork is important, and 8) adapt to changes in the legal field. The document also notes three major technology trends of social media, cloud computing, and mobile computing that lawyers need to stay aware of as the legal industry evolves.

$Module 1 lesson 12 ratios of fractions and unit rates$ $Module 1 lesson 12 ratios of fractions and unit rates$

Module 1 lesson 12 ratios of fractions and unit rates

Erik Tjersland

This document outlines lessons on ratios of fractions and unit rates. It includes homework assignments on problem sets and an upcoming exam. The lesson aims to teach ratios of fractions and their unit rates. Examples are provided for converting times to fractions of an hour, finding unit rates from graphs and equations, and comparing different methods for solving rate problems. Discussion questions are included to help understand these concepts.

Roman authorship

Krista Kennedy

This document discusses Roman perspectives on topics like invention, authorship, interpretation, and rhetoric. It references various historical figures from different time periods in Rome like St. Bonaventure, Cicero, Pliny, and Augustine. The document also examines debates around what classifies someone as an author versus a compiler or commentator. It explores Roman traditions like handbooks and how perspectives on topics like invention and eloquence evolved over time in Rome.

Intro to Wikis and More on Distance Collaboration

Krista Kennedy

The document discusses wikis and their uses and limitations. It notes that wikis are best suited for big, collaborative projects that require letting go of the idea of individual work and embracing collaboration. However, wikis may not be well-suited for personal projects that impact one's digital identity or private matters meant for only one person. The document also presents differing views about whether technology enhances or hinders community, with one viewpoint arguing it revolutionizes community and the other concerned it may replace human interaction.

Authorship: Digital and Database

Krista Kennedy

The document discusses authorship and metadata in digital contexts. It notes that anyone can be considered an author if publishing is defined narrowly, but not everyone can be a true Author. It also examines how readers interact with screen-based texts by actualizing possibilities rather than simply consuming. Additionally, it explores how user-generated metadata and data are appropriated by technology companies and treated as objective facts and unowned property separate from users' creative activities, neglecting the link between user data and user-generated content.

Designing For Usability

Krista Kennedy

Usability: Navigation

Krista Kennedy

The document discusses usability testing of website navigation. It notes that navigation helps users find what they are looking for, tells them where they are and what is available, and builds confidence in the website. The document then recommends simplifying navigation elements, providing navigation for multiple browsing behaviors, and using methods like silent observation, talk-aloud protocols and interviews to test navigation usability. Testers should develop protocols including browsing prompts, behavior coding, and information presentation formats.

Usability intro 419

Krista Kennedy

The document discusses usability and defines it as the effectiveness, efficiency, and satisfaction with which users can achieve tasks. It notes that high usability means a system is easy to learn and remember, efficient, visually pleasing, and fun to use, and quick to recover from errors. It emphasizes that usability is about designing and writing with end users in mind through revision and testing. The focus is on writing professional documents like status reports, evaluations, summaries, and reports in this class.

This document discusses copyright law and fair use principles regarding derivative works and appropriation art. It covers the purpose and nature of use, the amount of a work used, and the effect on the original work's potential market. While copyright aims to protect original works, some argue it should allow free access for creative expression. Courts have struggled to determine what constitutes parody or piracy in appropriation art that references or incorporates existing copyrighted works.

The Copyright Thing Doesn't Work Here, 2

Krista Kennedy

The document discusses issues around authorship, appropriation, and intellectual property rights regarding traditional Ghanaian kente and adinkra cloth. It addresses how these cloths have become regarded as both Asante and Ghanaian through long-standing practices of appropriation by states, groups, and individuals. It also discusses the multidirectional globalization process and the economic challenges less powerful groups and nations face when intellectual property becomes predominantly an economic issue that can impact livelihoods.

The Copyright Thing Doesn't Work Here, Part 1

Krista Kennedy

This document discusses authorship and ownership of traditional knowledge and cultural productions. It notes that while individual inspiration is recognized, control and ownership are often communal and built on contributions from past generations as well as cultural institutions. It argues that strategies for protecting traditional knowledge must acknowledge both individual and communal aspects of creation, and recognize that authorship is situated within temporal, cultural and gendered contexts of apprenticeship and collective production.

Distributed Collaboration

Krista Kennedy

The document discusses the concepts of distributed collaboration and commons-based peer production (CBPP). It provides three key requirements for successful peer production projects: 1) being modular and divisible into independently producible components, 2) having fine-grained modules to accommodate variously sized contributions, and 3) having low-cost integration mechanisms for quality control and assembly. CBPP depends on large numbers of individuals independently contributing small creative efforts which are then integrated. Successful systems have mechanisms for peer review. The document also discusses factors that enable CBPP, such as nonrivalrous knowledge goods, and incentives and motivations for participation.

Authorship: Copyleft Basics

Krista Kennedy

The document discusses John Perry Barlow's views on ideas, intellectual property, and the economy of ideas in the digital age. Some key points discussed include: (1) How digital technology allows ideas and intellectual property to be instantly distributed worldwide without cost; (2) The challenge this poses to protecting and monetizing creative works; (3) The idea that information wants to be free and spread; and (4) That familiarity and widespread distribution can increase, rather than decrease, the value of ideas and creative works. The document explores these issues over time from the 1990s to today.

Authorship Seminar: Intellectual Property Basics

Krista Kennedy

The document discusses copyright law and its history and purposes. It covers the Statute of Anne, the first copyright law from 1710, which aimed to encourage learning. It then covers developments in U.S. copyright law over time, including the Constitution giving Congress power to enact copyright law, and various Copyright Acts that expanded protections. Key concepts of fair use, public domain, and international treaties like the Berne Convention are summarized.

Authorship Seminar: The Signature

Krista Kennedy

The document discusses the role and importance of signatures and authorship in various contexts. It touches on how signatures are used in law and institutions to determine ownership and validity. It also discusses the concept of auteurism in film and how directors are often constructed and marketed as the sole authors of films for commercial purposes. The discussion further explores how experts rely on notions of authentic authors and signatures to validate works, and how this impacts judgments of authenticity. The concept of fake works and forged signatures is also examined.

Authorship Seminar: Bot-Written Texts

Krista Kennedy

This document discusses bots writing texts and their level of agency and authorship. It explores whether bots can be considered authors, writers, or composers. Examples are given of bots fixing typos, adding facts, reverting vandalism, and performing other editing tasks on Wikipedia. Statistics provided indicate that for one article, 88% of the text was bot-generated and bots performed 21 out of 35 edits, suggesting bots can be highly productive wiki editors.

Intellectual property basics

Krista Kennedy

The document discusses intellectual property and copyright. It notes that all original creative works are automatically copyrighted upon creation. It describes what copyright gives the creator control over, including reproduction, derivatives, distribution, public performance, and digital transmission. The document outlines exceptions to copyright restrictions such as works in the public domain, fair use, Creative Commons, and GNU/Linux works. It provides guidance on determining what constitutes fair use based on factors like the purpose of the use, amount used, and commercial effects. The document also notes that modern authorship is often collaborative, distributed, and involves assembling preexisting information in new ways.

Authorship: Rhet/Comp Perspectives

Krista Kennedy

This document discusses the history of intellectual property issues within the field of rhetoric and composition dating back to the 1960s. It addresses how scholars have long been attentive to legal and economic factors that impact their work and classrooms. Key topics that have been discussed include notions of authorship, the impact of changing technologies, and concerns about how restrictive copyright laws and corporate interests could negatively influence teaching and scholarship. The document also examines calls to reimagine writing and authorship in a way that values collaboration over individual ownership and promotes the growth of a shared cultural commons.

Authorship: Feminist Perspectives

Krista Kennedy

This document discusses feminist perspectives on authorship and textual ownership. It references several French feminist theorists including Hélène Cixous who advocated for "l'écriture féminine" or feminine writing. Cixous believed that writing is inherently feminine and connected to the maternal body. The document also discusses how authorship has been viewed as a gendered concept with myths of solitary male authorship. Andrea Lunsford addresses how a feminist approach could reframe ideas of collaborative authorship and situated authority through interconnection rather than sole ownership.

Social Bookmarking w/ Diigo

Krista Kennedy

The document discusses tagging and social bookmarking as ways to organize and retrieve information. It notes that tagging is simple, flexible, and tags can be aggregated. A taxonomy is a formal classification system, while a folksonomy allows for bottom-up collaborative tagging by multiple users. Folksonomies allow for evolving terminology and viewpoints but can be messy. To simplify, tags should use basic lowercase terms without punctuation. There are four types of tags: descriptive, resource, ownership/source, and self-reference.

Authorship belletristic modern

Krista Kennedy

The document discusses various views on authorship, genius, and rhetoric from the 18th-19th centuries. It mentions that 18th century Scottish rhetoricians like Hugh Blair were more interested in how discourse appealed to taste and propriety rather than reasoning. The document also discusses Sharon Crowley's critique of 19th century assumptions that genius and successful composition depend on innate talents rather than teaching. Additionally, it covers views from various thinkers on invention, imagination, tradition, and the relationship between creativity and reality.

Authorship 20c

Krista Kennedy

The document discusses the evolving definition of an "author" in cultural and legal contexts. It notes that historically, being an author did not signify a high-status profession, but rather distinguished cultural labor from industrial labor. To be considered an author, work needed to be in approved mediums and show the imprint of the creator's personality. Over time, mass cultural works challenged this definition as they involved new technologies and collaborative labor. The essay argues we must analyze the relationships between culture and industry, and proposes considering authorship in terms of collective and responsible cultural labor rather than isolated genius.

Basic project management

Krista Kennedy

The document discusses basic project management techniques including defining the scope of work, creating a calendar and milestones, breaking tasks into individual assignments, identifying deliverables, making an equipment list, keeping materials in a central location, maintaining open communication, using available tools, and visualizing progress. The overall message is the importance of planning, organization, communication, and tracking progress to set yourself up for success on a project.

18c Perspectives on Authorship, Part III

Krista Kennedy

Young was situated within 18th century book production culture, writing in multiple genres for patronage. His works were popular, being translated into 7 languages and having multiple editions, including an illustrated edition by William Blake. Young explores the concepts of genius, originality, and imitation in his piece "Conjectures on Original Composition." He compares original works to a blooming spring arising from a barren waste, while imitations have quicker growth but fainter bloom. Imitators build on others' foundations, while originals extend the boundaries of knowledge.

18c Perspectives on Authorship, Part II

Krista Kennedy

The document discusses the Statute of Anne, the first copyright law, passed in 1710 in England. It established copyright protection for published works for a renewable term of 14 years for new works and 21 years for existing works. The statute aimed to encourage learning by granting authors and booksellers property rights over copies of their published books. It provided remedies against copyright infringement including forfeiture and fines. The statute also required registration and deposit of copies with certain libraries. It did not include any provisions for censorship.

Info arch

Krista Kennedy

This document discusses information architecture and its key principles. Information architecture involves structuring, organizing and labeling information on websites in a logical way so that users can easily find and manage content. It is both an art and a science. The document emphasizes that websites are dynamic environments that evolve over time based on user needs and behaviors, not static constructs. Effective information architecture considers the context, content, and users of a particular system to design organizational structures and navigation that meet user needs.

18c Views on Authorship, Part 1

Krista Kennedy

The document discusses Adrian Johns, a professor of history at the University of Chicago whose areas of expertise include the history of science, the history of books and media, and intellectual piracy and property from the Renaissance to the present. It also discusses how Johns' work counters another unnamed book. Several participants in a discussion discuss concepts from Johns' work, including how craft relates to piracy and authorship, what gives printed books authority, and when knowledge becomes public property.

Second Sophistic, Medieval, and Renaissance Views on Authorship

Krista Kennedy

The document discusses views on authorship from various historical periods: 1) During the Second Sophistic period (roughly 100-230 AD), authorship was seen as an inventional act focused on interpreting scriptures and embellishing sermons. 2) In the Middle Ages, invention influenced rhetorical theory, theology, and logic. Three new rhetorical arts also emerged: letter writing, preaching, and poetry. 3) During the Renaissance, debates reignited about the nature, purposes and epistemologies of invention. Scholars like Thomas Wilson and Francis Bacon discussed the role of invention and whether it belonged to rhetoric or logic.

Fueling AI with Great Data with Airbyte Webinar

Zilliz

Christine's Supplier Sourcing Presentaion.pptx

christinelarrosa

Recently uploaded

Fueling AI with Great Data with Airbyte Webinar

Zilliz

Christine's Supplier Sourcing Presentaion.pptx

christinelarrosa

Astute Business Solutions | Oracle Cloud Partner |

AstuteBusiness

JavaLand 2024: Application Development Green Masterplan

Miro Wengner

Nordic Marketo Engage User Group_June 13_ 2024.pptx

MichaelKnudsen27

Your One-Stop Shop for Python Success: Top 10 US Python Development Providers

akankshawande

Leveraging the Graph for Clinical Trials and Standards

Neo4j

Mutation Testing for Task-Oriented Chatbots

Pablo Gómez Abajo

Conversational agents, or chatbots, are increasingly used to access all sorts of services using natural language. While open-domain chatbots - like ChatGPT - can converse on any topic, task-oriented chatbots - the focus of this paper - are designed for specific tasks, like booking a flight, obtaining customer support, or setting an appointment. Like any other software, task-oriented chatbots need to be properly tested, usually by defining and executing test scenarios (i.e., sequences of user-chatbot interactions). However, there is currently a lack of methods to quantify the completeness and strength of such test scenarios, which can lead to low-quality tests, and hence to buggy chatbots. To fill this gap, we propose adapting mutation testing (MuT) for task-oriented chatbots. To this end, we introduce a set of mutation operators that emulate faults in chatbot designs, an architecture that enables MuT on chatbots built using heterogeneous technologies, and a practical realisation as an Eclipse plugin. Moreover, we evaluate the applicability, effectiveness and efficiency of our approach on open-source chatbots, with promising results.

9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...

saastr

Must Know Postgres Extension for DBA and Developer during Migration

Mydbops

Mydbops Opensource Database Meetup 16 Topic: Must-Know PostgreSQL Extensions for Developers and DBAs During Migration Speaker: Deepak Mahto, Founder of DataCloudGaze Consulting Date & Time: 8th June | 10 AM - 1 PM IST Venue: Bangalore International Centre, Bangalore Abstract: Discover how PostgreSQL extensions can be your secret weapon! This talk explores how key extensions enhance database capabilities and streamline the migration process for users moving from other relational databases like Oracle. Key Takeaways: * Learn about crucial extensions like oracle_fdw, pgtt, and pg_audit that ease migration complexities. * Gain valuable strategies for implementing these extensions in PostgreSQL to achieve license freedom. * Discover how these key extensions can empower both developers and DBAs during the migration process. * Don't miss this chance to gain practical knowledge from an industry expert and stay updated on the latest open-source database trends. Mydbops Managed Services specializes in taking the pain out of database management while optimizing performance. Since 2015, we have been providing top-notch support and assistance for the top three open-source databases: MySQL, MongoDB, and PostgreSQL. Our team offers a wide range of services, including assistance, support, consulting, 24/7 operations, and expertise in all relevant technologies. We help organizations improve their database's performance, scalability, efficiency, and availability. Contact us: info@mydbops.com Visit: https://www.mydbops.com/ Follow us on LinkedIn: https://in.linkedin.com/company/mydbops For more details and updates, please follow up the below links. Meetup Page : https://www.meetup.com/mydbops-databa... Twitter: https://twitter.com/mydbopsofficial Blogs: https://www.mydbops.com/blog/ Facebook(Meta): https://www.facebook.com/mydbops/

Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency

ScyllaDB

inQuba Webinar Mastering Customer Journey Management with Dr Graham Hill

LizaNolte

HERE IS YOUR WEBINAR CONTENT! 'Mastering Customer Journey Management with Dr. Graham Hill'. We hope you find the webinar recording both insightful and enjoyable. In this webinar, we explored essential aspects of Customer Journey Management and personalization. Here’s a summary of the key insights and topics discussed: Key Takeaways: Understanding the Customer Journey: Dr. Hill emphasized the importance of mapping and understanding the complete customer journey to identify touchpoints and opportunities for improvement. Personalization Strategies: We discussed how to leverage data and insights to create personalized experiences that resonate with customers. Technology Integration: Insights were shared on how inQuba’s advanced technology can streamline customer interactions and drive operational efficiency.

How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf

Chart Kalyan

Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...

saastr

What is an RPA CoE? Session 1 – CoE Vision

DianaGray10

GNSS spoofing via SDR (Criptored Talks 2024)

Javier Junquera

In the realm of cybersecurity, offensive security practices act as a critical shield. By simulating real-world attacks in a controlled environment, these techniques expose vulnerabilities before malicious actors can exploit them. This proactive approach allows manufacturers to identify and fix weaknesses, significantly enhancing system security. This presentation delves into the development of a system designed to mimic Galileo's Open Service signal using software-defined radio (SDR) technology. We'll begin with a foundational overview of both Global Navigation Satellite Systems (GNSS) and the intricacies of digital signal processing. The presentation culminates in a live demonstration. We'll showcase the manipulation of Galileo's Open Service pilot signal, simulating an attack on various software and hardware systems. This practical demonstration serves to highlight the potential consequences of unaddressed vulnerabilities, emphasizing the importance of offensive security practices in safeguarding critical infrastructure.

Essentials of Automations: Exploring Attributes & Automation Parameters

Safe Software

Building automations in FME Flow can save time, money, and help businesses scale by eliminating data silos and providing data to stakeholders in real-time. One essential component to orchestrating complex automations is the use of attributes & automation parameters (both formerly known as “keys”). In fact, it’s unlikely you’ll ever build an Automation without using these components, but what exactly are they? Attributes & automation parameters enable the automation author to pass data values from one automation component to the next. During this webinar, our FME Flow Specialists will cover leveraging the three types of these output attributes & parameters in FME Flow: Event, Custom, and Automation. As a bonus, they’ll also be making use of the Split-Merge Block functionality. You’ll leave this webinar with a better understanding of how to maximize the potential of automations by making use of attributes & automation parameters, with the ultimate goal of setting your enterprise integration workflows up on autopilot.

"Choosing proper type of scaling", Olena Syrota

Fwdays

Choosing The Best AWS Service For Your Website + API.pptx

Brandon Minnick, MBA

Have you ever been confused by the myriad of choices offered by AWS for hosting a website or an API? Lambda, Elastic Beanstalk, Lightsail, Amplify, S3 (and more!) can each host websites + APIs. But which one should we choose? Which one is cheapest? Which one is fastest? Which one will scale to meet our needs? Join me in this session as we dive into each AWS hosting service to determine which one is best for your scenario and explain why!

Dandelion Hashtable: beyond billion requests per second on a commodity server

Antonios Katsarakis

This slide deck presents DLHT, a concurrent in-memory hashtable. Despite efforts to optimize hashtables, that go as far as sacrificing core functionality, state-of-the-art designs still incur multiple memory accesses per request and block request processing in three cases. First, most hashtables block while waiting for data to be retrieved from memory. Second, open-addressing designs, which represent the current state-of-the-art, either cannot free index slots on deletes or must block all requests to do so. Third, index resizes block every request until all objects are copied to the new index. Defying folklore wisdom, DLHT forgoes open-addressing and adopts a fully-featured and memory-aware closed-addressing design based on bounded cache-line-chaining. This design offers lock-free index operations and deletes that free slots instantly, (2) completes most requests with a single memory access, (3) utilizes software prefetching to hide memory latencies, and (4) employs a novel non-blocking and parallel resizing. In a commodity server and a memory-resident workload, DLHT surpasses 1.6B requests per second and provides 3.5x (12x) the throughput of the state-of-the-art closed-addressing (open-addressing) resizable hashtable on Gets (Deletes).

Recently uploaded (20)

Fueling AI with Great Data with Airbyte Webinar

Christine's Supplier Sourcing Presentaion.pptx

Astute Business Solutions | Oracle Cloud Partner |

JavaLand 2024: Application Development Green Masterplan

Nordic Marketo Engage User Group_June 13_ 2024.pptx

Your One-Stop Shop for Python Success: Top 10 US Python Development Providers

Leveraging the Graph for Clinical Trials and Standards

Mutation Testing for Task-Oriented Chatbots

9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...

Must Know Postgres Extension for DBA and Developer during Migration

Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency

inQuba Webinar Mastering Customer Journey Management with Dr Graham Hill

How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf

Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...

What is an RPA CoE? Session 1 – CoE Vision

GNSS spoofing via SDR (Criptored Talks 2024)

Essentials of Automations: Exploring Attributes & Automation Parameters

"Choosing proper type of scaling", Olena Syrota

Choosing The Best AWS Service For Your Website + API.pptx

Dandelion Hashtable: beyond billion requests per second on a commodity server

Usability Testing: analyzing data

1. • Compile • Summarize data • Analyze data • Develop recommendations • Produce the ﬁnal report Wednesday, March 28, 12

2. Data Analysis Wednesday, March 28, 12

3. next 2 weeks: Wednesday, March 28, 12

4. Wednesday, March 28, 12

5. Wednesday, March 28, 12

6. Step 1: Compile Wednesday, March 28, 12

7. Wednesday, March 28, 12

8. Get it into a pile. Wednesday, March 28, 12

9. Get your piles sorted. Wednesday, March 28, 12

10. Ideally: Wednesday, March 28, 12

11. compile as you test. Wednesday, March 28, 12

12. further test the test. Wednesday, March 28, 12

13. keep the data legible. Wednesday, March 28, 12

14. • Type handwritten notes • Verify data captures • Back up ﬁles Wednesday, March 28, 12

15. Organize raw data. Wednesday, March 28, 12

16. Do whatever it takes to get it done. Wednesday, March 28, 12

17. • lists • tallies • matrices • stories • structure models • ﬂow diagrams Wednesday, March 28, 12

18. Wednesday, March 28, 12

19. Wednesday, March 28, 12

20. Wednesday, March 28, 12

21. Wednesday, March 28, 12

22. Goal: Wednesday, March 28, 12

23. Wednesday, March 28, 12

24. Step 2: summarize Wednesday, March 28, 12

25. 1. task accuracy Wednesday, March 28, 12

26. number of errors made per task Wednesday, March 28, 12

27. • categorize errors by type • ommission • commission Wednesday, March 28, 12

28. # of participants who performed: • successfully • successfully but with some assistance • assistance types, tasks, products Wednesday, March 28, 12

29. Vital Statistics: Wednesday, March 28, 12

30. % performing successfully, including those who needed assistance • regardless of time limits • regardless of assistance needed Wednesday, March 28, 12

31. If this percentage is very low, you’ve got a serious problem. Wednesday, March 28, 12

32. % performing successfully • including those who corrected errors Wednesday, March 28, 12

33. % performing successfully within benchmark • indicative of efﬁciency Wednesday, March 28, 12

34. 2. task timings Wednesday, March 28, 12

35. Wednesday, March 28, 12

36. summarize preference data Wednesday, March 28, 12

37. Limited choice questions: • Sum by choice • Chart trends Wednesday, March 28, 12

38. Free-form questions: • Group into meaningful categories • Ex: particular screen, doc section, etc. Wednesday, March 28, 12

39. Summarize other measures • Unnecessary returns to main navigation • Number/type of hints and prompts • Times site map was accessed • Points of hesitation (and for how long) Wednesday, March 28, 12

40. Summarize by Group/Version Wednesday, March 28, 12

41. (see pages 255 - 259) Wednesday, March 28, 12

42. 3: analyze data Wednesday, March 28, 12

43. What didn’t succeed? Wednesday, March 28, 12

44. Wednesday, March 28, 12

45. What were the difﬁculties? Wednesday, March 28, 12

46. What were the error sources? Wednesday, March 28, 12

47. Prioritize problems by severity Wednesday, March 28, 12

48. Severity descriptions & deﬁnitions: p. 262 Wednesday, March 28, 12