Remote Testing Rocks! Ignite at UXPA 2013
•Download as PPTX, PDF•
1 like•920 views
Jon Strohl organized an Ignite session in which many of us "pitted" different UX methods against each other. In mine, I argue for why remote UX testing is the best UX method. (Of course, I like many methods, and each is "the best" in different situations, but for the sake of this presentation, I hd some fun...) See my blog post about this: http://www.forsmarshgroup.com/index.php/blog/post/uxpa-recap-part-ii-why-remote-testing-is-the-most-preferred-ux-method.
Report
Share
Report
Share
Recommended
Rocks monroe
Igneous rocks form when magma cools and solidifies, either underground (intrusive) or on the surface (extrusive). Metamorphic rocks form from sedimentary, igneous, or other metamorphic rocks undergoing changes from heat and pressure. Sedimentary rocks form from compression of sediments such as small rocks and organic matter. Rocks come in three main types - sedimentary, igneous, and metamorphic - and should not be thrown at animals or people as they can cause harm.
Igneous rocks
Nature of Igneous Rocks, Magma, Lava, Textures, Types classification,compositions,Bowen’s Reaction Series, characteristics of magma, Origin of Magmas, Evolution of Magma, Magma Differentiation,Partial Melting,Fractional Crystallization, Plate Tectonic Setting of Igneous Rocks
Igneous rocks
This document provides information about igneous rocks, including their classification, textures, and mineral compositions. It discusses how igneous rocks are formed by the cooling of magma and can be classified as intrusive or extrusive depending on where they solidify. Intrusive igneous rocks cool slowly below the Earth's surface, resulting in large crystal sizes, while extrusive rocks cool rapidly after erupting, producing small crystals. The document also examines different igneous rock textures that provide information about cooling rates, and explains how mineral compositions are determined by Bowen's Reaction Series during crystallization.
Processing Speed and Vocabulary are Related to Older Adults' Internet Experie...
Processing Speed and Vocabulary are Related to Older Adults' Internet Experie...Jennifer Romano Bergstrom
This study examined the relationship between age-related cognitive decline and internet performance in older adults. The results showed:
1. Processing speed and accuracy on information-finding tasks declined with age.
2. When dividing older adults into high- and low-functioning groups based on processing speed and vocabulary tests, the low-functioning older adults performed worse than the high-functioning older adults and younger adults.
3. The findings suggest that age-related cognitive decline can impact older adults' internet experiences, and user experience testing should account for variability in cognitive abilities across age groups.User-Centered Design of Forms and Surveys
Whether surveys or forms are your final product or a part of your website/app, creating usable surveys and forms is crucial to a strong user experience for both the user entering information and the user receiving the information. In this session, you will learn about UX principles that drive a strong user experience when completing surveys/forms. The session will focus on understanding the key components of surveys/forms, what they are used for, and how to use them effectively. Topics include using labels to make forms and surveys easier, writing clear instructions, reducing respondent burden, and determining appropriate input fields such as check boxes versus radio buttons. Examples will include findings from usability studies and empirical research, some of which include eye tracking. Usability testing, eye tracking, and other user experience research methods will be discussed.
Eye Tracking the UX of Mobile: What You Need to Know
Eye tracking research was conducted on a mobile app called Fleet. The research involved 74 participants completing tasks on the app both with and without eye tracking. Key findings from the eye tracking data included:
- Novice and experienced users focused on different elements of the app interface.
- Larger interface elements were not necessarily noticed more than smaller elements.
- Interface designs that matched users' mental models were easier for users to process.
- Users did not read dense blocks of text or instruction text, focusing only on actionable areas instead.
- Error messages needed to be more helpful in indicating where users failed to complete mandatory fields.
UXPA2015 sponsorship prospectus
The document describes sponsorship opportunities for the annual User Experience Professionals Association (UXPA) conference. It provides details about the conference, which brings together over 500 UX professionals over 4 days for courses, presentations and networking. Sponsorship enables companies to gain industry access, reach customers, engage with potential employees, and support the UX field. Sponsorship levels range from $30,000 to $500 and provide various benefits depending on the level.
Unbiased Methods to Understand the User Experience
The way we ask questions and behave during UX sessions affects the data we collect and the interpretations of our findings. In order to collect good UX data, it is important for the moderator to be neutral, structured, and unbiased while setting a comfortable stage for participants to share their thoughts and reactions. In this interactive 45-minute session, you will learn about the importance of structured, unbiased methods to collecting user feedback. We will discuss different methods (e.g., in-lab testing, remote moderated/unmoderated testing, surveys, card sorting, focus groups) and pros/cons of each. You will learn about different data that can be collected from usability tests, including subjective (e.g., what participants verbalize about their experience), behavioral (e.g., what participants do) and implicit (e.g., what participants think but cannot explain) data. We will discuss how to ask participants questions in ways that do not introduce biases, and how additional methods, such as eye tracking, may be valuable in understanding the users’ experience. You will learn how to ensure the data we get from UX tests are reliable and valid.
Recommended
Rocks monroe
Igneous rocks form when magma cools and solidifies, either underground (intrusive) or on the surface (extrusive). Metamorphic rocks form from sedimentary, igneous, or other metamorphic rocks undergoing changes from heat and pressure. Sedimentary rocks form from compression of sediments such as small rocks and organic matter. Rocks come in three main types - sedimentary, igneous, and metamorphic - and should not be thrown at animals or people as they can cause harm.
Igneous rocks
Nature of Igneous Rocks, Magma, Lava, Textures, Types classification,compositions,Bowen’s Reaction Series, characteristics of magma, Origin of Magmas, Evolution of Magma, Magma Differentiation,Partial Melting,Fractional Crystallization, Plate Tectonic Setting of Igneous Rocks
Igneous rocks
This document provides information about igneous rocks, including their classification, textures, and mineral compositions. It discusses how igneous rocks are formed by the cooling of magma and can be classified as intrusive or extrusive depending on where they solidify. Intrusive igneous rocks cool slowly below the Earth's surface, resulting in large crystal sizes, while extrusive rocks cool rapidly after erupting, producing small crystals. The document also examines different igneous rock textures that provide information about cooling rates, and explains how mineral compositions are determined by Bowen's Reaction Series during crystallization.
Processing Speed and Vocabulary are Related to Older Adults' Internet Experie...
Processing Speed and Vocabulary are Related to Older Adults' Internet Experie...Jennifer Romano Bergstrom
This study examined the relationship between age-related cognitive decline and internet performance in older adults. The results showed:
1. Processing speed and accuracy on information-finding tasks declined with age.
2. When dividing older adults into high- and low-functioning groups based on processing speed and vocabulary tests, the low-functioning older adults performed worse than the high-functioning older adults and younger adults.
3. The findings suggest that age-related cognitive decline can impact older adults' internet experiences, and user experience testing should account for variability in cognitive abilities across age groups.User-Centered Design of Forms and Surveys
Whether surveys or forms are your final product or a part of your website/app, creating usable surveys and forms is crucial to a strong user experience for both the user entering information and the user receiving the information. In this session, you will learn about UX principles that drive a strong user experience when completing surveys/forms. The session will focus on understanding the key components of surveys/forms, what they are used for, and how to use them effectively. Topics include using labels to make forms and surveys easier, writing clear instructions, reducing respondent burden, and determining appropriate input fields such as check boxes versus radio buttons. Examples will include findings from usability studies and empirical research, some of which include eye tracking. Usability testing, eye tracking, and other user experience research methods will be discussed.
Eye Tracking the UX of Mobile: What You Need to Know
Eye tracking research was conducted on a mobile app called Fleet. The research involved 74 participants completing tasks on the app both with and without eye tracking. Key findings from the eye tracking data included:
- Novice and experienced users focused on different elements of the app interface.
- Larger interface elements were not necessarily noticed more than smaller elements.
- Interface designs that matched users' mental models were easier for users to process.
- Users did not read dense blocks of text or instruction text, focusing only on actionable areas instead.
- Error messages needed to be more helpful in indicating where users failed to complete mandatory fields.
UXPA2015 sponsorship prospectus
The document describes sponsorship opportunities for the annual User Experience Professionals Association (UXPA) conference. It provides details about the conference, which brings together over 500 UX professionals over 4 days for courses, presentations and networking. Sponsorship enables companies to gain industry access, reach customers, engage with potential employees, and support the UX field. Sponsorship levels range from $30,000 to $500 and provide various benefits depending on the level.
Unbiased Methods to Understand the User Experience
The way we ask questions and behave during UX sessions affects the data we collect and the interpretations of our findings. In order to collect good UX data, it is important for the moderator to be neutral, structured, and unbiased while setting a comfortable stage for participants to share their thoughts and reactions. In this interactive 45-minute session, you will learn about the importance of structured, unbiased methods to collecting user feedback. We will discuss different methods (e.g., in-lab testing, remote moderated/unmoderated testing, surveys, card sorting, focus groups) and pros/cons of each. You will learn about different data that can be collected from usability tests, including subjective (e.g., what participants verbalize about their experience), behavioral (e.g., what participants do) and implicit (e.g., what participants think but cannot explain) data. We will discuss how to ask participants questions in ways that do not introduce biases, and how additional methods, such as eye tracking, may be valuable in understanding the users’ experience. You will learn how to ensure the data we get from UX tests are reliable and valid.
Benchmarking Usability Performance
This document discusses benchmarking usability performance. It defines usability and user experience, noting that usability refers to how effectively, efficiently and satisfactorily users can achieve goals. The document recommends benchmarking to provide a framework for comparing future website performance metrics. It describes different testing methods like in-lab one-on-one sessions using eye trackers, focus groups, and surveys. Preparation tips are provided like creating unambiguous tasks and avoiding bias. Analysis involves comparing results to goals and benchmarks. Outputs include notes, recordings, and reports.
User-Centered Research on the Paying for College Website and Tools - EDUI 2014
User-Centered Research on the Paying for College Website and Tools - EDUI 2014Jennifer Romano Bergstrom
The Paying for College website is designed to help consumers make informed decisions about college finance. The Consumer Financial Protection Bureau (CFPB) began development with a user-centered design process for this tool-set, which is now in its 4th iteration. The college cost and financial aid comparison tool, a central feature of these resources, supports efforts by the Department of Education to standardize financial aid disclosures.
During this session, we’ll cover the most recent rounds of usability testing conducted with multiple groups across the U.S. We’ll highlight difficulties when designing and testing for multiple audiences with different needs as well as testing and iterating with live and prototype versions of the site. Data will also be emphasized as we share collection methodologies (click paths, eye tracking, questionnaires, etc.) and the importance of each. We’ll also provide insights into planning, execution, and reporting and how these findings informed major changes on the website.Web Survey and Forms Usability Design & Testing
This document summarizes a presentation on web survey and form usability design and testing. It discusses how eye tracking research has provided insights into how users interact with forms and surveys. Key findings include that users focus on questions rather than instructions, have trouble with error messages and navigation, and may not read all pages in the same way. The document cautions that eye tracking is not always necessary and may not be suitable for tasks like recalling pre-existing answers. It encourages testing designs across devices to understand user experiences.
Improving Forms with User Experience Testing and Eye Tracking
The document summarizes a presentation about using user experience testing and eye tracking to improve federal forms. It discusses collecting both explicit and implicit user experience data through methods like questionnaires, task timing, eye tracking, and facial expression analysis. Examples are given of issues identified through this process, such as unclear instructions, non-intuitive layouts, and dense text blocking important form elements. The presentation advocates applying usability best practices to ensure forms are easy to use and understand.
Eye Tracking the User Experience of Mobile: What You Need to Know
This document discusses eye tracking and user experience testing across mobile devices. It provides examples of usability issues uncovered through eye tracking tests, such as error messages that are not helpful, inconsistent "Back" buttons, non-intuitive locations of "Next" buttons, and non-clickable icons that do not match user expectations. The document advocates designing interfaces that are consistent across devices and match how users think in order to improve the user experience. Implicit and observational data from eye tracking can reveal usability problems that users may not report explicitly.
Launch With Confidence! Integrate UX Research Throughout Development
Jennifer Romano Bergstrom gave a presentation on integrating usability testing methods in development. She discussed the importance of testing with end users, as things may seem straightforward to developers but not users. Usability testing can uncover issues developers may have overlooked. Bergstrom covered different testing methods like one-on-one sessions, focus groups, surveys, and prototypes of varying fidelity. Both qualitative and quantitative data should be collected through methods like observation, eye tracking, and questionnaires. Testing should occur throughout the development process from early concepts to final designs.
So much UX data! Now what?
workshop for UXPA DC on April 12, 2014, entitled "All this UX data! Now what?" Attendees learned how to deal with large amounts of user experience data from tests, and how to combine certain data to tell a succinct story.
Usable Government Forms and Surveys: Best Practices for Design (from MoDevGov)
Usable Government Forms and Surveys: Best Practices for Design (from MoDevGov)Jennifer Romano Bergstrom
This document discusses best practices for designing usable government forms and surveys. It covers topics like usability testing methods, navigation patterns, input field design, and placement of instructions. Specifically, it recommends:
- Conducting one-on-one sessions, focus groups, and surveys to test designs
- Placing the "Next" button on the left for primary navigation
- Avoiding vertical and horizontal scrolling for open-ended responses
- Using radio buttons and checkboxes according to conventions
- Placing instructions near related questions to reduce cognitive loadThe UX of Social Media
This talk briefly covers usability and the user experience and then discusses posting to social media in a way that is consistent with how people use it.
Unifying the UX of a Survey Across Multiple Devices (MoDevEast 2013)
The visual design of surveys and other types of online data collection tools impacts how users perceive, understand and navigate the instrument as well as the responses they provide. Two key considerations that impact how users experience online data collection tools are the device they are using (e.g., smartphone, tablet, computer) and the method of interaction (e.g., website, app or both). When designing online data collection tools, creating a common user experience across different devices and methods of interaction is important to create a consistent user experience and to minimize measurement differences.
In this talk, we will compare the user experience across four different combinations of device and method of interaction of a survey: (1) desktop PC-website, (2) smartphone-app, (3) tablet-app, and (4) tablet-website. Through performance and eye-tracking data, we identify UX elements that must be unified across all devices as well as elements that might need customization for difference devices or methods of interaction.
UX Assessment Techniques (from NOVA UX Psychology of UX Panel: Dec 11, 2013)
UX Assessment Techniques (from NOVA UX Psychology of UX Panel: Dec 11, 2013)Jennifer Romano Bergstrom
The document discusses user experience (UX) assessment techniques. It defines UX and explains why assessing UX through user testing is important. It then describes different testing methods like in-lab usability testing, remote testing, and field studies. Specific metrics that can be measured are discussed like task completion rates, eye tracking data, and survey responses. Challenges to UX testing like time constraints and finding participants are addressed. The document concludes with examples of case studies and emphasizes that early and frequent testing is key.Age-Related Differences in Search Strategy and Performance When Using a Data-...
Age-Related Differences in Search Strategy and Performance When Using a Data-...Jennifer Romano Bergstrom
Erica Olmsted-Hawala presented these findings at HCII 2013 in Las Vegas. Data are from a lab-based experimental usability study, in which we showed that older adults have greater difficulties with cognitively challenging tasks. However, even young adults have difficulties with complex data tables that are often found on government Web sites.Age Differences in the Knowledge and Usage of QR Codes
Jonathan Mendelson presented this talk at HCI in Las Vegas. Data are from a probability-based online panel with US adults over the age of 25. We found that QR Code awareness, knowledge, and usage were highest for young adults and lowest for older adults. See slides for more details and see Jonathan's blog post about this talk at: http://www.forsmarshgroup.com/index.php/blog/post/hcii-2013-preview-age-and-qr-codes
Making your Brand Pinteresting to Youth - ESOMAR 2013
Caitlin Krulikowski presented this at ESOMAR 2013 in Boston. Results are based on a probability-based paper survey of American youth. Find out what youth think about and do on Pinterest... See Caitlin's blog post about this presentation here: http://www.forsmarshgroup.com/index.php/blog/post/esomar-pinterest-preview
Beyond Eye Tracking: Using User Temperature, Rating Dials, and Facial Analysi...
Beyond Eye Tracking: Using User Temperature, Rating Dials, and Facial Analysi...Jennifer Romano Bergstrom
Dan Berlin, Jon Strohl, David Hawkins and I presented this at UXPA 2013. Eye tracking is well known and accepted in the UX community. Here we present preliminary evidence for the usefulness of adding electrodermal activity (EDA), continuous dial ratings, etc. to user experience research. Introduction to Web Survey Usability Design and Testing
This document provides an agenda and objectives for a workshop on web survey usability design and testing. The workshop covers topics like paging versus scrolling, navigation, input fields, response options, and instructions. The goal is to discuss best practices for web survey design to ensure usability and data quality. The workshop will include presentations, activities, and a discussion of methods for assessing survey design.
UX Fundamentals
Slides for a short course I taught for UXPA DC on Feb 27, 2013. This is a UX 101- basics if you are new to UX and Usability. The focus is on desktop websites, but many of these principles apply to other products (e.g., surveys, apps) and devices (e.g., tablets, smartphones). Stay tuned for an updated version that is mobile-heavy.
Effects of Age and Think-Aloud Protocol on Eye-Tracking Data and Usability Me...
Effects of Age and Think-Aloud Protocol on Eye-Tracking Data and Usability Me...Jennifer Romano Bergstrom
- A study compared the effects of concurrent think-aloud (CTA) and retrospective think-aloud (RTA) protocols on usability performance, eye tracking data, and verbal reports for young, middle-aged, and older adults.
- The results showed that CTA had a negative impact on middle-aged adults' task accuracy and efficiency compared to RTA, while older adults struggled more overall due to cognitive decline.
- Eye tracking data revealed that older adults had fewer fixations than young adults during CTA, while middle-aged adults had fewer fixations than young adults during whole screen tasks for CTA.Benefits of Concurrent Cognitive and Usability Testing
Typically survey pretesting involves separate timelines and research staffs for cognitive and usability testing. In this paper, we make the case that a more comprehensive and less labor-intensive approach to pretesting is to conduct both cognitive and usability testing concurrently. By testing the same questionnaire concurrently with respondents and interviewers (the users in this case), potentially problematic question wording and instrument design can be more efficiently identified in a way that can be used to improve the questionnaire for both the respondent and the interviewer.
In 2005 and 2006, the U.S. Census Bureau conducted separate rounds of cognitive and usability testing on an interviewer-administered non-response follow-up questionnaire in preparation for the 2010 Census. The usability testing was conducted in the Census Bureau’s Usability Lab with an early version of the instrument. Later, the Census Bureau’s Cognitive Lab conducted cognitive testing of the instrument. In doing the testing separately, we learned that in addition to usability issues, usability testing also identifies question wording issues, but that usability staff does not have the specialized experience (or sometimes the authority) to make recommendations in that arena. Similarly, while examining question wording, cognitive testing also identifies poor usability features, but the cognitive-testing staff lacks the experience with such testing to be able to recommend improvements in usability features. Based on this observation, in 2008, the Cognitive and Usability Labs at the Census Bureau conducted 40 cognitive and 20 usability interviews concurrently and in conjunction to test the questionnaire and presented results and recommendations from both types of testing together. When testing is conducted concurrently, staff from both labs, representing both specialties, can be at the table at once, creating a more efficient methodology. By examining these two case studies, this paper will discuss what can be gained by conducting these studies in concert above and beyond conducting them independently. Examples of the kinds of findings that are possible through this joint research and the synergy from having both research teams involved will be described.
Display Matters: A Test of Visual Display Options in a Web-Based Survey
This document summarizes a study on the effects of different visual display options in a web-based survey. The study tested four versions that varied the location of the Next and Previous buttons and the presentation of response options as single or double columns. Participants completed the survey while their eye movements were tracked. Results showed higher satisfaction ratings for versions that placed the Previous button on the left and presented response options in double columns. Eye tracking data provided insights into how participants viewed the different display elements.
Artificial Intelligence for XMLDevelopment
In the rapidly evolving landscape of technologies, XML continues to play a vital role in structuring, storing, and transporting data across diverse systems. The recent advancements in artificial intelligence (AI) present new methodologies for enhancing XML development workflows, introducing efficiency, automation, and intelligent capabilities. This presentation will outline the scope and perspective of utilizing AI in XML development. The potential benefits and the possible pitfalls will be highlighted, providing a balanced view of the subject.
We will explore the capabilities of AI in understanding XML markup languages and autonomously creating structured XML content. Additionally, we will examine the capacity of AI to enrich plain text with appropriate XML markup. Practical examples and methodological guidelines will be provided to elucidate how AI can be effectively prompted to interpret and generate accurate XML markup.
Further emphasis will be placed on the role of AI in developing XSLT, or schemas such as XSD and Schematron. We will address the techniques and strategies adopted to create prompts for generating code, explaining code, or refactoring the code, and the results achieved.
The discussion will extend to how AI can be used to transform XML content. In particular, the focus will be on the use of AI XPath extension functions in XSLT, Schematron, Schematron Quick Fixes, or for XML content refactoring.
The presentation aims to deliver a comprehensive overview of AI usage in XML development, providing attendees with the necessary knowledge to make informed decisions. Whether you’re at the early stages of adopting AI or considering integrating it in advanced XML development, this presentation will cover all levels of expertise.
By highlighting the potential advantages and challenges of integrating AI with XML development tools and languages, the presentation seeks to inspire thoughtful conversation around the future of XML development. We’ll not only delve into the technical aspects of AI-powered XML development but also discuss practical implications and possible future directions.
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Discover the seamless integration of RPA (Robotic Process Automation), COMPOSER, and APM with AWS IDP enhanced with Slack notifications. Explore how these technologies converge to streamline workflows, optimize performance, and ensure secure access, all while leveraging the power of AWS IDP and real-time communication via Slack notifications.
More Related Content
More from Jennifer Romano Bergstrom
Benchmarking Usability Performance
This document discusses benchmarking usability performance. It defines usability and user experience, noting that usability refers to how effectively, efficiently and satisfactorily users can achieve goals. The document recommends benchmarking to provide a framework for comparing future website performance metrics. It describes different testing methods like in-lab one-on-one sessions using eye trackers, focus groups, and surveys. Preparation tips are provided like creating unambiguous tasks and avoiding bias. Analysis involves comparing results to goals and benchmarks. Outputs include notes, recordings, and reports.
User-Centered Research on the Paying for College Website and Tools - EDUI 2014
User-Centered Research on the Paying for College Website and Tools - EDUI 2014Jennifer Romano Bergstrom
The Paying for College website is designed to help consumers make informed decisions about college finance. The Consumer Financial Protection Bureau (CFPB) began development with a user-centered design process for this tool-set, which is now in its 4th iteration. The college cost and financial aid comparison tool, a central feature of these resources, supports efforts by the Department of Education to standardize financial aid disclosures.
During this session, we’ll cover the most recent rounds of usability testing conducted with multiple groups across the U.S. We’ll highlight difficulties when designing and testing for multiple audiences with different needs as well as testing and iterating with live and prototype versions of the site. Data will also be emphasized as we share collection methodologies (click paths, eye tracking, questionnaires, etc.) and the importance of each. We’ll also provide insights into planning, execution, and reporting and how these findings informed major changes on the website.Web Survey and Forms Usability Design & Testing
This document summarizes a presentation on web survey and form usability design and testing. It discusses how eye tracking research has provided insights into how users interact with forms and surveys. Key findings include that users focus on questions rather than instructions, have trouble with error messages and navigation, and may not read all pages in the same way. The document cautions that eye tracking is not always necessary and may not be suitable for tasks like recalling pre-existing answers. It encourages testing designs across devices to understand user experiences.
Improving Forms with User Experience Testing and Eye Tracking
The document summarizes a presentation about using user experience testing and eye tracking to improve federal forms. It discusses collecting both explicit and implicit user experience data through methods like questionnaires, task timing, eye tracking, and facial expression analysis. Examples are given of issues identified through this process, such as unclear instructions, non-intuitive layouts, and dense text blocking important form elements. The presentation advocates applying usability best practices to ensure forms are easy to use and understand.
Eye Tracking the User Experience of Mobile: What You Need to Know
This document discusses eye tracking and user experience testing across mobile devices. It provides examples of usability issues uncovered through eye tracking tests, such as error messages that are not helpful, inconsistent "Back" buttons, non-intuitive locations of "Next" buttons, and non-clickable icons that do not match user expectations. The document advocates designing interfaces that are consistent across devices and match how users think in order to improve the user experience. Implicit and observational data from eye tracking can reveal usability problems that users may not report explicitly.
Launch With Confidence! Integrate UX Research Throughout Development
Jennifer Romano Bergstrom gave a presentation on integrating usability testing methods in development. She discussed the importance of testing with end users, as things may seem straightforward to developers but not users. Usability testing can uncover issues developers may have overlooked. Bergstrom covered different testing methods like one-on-one sessions, focus groups, surveys, and prototypes of varying fidelity. Both qualitative and quantitative data should be collected through methods like observation, eye tracking, and questionnaires. Testing should occur throughout the development process from early concepts to final designs.
So much UX data! Now what?
workshop for UXPA DC on April 12, 2014, entitled "All this UX data! Now what?" Attendees learned how to deal with large amounts of user experience data from tests, and how to combine certain data to tell a succinct story.
Usable Government Forms and Surveys: Best Practices for Design (from MoDevGov)
Usable Government Forms and Surveys: Best Practices for Design (from MoDevGov)Jennifer Romano Bergstrom
This document discusses best practices for designing usable government forms and surveys. It covers topics like usability testing methods, navigation patterns, input field design, and placement of instructions. Specifically, it recommends:
- Conducting one-on-one sessions, focus groups, and surveys to test designs
- Placing the "Next" button on the left for primary navigation
- Avoiding vertical and horizontal scrolling for open-ended responses
- Using radio buttons and checkboxes according to conventions
- Placing instructions near related questions to reduce cognitive loadThe UX of Social Media
This talk briefly covers usability and the user experience and then discusses posting to social media in a way that is consistent with how people use it.
Unifying the UX of a Survey Across Multiple Devices (MoDevEast 2013)
The visual design of surveys and other types of online data collection tools impacts how users perceive, understand and navigate the instrument as well as the responses they provide. Two key considerations that impact how users experience online data collection tools are the device they are using (e.g., smartphone, tablet, computer) and the method of interaction (e.g., website, app or both). When designing online data collection tools, creating a common user experience across different devices and methods of interaction is important to create a consistent user experience and to minimize measurement differences.
In this talk, we will compare the user experience across four different combinations of device and method of interaction of a survey: (1) desktop PC-website, (2) smartphone-app, (3) tablet-app, and (4) tablet-website. Through performance and eye-tracking data, we identify UX elements that must be unified across all devices as well as elements that might need customization for difference devices or methods of interaction.
UX Assessment Techniques (from NOVA UX Psychology of UX Panel: Dec 11, 2013)
UX Assessment Techniques (from NOVA UX Psychology of UX Panel: Dec 11, 2013)Jennifer Romano Bergstrom
The document discusses user experience (UX) assessment techniques. It defines UX and explains why assessing UX through user testing is important. It then describes different testing methods like in-lab usability testing, remote testing, and field studies. Specific metrics that can be measured are discussed like task completion rates, eye tracking data, and survey responses. Challenges to UX testing like time constraints and finding participants are addressed. The document concludes with examples of case studies and emphasizes that early and frequent testing is key.Age-Related Differences in Search Strategy and Performance When Using a Data-...
Age-Related Differences in Search Strategy and Performance When Using a Data-...Jennifer Romano Bergstrom
Erica Olmsted-Hawala presented these findings at HCII 2013 in Las Vegas. Data are from a lab-based experimental usability study, in which we showed that older adults have greater difficulties with cognitively challenging tasks. However, even young adults have difficulties with complex data tables that are often found on government Web sites.Age Differences in the Knowledge and Usage of QR Codes
Jonathan Mendelson presented this talk at HCI in Las Vegas. Data are from a probability-based online panel with US adults over the age of 25. We found that QR Code awareness, knowledge, and usage were highest for young adults and lowest for older adults. See slides for more details and see Jonathan's blog post about this talk at: http://www.forsmarshgroup.com/index.php/blog/post/hcii-2013-preview-age-and-qr-codes
Making your Brand Pinteresting to Youth - ESOMAR 2013
Caitlin Krulikowski presented this at ESOMAR 2013 in Boston. Results are based on a probability-based paper survey of American youth. Find out what youth think about and do on Pinterest... See Caitlin's blog post about this presentation here: http://www.forsmarshgroup.com/index.php/blog/post/esomar-pinterest-preview
Beyond Eye Tracking: Using User Temperature, Rating Dials, and Facial Analysi...
Beyond Eye Tracking: Using User Temperature, Rating Dials, and Facial Analysi...Jennifer Romano Bergstrom
Dan Berlin, Jon Strohl, David Hawkins and I presented this at UXPA 2013. Eye tracking is well known and accepted in the UX community. Here we present preliminary evidence for the usefulness of adding electrodermal activity (EDA), continuous dial ratings, etc. to user experience research. Introduction to Web Survey Usability Design and Testing
This document provides an agenda and objectives for a workshop on web survey usability design and testing. The workshop covers topics like paging versus scrolling, navigation, input fields, response options, and instructions. The goal is to discuss best practices for web survey design to ensure usability and data quality. The workshop will include presentations, activities, and a discussion of methods for assessing survey design.
UX Fundamentals
Slides for a short course I taught for UXPA DC on Feb 27, 2013. This is a UX 101- basics if you are new to UX and Usability. The focus is on desktop websites, but many of these principles apply to other products (e.g., surveys, apps) and devices (e.g., tablets, smartphones). Stay tuned for an updated version that is mobile-heavy.
Effects of Age and Think-Aloud Protocol on Eye-Tracking Data and Usability Me...
Effects of Age and Think-Aloud Protocol on Eye-Tracking Data and Usability Me...Jennifer Romano Bergstrom
- A study compared the effects of concurrent think-aloud (CTA) and retrospective think-aloud (RTA) protocols on usability performance, eye tracking data, and verbal reports for young, middle-aged, and older adults.
- The results showed that CTA had a negative impact on middle-aged adults' task accuracy and efficiency compared to RTA, while older adults struggled more overall due to cognitive decline.
- Eye tracking data revealed that older adults had fewer fixations than young adults during CTA, while middle-aged adults had fewer fixations than young adults during whole screen tasks for CTA.Benefits of Concurrent Cognitive and Usability Testing
Typically survey pretesting involves separate timelines and research staffs for cognitive and usability testing. In this paper, we make the case that a more comprehensive and less labor-intensive approach to pretesting is to conduct both cognitive and usability testing concurrently. By testing the same questionnaire concurrently with respondents and interviewers (the users in this case), potentially problematic question wording and instrument design can be more efficiently identified in a way that can be used to improve the questionnaire for both the respondent and the interviewer.
In 2005 and 2006, the U.S. Census Bureau conducted separate rounds of cognitive and usability testing on an interviewer-administered non-response follow-up questionnaire in preparation for the 2010 Census. The usability testing was conducted in the Census Bureau’s Usability Lab with an early version of the instrument. Later, the Census Bureau’s Cognitive Lab conducted cognitive testing of the instrument. In doing the testing separately, we learned that in addition to usability issues, usability testing also identifies question wording issues, but that usability staff does not have the specialized experience (or sometimes the authority) to make recommendations in that arena. Similarly, while examining question wording, cognitive testing also identifies poor usability features, but the cognitive-testing staff lacks the experience with such testing to be able to recommend improvements in usability features. Based on this observation, in 2008, the Cognitive and Usability Labs at the Census Bureau conducted 40 cognitive and 20 usability interviews concurrently and in conjunction to test the questionnaire and presented results and recommendations from both types of testing together. When testing is conducted concurrently, staff from both labs, representing both specialties, can be at the table at once, creating a more efficient methodology. By examining these two case studies, this paper will discuss what can be gained by conducting these studies in concert above and beyond conducting them independently. Examples of the kinds of findings that are possible through this joint research and the synergy from having both research teams involved will be described.
Display Matters: A Test of Visual Display Options in a Web-Based Survey
This document summarizes a study on the effects of different visual display options in a web-based survey. The study tested four versions that varied the location of the Next and Previous buttons and the presentation of response options as single or double columns. Participants completed the survey while their eye movements were tracked. Results showed higher satisfaction ratings for versions that placed the Previous button on the left and presented response options in double columns. Eye tracking data provided insights into how participants viewed the different display elements.
More from Jennifer Romano Bergstrom (20)
User-Centered Research on the Paying for College Website and Tools - EDUI 2014
User-Centered Research on the Paying for College Website and Tools - EDUI 2014
Improving Forms with User Experience Testing and Eye Tracking
Improving Forms with User Experience Testing and Eye Tracking
Eye Tracking the User Experience of Mobile: What You Need to Know
Eye Tracking the User Experience of Mobile: What You Need to Know
Launch With Confidence! Integrate UX Research Throughout Development
Launch With Confidence! Integrate UX Research Throughout Development
Usable Government Forms and Surveys: Best Practices for Design (from MoDevGov)
Usable Government Forms and Surveys: Best Practices for Design (from MoDevGov)
Unifying the UX of a Survey Across Multiple Devices (MoDevEast 2013)
Unifying the UX of a Survey Across Multiple Devices (MoDevEast 2013)
UX Assessment Techniques (from NOVA UX Psychology of UX Panel: Dec 11, 2013)
UX Assessment Techniques (from NOVA UX Psychology of UX Panel: Dec 11, 2013)
Age-Related Differences in Search Strategy and Performance When Using a Data-...
Age-Related Differences in Search Strategy and Performance When Using a Data-...
Age Differences in the Knowledge and Usage of QR Codes
Age Differences in the Knowledge and Usage of QR Codes
Making your Brand Pinteresting to Youth - ESOMAR 2013
Making your Brand Pinteresting to Youth - ESOMAR 2013
Beyond Eye Tracking: Using User Temperature, Rating Dials, and Facial Analysi...
Beyond Eye Tracking: Using User Temperature, Rating Dials, and Facial Analysi...
Introduction to Web Survey Usability Design and Testing
Introduction to Web Survey Usability Design and Testing
Effects of Age and Think-Aloud Protocol on Eye-Tracking Data and Usability Me...
Effects of Age and Think-Aloud Protocol on Eye-Tracking Data and Usability Me...
Benefits of Concurrent Cognitive and Usability Testing
Benefits of Concurrent Cognitive and Usability Testing
Display Matters: A Test of Visual Display Options in a Web-Based Survey
Display Matters: A Test of Visual Display Options in a Web-Based Survey
Recently uploaded
Artificial Intelligence for XMLDevelopment
In the rapidly evolving landscape of technologies, XML continues to play a vital role in structuring, storing, and transporting data across diverse systems. The recent advancements in artificial intelligence (AI) present new methodologies for enhancing XML development workflows, introducing efficiency, automation, and intelligent capabilities. This presentation will outline the scope and perspective of utilizing AI in XML development. The potential benefits and the possible pitfalls will be highlighted, providing a balanced view of the subject.
We will explore the capabilities of AI in understanding XML markup languages and autonomously creating structured XML content. Additionally, we will examine the capacity of AI to enrich plain text with appropriate XML markup. Practical examples and methodological guidelines will be provided to elucidate how AI can be effectively prompted to interpret and generate accurate XML markup.
Further emphasis will be placed on the role of AI in developing XSLT, or schemas such as XSD and Schematron. We will address the techniques and strategies adopted to create prompts for generating code, explaining code, or refactoring the code, and the results achieved.
The discussion will extend to how AI can be used to transform XML content. In particular, the focus will be on the use of AI XPath extension functions in XSLT, Schematron, Schematron Quick Fixes, or for XML content refactoring.
The presentation aims to deliver a comprehensive overview of AI usage in XML development, providing attendees with the necessary knowledge to make informed decisions. Whether you’re at the early stages of adopting AI or considering integrating it in advanced XML development, this presentation will cover all levels of expertise.
By highlighting the potential advantages and challenges of integrating AI with XML development tools and languages, the presentation seeks to inspire thoughtful conversation around the future of XML development. We’ll not only delve into the technical aspects of AI-powered XML development but also discuss practical implications and possible future directions.
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Discover the seamless integration of RPA (Robotic Process Automation), COMPOSER, and APM with AWS IDP enhanced with Slack notifications. Explore how these technologies converge to streamline workflows, optimize performance, and ensure secure access, all while leveraging the power of AWS IDP and real-time communication via Slack notifications.
TrustArc Webinar - 2024 Global Privacy Survey
How does your privacy program stack up against your peers? What challenges are privacy teams tackling and prioritizing in 2024?
In the fifth annual Global Privacy Benchmarks Survey, we asked over 1,800 global privacy professionals and business executives to share their perspectives on the current state of privacy inside and outside of their organizations. This year’s report focused on emerging areas of importance for privacy and compliance professionals, including considerations and implications of Artificial Intelligence (AI) technologies, building brand trust, and different approaches for achieving higher privacy competence scores.
See how organizational priorities and strategic approaches to data security and privacy are evolving around the globe.
This webinar will review:
- The top 10 privacy insights from the fifth annual Global Privacy Benchmarks Survey
- The top challenges for privacy leaders, practitioners, and organizations in 2024
- Key themes to consider in developing and maintaining your privacy program
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
Dr. Sean Tan, Head of Data Science, Changi Airport Group
Discover how Changi Airport Group (CAG) leverages graph technologies and generative AI to revolutionize their search capabilities. This session delves into the unique search needs of CAG’s diverse passengers and customers, showcasing how graph data structures enhance the accuracy and relevance of AI-generated search results, mitigating the risk of “hallucinations” and improving the overall customer journey.
20240609 QFM020 Irresponsible AI Reading List May 2024
Everything I found interesting about the irresponsible use of machine intelligence in May 2024
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
Leonard Jayamohan, Partner & Generative AI Lead, Deloitte
This keynote will reveal how Deloitte leverages Neo4j’s graph power for groundbreaking digital twin solutions, achieving a staggering 100x performance boost. Discover the essential role knowledge graphs play in successful generative AI implementations. Plus, get an exclusive look at an innovative Neo4j + Generative AI solution Deloitte is developing in-house.
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
ABSTRACT: A prima vista, un mattoncino Lego e la backdoor XZ potrebbero avere in comune il fatto di essere entrambi blocchi di costruzione, o dipendenze di progetti creativi e software. La realtà è che un mattoncino Lego e il caso della backdoor XZ hanno molto di più di tutto ciò in comune.
Partecipate alla presentazione per immergervi in una storia di interoperabilità, standard e formati aperti, per poi discutere del ruolo importante che i contributori hanno in una comunità open source sostenibile.
BIO: Sostenitrice del software libero e dei formati standard e aperti. È stata un membro attivo dei progetti Fedora e openSUSE e ha co-fondato l'Associazione LibreItalia dove è stata coinvolta in diversi eventi, migrazioni e formazione relativi a LibreOffice. In precedenza ha lavorato a migrazioni e corsi di formazione su LibreOffice per diverse amministrazioni pubbliche e privati. Da gennaio 2020 lavora in SUSE come Software Release Engineer per Uyuni e SUSE Manager e quando non segue la sua passione per i computer e per Geeko coltiva la sua curiosità per l'astronomia (da cui deriva il suo nickname deneb_alpha).
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for life science domain, where you retriever information from biomedical knowledge graphs using LLMs to increase the accuracy and performance of generated answers
How to Get CNIC Information System with Paksim Ga.pptx
Pakdata Cf is a groundbreaking system designed to streamline and facilitate access to CNIC information. This innovative platform leverages advanced technology to provide users with efficient and secure access to their CNIC details.
UiPath Test Automation using UiPath Test Suite series, part 6
Welcome to UiPath Test Automation using UiPath Test Suite series part 6. In this session, we will cover Test Automation with generative AI and Open AI.
UiPath Test Automation with generative AI and Open AI webinar offers an in-depth exploration of leveraging cutting-edge technologies for test automation within the UiPath platform. Attendees will delve into the integration of generative AI, a test automation solution, with Open AI advanced natural language processing capabilities.
Throughout the session, participants will discover how this synergy empowers testers to automate repetitive tasks, enhance testing accuracy, and expedite the software testing life cycle. Topics covered include the seamless integration process, practical use cases, and the benefits of harnessing AI-driven automation for UiPath testing initiatives. By attending this webinar, testers, and automation professionals can gain valuable insights into harnessing the power of AI to optimize their test automation workflows within the UiPath ecosystem, ultimately driving efficiency and quality in software development processes.
What will you get from this session?
1. Insights into integrating generative AI.
2. Understanding how this integration enhances test automation within the UiPath platform
3. Practical demonstrations
4. Exploration of real-world use cases illustrating the benefits of AI-driven test automation for UiPath
Topics covered:
What is generative AI
Test Automation with generative AI and Open AI.
UiPath integration with generative AI
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Microsoft - Power Platform_G.Aspiotis.pdf
Revolutionizing Application Development
with AI-powered low-code, presentation by George Aspiotis, Sr. Partner Development Manager, Microsoft
Presentation of the OECD Artificial Intelligence Review of Germany
Consult the full report at https://www.oecd.org/digital/oecd-artificial-intelligence-review-of-germany-609808d6-en.htm
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Are you ready to revolutionize how you handle data? Join us for a webinar where we’ll bring you up to speed with the latest advancements in Generative AI technology and discover how leveraging FME with tools from giants like Google Gemini, Amazon, and Microsoft OpenAI can supercharge your workflow efficiency.
During the hour, we’ll take you through:
Guest Speaker Segment with Hannah Barrington: Dive into the world of dynamic real estate marketing with Hannah, the Marketing Manager at Workspace Group. Hear firsthand how their team generates engaging descriptions for thousands of office units by integrating diverse data sources—from PDF floorplans to web pages—using FME transformers, like OpenAIVisionConnector and AnthropicVisionConnector. This use case will show you how GenAI can streamline content creation for marketing across the board.
Ollama Use Case: Learn how Scenario Specialist Dmitri Bagh has utilized Ollama within FME to input data, create custom models, and enhance security protocols. This segment will include demos to illustrate the full capabilities of FME in AI-driven processes.
Custom AI Models: Discover how to leverage FME to build personalized AI models using your data. Whether it’s populating a model with local data for added security or integrating public AI tools, find out how FME facilitates a versatile and secure approach to AI.
We’ll wrap up with a live Q&A session where you can engage with our experts on your specific use cases, and learn more about optimizing your data workflows with AI.
This webinar is ideal for professionals seeking to harness the power of AI within their data management systems while ensuring high levels of customization and security. Whether you're a novice or an expert, gain actionable insights and strategies to elevate your data processes. Join us to see how FME and AI can revolutionize how you work with data!
National Security Agency - NSA mobile device best practices
Threats to mobile devices are more prevalent and increasing in scope and complexity. Users of mobile devices desire to take full advantage of the features
available on those devices, but many of the features provide convenience and capability but sacrifice security. This best practices guide outlines steps the users can take to better protect personal devices and information.
20240607 QFM018 Elixir Reading List May 2024
Everything I found interesting about the Elixir programming ecosystem in May 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
Maruthi Prithivirajan, Head of ASEAN & IN Solution Architecture, Neo4j
Get an inside look at the latest Neo4j innovations that enable relationship-driven intelligence at scale. Learn more about the newest cloud integrations and product enhancements that make Neo4j an essential choice for developers building apps with interconnected data and generative AI.
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Discover how MongoDB Atlas and vector search technology can revolutionize your application's search capabilities. This comprehensive presentation covers:
* What is Vector Search?
* Importance and benefits of vector search
* Practical use cases across various industries
* Step-by-step implementation guide
* Live demos with code snippets
* Enhancing LLM capabilities with vector search
* Best practices and optimization strategies
Perfect for developers, AI enthusiasts, and tech leaders. Learn how to leverage MongoDB Atlas to deliver highly relevant, context-aware search results, transforming your data retrieval process. Stay ahead in tech innovation and maximize the potential of your applications.
#MongoDB #VectorSearch #AI #SemanticSearch #TechInnovation #DataScience #LLM #MachineLearning #SearchTechnology
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
Sudheer Mechineni, Head of Application Frameworks, Standard Chartered Bank
Discover how Standard Chartered Bank harnessed the power of Neo4j to transform complex data access challenges into a dynamic, scalable graph database solution. This keynote will cover their journey from initial adoption to deploying a fully automated, enterprise-grade causal cluster, highlighting key strategies for modelling organisational changes and ensuring robust disaster recovery. Learn how these innovations have not only enhanced Standard Chartered Bank’s data infrastructure but also positioned them as pioneers in the banking sector’s adoption of graph technology.
Recently uploaded (20)
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
Remote Testing Rocks! Ignite at UXPA 2013
- 1. 2013 This Is Why Remote Testing Rocks! Jennifer Romano Bergstrom User Experience Research Leader Fors Marsh Group @romanocog
- 2. 2013 Remote Testing = Running sessions from afar @romanocog
- 6. 2013 Participants in natural environment @romanocog
- 7. 2013 Busy participant in natural environment @romanocog
- 8. 2013 Hard to reach populations Hard to reach participants @romanocog
- 9. 2013 Hard to reach participants in natural environment @romanocog
- 10. 2013 Un-moderated Sessions = Reach lots of people fast @romanocog
- 11. 2013 Interview a lot of people quickly Un-moderated Sessions = Lots of data fast @romanocog
- 12. 2013 Sample from the country…or the world Collect data from participants in your hometown @romanocog
- 13. 2013 Collect data from participants all over the country @romanocog
- 14. 2013 Collect data from participants all over the world @romanocog
- 20. 2013 @romanocog More time for family, friends, and fun
- 21. 2013 And THAT is why Remote Testing rocks! Jennifer Romano Bergstrom www.forsmarshgroup.com @forsmarshgroup @romanocog