SlideShare a Scribd company logo
User Information for Designers:
                                     A Visual Research Package
             Anu Antikainen                                      Mirja Kälviäinen                                   Hugh Miller
    The Kuopio Academy of Design                        The Kuopio Academy of Design                     The Nottingham Trent University
            PL 98, 70101                                        PL 98, 70101                                      Burton Street
           Kuopio, Finland                                     Kuopio, Finland                             Nottingham NG3 5DY, UK
         +358 (0)17 308135                                   +358 (0)17 308201                                +44 (0)115 848 5550
  anu.antikainen@designkuopio.fi                     mirja.kalviainen@designkuopio.fi                        hugh.miller@ntu.ac.uk



                                                                                 developed by Pieter Jan Stappers at TUDelft, has been to use
ABSTRACT
                                                                                 multidimensional scaling to present complex characteristics of
In this paper, we describe the development of a flexible, visually-
                                                                                 products to consumers, and to allow them to manipulate the
based on-line package, based on free sorting and multi-
                                                                                 displays to emphasise those dimensions that interested them most
dimensional scaling to help designers research users’ emotional
                                                                                 [8]. The approach of presenting complex information in visual,
and social responses to designed objects.
                                                                                 preferably user-manipulable ways has been promoted by
                                                                                 researchers like Ben Shneiderman [7], and consultancies like
Categories and Subject Descriptors                                               Doblin, with ‘innovation landscapes’ [2].
H.1.2 [Information Systems]: User-Machine Systems – human
                                                                                 The multidimensional scaling approach used in the chair research
factors.
                                                                                 was evaluated by small design companies in Finland, who were
General Terms: Human Factors                                                     asked if they could see ways of using this technique in their
                                                                                 design process [5]. We found that designers felt comfortable with
Keywords: Design and emotion, visual research,                                   the kind of pictures the research produced. An analysis which
                                                                                 gave them groups of pictures with different explanations of how
multidimensional scaling, on-line methods
                                                                                 the users saw them was useful from their point of view, and they
                                                                                 could also see how such a presentation might be valuable in
1. INTRODUCTION                                                                  discussing designs with management and with outside suppliers.
Designed objects have a social and emotional impact on
                                                                                 The present paper describes how the grouping method has been
consumer’s lives, and researchers have tried to find ways of
                                                                                 developed further and combined with other supporting methods to
researching and describing these impacts. Approaches range from
                                                                                 form a consistent software package that can serve researchers
considering ways of characterising the personalities of objects [4],
                                                                                 working with companies and in educational use. We set out to
through using morphological analysis to find those ‘form
                                                                                 present information in a visual, easily manipulated, exploratory
elements’ that are associated with certain aspects of the object [1,
                                                                                 way: a way which corresponds with the way that designers like to
3], to calculating numerical indices that indicate how the elements
                                                                                 work. There are limitations in using purely pictorial
of an object convey certain qualities [9]. Understanding how
                                                                                 representations of physical objects, but it makes for a quick and
objects are perceived by users should be helpful in the design
                                                                                 easy presentation method, and designers we spoke to, who often
process for producing enjoyable objects, but such research is often
                                                                                 work with visual sketches in the early stages of developing a
conducted after the design process is finished, and may produce
                                                                                 project, found it an acceptable approach. The results can be used
rather abstract results, often verbally- or numerically-based, rather
                                                                                 either as a practical support for designers and marketing personnel
than visual.
                                                                                 in a company or to increase general understanding of users. This
A visual research package for design development and marketing
                                                                                 paper describes our intentions in developing this package. Once it
research is being built by The Kuopio Academy of Design, based
                                                                                 is complete, in fall 2003, we hope to go on to evaluate its
on a method developed for evaluating chair designs by Hugh
                                                                                 usefulness to small design companies.
Miller and Mirja Kälviäinen [6]. The method of grouping items,
based on free-sorting and multi-dimensional scaling, was intended                2. THE VISUAL RESEARCH PACKAGE
to produce holistic, user-centred accounts of both social and
                                                                                 DEVELOPMENT PROJECT
design aspects of the objects. A complementary approach,
                                                                                 2.1 Aims
                                                                                 The aim is to develop a tool which can obtain useful information
 Permission to make digital or hard copies of all or part of this work for
                                                                                 to support the design process as well as other functions in a
 personal or classroom use is granted without fee provided that copies are
                                                                                 company. The advantages are flexibility in designing research and
 not made or distributed for profit or commercial advantage and that
 copies bear this notice and the full citation on the first page. To copy        speed in collecting and analysing data from a large number of
 otherwise, or republish, to post on servers or to redistribute to lists,        respondents globally. Consequently time and financial resources
 requires prior specific permission and/or a fee.                                are saved compared to the manual process used in the original
 DPPI’03, June 23-26, 2003, Pittsburgh, Pennsylvania, USA.
 Copyright 2003 ACM 1-58113-652-8/03/0006…$5.00.



                                                                             1
with the combining version of grouping (i.e. finding out the order
research. However, the software is not replacing personal user
                                                                                         of preference in the ‘I would buy – would not buy’ example).
research, but aims at giving supplementary information to
designers and marketers that can be both qualitative and                                 The semantic differential method in the traditional form can also
quantitative.                                                                            be used visually. The respondent is asked to set one to three
                                                                                         pictures of, for example, products on a scale between a pair of
Starting in fall 2001, The Kuopio Academy of Design started a
                                                                                         words. This method is particularly useful when more accurate
design-based EU-funded project titled Muotoiluparkki. One of the
                                                                                         information from selected items is wanted after the grouping
project aims was to develop the new software, with the active
                                                                                         method.
cooperation of the Lahti Design Research Institute, which
operates as a research consultant in design and user research. It is                     Multiple choice can be used with words or with pictures. Verbal
intended that the project will be finished by the end of 2003.                           questions can be used, for example, in collecting background
                                                                                         information. Free text is used mainly as a supportive method, and
2.2 Components Of The Software Package                                                   could be used in other forms such as in a story-telling method,
Although the software package under development is based on the
                                                                                         which might be seen as a useful additional research method in
grouping method, other approaches like semantic differential,
                                                                                         some cases.
multiple choice and free text have been added to make a more
                                                                                         To briefly illustrate the application of the methods, short
flexible research tool. Combining a variety of techniques gives the
                                                                                         descriptions of practical company cases that we used in
advantage of gaining results from various different perspectives.
                                                                                         developing the package are presented. These are being used
However, the grouping method is the primary research method
                                                                                         throughout the development process to improve the package.
and is thus generally used first.
This method has been modified into several different versions to                         2.3 The Furniture Company Case
match different research settings (figure 1). The free sorting                           A Finnish furniture company has a large variety of products. One
method using to a supplied theme or question is best applied to                          of their important product lines is sofas. To gain further
gain information of product categorisations or to position a                             information of their market position and different consumer
chosen product among other products in the market. In all forms                          groups’ taste they wanted to do research on their and competitors
of grouping respondents are usually asked to describe their                              products by grouping. In addition, new product prototypes under
choices after grouping items, which can be pictures or words.                            development are being included in the study (figure 2).
A second version of grouping is called combining, in which there
is one or several predetermined groups where the given items are
placed. The respondent has freedom to place items into the
groups, or to leave some items aside. A practical application could
be to study which products are appealing (i.e. a box titled ‘I
would buy’) and undesirable (i.e. ‘I would not buy). Alternatively
a selection of descriptive words can be offered as items to be
combined with two to four product (or other visual) pictures,
which can be either prototypes or finalised products. Finally
grouping can be arranged in a scale form, which resembles the
semantic differential method.

   Organise the given pictures                     Move products you would buy and
   according to their potential users                would not buy into the boxes
                                                                below




                                                                                         Figure 2: Free sorting
                             Organise the given products on the
                                pleasing – unpleasing scale
                                                                                         2.4 The Wooden Cutlery Case
                                                                                         A Finnish wood processing company had invented a unique
                                                                                         automated cutting mechanism, which enables all kinds of forms to
                                                                                         be shaped from wood. As a challenging test product the company
                            Pleasing                Unpleasing
                                                                                         decided to try producing a set of wooden cutlery. The visual
                                                                                         research package was used to study what are the general attitudes
     Figure 1: Three versions of grouping; grouping freely,
                                                                                         towards wood as a material for cutlery and how wood associates
                  combining, and scale form
                                                                                         with cooking and eating. Research questions include, for example,
                                                                                         how wooden cutlery relates to steel, silver and plastic, and what
                                                                                         are the ideal user environments (figures 3 and 4).
Two opposing verbal definitions are set on two ends of the screen
and the respondent arranges pictures on a scale or space between
them. This way the information gained is more precise compared




                                                                                     2
Figure 5: The visual research on emotions linked to the
                                                                             bathroom. After grouping the respondents are asked to
                                                                              describe the emotions that are linked to the pictures
Figure 3: Grouping by combining is used to find out the most
            pleasing and displeasing fork forms
                                                                          3. PRESENTATION OF RESULTS
                                                                          The results that are produced are presented in a form that is visual
                                                                          and easy to approach and work with. Each picture can be enlarged
                                                                          on the result screens. A package that is visual, flexible and
                                                                          provides a multiple way of presenting results should be easy for
                                                                          designers to approach and use in their visual work as opposed to
                                                                          the traditional, verbal or numerical research results. Interviews
                                                                          with designers have confirmed a need for these features [5].
                                                                          The first screen of results from the grouping task is presented as a
                                                                          confusion matrix (figure 6). It simply shows how often each
                                                                          example has been grouped with each other example. The
                                                                          confusion matrix is an easy way to gain an overall picture of the
                                                                          results. However, other ways of presenting results are necessary to
                                                                          gain a more accurate view of general meanings behind groupings
                                                                          and meanings connected to individual groups.
                                                                          After viewing the confusion matrix the researcher has a choice of
                                                                          proceeding to either a two-dimensional plot formed when the
                                                                          confusion matrix is subjected to a multidimensional scaling
                                                                          analysis, or a network view that presents interlinkages between
  Figure 4: Grouping by combining is used to study a suitable             different items. In the two-dimensional plot the dimensions are
               environment for wooden cutlery.                            given meanings by using the descriptions that arise from the
                                                                          grouping results as Miller and Kälviäinen [6] did in their study of
                                                                          chairs (Figure 7). The constrained sort can be analysed in the
2.5 Study of Emotions Linked to the                                       same way. The visual scale shows small thumbnail pictures of the
                                                                          items studied. Explaining words or codes can be added to the
Bathroom                                                                  thumbnails. The results are read from the distances to other items
Ido Bathrooms produces bathroom furnishing. The company was
                                                                          and the dimensions.
interested in finding out about real and dreamt emotions people
                                                                          The results can also be presented as a network display (figure 8).
link to their bathrooms. This information is intended to assist the
                                                                          Any item from the confusion matrix or the two-dimensional plot
designer in his design process: the results will be part of his
                                                                          can be selected as the centre of the display. Items which were
design brief. The study took two approaches: one which
                                                                          frequently grouped with that one will appear clustered round it,
approaches emotions with a set of pictures such as buildings and
                                                                          with less-frequently chosen items a little further away. Selecting
texture that are meant to match with emotions linked to the
                                                                          any item will move it to the middle of the screen, with an
bathroom (figure 5), and another which aims at arising emotions
                                                                          appropriate rearrangement of the others. The same presentation
through pictures presenting situations and actions.
                                                                          can be used for the words used to describe the groupings.




                                                                      3
Figure 6: The confusion matrix. The information is presented in numbers and different colours and shades.
             The stronger the shade, the more often the two examples were grouped together.




                        Figure 7: Example of a two dimensional plot




                                                    4
Results from the traditional form of semantic differential can be         developing the package is that whenever users’ visual
viewed on a screen similar to the one used for gathering the              impressions are sought and two dimensional visual material is
data. Additionally two scales can be combined to form a two               sufficient, the visual research package could be applied.
dimensional graphic, where the items are presented as
                                                                          5. REFERENCES
thumbnails.
                                                                          [1] Chuang, M-C. and Ma, Y-C., 2001, Expressing the
Generally the results can be read in a flexible way. Clicking any
                                                                              expected product images in product design of micro-
of the items in the result screens can fetch access to individual
                                                                              electronic products. International Journal of Industrial
explanations. Also access to individual questionnaires or other
                                                                              Ergonomics, 27, pp. 233-245
results concerning each item can be opened directly from the
                                                                          [2] Doblin, 2003 Innovation Landscapes: Visualizing
different screens. Everyone using the results of a certain research
                                                                              Innovation Available at
can gather and save an individual collection of results in a
                                                                              http://www.doblin.com/landscapes/index.html
personal file.
                                                                          [3] Hsiao, S-W. and Chen, C-H., 1997, A semantic and shape
The visual research package aims to be a conceptual and
                                                                              grammar based approach for product design. Design
exploratory tool that supports the work of designers and
                                                                              Studies, 18, pp. 275-296
marketing people in a company. In addition the results can aid
discussion between designers, managers, and clients during the            [4] Janlert, L-E. and Stolterman, E, 1997, The Character of
product development process.                                                  Things. Design Studies, 18, pp. 297-314.
                                                                          [5] Kälviäinen, M. and Miller, H., in press, Researching Users’
                                                                              Understanding of Products: An On-line Tool. In
                                                                              McDonagh, D., Hekkert, P., Gyi, D. and van Erp, J. (2003)
                                                                              Design and Emotion, Episode III: The Design of Everyday
                                                                              Things London: Taylor and Francis
                                                                          [6] Miller, H. and Kälviäinen, M., 2001, Objects for an
                                                                              Enjoyable Life: Social and Design Aspects. In Proceedings
                                                                              of the International Conference on Affective Human
                                                                              Factors Design (Singapore), edited by Helander, M.,
                                                                              Khalid, H. M. and Ming Po, T. (London: Asean Academic
                                                                              Press), pp. 487-494.
                                                                          [7] Shneiderman, B., 1999 Dynamic queries, starfield displays,
                                                                              and the path to Spotfire Available at
          Figure 8: Example of a network display
                                                                              http://www.cs.umd.edu/hcil/spotfire/
                                                                          [8] Stappers,P.J, Pasman,G. and Groenen, P.J.F., 2000,
4. CONCLUSIONS                                                                Exploring databases for taste or inspiration with interactive
                                                                              multi-dimensional scaling Proceedings of IEA 2000/HFES
The practical examples discussed above show how the visual
                                                                              2000 Ergonomics for the new Millenium San Diego July-
research package can be used in various applications. The
                                                                              August 2000, pp 3.575-3.578. Available at
development process of the visual research package is still under
                                                                              http://studiolab.io.tudelft.nl/gems/mdsi/MDSIPaeprIEA.pdf
way, so the content presented here may change during the
                                                                              There is more information at
process. Commercial and cooperative company cases are being
                                                                              http://studiolab.io.tudelft.nl/mdsi/
used throughout the project. Some interesting cases are product
development for a multinational corporation, the development              [9] Veryzer, R. W., 1997, Measuring Consumer perceptions in
project for a new travelling vehicle, and an image study of the               the Product Development Process. Design Management
Kuopio soccer team corporate identity. The guiding idea in                    Journal, 8, pp. 66-71.




                                                                      5

More Related Content

What's hot

Seminar Nyenrode 20 juni 2012
Seminar Nyenrode 20 juni 2012Seminar Nyenrode 20 juni 2012
Seminar Nyenrode 20 juni 2012Jeroen van Bree
 
Lecture 6 representation techniques
Lecture 6 representation techniquesLecture 6 representation techniques
Lecture 6 representation techniquesNicola Morelli
 
What is Human Centred Design - The Design Journal
What is Human Centred Design - The Design JournalWhat is Human Centred Design - The Design Journal
What is Human Centred Design - The Design JournalJoseph Giacomin
 
10 interview med_designere
10 interview med_designere10 interview med_designere
10 interview med_designereNika Stuard
 
Hong Kong Post Office
Hong Kong Post OfficeHong Kong Post Office
Hong Kong Post OfficeElaine
 
Howard - hb&c sig keynote
Howard - hb&c sig keynoteHoward - hb&c sig keynote
Howard - hb&c sig keynoteTom Howard
 
Design prototyping
Design prototypingDesign prototyping
Design prototypingAditya Pawar
 
AI Therapist – Emotion Detection using Facial Detection and Recognition and S...
AI Therapist – Emotion Detection using Facial Detection and Recognition and S...AI Therapist – Emotion Detection using Facial Detection and Recognition and S...
AI Therapist – Emotion Detection using Facial Detection and Recognition and S...ijtsrd
 
YEO Wee John. PR-Охота! "Brand. Brain. Communication"
YEO Wee John. PR-Охота! "Brand. Brain. Communication"YEO Wee John. PR-Охота! "Brand. Brain. Communication"
YEO Wee John. PR-Охота! "Brand. Brain. Communication"prasu1995
 
Ebook Project Log
Ebook Project LogEbook Project Log
Ebook Project Logzweidesign
 
Experiencing products in the virtual world r8
Experiencing products in the virtual world r8Experiencing products in the virtual world r8
Experiencing products in the virtual world r8radygogo
 
Becoming a UX Practitioner
Becoming a UX PractitionerBecoming a UX Practitioner
Becoming a UX Practitionerrachelache
 
2013 trendinsight English_quick_translation
2013 trendinsight English_quick_translation2013 trendinsight English_quick_translation
2013 trendinsight English_quick_translationjong K
 

What's hot (17)

Seminar Nyenrode 20 juni 2012
Seminar Nyenrode 20 juni 2012Seminar Nyenrode 20 juni 2012
Seminar Nyenrode 20 juni 2012
 
Lecture 6 representation techniques
Lecture 6 representation techniquesLecture 6 representation techniques
Lecture 6 representation techniques
 
What is Human Centred Design - The Design Journal
What is Human Centred Design - The Design JournalWhat is Human Centred Design - The Design Journal
What is Human Centred Design - The Design Journal
 
Koupriesleeswijkemp empathy framework
Koupriesleeswijkemp empathy frameworkKoupriesleeswijkemp empathy framework
Koupriesleeswijkemp empathy framework
 
10 interview med_designere
10 interview med_designere10 interview med_designere
10 interview med_designere
 
WiID Introduction
WiID IntroductionWiID Introduction
WiID Introduction
 
Hong Kong Post Office
Hong Kong Post OfficeHong Kong Post Office
Hong Kong Post Office
 
Howard - hb&c sig keynote
Howard - hb&c sig keynoteHoward - hb&c sig keynote
Howard - hb&c sig keynote
 
Design prototyping
Design prototypingDesign prototyping
Design prototyping
 
AI Therapist – Emotion Detection using Facial Detection and Recognition and S...
AI Therapist – Emotion Detection using Facial Detection and Recognition and S...AI Therapist – Emotion Detection using Facial Detection and Recognition and S...
AI Therapist – Emotion Detection using Facial Detection and Recognition and S...
 
YEO Wee John. PR-Охота! "Brand. Brain. Communication"
YEO Wee John. PR-Охота! "Brand. Brain. Communication"YEO Wee John. PR-Охота! "Brand. Brain. Communication"
YEO Wee John. PR-Охота! "Brand. Brain. Communication"
 
Co design tools research
Co design tools researchCo design tools research
Co design tools research
 
Build A Better Photograph
Build A Better PhotographBuild A Better Photograph
Build A Better Photograph
 
Ebook Project Log
Ebook Project LogEbook Project Log
Ebook Project Log
 
Experiencing products in the virtual world r8
Experiencing products in the virtual world r8Experiencing products in the virtual world r8
Experiencing products in the virtual world r8
 
Becoming a UX Practitioner
Becoming a UX PractitionerBecoming a UX Practitioner
Becoming a UX Practitioner
 
2013 trendinsight English_quick_translation
2013 trendinsight English_quick_translation2013 trendinsight English_quick_translation
2013 trendinsight English_quick_translation
 

Viewers also liked

citigroup Financial Supplement July 18, 2008 - Second Quarter
citigroup Financial Supplement July 18, 2008 - Second Quartercitigroup Financial Supplement July 18, 2008 - Second Quarter
citigroup Financial Supplement July 18, 2008 - Second QuarterQuarterlyEarningsReports
 
citigroup August 5, 2008 - Re-Mapping of Press Release Disclosed Items Explan...
citigroup August 5, 2008 - Re-Mapping of Press Release Disclosed Items Explan...citigroup August 5, 2008 - Re-Mapping of Press Release Disclosed Items Explan...
citigroup August 5, 2008 - Re-Mapping of Press Release Disclosed Items Explan...QuarterlyEarningsReports
 
citigroup Guide to Reformatted Financial Supplement July 2, 2008
citigroup Guide to Reformatted Financial Supplement July 2, 2008citigroup Guide to Reformatted Financial Supplement July 2, 2008
citigroup Guide to Reformatted Financial Supplement July 2, 2008QuarterlyEarningsReports
 
citigroup Financial Supplement January 15, 2008
citigroup Financial Supplement January 15, 2008citigroup Financial Supplement January 15, 2008
citigroup Financial Supplement January 15, 2008QuarterlyEarningsReports
 
Meg Whitman to Step Down as President and CEO of eBay
Meg Whitman to Step Down as President and CEO of eBayMeg Whitman to Step Down as President and CEO of eBay
Meg Whitman to Step Down as President and CEO of eBayQuarterlyEarningsReports
 

Viewers also liked (17)

citigroup Financial Supplement July 18, 2008 - Second Quarter
citigroup Financial Supplement July 18, 2008 - Second Quartercitigroup Financial Supplement July 18, 2008 - Second Quarter
citigroup Financial Supplement July 18, 2008 - Second Quarter
 
citigroup April 18, 2008 - First Quarter
citigroup April 18, 2008 - First Quartercitigroup April 18, 2008 - First Quarter
citigroup April 18, 2008 - First Quarter
 
Ebay1017a
Ebay1017aEbay1017a
Ebay1017a
 
citigroup August 5, 2008 - Re-Mapping of Press Release Disclosed Items Explan...
citigroup August 5, 2008 - Re-Mapping of Press Release Disclosed Items Explan...citigroup August 5, 2008 - Re-Mapping of Press Release Disclosed Items Explan...
citigroup August 5, 2008 - Re-Mapping of Press Release Disclosed Items Explan...
 
citigroup Guide to Reformatted Financial Supplement July 2, 2008
citigroup Guide to Reformatted Financial Supplement July 2, 2008citigroup Guide to Reformatted Financial Supplement July 2, 2008
citigroup Guide to Reformatted Financial Supplement July 2, 2008
 
Ebay News 2004 4 21 Earnings
Ebay News 2004 4 21 EarningsEbay News 2004 4 21 Earnings
Ebay News 2004 4 21 Earnings
 
Ebay News 2002 1 15 Earnings
Ebay News 2002 1 15 EarningsEbay News 2002 1 15 Earnings
Ebay News 2002 1 15 Earnings
 
E Bay Inc Earnings Release Q42006
E Bay Inc Earnings Release Q42006E Bay Inc Earnings Release Q42006
E Bay Inc Earnings Release Q42006
 
citigroup Financial Supplement January 15, 2008
citigroup Financial Supplement January 15, 2008citigroup Financial Supplement January 15, 2008
citigroup Financial Supplement January 15, 2008
 
2007 Q1 Google Earnings Slides
2007 Q1 Google Earnings Slides2007 Q1 Google Earnings Slides
2007 Q1 Google Earnings Slides
 
Ebay News 2001 4 19 Earnings
Ebay News 2001 4 19 EarningsEbay News 2001 4 19 Earnings
Ebay News 2001 4 19 Earnings
 
Ebay News 2003 1 16 Earnings
Ebay News 2003 1 16 EarningsEbay News 2003 1 16 Earnings
Ebay News 2003 1 16 Earnings
 
Ebay News 2005 4 20 Earnings
Ebay News 2005 4 20 EarningsEbay News 2005 4 20 Earnings
Ebay News 2005 4 20 Earnings
 
20050930 Google 10 Q
20050930 Google 10 Q20050930 Google 10 Q
20050930 Google 10 Q
 
citigroup October 15, 2007 - Third Quarte
citigroup October 15, 2007 - Third Quartecitigroup October 15, 2007 - Third Quarte
citigroup October 15, 2007 - Third Quarte
 
Meg Whitman to Step Down as President and CEO of eBay
Meg Whitman to Step Down as President and CEO of eBayMeg Whitman to Step Down as President and CEO of eBay
Meg Whitman to Step Down as President and CEO of eBay
 
20070930 Google 10 Q
20070930 Google 10 Q20070930 Google 10 Q
20070930 Google 10 Q
 

Similar to citigroup October 16, 2008 - Financial Supplement

Supporting The Initial Stages of The Product Design Process: Towards Knowledg...
Supporting The Initial Stages of The Product Design Process: Towards Knowledg...Supporting The Initial Stages of The Product Design Process: Towards Knowledg...
Supporting The Initial Stages of The Product Design Process: Towards Knowledg...CSCJournals
 
SUPPORTING NPD TEAMS IN INNOVATION: STRUCTURING USER DATA ON THE FOUNDATIONS ...
SUPPORTING NPD TEAMS IN INNOVATION: STRUCTURING USER DATA ON THE FOUNDATIONS ...SUPPORTING NPD TEAMS IN INNOVATION: STRUCTURING USER DATA ON THE FOUNDATIONS ...
SUPPORTING NPD TEAMS IN INNOVATION: STRUCTURING USER DATA ON THE FOUNDATIONS ...Mahir Alkaya
 
Self ethnography for better user experience
Self ethnography for better user experienceSelf ethnography for better user experience
Self ethnography for better user experiencePulsar Platform
 
Touchpoint article: Service Prototyping in Action! www.service-design-network...
Touchpoint article: Service Prototyping in Action! www.service-design-network...Touchpoint article: Service Prototyping in Action! www.service-design-network...
Touchpoint article: Service Prototyping in Action! www.service-design-network...Satu Miettinen
 
Data analysis and synthesis
Data analysis and synthesisData analysis and synthesis
Data analysis and synthesisEva Durall
 
Apply Funnel Model To Design Thinking Process
Apply Funnel Model To Design Thinking ProcessApply Funnel Model To Design Thinking Process
Apply Funnel Model To Design Thinking ProcessSara Alvarez
 
A theoritical model construction in user research by empathic design with per...
A theoritical model construction in user research by empathic design with per...A theoritical model construction in user research by empathic design with per...
A theoritical model construction in user research by empathic design with per...WenNivala
 
Engelman.2011.exploring interaction modes for image retrieval
Engelman.2011.exploring interaction modes for image retrievalEngelman.2011.exploring interaction modes for image retrieval
Engelman.2011.exploring interaction modes for image retrievalmrgazer
 
Personas_practice and theory by Pruitt & Grudin
Personas_practice and theory by Pruitt & GrudinPersonas_practice and theory by Pruitt & Grudin
Personas_practice and theory by Pruitt & GrudinFran Maciel
 
For, With, Through Design
For, With, Through DesignFor, With, Through Design
For, With, Through DesignCeline Pering
 
User Centered Design Process to Develop a Multi-modal Family Needs Assessment...
User Centered Design Process to Develop a Multi-modal Family Needs Assessment...User Centered Design Process to Develop a Multi-modal Family Needs Assessment...
User Centered Design Process to Develop a Multi-modal Family Needs Assessment...Arthi Krishnaswami
 
Design Thinking in Project Management for Innovation
Design Thinking in Project Management for InnovationDesign Thinking in Project Management for Innovation
Design Thinking in Project Management for Innovationijtsrd
 
13 support designere
13 support designere13 support designere
13 support designereNika Stuard
 
Btp report linu&rupam
Btp report linu&rupamBtp report linu&rupam
Btp report linu&rupamLinu George
 

Similar to citigroup October 16, 2008 - Financial Supplement (20)

visual sorting
visual sortingvisual sorting
visual sorting
 
Supporting The Initial Stages of The Product Design Process: Towards Knowledg...
Supporting The Initial Stages of The Product Design Process: Towards Knowledg...Supporting The Initial Stages of The Product Design Process: Towards Knowledg...
Supporting The Initial Stages of The Product Design Process: Towards Knowledg...
 
SUPPORTING NPD TEAMS IN INNOVATION: STRUCTURING USER DATA ON THE FOUNDATIONS ...
SUPPORTING NPD TEAMS IN INNOVATION: STRUCTURING USER DATA ON THE FOUNDATIONS ...SUPPORTING NPD TEAMS IN INNOVATION: STRUCTURING USER DATA ON THE FOUNDATIONS ...
SUPPORTING NPD TEAMS IN INNOVATION: STRUCTURING USER DATA ON THE FOUNDATIONS ...
 
Apps are for Humans
Apps are for HumansApps are for Humans
Apps are for Humans
 
Self ethnography for better user experience
Self ethnography for better user experienceSelf ethnography for better user experience
Self ethnography for better user experience
 
Touchpoint article: Service Prototyping in Action! www.service-design-network...
Touchpoint article: Service Prototyping in Action! www.service-design-network...Touchpoint article: Service Prototyping in Action! www.service-design-network...
Touchpoint article: Service Prototyping in Action! www.service-design-network...
 
Mobile UX-COE
Mobile UX-COEMobile UX-COE
Mobile UX-COE
 
Data analysis and synthesis
Data analysis and synthesisData analysis and synthesis
Data analysis and synthesis
 
Apply Funnel Model To Design Thinking Process
Apply Funnel Model To Design Thinking ProcessApply Funnel Model To Design Thinking Process
Apply Funnel Model To Design Thinking Process
 
TP2 Understanding the customer
TP2 Understanding the customerTP2 Understanding the customer
TP2 Understanding the customer
 
A theoritical model construction in user research by empathic design with per...
A theoritical model construction in user research by empathic design with per...A theoritical model construction in user research by empathic design with per...
A theoritical model construction in user research by empathic design with per...
 
Engelman.2011.exploring interaction modes for image retrieval
Engelman.2011.exploring interaction modes for image retrievalEngelman.2011.exploring interaction modes for image retrieval
Engelman.2011.exploring interaction modes for image retrieval
 
Ux design process
Ux design processUx design process
Ux design process
 
Personas_practice and theory by Pruitt & Grudin
Personas_practice and theory by Pruitt & GrudinPersonas_practice and theory by Pruitt & Grudin
Personas_practice and theory by Pruitt & Grudin
 
Ux presentation
Ux presentationUx presentation
Ux presentation
 
For, With, Through Design
For, With, Through DesignFor, With, Through Design
For, With, Through Design
 
User Centered Design Process to Develop a Multi-modal Family Needs Assessment...
User Centered Design Process to Develop a Multi-modal Family Needs Assessment...User Centered Design Process to Develop a Multi-modal Family Needs Assessment...
User Centered Design Process to Develop a Multi-modal Family Needs Assessment...
 
Design Thinking in Project Management for Innovation
Design Thinking in Project Management for InnovationDesign Thinking in Project Management for Innovation
Design Thinking in Project Management for Innovation
 
13 support designere
13 support designere13 support designere
13 support designere
 
Btp report linu&rupam
Btp report linu&rupamBtp report linu&rupam
Btp report linu&rupam
 

More from QuarterlyEarningsReports

citigroup April 17, 2000 - First Quarter Financial Supplement
citigroup April 17, 2000 - First Quarter Financial Supplementcitigroup April 17, 2000 - First Quarter Financial Supplement
citigroup April 17, 2000 - First Quarter Financial SupplementQuarterlyEarningsReports
 
citigroup April 17, 2000 - First Quarter Press Release
citigroup April 17, 2000 - First Quarter Press Releasecitigroup April 17, 2000 - First Quarter Press Release
citigroup April 17, 2000 - First Quarter Press ReleaseQuarterlyEarningsReports
 
citigroup July 19, 2000 - Second Quarter Financial Supplement
citigroup July 19, 2000 - Second Quarter Financial Supplementcitigroup July 19, 2000 - Second Quarter Financial Supplement
citigroup July 19, 2000 - Second Quarter Financial SupplementQuarterlyEarningsReports
 
citigroup July 19, 2000 - Second Quarter Press Release
citigroup  July 19, 2000 - Second Quarter Press Releasecitigroup  July 19, 2000 - Second Quarter Press Release
citigroup July 19, 2000 - Second Quarter Press ReleaseQuarterlyEarningsReports
 
citigroup October 17, 2000 - Third Quarter Press Release
citigroup October 17, 2000 - Third Quarter Press Releasecitigroup October 17, 2000 - Third Quarter Press Release
citigroup October 17, 2000 - Third Quarter Press ReleaseQuarterlyEarningsReports
 
citigroup January 16, 2001 - Fourth Quarter Financial Supplement
citigroup January 16, 2001 - Fourth Quarter Financial Supplementcitigroup January 16, 2001 - Fourth Quarter Financial Supplement
citigroup January 16, 2001 - Fourth Quarter Financial SupplementQuarterlyEarningsReports
 
citigroup January 16, 2001 - Fourth Quarter Press Release
citigroup January 16, 2001 - Fourth Quarter Press Releasecitigroup January 16, 2001 - Fourth Quarter Press Release
citigroup January 16, 2001 - Fourth Quarter Press ReleaseQuarterlyEarningsReports
 
citigroup April 16, 2001 - First Quarter Financial Supplement
citigroup April 16, 2001 - First Quarter  Financial Supplementcitigroup April 16, 2001 - First Quarter  Financial Supplement
citigroup April 16, 2001 - First Quarter Financial SupplementQuarterlyEarningsReports
 
citigroup April 16, 2001 - First Quarter Press Release
citigroup April 16, 2001 - First Quarter Press Releasecitigroup April 16, 2001 - First Quarter Press Release
citigroup April 16, 2001 - First Quarter Press ReleaseQuarterlyEarningsReports
 
citi July 16, 2001 - Second Quarter Financial Supplement
citi July 16, 2001 - Second Quarter Financial Supplementciti July 16, 2001 - Second Quarter Financial Supplement
citi July 16, 2001 - Second Quarter Financial SupplementQuarterlyEarningsReports
 
citigroup July 16, 2001 - Second Quarter Press Release
citigroup July 16, 2001 - Second Quarter Press Releasecitigroup July 16, 2001 - Second Quarter Press Release
citigroup July 16, 2001 - Second Quarter Press ReleaseQuarterlyEarningsReports
 
citigroup October 17, 2001 - Third Quarter Financial Supplement
citigroup October 17, 2001 - Third Quarter  Financial Supplementcitigroup October 17, 2001 - Third Quarter  Financial Supplement
citigroup October 17, 2001 - Third Quarter Financial SupplementQuarterlyEarningsReports
 
citigroup October 17, 2001 - Third Quarter Press Release
citigroup October 17, 2001 - Third Quarter Press Releasecitigroup October 17, 2001 - Third Quarter Press Release
citigroup October 17, 2001 - Third Quarter Press ReleaseQuarterlyEarningsReports
 
citigroup January 17, 2002 - Fourth Quarter Financial Supplement
citigroup January 17, 2002 - Fourth Quarter  Financial Supplementcitigroup January 17, 2002 - Fourth Quarter  Financial Supplement
citigroup January 17, 2002 - Fourth Quarter Financial SupplementQuarterlyEarningsReports
 

More from QuarterlyEarningsReports (20)

citigroup April 17, 2000 - First Quarter Financial Supplement
citigroup April 17, 2000 - First Quarter Financial Supplementcitigroup April 17, 2000 - First Quarter Financial Supplement
citigroup April 17, 2000 - First Quarter Financial Supplement
 
citigroup April 17, 2000 - First Quarter Press Release
citigroup April 17, 2000 - First Quarter Press Releasecitigroup April 17, 2000 - First Quarter Press Release
citigroup April 17, 2000 - First Quarter Press Release
 
citigroup Financial Supplement
citigroup Financial Supplementcitigroup Financial Supplement
citigroup Financial Supplement
 
citigroup July 19, 2000 - Second Quarter Financial Supplement
citigroup July 19, 2000 - Second Quarter Financial Supplementcitigroup July 19, 2000 - Second Quarter Financial Supplement
citigroup July 19, 2000 - Second Quarter Financial Supplement
 
citigroup July 19, 2000 - Second Quarter Press Release
citigroup  July 19, 2000 - Second Quarter Press Releasecitigroup  July 19, 2000 - Second Quarter Press Release
citigroup July 19, 2000 - Second Quarter Press Release
 
citigroup Financial Supplement
citigroup Financial Supplementcitigroup Financial Supplement
citigroup Financial Supplement
 
citigroup Financial Supplement
citigroup Financial Supplementcitigroup Financial Supplement
citigroup Financial Supplement
 
citigroup October 17, 2000 - Third Quarter Press Release
citigroup October 17, 2000 - Third Quarter Press Releasecitigroup October 17, 2000 - Third Quarter Press Release
citigroup October 17, 2000 - Third Quarter Press Release
 
citigroup January 16, 2001 - Fourth Quarter Financial Supplement
citigroup January 16, 2001 - Fourth Quarter Financial Supplementcitigroup January 16, 2001 - Fourth Quarter Financial Supplement
citigroup January 16, 2001 - Fourth Quarter Financial Supplement
 
citigroup January 16, 2001 - Fourth Quarter Press Release
citigroup January 16, 2001 - Fourth Quarter Press Releasecitigroup January 16, 2001 - Fourth Quarter Press Release
citigroup January 16, 2001 - Fourth Quarter Press Release
 
citigroup Financial Supplement
citigroup Financial Supplementcitigroup Financial Supplement
citigroup Financial Supplement
 
citigroup April 16, 2001 - First Quarter Financial Supplement
citigroup April 16, 2001 - First Quarter  Financial Supplementcitigroup April 16, 2001 - First Quarter  Financial Supplement
citigroup April 16, 2001 - First Quarter Financial Supplement
 
citigroup April 16, 2001 - First Quarter Press Release
citigroup April 16, 2001 - First Quarter Press Releasecitigroup April 16, 2001 - First Quarter Press Release
citigroup April 16, 2001 - First Quarter Press Release
 
citigroup Financial Supplement
citigroup Financial Supplementcitigroup Financial Supplement
citigroup Financial Supplement
 
citi July 16, 2001 - Second Quarter Financial Supplement
citi July 16, 2001 - Second Quarter Financial Supplementciti July 16, 2001 - Second Quarter Financial Supplement
citi July 16, 2001 - Second Quarter Financial Supplement
 
citigroup July 16, 2001 - Second Quarter Press Release
citigroup July 16, 2001 - Second Quarter Press Releasecitigroup July 16, 2001 - Second Quarter Press Release
citigroup July 16, 2001 - Second Quarter Press Release
 
citigroupFinancial Supplement
citigroupFinancial SupplementcitigroupFinancial Supplement
citigroupFinancial Supplement
 
citigroup October 17, 2001 - Third Quarter Financial Supplement
citigroup October 17, 2001 - Third Quarter  Financial Supplementcitigroup October 17, 2001 - Third Quarter  Financial Supplement
citigroup October 17, 2001 - Third Quarter Financial Supplement
 
citigroup October 17, 2001 - Third Quarter Press Release
citigroup October 17, 2001 - Third Quarter Press Releasecitigroup October 17, 2001 - Third Quarter Press Release
citigroup October 17, 2001 - Third Quarter Press Release
 
citigroup January 17, 2002 - Fourth Quarter Financial Supplement
citigroup January 17, 2002 - Fourth Quarter  Financial Supplementcitigroup January 17, 2002 - Fourth Quarter  Financial Supplement
citigroup January 17, 2002 - Fourth Quarter Financial Supplement
 

Recently uploaded

In-Depth Performance Testing Guide for IT Professionals
In-Depth Performance Testing Guide for IT ProfessionalsIn-Depth Performance Testing Guide for IT Professionals
In-Depth Performance Testing Guide for IT ProfessionalsExpeed Software
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
 
Introduction to Open Source RAG and RAG Evaluation
Introduction to Open Source RAG and RAG EvaluationIntroduction to Open Source RAG and RAG Evaluation
Introduction to Open Source RAG and RAG EvaluationZilliz
 
The architecture of Generative AI for enterprises.pdf
The architecture of Generative AI for enterprises.pdfThe architecture of Generative AI for enterprises.pdf
The architecture of Generative AI for enterprises.pdfalexjohnson7307
 
Powerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara LaskowskaPowerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara LaskowskaCzechDreamin
 
Search and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical FuturesSearch and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical FuturesBhaskar Mitra
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backElena Simperl
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
 
Salesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
Salesforce Adoption – Metrics, Methods, and Motivation, Antone KomSalesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
Salesforce Adoption – Metrics, Methods, and Motivation, Antone KomCzechDreamin
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...Product School
 
IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024IoTAnalytics
 
UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1DianaGray10
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Product School
 
Speed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in MinutesSpeed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in Minutesconfluent
 
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...CzechDreamin
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...Product School
 
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya HalderCustom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya HalderCzechDreamin
 
IESVE for Early Stage Design and Planning
IESVE for Early Stage Design and PlanningIESVE for Early Stage Design and Planning
IESVE for Early Stage Design and PlanningIES VE
 
Demystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John StaveleyDemystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John StaveleyJohn Staveley
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Alison B. Lowndes
 

Recently uploaded (20)

In-Depth Performance Testing Guide for IT Professionals
In-Depth Performance Testing Guide for IT ProfessionalsIn-Depth Performance Testing Guide for IT Professionals
In-Depth Performance Testing Guide for IT Professionals
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
 
Introduction to Open Source RAG and RAG Evaluation
Introduction to Open Source RAG and RAG EvaluationIntroduction to Open Source RAG and RAG Evaluation
Introduction to Open Source RAG and RAG Evaluation
 
The architecture of Generative AI for enterprises.pdf
The architecture of Generative AI for enterprises.pdfThe architecture of Generative AI for enterprises.pdf
The architecture of Generative AI for enterprises.pdf
 
Powerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara LaskowskaPowerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara Laskowska
 
Search and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical FuturesSearch and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical Futures
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
 
Salesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
Salesforce Adoption – Metrics, Methods, and Motivation, Antone KomSalesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
Salesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
 
IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024
 
UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
 
Speed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in MinutesSpeed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in Minutes
 
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
 
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya HalderCustom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
 
IESVE for Early Stage Design and Planning
IESVE for Early Stage Design and PlanningIESVE for Early Stage Design and Planning
IESVE for Early Stage Design and Planning
 
Demystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John StaveleyDemystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John Staveley
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
 

citigroup October 16, 2008 - Financial Supplement

  • 1. User Information for Designers: A Visual Research Package Anu Antikainen Mirja Kälviäinen Hugh Miller The Kuopio Academy of Design The Kuopio Academy of Design The Nottingham Trent University PL 98, 70101 PL 98, 70101 Burton Street Kuopio, Finland Kuopio, Finland Nottingham NG3 5DY, UK +358 (0)17 308135 +358 (0)17 308201 +44 (0)115 848 5550 anu.antikainen@designkuopio.fi mirja.kalviainen@designkuopio.fi hugh.miller@ntu.ac.uk developed by Pieter Jan Stappers at TUDelft, has been to use ABSTRACT multidimensional scaling to present complex characteristics of In this paper, we describe the development of a flexible, visually- products to consumers, and to allow them to manipulate the based on-line package, based on free sorting and multi- displays to emphasise those dimensions that interested them most dimensional scaling to help designers research users’ emotional [8]. The approach of presenting complex information in visual, and social responses to designed objects. preferably user-manipulable ways has been promoted by researchers like Ben Shneiderman [7], and consultancies like Categories and Subject Descriptors Doblin, with ‘innovation landscapes’ [2]. H.1.2 [Information Systems]: User-Machine Systems – human The multidimensional scaling approach used in the chair research factors. was evaluated by small design companies in Finland, who were General Terms: Human Factors asked if they could see ways of using this technique in their design process [5]. We found that designers felt comfortable with Keywords: Design and emotion, visual research, the kind of pictures the research produced. An analysis which gave them groups of pictures with different explanations of how multidimensional scaling, on-line methods the users saw them was useful from their point of view, and they could also see how such a presentation might be valuable in 1. INTRODUCTION discussing designs with management and with outside suppliers. Designed objects have a social and emotional impact on The present paper describes how the grouping method has been consumer’s lives, and researchers have tried to find ways of developed further and combined with other supporting methods to researching and describing these impacts. Approaches range from form a consistent software package that can serve researchers considering ways of characterising the personalities of objects [4], working with companies and in educational use. We set out to through using morphological analysis to find those ‘form present information in a visual, easily manipulated, exploratory elements’ that are associated with certain aspects of the object [1, way: a way which corresponds with the way that designers like to 3], to calculating numerical indices that indicate how the elements work. There are limitations in using purely pictorial of an object convey certain qualities [9]. Understanding how representations of physical objects, but it makes for a quick and objects are perceived by users should be helpful in the design easy presentation method, and designers we spoke to, who often process for producing enjoyable objects, but such research is often work with visual sketches in the early stages of developing a conducted after the design process is finished, and may produce project, found it an acceptable approach. The results can be used rather abstract results, often verbally- or numerically-based, rather either as a practical support for designers and marketing personnel than visual. in a company or to increase general understanding of users. This A visual research package for design development and marketing paper describes our intentions in developing this package. Once it research is being built by The Kuopio Academy of Design, based is complete, in fall 2003, we hope to go on to evaluate its on a method developed for evaluating chair designs by Hugh usefulness to small design companies. Miller and Mirja Kälviäinen [6]. The method of grouping items, based on free-sorting and multi-dimensional scaling, was intended 2. THE VISUAL RESEARCH PACKAGE to produce holistic, user-centred accounts of both social and DEVELOPMENT PROJECT design aspects of the objects. A complementary approach, 2.1 Aims The aim is to develop a tool which can obtain useful information Permission to make digital or hard copies of all or part of this work for to support the design process as well as other functions in a personal or classroom use is granted without fee provided that copies are company. The advantages are flexibility in designing research and not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. To copy speed in collecting and analysing data from a large number of otherwise, or republish, to post on servers or to redistribute to lists, respondents globally. Consequently time and financial resources requires prior specific permission and/or a fee. are saved compared to the manual process used in the original DPPI’03, June 23-26, 2003, Pittsburgh, Pennsylvania, USA. Copyright 2003 ACM 1-58113-652-8/03/0006…$5.00. 1
  • 2. with the combining version of grouping (i.e. finding out the order research. However, the software is not replacing personal user of preference in the ‘I would buy – would not buy’ example). research, but aims at giving supplementary information to designers and marketers that can be both qualitative and The semantic differential method in the traditional form can also quantitative. be used visually. The respondent is asked to set one to three pictures of, for example, products on a scale between a pair of Starting in fall 2001, The Kuopio Academy of Design started a words. This method is particularly useful when more accurate design-based EU-funded project titled Muotoiluparkki. One of the information from selected items is wanted after the grouping project aims was to develop the new software, with the active method. cooperation of the Lahti Design Research Institute, which operates as a research consultant in design and user research. It is Multiple choice can be used with words or with pictures. Verbal intended that the project will be finished by the end of 2003. questions can be used, for example, in collecting background information. Free text is used mainly as a supportive method, and 2.2 Components Of The Software Package could be used in other forms such as in a story-telling method, Although the software package under development is based on the which might be seen as a useful additional research method in grouping method, other approaches like semantic differential, some cases. multiple choice and free text have been added to make a more To briefly illustrate the application of the methods, short flexible research tool. Combining a variety of techniques gives the descriptions of practical company cases that we used in advantage of gaining results from various different perspectives. developing the package are presented. These are being used However, the grouping method is the primary research method throughout the development process to improve the package. and is thus generally used first. This method has been modified into several different versions to 2.3 The Furniture Company Case match different research settings (figure 1). The free sorting A Finnish furniture company has a large variety of products. One method using to a supplied theme or question is best applied to of their important product lines is sofas. To gain further gain information of product categorisations or to position a information of their market position and different consumer chosen product among other products in the market. In all forms groups’ taste they wanted to do research on their and competitors of grouping respondents are usually asked to describe their products by grouping. In addition, new product prototypes under choices after grouping items, which can be pictures or words. development are being included in the study (figure 2). A second version of grouping is called combining, in which there is one or several predetermined groups where the given items are placed. The respondent has freedom to place items into the groups, or to leave some items aside. A practical application could be to study which products are appealing (i.e. a box titled ‘I would buy’) and undesirable (i.e. ‘I would not buy). Alternatively a selection of descriptive words can be offered as items to be combined with two to four product (or other visual) pictures, which can be either prototypes or finalised products. Finally grouping can be arranged in a scale form, which resembles the semantic differential method. Organise the given pictures Move products you would buy and according to their potential users would not buy into the boxes below Figure 2: Free sorting Organise the given products on the pleasing – unpleasing scale 2.4 The Wooden Cutlery Case A Finnish wood processing company had invented a unique automated cutting mechanism, which enables all kinds of forms to be shaped from wood. As a challenging test product the company Pleasing Unpleasing decided to try producing a set of wooden cutlery. The visual research package was used to study what are the general attitudes Figure 1: Three versions of grouping; grouping freely, towards wood as a material for cutlery and how wood associates combining, and scale form with cooking and eating. Research questions include, for example, how wooden cutlery relates to steel, silver and plastic, and what are the ideal user environments (figures 3 and 4). Two opposing verbal definitions are set on two ends of the screen and the respondent arranges pictures on a scale or space between them. This way the information gained is more precise compared 2
  • 3. Figure 5: The visual research on emotions linked to the bathroom. After grouping the respondents are asked to describe the emotions that are linked to the pictures Figure 3: Grouping by combining is used to find out the most pleasing and displeasing fork forms 3. PRESENTATION OF RESULTS The results that are produced are presented in a form that is visual and easy to approach and work with. Each picture can be enlarged on the result screens. A package that is visual, flexible and provides a multiple way of presenting results should be easy for designers to approach and use in their visual work as opposed to the traditional, verbal or numerical research results. Interviews with designers have confirmed a need for these features [5]. The first screen of results from the grouping task is presented as a confusion matrix (figure 6). It simply shows how often each example has been grouped with each other example. The confusion matrix is an easy way to gain an overall picture of the results. However, other ways of presenting results are necessary to gain a more accurate view of general meanings behind groupings and meanings connected to individual groups. After viewing the confusion matrix the researcher has a choice of proceeding to either a two-dimensional plot formed when the confusion matrix is subjected to a multidimensional scaling analysis, or a network view that presents interlinkages between Figure 4: Grouping by combining is used to study a suitable different items. In the two-dimensional plot the dimensions are environment for wooden cutlery. given meanings by using the descriptions that arise from the grouping results as Miller and Kälviäinen [6] did in their study of chairs (Figure 7). The constrained sort can be analysed in the 2.5 Study of Emotions Linked to the same way. The visual scale shows small thumbnail pictures of the items studied. Explaining words or codes can be added to the Bathroom thumbnails. The results are read from the distances to other items Ido Bathrooms produces bathroom furnishing. The company was and the dimensions. interested in finding out about real and dreamt emotions people The results can also be presented as a network display (figure 8). link to their bathrooms. This information is intended to assist the Any item from the confusion matrix or the two-dimensional plot designer in his design process: the results will be part of his can be selected as the centre of the display. Items which were design brief. The study took two approaches: one which frequently grouped with that one will appear clustered round it, approaches emotions with a set of pictures such as buildings and with less-frequently chosen items a little further away. Selecting texture that are meant to match with emotions linked to the any item will move it to the middle of the screen, with an bathroom (figure 5), and another which aims at arising emotions appropriate rearrangement of the others. The same presentation through pictures presenting situations and actions. can be used for the words used to describe the groupings. 3
  • 4. Figure 6: The confusion matrix. The information is presented in numbers and different colours and shades. The stronger the shade, the more often the two examples were grouped together. Figure 7: Example of a two dimensional plot 4
  • 5. Results from the traditional form of semantic differential can be developing the package is that whenever users’ visual viewed on a screen similar to the one used for gathering the impressions are sought and two dimensional visual material is data. Additionally two scales can be combined to form a two sufficient, the visual research package could be applied. dimensional graphic, where the items are presented as 5. REFERENCES thumbnails. [1] Chuang, M-C. and Ma, Y-C., 2001, Expressing the Generally the results can be read in a flexible way. Clicking any expected product images in product design of micro- of the items in the result screens can fetch access to individual electronic products. International Journal of Industrial explanations. Also access to individual questionnaires or other Ergonomics, 27, pp. 233-245 results concerning each item can be opened directly from the [2] Doblin, 2003 Innovation Landscapes: Visualizing different screens. Everyone using the results of a certain research Innovation Available at can gather and save an individual collection of results in a http://www.doblin.com/landscapes/index.html personal file. [3] Hsiao, S-W. and Chen, C-H., 1997, A semantic and shape The visual research package aims to be a conceptual and grammar based approach for product design. Design exploratory tool that supports the work of designers and Studies, 18, pp. 275-296 marketing people in a company. In addition the results can aid discussion between designers, managers, and clients during the [4] Janlert, L-E. and Stolterman, E, 1997, The Character of product development process. Things. Design Studies, 18, pp. 297-314. [5] Kälviäinen, M. and Miller, H., in press, Researching Users’ Understanding of Products: An On-line Tool. In McDonagh, D., Hekkert, P., Gyi, D. and van Erp, J. (2003) Design and Emotion, Episode III: The Design of Everyday Things London: Taylor and Francis [6] Miller, H. and Kälviäinen, M., 2001, Objects for an Enjoyable Life: Social and Design Aspects. In Proceedings of the International Conference on Affective Human Factors Design (Singapore), edited by Helander, M., Khalid, H. M. and Ming Po, T. (London: Asean Academic Press), pp. 487-494. [7] Shneiderman, B., 1999 Dynamic queries, starfield displays, and the path to Spotfire Available at Figure 8: Example of a network display http://www.cs.umd.edu/hcil/spotfire/ [8] Stappers,P.J, Pasman,G. and Groenen, P.J.F., 2000, 4. CONCLUSIONS Exploring databases for taste or inspiration with interactive multi-dimensional scaling Proceedings of IEA 2000/HFES The practical examples discussed above show how the visual 2000 Ergonomics for the new Millenium San Diego July- research package can be used in various applications. The August 2000, pp 3.575-3.578. Available at development process of the visual research package is still under http://studiolab.io.tudelft.nl/gems/mdsi/MDSIPaeprIEA.pdf way, so the content presented here may change during the There is more information at process. Commercial and cooperative company cases are being http://studiolab.io.tudelft.nl/mdsi/ used throughout the project. Some interesting cases are product development for a multinational corporation, the development [9] Veryzer, R. W., 1997, Measuring Consumer perceptions in project for a new travelling vehicle, and an image study of the the Product Development Process. Design Management Kuopio soccer team corporate identity. The guiding idea in Journal, 8, pp. 66-71. 5