Topic 7 Product Evaluation


Published on

Product Evaluation

  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Topic 7 Product Evaluation

    1. 1. Topic 7 Evaluation Evaluation and Designing
    2. 2. Examine the following products
    3. 4. Product Evaluation <ul><li>The following photographs show some of the different lemon squeezers that have been made through history.  They range in size, price, material, effectiveness and attractiveness </li></ul><ul><li>Look at the pictures of the lemon squeezers below, the designs may have changed over the years but does this make the newer versions more effective? </li></ul>
    5. 6. A wooden fruit squeezer (above) - this simple squeezer is a modern but the design is Victorian
    6. 7. Starck's Juicy Salif (above)- The juicer was designed in 1988 by the French designer Philippe Starck
    7. 8. A modern novelty juicer  
    8. 9. A modern representation of a Victorian glass lemon squeezer
    9. 10. A modern simple hinged fruit squeezer
    10. 11. A simple modern plastic lemon squeezer
    11. 12. Product Evaluation <ul><li>Does this equipment encourage people to prepare and cook food? </li></ul><ul><li>Is one of the lemon squeezers more efficient than the others? </li></ul><ul><li>Is there a difference in price?  </li></ul>
    12. 13. Evaluation Models <ul><li>Try answering these questions: </li></ul><ul><ul><li>Describe how each of the lemon squeezers works? </li></ul></ul><ul><ul><li>Evaluate the different squeezers using the evaluation model ACCESS FM: </li></ul></ul><ul><ul><ul><li>Aesthetics </li></ul></ul></ul><ul><ul><ul><li>Cost </li></ul></ul></ul><ul><ul><ul><li>Customer </li></ul></ul></ul><ul><ul><ul><li>Environment </li></ul></ul></ul><ul><ul><ul><li>Safety </li></ul></ul></ul><ul><ul><ul><li>Size </li></ul></ul></ul><ul><ul><ul><li>Function </li></ul></ul></ul><ul><ul><ul><li>Materials </li></ul></ul></ul>
    13. 14. Evaluation Models <ul><li>Evaluate the different squeezers using the evaluation model PIM’s </li></ul>POSITIVE INTERESTING MINUS
    14. 15. Evaluation <ul><li>Evaluation is the systematic assessment of the worth or merit of some object </li></ul><ul><li>Evaluation is the systematic acquisition and assessment of information to provide useful feedback about some object </li></ul><ul><li>Goals of evaluation </li></ul><ul><ul><li>most evaluations is to provide &quot;useful feedback“ </li></ul></ul><ul><ul><li>the major goal of evaluation should be to influence decision-making </li></ul></ul>
    15. 16. Types of Evaluation <ul><li>Formative evaluation includes several evaluation types : </li></ul><ul><ul><li>needs assessment determines who needs the program, how great the need is, and what might work to meet the need </li></ul></ul><ul><ul><li>evaluability assessment determines whether an evaluation is feasible and how stakeholders can help shape its usefulness </li></ul></ul><ul><ul><li>structured conceptualization helps stakeholders define the program or technology, the target population, and the possible outcomes </li></ul></ul><ul><ul><li>implementation evaluation monitors the fidelity of the program or technology delivery </li></ul></ul><ul><ul><li>process evaluation investigates the process of delivering the program or technology, including alternative delivery procedures </li></ul></ul>
    16. 17. Types of Evaluation <ul><li>Summative evaluation can also be subdivided: </li></ul><ul><ul><li>outcome evaluations investigate whether the program or technology caused demonstrable effects on specifically defined target outcomes </li></ul></ul><ul><ul><li>impact evaluation is broader and assesses the overall or net effects (intended or unintended) of the program or technology as a whole </li></ul></ul><ul><ul><li>cost-effectiveness and cost-benefit analysis address questions of efficiency by standardizing outcomes in terms of their dollar costs and values </li></ul></ul><ul><ul><li>secondary analysis reexamines existing data to address new questions or use methods not previously employed </li></ul></ul><ul><ul><li>meta-analysis integrates the outcome estimates from multiple studies to arrive at an overall or summary judgment on an evaluation question </li></ul></ul>
    17. 18. Evaluation Strategies <ul><li>Qualitative Evaluation </li></ul><ul><ul><li>Is an assessment process that answers the question, &quot;How well did we do?&quot; </li></ul></ul><ul><li>Quantitative Evaluation </li></ul><ul><ul><li>Is an assessment process that answers the question, &quot;How much did we do?&quot; </li></ul></ul><ul><li>Tests, models and experiments are used at the design development stage of the design cycle </li></ul><ul><li>Evaluating ideas, before developing a chosen solution </li></ul>
    18. 19. Literature Search <ul><li>The process of carrying out a systematic (and usually exhaustive) search of the literature on a given topic. It is usually the first step in a research project. </li></ul><ul><li>A review of the literature this is important for a research project because it enables you to </li></ul><ul><li>acquire an understanding </li></ul><ul><li>of your topic, with its key </li></ul><ul><li>issues, and an awareness </li></ul><ul><li>of relevant research </li></ul><ul><li>that has already been </li></ul><ul><li>conducted. </li></ul>
    19. 20. User Trial <ul><li>Experimental investigation in which a group of users test versions of a product under controlled conditions (Pheasant 1996), usability trial within research </li></ul><ul><li>Systematic heuristic (trail and error) or experimental evaluation of the interaction between people and the products, equipment and environments they use </li></ul>
    20. 21. User Research <ul><li>When undertaking user research, you are effectively asking questions of users. The types of questions you want to ask define or limit the appropriate type of research. Questions for users include: </li></ul><ul><ul><li>How well is the existing product supporting them? What do they like and dislike? </li></ul></ul><ul><ul><li>Do they have a wish-list for what the product should do? </li></ul></ul><ul><ul><li>Do they understand the meaning of a specific function, page, menu or screen? </li></ul></ul><ul><ul><li>Can they complete the tasks they want? </li></ul></ul><ul><ul><li>What is their emotional reaction to a design concept or product? </li></ul></ul><ul><ul><li>Do they value a product (whether existing or proposed)? </li></ul></ul><ul><ul><li>What alternative or additional methods, channels or tools are they using? </li></ul></ul><ul><ul><li>Are they using any workarounds? </li></ul></ul><ul><ul><li>What are their concerns about a product? </li></ul></ul><ul><ul><li>Do they understand the navigation, terminology and behavior of the product? </li></ul></ul>
    21. 22. Expert Appraisal <ul><li>Is the evaluation of a product or service by someone who has the professional training or experience to make an informed judgment on the design. Ideally, this person should not be biased by former involvement with the product since familiarity with any product or task makes it seem simpler and easier. Expert appraisal can be used to </li></ul><ul><ul><li>Identify possible causes of design exclusion </li></ul></ul><ul><ul><li>Suggest improvements to reduce this exclusion </li></ul></ul><ul><ul><li>Increase user satisfaction </li></ul></ul>
    22. 23. Advantages / Disadvantages ADVANTAGES DISADVANTAGES Literature Search Many sources of information are available. Use of ICT to access information, online books, periodicals enhances the search of information, speed and cost , storage & security are all considerations. An abundance of data which can be time consuming. User Trial User trail data is collected by observing users behaviour. The “user” is a non-specialist which makes trials easier and cost effective. “ Users” may carry out tasks in different ways from those expected and be inexperienced in data collection. User Research User research is collected by obtaining users’ responses to questions. Data is relatively easy and cheap to obtain. The data is usually qualitative. Expert Appraisal Expert knowledge and advice are gained. The expert may be biased Locating an expert may be difficult and expensive. The data is usually qualitative.