7.pdf This presentation captures many uses and the significance of the number...
Usability Test Comparison: Custom Ink vs Spread Shirt Design Websites
1. Usability Test of
Custom Ink and Spread Shirt
Comparison of Custom T-Shirt Design Websites
Nikki Imanaka
ENGL 317
2. Table of Contents
INTRODUCTION..................................................................................................................................3
METHODOLOGY .................................................................................................................................3
TASKS:............................................................................................................................................3
EQUIPTMENT/ENVIRONMENT:........................................................................................................3
DESIGN METRICS: ...........................................................................................................................3
EVALUATION:.................................................................................................................................4
TESTING:........................................................................................................................................4
RESULTS.............................................................................................................................................4
Task 1: ENTERING THE DESIGN LAB..................................................................................................4
Task 2: CHANGING STYLE AND COLOR..............................................................................................6
Task 3: UPLOADING CUSTOMDESIGNS ............................................................................................7
Task 4: USING BUILT IN DESIGNS......................................................................................................9
Task 5: VISUAL ORIENTATION ........................................................................................................10
Task 6: DESIGN FEEDBACK.............................................................................................................11
Task 7: SHARING DESIGN...............................................................................................................12
Task 8: FINALIZING AND PAYMENT.................................................................................................13
Task 9: GETTING A PRICE QUOTE ...................................................................................................14
Task 10: CUSTOMIZING FOR GROUPS/TEAMS.................................................................................15
OVERALL RESULTS:........................................................................................................................17
CONCLUSIONS/RECOMMENDATIONS:...............................................................................................17
BIBLIOGRAPHY.................................................................................................................................18
APPENDIX ........................................................................................................................................18
3. INTRODUCTION
Custom Ink and Spread Shirt are two free online t-shirt design websites. This white paper
presents the results of a usability test that compared how well each website performed in five
component standards that define usability.
METHODOLOGY
TASKS:
Ten tasks were evaluated on each website:
1. Enter the design lab and choose a t-shirt
2. Changing shirt style or color
3. Upload custom designs
4. Using built in designs
5. Visual representation of design (orientations)
6. Getting Design feedback
7. Share the design with other collaborators
8. Finalizing and payment options
9. Price quotes
10. Customizing for groups and teams
EQUIPTMENT/ENVIRONMENT:
This usability test of Custom Ink and Spread Shirt for first time users was conducted using
Google Chrome on a Lenovo using Windows 10.
Typical users could be working from home or at work or anywhere where someone has access
to the internet. Therefore, this usability test was conducted on a computer in a computer lab.
DESIGN METRICS:
Five design metrics will be tested in each website. These are my five criteria statements:
1. Effective: I was able to complete the task successfully without help from any outside
sources or the websites help option.
2. Efficient: I was able to complete the task in a realistic amount of time without getting
frustrated.
3. Engaging: The product/website is pleasing or satisfying to use.
4. Error Tolerant: The product/website helped me recover from errors and there was no
need to completely restart.
5. Easy to learn: I quickly became familiar with the website and its functions.
4. EVALUATION:
Each of these metrics will be evaluated on a Likert scale from 1 to 6 with 6 being the most
agreeable and 1 being the least. There is an even number of options so that when the user feels
in the middle they are somewhat forced to choose a side to help the evaluation.
Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
1 2 3 4 5 6
Based on the results from the Likert Scale, a total score will be calculated for each task. The
maximum score for each task will be 30 and maximum total score will be 300.
TESTING:
Sample t-shirtdesignswillbe createdfor bothwebsitesandmyvandal email will be usedtoshare
designswithcollaborators.
RESULTS
Task 1: ENTERING THE DESIGN LAB
Both websiteshada home page that made itveryclear how to getto theirdesignlab. Gettingstartedis
an importantpart of any website.If the usercannotfigure outhow tostart theymay justleave and
choose a differentwebsite.
Afterenteringthe designlabfeature usersare promptedtochoose ashirtstyle to designonforboth
websites.
5. Custominkhas a more visuallypleasinglayoutwithacontentnavigationbaronthe left.SpreadShirt
alsohas navigationbuttons,butitisoverall lessvisual. Myscoresforthistask are as follows:
I was able to complete the task successfully without outside help or the websites help option.
Effective Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
I was able to complete the task in a realistic amount of time without getting frustrated.
Efficient Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
The product/website is pleasing or satisfying to use.
Engaging Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
The website helped me recover from errors and there was no need to completely restart.
Error
Tolerant
Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
I quickly became familiar with the website and its functions.
Easy to
Learn
Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
6. Custom ink provides this Quick Tips visual as soon as you get into the design lab. This helps with
getting familiar with the website. They tell you exactly where everything is so you don’t have to
wonder where it is later.
Task 2: CHANGING STYLE AND COLOR
Afterenteringthe designlabandchoosingashirtstyle,yourealize thatyouwanttochange the shirtto
a longsleeve andyoualsowantto make it a red one. Bothwebsitesclearlyshow the “products”button
where youcan choose anothershirtstyle aswell asanothercolorto go withit.
7. Custominkseemsmore organizedbecause ittakesyoustepbystepthroughyourownthoughtprocess.
If you wantto change the color,clickhere,if youwantto change the product,clickhere.SpreadShirt
laysout all the differentoptionsall onthe same screenwhichmightbe alittle overwhelmingforfirst
time users.My ratingsare as follows:
I was able to complete the task successfully without outside help or the websites help option.
Effective Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
I was able to complete the task in a realistic amount of time without getting frustrated.
Efficient Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
The product/website is pleasing or satisfying to use.
Engaging Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
The website helped me recover from errors and there was no need to completely restart.
Error
Tolerant
Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
I quickly became familiar with the website and its functions.
Easy to
Learn
Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
Task 3: UPLOADING CUSTOM DESIGNS
For userswhoare usinga customdesignwebsite,manyof themmaywantto uploadtheirowncustom
designontoa t-shirt.Bothwebsiteshave avisible “upload”buttonontheirnavigationbarinthe design
lab.Custominkautomaticallyopensupall yourcomputercontentsandSpreadShirtgivesyouthree
options. SpreadShirtoffersthe options todraganddrop designs anduploadfromFacebook which
Custominkdoesnot offer.
8. My overall ratingsforthistaskare as follows:
I was able to complete the task successfully without outside help or the websites help option.
Effective Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
I was able to complete the task in a realistic amount of time without getting frustrated.
Efficient Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
The product/website is pleasing or satisfying to use.
Engaging Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
The website helped me recover from errors and there was no need to completely restart.
Error
Tolerant
Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
9. I quickly became familiar with the website and its functions.
Easy to
Learn
Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
Uploadeddesignsare juststoredinan“upload”sectionof the website.Uploadingthe wrongimage will
not cause any issues.
Task 4: USING BUILT IN DESIGNS
Both websiteshave builtindesignsthatuserscanselecttoprinton theirshirts.Bothsitesare very
intuitive touse andhave a searchbar. Some designsonSpreadShirtshave priceswhile otherssaythey
are free.InCustom Inkall the designsare unlabeledwhicheithermeanstheyare all free orthatthe
pricesare automaticallyaddedupinyourbill.
My ratingsfortask 4 isas follows:
I was able to complete the task successfully without outside help or the websites help option.
Effective Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
I was able to complete the task in a realistic amount of time without getting frustrated.
Efficient Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
The product/website is pleasing or satisfying to use.
10. Engaging Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
The website helped me recover from errors and there was no need to completely restart.
Error
Tolerant
Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
I quickly became familiar with the website and its functions.
Easy to
Learn
Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
Task 5: VISUAL ORIENTATION
Both websitesallowthe usertorotate the designtosee the frontand back of the shirt.Customink
showsthe shirton a humanbody whichgivesthe userabettersense of whatthe shirtwill looklike in
real life.SpreadShirtallowsdesigningtobe done onthe leftandrightsleevesof the shirtwhile custom
inkonlyallowsforfrontand back.Custominkhas twolittle dotsonthe bottom of the screenabove the
navigationbarwhichallowsyoutochoose whichside tolookat. Thisis verysubtle andcausesusersto
lookharderthan intended.SpreadShirtsusesaveryvisuallyclearmethod.There are 4 buttonsthat
allowyouto choose whatviewyouwouldlike tosee.
11. My ratingsonthistask are as follows:
I was able to complete the task successfully without outside help or the websites help option.
Effective Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
I was able to complete the task in a realistic amount of time without getting frustrated.
Efficient Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
The product/website is pleasing or satisfying to use.
Engaging Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
The website helped me recover from errors and there was no need to completely restart.
Error
Tolerant
Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
I quickly became familiar with the website and its functions.
Easy to
Learn
Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
Task 6: DESIGN FEEDBACK
It seemsthatthisisa feature onlyofferedbyCustomink.Somyratingsare as follows:
12. I was able to complete the task successfully without outside help or the websites help option.
Effective Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
I was able to complete the task in a realistic amount of time without getting frustrated.
Efficient Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
The product/website is pleasing or satisfying to use.
Engaging Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
The website helped me recover from errors and there was no need to completely restart.
Error
Tolerant
Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
I quickly became familiar with the website and its functions.
Easy to
Learn
Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
Task 7: SHARING DESIGN
Both websitesallowforsharingof designsbyclickingthe save/sharebutton.The onlythingrequiredis
an email address.
13. My ratingsare as follows:
I was able to complete the task successfully without outside help or the websites help option.
Effective Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
I was able to complete the task in a realistic amount of time without getting frustrated.
Efficient Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
The product/website is pleasing or satisfying to use.
Engaging Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
The website helped me recover from errors and there was no need to completely restart.
Error
Tolerant
Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
I quickly became familiar with the website and its functions.
Easy to
Learn
Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
Task 8: FINALIZING AND PAYMENT
Finalizingthe designandpayingiseasyforbothwebsites.Custominkusesa“$” nextbuttonandspread
shirtusesa price button.
14. Ratingsfor thistaskis as follows:
I was able to complete the task successfully without outside help or the websites help option.
Effective Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
I was able to complete the task in a realistic amount of time without getting frustrated.
Efficient Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
The product/website is pleasing or satisfying to use.
Engaging Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
The website helped me recover from errors and there was no need to completely restart.
Error
Tolerant
Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
I quickly became familiar with the website and its functions.
Easy to
Learn
Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
Task 9: GETTING A PRICE QUOTE
Gettinga price quote isprettytrivial.Youdo aboutthe same as you wouldwhencheckingoutand
actuallybuyingbutif youdon’tlike the price youdon’thave to buyit. The shirtshave pricesonthemso
whenyouchoose the style youknowabouthow much eachshirt will costandthe designsaddto the
price dependingonhowmanydesignsyouadd.
I was able to complete the task successfully without outside help or the websites help option.
Effective Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
15. I was able to complete the task in a realistic amount of time without getting frustrated.
Efficient Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
The product/website is pleasing or satisfying to use.
Engaging Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
The website helped me recover from errors and there was no need to completely restart.
Error
Tolerant
Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
I quickly became familiar with the website and its functions.
Easy to
Learn
Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
Task 10: CUSTOMIZING FOR GROUPS/TEAMS
Customshirtdesignisuseda lot for teamsand groupsso itwouldbe nice to be able to orderthe same
shirtwithvariousnamesandnumbersonit. Custominkprovidesthatoptiononthe navigationbar,but
Spreadshirtdoesnot.
16. I was able to complete the task successfully without outside help or the websites help option.
Effective Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
I was able to complete the task in a realistic amount of time without getting frustrated.
Efficient Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
The product/website is pleasing or satisfying to use.
Engaging Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
The website helped me recover from errors and there was no need to completely restart.
Error
Tolerant
Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
I quickly became familiar with the website and its functions.
Easy to
Learn
Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
Custom Ink 1 2 3 4 5 6
Spread Shirt 1 2 3 4 5 6
17. OVERALL RESULTS:
Total points
Custom Ink 289
Spread Shirts 254
CONCLUSIONS/RECOMMENDATIONS:
The two websitesare wellmade intermsof usability.Theybothtake the userstepbystepthroughthe
processof designingacustomt-shirt.The navigationthroughthe designlabiseasytogetfamiliarwith.
Overall,Ithinkthatcustomink wouldbe myfirstchoice.Ithas more to offerwhenitcomesto design
supportand makingbulkordersforgroupsand teams.It alsoismore pleasingtouse whenitcomesto
seeingthe designonahumanbodyand searchingthroughthe designart.Spreadshirtdidoffera couple
thingsthat custominkdidnot.For example,the draganddrop feature foruploadingcustomartand the
optiontodesignonthe sleevesof the shirts.
For custominkI wouldrecommendabettervisual forrotating the designfrombackto frontinsteadof
justthe two little dotsonthe bottom.
For spreadshirtI wouldrecommendaddingateam/grouporderingfeature andIwoulddesignthe laba
little differentlymakingthe designedshirtabiggerpart of the screen.
0
5
10
15
20
25
30
35
Task 1 Task 2 Task 3 Task 4 Task 5 Task 6 Task 7 Task 8 Task 9 Task 10
Test Metrics Results
CustomInk SpreadShirt
18. BIBLIOGRAPHY
https://www.customink.com/
https://www.spreadshirt.com/?gclid=EAIaIQobChMIw96E4LfL1wIVlshkCh2MSACjEAAYASAAEgK
hqPD_BwE&affiliateID=7394&s_kwcid=AL!312!3!115712399364!e!!g!!spread%20shirt&ef_id=W
fU7dAAABAsYvZOV:20171119200501:s
APPENDIX
TenTasks:
1. Enter the design lab and choose a t-shirt
2. Changing shirt style or color
3. Upload custom designs
4. Using built in designs
5. Visual representation of design (orientations)
6. Getting Design feedback
7. Share the design with other collaborators
8. Finalizing and payment options
9. Price quotes
10. Customizing for groups and teams
Likert Tables:
I was able to complete the task successfully without outside help or the websites help
option.
I was able to complete the task in a realistic amount of time without getting frustrated.
The product/website is pleasing or satisfying to use.
The website helped me recover from errors and there was no need to completely
restart.
I quickly became familiar with the website and its functions.
Strongly
Disagree
Disagree Somewhat
Disagree
Somewhat
Agree
Agree Strongly
Agree
1 2 3 4 5 6