The document discusses design requirements and existing approaches for accessible shopping systems for blind and visually impaired individuals. It identifies several key design requirements based on focus groups with visually impaired individuals, including requirements for mobile product selection, store navigation, product search, product identification, utilization of existing devices, and minimal environmental adjustment. It then analyzes several existing accessible shopping systems (RoboCart, ShopTalk) and how well they meet these design requirements. In general, existing systems only partially meet the requirements, providing motivation for further research and development to better support independent shopping by the visually impaired.
ShopTalk: Independent Blind Shopping Through Verbal Route Directions and Barc...Vladimir Kulyukin
Independent shopping in modern grocery stores that carry thousands of products is a great challenge for people
with visual impairments. ShopTalk is a proof-of-concept wearable system designed to assist visually impaired shoppers
with finding shelved products in grocery stores. Using synthetic verbal route directions and descriptions of the store layout,
ShopTalk leverages the everyday orientation and mobility skills of independent visually impaired travelers to direct
them to aisles with target products. Inside aisles, an off-the-shelf barcode scanner is used in conjunction with a software
data structure, called a barcode connectivity matrix, to locate target product on shelves. Two experiments were performed
at a real world supermarket. A successful earlier single-subject experiment is summarized and a new experiment involving
ten visually impaired participants is presented. In both experiments, ShopTalk was successfully used to guide visually impaired
shoppers to multiple products located in aisles on shelves. ShopTalk is a feasible system for guiding visually impaired
shoppers who are skilled, independent travelers. Its design does not require any hardware instrumentation of the
store and leads to low installation and maintenance costs.
On Sufficiency of Verbal Instructions for Independent Blind ShoppingVladimir Kulyukin
A field study of independent blind shopping in a modern supermarket suggests that
verbal instructions may be sufficient for retrieving shelved products.
ShopTalk: Independent Blind Shopping Through Verbal Route Directions and Barc...Vladimir Kulyukin
Independent shopping in modern grocery stores that carry thousands of products is a great challenge for people
with visual impairments. ShopTalk is a proof-of-concept wearable system designed to assist visually impaired shoppers
with finding shelved products in grocery stores. Using synthetic verbal route directions and descriptions of the store layout,
ShopTalk leverages the everyday orientation and mobility skills of independent visually impaired travelers to direct
them to aisles with target products. Inside aisles, an off-the-shelf barcode scanner is used in conjunction with a software
data structure, called a barcode connectivity matrix, to locate target product on shelves. Two experiments were performed
at a real world supermarket. A successful earlier single-subject experiment is summarized and a new experiment involving
ten visually impaired participants is presented. In both experiments, ShopTalk was successfully used to guide visually impaired
shoppers to multiple products located in aisles on shelves. ShopTalk is a feasible system for guiding visually impaired
shoppers who are skilled, independent travelers. Its design does not require any hardware instrumentation of the
store and leads to low installation and maintenance costs.
On Sufficiency of Verbal Instructions for Independent Blind ShoppingVladimir Kulyukin
A field study of independent blind shopping in a modern supermarket suggests that
verbal instructions may be sufficient for retrieving shelved products.
Co-presented with Mars Petcare on "Disrupting the habitual consumer decision ...SKIM
Download this presentation on our website https://goo.gl/bNrPri
In the new omnichannel reality of consumer behaviors, we and Mars Petcare talked about a new framework of uncovering consumer decision journey insights centered around disruption and cross-category learnings when applying this framework. By adopting a designer mentality, we also shared tips and best practices on activating journey insights to create best-in-class consumer experiences.
How on-line community research can help brands keep their finger on the pulse of shoppers' decision making.
Coca-Cola is one of the world’s strongest brands, delivering consistently high brand equity scores and generating a huge amount of brand love across generations. As the soft drinks market becomes increasingly competitive and diversified, a major challenge for Coca-Cola is ensuring that shoppers continue to actually pick the product up and put it in the supermarket trolley, convenience store basket, the drinks holder in the car, or to open on the bus journey home. In short, the brand faces an on-going challenge to ensure consistent conversion from brand love to purchase and consumption.
This paper outlines some of the approach, some of the learning, and some of the principles from several different studies conducted by Coca-Cola in GB and Ireland between 2008 and 2010.
Written by Philip McNaughton and Beth Corte-Real for Esomar 2011 event.
Open Inclusion Consumer and Market Insights. WALL18 London, 08022018Open Inclusion
A quantitative and qualitative insightful research report on digital accessibility for business, including exposing the myths of why people don't make their digital products accessible.
A presentation of a college project explaining the issue of local vendors during the covid . We have presented a solution in the form of an android app which will help the local vendors to stay in the market of internet beside big giants like grofers, big basket and all others with a different approach.
UNDERSTANDING CONSUMERS- ONLINE PURCHASING BEHAVIOURS IN PUNE CITYJournal For Research
The Internet has captivated the attention of retail marketers. The Internet, as a retail outlet, is moving from its infancy used by only a few to a market with significant potential. The purpose of the study was to explore the attitudes of respondents toward purchasing products on the internet. Four groups of respondents were examined. To attract all four groups of consumers to Internet buying, e-tailers need to tailer specific parts of his or her marketing campaign to meet the specific demands and needs of each group. When testing the research results, the consumer factor and marketing factor had adequate internal consistency, while the technology factor failed to give any meaningful conclusions. The Internet buyers group and non-buyers groups shared dissimilar attitudes towards consumer and marketing factors. Internet buyers group and non-buyers group significantly varied in their intention to make online purchases.
An Evaluation of the Effect of Consumer Characteristics on Retail Format Patr...Dr. Amarjeet Singh
Consumer is prime factor in retailing. A customer
can adapt various buying roles like initiator, influencer,
decider, buyer, preparer, maintainer and disposer in
purchasing and using the products. Buying behavior helps
marketers learn the intensity and degree of involvement of
customers in purchasing the products. Studies that link
customer service to factors such as demographic,
psychographic characteristics and store format choice are
rather limited and under studied despite the fact of the
discovery that individual characteristics of consumers
influence their shopping behavior. Despite its importance
and its contribution toward better understanding of
consumer purchasing behavior, there is still lack of research
in this area especially in the retail sector. In validating the
measurements and investigating 650 questionnaires were
filled by shoppers. The research concluded with a
discussion on management implications as well as
recommendations that suppliers should supply the good
in shopping malls through considering their demographic
and psychographic responses.
Digitizing Buzzing Signals into A440 Piano Note Sequences and Estimating Fora...Vladimir Kulyukin
Digitizing Buzzing Signals into A440 Piano Note Sequences and Estimating Forager Traffic Levels from Images in Solar-Powered, Electronic Beehive Monitoring
More Related Content
Similar to Accessible Shopping Systems for Blind and Visually Impaired Individuals: Design Requirements and the State of the Art
Co-presented with Mars Petcare on "Disrupting the habitual consumer decision ...SKIM
Download this presentation on our website https://goo.gl/bNrPri
In the new omnichannel reality of consumer behaviors, we and Mars Petcare talked about a new framework of uncovering consumer decision journey insights centered around disruption and cross-category learnings when applying this framework. By adopting a designer mentality, we also shared tips and best practices on activating journey insights to create best-in-class consumer experiences.
How on-line community research can help brands keep their finger on the pulse of shoppers' decision making.
Coca-Cola is one of the world’s strongest brands, delivering consistently high brand equity scores and generating a huge amount of brand love across generations. As the soft drinks market becomes increasingly competitive and diversified, a major challenge for Coca-Cola is ensuring that shoppers continue to actually pick the product up and put it in the supermarket trolley, convenience store basket, the drinks holder in the car, or to open on the bus journey home. In short, the brand faces an on-going challenge to ensure consistent conversion from brand love to purchase and consumption.
This paper outlines some of the approach, some of the learning, and some of the principles from several different studies conducted by Coca-Cola in GB and Ireland between 2008 and 2010.
Written by Philip McNaughton and Beth Corte-Real for Esomar 2011 event.
Open Inclusion Consumer and Market Insights. WALL18 London, 08022018Open Inclusion
A quantitative and qualitative insightful research report on digital accessibility for business, including exposing the myths of why people don't make their digital products accessible.
A presentation of a college project explaining the issue of local vendors during the covid . We have presented a solution in the form of an android app which will help the local vendors to stay in the market of internet beside big giants like grofers, big basket and all others with a different approach.
UNDERSTANDING CONSUMERS- ONLINE PURCHASING BEHAVIOURS IN PUNE CITYJournal For Research
The Internet has captivated the attention of retail marketers. The Internet, as a retail outlet, is moving from its infancy used by only a few to a market with significant potential. The purpose of the study was to explore the attitudes of respondents toward purchasing products on the internet. Four groups of respondents were examined. To attract all four groups of consumers to Internet buying, e-tailers need to tailer specific parts of his or her marketing campaign to meet the specific demands and needs of each group. When testing the research results, the consumer factor and marketing factor had adequate internal consistency, while the technology factor failed to give any meaningful conclusions. The Internet buyers group and non-buyers groups shared dissimilar attitudes towards consumer and marketing factors. Internet buyers group and non-buyers group significantly varied in their intention to make online purchases.
An Evaluation of the Effect of Consumer Characteristics on Retail Format Patr...Dr. Amarjeet Singh
Consumer is prime factor in retailing. A customer
can adapt various buying roles like initiator, influencer,
decider, buyer, preparer, maintainer and disposer in
purchasing and using the products. Buying behavior helps
marketers learn the intensity and degree of involvement of
customers in purchasing the products. Studies that link
customer service to factors such as demographic,
psychographic characteristics and store format choice are
rather limited and under studied despite the fact of the
discovery that individual characteristics of consumers
influence their shopping behavior. Despite its importance
and its contribution toward better understanding of
consumer purchasing behavior, there is still lack of research
in this area especially in the retail sector. In validating the
measurements and investigating 650 questionnaires were
filled by shoppers. The research concluded with a
discussion on management implications as well as
recommendations that suppliers should supply the good
in shopping malls through considering their demographic
and psychographic responses.
Digitizing Buzzing Signals into A440 Piano Note Sequences and Estimating Fora...Vladimir Kulyukin
Digitizing Buzzing Signals into A440 Piano Note Sequences and Estimating Forager Traffic Levels from Images in Solar-Powered, Electronic Beehive Monitoring
Many problems in information retrieval and related fields depend on a reliable measure of the distance or similarity between objects that, most frequently, are represented
as vectors. This paper considers vectors of bits. Such data structures implement entities as diverse as bitmaps that indicate the occurrences of terms and bitstrings indicating the presence
of edges in images. For such applications, a popular distance measure is the Hamming distance. The value of the Hamming distance for information retrieval applications is limited by the
fact that it counts only exact matches, whereas in information retrieval, corresponding bits that are close by can still be considered to be almost identical. We define a "Generalized
Hamming distance" that extends the Hamming concept to give partial credit for near misses, and suggest a dynamic programming algorithm that permits it to be computed efficiently.
We envision many uses for such a measure. In this paper we define and prove some basic properties of the :Generalized Hamming distance," and illustrate its use in the area of object
recognition. We evaluate our implementation in a series of experiments, using autonomous robots to test the measure's effectiveness in relating similar bitstrings.
Adapting Measures of Clumping Strength to Assess Term-Term SimilarityVladimir Kulyukin
Automated information retrieval relies heavily on statistical regularities that emerge as terms are deposited to produce text. This paper examines statistical patterns expected of a pair of
terms that are semantically related to each other. Guided by a conceptualization of the text generation process, we derive measures of how tightly two terms are semantically associated.
Our main objective is to probe whether such measures yields reasonable results. Specifically, we examine how the tendency of a content bearing term to clump, as quantified by previously
developed measures of term clumping, is influenced by the presence of other terms. This
approach allows us to present a toolkit from which a range of measures can be constructed.
As an illustration, one of several suggested measures is evaluated on a large text corpus built from an on-line encyclopedia.
Vision-Based Localization and Scanning of 1D UPC and EAN Barcodes with Relaxe...Vladimir Kulyukin
V. Kulyukin & T. Zaman. "Vision-Based Localization and Scanning of 1D UPC and EAN Barcodes with Relaxed Pitch, Roll, and Yaw Camera A lignment Constraints." International Journal of Image Processing (IJIP), V olume (8) : Issue (5) : 2014, pp. 355-383.
Toward Blind Travel Support through Verbal Route Directions: A Path Inference...Vladimir Kulyukin
The work presented in this article continues our investigation of such assisted navigation solutions where the
main emphasis is placed not on sensor sets or sensor fusion algorithms but on the ability of the travelers to interpret and
contextualize verbal route directions en route. This work contributes to our investigation of the research hypothesis that
we have formulated and partially validated in our previous studies: if a route is verbally described in sufficient and
appropriate amount of detail, independent VI travelers can use their O&M and problem solving skills to successfully
follow the route without any wearable sensors or sensors embedded in the environment.
In this investigation, we temporarily put aside the issue of how VI and blind travelers successfully interpret route
directions en route and tackle the question of how those route directions can be created, generated, and maintained by
online communities. In particular, we focus on the automation of path inference and present an algorithm that may be used
as part of the background computation of VGI sites to find new paths in the previous route directions written by online
community members, generate new route descriptions from them, and post them for subsequent community editing.
Phenomics assisted breeding in crop improvementIshaGoswami9
As the population is increasing and will reach about 9 billion upto 2050. Also due to climate change, it is difficult to meet the food requirement of such a large population. Facing the challenges presented by resource shortages, climate
change, and increasing global population, crop yield and quality need to be improved in a sustainable way over the coming decades. Genetic improvement by breeding is the best way to increase crop productivity. With the rapid progression of functional
genomics, an increasing number of crop genomes have been sequenced and dozens of genes influencing key agronomic traits have been identified. However, current genome sequence information has not been adequately exploited for understanding
the complex characteristics of multiple gene, owing to a lack of crop phenotypic data. Efficient, automatic, and accurate technologies and platforms that can capture phenotypic data that can
be linked to genomics information for crop improvement at all growth stages have become as important as genotyping. Thus,
high-throughput phenotyping has become the major bottleneck restricting crop breeding. Plant phenomics has been defined as the high-throughput, accurate acquisition and analysis of multi-dimensional phenotypes
during crop growing stages at the organism level, including the cell, tissue, organ, individual plant, plot, and field levels. With the rapid development of novel sensors, imaging technology,
and analysis methods, numerous infrastructure platforms have been developed for phenotyping.
Observation of Io’s Resurfacing via Plume Deposition Using Ground-based Adapt...Sérgio Sacani
Since volcanic activity was first discovered on Io from Voyager images in 1979, changes
on Io’s surface have been monitored from both spacecraft and ground-based telescopes.
Here, we present the highest spatial resolution images of Io ever obtained from a groundbased telescope. These images, acquired by the SHARK-VIS instrument on the Large
Binocular Telescope, show evidence of a major resurfacing event on Io’s trailing hemisphere. When compared to the most recent spacecraft images, the SHARK-VIS images
show that a plume deposit from a powerful eruption at Pillan Patera has covered part
of the long-lived Pele plume deposit. Although this type of resurfacing event may be common on Io, few have been detected due to the rarity of spacecraft visits and the previously low spatial resolution available from Earth-based telescopes. The SHARK-VIS instrument ushers in a new era of high resolution imaging of Io’s surface using adaptive
optics at visible wavelengths.
Comparing Evolved Extractive Text Summary Scores of Bidirectional Encoder Rep...University of Maribor
Slides from:
11th International Conference on Electrical, Electronics and Computer Engineering (IcETRAN), Niš, 3-6 June 2024
Track: Artificial Intelligence
https://www.etran.rs/2024/en/home-english/
Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...Sérgio Sacani
We characterize the earliest galaxy population in the JADES Origins Field (JOF), the deepest
imaging field observed with JWST. We make use of the ancillary Hubble optical images (5 filters
spanning 0.4−0.9µm) and novel JWST images with 14 filters spanning 0.8−5µm, including 7 mediumband filters, and reaching total exposure times of up to 46 hours per filter. We combine all our data
at > 2.3µm to construct an ultradeep image, reaching as deep as ≈ 31.4 AB mag in the stack and
30.3-31.0 AB mag (5σ, r = 0.1” circular aperture) in individual filters. We measure photometric
redshifts and use robust selection criteria to identify a sample of eight galaxy candidates at redshifts
z = 11.5 − 15. These objects show compact half-light radii of R1/2 ∼ 50 − 200pc, stellar masses of
M⋆ ∼ 107−108M⊙, and star-formation rates of SFR ∼ 0.1−1 M⊙ yr−1
. Our search finds no candidates
at 15 < z < 20, placing upper limits at these redshifts. We develop a forward modeling approach to
infer the properties of the evolving luminosity function without binning in redshift or luminosity that
marginalizes over the photometric redshift uncertainty of our candidate galaxies and incorporates the
impact of non-detections. We find a z = 12 luminosity function in good agreement with prior results,
and that the luminosity function normalization and UV luminosity density decline by a factor of ∼ 2.5
from z = 12 to z = 14. We discuss the possible implications of our results in the context of theoretical
models for evolution of the dark matter halo mass function.
Richard's aventures in two entangled wonderlandsRichard Gill
Since the loophole-free Bell experiments of 2020 and the Nobel prizes in physics of 2022, critics of Bell's work have retreated to the fortress of super-determinism. Now, super-determinism is a derogatory word - it just means "determinism". Palmer, Hance and Hossenfelder argue that quantum mechanics and determinism are not incompatible, using a sophisticated mathematical construction based on a subtle thinning of allowed states and measurements in quantum mechanics, such that what is left appears to make Bell's argument fail, without altering the empirical predictions of quantum mechanics. I think however that it is a smoke screen, and the slogan "lost in math" comes to my mind. I will discuss some other recent disproofs of Bell's theorem using the language of causality based on causal graphs. Causal thinking is also central to law and justice. I will mention surprising connections to my work on serial killer nurse cases, in particular the Dutch case of Lucia de Berk and the current UK case of Lucy Letby.
This presentation explores a brief idea about the structural and functional attributes of nucleotides, the structure and function of genetic materials along with the impact of UV rays and pH upon them.
Salas, V. (2024) "John of St. Thomas (Poinsot) on the Science of Sacred Theol...Studia Poinsotiana
I Introduction
II Subalternation and Theology
III Theology and Dogmatic Declarations
IV The Mixed Principles of Theology
V Virtual Revelation: The Unity of Theology
VI Theology as a Natural Science
VII Theology’s Certitude
VIII Conclusion
Notes
Bibliography
All the contents are fully attributable to the author, Doctor Victor Salas. Should you wish to get this text republished, get in touch with the author or the editorial committee of the Studia Poinsotiana. Insofar as possible, we will be happy to broker your contact.
Seminar of U.V. Spectroscopy by SAMIR PANDASAMIR PANDA
Spectroscopy is a branch of science dealing the study of interaction of electromagnetic radiation with matter.
Ultraviolet-visible spectroscopy refers to absorption spectroscopy or reflect spectroscopy in the UV-VIS spectral region.
Ultraviolet-visible spectroscopy is an analytical method that can measure the amount of light received by the analyte.
Professional air quality monitoring systems provide immediate, on-site data for analysis, compliance, and decision-making.
Monitor common gases, weather parameters, particulates.
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...University of Maribor
Slides from talk:
Aleš Zamuda: Remote Sensing and Computational, Evolutionary, Supercomputing, and Intelligent Systems.
11th International Conference on Electrical, Electronics and Computer Engineering (IcETRAN), Niš, 3-6 June 2024
Inter-Society Networking Panel GRSS/MTT-S/CIS Panel Session: Promoting Connection and Cooperation
https://www.etran.rs/2024/en/home-english/
What is greenhouse gasses and how many gasses are there to affect the Earth.moosaasad1975
What are greenhouse gasses how they affect the earth and its environment what is the future of the environment and earth how the weather and the climate effects.
Accessible Shopping Systems for Blind and Visually Impaired Individuals: Design Requirements and the State of the Art
1. 158 The Open Rehabilitation Journal, 2010, 3, 158-168
Open Access
Accessible Shopping Systems for Blind and Visually Impaired Individuals:
Design Requirements and the State of the Art
Vladimir Kulyukin and Aliasgar Kutiyanawala*
Computer Science Assistive Technology Laboratory, Department of Computer Science, Utah State University, USA
Abstract: Independent grocery shopping is one of the most functionally challenging tasks for visually impaired and blind
individuals. Many assistive shopping systems have been developed to address the problem of blind grocery shopping. In
this article, we identify several design requirements for assistive shopping systems and analyze existing approaches to see
how well they meet them. Our objective is to shed some light on possible research and development directions for the
accessible blind shopping community and to offer designers of accessible shopping solutions evaluation tools that can be
used as initial points of comparison.
Keywords: Accessible shopping, assistive technology.
1. INTRODUCTION making spontaneous shopping difficult. Nor do such services
offer VI individuals opportunities to explore stores on their
What would it take for blind and visually impaired (VI)
own. To overcome these access barriers, accessible shopping
individuals to shop at modern supermarkets independently?
solutions are needed that increase personal independence,
Many sighted shoppers, unless they closely know someone
enable spontaneous shopping, and do not require that
who is blind or VI, may never ask themselves this question,
supermarkets undergo extensive technological adjustments.
let alone ponder how their sensory-motor system seamlessly Such systems will make VI individuals less dependent on
handles the amazing complexity of the modern supermarket
external assistance and improve their quality of life. Toward
that stocks an average of 45,000 products and has a median
that end, in this article we will formulate a set of design
store size of 4,529 square meters [1]. They successfully
requirements for accessible shopping solutions for VI
navigate to the right aisles, locate the shelves with the
individuals and use them to analyze several existing systems.
desired products, identify the products on the shelves, read
their ingredients, and deal with relocated or discontinued We would like to emphasize that training independent
products. evaluators and having them evaluate various accessible
shopping solutions in the field is beyond the scope of the
Unlike sighted individuals, many blind and VI people do
work presented in this article. Such an evaluation, besides
not shop independently. They typically rely on friends,
requiring substantial budgetary commitments, does not seem
relatives, volunteers, and store employees. When these
feasible to us at the moment, because some systems exist
individuals are unavailable, VI shoppers have to reschedule only as research prototypes while others exist only on paper
or postpone shopping trips. When they go to the
as patents. Nonetheless, we hope that our analysis sheds
supermarkets by themselves, they experience delays, waiting
some light on possible research and development (R&D)
for store employees to assist them. Some staffers are
directions for the accessible blind shopping community.
unfamiliar with the store layout, others become irritated with
long searches and requests to read aloud product ingredients,
2. DESIGN REQUIREMENTS
and still others do not have adequate English skills to read
the products' ingredients or answer basic questions about the The design requirements proposed in this article are
supermarket layout. These difficulties cause blind and VI informed by two focus groups on accessibility barriers to
shoppers to abandon searching for desirable products, settle independent blind supermarket shopping conducted by the
for distant substitutes, or, in the worst case, abandon authors at the Utah State University’s Center for Persons
independent shopping altogether [2]. with Disabilities (USU CPD). The first focus group
PeaPod (www.peapod.com) and similar home delivery consisted of five VI individuals from Logan, Utah. The age
ranged from 16 to 47. Two used white canes; three used
services provide grocery shopping alternatives. However,
guide dogs. We met with each individual separately to
such services are not universally available and, when
minimize peer pressure. Each interview lasted one hour.
available, require shoppers to schedule and wait for
deliveries, thereby reducing personal independence and The second focus group with different participants was
conducted during a regular monthly meeting of the Logan
Chapter of the National Federation of the Blind (NFB)
*Address correspondence to this author at the Computer Science Assistive hosted by the USU CPD. This group consisted of six
Technology Laboratory, Department of Computer Science, Utah State individuals from Cache Valley, Utah, all of whom held part-
University, USA; Tel: 435 512 0225;
E-mails: aliasgar.k@aggiemail.usu.edu time or full-time jobs, used public transportation, and walked
1874-9437/10 2010 Bentham Open
2. Accessible Shopping Systems for Blind and Visually Impaired Individuals The Open Rehabilitation Journal, 2010, Volume 3 159
independently around their neighborhoods. The age ranged When analyzing TF1, we found it necessary to
from 19 to 51. Four were white cane users; two used guide distinguish among planned shopping (complete shopping list
dogs. This focus group was an open forum and lasted three available in store), spontaneous or opportunistic shopping
hours. when no shopping list is available in store, and mixed
Written transcripts of both focus groups were combined shopping when the shopping list is found to be incomplete or
must be modified due to some information received in the
into one electronic master transcript. We used ergonomics
store, e.g. a sales promotion.
for one (EFO) to analyze the master transcript. EFO is an
occupational therapy framework proposed by McQuistion in The shopping list preparation for planned shopping is not
1993 [3] that we successfully used in our previous accessible a performance gap, because, assuming that the shopper has
blind shopping investigations (e.g., [4-6]). EFO is a method access to a PC with a screen reader, it reduces to the problem
of fitting tasks to individuals with disabilities who must of eyes-free item selection from large data sets on PCs,
repeatedly accomplish them in specific environments. which appears to be adequately addressed in the literature
Interviews or field studies are used to identify task functions, (e.g., [8, 9]). However, in opportunistic and mixed shopping,
i.e., things that the individual must do in a given VI shoppers are likely to use mobile devices on which eyes-
environment, and to match task functions with the free item selection from large data sets is presently difficult
individual's abilities. Unmatched or partially matched task due to limited input options (e.g., [10]). Therefore, if the
functions are referred to as performance gaps. Solutions, accommodation system is to operate on a mobile device
called accommodation systems, are subsequently designed to (e.g., a smart phone), eyes-free product selection and
bridge the performance gaps. Once identified, the browsing user interfaces (UIs) are a performance gap and,
performance gaps become design requirements for consequently, a design requirement.
accommodation systems.
We decomposed TF3 into three sub-functions: TF3.1)
We found the EFO analysis to be particularly suitable for store navigation; TF3.2) product search; and TF3.3) product
working with VI individuals in supermarkets, because, due identification (making sure that the found product is the one
to the uneven distribution of the VI population [7], it is that the shopper really wants). All three sub-functions
difficult to find groups of statistically significant sizes with introduce performance gaps for our focus groups. It is
the exact same level of blindness and physical ability. important to note that store exploration, sometimes referred
Variability in vision and physical ability, primarily due to to as product or store browsing, is implied by TF3.2 and
age or onslaught of blindness, within the locally available TF3.3, but not vice versa. In other words, the shopper cannot
group is the norm. Another advantage of the EFO analysis, search for and retrieve products without browsing, i.e.
although by no means unique, is that it establishes a inspecting and identifying individual products. However, the
meaningful framework for comparing different ability to just browse does not necessarily result in
accommodation systems operating in the same environment. successful product retrievals due to the sheer numbers of
Table 1. Task Functions
products in modern supermarkets. Task functions TF4
(getting to cash registers) and TF6 (getting to the exit) do
not introduce new performance gaps, because both reduce to
Function Name Function Description sub-function TF3.1.
TF1 Shopping list preparation Another design requirement that we discovered during
our analysis of the master transcript and informal
TF2 Getting to supermarket
conversations with VI individuals is the utilization of
TF3 Finding products in store existing devices that VI individuals already own and know
TF4 Getting to cash registers
how to operate. Adding new devices not only increases the
cost of ownership but also has a negative ergonomic impact,
TF5 Paying because VI persons already handle numerous navigation
TF6 Getting to exit tools (e.g., white canes and guide dogs, Braille note takers,
personal GPS devices) and everyday wearable objects (e.g.,
TF7 Getting home purses, backpacks, and bags). In addition, one should not
forget that some VI shoppers must also handle their children,
who accompany them to the store.
Our analysis of the master transcript resulted in the
identification of seven task functions given in Table 1. We There is yet another aspect of accessible blind shopping
will not address TF2, TF5, and TF7 in this article. Task to which we would like to draw the reader's attention,
functions TF2 and TF7 pertain to outdoor blind navigation, because it is often overlooked in the literature, and that is the
a separate research area with a vast R&D literature. degree of environmental adjustment. Accessible shopping
Although TF5 was identified as a task function by our focus systems must operate not only in research labs but also in
groups, it did not introduce a performance gap, because all real supermarkets with established business processes (e.g.,
participants indicated that they handled payment with credit restocking, inventory control, cleaning, advertisements, etc.).
cards. We readily acknowledge, however, that for VI An exclusive focus on technological means to bridge
individuals who prefer to pay cash, payment is a performance gaps, in which the computer science and
performance gap in that individual bills must be reliably engineering literature abounds due to its concentration on the
recognized. end user, runs the risk of developing accommodation
systems that require unreasonable adjustments by the
supermarket.
3. 160 The Open Rehabilitation Journal, 2010, Volume 3 Kulyukin and Kutiyanawala
We became aware of this in the course of our
negotiations with the management of Lee’s Market Place in
Logan, Utah to allow us to use their store as a research site.
One of the very first questions that we were asked was what
hardware must be installed in the store, who would maintain
it, and whether it would be disruptive to the shopper traffic.
Subsequent trial runs and longitudinal experiments with VI
shoppers turned our awareness into a firm conviction. One
insight, slightly paraphrased, from the ecological systems
theory [11] is immediately applicable: if the introduction of
an accommodation system causes significant disruptions to
the existing business processes, the supermarkets will resist
or reject its adoption. Consequently, another design
requirement is minimal environmental adjustment, with no
environmental adjustment being the ideal. The designed
requirements that we have identified are summarized in
Table 2.
Table 2. Design Requirements
Requirement Name Requirement Description
DR1 Mobile product selection
DR2 Store navigation
DR3 Product search
DR4 Product identification
DR5 Utilization of existing devices
DR6 Minimal environ. adjustment
3. ANALYSIS OF ACCESSIBLE SHOPPING SOLUTIONS Fig. (1). RoboCart.
Now that we have formulated several design
requirements for accessible blind shopping systems, let us
use them to analyze several existing approaches to see how
well they meet these requirements. Our objective is to shed
some light on possible R&D directions for the accessible
blind shopping community and to offer designers of
accessible shopping solutions some evaluation tools that can
be used as initial points of comparison.
Our analysis will use the following conventions. We will
say that a system S meets a design requirement R when S has
a software or hardware module specifically designed to meet
R. When the literature offers evidence that the designers of S
are aware of R but have not had the resources to address it,
we will say that S partially meets R. When the literature
offers no such evidence, we will say that S does not meet R.
In some cases, it is simply impossible to tell whether S
meets, partially meets, or does not meet R. For example, if S
is proposed in a patent but is not actually implemented.
Moreover, the text of the patent or a description found in the
literature makes no software or hardware commitments on
how the system can be realized. In such cases, we will say
that it is unknown if S meets R.
3.1. RoboCart
RoboCart was our first accessible blind shopping project
that started in early 2004 [12] at the Computer Science
Assistive Technology Laboratory of Utah State University
Fig. (2). Belkin keypad on handle.
4. Accessible Shopping Systems for Blind and Visually Impaired Individuals The Open Rehabilitation Journal, 2010, Volume 3 161
(USU CSATL). The objective was to design a robotic completed by the participants and all research hypotheses
supermarket shopping assistant for blind and VI shoppers. A verified.
long-term collaborative agreement was negotiated with Lee's
As an accessible shopping accommodation system,
Market Place to grant us access to its supermarket in Logan,
RoboCart partially meets DR1 (mobile product selection),
Utah for experimental purposes. because its keypad with which the user selects products is
In 2004 - 2005, RoboCart was built on top of a programmed as a mobile phone keypad, which allows the
commercial Pioneer 2DX platform (www.activmedia.com) shopper to select items by list browsing. The system meets
to which a polyvinyl chloride (PVC) pipe structure was DR2 (store navigation) through robot navigation and
securely attached. The payload included a laptop, a SICK partially meets DR3 (product search) and DR4 (product
laser range finder, a Radio-Frequency Identification (RFID) identification) though a wireless barcode scanner. RobotCart
reader, a 200mm x 200mm RFID antenna, and a shopping addresses neither DR5 (utilization of existing devices) nor
basket (See Fig. 1). DR6 (minimal environmental adjustments).
For localization, RoboCart relied on passive RFID tags
3.2. ShopTalk
that we temporarily deployed at various locations in the
store. Specifically, the tags were placed at the beginning and In early 2006, in parallel with our R&D activities with
end of every aisle and at three different locations within each RoboCart, we began our work on ShopTalk, a wearable
aisle. These tags allowed the robot to keep track of its system for independent blind supermarket shopping. We
position in each aisle and to correct global Markov carefully considered several mobile phone platforms but
localization errors. Several laser range finding techniques found them unable to support the required computational
were developed for obstacle avoidance [13]. Single subject loads without server support. As we had by then become
experiments were successfully executed with two VI fully aware of DR6 (minimal environmental adjustment), we
participants. The participants’ feedback allowed us to make wanted all computation to run on the system with no external
iterative software and hardware changes to adjust the robot's server support. After considering several mobile phone
navigation routines, i.e., improve its speed and make platforms, we ruled them out as insufficiently powerful.
smoother turns. Eventually we settled on the OQO 01 wearable computer,
In 2006, a small 10-key Belkin keypad was attached to which we viewed as a temporary compromise solution with
the handle for product selection by list browsing and for sufficient computational power and reasonable ergonomics.
finer robot control (See Fig. 2). The keypad was deliberately The final ShopTalk hardware (See Fig. 3) consisted of
programmed to emulate the keypad of a cell phone. We also the OQO computer, a Belkin numeric keypad, a Hand Held
added a handheld wireless IT4600 SR barcode scanner. Products IT4600 SR wireless barcode scanner (See Fig. 4)
After these hardware modifications were integrated, and its base station, and a USB hub to connect all
another two-month single subject study was executed in components. We used the ergonomic lessons we had learned
which each VI participant was asked to: 1) find RoboCart in from our field experiments with RoboCart and added two
the cart area, 2) use the keypad to select three grocery items, plastic stabilizers to the barcode scanner. The shopper could
3) navigate to shelf sections, 4) retrieve the selected items now place the stabilizers on shelf lips to align the scanner
from the shelves by scanning shelf barcodes and reaching with shelf barcodes.
over them to retrieve the items, 5) place the items into The equipment was placed in a small CamelBak
RoboCart's basket, 6) navigate to a cash register, 7) place the backpack. The numeric keypad was attached by a Velcro
items on the conveyer belt, 8) pretend to pay with a credit strip to either left or right shoulder strap, depending on
card, 9) navigate to the exit, 10) remove the shopping bags whether the shopper was left- or right-handed. Since all
from RoboCart, and 11) leave the store. The database instructions were speech-based, the shopper was required to
consisted of 24 products from aisles 9 and 10 in the wear a small headphone.
supermarket. Seven trials were executed on three separate
days for three different sets of products. The participant ShopTalk was based on the following conceptual
formula: independent blind shopping = verbal route
successfully completed all trials and retrieved all products
instructions + shelf barcode scans [16]. The system was our
[14].
first attempt (and, to the best of our knowledge, the first
In 2007, we focused on cognitive aspects of accessible attempt reported in the accessible shopping literature) to use
blind shopping by developing a trichotomous spatial MSI (Modified Plessey) shelf barcodes (See Fig. 4) as
ontology of locomotor, haptic, and target spaces. The topological cues for product search and store navigation.
introduction of the target space (a shopper-centric subspace MSI is a barcode symbology developed by the MSI Data
of the locomotor space where the shopper perceives that Corporation (http://en.wikipedia.org/wiki/MSI_Barcode) used
target product to be) extended the traditional locomotor vs primarily for inventory control.
haptic dichotomy in the blind navigation literature [15].
A key data structure in ShopTalk is the barcode
A longitudinal formal study was executed with ten VI connectivity matrix (BCM). The BCM associates MSI
participants recruited through the Utah National Federation barcodes with aisles, aisle sides, shelf sections (groups of
of the Blind (NFB) Chapter. The supermarket experiments shelves), specific shelves in the shelf section, and relative
lasted four months with each participant having to execute positions on shelves. The BCM is used to generate the store
fifteen runs on two different days. The 2006 product navigation and product search and retrieval instructions.
database was used. All trial runs were successfully
5. 162 The Open Rehabilitation Journal, 2010, Volume 3 Kulyukin and Kutiyanawala
In 2007 - 2008, after two single subject studies at Lee’s system partially meets DR6 (minimal environmental
Market Place and one single subject study at Sweet Peas, a adjustment). Although the supermarket is not required to
smaller independent natural foods store in Logan, Utah, ten install and maintain any new hardware, the system assumes
VI participants were recruited for a formal longitudinal access to the supermarket’s inventory control system without
study. The product database included 4,297 products. The which the BCM cannot be computed. Some supermarkets
experiments, performed during regular business hours, had may not be willing to provide such access.
each participant shop for the same set of three randomly
chosen products five times. The product retrieval rate was
100%. All ten participants found all three products in every
run [2].
A key finding of ShopTalk is that independent VI
travelers can execute verbal template-based route and
product search instructions in supermarkets with 100%
accuracy. In effect, our experiments with the system have
demonstrated that, for our sample of participants, verbal
route directions were self-sufficient for successful blind
navigation in a real supermarket.
Fig. (4). MSI barcode on shelf scanned.
3.3. GroZi
GroZi [17] is an accessible shopping project at UC San
Diego. The project has three components: 1) an accessible
web site for blind and VI users to create grocery shopping
lists in the comfort of their homes; 2) computer vision
software for recognizing products and signs in stores; and 3)
portable devices that can execute computer vision algorithms
and give the user haptic and verbal feedback.
Figs. (5, 6) (reproduced from http://grozi.calit2.net/ with
permission) show two such devices: the MoZi Box and the
GroZi hand glove with a small portable camera and vibrating
motors. In a typical GroZi use case, a VI shopper uses the
web site to compile a shopping list of products and uploads it
on the portable device. In the store, the shopper takes out the
device and uses it to receive directions for each item in the
shopping list. For example, if the shopper wears the glove
and points at an aisle, the portable unit will indicate the
Fig. (3). ShopTalk. components of that aisle and guide the shopper to the desired
item.
As an accommodation system, ShopTalk does not meet
DR1 (mobile product selection) in that a complete product The primary focus of the project has so far been on
list is assumed to be prepared and stored on the various object recognition algorithms for detecting items on
computational device. The system meets DR2 (store the shopping list in continuous video streams [18]. The
navigation) and DR3 (product search) by using shelf GroZi team’s long-term objective is to enable the user to
barcodes as topological cues during store navigation and sweep the portable camera’s field of view across the grocery
product search. The system partially meet DR4 (product shelves. When an item on the user’s shopping list is detected
identification), because the user can verify the identity of the in the video stream, the system will give the user either
retrieved product by scanning its UPC barcode on the haptic or verbal guidance as to how to get to that item. In
package. However, as we observed during the experiments, GroZi, there are two classes of images: in vitro and in situ.
this scanner was difficult to use on softer packages (e.g., The in vitro images are images of products taken under ideal
potato chips). ShopTalk does not meet DR5 (utilization of lighting and perspective conditions. The in situ images are
existing devices), because none of the hardware components obtained from actual video streams in the store. The former
used in the system are widely used by VI individuals. The are used for training; the latter - for testing.
6. Accessible Shopping Systems for Blind and Visually Impaired Individuals The Open Rehabilitation Journal, 2010, Volume 3 163
shopper must wear a powerful laptop on his or her back. In
principle, different procedures used in the algorithms can be
parallelized. If such parallelization is achieved, it may be
possible for the system to operate in real time without
incurring significant performance costs.
The system does not meet DR5 (utilization of existing
devices). Although each individual component of the GroZi
hardware is completely-off-the-shelf, which makes for easier
maintenance of the end deliverables, the end deliverables
will still have to be assembled by hardware professionals and
purchased by VI individuals in addition to the devices that
they already own and know how to operate.
Whether the GroZi system meets DR6 (minimal
environmental adjustment) is presently unknown. It depends
on who will be ultimately responsible for maintaining the
databases of the in vitro images required for training and
where the servers hosting these databases will reside. If it is
Fig. (5). MoZi box. the supermarket that is required to maintain both the servers
and the databases, then the system is unlikely to meet DR6
due to significant maintenance costs. The system could meet
DR6 by outsourcing the maintenance of these resources to
third parties, such as volunteer groups, local NFB chapters,
etc. Of course, it remains to be seen how realistic and cost
effective such outsourcing will be.
3.4. iCare
iCARE [19] is an accessible shopping project at Arizona
State University. The project’s objective is to design an
ambient interactive shopping environment for VI shoppers.
The ambient environment is assumed to provide reliable
indoor navigation, an understanding of locations and
contents of different sections and a user interface for
querying product databases. The system design includes a
PDA with Bluetooth, Wi-Fi, a screen reader, and an RFID
reader embedded in a hand glove (See Fig. 7 from [20],
Fig. (6). GroZi glove. reproduced with permission).
As an accessible shopping accommodation system, GroZi As the shopper moves around the grocery store, the RFID
does not meet DR1 (mobile product selection). As in reader in the hand glove reads IDs from the products, looks
ShopTalk, access to the complete shopping list is taken for them up in a store database through a Wi-Fi connection, and
granted, and the shopper is not supposed to modify the gives instructions to the user. The primary purpose of the
shopping list in the store. The system partially meets DR2 device is store browsing. When the shopper moves his or her
(store navigation). Although the current assumption is that hand along a shelf, the PDA will deliver messages such as
the shopper is capable of navigating to each item’s location “passing dairy section,” “passing coffee section,” etc. When
independently, the designers of the system are aware that the user is inspecting a product, the user will receive the
store navigation is a design requirement and plan to address individual package’s price, weight, ingredients, and
it in their future work. nutritional data presumably from the RFID tag read from the
The system partially meets DR3 (product search). Once package.
the shopper is in the right aisle, the system uses five haptic As an accommodation system, iCARE does not meet
instructions in the two-dimensional plane of the shelf under DR1 (mobile product selection), insomuch as there appears
exploration: up, down, left, right, step back – camera blurry. to be no discussion of this problem in the references. The
Theoretically speaking, these instructions should be system partially addresses DR2 (store navigation) and DR3
sufficient to enable the VI shopper to find and retrieve a (product search), because RFIDs on individual products can
product from the shelf. However, this conjecture needs be used as navigational and search cues. However, since the
empirical verification in a real supermarket during regular project’s primary focus is on product browsing, it is unclear
operating hours. whether store navigation and product search have been
The system partially meets DR4 (product identification) actually implemented or ever evaluated in a real
through various computer vision product identification supermarket.
algorithms. The developed algorithms (e.g., ShelfScanner The system meets DR4 (product identification) on the
[18]) can currently process about two frames per second. assumption that the RFID reader can always read the
However, this speed comes at an ergonomic price: the product’s tag. This assumption may not hold for many liquid
7. 164 The Open Rehabilitation Journal, 2010, Volume 3 Kulyukin and Kutiyanawala
low-end products with metal cases that refract and reflect RF Trinetra partially meets DR1 (mobile product selection)
waves. The system partially meets DR5 (utilization of in that the literature offers some evidence that the shopper
existing devices) in that most technologies appear to rely on can select products from the phone. It is unclear, however, if
completely-off-the-shelf components, except, of course, the the selection is made from the prepared list or from a
hand glove with an embedded RFID reader. database of products. The system does not meet DR2 (store
navigation): the shopper is assumed to be able to navigate to
The system does not meet DR6 (minimal environmental
the product’s location independently or ask for assistance in
adjustment). A fundamental assumption underlying the
the store. This assumption may be true in a small
system’s design is that every single item in the store has an
convenience store but it is unlikely to hold in a modern
RFID tag, which, as we argue in Section 4, presents a
supermarket.
significant environmental adjustment cost to modern
supermarkets in the short term and an equally significant The system does not meet DR3 (product search) in that
social acceptance cost in the long term. Furthermore, to there does not seem to be any explicit guidance provided by
support timely delivery of information on prices, weights, the system to the shopper at run time. The system partially
ingredients, nutritional data, and store sections, iCARE will meets DR4 (product identification): the shopper can identify
need access to the store’s inventory control system, which the found product by locating and scanning its barcode with
some supermarkets may not be willing to provide. the Baracoda pencil. Since the only reported informal single-
subject study was done at a small campus store with two
3.5. Trinetra aisles, more empirical evidence is needed to discover how
successfully VI shoppers can use the Baracoda pencil to
Trinetra is a project at Carnegie Mellon University [21,
identify products. Our own laboratory studies with the
22] whose long-term objective is to develop a mobile system
BaraCoda pencil indicate that it may be difficult for both
that enables people with visual impairments to shop
blind and blindfolded individuals to scan shelf and product
independently. The system is intended to handle both barcodes with it [23].
barcodes and RFID tags, if and when the latter will be
available in supermarkets. The system’s hardware consists of The system meets DR5 (utilization of existing devices).
a Nokia mobile phone, a Bluetooth headset, a Baracoda To the best of our knowledge, the Trinetra team was the first
IDBlue Pen, a Baracoda Pencil, and a Windows-based to advocate the mobile phone platform for accessible blind
server. The Baracoda Pencil is used to scan barcodes, and the shopping.
Baracoda IDBlue Pen is used to scan RFID tags. Whether Trinetra meets DR6 depends on which version
The primary use case of the system starts with the of the system will be ultimately adopted. While the barcode
shopper scanning a UPC barcode with a Baracoda Pencil and version of the system meets DR6 (minimal environmental
retrieving a description of the product. The data are passed adjustment), provided that the supermarket agrees to install
wirelessly to and from the mobile phone via Bluetooth. The and maintain the UPC barcode server, the RFID version does
system on the phone first checks a local cache to see if the not, because item-level RFID tagging will require a major
barcode has previously been scanned. If the barcode is not in environmental adjustment on the part of supermarkets.
the mobile application's cache, a request is sent to the remote
server, which also has a cache of UPC barcodes. If the 3.6. IBM’s Patent
barcode is in the server's cache, the information is returned
In 2002, IBM acquired a patent on a method to provide
to the phone. If the barcode is in neither cache, a public UPC
VI shoppers with location and item identification at sites that
database is contacted by the server to retrieve the necessary have barcode labels [24]. The patent describes a portable unit
information.
that assists VI shoppers at stores by providing them, through
speech synthesis, with information on their locations from
various barcode labels. The location of each barcode label is
stored in a database on the portable unit.
The portable unit is claimed to be capable of determining
a path between the shopper’s current location and the
location of the item that the shopper wants to find and of
describing the path through speech synthesis. The shopper
can select items from a shopping list on the portable unit.
To become operational, the system appears to need
barcode directories at both ends of each aisle similar to
building directories. Each barcode directory will list all
barcode labels in a specific aisle. It is not clear from the text
of the patent which barcode labels will be in these directories
– UPC or MSI or both.
Since, as far as we know, IBM has never built an actual
prototype of this device and tested it in a real supermarket, it
is difficult to tell how well a system built according to the
Fig. (7). iCARE framework.
specifications outlined in the patent will meet the design
requirements. The patent does not seem to meet DR1
8. Accessible Shopping Systems for Blind and Visually Impaired Individuals The Open Rehabilitation Journal, 2010, Volume 3 165
(mobile product selection) as it mentions only the shopper tested in a real store with at least ten visually VI participants.
selecting items from a target shopping list that already
resides on the device. DR2 (store navigation) appears to be 4. WHAT ABOUT RFID?
met in that the device is claimed to generate verbal route
Our analysis of accessible shopping solutions for blind
directions to various locations in the store. Presumably, the
shopper will have to scan some barcode label in the store to and VI individuals would be incomplete with no mention of
Radio-Frequency Identification (RFID). The topic of RFID
inform the device of his or her present location and then
is quite polarizing. The technology has many vocal
select a product from the stored shopping list. The device
proponents and equally vocal opponents who frequently
will retrieve the location of the target product from its
speak past each other and are unwilling to address each
database, plan a path from the shopper’s location to the
other’s concerns and critiques.
product’s location, and verbalize it to the shopper.
RFID has been proposed as a technology of choice for
While the patent does not appear to address DR3
the Electronic Product Code (EPC), a global network of
(product search), one can easily conjecture various means of
objects under a universal labeling system [25]. Two
meeting this requirement given the rich information in the
competing organizations work on international RFID
device’s barcode database. Thus, it is reasonable to assume
standards: EPCGlobal and the ISO. An RFID system
that DR3 is, at the very least, partially met.
consists of a set of tags and an antenna connected to a reader
It is unknown whether the device built according to the which, in turn, is connected to a data processor. Tags have
patent’s specifications will meet DR4 (product chips that respond to radio waves transmitted by readers.
identification). It will ultimately depend on the actual means Tags can be passive (no external power supply) or active
of obtaining barcodes from individual packages. Nor can it (external power supply). Tags have unique IDs which
be known at this point whether the actual realization of the identify tagged items. Since practical RFID use in accessible
concept will meet DR5 (utilization of existing devices). blind shopping requires passive item-level tagging, i.e. every
The conceptual design outlined in the patent does not single product in a supermarket must have a passive tag, we
meet DR6 (minimal environmental adjustment). The will focus on the ultra high frequency (UHF) tags, the class
assumption that both ends of every aisle have detailed that includes passive item-level tags.
barcode directories incurs a high maintenance cost. Many Wal-Mart was the first major supermarket chain to
products regularly change their locations; some products are champion item-level RFID. In 2005, it mandated its top 100
discontinued and replaced with others. It is difficult to see suppliers to start using item-level RFID [26]. The date was
how these changes will find timely reflection in the barcode looked upon as a watershed event in the industry. Yet, it
directories. Furthermore, the patent does not take into arrived and quietly passed. To revive RFID adoption, Sam's
account the fact that many supermarkets use the physical Club required some of its suppliers on January 7, 2008, to
space at the end of each aisle for stacking products or for apply EPC RFID tags to distribution center shipments [27].
placing advertisement boards. The letter outlined fines ranging from $2 to $3 for each non-
tagged pallet. This was the first time Wal-Mart, which owns
3.7. Comparison Summary Sam's Club, announced monetary penalties for suppliers for
not following RFID tagging guidelines. The suppliers did not
Table 3 summarizes how RoboCart, ShopTalk, GroZi,
comply. In a letter dated January 15, 2009 [28], Sam's Club
iCARE, Trinetra, and IBM’s device and meet the design
made case-level tagging optional and the requirement for
requirements summarized in Table 2. The plus sign means
that a given system meets a given design requirement; the item-level tagging has been postponed indefinitely. The fine
was slashed to $0.12 per pallet, which could be construed as
minus sign means that a given system does not meet a given
a tacit admission of the fact that RFID tagging was not a
design requirement; the plus/minus means that a given
viable option even in the presence of steep mandatory fines.
system partially meets a given design requirement; the
question mark means that it is unknown whether the system The reasons for slow acceptance of RFID by many
meets a specific requirement. We also added a column on suppliers are multiple and varied. In this article, we will
field evaluations to reflect whether a specific system was address only a few. Interested readers are referred to
excellent analyses offered in [29]. Many countries have
Table 3. Comparison of RoboCart, Trinetra, ShopTalk, iCARE, and GroZi
DR1 DR2 DR3 DR4 DR5 DR6 Field Evals
RoboCart +/- + +/- +/- - - +
ShopTalk - + + +/- - +/- +
GroZi - +/- +/- +/- - ? -
iCARE - +/- +/- + +/- - -
Trinetra Barcode +/- - - +/- + + -
Trinetra RFID +/- - - + + - -
IBM - + +/- ? ? - -
9. 166 The Open Rehabilitation Journal, 2010, Volume 3 Kulyukin and Kutiyanawala
auctioned large portions of the UHF spectrum to cellular as Wal-Mart begins to use RFID tags to track individual
phone service providers for high license fees. For many pairs of jeans and underwear, which some experts view as
suppliers, buying that spectrum back for RFID use is the first step in implementing a comprehensive RFID-based
impractical, if not impossible. It does not make much inventory control [36]. If this trial succeeds, it may create the
business sense to invest in RFID use in global supply chains tipping point for RFID tags’ prices and force other retailers
when tags in source countries cannot be read in target to consider RFID tags in their inventory control systems.
countries due to incompatible UHF spectrum bands.
5. WHERE TO NOW?
Continuing lack of convincing business cases that satisfy
all parties, not just retailers and RFID manufacturers, is Several commercial products already exist on the market
another major reason why many suppliers steer clear of and can be productively used by blind and VI people in
RFID. The manufacturing costs for tags and readers remain supermarkets and other stores. Looky [37] and OPAL [38]
prohibitive for tagging all but high-value products unless the are electronic magnifiers for low-vision people that offer
tagging is subsidized by the retailer. According to many advantages over a regular hand-held magnifying glass, such
independent RFID analysts, significant cost reduction will be as zoom and image enhancement. OMNI [39], a commercial
slow due to numerous unresolved intellectual property issues product from En-Vision America, is a standalone, talking
and manufacturing costs [30]. barcode scanner. It has an on-board database of UPC
The future of item-level RFID tagging remains, at best, barcodes and includes extra data such as ingredients and
uncertain due to technical problems. Liquid low-end nutrition information for some products. The database
products, such as shampoos, juices, sodas, and canned goods updates require an annual paid subscription.
with metal cases, refract and reflect RF waves. If UHF radio Our analysis of the existing systems shows that no
waves propagate toward liquid, they refract into it; if they solution meets all the design requirements wanted by VI
pass onto metal, they are reflected. Several research shoppers. None of the solutions meets DR1 (mobile product
solutions have been proposed; none have been shown to selection). While some progress has been recently made
work consistently [31]. [40], more work must be done to meet this design
Product packaging with RFID tags poses a clear requirement.
substantial threat to the recycling of residential and industrial The existing solutions appear to display better awareness
waste: it contaminates host materials and prohibits effective of the requirements DR2 – DR4 (store navigation, product
processing of paper, plastic, glass, pallets, boxes, and other search, and product identification). This does not appear to
supply chain containers. Yet, no recycling provisions for be the case with DR5 (utilization of existing devices) yet.
RFID exist and none are planned. This requirement is significant as VI and blind consumers
Consumer privacy is another hurdle that the RFID show reluctance to purchase hardware items in addition to
technology will have to overcome. RFID store trials by those that they already own and know how to operate. As
Benetton, Prada, and Gap were cancelled due to consumer more and more VI individuals become mobile phone users,
privacy outcry; the same fate awaited Gillette which, in the accessible shopping R&D community should take a
cooperation with Wal-Mart, attempted to place RFID tags on serious look at adopting the mobile phone as the central
individual razors [32]. A comprehensive study on consumer computational unit of the proposed solutions.
perception of RFID was conducted by Günther and Definite progress has been made on vision-based barcode
Spiekermann with two groups of 129 well educated recognition algorithms [41]. As the mobile phones become
individuals in an RFID-enabled retail environment [33]. The more computationally powerful, these algorithms can
study showed that, regardless of the Privacy Enhancement successfully be ported to various mobile platforms. What
Technology (PET), consumers felt helpless toward the RFID makes vision-based barcode recognition particularly difficult
environment. RFID-related privacy concerns recently for VI individuals is the problem of camera alignment. More
resulted in the formation of Consumers Against Supermarket research is needed on vision techniques that recognize partial
Privacy Invasion and Numbering (CASPIAN), an active barcodes in images and give the VI users audio or haptic
non-profit consumer advocacy group that referred to RFID feedback to align the phone cameras with barcodes [42].
as "paving the way for a totalitarian state" [34]. These
Most algorithms focus on recognizing UPC barcodes.
sentiments clearly indicate that item-level RFID tagging has
Surprisingly little research has been done on recognizing
a high social cost.
MSI and other non-UPC barcodes, which is unfortunate,
Despite numerous research proposals and marketing because, as we argued above, such barcodes can be key to
initiatives, the literature appears to have reached a consensus independent store navigation and exploration. The small
that technical problems, environmental hazards, and amount of research can be explained by lack of uniform
consumer perceptions of trust, privacy, and risk, mixed with inventory control standards. These barcodes vary from store
fear (the recent vulnerability issues with RFID-enabled U.S. to store or from store chain to store chain. However, it not
passports furnish yet another good example [35]), remain unreasonable to conjecture that algorithms can be designed
significant acceptance barriers to RFID item-level tagging. that learn barcode decoders for specific stores from small
RFID use in retail will likely be limited to tracking samples.
containers, not individual items, in the short term.
The minimal environmental adjustment requirement
In the long term, RFID should by no means be (DR6) is hard to meet for any accessible shopping system.
discounted as it has many vocal proponents in R&D and Any system that purports to give VI and blind shoppers
retail. For example, the RFID outlook may gradually change adequate store navigation and product search support is
10. Accessible Shopping Systems for Blind and Visually Impaired Individuals The Open Rehabilitation Journal, 2010, Volume 3 167
likely to be coupled to the store’s inventory control system. complex structured indoor environments. The satisfaction of
Since such collaboration may not be forthcoming from some the sixth UD principle of low physical effort is an empirical
stores or chains, it may be worth it for the accessible question that will likely vary from system to system. Finally,
shopping R&D community to think of solutions that do not the seventh UD principle will be easily met because barcode
depend on store collaboration. One such solution may be scanners, smartphones, and gloves are used by people with
collaborative knowledge engineering where a group of blind, various hand and body sizes, postures, and mobilities.
VI and sighted individuals, over a period of time, create and
maintain a database of a specific store in the same way as 6. SUPPLEMENTAL ONLINE MATERIALS
sighted individuals annotate various regions of the world on
Interested readers can examine several online resources
sites such as Wikimapia (http://wikimapia.org/).
related to the systems described in this article. Research
As our analysis indicates, the existing solutions have very videos of blind and VI individuals testing RoboCart and
few comprehensive field evaluations. This lack of ShopTalk at Lee’s Market Place in Logan, Utah are available
evaluations makes it more difficult to predict which on the USU CSATL’s YouTube channel at http://www.yout
approaches to accessible blind shopping may translate into ube.com/user/CsatlUSU. The site http://grozi.calit2.net/
real systems. It may be impractical, if not impossible, to run offers a wealth of materials about GroZi. Trinetra’s home
controlled studies in real supermarkets due to the ever page at http://www.ece.cmu.edu/~trinetra/ contains several
fluctuating shopper traffic patterns and indigenous business articles and videos. While iCARE does not appear to have its
processes that cannot be interrupted. But, rigorous controlled own web site, interested readers are advised to check the site
studies may not be needed. In our opinion, diary studies are of the Center for Cognitive and Ubiquitous Computing of
particularly well suited for evaluating accessible shopping Arizona State University at http://cubic.asu.edu. Readers
systems in the target environments and should be pursued. interested in UD can take a look at the home page of the
In conclusion, we would like to offer a few thoughts on Center for Universal Design at the College of Design of NC
the relationship between our analysis and Universal Design State University at http://www.ncsu.edu/www/ncsu/design/
(UD). UD is a term created by Ron Mace, architect, who sod5/cud/.
founded and directed the Center for Universal Design at the
College of Design at NC State University (http://www.ncsu. ACKNOWLEDGEMENTS
edu/dso/general/universal-design.html). The Center has We would like to thank the anonymous reviewers of this
worked on accessible design for environment and products article for their constructive comments. We would like to
since 1989. UD has seven principles: 1) equitable use (utility thank the NFB Chapter in Logan, Utah and especially Sachin
and marketability to people with diverse abilities); 2) Pavithran for helping us organize the two focus groups on
flexibility in use (accommodation of multiple preferences accessible blind shopping. We are grateful to Serge Belongie
and abilities); 3) simple and intuitive use (easy for giving us the pictures of the MoZi box and the GroZi
comprehension regardless of the end user’s experience, glove and to Vineeth Balasubramanian for the picture of the
knowledge, language, or current concentration level); 4) iCare framework. We would like to thank John Nicholson
perceptible information (effective communication of for reading several drafts of this manuscripts and providing
necessary information regardless of ambient conditions); 5) valuable comments. Our research on accessible shopping and
tolerance for error (minimization of hazards and adverse blind navigation system has been supported, in part, through
consequences of accidental and unintended actions); 6) low the NSF grant IIS-0346880, the NEI/NIH grant R41
physical effort (efficient and comfortable usage with EY017516-01A1, and the Community University Research
minimum fatigue); 7) size and space for approach and use Initiative (CURI) in the State of Utah.
(provision of sufficient size and space for approach, reach,
manipulation, and use regardless of user’s body size, REFERENCES
posture, and mobility).
[1] Food marketing institute research. The food retailing industry
How would an accessible shopping system that meets the speaks 2006. Food Marketing Institute 2006.
design requirements proposed in our article (DR1 – D6) fare [2] Nicholson J, Kulyukin V, Coster D. ShopTalk: Independent blind
shopping through verbal route directions and barcode scans. Open
with respect to the seven UD principles? Such a system Rehab J 2009; 2: 11-23.
would probably meet the first UI principle in that it could be [3] McQuistion L. Rehabilitation Engineering: Ergonomics for one.
useful not only to the blind and visually impaired but also to Ergon Des 1993; 9-10.
the elderly. The second UD principle may also be met [4] Kulyukin V, Gharpure C. Ergonomics for one. In: A robotic
insomuch as the system could be used for both spontaneous shopping cart for the blind proceedings of the acm conference on
human robot interaction (HRI). Salt Lake City 2006; pp. 142-9.
and planned shopping. It is difficult to tell whether the third [5] Kulyukin V, Gharpure C, Pentico C. Robots as interfaces to haptic
principle would be met. For example, if the system is and locomotor spaces. Proceedings of the acm conference on
deployed on a smartphone with a touch screen, a significant human-robot interaction (HRI). Washington DC 2007; pp. 325-31.
amount of the blind user’s experience will be determined by [6] Gharpure C. Kulyukin V. Robot-Assisted Shopping for the Blind.
Issues in spatial cognition and product selection. Int J Serv
the touch gesture user interfaces. The system that satisfies Robotics 2008; 1(3): 237-51.
the design requirements of store navigation, product search, [7] LaPlante M, Carson D. Disability in the United States: Prevalence
and identification will, by definition, meet the fourth and causes. U.S. Department of education, Washington DC, 2000.
principle with respect to accessible shopping. In our opinion, [8] Raman TV. Auditory user interfaces. Kluwer Academic Publishers,
all systems analyzed in this article meet the fifth UD Boston, Hard Bound 1997; p. 168.
[9] Smith A, Cook J, Francioni J, Hossain A, Anwar M, Rahman M.
principle in that they do not increase the risks and hazards Nonvisual tool for navigating hierarchical structures. In:
typically associated with blind navigation in dynamic and