1. Composing Word Meanings
tuna
spicy-tuna
salmon
rice vinegar
minced-tuna
citytown
river
park
road
countryvillage
island
street
,
the
.
of
and
in
-rrb-
-lrb-
a
to
*
is
-
was
:
for
as
on
''
``
by
's
that
with
it
from
he
at
this
an his
be
are
not
i
or
utc
which
also
1
has
were
but
have
;
one
%
new
first
2
had
they
2007
who
their
o
its
there
other
all
2006
you
been
after
article
may
3
=
2008
can
talk
no
'
her
when
more
two
/
she
links
?
would
time
4
image
about
do
some
only
into
school
if
page
see
--
n't
references
made
used
5
most
such
#
external
up
_
2005
world
&
city
out
during
years
over
many
will
6
than
0
use
so
should
united
state
university
then
where
these
people
him
7
de
history
10
`
name
american
being
any
states
under
national
delete
them
8
wikipedia
between
year
known
july
part
like
later
list
what
well
county
september
john
war
august
while
however
articles
march
three
9
october
june
south
now
film
january
high
both
series
team
12
through
before
because
work
april
since
north
album
born
!
december
does
18
my
music
we
11
area
just
november
second
group
including
game
licensing could
became
2004
family
february
summary
number
same
very
jpg
class
15
...
user
several
york
category
did
life
added
until
company
against
20
1314
called
early
town
season
16
diff
age
west
house
general
each
best
even
per
international
me
place
discussion
partycollege
district
$
band
keep
way
24
day
back
system
population
following
still
those
your
much
station
-rcb-
public
another
original
government
show
british
released
information
-lcb-
17
line
center
make
support
home
u.s.
end
above
major
river
25
found
league
song
official
book
30
own
2000
east
link
22
english
long
here
located
please
how
last
based
played
around
website
great
good
21
four
although
former
version
19
church
site
main
park
right
club
often
further
____
100
small
king
member
23
left
2003
named
old
service
notable
century
order
us
members
km
point
ii
local
won
single
football
player
air
26
large
though
times
within
death
different
2001
due
set
___
road
28
career
london
2002
include
man
down
sources
title
president
.1
27
__
country
white
games
village
top
began
law
island
along
french
published
power
off
community
29
current
again
live
_____
every
think
form
using
get
without
army
created
black
said
took
england
few
william
given
children
______
james
final
note
la
radio
take
source
little
held
st.
men
george
built
case
research
water
records
street
free
example
central
television
david
having
written
third
art
love
included
german
red
near
according
building
son currently
no-class
died
p
program
record
political
san
various
1999
others
never
species
side
go
land
development
division
play
'm
works
comments
isbn
m
among
students
become
five
western
language
project
force
education
california
department
_______
military
battle
press
section
served
father
popular
late
australia
uk
comment
women
france
important
news
young
award
mince d - tuna
minced
... ... ... ...
... ...-tuna
minced-tuna ...
minced-tuna
• Vectors can be used to
construct “word spaces”.
• However, all new words
share the same
representation, they thus
appear identical.
• Humans can generalise from
the structure of a word,
having seen “mince” and
“tuna” we can guess the
meaning of “minced-tuna”.
• Use Deep Learning to
compose a words meaning
from sub-word components.
The National Institute of Informatics, Tokyo, Japan 1/1
