4. Word
What is a word? Let’s consider French:
Je sais
4 / 107
5. Word
What is a word? Let’s consider French:
Je sais
I know
5 / 107
6. Word
What is a word? Let’s consider French:
Je sais
I know
Je ne sais pas
6 / 107
7. Word
What is a word? Let’s consider French:
Je sais
I know
Je ne sais pas
I NEG know NEG
7 / 107
8. Word
What is a word? Let’s consider French:
Je sais
I know
Je ne sais pas
I NEG know NEG
Je sais pas
8 / 107
9. Word
What is a word? Let’s consider French:
Je sais
I know
Je ne sais pas
I NEG know NEG
Je sais pas
I know NEG
9 / 107
10. Word
What is a word? Let’s consider French:
Je sais
I know
Je ne sais pas
I NEG know NEG
Je sais pas
I know NEG
Je ne veux pas travailler
I NEG want NEG work
J’ai peur de ne pas réussir
I have fear of NEG NEG succeed
10 / 107
12. Word
What is a word? How many words can you identify in the following
sentences?
語言所有東西
12 / 107
13. Word
What is a word? How many words can you identify in the following
sentences?
語言所有東西
高雄市長春藥局
13 / 107
14. Word
What is a word? How many words can you identify in the following
sentences?
語言所有東西
高雄市長春藥局
⇒ How would machines segment words in these sentences?
14 / 107
15. Word
What is a word? How many words can you identify in the following
sentences?
語言所有東西
高雄市長春藥局
⇒ How would machines segment words in these sentences?
Bi-gram: 語言 言所 所有 有東 東西
15 / 107
16. Word
What is a word? How many words can you identify in the following
sentences?
語言所有東西
高雄市長春藥局
⇒ How would machines segment words in these sentences?
Bi-gram: 語言 言所 所有 有東 東西
Tri-gram: 語言所 言所有 所有東 有東西
16 / 107
17. Word
What is a word? How many words can you identify in the following
sentences?
語言所有東西
高雄市長春藥局
⇒ How would machines segment words in these sentences?
Bi-gram: 語言 言所 所有 有東 東西
Tri-gram: 語言所 言所有 所有東 有東西
⇒ N-gram hinges heavily on probability (i.e., how probable a
n-gram sequence would occur.)
17 / 107
18. Word
Can N-gram be universally applicable? Consider the following
German sentences. Where are the words?
abbiegen
‘to turn’
18 / 107
19. Word
Can N-gram be universally applicable? Consider the following
German sentences. Where are the words?
abbiegen
‘to turn’
Ich biege ab.
‘I turn.’
19 / 107
20. Word
Can N-gram be universally applicable? Consider the following
German sentences. Where are the words?
abbiegen
‘to turn’
Ich biege ab.
‘I turn.’
Ich biege rechts ab.
‘I turn right.’
20 / 107
21. Word
Can N-gram be universally applicable? Consider the following
German sentences. Where are the words?
abbiegen
‘to turn’
Ich biege ab.
‘I turn.’
Ich biege rechts ab.
‘I turn right.’
Ich biege nach 400 Metern rechts ab.
‘I turn right after 400 meters.’
21 / 107
22. Word
Can N-gram be universally applicable? Consider the following
German sentences. Where are the words?
abbiegen
‘to turn’
Ich biege ab.
‘I turn.’
Ich biege rechts ab.
‘I turn right.’
Ich biege nach 400 Metern rechts ab.
‘I turn right after 400 meters.’
Ich biege nach 400 Metern vor dem Baum mit Blumen rechts ab.
‘I turn right after 400 meters before the tree with flowers’.
22 / 107
24. Word
What is a word?
A word is a freestanding unit of meaning.
24 / 107
25. Word
What is a word?
A word is a freestanding unit of meaning.
English examples: a, university, bookstore, into, friendly,
faithfully, which, sternocleidomastoid ... etc.
25 / 107
26. Word
What is a word?
A word is a freestanding unit of meaning.
English examples: a, university, bookstore, into, friendly,
faithfully, which, sternocleidomastoid ... etc.
Mandarin examples: 書、跳、葡萄、網路、維骨力、...
26 / 107
27. Word
What is a word?
A word is a freestanding unit of meaning.
English examples: a, university, bookstore, into, friendly,
faithfully, which, sternocleidomastoid ... etc.
Mandarin examples: 書、跳、葡萄、網路、維骨力、...
Words are dynamically evolving. New words can be created every
day and may not be listed in the existing dictionary/lexicon (i.e,
out-of-vocabulary, OOV): 芒果乾、咩噗、天菜、...
27 / 107
28. Smaller than words
OK. Now we know what a word is. So, cat is a word, and cats is also
a word.
28 / 107
29. Smaller than words
OK. Now we know what a word is. So, cat is a word, and cats is also
a word.
Can “s” in cats be a word?
What about “ed” in walked?
29 / 107
30. Smaller than words
OK. Now we know what a word is. So, cat is a word, and cats is also
a word.
Can “s” in cats be a word?
What about “ed” in walked?
⇒ Sometimes, within a word, we can identify some smaller units
which also carry some meanings.
⇒ These smaller units are termed .
30 / 107
31. Smaller than words
OK. Now we know what a word is. So, cat is a word, and cats is also
a word.
Can “s” in cats be a word?
What about “ed” in walked?
⇒ Sometimes, within a word, we can identify some smaller units
which also carry some meanings.
⇒ These smaller units are termed .
Morpheme (詞
詞
詞素
素
素): a single unit of meaning
free morpheme: walk, cat, kick, eat, 吃、買、葡萄、... etc.
bound morpheme: -s (plural), -ed (past tense; participle), +們、+子、
小+
31 / 107
33. Identifying morphemes
How many morphemes are there in the word “hardness”?
hard is a morpheme, meaning the quality of being rigid.
33 / 107
34. Identifying morphemes
How many morphemes are there in the word “hardness”?
hard is a morpheme, meaning the quality of being rigid.
Set A: {hardness, harden, hardship, hardy}
34 / 107
35. Identifying morphemes
How many morphemes are there in the word “hardness”?
hard is a morpheme, meaning the quality of being rigid.
Set A: {hardness, harden, hardship, hardy}
ness is a morpheme, changing an adjective into a noun.
35 / 107
36. Identifying morphemes
How many morphemes are there in the word “hardness”?
hard is a morpheme, meaning the quality of being rigid.
Set A: {hardness, harden, hardship, hardy}
ness is a morpheme, changing an adjective into a noun.
Set B: {hardness, kindness, baldness, weirdness}
36 / 107
37. Allomorphs
Now we have a better idea of morphemes. But hold on a second,
the following two -ers mean different things!
37 / 107
38. Allomorphs
Now we have a better idea of morphemes. But hold on a second,
the following two -ers mean different things!
work – worker fast – faster
38 / 107
39. Allomorphs
Now we have a better idea of morphemes. But hold on a second,
the following two -ers mean different things!
work – worker fast – faster
⇒ The similarity of form does not guarantee the similarity in
meaning!
39 / 107
40. Allomorphs
Now we have a better idea of morphemes. But hold on a second,
the following two -ers mean different things!
work – worker fast – faster
⇒ The similarity of form does not guarantee the similarity in
meaning!
On the flip side, sometimes a similarity in meaning is not
matched by an exact similarity in form.
40 / 107
41. Allomorphs
Now we have a better idea of morphemes. But hold on a second,
the following two -ers mean different things!
work – worker fast – faster
⇒ The similarity of form does not guarantee the similarity in
meaning!
On the flip side, sometimes a similarity in meaning is not
matched by an exact similarity in form.
imprecise inadequate incomplete irresponsible illegal
41 / 107
42. Allomorphs
Now we have a better idea of morphemes. But hold on a second,
the following two -ers mean different things!
work – worker fast – faster
⇒ The similarity of form does not guarantee the similarity in
meaning!
On the flip side, sometimes a similarity in meaning is not
matched by an exact similarity in form.
imprecise inadequate incomplete irresponsible illegal
⇒The forms that are associated with the same morpheme (i.e.,
having the same meaning) but phonetically contrastive are called
.
42 / 107
43. Building a word
Now, let’s take a closer look at words. Consider the following forms
and determine if they are words.
unfriend
43 / 107
44. Building a word
Now, let’s take a closer look at words. Consider the following forms
and determine if they are words.
unfriend befriended
44 / 107
45. Building a word
Now, let’s take a closer look at words. Consider the following forms
and determine if they are words.
unfriend befriended unfriended
45 / 107
46. Building a word
Now, let’s take a closer look at words. Consider the following forms
and determine if they are words.
unfriend befriended unfriended
unbefriendship
46 / 107
47. Building a word
Now, let’s take a closer look at words. Consider the following forms
and determine if they are words.
unfriend befriended unfriended
unbefriendship un-ed
47 / 107
48. Building a word
Now, let’s take a closer look at words. Consider the following forms
and determine if they are words.
unfriend befriended unfriended
unbefriendship un-ed un-ship
48 / 107
49. Building a word
Now, let’s take a closer look at words. Consider the following forms
and determine if they are words.
unfriend befriended unfriended
unbefriendship un-ed un-ship
boyfriend
49 / 107
50. Building a word
Now, let’s take a closer look at words. Consider the following forms
and determine if they are words.
unfriend befriended unfriended
unbefriendship un-ed un-ship
boyfriend unboyfriend
50 / 107
51. Building a word
Now, let’s take a closer look at words. Consider the following forms
and determine if they are words.
unfriend befriended unfriended
unbefriendship un-ed un-ship
boyfriend unboyfriend
It looks like there are some rules/restrictions to building a word (or to
combine morphemes)!
51 / 107
52. Building a word
The foundation of a word: morpheme
(unfriend, befriended, ...)
52 / 107
53. Building a word
The foundation of a word: morpheme
(unfriend, befriended, ...)
Morphemes that go before the root:
(un-friend, ...)
53 / 107
54. Building a word
The foundation of a word: morpheme
(unfriend, befriended, ...)
Morphemes that go before the root:
(un-friend, ...)
Morphemes that come after the root:
(friend-ed, ...)
54 / 107
55. Building a word
The foundation of a word: morpheme
(unfriend, befriended, ...)
Morphemes that go before the root:
(un-friend, ...)
Morphemes that come after the root:
(friend-ed, ...)
Morphemes that are inserted within the root:
(fan-bloody-tastic)
55 / 107
56. Building a word
The foundation of a word: morpheme
(unfriend, befriended, ...)
Morphemes that go before the root:
(un-friend, ...)
Morphemes that come after the root:
(friend-ed, ...)
Morphemes that are inserted within the root:
(fan-bloody-tastic)
Morphemes that surround the root:
(a-fly-ing, as in Time is aflying.)
56 / 107
57. Building a word
The foundation of a word: morpheme
(unfriend, befriended, ...)
Morphemes that go before the root:
(un-friend, ...)
Morphemes that come after the root:
(friend-ed, ...)
Morphemes that are inserted within the root:
(fan-bloody-tastic)
Morphemes that surround the root:
(a-fly-ing, as in Time is aflying.)
Two free morphemes together:
(boy-friend)
57 / 107
58. Time out!
Give (Taiwan) Mandarin examples for the following morphemes and
post them on Padlet:
1 prefix
2 suffix
3 infix
4 circumfix
58 / 107
59. Other terms
Stem: A stem always includes the root and may also include one or
more affixes.
Lexicon: the Greek word for dictionary, as in mental lexicon.
59 / 107
60. Coding and decoding
Now, let’s consider the following examples/exercises.
Halfellalfo, halfow alfare yalfou?
60 / 107
67. Inflectional vs. derivational
Let’s revisit the suffixes in hard-ness and cat-s.
Do they induce the same or different effects?
⇒ ness: change the of the root
⇒ s: does not change the
67 / 107
68. Inflectional vs. derivational
English
Functions Affixes Attach to
3rd. per. sing.present -s verbs
past tense -ed verbs
progressive aspect -ing verbs
past participle -en, -ed verbs
plural -s nouns
comparative -er adjective, adverbs
superlative -est adjective, adverbs
68 / 107
69. Inflectional vs. derivational
English
Functions Affixes Attach to
3rd. per. sing.present -s verbs
past tense -ed verbs
progressive aspect -ing verbs
past participle -en, -ed verbs
plural -s nouns
comparative -er adjective, adverbs
superlative -est adjective, adverbs
⇒ affixes
69 / 107
72. Inflectional vs. derivational
Is there any order or principle to attach inflectional and derivational
affixes (for English)?
talks talker
72 / 107
73. Inflectional vs. derivational
Is there any order or principle to attach inflectional and derivational
affixes (for English)?
talks talker talkers *talkser
73 / 107
74. Inflectional vs. derivational
Is there any order or principle to attach inflectional and derivational
affixes (for English)?
talks talker talkers *talkser
reddish redness
74 / 107
75. Inflectional vs. derivational
Is there any order or principle to attach inflectional and derivational
affixes (for English)?
talks talker talkers *talkser
reddish redness reddishness *rednessish
75 / 107
76. Inflectional vs. derivational
Is there any order or principle to attach inflectional and derivational
affixes (for English)?
talks talker talkers *talkser
reddish redness reddishness *rednessish
antihuman inhuman
76 / 107
77. Inflectional vs. derivational
Is there any order or principle to attach inflectional and derivational
affixes (for English)?
talks talker talkers *talkser
reddish redness reddishness *rednessish
antihuman inhuman antiinhuman *inantihuman
77 / 107
78. Inflectional vs. derivational
Is there any order or principle to attach inflectional and derivational
affixes (for English)?
talks talker talkers *talkser
reddish redness reddishness *rednessish
antihuman inhuman antiinhuman *inantihuman
OK. Does that mean we, as second language users, have to memorize
all these rules?
-er > -s,
-ish > -ness,
anti- > -in,
... etc.?
78 / 107
79. Inflectional vs. derivational
Root
↓
Rules for root/stem boundary
derivations and irregular inflections
↓
Rules for word boundary derivations
and compounding
↓
Rules for word boundary inflections
79 / 107
80. Inflectional vs. derivational
Root
↓
Rules for root/stem boundary
derivations and irregular inflections
↓
Rules for word boundary derivations
and compounding
↓
Rules for word boundary inflections
Derivational affixes occurring at the
root/stem boundary: +ion, +ish,
+al, +ous, in+
Derivational affixes occurring at the
word boundary: #ness, #hood, #ist,
#ism, anti#
Inflectional affixes occurring at the
word boundary: #s, #ing, #ed
80 / 107
81. Inflectional vs. derivational
Root
↓
Rules for root/stem boundary
derivations and irregular inflections
↓
Rules for word boundary derivations
and compounding
↓
Rules for word boundary inflections
Derivational affixes occurring at the
root/stem boundary: +ion, +ish,
+al, +ous, in+
Derivational affixes occurring at the
word boundary: #ness, #hood, #ist,
#ism, anti#
Inflectional affixes occurring at the
word boundary: #s, #ing, #ed
*rats-eater, mice-eater
81 / 107
82. Inflectional vs. derivational
Root
↓
Rules for root/stem boundary
derivations and irregular inflections
↓
Rules for word boundary derivations
and compounding
↓
Rules for word boundary inflections
Derivational affixes occurring at the
root/stem boundary: +ion, +ish,
+al, +ous, in+
Derivational affixes occurring at the
word boundary: #ness, #hood, #ist,
#ism, anti#
Inflectional affixes occurring at the
word boundary: #s, #ing, #ed
*rats-eater, mice-eater
*houses cat, house cats
82 / 107
84. Hierarchical structure of words
How would you decompose the word undoable?
If you are sensitive enough, you should know that there are two
different ways of groupings to analyze this word:
84 / 107
85. Hierarchical structure of words
How would you decompose the word undoable?
If you are sensitive enough, you should know that there are two
different ways of groupings to analyze this word:
1 (un-(do-able))
2 ((un-do)-able)
85 / 107
86. Hierarchical structure of words
How would you decompose the word undoable?
If you are sensitive enough, you should know that there are two
different ways of groupings to analyze this word:
1 (un-(do-able))
2 ((un-do)-able)
Bracketing is away of decomposing the structure. But linguists
usually take another approach: Tree diagram
86 / 107
87. Hierarchical structure of words
un use able
Adj
Verb
Verb
Wait a minute! A few slides ago, we
talked about the order of affix
attachment. A general idea is that
derivational affixes should be attached
to the root before inflectional affixes.
But in this example, the inflectional
affix (un-) was attached before the
derivational affix (-able).
87 / 107
88. Hierarchical structure of words
un use able
Adj
Verb
Verb
Wait a minute! A few slides ago, we
talked about the order of affix
attachment. A general idea is that
derivational affixes should be attached
to the root before inflectional affixes.
But in this example, the inflectional
affix (un-) was attached before the
derivational affix (-able).
⇒ The rules do not explain all the
examples?
⇒ Exception? (Any other
exceptions?)
88 / 107
89. Hierarchical structure of words
Inflectional and derivational affixes are defined by Noam
Chomsky (Chomskian theory).
Cognitive linguistics takes a different approach.
89 / 107
90. Hierarchical structure of words
Inflectional and derivational affixes are defined by Noam
Chomsky (Chomskian theory).
Cognitive linguistics takes a different approach.
No more inflectional and derivational affixes.
Perspectives: un-use vs. use-able
⇒ Words with closer relationship were attached together first.
More on this in other courses, such as Cognitive Pragmatics.
90 / 107
91. Other word formation
We’ve seen affixation and compounding. Is there any other word
formation process? Consider the following examples.
Indonesian
rumah ‘house’ rumahrumah ‘houses’
ibu ‘mother’ ibuibu ‘mothers’
lalat ‘fly’ lalatlalat ‘flies’
91 / 107
92. Other word formation
We’ve seen affixation and compounding. Is there any other word
formation process? Consider the following examples.
Indonesian
rumah ‘house’ rumahrumah ‘houses’
ibu ‘mother’ ibuibu ‘mothers’
lalat ‘fly’ lalatlalat ‘flies’
Tagalog
bili ‘buy’ bibili ‘will buy’
kain ‘eat’ kakain ‘will eat’
pasok ‘enter’ papasok ‘will enter’
92 / 107
93. Other word formation
Some even more complicated way of word formation:
Tagalog
bili ‘buy’ mamimili ‘buyer’
sulat ‘write’ manunulat ‘writer’
Pisda ‘fish’ maNPiPisda ‘fisherman’
93 / 107
94. Other word formation
Some even more complicated way of word formation:
Tagalog
bili ‘buy’ mamimili ‘buyer’
sulat ‘write’ manunulat ‘writer’
Pisda ‘fish’ maNPiPisda ‘fisherman’
⇒ This process of word formation is termed Reduplication.
94 / 107
95. Other word formation
Reduplication is very common cross-linguistically. Study the following
examples and explain the effects of the reduplication.
Yesterday we just went out for coffee, but this weekend we are
going on a date-date.
That shirt isn’t what I had in mind; it’s too much pale of a green.
I want a shirt that is green-green.
95 / 107
96. Other word formation
Reduplication is very common cross-linguistically. Study the following
examples and explain the effects of the reduplication.
Yesterday we just went out for coffee, but this weekend we are
going on a date-date.
That shirt isn’t what I had in mind; it’s too much pale of a green.
I want a shirt that is green-green.
紅 vs. 紅紅
96 / 107
97. Other word formation
Reduplication is very common cross-linguistically. Study the following
examples and explain the effects of the reduplication.
Yesterday we just went out for coffee, but this weekend we are
going on a date-date.
That shirt isn’t what I had in mind; it’s too much pale of a green.
I want a shirt that is green-green.
紅 vs. 紅紅 vs. 紅紅紅
97 / 107
98. Other word formation
Reduplication is very common cross-linguistically. Study the following
examples and explain the effects of the reduplication.
Yesterday we just went out for coffee, but this weekend we are
going on a date-date.
That shirt isn’t what I had in mind; it’s too much pale of a green.
I want a shirt that is green-green.
紅 vs. 紅紅 vs. 紅紅紅
粉紅 vs. 粉紅粉紅 (?)
98 / 107
99. Other word formation
Reduplication is very common cross-linguistically. Study the following
examples and explain the effects of the reduplication.
Yesterday we just went out for coffee, but this weekend we are
going on a date-date.
That shirt isn’t what I had in mind; it’s too much pale of a green.
I want a shirt that is green-green.
紅 vs. 紅紅 vs. 紅紅紅
粉紅 vs. 粉紅粉紅 (?) vs. 粉紅粉紅粉紅 (?)
99 / 107
100. Other word formation
There are also other of morphemic alternations and suppletion
(i.e., irregular conjugation)
foot/feet, goose/geese, louse/Iice, man/men, mouse/mice,
tooth/teeth
ride/rode, freeze/froze, speak/spoke, steal/stole, sing/sang
strife/strive, teeth/teethe, breath/breathe, use/use
is/was, go/went, good/better/best, ...
100 / 107
101. Etymology
We spent the whole class talking about “decompose” the structure of
words and their correspondent attributes. Yet, there are also other
aspects we can look at words.
Etymology: (According the Webster Dictionary) the history of a linguistic form
(such as a word) shown by tracing its development since its earliest recorded occurrence
in the language where it is found, by tracing its transmission from one language to
another, by analyzing it into its component parts, by identifying its cognates in other
languages, or by tracing it and its cognates to a common ancestral form in an ancestral
language.
101 / 107
102. Etymology
Word Morpheme Gloss Other examples
Morphology morph- ‘shape’
-logy ‘study of’ phonology, psychology, ...etc.
Philosophy philo- ‘loving’ philharmonic
sophia ‘wisdom’
genesis gene ‘give birth’ gene, Eugene, ...etc.
centipede cent- ‘hundred’ century, centimeter, ... etc.
ped ‘foot’ pedestrian, expedite, ... etc.
exit ex- ‘out’
-it ‘go’
102 / 107
103. Etymology
Word Morpheme Gloss Other examples
Morphology morph- ‘shape’
-logy ‘study of’ phonology, psychology, ...etc.
Philosophy philo- ‘loving’ philharmonic
sophia ‘wisdom’
genesis gene ‘give birth’ gene, Eugene, ...etc.
centipede cent- ‘hundred’ century, centimeter, ... etc.
ped ‘foot’ pedestrian, expedite, ... etc.
exit ex- ‘out’
-it ‘go’
There are also some “codes” in names!
Barbara < Barbar, Lucy < luc, Tim < timid, cancer, ...
103 / 107
104. Wrap-up
Key concepts from today’s lecture:
1 What is a word? A is a freestanding unit of meaning.
104 / 107
105. Wrap-up
Key concepts from today’s lecture:
1 What is a word? A is a freestanding unit of meaning.
2 What is a morpheme? A is a smallest unit of meaning.
105 / 107
106. Wrap-up
Key concepts from today’s lecture:
1 What is a word? A is a freestanding unit of meaning.
2 What is a morpheme? A is a smallest unit of meaning.
3 Morphemes that change the lexical category are
morphemes and those don’t are morphemes.
106 / 107
107. Wrap-up
Key concepts from today’s lecture:
1 What is a word? A is a freestanding unit of meaning.
2 What is a morpheme? A is a smallest unit of meaning.
3 Morphemes that change the lexical category are
morphemes and those don’t are morphemes.
4 Word formations may be of different processes (e.g.,
reduplication, affixation, etc.) and driven by different linguistic
reasons (e.g., morphological categories, pragmatic purposes, etc.).
107 / 107