20. ์์ธ #0
๏ต๋ค์ ๋ฌธ์๋ค์ ์์ธ(Indexing)ํ๋ค๋ฉด?
The bright blue butterfly hangs on the breeze
It's best to forget the great sky and to retire from
every wind
Under blue sky, in bright sunlight, one need not search
around
21. ์์ธ #1 - tokenizing
๏ต๋จผ์ ๋จ์ด๋ณ๋ก ๋๋๋ค.
DOC1 The
bright
blue
butterfly
hangs
on
the
breeze
DOC2 Itโs to
best retire
to from
forget every
the wind.
great
sky
and
DOC3 Under not
blue search
sky around.
in
bright
sunlight
one
need
22. ์์ธ #2 - ๋ณํ
๏ตํน์๋ฌธ์ ์ ๊ฑฐ
DOC1 The
bright
blue
butterfly
hangs
on
the
breeze
DOC2 Itโs to
best retire
to from
forget every
the wind
great
sky
and
DOC3 Under not
blue search
sky around
in
bright
sunlight
one
need
23. ์์ธ #3 โ ์ญ์ธ๋ฑ์ค
๏ต๋ฌธ์ -> ๋จ์ด ์์ ๋จ์ด -> ๋ฌธ์๋ก ๋ณํ
๋จ์ด ๋ฌธ์ ๋จ์ด ๋ฌธ์ ๋จ์ด ๋ฌธ์ ๋จ์ด ๋ฌธ์
The 1 Itโs 2 to 2 in 3
bright 1 best 2 retire 2 bright 3
blue 1 to 2 from 2 sunlight 3
butterfly 1 forget 2 every 2 one 3
hangs 1 the 2 wind 2 need 3
on 1 great 2 Under 3 not 3
the 1 sky 2 blue 3 search 3
breeze 1 and 2 sky 3 around 3
24. ์์ธ #4 โ ๊ฐ์ ๋จ์ด ํฉ์น๊ธฐ
๏ต๊ฐ์ ๋จ์ด๋ฅผ ํฉ์น๊ธฐ ์ํด์ ์ด๋ป๊ฒ ํด์ผ ํ ๊น?
๋จ์ด ๋ฌธ์ ๋จ์ด ๋ฌธ์ ๋จ์ด ๋ฌธ์ ๋จ์ด ๋ฌธ์
The 1 Itโs 2 to 2 in 3
bright 1 best 2 retire 2 bright 3
blue 1 to 2 from 2 sunlight 3
butterfly 1 forget 2 every 2 one 3
hangs 1 the 2 wind 2 need 3
on 1 great 2 Under 3 not 3
the 1 sky 2 blue 3 search 3
breeze 1 and 2 sky 3 around 3
25. ์์ธ #4-1 โ ๋์๋ฌธ์ ๋ณํ
๏ต๋๋ฌธ์๋ฅผ ์๋ฌธ์๋ก.
๋จ์ด ๋ฌธ์ ๋จ์ด ๋ฌธ์ ๋จ์ด ๋ฌธ์ ๋จ์ด ๋ฌธ์
the 1 itโs 2 to 2 in 3
bright 1 best 2 retire 2 bright 3
blue 1 to 2 from 2 sunlight 3
butterfly 1 forget 2 every 2 one 3
hangs 1 the 2 wind 2 need 3
on 1 great 2 under 3 not 3
the 1 sky 2 blue 3 search 3
breeze 1 and 2 sky 3 around 3
26. ์์ธ #4-2 โ ์ ๋ ฌ
๏ต๋ค์ ์ฒ๋ฆฌ๋ฅผ ์ํด์ ์ ๋ ฌ๋ ํ๊ฒ๋จ
๋จ์ด ๋ฌธ์ ๋จ์ด ๋ฌธ์ ๋จ์ด ๋ฌธ์ ๋จ์ด ๋ฌธ์
and 2 butterfly 1 need 3 sunlight 3
around 3 every 2 not 3 the 1
best 2 forget 2 on 1 the 1
blue 1 from 2 one 3 the 2
blue 3 great 2 retire 2 to 2
breeze 1 hangs 1 search 3 to 2
bright 1 in 3 sky 2 under 3
bright 3 itโs 2 sky 3 wind 2
27. ์์ธ #4-3 โ ๋ถ์ฉ์ด ์ ๊ฑฐ
๏ต๋๋ฌด ํํด์ ์ ์ฐ๋๊ฑธ ์ง์ฐ์.
๏ต๊ฒ์์ด๋ก์ ๊ฐ์น๊ฐ ์์
a not
and on
around one
every the
for to
from under
in โฆ
it โฆ
itโs โฆ