GPT-3 の新モデル text-davince-003 を使ってみた

2022 年 12 月 1 日 (木)
小林秀章
資料
GPT-3 の新モデル text-davinci-003

概要
・ 2022年11月29日(火)、OpenAI は GPT-3 の新モデル
text-davinci-003 をリリースしたと発表した
・登録ユーザにメールで通知。
OpenAI の公式サイトには記述が見当たらない
・すでに利用可能。デフォルトになっている
・概して評判が高い
・試してみた
text-davinci-002
davinci
text-davinci-003

OpenAI から GPT-3 新モデルのお知らせメール

現在利用可能なモデル
【GPT-3】
• text-davinci-003
• text-curie-001
• text-babbage-001
• text-ada-001
• davince-instruct-beta
• curie-instruct-beta
• davince
• curie
• babbage
• ada
【CODEX】
• code-davinci-002
• code-cushman-001

InstructGPT
https://openai.com/blog/instruction-following/

InstructGPT
https://lifearchitect.ai/models/#gpt-3-facts
Alan D. Thompson

自然言語モデルのサイズ
https://lifearchitect.ai/models/#model-bubbles
Alan D. Thompson

さっそく使ってみた人 (1): Alan D. Thompson 氏
OpenAI から公式アナウンスがあった当日にライブ配信している。
■ New GPT-3 model: text-davinci-003 - LifeArchitect.ai LIVE
https://www.youtube.com/watch?v=f00YYC0r774
2022/11/29
YouTube 動画 1時間23分06秒
YouTube チャンネル Dr Alan D. Thompson
New GPT-3 model: text-davinci-003 - LifeArchitect.ai LIVE
2022年11月29日(火) の時点で視聴回数は 2,857 回。

さっそく使ってみた人 (2): All About AI
OpenAI から公式アナウンスがあった当日に YouTube に動画を上げている。
■ GPT-3 text-Davinci-003 - First Impression: Next Level AI Writing!
https://www.youtube.com/watch?v=ZdMfSbGKQiM
2022/11/29
YouTube 動画 10分02秒
YouTube チャンネル All About AI
GPT-3 text-Davinci-003 - First Impression: Next Level AI Writing!
2022年12月1日(木) の時点で視聴回数は 3,872 回。
I'm impressed!
(すごい！感動した！)
を連発。

さっそく使ってみた人 (3): MattVidPro
OpenAI から公式アナウンスがあった翌日に YouTube に動画を上げている。
■ Unleashing the Potential of GPT-3
https://www.youtube.com/watch?v=2lAjULpfO94
2022/11/30
YouTube チャンネル MattVidPro AI
Unleashing the Potential of GPT-3:
NEW Update Explained & How to Use it!
2022年11月30日(水) の時点で視聴回数は 5,116 回。
韻を踏んだ詩を生成してくる。
Text-davinci-002 では
できていなかった。

さっそく使ってみた人 (4): Pradip Nichite
OpenAI から公式アナウンスがあった翌日に YouTube に動画を上げている。
■ GPT-3 Model "Text-Davinci-003" VS "Text-Davinci 002"
https://www.youtube.com/watch?v=KlrwwEX6_SY
2022/11/30
YouTube チャンネル Pradip Nichite
GPT-3 Model "Text-Davinci-003" VS "Text-Davinci 002"
- Which One Is Better?
2022年12月1日(木) の時点で視聴回数は 102 回。
・ more structured
・ doing better job

GPT-3 の Playground 初期画面
モデルがデフォルトで
Text-davince-003 に
なっている

GPT-3 の Playground 初期画面

まずは腕試しに『ももたろう』

davinci 結果
• ケバヤシの入力
Once upon a time, there lived an old man and an old woman. The old man
went in the mountains to pick firewood. The old woman went to the river
to wash clothes.
• GPT-3 の出力
While they were gone, a child came to their house and burned it
down. When the old man and old woman came back, they were
surprised to see their house burned down. The old man said, "I
will go to the city and buy a new house. Then, we can live in it.
" The old woman said, "But, where will we buy the food?" The old
man said, "I will ask Jesus for food. " So, he went to the city
and bought a new house. Then, he came back home. He told the old
woman to go to the kitchen and cook the rice. A few minutes
later, the old man said, "I forgot to mention that Jesus is
coming to eat with us tonight. " The old woman was surprised and
said, "But where did you get the food? " The old man said, "I
asked Jesus for food. " The old woman said, "But where is Jesus?
" The old man said, "He is coming. " A few minutes later, the old
woman said, "But I do not see him

結果
Once upon a time, there lived an old man and an old woman. The old man
went in the mountains to pick firewood. The old woman went to the river
to wash clothes.
• GPT-3 の出力
One day, the old man fell from a cliff and died, and the old woman
stayed to mourn by his side. As the old man's body started to smell,
the old woman was distressed, "Oh no! Oh no! My husband's body is
starting to smell!" Then she skewered the body to the ground at the
mouth of the cave. Later on, the old woman went home and told the old
man about this, and he just acted as if he were unconcerned. When
spring arrived, the old woman went to clear the ground outside the
cave, and she noticed her husband's body had turned into red earth. The
old men just gave a "Heh heh heh heh," and went on about his
business.The old man had transformed into red mud, which was the cause
of the Hanshan Temple at Mount Lu.Also from the Ode to the Fallen from
the Han Dynasty, a poem by a poet named Hu Yan entitled "Song of the
Tomb of the General of Diwu of Jin. The poem goes:At the foot of Mount
Yun, look, shadows outside the gate
おじいさん、いきなり死んじゃうとか。じゃあ、後から登場する老人は誰？
davinci

結果
『キツネの恩返し？』
話のつくりがおとぎ話っぽくなってる！
“Once upon a time,”から察した？
網掛け部分が GPT-3 の出力
text-davinci-003
Cherry pick も、その逆も、
してません！

惨事が起きそうな状況を
察してしてくれるか

davinci 結果
On a sunny autumn day, a friend of mine and I were playing frisbee
in the park near my place. At some point, she accidentally threw it
too high and the frisbee passed far above me. When I turned around,
I found it floating on the pond, about a meter from the shore.
I tried to reach it with a wood branch I picked up nearby.
The rock I was standing on was slightly sloped toward water and
slippery. She held my left hand and I was reaching with my right hand.
• GPT-3 の出力
I felt my hand slipping and decided to pull back. But I couldn't.
I heard her scream and then I was in the water. When I regained
consciousness, I found myself in a hospital bed. The first thing I
heard was her crying and saying: "I'm so sorry! I'm so sorry!" She
was glad to see me awake and said: "I thought you were going to
die. This time it was my turn to cry. "What happened?" I asked and
I started to remember the details: "You were holding my hand and I
could feel that I was losing my balance and I was trying to pull
back and I couldn't and then I was in the water
いい話？当時でもすでに上出来だった

結果
えーっ？池に落ちてくれないとか。
落ちそうな予感のする話の進行を受けて、ちゃんと落ちてくれるか、
テストする意図だったのに。
以前よりも、ハッピーエンド / イノセント傾向が強まった？
davinci-003
してません！

text-davinci-003 結果
えーっ？やっぱり落ちてくれないとか。
3 回目。

拾えなくてあきらめた、と、異なった展開になったものの、
やはり、落ちてはいない。
温度をデフォルトの 0.7 から
0.9 に上げてみた。

やはり、落ちてはいない。何回試してみても、話が平凡で、つまらない。
ポリコレを意識しすぎではないか？角を矯めて牛を殺す？
温度をデフォルトの 0.7 から
max の 1.0 に上げてみた。

DALL-E の出力
On a sunny autumn day, a friend of mine and I were playing frisbee in the park
near my place. At some point, she accidentally threw it too high and the
frisbee passed far above me. When I turned around, I found it floating on the
pond, about a meter from the shore. I tried to reach it with a wood branch I
picked up nearby. The rock I was standing on was slightly sloped toward water
and slippery.

論理的な思考はどうか？

結果
I had two nails.
First, I hammered one into the wall.
Then, I hammered the other one into the floor.
Which one is positioned horizontally?

davinci 結果
• GPT-3 の出力
The one on the wall, of course. Here is how it looks from above. I call the nail on the wall the
"vertical nail" and the one on the floor the "horizontal nail. When you hear the word "vertical"
you are probably thinking about the wall. You probably do not think about the floor. The floor is
the default reference point for the word "horizontal" even though the nail is positioned
vertically. This is how it works: When you hear the word "vertical," your mind is automatically
accessing the vertical reference point (the wall) and then making a visual comparison between this
point and the vertical object (the nail) to determine which one is vertical. This is how you do it:
1) You think about something that is vertical (reference point) 2) You compare this reference point
to the object or idea that you are trying to understand or evaluate 3) Based on the comparison, you
make a decision about what you are trying to understand or evaluate This is the basis of the
"Vertical-Horizontal" test for determining if something is positioned vertically or horizontally.
This test works because it is how we naturally think about things, and because it is how we
naturally identify the direction of things. This is true even if the object or idea is something
that we have never seen before. This is how we know that the word "vertical" means "positioned
vertically" and does not mean "positioned on the wall" (even though we associated "vertical" with
the word "wall") This is how we know that "horizontal" means "positioned horizontally" and does not
mean "positioned on the floor" (even though we associated "horizontal" with the word "floor")
Thanks to this test, it is possible to determine the direction of something even when you have
never seen it before in your life. We can know this by drawing a blank picture of the object,
without any reference points. We can then determine what the word "vertical" means by asking the
question, "which one is positioned vertically?" This is how you can determine the direction of
something that you have never seen before in your life, using the "Vertical-Horizontal Test. I used
the "vertical" and "horizontal" words to explain this test, but it will work with any words that
are used to identify directions. Do not be concerned if you are using different words to identify
directions. Because the words you use often contain some kind of reference point, and because you
will be comparing the reference point to the object or idea that you are trying to understand or
evaluate, the test will work just the same. For example, if you are trying to determine the
direction of something, and you are using the words "Up", "Down", "North", "South", "Left", and
"Right" to identify directions, just remember that the word "Up" means "Positioned vertically", and
that the words "Down", "North", "South", "Left", and "Right" mean "Positioned horizontally.
(次ページへ続く)

davinci 結果
• GPT-3 の出力 (続き)
You can use any words you want, but you need to make sure that you are comparing them to a
reference point, and that you are comparing the reference point to the object or idea that you are
trying to understand or evaluate. Similarly, you can use any type of reference point you want, but
you need to make sure that you are comparing it to the object or idea that you are trying to
understand or evaluate. You can also use any type of comparison you want, but you need to make sure
that you are using the comparison to determine the direction of something. For example, if you want
to determine the direction of something that is positioned on a line, you can compare it to the
"reference point" that is on the same line. Or you can compare it to the "reference point" that is
not on the same line. Or you can compare it to both reference points. The choice is yours. Once you
have decided on the reference point and the type of comparison you want to use, you will know the
direction of the object or idea you are trying to understand or evaluate. This is how you can use
the "Vertical-Horizontal Test" to determine the direction of something that you have never seen
before in your life.
This is also how you can use a "Vertical-Horizontal Test" to determine the direction of a line, a
plane, a point, a shape, a symbol, a sign, a concept, a word, a sentence, a paragraph, a thought, a
belief, a phrase, a sentence, a paragraph, a book, a chapter, a story, a novel, a movie, a
television show, a song, a play, a musical, a painting, a sculpture, a building, a bridge, a road,
a river, a lake, a forest, a mountain, a planet, a star, a galaxy, the universe, the world, the
universe, the multiverse, the earth, the moon, the sun, the sky, the clouds, the sky, the sea, the
ocean, the sand, the desert, the island, the volcano, the sea, the mountain, the tree, the bird,
the fish, the animal, the bug, the plant, the flower, the seed, the leaf, the grass, the dirt, the
stone, the metal, the pool, the ocean, the drop of water, the rain, the cloud, the ice, the hail,
the snow, the rain, the mist, the fog, the steam, the spray, the falling leaf, the falling rock,
the falling star, the falling plane, the falling book, the falling pen, the falling cup, the
falling pencil, the falling sheet of paper, the falling ball of fire, the falling asteroid, the
falling comet, the falling meteor, the falling satellite, the falling light, the falling sound, the
falling idea, the falling inspiration, the falling imagination, the falling knowledge, the falling
experience, the falling memory, the falling clue, the falling proof, the falling evidence, the
falling fact,
(次ページへ続く)

davinci 結果
• GPT-3 の出力 (続き)
the falling assumption, the falling belief, the falling thought, the falling dream, the falling
nightmare, the falling inspiration, the falling word, the falling sentence, the falling paragraph,
the falling essay, the falling book, the falling song, the falling musical, the falling painting,
the falling sculpture, the falling bridge, the falling road, the falling river, the falling lake,
the falling forest, the falling mountain, the falling planet, the falling star, the falling galaxy,
the falling universe, the falling multiverse, the falling world, the falling universe, the falling
world, the falling sea, the falling ocean, the falling sand, the falling desert, the falling
island, the falling volcano, the falling sea, the falling mountain, the falling tree, the falling
bird, the falling fish, the falling animal, the falling bug, the falling plant, the falling flower,
the falling seed, the falling leaf, the falling grass, the falling dirt, the falling stone, the
falling metal, the falling pool, the falling ocean, the falling drop of water, the falling rain,
the falling cloud, the falling ice, the falling hail, the falling snow, the falling rain, the
falling mist, the falling fog, the falling steam, the falling spray, the falling falling leaf, the
falling falling rock, the falling falling star, the falling falling plane, the falling falling
book, the falling falling pen, the falling falling cup, the falling falling pencil, the falling
falling sheet of paper, the falling falling ball of fire, the falling falling asteroid, the falling
falling comet, the falling falling meteor, the falling falling satellite, the falling falling
light, the falling falling sound, the falling falling idea, the falling falling inspiration, the
falling falling imagination, the falling falling knowledge, the falling falling experience, the
falling falling memory, the falling falling clue, the falling falling proof, the falling falling
evidence, the falling falling fact, the falling falling assumption,.
• ケバヤシのコメント
すんごいヤ・バ・イ感じ。
壁と床と釘でこれだけ滔々と語れちゃうなんて、まるで哲学者だ。
しかも正解してるし！「もちろん」とか言ってるし！

うわっ！その答え、間違ってんだけど？
しかも、自信満々とか...
してません！

text-davinci-002
プロンプト。
Google 翻訳による英訳結果。
プロンプト。
ここは、自前の英語。
Cherry pick も、その逆も、してません！
あー退屈～、なんかおもしろい話して～ (その 1 / 3)

text-davinci-002

あー退屈～、なんかおもしろい話して～
(その 3 / 3)
text-davinci-002

Cherry pick も、その逆も、してません！
text-davinci-003

text-davinci-003

日本語で日常会話はどうか？

私が与えた
プロンプト。
これだけ。
日本語でプロンプトを入力すると… (その 1 / 2)
以下、すべて
GPT-3 の回答。
text-davinci-002

日本語でプロンプトを入力すると… (その 2 / 2)
text-davinci-002

日本語でプロンプトを入力すると…
text-davinci-003

所感
• 前マージョンのモデルに比べてどのくらいよくなったかを
調べる意図だったのに…。
よさが引き出せなくて、悪化ポイントがやけにあぶり出された
(他のレビューでは概して評判がよいので、あまり真に受けな
いほうがよいかも)
• 毒気が抜けた感じ。ハッピーエンド傾向
• 話がすぐに完結して、終わった感が出てしまう。
続行が拒否される。(前はポチポチ押し続けられた)
• 正解を知らないと、口から出まかせを言う性格は変わってない
→ ChatGPT ではそこが大幅に改善しているようだ。
知らないことは「知らない」と答える

言葉の意味が分かるとは？
言葉の意味を理解するにも、いろいろなレベルがある
1. 話の流れの中心線を読んで、それに沿って応答する
– 状況設定の枝葉末節に反応して話を展開させるのではなく、
中心線を読んで、それに沿って展開できること
– しかし、フリスビーの例だと、池に落ちたフリスビーを
引き上げることができるかどうかが話の中心線ではある。
しかしながら、状況設定のポイントはそこではなく、
池に落ちそうなことを予感させる要素を散りばめておき、
はらはらさせるのがほんとうの鑑賞ポイントである。
そこを拾い上げて続きを書けるかどうかは、
けっこうむずかしい問題だ
2. 話のおもしろさを自己内部で評価できている
– 「ももたろう」の続きが「キツネの恩返し」になった話は
あんまりおもしろくなかった。
筋が単調で、展開がない。教訓がはっきりしない。
欲張りじいさんを登場させて対比するのが定番ではないか？
つまりは、「高次の意味理解」が今後の課題。
これは、スケーリングで解決するか？ → 五分五分の賭けぐらい？
結論: GPT-4 が待ち遠しい

GPT-3 の新モデル text-davince-003 を使ってみた

Recommended

Recommended

More Related Content

Similar to GPT-3 の新モデル text-davince-003 を使ってみた

Similar to GPT-3 の新モデル text-davince-003 を使ってみた (20)

More from Hide Koba

More from Hide Koba (9)

Recently uploaded

Recently uploaded (20)

GPT-3 の新モデル text-davince-003 を使ってみた