Download to read offline
![Ragelの書きかた
# ---- Literal ---string = ("'" . (any - "'")* . "'")
|('"' . (any - '"')* . '"');
integer = digit+;
atom = (alpha (alpha | digit)* );
# ---- Operator ---operator = "+" | "-" | "*" | "/";
main := |*
atom => {
material := Ore{
Token: ATOM,
Value: data[ts:te],
}
material.Research()
ores = append(ores, material)
};
String => {
material := Ore{
Token: STRING,
Value: data[ts:te],
}
material.Research()
ores = append(ores, material)
};
….](https://image.slidesharecdn.com/go-131014003606-phpapp01/75/Go-38-2048.jpg)
![トークンの処理
main := |*
atom => {
material := Ore{
Token: ATOM,
Value: data[ts:te],
}
material.Research()
ores = append(ores, material)
};](https://image.slidesharecdn.com/go-131014003606-phpapp01/75/Go-42-2048.jpg)
![対応させましょう
var oretokens = [...]int {
miner.ATOM: ATOM,
miner.STRING: STRING,
miner.OPERATOR: OPERATOR,
miner.BINDER: BINDER,
miner.ROUNDPAREN_O: ROUNDPAREN_O,
miner.ROUNDPAREN_C: ROUNDPAREN_C,
}
func toToken(ore miner.Ore) int {
return oretokens[ore.Token]
}](https://image.slidesharecdn.com/go-131014003606-phpapp01/75/Go-55-2048.jpg)
![トークンの型定義
type Env interface{}
type envs []Env
var environment envs
type EnvValue struct {
Name string
Val Env
}
func AccessEnv() *envs {
return &environment
}](https://image.slidesharecdn.com/go-131014003606-phpapp01/75/Go-72-2048.jpg)
Goで言語処理系(の途中まで)を作ろう
- 1.
- 2.
- 3.
- 4.
- 5.
- 6. Lispが持つ病 1. 関数型言語カッコイイ！ 2. 関数型言語の元祖といえばLisp！カッ コイイ！（括弧なだけに） 3.コンピューターサイエンス、Artifact Intelligenceの分野でも活躍！ Awesome！ 4. Lispが使いこなせると構文木も自由自 在！
- 7.
- 8.
- 9.
- 11.
- 12.
- 13. C言語が持つ病 1. 「Lightweight Languageって所詮富豪 プログラミングだよねー」 2.「Lightweight Languageって所詮ポイ ンタとかメモリアドレスとか知らないんで しょ」 3. 「Lightweight Languageってコンパイル のこととか所詮わからないんでしょ」
- 14.
- 15.
- 16.
- 18.
- 19.
- 20.
- 21. How to CreateYour Own Programming Language http://createyourproglang.com/
- 22. “The book Iwant to read.”
- 23. プログラミング言語処理の流れ 『Create your ownlanguage』より
- 24.
- 25.
- 26. 例: Haskell 2010Language Report literal -> integer | float | char | string digit -> ascDigit | uniDigit ascDigit -> 0 | 1 | … | 9 uniDigit -> any Unicode descimal decit decimal -> digit{digit} integer -> decimal
- 27.
- 28.
- 29.
- 30.
- 31.
- 32.
- 33. Ragel :: StateMachine Compiler
- 34. Ragel compiles executable finitestate machines from regular languages. Ragel targets C, C++, ObjectiveC, C#, D, Java, Ruby, OCaml and Go.
- 35.
- 37.
- 38. Ragelの書きかた # ---- Literal---string = ("'" . (any - "'")* . "'") |('"' . (any - '"')* . '"'); integer = digit+; atom = (alpha (alpha | digit)* ); # ---- Operator ---operator = "+" | "-" | "*" | "/"; main := |* atom => { material := Ore{ Token: ATOM, Value: data[ts:te], } material.Research() ores = append(ores, material) }; String => { material := Ore{ Token: STRING, Value: data[ts:te], } material.Research() ores = append(ores, material) }; ….
- 39.
- 40. 文字の規則とトークン # ---- Literal---string = ("'" . (any - "'")* . "'") |('"' . (any - '"')* . '"'); integer = digit+; atom = (alpha (alpha | digit)* ); # ---- Operator ---operator = "+" | "-" | "*" | "/";
- 41.
- 42. トークンの処理 main := |* atom=> { material := Ore{ Token: ATOM, Value: data[ts:te], } material.Research() ores = append(ores, material) };
- 43. トークンの管理方法 type Ore struct{ Token Token // int Name string }
- 44. トークンの定義 const( //Special Token ILLEGAL Token= iota EOF COMMENT begin_define_literal ATOM STRING INTEGER end_define_literal ……… ) 参考: go/token
- 45.
- 46.
- 47.
- 48. go tool yacc Yaccis a version of yacc for Go. It is written in Go and generates parsers written in Go. (公式より)
- 49.
- 50. go yaccの書きかた %type <val>ATOM, STRING, OPERATOR, BINDER, DEFINE %type <val> ARG %type <val> action, Expression %type <values> StringExpression, AtomExpression %% %{ package casting import ( "fmt" ".. /miner" ) %} %union { tok int val interface{} values Val box Box } %token ATOM STRING %token ARG %token OPERATOR BINDER DEFINE %token ROUNDPAREN_O ROUNDPAREN_C action: ATOM { var v Value v = Box{Type: ATOM, Value: $1,} yylex.(*lex).NewBox(v) } | Expression { if val, ok := $1.(Val); ok { yylex.(*lex).root = val } } ...
- 51.
- 52. 利用するトークンの定義 %token ATOM STRING %tokenARG %token OPERATOR %token BINDER DEFINE %token ROUNDPAREN_O ROUNDPAREN_C
- 53.
- 54.
- 55. 対応させましょう var oretokens =[...]int { miner.ATOM: ATOM, miner.STRING: STRING, miner.OPERATOR: OPERATOR, miner.BINDER: BINDER, miner.ROUNDPAREN_O: ROUNDPAREN_O, miner.ROUNDPAREN_C: ROUNDPAREN_C, } func toToken(ore miner.Ore) int { return oretokens[ore.Token] }
- 56.
- 57.
- 58. トークンの型定義 %union { tok int valinterface{} values Val box Box } %type <val> ATOM, STRING, OPERATOR, BINDER, DEFINE %type <val> ARG %type <val> action, Expression %type <values> StringExpression, AtomExpression
- 59.
- 60.
- 61.
- 62.
- 63.
- 64.
- 65. go/ast Package ast declaresthe types used to represent syntax trees for Go packages. (公式より) ※実はPythonにも標準パッケージとしてあります
- 66.
- 67.
- 68.
- 69.
- 70.
- 71.
- 72. トークンの型定義 type Env interface{} typeenvs []Env var environment envs type EnvValue struct { Name string Val Env } func AccessEnv() *envs { return &environment }
- 73.
- 74.
- 75.
- 76.
- 78.
- 79.