BERT を中心に解説した資料です.BERT に比べると,XLNet と RoBERTa の内容は詳細に追ってないです.
あと,自作の図は上から下ですが,引っ張ってきた図は下から上になっているので注意してください.
もし間違い等あったら修正するので,言ってください.
(特に,RoBERTa の英語を読み間違えがちょっと怖いです.言い訳すいません.)
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
XLNet: Generalized Autoregressive Pretraining for Language Understanding
RoBERTa: A Robustly Optimized BERT Pretraining Approach
durable_rules is a framework for real-time event processing and inference using a Rete algorithm. It was created based on the author's personal research and can analyze streaming data to infer new information using rules. The document discusses the history of rule-based systems and expert systems, describes how the Rete algorithm works to efficiently match patterns in data, benchmarks durable_rules' performance against alternative approaches, and provides an example of using it to solve a seating arrangement problem based on guest attributes. Future plans include improving performance, supporting richer queries, and potentially developing it as a web service.
BERT を中心に解説した資料です.BERT に比べると,XLNet と RoBERTa の内容は詳細に追ってないです.
あと,自作の図は上から下ですが,引っ張ってきた図は下から上になっているので注意してください.
もし間違い等あったら修正するので,言ってください.
(特に,RoBERTa の英語を読み間違えがちょっと怖いです.言い訳すいません.)
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
XLNet: Generalized Autoregressive Pretraining for Language Understanding
RoBERTa: A Robustly Optimized BERT Pretraining Approach
durable_rules is a framework for real-time event processing and inference using a Rete algorithm. It was created based on the author's personal research and can analyze streaming data to infer new information using rules. The document discusses the history of rule-based systems and expert systems, describes how the Rete algorithm works to efficiently match patterns in data, benchmarks durable_rules' performance against alternative approaches, and provides an example of using it to solve a seating arrangement problem based on guest attributes. Future plans include improving performance, supporting richer queries, and potentially developing it as a web service.
16. 参考になるページ
The F# Type Provider SDK (fsprojects.github.io)
https://fsprojects.github.io/FSharp.TypeProviders.SDK/
Type Providers From the Ground Up - Mavnn's blog
https://blog.mavnn.co.uk/type-providers-from-the-ground-up/
なごやまつりでF# Type Providerについて(?)話してきた - ぐるぐ
る~ (hatenablog.com)
https://bleis-tift.hatenablog.com/entry/ngmatsuri
型プロバイダー(TypeProviders)のちょっとしたアレコレ - Bug
Catharsis (hatenablog.com)
https://zecl.hatenablog.com/entry/TypeProvderArekore