PFN福田圭祐による東大大学院「融合情報学特別講義Ⅲ」(2022年10月19日)の講義資料です。
・Introduction to Preferred Networks
・Our developments to date
・Our research & platform
・Simulation ✕ AI
This document summarizes a research paper on scaling laws for neural language models. Some key findings of the paper include:
- Language model performance depends strongly on model scale and weakly on model shape. With enough compute and data, performance scales as a power law of parameters, compute, and data.
- Overfitting is universal, with penalties depending on the ratio of parameters to data.
- Large models have higher sample efficiency and can reach the same performance levels with less optimization steps and data points.
- The paper motivated subsequent work by OpenAI on applying scaling laws to other domains like computer vision and developing increasingly large language models like GPT-3.
PFN福田圭祐による東大大学院「融合情報学特別講義Ⅲ」(2022年10月19日)の講義資料です。
・Introduction to Preferred Networks
・Our developments to date
・Our research & platform
・Simulation ✕ AI
This document summarizes a research paper on scaling laws for neural language models. Some key findings of the paper include:
- Language model performance depends strongly on model scale and weakly on model shape. With enough compute and data, performance scales as a power law of parameters, compute, and data.
- Overfitting is universal, with penalties depending on the ratio of parameters to data.
- Large models have higher sample efficiency and can reach the same performance levels with less optimization steps and data points.
- The paper motivated subsequent work by OpenAI on applying scaling laws to other domains like computer vision and developing increasingly large language models like GPT-3.
量子コンピュータ関連のコミュニティ・サイトであるQuantum Programming Studioの紹介です。
Introducing Quantum Programming Studio, a community site related to quantum computing.
#OpenQL勉強会
46. Javaで量子プログラミング
46
現在の量子プログラミングは、
量子回路の素子に対する低レイヤのプログラミング
Program p = new Program(2);
Gate xGate1 = new X(0);
Step step1 = new Step();
step1.addGate(xGate1);
p.addStep(step1);
Gate hGate2 = new Hadamard(0);
Gate xGate2 = new X(1);
Step step2 = new Step();
step2.addGates(hGate2, xGate2);
p.addStep(step2);
SimpleQuantumExecutionEnvironment sqee = new
SimpleQuantumExecutionEnvironment(); Result res = sqee.runProgram(p);
Qubit[] qubits = res.getQubits();
Arrays.asList(qubits).forEach(q -> System.out.println("qubit with probability on 1 =
"+q.getProbability()+", measured it gives "+ q.measure()));
量子回路