2013年7月16日にシンガポールで開催された第一回アジア組み合わせテストワークショップ(1st Asian Workshop on Combinatorial Testing for Complex Computer Systems)で発表した"Combinatorial Testing in Japan"のスライドを日本語にしました(だいぶ遅くなりましたが)。
英語版はこちら
https://www.slideshare.net/Bugler/combinatorial-testing-injapan20130616
2013年7月16日にシンガポールで開催された第一回アジア組み合わせテストワークショップ(1st Asian Workshop on Combinatorial Testing for Complex Computer Systems)で発表した"Combinatorial Testing in Japan"のスライドを日本語にしました(だいぶ遅くなりましたが)。
英語版はこちら
https://www.slideshare.net/Bugler/combinatorial-testing-injapan20130616
Misra cpp, cert cpp 2016 and RTL design style guide with HAZOPKiyoshi Ogawa
safety and security system with MISRA C++, CERT C++ and STARC RTL design style guide using HAZOP analysis. In Japan we use English on safety and security analysis with source code and coding standards in English.
Introduction to the 10th IEEE International Conference on Software Testing, Verification and Validation (ICST 2017) held on 13-17 March, 2017 in Tokyo, Japan.
How to Make Awesome SlideShares: Tips & TricksSlideShare
Turbocharge your online presence with SlideShare. We provide the best tips and tricks for succeeding on SlideShare. Get ideas for what to upload, tips for designing your deck and more.
IoT(internet of things) devices may be very dangerous for society. IoT cyber security Counter measurement will be proposed. Before study, check some slides, youtube movies and/or quiita contents. Main part will be announced at the room. HAZOP study for security analysis will be introduced today. Electric power source, harmonic generation, smoking, firing, wireless, noise, and human resources are discussed.
Misra cpp, cert cpp 2016 and RTL design style guide with HAZOPKiyoshi Ogawa
safety and security system with MISRA C++, CERT C++ and STARC RTL design style guide using HAZOP analysis. In Japan we use English on safety and security analysis with source code and coding standards in English.
Introduction to the 10th IEEE International Conference on Software Testing, Verification and Validation (ICST 2017) held on 13-17 March, 2017 in Tokyo, Japan.
How to Make Awesome SlideShares: Tips & TricksSlideShare
Turbocharge your online presence with SlideShare. We provide the best tips and tricks for succeeding on SlideShare. Get ideas for what to upload, tips for designing your deck and more.
IoT(internet of things) devices may be very dangerous for society. IoT cyber security Counter measurement will be proposed. Before study, check some slides, youtube movies and/or quiita contents. Main part will be announced at the room. HAZOP study for security analysis will be introduced today. Electric power source, harmonic generation, smoking, firing, wireless, noise, and human resources are discussed.
情報システム障害解析のための知識グラフ構築の試み / Constructing a knowledge graph for information sys...Shinji Takao
人工知能学会 第25回知識流通ネットワーク研究会発表 http://sigksn.html.xdomain.jp/conf25/index.html
システム障害解析に関する専門家知識の抽出、グラフ化、DB化を行った際得られた知見と、知識流通手段としての知識グラフの可能性と課題を考察した結果を報告します。
Knowledge graphs have been getting attention because of its relevance to interpretable AI. Not only that, they also can be useful as a knowledge sharing mean which enable non-experts to utilize experts’ knowledge. We aim to report findings from constructing a knowledge graph through eliciting experts’ knowledge and building a knowledge database. We also suggest the possibilities and issues of knowledge graph as a knowledge sharing mean.
Conceptual support for test case design (COMPSAC 87)Keizo Tatsumi
My presentation slides for COMPSAC '87. One of the earliest presentation about Combinatorial Testing.
K.Tatsumi, S.Watanabe, Y.Takeuchi, and H.Shimokawa, "Conceptual support for test case design," Proc. 11th Intl. Computer Software & Applications Conf.(COMPSAC), Oct. 1987
I put together historical topics regarding combinatorial testing on this timeline.
In the 1930s, Ronald Fisher developed the Design of Experiments.
Rao introduced orthogonal arrays in the 1940s
From the 1950s, Genichi Taguchi developed a methodology for applying statistics to improve quality in manufacturing and established the Quality Engineering.
Afterwards, his methodology got a great reputation and was named "Taguchi method" in the United States.
I think this reputation in the US was transmitted to Japan, Taguchi method drew attention in Japan in the early 1980s.
Shortly after, software QA engineers at Fujitsu started to apply the Design of Experiments to software testing in 1983, and they published papers in 1984 and 1987.
In the late 1980s, a few case studies were reported from NEC and IBM Japan, howe
In 1989, Fujitsu introduced this technique to AT&T.
After that, OATS, CATS and AETG were developed by AT&T group companies.
From the mid 1990s, combinatorial testing began to spread in the US.
In 1995, Dr. Phadke's paper was translated into Japanese and printed in the journal of Quality engineering.
Also, some case studies were reported in the community of quality engineering in the late 1990s.
However, combinatorial testing got much attention again after HAYST method was announced by Fuji Xerox in 2004.
Currently, many Japanese testers consider that Combinatorial Testing is one of the must-have techniques.
For Japan, we can say combinatorial testing is a re import technique.
6. 6
主要な国際会議 -アカデミック系
ISSTA (International Symposium on Software Testing and Analysis)
主催:ACM (Association for Computing Machinery)
第1回は1993年、元をたどると1978年のworkshop
研究者、企業の実務者、ICSTに比べてアカデミア寄り
併設ワークショップ: モデル検査、テスト自動化・モデルベース、パフォーマンス など
ICST (International Conference on Software Testing, Verification and Validation)
主催:IEEE (The Institute of Electrical and Electronics Engineers)
第1回は2008年(ノルウェイ)、毎年、米欧で交互に開催
研究者、企業の実務者
併設ワークショップ: モデルベース、セキュリティ、組み合わせ、クラウド など
ICSE併設ワークショップ (International Conference on Software Engineering)
AST (Automation of Software Test)
SBST (Search-Based Software Testing)
RST (Requirements Engineering and Testing)
MET (Metamorphic Testing)
(C) Keizo Tatsumi 2017
7. 7
主要な国際会議 – ビジネス系
STAREAST, STARWEST (Software Testing Analysis & Review Conference)
主催:SQE (Software Quality Engineering)
第1回は1992年
コンサルタント、実務者の発表が中心
CAST (Conference of the Association for Software Testing)
主催:AST (The Association for Software Testing)
第1回は2006年
コンサルタント、実務者の発表が中心
EuroSTAR (European conference on Software Testing, Analysis & Review)
主催:QualTech Ltd.
第1回は1993年
コンサルタント、実務者の発表が中心
その他
GTAC (Google Test Automation Conference)
Google主催のカンファレンス, 2006年から毎年開催
Agile Testing Days
ヨーロッパで開催, 2009年にドイツで開始され毎年開催
2017年6月に米国Bostonで第1回Agile Testing Days USAが開催予定
(C) Keizo Tatsumi 2017
8. ▲ ▲ ▲ ▲
EDSAC(最初のノイマン型コンピュータ) IBM System/360 IBM System/370 Cray-1(スパコン)
▲ ▲ ▲ ▲ ▲
UNIVAC1(世界初の商用コンピュータ) DEC PDP-1 DEC PDP-8 Apple PC IBM PC ▲
▲ ▲ ▲ Sun-
IBM 701 IBM 704 Intel 4004MPU
▲ ▲ ▲
Program Test Methods Symposium 1st Workshop 2nd Work
▲ ▲ on Software Testing
Courant Symposium IEEE Symposium on Computer Software Reliability
on Debugging Techniques ▲
in Large Systems International Conference on Reliable Software
1965 19701950 1955 1960 1975 1980
シンポジウム
8
2. テストの会議の歴史
1957, Digital Computer Programming
(McRacken)
•最も初期のプログラミング教科書
•”Program Checkout”の章でデバッグや
テストを説明
1961, Computer Programming Fundamentals
(Leeds & Weinberg)
•IBM社のLeedsとWeinbergが書籍
•初めて"Program Testing"の章が設けられた
1970, Debugging Techniques in Large
Systems (Rustin(Ed.))
•デバッグ技術のシンポジウム
•IBM社のElmendorf(原因結果グラフ考案者)
がテストプロセスに関して発表
1972, The Computer Program Test Methods
Symposium
•最初のテストのシンポジウム
•1973年に論文集を書籍化した“Program Test
Methods“(Hetzel(Ed.))がテストの最初の書籍
(C) Keizo Tatsumi 2017
9. 9
テストの会議の歴史
Cray-1(スパコン)
▲ ▲ ▲ ▲ ▲
Apple PC IBM PC ▲ Apple Macintosh iPhone iPad
Sun-1 ▲ ▲
Sun SPARC Intel Pentium Pro
▲ ▲ ▲ ▲ ▲ ▲ ▲
1st Workshop 2nd Workshop 3rd Workshop ISSTA ▲
on Software Testing Testing, Verification, ICST
um on Computer Software Reliability and Analysis (TAV) ▲ ▲
STAREAST/STARWEST CAST
onal Conference on Reliable Software ▲ ▲
EuroSTAR GTAC
▲ ▲
ソフトウェアシンポジウム(第1回) ソフトウェアテストシンポジウム(JaSST)
▲SPCシンポジウム(第1回)
20102000 20051980 1985 1990 1995
1978, Software Testing and Test Documentation Workshop
•最初のテストのワークショップ、世界の60人の専門家が出席
•1979年3月にWorkshop report発行(IEEE Computer誌)
•この後、1982年、1986年に継続して開催され、これが現在の
ISSTA (International Symposium on Software Testing and
Analysis) へ続く
ChairmanのEd Miller
(C) Keizo Tatsumi 2017
10. 10
3. ICSTの概要
2008年に第1回を開催
研究と実践をつなぐ新しいフォーラム
研究と産業(industry)のトラックと、専門分
野に関する多数のワークショップで構成
開催実績
1. ICST 2008 Lillehammer, Norway April 9-11, 2008
2. ICST 2009 Denver, Colorado, USA April 1-4, 2009
3. ICST 2010 Paris, France April 7-9, 2010
4. ICST 2011 Berlin, Germany March 21-25, 2011
5. ICST 2012 Montreal, QC, Canada April 17-21, 2012
6. ICST 2013 Luxembourg, Luxembourg March 18-22, 2013
7. ICST 2014 Cleveland, Ohio, USA March 31- April 4, 2014
8. ICST 2015 Graz, Austria April 13-17, 2015
9. ICST 2016 Chicago, IL, USA April 10-15, 2016
10. ICST 2017 Tokyo, Japan March 13-17, 2017
The IEEE International Conference on Software Testing Verification and Validation(ICST)
(C) Keizo Tatsumi 2017
14. 14
論文数、参加者数 (ASTERメンバー参加会議)
ICST 2015 Graz, Austria
参加者: 約250名
論文数: レビュ-129本、採択-32本(25%)
日本: 参加者-16名、発表-10件
ICST 2016 Chicago, IL, USA
参加者: 約200名
論文数: 研究-130本、採択-34本(26%)
日本: 参加者-13名、発表-9件
ICST 2017 Tokyo, Japan
参加者:
論文数: 研究-135本、採択-36本(27%)
日本:
参加者キット
検討中
乞うご期待
(C) Keizo Tatsumi 2017
15. 15
4. ICST 2017 プログラム概要
Program at a Glance
3/12(Sun) 3/13(Mon) 3/14(Tue) 3/15(Wed) 3/16(Thu) 3/17(Fri)
Co-located
Events Day
Workshops & Co-
located Events
Day
Main Conference
Day
Main Conference
Day
Main Conference
Day
Workshops &
Doctoral
Symposium Day
・IWESEP ・Mutation ・Keynote-1 ・Keynote-2 ・Keynote-3 ・A-MOST
・Asian PLoP ・TAIC PART ・InSTA
・ITEQS ・ACSE
・IWCT
・IWESEP ・Banquet
・Asian PLoP
・Doctoral
Symposium
・IPSJ SIGSE (in
Japanese)
・Various sessions
・Welcome
reception
・Various sessions ・Various sessions
・Open steering
committee
・IPSJ SIGSE (in
Japanese)
(C) Keizo Tatsumi 2017
16. 16
メイン・カンファレンス – 基調講演
Keynote-1 (3/14)
Title: The State of Continuous Integration Testing
at Google
Speaker: John Micco, Google, USA
Keynote-2 (3/15)
Title: TBA
Speaker: Kenji Nishikawa, Toyota Motor
Corporation, Japan
Keynote-3 (3/16)
Title: TBA
Speaker: TBA (from Europe)
(C) Keizo Tatsumi 2017