1. Talk
and
Play
for
Interac1ve
Learning
Playground

2. Member
1.
Chatsuda
Ra,arasan
ID:
53270615
2.
Surasawadee
Mantaak
ID:
53270647
3.
Arthit
Kritsin
ID:
53270651
Advisor
:
Dr.
Priyakorn
Pusawiro
Co-­‐Advisor
:
Dr.
Jaturon
Harnsomburana

3. Outline
•
•
•
•
•
•
•
Project
DescripMon
Problem
Statement
and
MoMvaMon
ObjecMve
Project
Scope
Proposed
Methodology
Equipment
and
Tools
Required
Deliverables
for
Term
1

4. TaP
Talk and Play for Interactive
Learning Playground

5. What is
“TaP”

7. Motivation
Photo credit: http://www.madeformums.com/toddler/children-bribed-to-read-by-parents/11270.html

8. Motivation
Jean Piaget
Seymour Papert
Constructivism
Constructionism

9. Motivation
SO HARD
Photo credit: http://www.dyslexia.ie/wp-content/uploads/2011/01/Maths.jpg

10. Motivation
Game Based Learning
Photo credit: http://www.upsidelearning.com/blog/wp-content/uploads/2011/06/What-Is-Game-Based-Learning.jpg

11. Motivation
Social
Interaction
Activity with
Real World
Photo credit: http://enableeducation.com/blog/wp-content/uploads/2013/04/shutterstock_16121635.jpg
Learn
Through
Game

12. Objective
1
2
Make learning easy
Deliver direct /
indirect knowledge
3
Study movements
and Physics

13. Objective
4
5
Compare motion
detecting devices
Compare developing
environment
6
Practise engineering
methods and teamwork

14. Project Scope
School-age children to preteen children
Photo credit : http://agent-for-endring.no/wp-content/uploads/2013/08/dev-bg-home-2.jpg

15. Project Scope
6 - 12 years old
Photo credit : http://agent-for-endring.no/wp-content/uploads/2013/08/dev-bg-home-2.jpg

16. Project Scope
What Toys are
Appropriate for My Child
Good Toys for Young
Children by Age and Stage
National Association for Education of
Young Children

17. Project Scope
Photo credit : http://0.tqn.com/d/familyinternet/1/0/L/2/-/-/Kinect_Lifestyle1.jpg

18. Project Scope
Covered knowledge from
general education subjects
Photo credit : http://fargoparks.areavoices.com/files/2012/03/art-kids.jpg

19. Project Scope
● Mixing Colors Game
● Reflecting Light Game
● Word Guessing Game
● Math Game
● Geometry Game

20. Related Work

21. Methodology
Compare
moMon
detecMon
devices
Kinect
Leap
Mo1on
Web
camera
Pla=orm
Windows 7, 8
Mac OS
Windows 7, 8
Mac OS
Develop
Kinect SDK
Microsoft Visual Studio,
OpenCV, OpenNI,
EmguCV
Leap Motion SDK,
Microsoft Visual
Microsoft Visual Studio Studio, OpenCV,
EmguCV
Language
C#, C++, Java,
Processing
Java, C++, C, C#,
Python, JavaScript
Constrain
Recognize 6 people but
detect full body up to 2
people
Cannot detect full body Difficult to detect
skeleton in real time
Detec1on
length
3.5 meters
1 meter (3 feet)
Windows 7, 8
Mac OS
C#, VB .NET
More than 2 meters
(depend on model)

22. Limitation
● 2 players for full body
● High of player at least 1 M
● Playground area 3.5 x 3.5 M
● Indoor place / Dim place
● Player must stand in the straight orientation
● Flat Floor / smooth surface

23. Methodology
Related theories
Children development and learning
Photo credit : http://www.cbtrust.org.uk/prevention/learningzone/

24. Methodology
Related theories
Colors theory
Physics of color which
guidelines of color mixing
Photo credit : http://www.artsparx.com/colorwheel.asp

25. Methodology
Related theories
Light theory
Learning physical of light such as
absorption, Reflection, etc.
Photo credit : http://upload.wikimedia.org/wikipedia/en/f/f8/Prismagoethe.gif

26. Methodology
Related theories
Geometric theory
Photo credit : http://ktenaglia.blogspot.com/2011/04/geometry-riddles_10.html

27. Methodology
Consider
plaUorm
to
be
used

28. Methodology
Research
on
library
and
consider
to
be
used.
Kinect SDK
Tool and APIs need to develop Kinect-enabled
applications for Microsoft Windows
OpenNI
Kinect library or tools use to develop Kinect
OpenCV
Image processing library

29. Methodology
Research
on
library
and
consider
to
be
used.
EmguCV
Cross platform .Net wrapper to the OpenCV
image processing library
OpenCVSharp
Cross platform wrapper of OpenCV
for .NET Framework written in C#

30. Methodology
System
schemaMc
Kinect
(Input Device)
Projector
(Output Device)
Computer
(Processor)

31. Game Logic Design
InteracMon
design

32. Game Logic Design
● Mixing Colors Game
● Reflecting Light Game
● Word Guessing Game
● Math Game
● Geometry Game

33. Game Logic Design
Game
design
:
Mixing
Color
Game
● Challenge
quest
● Player
area

34. Game Logic Design
Game
design
:
ReflecMng
Light
Game
● Challenge
quest
● Player
area
● Reflecting objects

35. Game Logic Design
Game
design
:
Word
Guessing
Game
● Challenge
quest
● Dropped
Alphabet

36. Game Logic Design
Game
design
:
Math
Game
● Challenge
quest
+
● Dropped
Objects
1
2
3
9
4
5
+

37. Game Logic Design
Game
design
:
Geometry
Game
● Challenge
quest
● Real
objects

38. Equipment and Tools
Hardware part
Kinect
Project
Computer

39. Equipment and Tools
Windows
7
or
8
Faast
Visual
Studio
Emgu
CV
Photoshop

40. Schedule
August
Study
April
Design
Implement
Testing
Report

41. Schedule
August
Study
April
Design
August - October
● Motion detecting devices
● Library
● Related theories
● Platform
● Programming language
Implement
Testing
Report

42. Schedule
August
Study
April
Design
September
● Graphic interface
● User scenario
● Paper prototype
Implement
Testing
Report

43. Schedule
August
Study
April
Design
Implement
Testing
September - February
● Detection modules
● Games
Report

44. Schedule
August
Study
April
Design
Implement
Testing
Report
March
● Module
● Real environment

45. Schedule
August
Study
April
Design
Implement
Testing
Report
April
● Report document
● Report Submission
● Final Presentation

46. Responsibility

47. Responsibility
Research
● Motion detecting devices
● Library and tools
Game develope and design
● Geometry game
● Reflecting light game

48. Responsibility
Research
● Children development and learning
● Color theory
● Geometric theory
Design user interface
Game develope and design
● Mixing color game

49. Responsibility
Research
● Hardware and software Platform
● Light theory
Design user interface
Game develope and design
● Word guessing game
● Math game

50. Outcome
● Game
for
children
that
projected
as
physical
playground
and
detect
movement
by
using
kinect.
Children
can
use
their
gesture
to
play
a
games.
● So_ware
games
on
Windows
plaUorm
○
○
○
○
○
Mixing
color
game
Reflexing
light
game
Word
guessing
game
Math
game
Geometry
game

51. Deliverables for Term 1
● InteracMon
design
concept
● Graphic
interface
design
● Paper
prototype
● ImplementaMon
first
module
via
simulaMon

52. Q&A

53. Thank you