This document proposes a system architecture for a typing assistant that uses electromagnets and relays controlled by Arduino boards to simulate finger taps on a keyboard. The system includes a Keyboard Panel component with 26 electromagnets and relays to simulate individual keys, and a FingerTip component with 8 electromagnets and relays to simulate finger taps. The components communicate with software over Bluetooth using Arduino boards. The software is developed using Node.js, Electron, and other tools. A video demonstration of a prototype is provided, and the document evaluates performance based on time taken for software vs hardware/software operations. Future work may include 3D printing components and exploring VR/AR interactions.

2. 01
02
03
04 05
06
07

3. 01
3
Proposed

4. 02
4
System Architecture

5. 02
5
Sequence Diagram

6. 02
6
Sequence Diagram

7. 02
7
Sequence Diagram

8. 02
8
Sequence Diagram

9. 02
9
Typing Assistant

10. 02
10
Keyboard Panel
Electromagnets x 26
16Ch Relay x 2
External Voltage (12V)
Bluetooth Module
Arduino Mega

11. 02
11
FingerTip
Electromagnets x 8
4Ch Relay x 2
External Voltage (12V)
Bluetooth Module
Arduino Uno

12. 03
12
Typing Assistant
NPM Ver 4.2.0
Node Ver 7.10.0
Electron Ver 1.4.1
electron-installer-dmg Ver 0.2.1
electron-rebuild Ver 1.4.0
electron-winstaller Ver 2.5.2
NPM Dependencies
app 0.1.0
electron-packager 8.7.0
path 0.12.7
serialport 4.0.7
Webstorm Ver 2016.3.2
IDE
Modules
Keyboard Panel & FingerTip
Arduino Sketch Ver 1.8.2
IDE
SoftwareSerial
Library

13. 04
13
Development

14. 05
14
Youtube Video
https://youtu.be/ZEWkTbEnWDc

15. 06
15
Evaluation
18~27 10
(1)1
(2) , ,
“ ” SW - HW/SW
“ ” HW/SW - SW

16. 06
16
Evaluation
0
375
750
1125
1500
O O O O O
SW HW&SW
1
O O O O O
SW HW&SW
( ) ( )

17. 06
17
Evaluation
, ,
(A)
(B)
(C)
SW
HW/SW
0 13 25 38 50
SW
HW/SW
0 10 20 30 40
SW
HW/SW
0 13 25 38 50

18. 07
18
Result
- (3D )
Future work
Github Repository
- Doc: https://github.com/sauber92/GraduationProject-Doc
- TA: https://github.com/sauber92/GraduationProject-TA
- KP: https://github.com/sauber92/GraduationProject-KP
- FT: https://github.com/sauber92/GraduationProject-FT
Trello
- https://trello.com/b/TO1BCMvY
- ( )
- ,
- VR/AR Interaction

19. QnA

20. Thank you