1. Steven

2. JewelryPi
Why?

3. Jewelrybox is
Good

4. But …
 Hardware is too old
Kernel version 2.6.22.19
 Lack of new IO modules
 BT,NFC, SDXC…
 Limited Storage Size
 We don’t fully understand what Alpha Network
did…
 Too many patches…

5. What If We Can
Use New Hardware

6. RPI 2

7. Let’s Porting!

8. Jewelrybox Main Functions
Account
Import &
Compress photos
Download &
Upload From
OSDP
Notification
Pairing with Agent
SWM
UI Display

9. Import & Compress Photos
 Importing :TJImportImage
 Compressing : TJExtracteThumbNail
 Native Compile on RPI2
 Basic libraries and Utilities

10. USB Storage
 /dev/sda->/mnt/sda1: 32G usb memory stick
 Where the photo stored in
 Internal Storage
 Don’t unplug it…
 /dev/sdb->/tmp/sdb
 Where the photos imported from

11. Detect USB Plug In : Udev Rule
 /etc/udev/rules.d/20-usb.rules.d
 KERNEL=="sdb",
SUBSYSTEM=="block",
ACTION=="add",
RUN="/etc/hotplug.d/block/import.sh“
 Import.sh-> 30-import.sh->TJImportImage-
>TJExtractThumbNamil

12. Close RPI’s Udisk-Deamon
 udisks is an abstraction for enumerating block
devices and performing operations on them,
such as creating file systems or mounting
 /usr/share/dbus-1/system-services/org.freedesktop.UDisks.service:3:#Exec=/usr/lib/udisks/udisks-
daemon
 /lib/systemd/system/udisks.service:7:#ExecStart=/usr/lib/udisks/udisks-daemon --no-debug
 Conflicting to JewelryPi’s Udev Rule

13. UI Display

14. tjshow
/www Browser
Qt application :Tjshow
C++
Javascript
Qtwebkit
Window.external
executeJs
Backend
Frontend

15. Qt Framework 5.4
 Native Compile
 Easy
 But Building Qt on rpi2 is insanely slow
○ >16hours
 Cross Compile
 Build on PC is fast
○ 1.5 hours
 But setting up the build environment is nightmare

16. Javascript plays audio/video/image
/www
mediaObj.src = filepath
mediaObj.play()
Qt application :Tjshow
C++
Javascript
Qtwebkit
Window.external
executeJs

17. Image Goes Fine
Except …

18. Audio and Video Don’t Work!
Image :canvas
Video/Audio : media

19. QtMultimedia
/www
mediaObj.src = filepath
mediaObj.play()
Qt application :tjshow
Qtwebkit
QMediaPlayer player;
player.setMedia(QUrl::fromLocalFile("/www/assets/music/2.mp3"));
player.setVolume(50);
player.play();
Warning: "No decoder available for type 'audio/mpeg,
mpegversion=(int)1, mpegaudioversion=(int)1, layer=(int)3,
rate=(int)44100, channels=(int)2, parsed=(boolean)true'.“
Error: "Your GStreamer installation is missing a plug-in."

20. Gstreamer
 Open-source media framework
 Create a variety of media-handling components
 audio/video playback, recording streaming and
editing
 sudo apt-get install gstreamer0.10-ffmpeg
 sudo apt-get install gstreamer0.10-plugins-ugly

21. DEMO

22. Audio Works
But …

23. Video is Laggy

24. Hardware Acceleration
 Qt5.5 support Gstreamer1.0
 Gstreamer1.0 supports omxplayer
 gst-omx
 Need to Compile Qt5.5…
 Another N*1.5hrs
 N: number of fails
 apt-get install libgstreamer1.0-0-dbg
gstreamer1.0-tools libgstreamer-plugins-
base1.0-0 gstreamer1.0-plugins-good
gstreamer1.0-plugins-bad-dbg gstreamer1.0-
omx gstreamer1.0-alsa

25. Video is Still Laggy

26. Verify Video
/www
mediaObj.src = filepath
mediaObj.play()
QtMultiMedia
Qtwebkit
Laggy
smoother
sudo apt-get remove gstreamer0.10-ffmpeg
sudo apt-get remove gstreamer0.10-plugins-ugly
GPU
gstreamer1.0-omx
TV_splash_mov_h264_.mp4

27. DEMO2

28. QtWebKit MediaPlayer
 QtWebKit and QtMultimedia have separated
implementation of mediaplayer

29. What’s Worse
 QtWebKit is officially depreciated in qt5.5
 Removed in qt5.6

30. JewelryPi is Stuck
Because QtWebkit

31. Time to Let
QtWebkit Go

32. SAD?

34. Make JewelryPi AWESOME
Instead

35. QML

36. What is Qml ?
 Qt Meta Language
 JavaScript-based, declarative language for
designing user interface–centric app
 Support by QtQuick (the standard library for
writing QML applications)
 Mainly for mobile app and embedded
 Qml element easily to be extended by
javascript and C++ class
 Qml can use various qt modules

37. piomxtexture
 GitHub:
https://github.com/carlonluca/pi/blob/ma
ster/PiOmxTextures.pro
 Implements file browser by QML
 Hardware Acceleration
 Suitable for Jewelrypi

38. DEMO3

39. QML Advantages
 Re-usability of existing source code
 Strong Performance of Graphic Operations
Qml
Qt application :Tjshow
C++
QMetaObject::invokeMethod(): view.engine()->rootContext()-
>setContextProperty(windos.external);

40. This is Far From Over
Account
Import &
Compress photos
Download &
Upload From
OSDP
NotificationUI DisplaySWM
Browser->qml
Exfat
filesystem
Utilize
multicores to
compress
photo

41. Conclusion
 Prototype of Jewelrypi
 Hotplug udev-rule
 Qtwebkit Performance Issue
 Qml
 Future Works

42. You Can Help!
 GitHub:
git@gitlab.tw.trendnet.org:steven_song/j
ewelrypi.git

43. Thanks!