The document describes the Smart TV Studio, which provides a low-cost platform for live multi-camera production using smartphones. It allows live capturing from multiple wireless smartphone cameras, live production control through a camera switcher and audio mixer, and broadcasting of the live stream. The target market includes schools, universities and small companies needing broadcasting services. Developing it requires addressing challenges like low latency video capturing, audio/video synchronization across cameras, and supporting multiple cameras. The internship project aims to develop and test a prototype through smartphone video encoding, a broadcasting control system, and restreaming the mixed video through streaming servers like NanoHTTPD.

1. Smart TV Studio: The easiest
way to create multi-camera
live production!
Multimedia Team
Jorge Frisancho
Internship Presentation

2. Overview
• Introduction
• Components
• The target market
• Similar Technologies
• Business Insight
• The Internship
• Smart TV Studio
• Components
• Challenges
• Methodology
• Conclusion
• Q&A
2016-06-29 Multimedia Team 2

3. Introduction
2016-06-29 Multimedia Team 3

4. Introduction
2016-06-29 Multimedia Team 4
• What is the Smart TV Studio?
• Is a professional easy and low-cost platform for live
production
• What the Smart TV Studio provides?
• Live multi-camera capturing
• Support from a range of wireless smartphone cameras
• Live production control
• Camera switcher
• Audio mixer
• Broadcasting service

5. Components
Production
Control System
Multi-Cameras
from Smartphones
A B
C
Broadcasting
Service
Restreaming
2016-06-29 Multimedia Team 5
5 GHz.
A
B
C
Wi-Fi

6. Live multi-camera capturing
2016-06-29 Multimedia Team 6
Wi-Fi 5Ghz Smartphone Camera

7. Live production control
2016-06-29 Multimedia Team 7
Camera switcher and
Audio Mixer
Broadcasting service

8. Live production control
2016-06-29 Multimedia Team 8
1Camera
switcher
and Audio
Mixer
Broadcasting
service
2

9. Target Market
2016-06-29 Multimedia Team 9
Korea has highest
smartphone ownership
rate in the WORLD

10. Target Market
2016-06-29 Multimedia Team 10
School and Universities
with an Internal
Broadcasting Network
Small Companies
that requires
Broadcasting Services

11. Similar
2016-06-29 Multimedia Team 11
• LiveStream Studio 3.0
• https://livestream.com/studio
• ATEM Television Studio
• https://www.blackmagicdesign.com/prod
ucts/atemtelevisionstudio/software
• Limitations
• Requires wired cameras
• Costly cameras and
hardware
• Very expensive license

12. Business Insight
• We have an opportunity in Korean Market
• Wireless Smartphone Cameras
• Low-cost Solution
• The implementation is possible but requires
• Long time for the development
• Special developers
2016-06-29 Multimedia Team 12

13. The Internship
2016-06-29 Multimedia Team 13

14. The project
• Is divided in two main goals
• Multi-camera capturing
• Support for smartphone cameras
• Wireless connection
• Low latency
• Audio and Video synchronization
• Production control
• Open Broadcaster Software modification
• Maintain Streaming synchronization
2016-06-29 Multimedia Team 14

15. Multi-camera capturing Challenges
• LOW LATENCY for the
VIDEO CAPTURING on
the smartphone
• AUDIO and VIDEO
SYNCHRONIZATION
(V = A)
• MULTI-CAMERA
support (1, 2, 3)
2016-06-29 Multimedia Team 15
1 V A
2 V A
3 V A

16. Methodology
• Smartphone
• Codes/decodes video and audio
• Runs a streaming server
• Broadcasting Control System
• Captures the streaming from the smartphones
• Mixes the captured Video/Audio streams
• Codes/decodes mixed Video/Audio
• Finally the mixed video is restreamed through an
intranet or to internet.
2016-06-29 Multimedia Team 16

17. Methodology
• To maintain a low
latency while the video
encoding we need:
• H.264 as recommended
video codec
• AAC ELD or AAC LC
codecs for audio
2016-06-29 Multimedia Team 17

18. Methodology
• There are many open source C, C++ and JAVA libraries
that provide this encoding solution
FFMPEG + X264 compiled for ARM processor
• GStreamer is a C++ library that provides media-handling
components multiplatform
• H.27X is a C library that allows stream the camera and/or
microphone multiplatform
JAVA + X246
• Libstreaming is a JAVA API that allows stream the camera
and/or microphone of an android powered device using RTP
over UDP.
WebRTC + X246 + Phyton
• Is an API that provides Real-Time Communications (RTC)
capabilities.
2016-06-29 Multimedia Team 18

19. Methodology
2016-06-29 Multimedia Team 19
NanoHTTPD
Software Encoder
Streaming
http://192.168.1.144:8080

20. Methodology
• Streaming Server
NanoHTTPD
• Tiny, easily embeddable HTTP server in
Java. http://nanohttpd.org
TinyHTTPD
• Very simple webserver that supports threading and
Common Gateway Interface (CGI) scripts!
OkHttp
Is a request/response API. It supports both synchronous
blocking calls and async calls with callbacks.
2016-06-29 Multimedia Team 20

21. Conclusion
What was achieved?
What did I learn?
Future work
2016-06-29 Multimedia Team 21

22. Conclusion
• What was achieved?
• We implemented a beta version of the camera streamer for
Android based on H.27X library and NanoHTTPD
• It has between 5~10 seconds of delay.
• It’s integrated with TYA
• What did I learn?
About:
• ThankyouAge
• Video coding/decoding
• Video Streaming
• NDK deployment
• Future work
• Achieve the low latency video encoding
2016-06-29 Multimedia Team 22

23. Do you have any question?
2016-06-29 Multimedia Team 23