This slide was presented at SIGGRAPH Asia 2017 "Emerging Technologies Talk: Magic of Light" session. https://sa2017.siggraph.org/attendees/emerging-technologies?view=session&sid=45 Demonstration of the Unphotogenic Light: Protection from Secret Photography by Small Cameras https://doi.org/10.1145/3132818.3132819 Unphotogenic light: high-speed projection method to prevent secret photography by small cameras https://doi.org/10.1145/3102163.3102164 【Project page】 http://digitalnature.slis.tsukuba.ac.jp/2017/07/unphotogenic-light/ 【Project movie】 https://www.youtube.com/watch?v=sCrAFTnqnkQ 【Presenter】 Ippei Suzuki (鈴木 一平) University of Tsukuba, School of Informatics College of Media Arts, Science and Technology Digital Nature Group (Yoichi Ochiai) http://1heisuzuki.tumblr.com/about 【Abstract】 We present a new method to protect projected content from secret photography using high-speed projection. In this study, we aim to realize a protectable projection method that allows people to observe content with their eyes but not record content with camera devices. To achieve this goal, we exploit the difference between the human vision system and the camera vision system. Notably, humans cannot recognize the high-speed changes of light. We were inspired by previous work that used these properties to show on-screen invisible markers. There are several studies that aim to present imperceptible on-screen markers using high-speed projection between the afterimage effect of human eyes and shutter speeds of digital cameras. From another point of view, these techniques show specific content only to the human eye while showing different content to a camera. Thus, we can project images that can be seen by human eyes whereas cameras only capture an incomplete frame. Therefore, this means the projected light is unphotogenic.

1. Unphotogenic Light
High-Speed Projection Method to Prevent
Secret Photography by Small Cameras
Ippei Suzuki Undergraduate Student, University of Tsukuba
Yoichi Ochiai Assistant Professor, University of Tsukuba
Emerging Technologies Talk: Magic of Light

3. 3
Introduction Content Protection on the Screen
Content Protection on the Screen = Difficult Problem

4. 4
Introduction Content Protection on the Screen
Content Protection on the Screen = Difficult Problem
Copy
Analog/Digital Copy Guard Techniques
They can take photos !

5. 5
Introduction Content Protection on the Screen
Visible
to
Human Eyes
Recordable
by
Cameras

6. 6
Introduction Content Protection on the Screen

7. 7
Introduction Practical Stories of the Proposed Method
When you would like to protect
this projected image from secret photography...
Situation

8. 8
Introduction Practical Stories of the Proposed Method
Solution A: Visible Watermarks or Protection Marks
CONFIDENTIAL
COPYRIGHT
NO PHOTOS

9. CONFIDENTIAL
COPYRIGHT
NO PHOTOS
9
Introduction Practical Stories of the Proposed Method
Solution A: Visible Watermarks or Protection Marks
Bad Experience for Visitors… "

10. Security Check Area
10
Introduction Practical Stories of the Proposed Method
Solution B: Confiscate Camera Devices
Security Man
Visitor Visitor’s Bag
Confiscated Camera

11. 11
Introduction Practical Stories of the Proposed Method
Solution B: Confiscate Camera Devices
Visitor
Security
Don’t use cameras!!!

12. 12
Introduction Practical Stories of the Proposed Method
Solution B: Confiscate Camera Devices
Visitor’s
Pocket
Visitor
Secret Camera
e.g., Pen-Shaped Small Camera
They can take photos !

13. 13
Introduction Target in This Study
Our Target
http://amzn.asia/etlTVOj “Google Glass” by lawrencegs (CC BY 2.0) “iPhone 7 Plus” by Kārlis Dambrāns from Latvia (CC BY 2.0) “Sony Alpha A77” by SkywalkerPL (CC BY 3.0)
Not considered in ours
Kinds of the camera which criminals may use
(Pen-shaped
camera)

14. 14
Introduction Goal
Human eyes can see Cameras cannot see
= Unphotogenic

15. 15
Introduction Solution
<
Temporal Resolution

16. 16
Related Work
VRCodes [Woo et al. 2012]Detection of Imperceptible On-Screen Markers
with Unsynchronized Cameras
[Sampaio et al. 2015]
Invisible Markers on Screen

17. 17
Method Apploach
Afterimage Effect
An impression of a vivid sensation retained after the stimulus has ceased

18. 18
Method Apploach

19. 19
Method Apploach
Divide Image
Switch
in High Refresh Rate

20. 20
Method Theory and Effect of The proposed System
Frame DivisionSource Image
Frame Period
Suitable Shutter Speed & Timings
Time
Projected
Image
Flame No.
Assigned
0 1 2 3
Recorded
Image
Shutter
Projection Period
Incomplete Shutter Speed & Timings Examples

21. 21
Result Evaluation from camera vision
DSLR
Smartphone
Variable Aperture
Fixed Aperture
SS 1/30, F20
SS 1/45, F2.2
SS 1/125, F10 SS 1/320, F6.3
SS 1/1000, F2.2SS 1/160, F2.2
Apple iPhone 6, with App “ProShot” by Rise Up Games LLC. All photos were taken by F/2.2, Not changeable the F-stops value.
Canon EOS Kiss X4 with TAMRON B005 17-50 mm F/2.8, All photos were taken by ISO 100
Cannot change the apearture

22. 22
Method Theory and Effect of The proposed System
Visitor
Security
Don’t use cameras!!!
Combination of the human power and our system

23. 23
Result Evaluation from camera vision
kvy37; Kyocera Corp.
Qua phone
ZE551ML; ASUSTeK Computer Inc.
ZenFone 2
A500KL; ASUSTeK Computer Inc.
ZenFone 5
SO-01F, Sony Corp.
Xperia Z1
DSC-W110, Sony Corp.
Cyber-shot
CCD Image Sensor
(Global Shutter)
*Photos are taken with the default automatic mode.

24. 24
Application Other examples than displaying divided images
EXIT
$10
Theme Park
Photo by Ted Murphy (CC BY 2.0) Photo by Ted Murphy (CC BY 2.0)
Result
Overlay onto the photos sold near the exit of the attraction

25. 25
Application Other examples than displaying divided images
Museum
Result
Overlay onto the artworks
Projector
Artwork

26. 26
Discussion Limitation and Future Work
Avoidance by merging multiple photos
Color image
Optimization the division pattern
Applicability for the video contents

28. FAQ
2. Could the system show the video as projection image?
3. Could the system show the video as blurred patterns?
1. Can I use my own logo for division pattern?
4. Can the system increase the number of the division?
Unphotogenic Light
Please visit our booth! and let’s try to take photo by your smartphone!!
— Yes in principle, under development
— Difficult. Changes of the division pattern are easily perceived by people.
— Yes, 2-bit image only because it should divide areas
— Yes, but decrease the brightness of the screen