Zi Siang See is researching production frameworks for combining HDRI and spherical panoramas. Their research aims to reduce obstacles and issues with current techniques. For HDRI, they found extending dynamic range from a single RAW digital negative capture avoids visual abnormalities from multiple exposures, requiring less production processes. For spherical panoramas, they are studying multi-row configurations to reduce variables while capturing multiple angles. Their goal is to optimize the techniques towards a leaner production approach.
Augmented Reality Using High Fidelity Spherical Panorama with HDRIZi Siang See
Zi Siang See, Mark Billinghurst, Adrian David Cheok (2015). Augmented Reality using High Fidelity Spherical Panorama with HDRI. SIGGRAPH ASIA 2015 Mobile Graphics and Interactive Applications.
Publication
http://dx.doi.org/10.1145/2818427.2818445
Video Demo
https://youtu.be/UuYUqDeM9jc
Keep in touch for research, idea exchange and collaboration
http://www.zisiangsee.com/research
Augmented Reality and Virtual Reality: Research Advances in Creative IndustryZi Siang See
This research seminar presents and discusses recent advances in augmented reality (AR) and virtual reality (VR). Recent developments have been implied that AR and VR innovation is more broadly accessible for different expert areas, these include the information technology sectors, education operations, build environment and the creative industries. During the session, participants will be able to experience AR and VR using mobile and head mount devices (HMD). This research talk will provide an overview of AR and VR interface development, industrial use cases and research direction.
This is the COSC 426 Lecture 4 on Designing AR Interfaces. Taught by Mark Billinghurst from the HIT Lab NZ at the University of Canterbury. This is part of his graduate course on Augmented Reality. Taught on August 2nd 2013
The power of deep learning models applicationsSameera Sk
I have performed a detailed analysis of recent advances in deep-learning based research efforts applied in the domains of Image Processing, Audio Processing and Video Processing. I have identified 25 relevant papers and 17 web resources, examining the particular area and problem they address, models employed, datasets used and the images from respective papers are reproduced with proper citation.
i hope this information is useful who are doing research in this area.
Head Mounted Displays: How to realize ultimate AR experiences? YutaItoh
Slides from a talk I gave at:
Wissens-Austausch-Workshop: The 3rd Workshop on Visualisierung großer Datenmengen in der Wissenschaft (VisDa3? WAW), DLR@Oberpfaffenhofen, Germany, Jun. 9 - 10, 2015.
For more detail of my work, see:
http://campar.in.tum.de/Main/YutaItoh
Augmented Reality Using High Fidelity Spherical Panorama with HDRIZi Siang See
Zi Siang See, Mark Billinghurst, Adrian David Cheok (2015). Augmented Reality using High Fidelity Spherical Panorama with HDRI. SIGGRAPH ASIA 2015 Mobile Graphics and Interactive Applications.
Publication
http://dx.doi.org/10.1145/2818427.2818445
Video Demo
https://youtu.be/UuYUqDeM9jc
Keep in touch for research, idea exchange and collaboration
http://www.zisiangsee.com/research
Augmented Reality and Virtual Reality: Research Advances in Creative IndustryZi Siang See
This research seminar presents and discusses recent advances in augmented reality (AR) and virtual reality (VR). Recent developments have been implied that AR and VR innovation is more broadly accessible for different expert areas, these include the information technology sectors, education operations, build environment and the creative industries. During the session, participants will be able to experience AR and VR using mobile and head mount devices (HMD). This research talk will provide an overview of AR and VR interface development, industrial use cases and research direction.
This is the COSC 426 Lecture 4 on Designing AR Interfaces. Taught by Mark Billinghurst from the HIT Lab NZ at the University of Canterbury. This is part of his graduate course on Augmented Reality. Taught on August 2nd 2013
The power of deep learning models applicationsSameera Sk
I have performed a detailed analysis of recent advances in deep-learning based research efforts applied in the domains of Image Processing, Audio Processing and Video Processing. I have identified 25 relevant papers and 17 web resources, examining the particular area and problem they address, models employed, datasets used and the images from respective papers are reproduced with proper citation.
i hope this information is useful who are doing research in this area.
Head Mounted Displays: How to realize ultimate AR experiences? YutaItoh
Slides from a talk I gave at:
Wissens-Austausch-Workshop: The 3rd Workshop on Visualisierung großer Datenmengen in der Wissenschaft (VisDa3? WAW), DLR@Oberpfaffenhofen, Germany, Jun. 9 - 10, 2015.
For more detail of my work, see:
http://campar.in.tum.de/Main/YutaItoh
Appling the Concepts of Panorama in Virtual Reality Using the Map Principle o...IJERD Editor
An Image associated with a hyperlink leads to a one hypermedia exception of one image that is a map; it leads to more than one link. So this principle of a map is used as an idea to form a virtual library using the concepts of the panorama so that the image of the library leads to more than a link of the books. This is a new idea in the libraries websites. The website has been applied in an environment that is using the concepts of panorama in virtual reality.
The 'state of the art' campus model of Illinois Tech Mies campus, Chicago using geographic data modeling technique. The project showcases 3D model of buildings and landscape of the campus with integration of virtual tour feature.
Lecture 8 from a course on Mobile Based Augmented Reality Development taught by Mark Billinghurst and Zi Siang See on November 29th and 30th 2015 at Johor Bahru in Malaysia. This lecture describes how to develop AR panoramas for mobile devices. Look for the other 9 lectures in the course.
Omniphotos Whitepaper | SIGGRAPH Asia 2020
A methodology for extracting parallax from photography and videography, using visual synthesis, optical flow, and scene-adaptive proxy geometry.
For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2023/09/learning-for-360-vision-a-presentation-from-google/
Yu-Chuan Su, Research Scientist at Google, presents the “Learning for 360° Vision,” tutorial at the May 2023 Embedded Vision Summit.
As a core building block of virtual reality (VR) and augmented reality (AR) technology, and with the rapid growth of VR and AR, 360° cameras are becoming more available and more popular. People now create, share and watch 360° content in their everyday lives, and the amount of 360° content is increasing rapidly.
While 360° cameras offer tremendous new possibilities in various domains, they also introduce new technical challenges. For example, the distortion of 360° content in the planar projection degrades the performance of visual recognition algorithms. In this talk, Su explains how his company enables visual recognition on 360° imagery using existing models. Google’s solution improves 360° video processing and builds a foundation for further exploration of this new media.
Invited talk at the 5th International Workshop on Search-Oriented Conversational AI (SCAI) @EMNLP2020. Here is the recording https://slideslive.com/38940054/response-generation-and-retrieval-for-multimodal-conversational-ai
This is a slide for IEEE International Conference on Computational Photography (ICCP) 2016 in Northwestern University.
See for details: http://omilab.naist.jp/project/LFseg/
A major challenge for the next decade is to design virtual and augmented reality systems (VR at large) for real-world use cases such as healthcare, entertainment, e-education, and high-risk missions. This requires VR systems to operate at scale, in a personalized manner, remaining bandwidth-tolerant whilst meeting quality and latency criteria. One key challenge to reach this goal is to fully understand and anticipate user behaviours in these mixed reality settings.
This can be accomplished only by a fundamental revolution of the network and VR systems that have to put the interactive user at the heart of the system rather than at the end of the chain. With this goal in mind, in this talk, we describe our current researches on user-centric systems. First, we describe our view-port based streaming strategies for 360-degree video. Then, we present more in details our research on of users‘ behaviour analysis, when users interact with the 360-degree content. Specifically, we describe a set of metrics that allows us to identify key behaviours among users and quantify the level of similarity of these behaviours. Specifically, we present our clique-based clustering methodology, information theory and trajectory base in-depth analysis. Finally, we conclude with an overview of the extension of this work to navigation within volumetric video sequences.
Background: Introduction to Augmented Reality
Projection-based Augmented Reality
Ongoing Research of the Speaker
Ending remarks: Further Research & Future Path
- 프로젝트명 : HomeNavi
- 발표 제목 : 3D Environment HOMENavi
- 발표자: 이의령 - RL Korea / 양홍선 - 고려대학교
- 내용 요약 : 3D 환경에서 강화학습 기반으로 네비게이션 방법에 대한 최신 연구 방향 및 비전에 대해 소개합니다. 기존 로봇 분야에서 SLAM 기반으로 네비게이션 방법과 달리 강화학습으로 접근했을 때 어떠한 장점과 단점이 있는지, 그리고 최근에 공개된 3D 강화학습 환경이 어떤 것들이 있는지 소개합니다. 그리고 베이스라인이 되는 논문들에 대한 간략한 설명과 함께 직접 실험을 통해 느낀 경험들을 공유하고자 합니다.
Appling the Concepts of Panorama in Virtual Reality Using the Map Principle o...IJERD Editor
An Image associated with a hyperlink leads to a one hypermedia exception of one image that is a map; it leads to more than one link. So this principle of a map is used as an idea to form a virtual library using the concepts of the panorama so that the image of the library leads to more than a link of the books. This is a new idea in the libraries websites. The website has been applied in an environment that is using the concepts of panorama in virtual reality.
The 'state of the art' campus model of Illinois Tech Mies campus, Chicago using geographic data modeling technique. The project showcases 3D model of buildings and landscape of the campus with integration of virtual tour feature.
Similar to Virtual Reality (VR360): Production Framework for the Combination of High Dynamic Range Imaging (HDRI) and Spherical Panorama towards Lean Approach
Lecture 8 from a course on Mobile Based Augmented Reality Development taught by Mark Billinghurst and Zi Siang See on November 29th and 30th 2015 at Johor Bahru in Malaysia. This lecture describes how to develop AR panoramas for mobile devices. Look for the other 9 lectures in the course.
Omniphotos Whitepaper | SIGGRAPH Asia 2020
A methodology for extracting parallax from photography and videography, using visual synthesis, optical flow, and scene-adaptive proxy geometry.
For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2023/09/learning-for-360-vision-a-presentation-from-google/
Yu-Chuan Su, Research Scientist at Google, presents the “Learning for 360° Vision,” tutorial at the May 2023 Embedded Vision Summit.
As a core building block of virtual reality (VR) and augmented reality (AR) technology, and with the rapid growth of VR and AR, 360° cameras are becoming more available and more popular. People now create, share and watch 360° content in their everyday lives, and the amount of 360° content is increasing rapidly.
While 360° cameras offer tremendous new possibilities in various domains, they also introduce new technical challenges. For example, the distortion of 360° content in the planar projection degrades the performance of visual recognition algorithms. In this talk, Su explains how his company enables visual recognition on 360° imagery using existing models. Google’s solution improves 360° video processing and builds a foundation for further exploration of this new media.
Invited talk at the 5th International Workshop on Search-Oriented Conversational AI (SCAI) @EMNLP2020. Here is the recording https://slideslive.com/38940054/response-generation-and-retrieval-for-multimodal-conversational-ai
This is a slide for IEEE International Conference on Computational Photography (ICCP) 2016 in Northwestern University.
See for details: http://omilab.naist.jp/project/LFseg/
A major challenge for the next decade is to design virtual and augmented reality systems (VR at large) for real-world use cases such as healthcare, entertainment, e-education, and high-risk missions. This requires VR systems to operate at scale, in a personalized manner, remaining bandwidth-tolerant whilst meeting quality and latency criteria. One key challenge to reach this goal is to fully understand and anticipate user behaviours in these mixed reality settings.
This can be accomplished only by a fundamental revolution of the network and VR systems that have to put the interactive user at the heart of the system rather than at the end of the chain. With this goal in mind, in this talk, we describe our current researches on user-centric systems. First, we describe our view-port based streaming strategies for 360-degree video. Then, we present more in details our research on of users‘ behaviour analysis, when users interact with the 360-degree content. Specifically, we describe a set of metrics that allows us to identify key behaviours among users and quantify the level of similarity of these behaviours. Specifically, we present our clique-based clustering methodology, information theory and trajectory base in-depth analysis. Finally, we conclude with an overview of the extension of this work to navigation within volumetric video sequences.
Background: Introduction to Augmented Reality
Projection-based Augmented Reality
Ongoing Research of the Speaker
Ending remarks: Further Research & Future Path
- 프로젝트명 : HomeNavi
- 발표 제목 : 3D Environment HOMENavi
- 발표자: 이의령 - RL Korea / 양홍선 - 고려대학교
- 내용 요약 : 3D 환경에서 강화학습 기반으로 네비게이션 방법에 대한 최신 연구 방향 및 비전에 대해 소개합니다. 기존 로봇 분야에서 SLAM 기반으로 네비게이션 방법과 달리 강화학습으로 접근했을 때 어떠한 장점과 단점이 있는지, 그리고 최근에 공개된 3D 강화학습 환경이 어떤 것들이 있는지 소개합니다. 그리고 베이스라인이 되는 논문들에 대한 간략한 설명과 함께 직접 실험을 통해 느낀 경험들을 공유하고자 합니다.
Using reverse viewshed analysis to assess the location correctness of visuall...Hansi Senaratne
With the increased availability of user generated data, assessing the quality and credibility of such data becomes important. In this article, we propose to assess the location correctness of visually generated Volunteered Geographic Information (VGI) as a quality reference measure. The location correctness is determined by checking the visibility of the point of interest from the position of the visually generated VGI (observer point); as an example we utilize Flickr photographs. Therefore we first collect all Flickr photographs
that conform to a certain point of interest through their textual labelling. Then we conduct a
reverse viewshed analysis for the point of interest to determine if it lies within the area of visibility of the observer points. If the point of interest lies outside the visibility of a given observer point, the respective geotagged image is considered to be incorrectly geotagged. In this way, we analyze sample datasets of photographs and make observations regarding the dependency of certain user/photo metadata and (in)correct geotags and labels. In future the dependency relationship between the location correctness and user/photo metadata can be used to automatically infer user credibility. In other words, attributes such as profile completeness, together with location correctness, can serve as a weighted score to assess credibility.
Invited talk at USTC and SJTU, discuss recent progress in object re-identification against very large repository, especially the problem of fast key point detection, feature repeatability prediction, aggregation, and object repository indexing and search.
An Augmented Reality and Virtual Reality Pillar for Exhibitions: A Subjective...Zi Siang See
International Conference on Artificial Reality and Telexistence & Eurographics Symposium on Virtual Environments
Zi Siang See, Mohd Shahrizal Sunar, Mark Billinghurst, Arindam Dey, Delas Santano, Human Esmaeili, Harold Thwaites
22-24 November 2017, Adelaide
Similar to Virtual Reality (VR360): Production Framework for the Combination of High Dynamic Range Imaging (HDRI) and Spherical Panorama towards Lean Approach (20)
Visual Style and Aesthetics: Basics of Visual Design
Visual Design for Enterprise Applications
Range of Visual Styles.
Mobile Interfaces:
Challenges and Opportunities of Mobile Design
Approach to Mobile Design
Patterns
Connect Conference 2022: Passive House - Economic and Environmental Solution...TE Studio
Passive House: The Economic and Environmental Solution for Sustainable Real Estate. Lecture by Tim Eian of TE Studio Passive House Design in November 2022 in Minneapolis.
- The Built Environment
- Let's imagine the perfect building
- The Passive House standard
- Why Passive House targets
- Clean Energy Plans?!
- How does Passive House compare and fit in?
- The business case for Passive House real estate
- Tools to quantify the value of Passive House
- What can I do?
- Resources
Technoblade The Legacy of a Minecraft Legend.Techno Merch
Technoblade, born Alex on June 1, 1999, was a legendary Minecraft YouTuber known for his sharp wit and exceptional PvP skills. Starting his channel in 2013, he gained nearly 11 million subscribers. His private battle with metastatic sarcoma ended in June 2022, but his enduring legacy continues to inspire millions.
Maximize Your Content with Beautiful Assets : Content & Asset for Landing Page pmgdscunsri
Figma is a cloud-based design tool widely used by designers for prototyping, UI/UX design, and real-time collaboration. With features such as precision pen tools, grid system, and reusable components, Figma makes it easy for teams to work together on design projects. Its flexibility and accessibility make Figma a top choice in the digital age.
PDF SubmissionDigital Marketing Institute in NoidaPoojaSaini954651
https://www.safalta.com/online-digital-marketing/advance-digital-marketing-training-in-noidaTop Digital Marketing Institute in Noida: Boost Your Career Fast
[3:29 am, 30/05/2024] +91 83818 43552: Safalta Digital Marketing Institute in Noida also provides advanced classes for individuals seeking to develop their expertise and skills in this field. These classes, led by industry experts with vast experience, focus on specific aspects of digital marketing such as advanced SEO strategies, sophisticated content creation techniques, and data-driven analytics.
Virtual Tour Application Powerpoint for museum of edinburgh
Virtual Reality (VR360): Production Framework for the Combination of High Dynamic Range Imaging (HDRI) and Spherical Panorama towards Lean Approach
1. Researcher: Zi Siang See
Production Framework for the Combination of HDRI
and Spherical Panorama towards Lean Approach
Email (University Tunku Abdul Rahman) seezs@utar.edu.my
Email (Industrial collaboration): zisiang@reina.com.my
University Tunku Abdul Rahman
Faculty of Creative Industries
Centre for Immersive Technology and Creativity
Department of Multimedia Design and Animation
Centre of Immersive Technology and Creativity
Department of Multimedia Design and Animation
Research Talk: Zi Siang See
Virtual Reality 360 (VR360)
collaborators from
2. Researcher: Zi Siang See
Research Presentation
1) Introduction (VR360)
a. Aim, Objectives, Research Problem
b. Literature Review and Related Work
2) Research Design and Method
3) Data Collection and Analysis
4) Discussion and Conclusion
collaborators from
3. Researcher: Zi Siang See
Professional Background:
Industrial involvements since 2003/04
Researcher: Zi Siang See
Industrial Specialization: Creative and Advertising Imaging
Research Area: High Dynamic Range Imaging (HDRI)
Spherical Panorama
Augmented Reality (AR)
Creative and Advertising Processes
11. Researcher: Zi Siang SeeObject Virtual Reality (Object VR) | Presenter: Zi Siang See
12. Researcher: Zi Siang SeeVirtual Reality 360 (VR360) | Presenter: Zi Siang See
Virtual Reality 360 (VR360)
13. Researcher: Zi Siang See
Introduction
Multimedia (Combination of Elements)
• Text
• Image
• Sound
• Video
• Animation Industries
• Creative and advertising
• Corporate communications visuals
• Architectural imaging
• Cultural heritage preservation
• Scientific achieve
Research - Virtual Reality 360 (VR360)
1) High Dynamic Range Imaging (HDRI)
2) Spherical Panorama
14. Researcher: Zi Siang See
Introduction: HDRI & Spherical Panorama
Obstacles and
Issues
• High Dynamic Range Imaging (HDRI)
• Spherical Panorama
Towards Lean
Approach
• Inaccurate reproduction of location-based subjects in image
• Architectural context as case study subject of location-based
content for data collection and analysis
Proposed
Production
Framework
• To have real-world likelihood photographic outcome
reproduced by HDRI and spherical panorama with reduced
imaging variables caused by various obstacles and issues.
production processes
15. Researcher: Zi Siang See
Figure: combined luminance (EV) range being covered by HDRI outcome.
Darker images
(luminance) Brighter images
(luminance)
Introduction: HDRI
• High Dynamic Range Imaging (HDRI) in photography technique has
a goal to increase the dynamic range resulting an improved
luminance reproduced in shadow and highlight areas (Reinhard et
al, 2010; Debevec and Malik, 1997; Fairchild, 2007), usually by
combining multiple exposures consist of darker and brighter images.
16. Researcher: Zi Siang See
• Possible major obstacles and issues of HDRI that involves multiple
exposures can include ghosting effect and misalignment issue due
to inconsistent acquisitions (Reinhard et al, 2010)
Figure: HDRI with visual abnormalities (by Reina).
Introduction: HDRI
Multiple exposures for HDRISingle exposure (LDR)
Visual abnormality
17. Researcher: Zi Siang See
Introduction: HDRI
• ‘The HDR Photographic Survey’ by Fairchild (2007) has
demonstrated HDRI reproduction may require massive amount of
multiple exposures, however may speculate to have production
wastage or technical redundancy.
(1) (2) (3)
(4) (5) (6)
(7) (8) (9)
(a) (b)
Massive amount of multiple
exposures, may have
wastage or redundancy.
For example, some image
sequences have exceed the
need of constructing HDRI.
Figure: example taken from ‘The HDR Photographic Survey’ by Fairchild (2007)
18. Researcher: Zi Siang See
Figure: Multirow production process to photographically create a spherical imagery
Processing (Stitching)
Multirow setup, to have
multiple photographs
covering 360 degrees.
Spherical
panorama
rendering
Introduction: Spherical Panorama
• Spherical panorama photography imaging technique aims to acquire
wider panoramic visibility in image usually unable to be acquired
from the conventional single angle photograph image (Benosman
and Kang, 2001; Brown and Lowe, 2006; Felinto et al, 2012), this
can be arranged by combining multiple angle images.
19. Researcher: Zi Siang See
• Microsoft launched a feature called the ‘Street Side’ in Bing Map on
November 2010 in competition to Google Map with ‘Street View’
featuring spherical panorama interactivity, however numerous
content published have shown high amount of visible imaging
errors and insufficient of dynamic range.
Introduction: Spherical Panorama
Figure: (a) “Street View” feature in Google Map. (b) “Street Side” feature in Microsoft Bing Map.
(a) (b) Visual abnormalityVisual abnormality
20. Researcher: Zi Siang See
• Major difficulty for spherical panorama reproduction may occur, this
can include limited dynamic range reproduced and parallax error
(Brown and Lowe, 2006; Felinto et al, 2012)
Figure: panoramic imagery with visual abnormality (by Reina).
Introduction: Spherical Panorama
Visual abnormality
Limited dynamic range
Parallax error
21. Researcher: Zi Siang See
Research Presentation
1) Introduction (VR360)
a. Research Aim, Objectives
b. Literature Review and Related Work
2) Research Design and Method
3) Data Collection and Analysis
4) Discussion and Conclusion
22. Researcher: Zi Siang See
Research Design and Method
Technical VariablesUnknown Variables
Review of Literature and Related Work
Research Design and Method
Data collection and analysis with experiment samplings
HDRI Spherical Panorama
Study: Reduction of Imaging
Variables (Obstacles, Issues)
Study: Reduction of Imaging
Variables (Obstacles, Issues)
Optimization towards Lean Approach
HDRI and Spherical Panorama
Propose Production Framework:
Combination HDRI and Spherical Panorama
Discussion and Conclusion
1 2
3
23. Researcher: Zi Siang See
Research Design and Method:
Lean Thinking:
What and how is the production framework of lean approach in the
context for the combination of HDRI and spherical panorama?
• Value: Value of an outcome (or a product) specified by target user
• Value Stream: Value-creating activities to be remained and waste to be reduced
• Flow: Flow of production processes for possible rearrangement
• Pull: Any new value to be refined according to new requirements (continuously)
• Perfection: Effort of continuous improvement and study
According to Lean Thinking (Womack and Jones, 1996)
24. Researcher: Zi Siang See
Research Design and Method:
High Dynamic Range Imaging (HDRI)
HDRI Technical
Configurations• Observe and study the obstacles
and issues.
• Study: The process of multiple
exposures for HDRI (Debevec and
Malik, 1997; Reinhard et al, 2010;
Fairchild, 2007; Larson, 1997).
• Quantify the dynamic range for
observation (Reinhard et al, 2010;
Imatest, 2012; Gardner, 2012).
• Exploration attempts to verify the
potential dynamic range can be
extended by digital negative – RAW
(Hill, 2010; Gakken Co, 2008).
• Produce samplings of HDRI during
the data collection and analysis
process for location-based images
using architectural context as case
study subject.
• Industrial convention DSLR system
(D3x)
• Quantify and verify the latitude of
the projected dynamic range covered
by the RAW image file of D3X at
ISO100
• Observe usable dynamic range
observed (pixel value reading)
-2EV (expanded) 0EV (neutral) +2EV (expanded)
25. Researcher: Zi Siang See
Research Design and Method:
Spherical Panorama
Spherical
Panorama
Technical
Configurations• Observe and study the obstacles
and issues.
• Considerations about the spherical
panorama photographic production
process (Felinto et al, 2012; Guan et
al, 2009; Hoshi and Kato, 2006;
Andrews, 2003).
• Study: The multirow configuration
for spherical panorama production
processes that is to acquire and
combine multiple angle images
(Brown and Lowe, 2006; Chen, 1995;
Gawthrop, 2007).
• Produce samplings of spherical
panorama during the data collection
and analysis process for location-
based images using architectural
context as case study subject.
• Industrial convention DSLR system
(D3x)
• 16mm Fish-eye, Manfrotto 303SPH
for multirow setup.
Multirow setup, to
have multiple angle
image sequence
covering 360 degrees.
1 x Zenith Angle
6 x Horizontal
Angle(s)
1 x Nadir Angle
26. Researcher: Zi Siang See
• Related studies (Felinto et al 2012, Gawthrop 2007, Brown and
Lowe 2006; Schulz, 2012) have shown that photographic
combination for HDRI and spherical panorama can be possible,
however conditionally tolerating with various obstacles and issues
as reported in previous literature and work.
Spherical Panorama Multirow HDRI requires multiple exposures
-4, -3, -2, -1, 0, +1, +2, +3, +4 (EV)
VR360: HDRI & Spherical Panorama
(Existing Production Processes, according related studies)
27. Researcher: Zi Siang See
Research Presentation
1) Introduction (VR360)
a. Research Aim, Objectives
b. Literature Review and Related Work
2) Research Design and Method
3) Data Collection and Analysis
4) Discussion and Conclusion
28. Researcher: Zi Siang See
Data Collection and Analysis Progress
Technical VariablesUnknown Variables
Review of Literature and Related Work
Research Design and Method
Data collection and analysis with experiment samplings
HDRI Spherical Panorama
Study: Reduction of Imaging
Variables (Obstacles, Issues)
Study: Reduction of Imaging
Variables (Obstacles, Issues)
Optimization towards Lean Approach
HDRI and Spherical Panorama
Propose Production Framework:
Combination HDRI and Spherical Panorama
Discussion and Conclusion
1
29. Researcher: Zi Siang See
Data Collection & Analysis:
High Dynamic Range Imaging (HDRI)
Measuring Dynamic Range of Instrument Used
• Quantify and verify the latitude of the projected dynamic range
covered by the digital negative of instrument used (D3X at ISO100).
• Different RAW processors tested (native, extended dynamic range).
pixelvalue
Sequence of exposure(s)
RAW Processor: C1Pro RAW Processor: ACR RAW Processor: ViewNX
30. Researcher: Zi Siang See
Data Collection & Analysis:
High Dynamic Range Imaging (HDRI)
Digital
Negative
(RAW)
Observations • The study implies that extending
high dynamic range is possible with
digital negative image by using
single acquisition as shown in the
initial result of measuring dynamic
range with instruments used.
• Similar to the idea brought up by
Debevec and Malik (1997) about
extending dynamic range can be
possible from conventional single
film processing - multiple scanning.
• The finding in the study about
native EV of dynamic range
reproduction was observed to have
similar approximated usable
exposure values with the RAW
produced by ISO100 according to the
test by Rehm (2009) with the same
camera equipment tested using
calibrated Stouffer Step Wedge.
• Extending Dynamic Range from
Digital Negative (RAW), observation.
• (-2 EV and +2 EV, resulting an
increment of 8.5EV to 12.5EV)
Extended Dynamic Range
Data taken from RAW Processor: C1Pro
• 8.5EV, contrast ratio 362:1
• 12.5EV, contrast ratio 5793:1 2f-stopContrast ratio =
31. Researcher: Zi Siang See
High Dynamic Range Imaging (HDRI) with single acquisition
Figure: HDRI by retrieving extended high dynamic range from digital negative image
Blended result,
HDRI expanded from single
source of RAW.
Proposed Method and Apparatus:
monotonic mask
from RGB
channel
monotonic mask
from RGB
channel
(inverted)
masking on the
extended (-2EV) layer
on top of the neutral
(0EV) layer
masking on the
extended (+2EV) layer
on top of the neutral
(0EV) layer
RAW processing, EV parameter specified -2EV (expanded) 0EV (neutral) +2EV (expanded)
Apply Image: 50% opacity
on top of each layer.
(can be any sequence)
Example of single exposure required for this process
Global or local HDRI
reproduction. For
local HDRI, blurred
mask can be applied
(optional)
Global or local HDRI
reproduction. For
local HDRI, blurred
mask can be applied
(optional)
32. Researcher: Zi Siang See
High Dynamic Range Imaging (HDRI) with single acquisition
Figure: HDRI by retrieving extended high dynamic range from digital negative image
Blended result,
HDRI expanded from single
source of RAW.
Proposed Method and Apparatus:
Single
Acquisition
(RAW)
Process: Extending
Dynamic Range
Extended
+2EV
Original
0EV
Extended
-2EV
HDRI from
single source
Figure: HDRI by retrieving extended high dynamic range from digital negative image
(simplified production process illustration)
33. Researcher: Zi Siang See
(a) Conventional LDR Photo (b) Proposed HDRI from single acquisition (c) HDRI from Multiple Exposures
-2EV +2EV0EV
Proposed HDRI
using single acquisition
(HDRI extended from RAW)
Data Collection & Analysis:
High Dynamic Range Imaging (HDRI)
HDRI (Multiple exposures)
Sampling(s)
34. Researcher: Zi Siang See
(a) Conventional LDR Photo
(b) Proposed HDRI produced
from single acquisition
Can have moderate extended
dynamic range reproduced, least
production processes and free
from imaging errors (zero visual
abnormality).
(c) HDRI reproduced from
multiple exposures technique
Observations: HDRI
Visual abnormalities
35. Researcher: Zi Siang See
-2EV +2EV0EV
(a) LDR (b) HDRI, single
acquisition
(c) HDRI, multiple
exposures
-2EV +2EV0EV
Proposed HDRI produced
from single acquisition
(HDRI extended from RAW)
Proposed HDRI produced
from single acquisition
(HDRI extended from RAW)
Data Collection & Analysis:
High Dynamic Range Imaging (HDRI)
(a) LDR (b) HDRI, single
acquisition
(c) HDRI, multiple
exposures
Sampling(s) Sampling(s)
36. Researcher: Zi Siang See
Ghosting effect /issue of HDRI
reproduction from source of
multiple exposures
HDRI reproduction from source of single
acquisition where dynamic range can be
extended from Digital Negative (RAW)
(achieve result of reduced imaging errors
while needing least production processes
and time)
Moving objects, plants, weather
Observation: HDRI
(Obstacles and Issues)
37. Researcher: Zi Siang See
Outcome: HDRI with single acquisition using digital negative
• Reduced production processes and imaging variables.
• Avoided visual abnormalities (issues from multiple exposures).
• Imagery features can be preserved moderately in high contrast scene.
Data Collection & Analysis:
Discussion: HDRI
Single
Acquisition
(RAW)
Process: Extending
Dynamic Range
Extended
+2EV
Original
0EV
Extended
-2EV
HDRI from
single source
HDRI that requires single acquisition
Proposed Production Process DesignExisting Process
HDRI that requires multiple exposures
-4, -3, -2, -1, 0, +1, +2, +3, +4 (EV)
38. Researcher: Zi Siang See
Data Collection and Analysis Progress
Technical VariablesUnknown Variables
Review of Literature and Related Work
Research Design and Method
Data collection and analysis with experiment samplings
HDRI Spherical Panorama
Study: Reduction of Imaging
Variables (Obstacles, Issues)
Study: Reduction of Imaging
Variables (Obstacles, Issues)
Optimization towards Lean Approach
HDRI and Spherical Panorama
Propose Production Framework:
Combination HDRI and Spherical Panorama
Discussion and Conclusion
2
39. Researcher: Zi Siang See
multiple angles of multirow configuration,
covering horizontal, zenith and nadir angles.
(However having nadir angle difficulty)
Data Collection & Analysis:
Spherical Panorama Sampling(s)
40. Researcher: Zi Siang See
Parallax error
Nadir angle difficulty
(unwanted imagery content )
Observations: Spherical Panorama (cubic projection)
Insufficient dynamic range
Sampling(s)
41. Researcher: Zi Siang See
(a) Spherical Panorama
(nadir angle difficulty resulting
visual abnormality is a mistake
that requires rectification)
(b) Spherical Panorama
(post-processing correction)
Observations: Spherical Panorama (rectification required)
Visual abnormalities after post processing correction (manual image manipulation)
Sampling(s)
42. Researcher: Zi Siang See
• Need to have higher luminance (dynamic range) in multiple angles.
• Suggested to avoid parallax error & ghosting effect (acquisition)
Critical consideration
• Nadir angle difficulty
(if rectification required?)
• Consistency of white balance and exposures in multiple angles.
(a) (b)
Post
Processing
Correction
(Manual
Correction
Required)
Consistency white balance
Is critical for the process
Observation: Spherical Panorama
(Obstacles and Issues)
43. Researcher: Zi Siang See
Outcome: Spherical Panorama Multirow Configuration Redesign
• Redesign that aims to reduce mistake that requires rectification
• Redesign that can reproduce the nadir (bottom) angle adequately
from the original source of the location-based subject in image.
Data Collection & Analysis:
Discussion: Spherical Panorama
Multirow with reduced obstacles and issues
Proposed Production Process DesignExisting Process
Multirow with various obstacles and issues
44. Researcher: Zi Siang See
Data Collection and Analysis Progress
Technical VariablesUnknown Variables
Review of Literature and Related Work
Research Design and Method
Data collection and analysis with experiment samplings
HDRI Spherical Panorama
Study: Reduction of Imaging
Variables (Obstacles, Issues)
Study: Reduction of Imaging
Variables (Obstacles, Issues)
Optimization towards Lean Approach
HDRI and Spherical Panorama
Propose Production Framework:
Combination HDRI and Spherical Panorama
Discussion and Conclusion
3
45. Researcher: Zi Siang See
Total images required = 72 images (simulated scenario)
• 8 angles required (image sequence)
• 9 exposures required for each angle
Spherical Panorama configuration covering the
immersive 360 degrees.
• 8 angles required (image sequence)
HDRI that requires multiple exposures
• 9 exposures required for each angle
-4, -3, -2, -1, 0, +1, +2, +3, +4 (EV)
Combination of HDRI and Spherical Panorama
(Existing Production Process, according related studies)
Figure: combination of HDRI and spherical panorama, existing production processes.
46. Researcher: Zi Siang See
Total images required = 11 images (sampling scenario)
• 11 angles required (image sequence)
• 1 exposure (RAW) required for each angle
Figure: Proposed production framework towards lean approach for the combination of HDRI and spherical panorama according to
previous studies and related works.
HDRI that requires single source acquisition
• 1 physical exposure required for each angle
(Extended dynamic range -2EV and +2EV can be
reproduced from RAW processing)
Spherical panorama configuration covering
the immersive 360 degrees.
• 11 angles required (image sequence)
Single
Acquisition
(RAW)
Process: Extending
Dynamic Range
Extended
+2EV
Original
0EV
Extended
-2EV
HDRI from
single source
Combination of HDRI and Spherical Panorama
(Proposed Production Framework towards Lean Approach)
47. Researcher: Zi Siang See
Production Framework: HDRI and Spherical Panorama
multiple angles facilitated by HDRI required
for producing the spherical panorama
(zero visual abnormality)
Successful sampling(s)
48. Researcher: Zi Siang See
Observations: HDRI and Spherical Panorama
(a) LDR photo image (b) HDRI from single source acquisition (c) HDRI from multiple exposures
Moderate extended high dynamic range,
reduced overall production processes.
49. Researcher: Zi Siang See
Production Framework: HDRI and Spherical Panorama
multiple angles facilitated by HDRI required
for producing the spherical panorama
(zero visual abnormality)
Successful sampling(s)
50. Researcher: Zi Siang See
HDRI ghosting effect
using multiple
exposures method.
HDRI reproduction
from single acquisition,
digital negative (RAW)
visual abnormality is
eliminated or avoided
(for multiple angles
required for spherical
panorama)
Observations: HDRI and Spherical Panorama
51. Researcher: Zi Siang See
Production Framework: HDRI and Spherical Panorama
multiple angles facilitated by HDRI required
for producing the spherical panorama
(zero visual abnormality)
Successful sampling(s)
52. Researcher: Zi Siang See
Multiple angles of multirow configuration
(from the proposed production framework)
with reduced error or mistakes that requires
rectifications, including nadir angle reproduction.
Observations: HDRI and Spherical Panorama
Nadir Angle:
Reproduction from the original
location-based scene, minimal
or no post-production
correction required
Sampling(s)
53. Researcher: Zi Siang See
Production Framework: HDRI and Spherical Panorama
multiple angles facilitated by HDRI required
for producing the spherical panorama
(zero visual abnormality)
Successful sampling(s)
54. Researcher: Zi Siang See
Inconsistent HDRI local adaptation for different angles, for spherical panorama
(multiple exposures: 9 image sequences for each angle)
Can produce consistent multiple angles of HDRI, for spherical panorama
(single acquisition: extended high dynamic range from RAW)
Observations: HDRI and Spherical Panorama
Sampling(s)
Sampling(s)
55. Researcher: Zi Siang See
Research Presentation
1) Introduction (VR360)
a. Research Aim, Objectives
b. Literature Review and Related Work
2) Research Design and Method
3) Data Collection and Analysis
4) Discussion and Conclusion
56. Researcher: Zi Siang See
Elements from Lean Approach HDRI Spherical Panorama
Waste: mistakes which requires
rectification
Obstacle avoided
(Ghosting, Misalignment)
Obstacle minimized,
minimal correction
Waste: excessive productions objects or
volume that remaindered as goods pile up
Single acquisition,
reduced storage and time
Irrelevant
Waste: processing steps which are actually
not needed
Single acquisition
(instead of multiple)
New multi angles
configuration
Waste: redundant human movements of
production processes or transportation
Less activity
Faster production
process
Waste: waiting time for an processed
materials to be used in the next process
which has not been delivered in time
Reduced to single
acquisition (instead of
multiple exposures)
Single acquisition only
from HDRI for each
angle
Waste: Production outcome which do not
meet the needs according to the value
defined by the end user or customer
Moderate extended
dynamic range limited to
capability of DNG/RAW
Avoided nadir error,
geometrically
accurate/reproduced
Discussion: HDRI and Spherical Panorama
Improvements made towards Lean Approach
Table: Improvements with lean approach for the combination of HDRI and spherical panorama
Updated reference: Lean Lexicon (The Lean Enterprise Institution, 2008) and Lean Thinking (Womack and Jones, 1996)
57. Researcher: Zi Siang See
Field Implementation: Corporate communications image for advertising visual (SP Setia, 2013)
Field Implementation
59. Researcher: Zi Siang See
Conclusion
Proposed
Production
Framework
Before
optimization
The proposed production framework towards lean approach has
shown that the outcome of spherical panorama facilitated with
HDRI can be reproduced towards improved photographic
reproduction with least visual abnormalities. This is possible with
reduced production processes, wastes, obstacles and issues.
60. Researcher: Zi Siang See
• Zi Siang See, Adrian David Cheok. (2014) Virtual Reality 360 Interactive Panorama Reproduction Obstacles and
Issues. Virtual Reality, Springer [indexed by SCOPUS]
• Zi Siang See, Khairul Hazrin Hashim, Kamarulzaman Ab Aziz, Adrian David Cheok (work-in-progress). Spherical
Panorama and High Dynamic Range Imaging: Lean Reproduction Approach. [Journal submission /review in
progress]
• Zi Siang See, Khairul Hazrin Hashim, Harold Thwaites, Lee Xia Sheng, Ooi Wooi Har. (2012). Retrieving
Extended High Dynamic Range From Digital Negative Image - An Experiment On Architectural Photo Imaging.
World Academy of Science, Engineering and Technology, Issue 68 August 2012, pp. 2158-2166. [indexed by
EBSCO]
• Zi Siang See, Lee Xia Sheng. (2011). Non-bias Architectural Image Archive using High Dynamic Range
Approach. 2nd International Conference on Research and Innovation in Information Systems – 2011 (ICRIIS’11)
[CD Proceedings], Kuala Lumpur, Malaysia, 23-24 November. [indexed by SCOPUS, IEEE Xplorer]
• Zi Siang See. (2011). Non-bias Scientific Imaging Archive for Urban Morphology Research. Exchanging Views on
How to Sustain Urban and Rural Environments in Aspects of Technology, Social and Ecology in Green Innovation
Research Group (GIRG) [CD-ROM], Universiti Technologi Malaysia (UTM), Malaysia.
Publications & Collaborations
61. Researcher: Zi Siang See
Recommendations and Suggestions
for Future Research
• Explore production framework adaptation with new technologies available.
• Collaboration with academic and field researchers.
Figure: Mobile device (Android) featuring spherical panorama functionality. Technical areas of HDRI and spherical panorama are
currently the industrial interests for digital equipment developers and multimedia content producers.
62. Researcher: Zi Siang See
Prototype (program name): See Through 360
• Prototype configuration design: See Through 360
• Capability to acquire completeness of multiple angle images including
horizontal, zenith and nadir.
Figure: “See Through 360” prototype configuration customization, program funded by Reina Imaging (2014).
(a) (b) (c)
63. Researcher: Zi Siang See
Prototype (program name): See Through 360
• Prototype configuration design: See Through 360
• Capability to acquire completeness of multiple angle images including
horizontal, zenith and nadir.
Figure: “See Through 360” prototype configuration customization, program funded by Reina Imaging (2014).
(a) (b) (c)
Leveling
rotation nadir
64. Researcher: Zi Siang See
Thank you
Research Discussion
Research Track
www.zisiangsee.com/research
65. Researcher: Zi Siang See
Recommendations and Suggestions
for Future Research
• Augmented Reality Process using Using Spherical Panorama
facilitated with High Dynamic Range Imaging (HDRI)
• Cultural Heritage Reproduction Using Spherical Panorama
facilitated with High Dynamic Range Imaging (HDRI)
• Macro Virtual Reality 360 Using Spherical Panorama facilitated with
High Dynamic Range Imaging (HDRI)
• Interactive Advertising Visual Using Spherical Panorama facilitated
with High Dynamic Range Imaging (HDRI)