SlideShare a Scribd company logo
1 of 29
Download to read offline
Evaluating the Perceptual Impact of Rendering Techniques on
Thematic Color Mappings in 3D Virtual Environments
18th International Workshop on Vision, Modeling and Visualization
Juri Engel Amir Semmo Matthias Trapp Jürgen Döllner
Hasso-Plattner-Institut, Potsdam, Germany
1) Motivation 2) Rendering Techniques 3) User Study
4) Results 5) Conclusions 6) Questions
• Using color maps to communicate information is a fundamental approach in visualization
• In 3D virtual environments surface-based data is usually visualized using color-encoded surface textures
Air flow at the surface of a cooling jacket [R.S. Laramee, 2004] Deformation of the colon between two CT scans [W. Zeng, 2004]
• Virtual 3D city models communicate geospatial information by means of virtual 3D worlds
• Thematic data is an integral part of geospatial data along geometry, topology, semantics, and appearance
• For example, results of a solar potential, crime, or heat transmission analysis may be mapped to colors
Object semantic Visibility Solar potential
• Huge amount of objects
• Objects need to be visually
distinguished
• Most surfaces are flat
• Appearance and
microstructure is usually
modeled with textures
• Appearance is highly
important for the recognition
of landmarks and orientation
• 1.8 km² central urban area of
Berlin, Germany
• Solar radiation summed up
over a year
• Considering surface
orientation and shadowing
• Continuous surface
information
• Precomputed and stored in a
texture atlas
• Values: 0-no radiation; 1-
maximum radiation
• Objects can hardly be distinguished because of missing monocular depth cues
• Appearance and microstructure information is lost
• Depth Cues
• Enable the perception of 2D images as three dimensional
• Essential for mental modeling to estimate distance, relative position, object size and shape
• Monocular depth cues: linear perspective, relative size, texture gradient, occlusion, shading, shadows, areal
perspective, and defocus blur [J. D. Pfautz, 2000]
• Rendering Techniques for Depth-Cue Enhancement
• Edge Enhancement
• Global Illumination
(Ambient Occlusion)
• Local Illumination
(Blinn-Phong Shading)
• Abstracted façade textures
• Depth Cues
• Enable the perception of 2D images as three dimensional
• Essential for mental modeling to estimate distance, relative position, object size and shape
• Monocular depth cues: linear perspective, relative size, texture gradient, occlusion, shading, shadows, areal
perspective, and defocus blur [J. D. Pfautz, 2000]
• Rendering Techniques for Depth-Cue Enhancement
• Edge Enhancement
• Global Illumination
(Ambient Occlusion)
• Local Illumination
(Blinn-Phong Shading)
• Abstracted façade textures
• Depth Cues
• Enable the perception of 2D images as three dimensional
• Essential for mental modeling to estimate distance, relative position, object size and shape
• Monocular depth cues: linear perspective, relative size, texture gradient, occlusion, shading, shadows, areal
perspective, and defocus blur [J. D. Pfautz, 2000]
• Rendering Techniques for Depth-Cue Enhancement
• Edge Enhancement
• Global Illumination
(Ambient Occlusion)
• Local Illumination
(Blinn-Phong Shading)
• Abstracted façade textures
• Depth Cues
• Enable the perception of 2D images as three dimensional
• Essential for mental modeling to estimate distance, relative position, object size and shape
• Monocular depth cues: linear perspective, relative size, texture gradient, occlusion, shading, shadows, areal
perspective, and defocus blur [J. D. Pfautz, 2000]
• Rendering Techniques for Depth-Cue Enhancement
• Edge Enhancement
• Global Illumination
(Ambient Occlusion)
• Local Illumination
(Blinn-Phong Shading)
• Abstracted façade textures
• Color information is altered, which may lead to ambiguity in the interpretation of a color mapping
• Each rendering technique has a different impact
• Goal for visualization design: reduce information ambiguity while still preserving depth cues
• To which degree improve rendering techniques the orientation in 3D and creation of mental maps?
• Do they improve the perception and estimation of distances?
• Do they alter the perception of the visualized thematic data?
• Perform certain rendering techniques better for thematic visualization than others?
• Does a combination of rendering techniques always improves the orientation and distance estimation?
→ We performed a quantitative and qualitative user study to objectively compare and evaluate the
different rendering techniques
→ The purpose of this study was to determine if there is a significant main effect on the rendering
techniques and color mappings
Task 1: Mental mapping and orientation Task 2: Distance estimation
Task 3: Point-wise value estimation Task 4: Area-wise value estimation
1. All rendering techniques would improve the spatial perception and, thus, would reduce task time
and error rate for mental mapping and distance estimation.
2. The estimation of thematic values would be more difficult with any rendering technique and would
result in higher error rates and task completion times.
3. There would be significant main effects between color mappings and the tasks’ completion times and
error rates.
4. There would be a distinct order of rendering techniques and color mappings for each task.
5. Compared to individual rendering techniques, a combination would improve the participants’
performance in task 1 and 2 but increase the error rate in task 3 and 4.
• Evaluated different color maps to have more generalized results
• Single hue: only saturation as visual variable
• Black body radiation (BBR): hue, saturation, and luminance as visual variables
(Luminance can interfere with the output of rendering techniques)
• Diverging: saturation as variable and two hues that can be easily correlated with high and low value, neutral midpoint
None
Abstracted façade textures (AFT)
Blinn Phong shading
Blinn Phong + SSAO
Screen Space Ambient Occlusion (SSAO)
SSAO + AFT
Edge enhancement
Edge enhancement + AFT
• Within subjects design 4×3×8
(task × color mapping ×
rendering technique) = 96 trials
• Additional trial in the
beginning for practicing
• Task and trial order were
randomized to avoid sequence
effects
• Questionnaire for usefulness of
each rendering technique after
completion of each task
• 21 participants (17 male, age
21-49, 19 from campus)
• Average completion time:
40 minutes
• Each rendering technique reduced the time required for
orientation over a plain color mapping
• Using abstracted façade textures resulted in the best
performance increase
Rendering techniques: (0) none, (1) Blinn-Phong shading, (2) SSAO, (3) edge enhancement (EE), (4) abstracted facade textures (AFT), (5) Blinn-Phong shading + SSAO, (6) SSAO + AFT, (7) AFT + EE
• Applying the examined rendering techniques didn’t result in a
performance improvement
• Participants had difficulties to overview all marked points
→Abstracted façade textures are prone to create visual clutter
Rendering techniques: (0) none, (1) Blinn-Phong shading, (2) SSAO, (3) edge enhancement (EE), (4) abstracted facade textures (AFT), (5) Blinn-Phong shading + SSAO, (6) SSAO + AFT, (7) AFT + EE
• As expected, each rendering technique reduced the accuracy of
a point-wise value estimation
• Local illumination showed to be least suitable for an accurate
point-wise value estimation
Rendering techniques: (0) none, (1) Blinn-Phong shading, (2) SSAO, (3) edge enhancement (EE), (4) abstracted facade textures (AFT), (5) Blinn-Phong shading + SSAO, (6) SSAO + AFT, (7) AFT + EE
• Surprisingly, each rendering technique increased the accuracy of
area-wise value estimation
• Edge enhancement showed to be the most suited technique for
an accurate area-wise value estimation
Rendering techniques: (0) none, (1) Blinn-Phong shading, (2) SSAO, (3) edge enhancement (EE), (4) abstracted facade textures (AFT), (5) Blinn-Phong shading + SSAO, (6) SSAO + AFT, (7) AFT + EE
• Color mapping has a significant effect on value
estimation in 3D virtual environments
• For the mental mapping task the average
completion time using the BBR was 15.1%
longer than using the other two color mappings
• The combination of different techniques shows
no pattern compared to the individual ones
regarding performance
• Participants rating: 0-not useful at all, 7-absolutely useful
• Edge enhancement was perceived as the most helpful rendering technique
• Abstract façade textures were perceived helpful for spatial tasks
• Effect of abstract façade textures was underestimated for value estimation tasks.
• Rendering techniques can be used to improve mental mapping and orientation in a thematic visualization
• The examined rendering techniques alter the perception of visualized data
• Whereby they reduce the accuracy of a point-wise value estimation
• Color mappings have a significant effect on the perception of thematic data in 3D virtual environments
• Rendering techniques can increase
the accuracy of an area-wise value
estimation
• Attention should be paid to visual
clutter
• There was no clear order of
rendering techniques among all tasks
• A combination of multiple
techniques was not necessarily
better than single techniques
→ The used rendering technique
should be chosen according to the
visualization needs
Rendering Technique Mental
Mapping /
Orientation
Distance
Estimation
Point-Wise
Value
Estimation
Area-wise
Value
Estimation
None – + –
Blinn-Phong Shading –
SSAO
Edge enhancement +
Abstracted façade
textures (AFT)
+ –
Blinn-Phong + SSAO –
SSAO + AFT –
Edge enhancement +
AFT
–
• Evaluation with color mappings for different data sets
• Follow-up evaluation of edge enhancement for area-wise value estimations
• View-dependent combination of rendering techniques for depth-cue enhancement (e.g., view-distance
based or focus+context visualization)
• Generalization scheme for color-encoded thematic data to reduce visual clutter
Thank You For Your Attention!
• Juri Engel
juri.engel@hpi.uni-potsdam.de
• Amir Semmo
amir.semmo@hpi.uni-potsdam.de
• Computer Graphics Group
Prof. Dr. Jürgen Döllner
hpi3d.de youtube.com/hpicgs @hpi3d

More Related Content

Similar to Impact of Rendering Techniques on 3D Color Mappings

Color and 3D Semantic Reconstruction of Indoor Scenes from RGB-D stream
Color and 3D Semantic Reconstruction of Indoor Scenes from RGB-D streamColor and 3D Semantic Reconstruction of Indoor Scenes from RGB-D stream
Color and 3D Semantic Reconstruction of Indoor Scenes from RGB-D streamNAVER Engineering
 
12-Image enhancement and filtering.ppt
12-Image enhancement and filtering.ppt12-Image enhancement and filtering.ppt
12-Image enhancement and filtering.pptAJAYMALIK97
 
Surface Normal Prediction using Hypercolumn Skip-Net & Normal-Depth
Surface Normal Prediction using Hypercolumn Skip-Net & Normal-DepthSurface Normal Prediction using Hypercolumn Skip-Net & Normal-Depth
Surface Normal Prediction using Hypercolumn Skip-Net & Normal-DepthChinghang chen
 
AMIA 2015 Visual Analytics in Healthcare Tutorial Part 1
AMIA 2015 Visual Analytics in Healthcare Tutorial Part 1AMIA 2015 Visual Analytics in Healthcare Tutorial Part 1
AMIA 2015 Visual Analytics in Healthcare Tutorial Part 1David Gotz
 
IRJET-A Review on Implementation of High Dimension Colour Transform in Domain...
IRJET-A Review on Implementation of High Dimension Colour Transform in Domain...IRJET-A Review on Implementation of High Dimension Colour Transform in Domain...
IRJET-A Review on Implementation of High Dimension Colour Transform in Domain...IRJET Journal
 
ozdogan1_lcluc_8-2010_training_0.pdf
ozdogan1_lcluc_8-2010_training_0.pdfozdogan1_lcluc_8-2010_training_0.pdf
ozdogan1_lcluc_8-2010_training_0.pdfchantey2303
 
Reviewing Data Visualization: an Analytical Taxonomical Study
Reviewing Data Visualization: an Analytical Taxonomical StudyReviewing Data Visualization: an Analytical Taxonomical Study
Reviewing Data Visualization: an Analytical Taxonomical StudyUniversidade de São Paulo
 
Learning RGB-D Salient Object Detection using background enclosure, depth con...
Learning RGB-D Salient Object Detection using background enclosure, depth con...Learning RGB-D Salient Object Detection using background enclosure, depth con...
Learning RGB-D Salient Object Detection using background enclosure, depth con...Benyamin Moadab
 
ICC2017 UUUI sessions 6205-2
ICC2017 UUUI sessions 6205-2ICC2017 UUUI sessions 6205-2
ICC2017 UUUI sessions 6205-2UUUI ICA
 
GIS Orientation 2015
GIS Orientation 2015GIS Orientation 2015
GIS Orientation 2015DUSPviz
 
Computer Graphics Unit 5 notes for Manonmanium Sundaranar University
Computer Graphics  Unit 5 notes for Manonmanium Sundaranar UniversityComputer Graphics  Unit 5 notes for Manonmanium Sundaranar University
Computer Graphics Unit 5 notes for Manonmanium Sundaranar UniversityRajeswariR45
 
Image enhancement
Image enhancementImage enhancement
Image enhancementAyaelshiwi
 
Static Spatial Graph Features
Static Spatial Graph FeaturesStatic Spatial Graph Features
Static Spatial Graph FeaturesNiklas Elmqvist
 
Passive stereo vision with deep learning
Passive stereo vision with deep learningPassive stereo vision with deep learning
Passive stereo vision with deep learningYu Huang
 
Spectral and color prediction for arbitrary halftone patterns: a drop-by-drop...
Spectral and color prediction for arbitrary halftone patterns: a drop-by-drop...Spectral and color prediction for arbitrary halftone patterns: a drop-by-drop...
Spectral and color prediction for arbitrary halftone patterns: a drop-by-drop...Peter Morovic
 

Similar to Impact of Rendering Techniques on 3D Color Mappings (20)

Pro active management of visual appearance of products
Pro active management of visual appearance of productsPro active management of visual appearance of products
Pro active management of visual appearance of products
 
Color and 3D Semantic Reconstruction of Indoor Scenes from RGB-D stream
Color and 3D Semantic Reconstruction of Indoor Scenes from RGB-D streamColor and 3D Semantic Reconstruction of Indoor Scenes from RGB-D stream
Color and 3D Semantic Reconstruction of Indoor Scenes from RGB-D stream
 
Image analytics - A Primer
Image analytics - A PrimerImage analytics - A Primer
Image analytics - A Primer
 
12-Image enhancement and filtering.ppt
12-Image enhancement and filtering.ppt12-Image enhancement and filtering.ppt
12-Image enhancement and filtering.ppt
 
Surface Normal Prediction using Hypercolumn Skip-Net & Normal-Depth
Surface Normal Prediction using Hypercolumn Skip-Net & Normal-DepthSurface Normal Prediction using Hypercolumn Skip-Net & Normal-Depth
Surface Normal Prediction using Hypercolumn Skip-Net & Normal-Depth
 
AMIA 2015 Visual Analytics in Healthcare Tutorial Part 1
AMIA 2015 Visual Analytics in Healthcare Tutorial Part 1AMIA 2015 Visual Analytics in Healthcare Tutorial Part 1
AMIA 2015 Visual Analytics in Healthcare Tutorial Part 1
 
IRJET-A Review on Implementation of High Dimension Colour Transform in Domain...
IRJET-A Review on Implementation of High Dimension Colour Transform in Domain...IRJET-A Review on Implementation of High Dimension Colour Transform in Domain...
IRJET-A Review on Implementation of High Dimension Colour Transform in Domain...
 
ozdogan1_lcluc_8-2010_training_0.pdf
ozdogan1_lcluc_8-2010_training_0.pdfozdogan1_lcluc_8-2010_training_0.pdf
ozdogan1_lcluc_8-2010_training_0.pdf
 
project_PPT_final
project_PPT_finalproject_PPT_final
project_PPT_final
 
Reviewing Data Visualization: an Analytical Taxonomical Study
Reviewing Data Visualization: an Analytical Taxonomical StudyReviewing Data Visualization: an Analytical Taxonomical Study
Reviewing Data Visualization: an Analytical Taxonomical Study
 
Cbir ‐ features
Cbir ‐ featuresCbir ‐ features
Cbir ‐ features
 
Learning RGB-D Salient Object Detection using background enclosure, depth con...
Learning RGB-D Salient Object Detection using background enclosure, depth con...Learning RGB-D Salient Object Detection using background enclosure, depth con...
Learning RGB-D Salient Object Detection using background enclosure, depth con...
 
ICC2017 UUUI sessions 6205-2
ICC2017 UUUI sessions 6205-2ICC2017 UUUI sessions 6205-2
ICC2017 UUUI sessions 6205-2
 
GIS Orientation 2015
GIS Orientation 2015GIS Orientation 2015
GIS Orientation 2015
 
PPT s06-machine vision-s2
PPT s06-machine vision-s2PPT s06-machine vision-s2
PPT s06-machine vision-s2
 
Computer Graphics Unit 5 notes for Manonmanium Sundaranar University
Computer Graphics  Unit 5 notes for Manonmanium Sundaranar UniversityComputer Graphics  Unit 5 notes for Manonmanium Sundaranar University
Computer Graphics Unit 5 notes for Manonmanium Sundaranar University
 
Image enhancement
Image enhancementImage enhancement
Image enhancement
 
Static Spatial Graph Features
Static Spatial Graph FeaturesStatic Spatial Graph Features
Static Spatial Graph Features
 
Passive stereo vision with deep learning
Passive stereo vision with deep learningPassive stereo vision with deep learning
Passive stereo vision with deep learning
 
Spectral and color prediction for arbitrary halftone patterns: a drop-by-drop...
Spectral and color prediction for arbitrary halftone patterns: a drop-by-drop...Spectral and color prediction for arbitrary halftone patterns: a drop-by-drop...
Spectral and color prediction for arbitrary halftone patterns: a drop-by-drop...
 

More from Matthias Trapp

Interactive Control over Temporal Consistency while Stylizing Video Streams
Interactive Control over Temporal Consistency while Stylizing Video StreamsInteractive Control over Temporal Consistency while Stylizing Video Streams
Interactive Control over Temporal Consistency while Stylizing Video StreamsMatthias Trapp
 
A Framework for Art-directed Augmentation of Human Motion in Videos on Mobile...
A Framework for Art-directed Augmentation of Human Motion in Videos on Mobile...A Framework for Art-directed Augmentation of Human Motion in Videos on Mobile...
A Framework for Art-directed Augmentation of Human Motion in Videos on Mobile...Matthias Trapp
 
A Framework for Interactive 3D Photo Stylization Techniques on Mobile Devices
A Framework for Interactive 3D Photo Stylization Techniques on Mobile DevicesA Framework for Interactive 3D Photo Stylization Techniques on Mobile Devices
A Framework for Interactive 3D Photo Stylization Techniques on Mobile DevicesMatthias Trapp
 
ALIVE-Adaptive Chromaticity for Interactive Low-light Image and Video Enhance...
ALIVE-Adaptive Chromaticity for Interactive Low-light Image and Video Enhance...ALIVE-Adaptive Chromaticity for Interactive Low-light Image and Video Enhance...
ALIVE-Adaptive Chromaticity for Interactive Low-light Image and Video Enhance...Matthias Trapp
 
A Service-based Preset Recommendation System for Image Stylization Applications
A Service-based Preset Recommendation System for Image Stylization ApplicationsA Service-based Preset Recommendation System for Image Stylization Applications
A Service-based Preset Recommendation System for Image Stylization ApplicationsMatthias Trapp
 
Design Space of Geometry-based Image Abstraction Techniques with Vectorizatio...
Design Space of Geometry-based Image Abstraction Techniques with Vectorizatio...Design Space of Geometry-based Image Abstraction Techniques with Vectorizatio...
Design Space of Geometry-based Image Abstraction Techniques with Vectorizatio...Matthias Trapp
 
A Benchmark for the Use of Topic Models for Text Visualization Tasks - Online...
A Benchmark for the Use of Topic Models for Text Visualization Tasks - Online...A Benchmark for the Use of Topic Models for Text Visualization Tasks - Online...
A Benchmark for the Use of Topic Models for Text Visualization Tasks - Online...Matthias Trapp
 
Efficient GitHub Crawling using the GraphQL API
Efficient GitHub Crawling using the GraphQL APIEfficient GitHub Crawling using the GraphQL API
Efficient GitHub Crawling using the GraphQL APIMatthias Trapp
 
CodeCV - Mining Expertise of GitHub Users from Coding Activities - Online.pdf
CodeCV - Mining Expertise of GitHub Users from Coding Activities - Online.pdfCodeCV - Mining Expertise of GitHub Users from Coding Activities - Online.pdf
CodeCV - Mining Expertise of GitHub Users from Coding Activities - Online.pdfMatthias Trapp
 
Non-Photorealistic Rendering of 3D Point Clouds for Cartographic Visualization
Non-Photorealistic Rendering of 3D Point Clouds for Cartographic VisualizationNon-Photorealistic Rendering of 3D Point Clouds for Cartographic Visualization
Non-Photorealistic Rendering of 3D Point Clouds for Cartographic VisualizationMatthias Trapp
 
TWIN4ROAD - Erfassung Analyse und Auswertung mobiler Multi Sensorik im Strass...
TWIN4ROAD - Erfassung Analyse und Auswertung mobiler Multi Sensorik im Strass...TWIN4ROAD - Erfassung Analyse und Auswertung mobiler Multi Sensorik im Strass...
TWIN4ROAD - Erfassung Analyse und Auswertung mobiler Multi Sensorik im Strass...Matthias Trapp
 
Interactive Close-Up Rendering for Detail+Overview Visualization of 3D Digita...
Interactive Close-Up Rendering for Detail+Overview Visualization of 3D Digita...Interactive Close-Up Rendering for Detail+Overview Visualization of 3D Digita...
Interactive Close-Up Rendering for Detail+Overview Visualization of 3D Digita...Matthias Trapp
 
Web-based and Mobile Provisioning of Virtual 3D Reconstructions
Web-based and Mobile Provisioning of Virtual 3D ReconstructionsWeb-based and Mobile Provisioning of Virtual 3D Reconstructions
Web-based and Mobile Provisioning of Virtual 3D ReconstructionsMatthias Trapp
 
Visualization of Knowledge Distribution across Development Teams using 2.5D S...
Visualization of Knowledge Distribution across Development Teams using 2.5D S...Visualization of Knowledge Distribution across Development Teams using 2.5D S...
Visualization of Knowledge Distribution across Development Teams using 2.5D S...Matthias Trapp
 
Real-time Screen-space Geometry Draping for 3D Digital Terrain Models
Real-time Screen-space Geometry Draping for 3D Digital Terrain ModelsReal-time Screen-space Geometry Draping for 3D Digital Terrain Models
Real-time Screen-space Geometry Draping for 3D Digital Terrain ModelsMatthias Trapp
 
FERMIUM - A Framework for Real-time Procedural Point Cloud Animation & Morphing
FERMIUM - A Framework for Real-time Procedural Point Cloud Animation & MorphingFERMIUM - A Framework for Real-time Procedural Point Cloud Animation & Morphing
FERMIUM - A Framework for Real-time Procedural Point Cloud Animation & MorphingMatthias Trapp
 
Interactive Editing of Signed Distance Fields
Interactive Editing of Signed Distance FieldsInteractive Editing of Signed Distance Fields
Interactive Editing of Signed Distance FieldsMatthias Trapp
 
Integration of Image Processing Techniques into the Unity Game Engine
Integration of Image Processing Techniques into the Unity Game EngineIntegration of Image Processing Techniques into the Unity Game Engine
Integration of Image Processing Techniques into the Unity Game EngineMatthias Trapp
 
Interactive GPU-based Image Deformation for Mobile Devices
Interactive GPU-based Image Deformation for Mobile DevicesInteractive GPU-based Image Deformation for Mobile Devices
Interactive GPU-based Image Deformation for Mobile DevicesMatthias Trapp
 
Interactive Photo Editing on Smartphones via Intrinsic Decomposition
Interactive Photo Editing on Smartphones via Intrinsic DecompositionInteractive Photo Editing on Smartphones via Intrinsic Decomposition
Interactive Photo Editing on Smartphones via Intrinsic DecompositionMatthias Trapp
 

More from Matthias Trapp (20)

Interactive Control over Temporal Consistency while Stylizing Video Streams
Interactive Control over Temporal Consistency while Stylizing Video StreamsInteractive Control over Temporal Consistency while Stylizing Video Streams
Interactive Control over Temporal Consistency while Stylizing Video Streams
 
A Framework for Art-directed Augmentation of Human Motion in Videos on Mobile...
A Framework for Art-directed Augmentation of Human Motion in Videos on Mobile...A Framework for Art-directed Augmentation of Human Motion in Videos on Mobile...
A Framework for Art-directed Augmentation of Human Motion in Videos on Mobile...
 
A Framework for Interactive 3D Photo Stylization Techniques on Mobile Devices
A Framework for Interactive 3D Photo Stylization Techniques on Mobile DevicesA Framework for Interactive 3D Photo Stylization Techniques on Mobile Devices
A Framework for Interactive 3D Photo Stylization Techniques on Mobile Devices
 
ALIVE-Adaptive Chromaticity for Interactive Low-light Image and Video Enhance...
ALIVE-Adaptive Chromaticity for Interactive Low-light Image and Video Enhance...ALIVE-Adaptive Chromaticity for Interactive Low-light Image and Video Enhance...
ALIVE-Adaptive Chromaticity for Interactive Low-light Image and Video Enhance...
 
A Service-based Preset Recommendation System for Image Stylization Applications
A Service-based Preset Recommendation System for Image Stylization ApplicationsA Service-based Preset Recommendation System for Image Stylization Applications
A Service-based Preset Recommendation System for Image Stylization Applications
 
Design Space of Geometry-based Image Abstraction Techniques with Vectorizatio...
Design Space of Geometry-based Image Abstraction Techniques with Vectorizatio...Design Space of Geometry-based Image Abstraction Techniques with Vectorizatio...
Design Space of Geometry-based Image Abstraction Techniques with Vectorizatio...
 
A Benchmark for the Use of Topic Models for Text Visualization Tasks - Online...
A Benchmark for the Use of Topic Models for Text Visualization Tasks - Online...A Benchmark for the Use of Topic Models for Text Visualization Tasks - Online...
A Benchmark for the Use of Topic Models for Text Visualization Tasks - Online...
 
Efficient GitHub Crawling using the GraphQL API
Efficient GitHub Crawling using the GraphQL APIEfficient GitHub Crawling using the GraphQL API
Efficient GitHub Crawling using the GraphQL API
 
CodeCV - Mining Expertise of GitHub Users from Coding Activities - Online.pdf
CodeCV - Mining Expertise of GitHub Users from Coding Activities - Online.pdfCodeCV - Mining Expertise of GitHub Users from Coding Activities - Online.pdf
CodeCV - Mining Expertise of GitHub Users from Coding Activities - Online.pdf
 
Non-Photorealistic Rendering of 3D Point Clouds for Cartographic Visualization
Non-Photorealistic Rendering of 3D Point Clouds for Cartographic VisualizationNon-Photorealistic Rendering of 3D Point Clouds for Cartographic Visualization
Non-Photorealistic Rendering of 3D Point Clouds for Cartographic Visualization
 
TWIN4ROAD - Erfassung Analyse und Auswertung mobiler Multi Sensorik im Strass...
TWIN4ROAD - Erfassung Analyse und Auswertung mobiler Multi Sensorik im Strass...TWIN4ROAD - Erfassung Analyse und Auswertung mobiler Multi Sensorik im Strass...
TWIN4ROAD - Erfassung Analyse und Auswertung mobiler Multi Sensorik im Strass...
 
Interactive Close-Up Rendering for Detail+Overview Visualization of 3D Digita...
Interactive Close-Up Rendering for Detail+Overview Visualization of 3D Digita...Interactive Close-Up Rendering for Detail+Overview Visualization of 3D Digita...
Interactive Close-Up Rendering for Detail+Overview Visualization of 3D Digita...
 
Web-based and Mobile Provisioning of Virtual 3D Reconstructions
Web-based and Mobile Provisioning of Virtual 3D ReconstructionsWeb-based and Mobile Provisioning of Virtual 3D Reconstructions
Web-based and Mobile Provisioning of Virtual 3D Reconstructions
 
Visualization of Knowledge Distribution across Development Teams using 2.5D S...
Visualization of Knowledge Distribution across Development Teams using 2.5D S...Visualization of Knowledge Distribution across Development Teams using 2.5D S...
Visualization of Knowledge Distribution across Development Teams using 2.5D S...
 
Real-time Screen-space Geometry Draping for 3D Digital Terrain Models
Real-time Screen-space Geometry Draping for 3D Digital Terrain ModelsReal-time Screen-space Geometry Draping for 3D Digital Terrain Models
Real-time Screen-space Geometry Draping for 3D Digital Terrain Models
 
FERMIUM - A Framework for Real-time Procedural Point Cloud Animation & Morphing
FERMIUM - A Framework for Real-time Procedural Point Cloud Animation & MorphingFERMIUM - A Framework for Real-time Procedural Point Cloud Animation & Morphing
FERMIUM - A Framework for Real-time Procedural Point Cloud Animation & Morphing
 
Interactive Editing of Signed Distance Fields
Interactive Editing of Signed Distance FieldsInteractive Editing of Signed Distance Fields
Interactive Editing of Signed Distance Fields
 
Integration of Image Processing Techniques into the Unity Game Engine
Integration of Image Processing Techniques into the Unity Game EngineIntegration of Image Processing Techniques into the Unity Game Engine
Integration of Image Processing Techniques into the Unity Game Engine
 
Interactive GPU-based Image Deformation for Mobile Devices
Interactive GPU-based Image Deformation for Mobile DevicesInteractive GPU-based Image Deformation for Mobile Devices
Interactive GPU-based Image Deformation for Mobile Devices
 
Interactive Photo Editing on Smartphones via Intrinsic Decomposition
Interactive Photo Editing on Smartphones via Intrinsic DecompositionInteractive Photo Editing on Smartphones via Intrinsic Decomposition
Interactive Photo Editing on Smartphones via Intrinsic Decomposition
 

Recently uploaded

Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksSoftradix Technologies
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Patryk Bandurski
 
costume and set research powerpoint presentation
costume and set research powerpoint presentationcostume and set research powerpoint presentation
costume and set research powerpoint presentationphoebematthew05
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix
 
Science&tech:THE INFORMATION AGE STS.pdf
Science&tech:THE INFORMATION AGE STS.pdfScience&tech:THE INFORMATION AGE STS.pdf
Science&tech:THE INFORMATION AGE STS.pdfjimielynbastida
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024The Digital Insurer
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions
 
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphNeo4j
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
Bluetooth Controlled Car with Arduino.pdf
Bluetooth Controlled Car with Arduino.pdfBluetooth Controlled Car with Arduino.pdf
Bluetooth Controlled Car with Arduino.pdfngoud9212
 
Unlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsUnlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsPrecisely
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Neo4j
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Wonjun Hwang
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 

Recently uploaded (20)

Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other Frameworks
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
 
costume and set research powerpoint presentation
costume and set research powerpoint presentationcostume and set research powerpoint presentation
costume and set research powerpoint presentation
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 
Science&tech:THE INFORMATION AGE STS.pdf
Science&tech:THE INFORMATION AGE STS.pdfScience&tech:THE INFORMATION AGE STS.pdf
Science&tech:THE INFORMATION AGE STS.pdf
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food Manufacturing
 
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
Bluetooth Controlled Car with Arduino.pdf
Bluetooth Controlled Car with Arduino.pdfBluetooth Controlled Car with Arduino.pdf
Bluetooth Controlled Car with Arduino.pdf
 
Unlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsUnlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power Systems
 
Hot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort Service
Hot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort ServiceHot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort Service
Hot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort Service
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
 
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 

Impact of Rendering Techniques on 3D Color Mappings

  • 1. Evaluating the Perceptual Impact of Rendering Techniques on Thematic Color Mappings in 3D Virtual Environments 18th International Workshop on Vision, Modeling and Visualization Juri Engel Amir Semmo Matthias Trapp Jürgen Döllner Hasso-Plattner-Institut, Potsdam, Germany
  • 2. 1) Motivation 2) Rendering Techniques 3) User Study 4) Results 5) Conclusions 6) Questions
  • 3. • Using color maps to communicate information is a fundamental approach in visualization • In 3D virtual environments surface-based data is usually visualized using color-encoded surface textures Air flow at the surface of a cooling jacket [R.S. Laramee, 2004] Deformation of the colon between two CT scans [W. Zeng, 2004]
  • 4. • Virtual 3D city models communicate geospatial information by means of virtual 3D worlds • Thematic data is an integral part of geospatial data along geometry, topology, semantics, and appearance • For example, results of a solar potential, crime, or heat transmission analysis may be mapped to colors Object semantic Visibility Solar potential
  • 5. • Huge amount of objects • Objects need to be visually distinguished • Most surfaces are flat • Appearance and microstructure is usually modeled with textures • Appearance is highly important for the recognition of landmarks and orientation
  • 6. • 1.8 km² central urban area of Berlin, Germany • Solar radiation summed up over a year • Considering surface orientation and shadowing • Continuous surface information • Precomputed and stored in a texture atlas • Values: 0-no radiation; 1- maximum radiation
  • 7. • Objects can hardly be distinguished because of missing monocular depth cues • Appearance and microstructure information is lost
  • 8. • Depth Cues • Enable the perception of 2D images as three dimensional • Essential for mental modeling to estimate distance, relative position, object size and shape • Monocular depth cues: linear perspective, relative size, texture gradient, occlusion, shading, shadows, areal perspective, and defocus blur [J. D. Pfautz, 2000] • Rendering Techniques for Depth-Cue Enhancement • Edge Enhancement • Global Illumination (Ambient Occlusion) • Local Illumination (Blinn-Phong Shading) • Abstracted façade textures
  • 9. • Depth Cues • Enable the perception of 2D images as three dimensional • Essential for mental modeling to estimate distance, relative position, object size and shape • Monocular depth cues: linear perspective, relative size, texture gradient, occlusion, shading, shadows, areal perspective, and defocus blur [J. D. Pfautz, 2000] • Rendering Techniques for Depth-Cue Enhancement • Edge Enhancement • Global Illumination (Ambient Occlusion) • Local Illumination (Blinn-Phong Shading) • Abstracted façade textures
  • 10. • Depth Cues • Enable the perception of 2D images as three dimensional • Essential for mental modeling to estimate distance, relative position, object size and shape • Monocular depth cues: linear perspective, relative size, texture gradient, occlusion, shading, shadows, areal perspective, and defocus blur [J. D. Pfautz, 2000] • Rendering Techniques for Depth-Cue Enhancement • Edge Enhancement • Global Illumination (Ambient Occlusion) • Local Illumination (Blinn-Phong Shading) • Abstracted façade textures
  • 11. • Depth Cues • Enable the perception of 2D images as three dimensional • Essential for mental modeling to estimate distance, relative position, object size and shape • Monocular depth cues: linear perspective, relative size, texture gradient, occlusion, shading, shadows, areal perspective, and defocus blur [J. D. Pfautz, 2000] • Rendering Techniques for Depth-Cue Enhancement • Edge Enhancement • Global Illumination (Ambient Occlusion) • Local Illumination (Blinn-Phong Shading) • Abstracted façade textures
  • 12. • Color information is altered, which may lead to ambiguity in the interpretation of a color mapping • Each rendering technique has a different impact • Goal for visualization design: reduce information ambiguity while still preserving depth cues
  • 13. • To which degree improve rendering techniques the orientation in 3D and creation of mental maps? • Do they improve the perception and estimation of distances? • Do they alter the perception of the visualized thematic data? • Perform certain rendering techniques better for thematic visualization than others? • Does a combination of rendering techniques always improves the orientation and distance estimation? → We performed a quantitative and qualitative user study to objectively compare and evaluate the different rendering techniques → The purpose of this study was to determine if there is a significant main effect on the rendering techniques and color mappings
  • 14. Task 1: Mental mapping and orientation Task 2: Distance estimation
  • 15. Task 3: Point-wise value estimation Task 4: Area-wise value estimation
  • 16. 1. All rendering techniques would improve the spatial perception and, thus, would reduce task time and error rate for mental mapping and distance estimation. 2. The estimation of thematic values would be more difficult with any rendering technique and would result in higher error rates and task completion times. 3. There would be significant main effects between color mappings and the tasks’ completion times and error rates. 4. There would be a distinct order of rendering techniques and color mappings for each task. 5. Compared to individual rendering techniques, a combination would improve the participants’ performance in task 1 and 2 but increase the error rate in task 3 and 4.
  • 17. • Evaluated different color maps to have more generalized results • Single hue: only saturation as visual variable • Black body radiation (BBR): hue, saturation, and luminance as visual variables (Luminance can interfere with the output of rendering techniques) • Diverging: saturation as variable and two hues that can be easily correlated with high and low value, neutral midpoint
  • 18. None Abstracted façade textures (AFT) Blinn Phong shading Blinn Phong + SSAO Screen Space Ambient Occlusion (SSAO) SSAO + AFT Edge enhancement Edge enhancement + AFT
  • 19. • Within subjects design 4×3×8 (task × color mapping × rendering technique) = 96 trials • Additional trial in the beginning for practicing • Task and trial order were randomized to avoid sequence effects • Questionnaire for usefulness of each rendering technique after completion of each task • 21 participants (17 male, age 21-49, 19 from campus) • Average completion time: 40 minutes
  • 20. • Each rendering technique reduced the time required for orientation over a plain color mapping • Using abstracted façade textures resulted in the best performance increase Rendering techniques: (0) none, (1) Blinn-Phong shading, (2) SSAO, (3) edge enhancement (EE), (4) abstracted facade textures (AFT), (5) Blinn-Phong shading + SSAO, (6) SSAO + AFT, (7) AFT + EE
  • 21. • Applying the examined rendering techniques didn’t result in a performance improvement • Participants had difficulties to overview all marked points →Abstracted façade textures are prone to create visual clutter Rendering techniques: (0) none, (1) Blinn-Phong shading, (2) SSAO, (3) edge enhancement (EE), (4) abstracted facade textures (AFT), (5) Blinn-Phong shading + SSAO, (6) SSAO + AFT, (7) AFT + EE
  • 22. • As expected, each rendering technique reduced the accuracy of a point-wise value estimation • Local illumination showed to be least suitable for an accurate point-wise value estimation Rendering techniques: (0) none, (1) Blinn-Phong shading, (2) SSAO, (3) edge enhancement (EE), (4) abstracted facade textures (AFT), (5) Blinn-Phong shading + SSAO, (6) SSAO + AFT, (7) AFT + EE
  • 23. • Surprisingly, each rendering technique increased the accuracy of area-wise value estimation • Edge enhancement showed to be the most suited technique for an accurate area-wise value estimation Rendering techniques: (0) none, (1) Blinn-Phong shading, (2) SSAO, (3) edge enhancement (EE), (4) abstracted facade textures (AFT), (5) Blinn-Phong shading + SSAO, (6) SSAO + AFT, (7) AFT + EE
  • 24. • Color mapping has a significant effect on value estimation in 3D virtual environments • For the mental mapping task the average completion time using the BBR was 15.1% longer than using the other two color mappings • The combination of different techniques shows no pattern compared to the individual ones regarding performance
  • 25. • Participants rating: 0-not useful at all, 7-absolutely useful • Edge enhancement was perceived as the most helpful rendering technique • Abstract façade textures were perceived helpful for spatial tasks • Effect of abstract façade textures was underestimated for value estimation tasks.
  • 26. • Rendering techniques can be used to improve mental mapping and orientation in a thematic visualization • The examined rendering techniques alter the perception of visualized data • Whereby they reduce the accuracy of a point-wise value estimation • Color mappings have a significant effect on the perception of thematic data in 3D virtual environments
  • 27. • Rendering techniques can increase the accuracy of an area-wise value estimation • Attention should be paid to visual clutter • There was no clear order of rendering techniques among all tasks • A combination of multiple techniques was not necessarily better than single techniques → The used rendering technique should be chosen according to the visualization needs Rendering Technique Mental Mapping / Orientation Distance Estimation Point-Wise Value Estimation Area-wise Value Estimation None – + – Blinn-Phong Shading – SSAO Edge enhancement + Abstracted façade textures (AFT) + – Blinn-Phong + SSAO – SSAO + AFT – Edge enhancement + AFT –
  • 28. • Evaluation with color mappings for different data sets • Follow-up evaluation of edge enhancement for area-wise value estimations • View-dependent combination of rendering techniques for depth-cue enhancement (e.g., view-distance based or focus+context visualization) • Generalization scheme for color-encoded thematic data to reduce visual clutter
  • 29. Thank You For Your Attention! • Juri Engel juri.engel@hpi.uni-potsdam.de • Amir Semmo amir.semmo@hpi.uni-potsdam.de • Computer Graphics Group Prof. Dr. Jürgen Döllner hpi3d.de youtube.com/hpicgs @hpi3d