The document describes MNPR, a framework for real-time expressive non-photorealistic rendering of 3D computer graphics. The framework aims to provide a wide spectrum of control over NPR styles through various levels of art direction, enable cross-stylization between different styles, and offer implementation insights through open source code. It addresses limitations of previous work such as narrow control, proprietary nature, and lack of support for cross-stylization between styles.

1. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
A n I G S S t u d e n t S e m i n a r
b y S a n t i a g o M o n t e s d e o c a
1 6 M a r c h 2 0 1 6

2. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Contribution

3. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Contribution
• Art-direction covering the interaction spectrum within NPR

4. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Contribution
• Art-direction covering the interaction spectrum within NPR
• User-study---validate usefulness of each level of control

5. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Contribution
• Art-direction covering the interaction spectrum within NPR
• User-study---validate usefulness of each level of control
• Control semantics for cross-stylization

6. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Contribution
• Art-direction covering the interaction spectrum within NPR
• User-study---validate usefulness of each level of control
• Control semantics for cross-stylization
• Implementation insights and source code of MNPR

7. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
3D model by Inuciian
Contribution

8. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
3D model by Inuciian
Contribution

9. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
3D model by Inuciian
Contribution

10. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
3D model by Inuciian
Contribution

11. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
3D model by Inuciian
Contribution

12. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Motivation
Artistic need

13. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Wide research in NPR
Motivation

14. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Wide research in NPR
Motivation
but limited application in 3D

15. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
NPR is not expressive by itself
Motivation

16. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer GraphicsMNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
3D model by OculusMotivation

17. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer GraphicsMNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
3D model by OculusMotivation

18. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer GraphicsMNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
3D model by OculusMotivation

19. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
3D model by Tom RobinsonMotivation

20. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
3D model by Tom RobinsonMotivation

21. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
3D model by Tom RobinsonMotivation

22. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Every style needs art-direction
Motivation

23. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Every style needs art-direction
Motivation
Art-direction can cross styles

24. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
NPR is not expressive by itself
Paintings by Dylan Scott Pierce

25. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
“Overall, NPR researchers might put more emphasis on assisting art creation, rather
than automating it.”
Holger Winnemöller, 2013
Motivation

26. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
“Overall, NPR researchers might put more emphasis on assisting art creation, rather
than automating it.”
Holger Winnemöller, 2013
“As researchers, however, we should focus—in addition to working on algorithmic
contributions—on how to design the interaction with the algorithmic support”
Tobias Isenberg, 2016
Motivation

27. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
No intuitive and generalized approach
towards expressive NPR in 3D
Motivation

28. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Related Work
3D Stylization

29. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
3D stroke-space stylization
Related Work

30. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
3D stroke-space stylization
• Seminal work – Hanrahan and Haeberli 1990
[Hanrahan and Haeberli 1990]
Related Work

31. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
3D stroke-space stylization
• Seminal work – Hanrahan and Haeberli 1990
• Deep Canvas – Daniels 1999
[Hanrahan and Haeberli 1990]
Related Work

32. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
3D stroke-space stylization
• Seminal work – Hanrahan and Haeberli 1990
• Deep Canvas – Daniels 1999
• OverCoat – Schmid et al. 2011
[Hanrahan and Haeberli 1990]
[Schmid et al. 2011]
Related Work

33. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Specialized frameworks
Related Work

34. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Specialized frameworks
• Jot (linework) – Kalnins et al. 2003
Related Work
[Kalnins et al. 2003]

35. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Specialized frameworks
• Jot (linework) – Kalnins et al. 2003
• aQtree (watercolor) – Luft et al. 2007
Related Work
[Kalnins et al. 2003]
[Luft et al. 2007]

36. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Specialized frameworks
• Jot (linework) – Kalnins et al. 2003
• aQtree (watercolor) – Luft et al. 2007
• Freestyle (linework) – Grabli et al. 2010
Related Work
[Kalnins et al. 2003]
[Luft et al. 2007] [Grabli et al. 2010]

37. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Specialized frameworks
• Jot (linework) – Kalnins et al. 2003
• aQtree (watercolor) – Luft et al. 2007
• Freestyle (linework) – Grabli et al. 2010
• Meander (linework) – Whited et al. (Disney)
Related Work
[Kalnins et al. 2003]
[Luft et al. 2007] [Grabli et al. 2010] [Disney 2013]

38. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Generalized NPR frameworks
Related Work

39. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Generalized NPR frameworks
• OPENNPAR – Halper et al. 2002, 2003
Related Work
[Halper et al. 2002, 2003]

40. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Generalized NPR frameworks
• OPENNPAR – Halper et al. 2002, 2003
• RenderBots – Schlechtweg et al. 2005
Related Work
[Halper et al. 2002, 2003] [Schlechtweg et al. 2005]

41. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Generalized NPR frameworks
• OPENNPAR – Halper et al. 2002, 2003
• RenderBots – Schlechtweg et al. 2005
• Example-based – Bénard et al. 2013, Fišer et al. 2016
Related Work
[Halper et al. 2002, 2003] [Schlechtweg et al. 2005] [Fišer et al. 2016]

42. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Closest to our work
Related Work

43. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Closest to our work
• 2D XML based framework – Semmo et al. 2016
• Default presets
• Global parameters
• Local adjustments
Related Work

44. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Closest to our work
• 2D XML based framework – Semmo et al. 2016
• Default presets
• Global parameters
• Local adjustments
Related Work
[Semmo et al. 2003]

45. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Limitations
Related Work

46. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Limitations
• Proprietary
Related Work

47. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Limitations
• Proprietary
• Standalone applications
Related Work

48. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Limitations
• Proprietary
• Standalone applications
• Narrow spectrum of control
Related Work

49. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Limitations
• Proprietary
• Standalone applications
• Narrow spectrum of control
• No cross-stylization
Related Work

50. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Practical answer, in the context of
interactive filter-based stylization of 3D
computer graphics
Related Work

51. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
MNPR: Expressive NPR Framework
“In the same way that scientists concocted new colors and artisans crafted new
tools for painters to enable their visions, we need to provide these to 3D artists.”

52. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Contents
• Levels of Control
• Cross-stylization
• Discussion and QA
MNPR: Expressive NPR Framework

53. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Levels of Control
Covering the interaction spectrum in 3D

54. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Interaction spectrum
Levels of Control
[Isenberg 2016]

55. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Why?
Interaction spectrum
Levels of Control
[Isenberg 2016]

56. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Why?
• Augments the artistic workflow
Interaction spectrum
Levels of Control
[Isenberg 2016]

57. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Why?
• Augments the artistic workflow
• Maximizes the potential
Interaction spectrum
Levels of Control
[Isenberg 2016]

58. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Why?
• Augments the artistic workflow
• Maximizes the potential
• Highlights intrinsic problems
Interaction spectrum
Levels of Control
[Isenberg 2016]

59. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Levels of Control

60. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Style presets Global control
Levels of Control

61. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Style presets Global control
Levels of Control

62. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Style presets
• Defines the stylization
Global control
Levels of Control

63. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Style presets
• Defines the stylization
• Save/load global control presets
Global control
Levels of Control

64. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Style presets
• Defines the stylization
• Save/load global control presets
Global control
Levels of Control
• Defines the style

65. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Style presets
• Defines the stylization
• Save/load global control presets
Global control
Levels of Control
• Defines the style
• Effect variables

66. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Levels of Control
3D model by Slava Zhuravlev

67. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Material presets Material control
Levels of Control

68. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Material presets Material control
Levels of Control

69. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Material presets
• Save/load material attributes
and procedural parameters
Material control
Levels of Control

70. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Material presets
• Save/load material attributes
and procedural parameters
• Modifies underlying shaders
Material control
Levels of Control

71. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Material presets
• Save/load material attributes
and procedural parameters
• Modifies underlying shaders
Material control
Levels of Control
• Defines the material attributes

72. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Material presets
• Save/load material attributes
and procedural parameters
• Modifies underlying shaders
Material control
Levels of Control
• Defines the material attributes
• Drives procedural effect
parameters

73. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
3D model by Slava Zhuravlev

74. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
3D model by Slava Zhuravlev

75. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Mapped control
Levels of Control

76. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Mapped control
Levels of Control

77. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
• Locally control effects
Mapped control
Levels of Control

78. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
• Locally control effects
• Painting effect parameters onto 3D objects
Mapped control
Levels of Control

79. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
• Locally control effects
• Painting effect parameters onto 3D objects
• Most versatile, but time consuming
Mapped control
Levels of Control

80. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
• Locally control effects
• Painting effect parameters onto 3D objects
• Most versatile, but time consuming
Mapped control
Levels of Control
Procedural pigment density
< 5 sec.
Mapped pigment density
> 40 sec.

81. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
3D model by Slava Zhuravlev

82. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
3D model by Slava Zhuravlev

83. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Proxy control
Levels of Control 3D model by Slava Zhuravlev

84. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
• Standalone “invisible” stylization objects within the scene
Proxy control
Levels of Control 3D model by Slava Zhuravlev

85. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
• Standalone “invisible” stylization objects within the scene
• Arbitrary representation: high and low level of control
Proxy control
Levels of Control 3D model by Slava Zhuravlev

86. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
• Standalone “invisible” stylization objects within the scene
• Arbitrary representation: high and low level of control
• Supports procedural and local effect parameters
Proxy control
Levels of Control 3D model by Slava Zhuravlev

87. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Live demo, levels of control
Real-time showcase

88. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
3D scene by one of our test users

89. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
3D scene by one of our test users

90. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
What is happening in the back-end?
Levels of Control

91. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
What is happening in the back-end?
Stylization maps!
Levels of Control

92. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Levels of Control
N M
P Mfx
3D model by Slava Zhuravlev

93. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
3D model by Slava Zhuravlev

94. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
3D model by Slava Zhuravlev

95. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Levels of Control

96. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Evaluating usefulness
Levels of Control

97. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Evaluating usefulness
Levels of Control
User study

98. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Evaluating usefulness
• 65 participants
Levels of Control
User study

99. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Evaluating usefulness
• 65 participants
• Watercolor style
Levels of Control
User study

100. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Evaluating usefulness
• 65 participants
• Watercolor style
• ~25 mins of tutorials
Levels of Control
User study

101. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Evaluating usefulness
• 65 participants
• Watercolor style
• ~25 mins of tutorials
• 2+ hours experimenting
Levels of Control
User study

102. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Evaluating usefulness
• 65 participants
• Watercolor style
• ~25 mins of tutorials
• 2+ hours experimenting
• Online questionnaire
Levels of Control
User study

103. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Evaluating usefulness
• 65 participants
• Watercolor style
• ~25 mins of tutorials
• 2+ hours experimenting
• Online questionnaire
• 20 responses
Levels of Control
User study

104. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Evaluating usefulness
• 65 participants
• Watercolor style
• ~25 mins of tutorials
• 2+ hours experimenting
• Online questionnaire
• 20 responses
no
experience
minimal
experience
limited
experience
experienced
highly
experienced
traditional
watercolor
NPR
solutions
Autodesk
Maya
0
5
1 0
1 5
20
25
30
35
Experience in CG
(in years)in:
1
2
3
4
5
Levels of Control
User study

105. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Evaluating each Level of Control
not useful
of little use
sometimes
useful
useful
highly
useful
Style presets
& global control
Material presets
& material control
Material effect
control
Mapped
control
Proxy
control
0
1 0
20
30
40
50
60
Test duration
(in hours)
1
2
3
4
5
Levels of Control

106. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Overall satisfaction
strongly
disagree
disagree
neutral
agree
strongly
agree
stylistic goal
achieved
range of control
beneficial
future use
of the system
1
2
3
4
5
Levels of Control

107. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Cross-stylization
Generalizing control semantics

108. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
NPR is not expressive by itself
Paintings by Dylan Scott Pierce

109. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Enabling cross-stylization
Cross-stylization 3D model by Slava Zhuravlev

110. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Enabling cross-stylization
Cross-stylization
• Stylization driven by effect parameters
3D model by Slava Zhuravlev

111. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Enabling cross-stylization
Cross-stylization
• Stylization driven by effect parameters
• All effect parameters stored in stylization maps
3D model by Slava Zhuravlev

112. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Enabling cross-stylization
Cross-stylization
• Stylization driven by effect parameters
• All effect parameters stored in stylization maps
Is there any correlation between effects in different styles?
3D model by Slava Zhuravlev

113. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Effect categories
Cross-stylization
• Pigment-based effects
• Substrate-based effects
• Edge-based effects
• Abstraction-based effects

114. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Effect categories
Cross-stylization
• Pigment-based effects
• Substrate-based effects
• Edge-based effects
• Abstraction-based effects
Why not correlate effects in these categories?
Each category contained in one stylization map

115. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Stylization control semantics
Cross-stylization
• Sufficiently generic
• Semantically meaningful
• Adhere to a defined control scheme

116. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Stylization control semantics
Cross-stylization
• Sufficiently generic
• Semantically meaningful
• Adhere to a defined control scheme

117. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Pigment-based effects
Cross-stylization

118. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Pigment-based effects
Cross-stylization
• Pigment variation
• Variation towards one or another color in compound pigments

119. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Pigment-based effects
Cross-stylization
• Pigment variation
• Variation towards one or another color in compound pigments
• Pigment application
• Placement of the pigments over the substrate

120. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Pigment-based effects
Cross-stylization
• Pigment variation
• Variation towards one or another color in compound pigments
• Pigment application
• Placement of the pigments over the substrate
• Pigment density
• Concentration of pigments

121. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Substrate-based effects
Cross-stylization

122. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Substrate-based effects
Cross-stylization
• Substrate distortion
• Distortion of the subject by the substrate

123. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Substrate-based effects
Cross-stylization
• Substrate distortion
• Distortion of the subject by the substrate
• U- and V-inclination
• U and V offset in patterns (generalized from substrate inclination)

124. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Edge-based effects
Cross-stylization

125. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Edge-based effects
Cross-stylization
• Edge intensity
• Strength/intensity/darkness of an edge

126. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Edge-based effects
Cross-stylization
• Edge intensity
• Strength/intensity/darkness of an edge
• Edge width
• Thickness of an edge

127. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Edge-based effects
Cross-stylization
• Edge intensity
• Strength/intensity/darkness of an edge
• Edge width
• Thickness of an edge
• Edge transition
• Transition between edges

128. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Abstraction-based effects
Cross-stylization

129. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Abstraction-based effects
Cross-stylization
• Detail
• Detail of subject

130. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Abstraction-based effects
Cross-stylization
• Detail
• Detail of subject
• Shape
• Abstraction/distortion of shapes

131. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Abstraction-based effects
Cross-stylization
• Detail
• Detail of subject
• Shape
• Abstraction/distortion of shapes
• Blending
• Blending of colors

132. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Cross-stylization 3D model by Julien Kaspar

133. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Cross-stylization
Viewport 2.0 Watercolor Oil paint Charcoal
3D model by Julien Kaspar

134. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Live demo, cross-stylization
Real-time showcase

135. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Cross-stylization 3D model by Stevie Brown

136. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Cross-stylization 3D model by Stevie Brown

137. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Cross-stylization 3D model by Stevie Brown

138. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Cross-stylization 3D model by Stevie Brown

139. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Cross-stylization incompatibilities
Conclusion
Oil paint
3D model by Black Spire Studio

140. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Cross-stylization incompatibilities
Conclusion
Oil paint Charcoal
3D model by Black Spire Studio

141. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Cross-stylization incompatibilities
Conclusion
Oil paint Charcoal Charcoal with material adjustment
3D model by Black Spire Studio

142. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Implementation
In a nutshell

143. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Implementation

144. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Creating a stylization pipeline
Implementation

145. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Creating a stylization pipeline
Implementation
• Define and create attributes for global effect parameters (C++)

146. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Creating a stylization pipeline
Implementation
• Define and create attributes for global effect parameters (C++)
• Outline the custom stylization pipeline (C++)

147. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Creating a stylization pipeline
Implementation
• Define and create attributes for global effect parameters (C++)
• Outline the custom stylization pipeline (C++)
• Define NoiseFX and PaintFX controls (Python)

148. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Creating a stylization pipeline
Implementation
• Define and create attributes for global effect parameters (C++)
• Outline the custom stylization pipeline (C++)
• Define NoiseFX and PaintFX controls (Python)
• Follow the control semantics and scheme

149. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Creating a stylization pipeline
Implementation
• Define and create attributes for global effect parameters (C++)
• Outline the custom stylization pipeline (C++)
• Define NoiseFX and PaintFX controls (Python)
• Follow the control semantics and scheme
Refer to the paper and the source code for more implementation details.

150. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Conclusion
It’s time…

151. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Limitations and Future Work
Conclusion

152. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Limitations and Future Work
• MNPR may not be production ready
Conclusion

153. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Limitations and Future Work
• MNPR may not be production ready
• Motion coherence of substrate-based effects
Conclusion

154. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Limitations and Future Work
• MNPR may not be production ready
• Motion coherence of substrate-based effects
• Maya limitations
Conclusion

155. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Limitations and Future Work
• MNPR may not be production ready
• Motion coherence of substrate-based effects
• Maya limitations
• Hardware limitations
Conclusion

156. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Limitations and Future Work
• MNPR may not be production ready
• Motion coherence of substrate-based effects
• Maya limitations
• Hardware limitations
• Art-directed tools can be further explored/improved (proxies)
Conclusion

157. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Limitations and Future Work
• MNPR may not be production ready
• Motion coherence of substrate-based effects
• Maya limitations
• Hardware limitations
• Art-directed tools can be further explored/improved (proxies)
• Stylization control semantics can be further refined
Conclusion

158. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Limitations and Future Work
• MNPR may not be production ready
• Motion coherence of substrate-based effects
• Maya limitations
• Hardware limitations
• Art-directed tools can be further explored/improved (proxies)
• Stylization control semantics can be further refined
• Potential cross-stylization incompatibilities
Conclusion

159. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Conclusion: MNPR
Conclusion

160. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Conclusion: MNPR
• Expressive Non-Photorealistic Rendering Framework
Conclusion

161. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Conclusion: MNPR
• Expressive Non-Photorealistic Rendering Framework
• Covering the interaction spectrum
Conclusion

162. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Conclusion: MNPR
• Expressive Non-Photorealistic Rendering Framework
• Covering the interaction spectrum
• Useful tools for artists at each level of control
Conclusion

163. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Conclusion: MNPR
• Expressive Non-Photorealistic Rendering Framework
• Covering the interaction spectrum
• Useful tools for artists at each level of control
• Stylization control semantics for predictable cross-stylization
with watercolor, oil paint and charcoal styles
Conclusion

164. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Conclusion: MNPR
• Expressive Non-Photorealistic Rendering Framework
• Covering the interaction spectrum
• Useful tools for artists at each level of control
• Stylization control semantics for predictable cross-stylization
with watercolor, oil paint and charcoal styles
• Using Autodesk Maya as a development framework
Conclusion

165. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
Conclusion: MNPR
• Expressive Non-Photorealistic Rendering Framework
• Covering the interaction spectrum
• Useful tools for artists at each level of control
• Stylization control semantics for predictable cross-stylization
with watercolor, oil paint and charcoal styles
• Using Autodesk Maya as a development framework
• Open-sourcing the framework to facilitate further
development and use by artists/engineers/researchers.
Conclusion

166. MNPR: A Framework for Real-Time Expressive Non-Photorealistic Rendering of 3D Computer Graphics
made by Brian Horgan
https://vimeo.com/285085957

167. http://mnpr.artineering.io
Get the source code now!