Download as PDF, PPTX
Uploaded byMindos Cheng
Open GL ES Android
The document discusses OpenGL ES and graphics rendering in Android. It explains the OpenGL family including OpenGL, OpenGL ES, and WebGL. It describes how graphics are rendered in Android using a PhoneWindow, DecorView, SurfaceView, and GLSurfaceView. It provides an example of setting up OpenGL ES 3.1 rendering in Android using GLSurfaceView and discusses key classes and concepts like the renderer, surface, and drawing commands.
Open GL ES Android
- 1. OpenGL ES 3.1 on Android non-OpenGL part
- 2.
- 3. OpenGL Family • OpenGL •A very common GPU accelerated Graphics Library for most desktop environment, such as in Windows, Mac, and Linux. • OpenGL ES • OpenGL for Embedded Systems, a refined subset of OpenGL for embedded environment, such as in iOS, Android, BlackBerry, bada, Linux, Windows, and Raspberry Pi, . • OpenGL ES 1.1 / 2.0 / 3.0 / 3.1 / 3.2 • Different in API and functionality. The newer the more powerful. • WebGL • OpenGL ES 2.0 in Browser • Vulkan • Newer, Cooler, and thiner version of OpenGL / ES.
- 4.
- 5. https://github.com/aosp-mirror/platform_frameworks_base/blob/master/core/java/com/android/internal/policy/PhoneWindow.java SurfaceView View sub class TextView ImageViewViewGroup (Standard OOP technique for tree structure) Activity has a PhoneWindow (Android-specific Window) DecorView (top-level view of the window) has a ViewGroup (window contents are placed) has a has * View View View Surface (raw buffer for display) has a SurfaceView GLSurfaceViewVideoView sub class bridged to OpenGL ES draw on ?
- 6. GLSurfaceView Handy andusual way. SurfaceView For experienced. TextureView Skip. SurfaceTexture Skip. Other way with OpenGL
- 7. GLSurfaceView / Renderer GLSurfaceViewGLSurfaceView.Renderer draw on has a / notify change Surface (raw buffer for display) has a
- 8.
- 9.
- 10.
- 11.
- 12.
- 15. OpenGL ES 3.1need API 21+
- 19. use OpenGL ES3.1 also compressed textures
- 20. _ Available in all OpenGLES 3.1 Devices "GL_COMPRESSED_RGB8_ETC2_texture"
- 21.
- 23. use OpenGL ES3.X Renderer base clase
- 24.
- 26. Run > Run'app'
- 27.
- 28. EGL 1.4 OpenGL ES3.1 because of using host GPU in emulator, ignore
- 29.
- 30.
- 31.
- 32. Texture https://www.pexels.com/photo/bark-nature-texture-trees-819672/ Blender Projection Paintingtutorial https://vimeo.com/5093588
- 33.
- 34. EGL 1.4 OpenGL ES1.1 OpenGL ES 2.0 OpenGL ES 3.0 OpenGL ES 3.1 Draw on SurfaceInteract with Android Window system Query GL capacities. Manage framebuffer / Surface creation API eglCreateContext() eglMakeCurrent() eglSwapBuffers() eglGetDisplay() eglCreateWindowSurface() eglCreatePbufferSurface() glFinish() glGenBuffers() glBindBuffer() glCreateShader(() glBindTexture() glTexImage2D() glClear() glDrawArrays() glDrawElements() No shader
- 35. texture unit framebuffer (for display) pbuffer (astexture) textures vertices / indexes / per vertex data (like colors) drawing commends GPU Simplified Diagram vertex shader build point / line / triangle rasterization fragment shader vertex shader fragment shader program fragment pixel shader special processor texture bitmap rasterization point/line/triangle to pixel framebuffer a memory block for display pbuffer like framebuffer but not for display
- 36. In Detail OpenGL ES3.0 Programming Guide
- 37. OpenGL ES 3.0Programming Guide Constants Texture access output for one vertex coordinates for points only input for one vertex vertex shader program runs here transform matrix,
- 38. OpenGL ES 3.0Programming Guide
- 39. OpenGL ES 3.0Programming Guide fragment shader program runs here input for one pixel output for one pixel Constants Texture access
- 40. Per fragment operations OpenGLES 3.0 Programming Guide if this area in framebuffer owned by OpenGL ES
- 41.
- 43.
- 44. JNI/NDK class AJava /Kotlin C function definition Java_com_example_blah_A_y() { ...... } namespace com.example.blah load C/C++ library x Activity external fun y(width: Int)method y implemented by extern "C" JNIEXPORT void JNICALL Java_com_example_blah_A_y( JNIEnv *env, jobject this, jint width) { ....... }
- 45.
- 46. glCreateProgram() attached into glCreateShader(GL_VERTEX_SHADER) glCreateShader(GL_FRAGMENT_SHADER) vertexshader object fragment shader object glShaderSource(vertex shader code) glCompileShader() glShaderSource(fragment shader code) glCompileShader() compiled shader object compiled shader object glLinkProgram() program object glValidateProgram() done linked program #version 300 es in vec2 p; in vec4 color; uniform mat2 matTransform; out vec4 vColor; void main() { vec2 p2 = matTransform * p; gl_Position = vec4(p2.x, p2.y, 0.0, 1.0); vColor = color; } #version 300 es precision mediump float; in vec4 vColor; out vec4 outColor; void main() { outColor = vColor; }
- 47. Linked Program Vertex Shader gl_Position FragmentShader primitive assembly / clipping / culling / rasterization / .... rasterized in a in b uniform u frambuffer, etc gl_PointSize out x out y gl_FragCoord gl_FrontFacing gl_PointCoord in x' in y' uniform q uniform sampler2D s gl_FragDepth out color_0 out color_1 out color_2 out color_3 out color_N out : Output colors are by orders, no special names here. gl_xxx variables are special names. in/out : per vertex data uniform : global data, shared by all vertices in : per fragment data uniform sampler2D : a texture map uniform : global data, shared by all fragments
- 48. Vertex Shader gl_Position in a inb uniform u gl_PointSize out x out y in/out : per vertex data uniform : global data, shared by all vertices ID_a = glGetAttribLocation(program, "a") glVertexAttribPointer(ID_a, .....,offsetof(..., adata)) glEnableVertexAttribArray(ID_a) ID_u = glGetUniformLocation(program, "u") glUniformMatrix2fv(ID_u, 1, false, udata); #version 300 es in vec2 a; in vec4 b; uniform mat2 u; out vec4 x; void main() { vec2 p2 = u * a; gl_Position = vec4(p2.x, p2.y, 0.0, 1.0); x = b; y = b; }
- 49. Minimal Example for GLES 3.1
- 50.
- 51.
- 52. Auto generated but removedby us function declaration class MainActivity native-lib.cpp function body (convention in color box) libname cpp files
- 54.
- 61.
- 65.
- 67.
- 69.
- 72.
- 74.
- 75. Instancing (Vulkan) PowerVR RogueGPUs running Gnome Horde demo (Vulkan prototype)
- 76. Reference - Android •PhoneWindow.java • SurfaceView.java • GLSurfaceView.java • Build an OpenGL ES environment • OpenGL ES • SurfaceView and GLSurfaceView • GLSurfaceView.Renderer • Graphics architecture • Android NDK Native APIs • Activity View Window • Activity Window View • GLSurfaceView
- 77. Reference - Graphics •Interactive Computer Graphics • OpenGL ES 3.0 Programming Guide: Edition 2
- 78.
- 79. FAQ • Q :So, where is the animation? • A : For mostly graphics subsystem, images display frame by frame. Since each frame differs slightly, we think it as animation.
- 80.
- 81. • Beginning inAndroid 4.0, hardware-accelerated Canvas is enabled by default. Consequently, a hardware GPU that supports OpenGL ES 2.0 is mandatory for Android 4.0 and later devices. • SurfaceFlinger is the only service that can modify the content of the display
- 82. • Bandwidth optimization • Framebuffer invalidation