JME3 and Shaders


Shaders Basics

Shaders are sets of instructions that are executed on the GPU. They are used to take advantage of hardware acceleration available on the GPU for rendering purposes.
This paper only covers Vertex and Fragment shaders because they are the only ones supported by JME3 for the moment. But be aware that there are some other types of shaders (geometry, tessellation,…).
There are multiple frequently used languages that you may encounter to code shaders but as JME3 is based on OpenGL, shaders in JME use GLSL and any example in this paper will be written in GLSL.

How Does it work?

To keep it Simple: The Vertex shader is executed once for each vertex in the view, then the Fragment shader (also called the Pixel shader) is executed once for each pixel on the screen.
The main purpose of the Vertex shader is to compute the screen coordinate of a vertex (where this vertex will be displayed on screen) while the main purpose of the Fragment shader is to compute the color of a pixel.
This is a very simplified graphic to describe the call stack:

The main program sends mesh data to the vertex shader (vertex position in object space, normals, tangents, etc..). The vertex shader computes the screen position of the vertex and sends it to the Fragment shader. The fragment shader computes the color, and the result is displayed on screen or in a texture.

Variables scope

There are different types of scope for variables in a shader :

There is a large panel of variable types to be used, for more information about it I recommend reading the GLSL specification here.

Spaces and Matrices

To understand the coming example you must know about the different spaces in 3D computer graphics, and the matrices used to translate coordinate from one space to another.

The engine passes the object space coordinates to the vertex shader. We need to compute its position in projection space. To do that we transform the object space position by the WorldViewProjectionMatrix which is a combination of the World, View, Projection matrices (who would have guessed?).

Simple example : rendering a solid color on an object

Here is the simplest application to shaders, rendering a solid color.
Vertex Shader :

//the global uniform World view projection matrix 
//(more on global uniforms below)
uniform mat4 g_WorldViewProjectionMatrix;
//The attribute inPosition is the Object space position of the vertex
attribute vec3 inPosition;
 
void main(){
    //Transformation of the object space coordinate to projection space
    //coordinates.
    //- gl_Position is the standard GLSL variable holding projection space
    //position. It must be filled in the vertex shader
    //- To convert position we multiply the worldViewProjectionMatrix by
    //by the position vector. 
    //The multiplication must be done in this order.
    gl_Position = g_WorldViewProjectionMatrix * vec4(inPosition, 1.0);
}

Fragment Shader :

void main(){
    //returning the color of the pixel (here solid blue)
    //- gl_FragColor is the standard GLSL variable that holds the pixel
    //color. It must be filled in the Fragment Shader.
    gl_FragColor = vec4(0.0, 0.0, 1.0, 1.0);
}

For example applying this shader to a sphere would render a solid blue sphere on screen.

How to use shaders in JME3

You probably heard that JME3 is “shader oriented”, but what does that mean?
Usually to use shaders you must create what is called a program. This program specify the vertex shader and the fragment shader to use.
JME3 encloses this in the material system. Every material in JME3 uses shaders.
For example let’s have a look at the SolidColor.j3md file :

MaterialDef Solid Color {
    //This is the complete list of user defined uniforms to be used in the
    //shaders
    MaterialParameters {
        Vector4 Color
    }
 
    Technique {
        //This is where the vertex and fragment shader files are
        //specified
        VertexShader GLSL100:   Common/MatDefs/Misc/SolidColor.vert
        FragmentShader GLSL100: Common/MatDefs/Misc/SolidColor.frag
 
        //This is where you specify which global uniform you need for your
        //shaders
        WorldParameters {
            WorldViewProjectionMatrix
        }
    }
    Technique FixedFunc {
    }
}

For more information on JME3 material system, i suggest you read this topic.

JME3 Global uniforms

JME3 can expose pre-computed global uniforms to your shaders. You must specify the one that are required for your shader in the WorldParameters section of the material definition file (.j3md).
Note that in the shader the uniform names will be prefixed by a “g_”.
In the example above, WorldViewProjectionMatrix is declared as uniform mat4 g_WorldViewProjectionMatrix in the shader.
The complete list of global uniforms that can be used in JME3 can be found here.

JME3 attributes

Those are different attributes that are always passed to your shader.
you can find a complete list of those attribute in the Type enum of the VertexBuffer here.
Note that in the shader the attributes names will be prefixed by a “in”.

User's uniforms

At some point when making your own shader you'll need to pass your own uniforms
Any uniform has to be declared in the material definition file in the "MaterialParameters" section.

    MaterialParameters {
        Vector4 Color
    }

This material parameter will be sent from the engine to the shader as follow

   material.setColor("Color", ColorRGBA(1.0f, 0.0f, 0.0f, 1.0f);//red color

Note that there is a setXXXX method for any type of uniform you want to pass.
To use this uniform in the shader, you need to declare it in the .frag or in the .vert files (depending on where you need it) as follow :

   uniform vec4 m_Color;

Note the "m_" prefix that specifies that the uniform is a material parameter.
This uniform will be populated at runtime with the value you sent.

Step by step

    // A cube 
    Box(Vector3f.ZERO, 1f,1f,1f);
    Geometry cube = new Geometry("box", box);
    Material mat = new Material(assetManager,"Path/To/My/materialDef.j3md");
    cube.setMaterial(mat);
    rootNode.attachChild(cube);


JME3 and OpenGL 3 & 4 compatibility

GLSL 1.0 to 1.2 comes with build in attributes and uniforms (ie, gl_Vertex, gl_ModelViewMatrix, etc…).
Those attributes are deprecated since GLSL 1.3 (opengl 3), hence JME3 global uniforms and attributes. Here is a list of deprecated attributes and their equivalent in JME3

GLSL 1.2 attributesJME3 equivalent
gl_VertexinPosition
gl_NormalinNormal
gl_ColorinColor
gl_MultiTexCoord0inTexCoord
gl_ModelViewMatrixg_WorldViewMatrix
gl_ProjectionMatrixg_ProjectionMatrix
gl_ModelViewProjectionMatrixg_WorldViewProjectionMatrix
gl_NormalMatrixg_NormalMatrix

Useful links

http://www.eng.utah.edu/~cs5610/lectures/GLSL-ATI-Intro.pdf

view online version